-- Logs begin at Tue 2022-10-18 23:51:18 UTC, end at Wed 2022-10-19 02:38:18 UTC. -- Oct 19 00:27:09.049825 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Oct 19 00:27:09.064473 n-d-master-1 devstack@keystone.service[86413]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 19 00:27:09.068224 n-d-master-1 devstack@keystone.service[86413]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 00:27:09 2022] *** Oct 19 00:27:09.068224 n-d-master-1 devstack@keystone.service[86413]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 00:27:09.068224 n-d-master-1 devstack@keystone.service[86413]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 00:27:09.068224 n-d-master-1 devstack@keystone.service[86413]: nodename: n-d-master-1 Oct 19 00:27:09.068224 n-d-master-1 devstack@keystone.service[86413]: machine: x86_64 Oct 19 00:27:09.068224 n-d-master-1 devstack@keystone.service[86413]: clock source: unix Oct 19 00:27:09.068224 n-d-master-1 devstack@keystone.service[86413]: pcre jit disabled Oct 19 00:27:09.068224 n-d-master-1 devstack@keystone.service[86413]: detected number of CPU cores: 4 Oct 19 00:27:09.068224 n-d-master-1 devstack@keystone.service[86413]: current working directory: / Oct 19 00:27:09.068841 n-d-master-1 devstack@keystone.service[86413]: detected binary path: /usr/bin/uwsgi-core Oct 19 00:27:09.068841 n-d-master-1 devstack@keystone.service[86413]: your processes number limit is 47680 Oct 19 00:27:09.068841 n-d-master-1 devstack@keystone.service[86413]: your memory page size is 4096 bytes Oct 19 00:27:09.068841 n-d-master-1 devstack@keystone.service[86413]: detected max file descriptor number: 2048 Oct 19 00:27:09.068841 n-d-master-1 devstack@keystone.service[86413]: lock engine: pthread robust mutexes Oct 19 00:27:09.068841 n-d-master-1 devstack@keystone.service[86413]: thunder lock: enabled Oct 19 00:27:09.068841 n-d-master-1 devstack@keystone.service[86413]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 19 00:27:09.069261 n-d-master-1 devstack@keystone.service[86413]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 00:27:09.136094 n-d-master-1 devstack@keystone.service[86413]: Python main interpreter initialized at 0x564bfb3149c0 Oct 19 00:27:09.136094 n-d-master-1 devstack@keystone.service[86413]: python threads support enabled Oct 19 00:27:09.136094 n-d-master-1 devstack@keystone.service[86413]: your server socket listen backlog is limited to 100 connections Oct 19 00:27:09.136094 n-d-master-1 devstack@keystone.service[86413]: your mercy for graceful operations on workers is 90 seconds Oct 19 00:27:09.136662 n-d-master-1 devstack@keystone.service[86413]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 00:27:09.136832 n-d-master-1 devstack@keystone.service[86413]: *** Operational MODE: preforking *** Oct 19 00:27:09.137289 n-d-master-1 devstack@keystone.service[86413]: *** uWSGI is running in multiple interpreter mode *** Oct 19 00:27:09.137289 n-d-master-1 devstack@keystone.service[86413]: spawned uWSGI master process (pid: 86413) Oct 19 00:27:09.137521 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Oct 19 00:27:09.138473 n-d-master-1 devstack@keystone.service[86413]: spawned uWSGI worker 1 (pid: 86424, cores: 1) Oct 19 00:27:09.139089 n-d-master-1 devstack@keystone.service[86413]: spawned uWSGI worker 2 (pid: 86425, cores: 1) Oct 19 00:27:09.139193 n-d-master-1 devstack@keystone.service[86413]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 00:27:13.526664 n-d-master-1 devstack@keystone.service[86424]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:27:13.526664 n-d-master-1 devstack@keystone.service[86424]: from cryptography.utils import int_from_bytes Oct 19 00:27:13.527752 n-d-master-1 devstack@keystone.service[86425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:27:13.527752 n-d-master-1 devstack@keystone.service[86425]: from cryptography.utils import int_from_bytes Oct 19 00:27:13.528402 n-d-master-1 devstack@keystone.service[86424]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:27:13.528402 n-d-master-1 devstack@keystone.service[86424]: from cryptography.utils import int_from_bytes Oct 19 00:27:13.528564 n-d-master-1 devstack@keystone.service[86425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:27:13.528564 n-d-master-1 devstack@keystone.service[86425]: from cryptography.utils import int_from_bytes Oct 19 00:27:13.580337 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:27:13.580593 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:27:13.580764 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] command line args: [] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:27:13.581001 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:27:13.581146 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ================================================================================ {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:27:13.581404 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] admin_token = **** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.581545 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:27:13.581675 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] config_dir = [] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.581797 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:27:13.581957 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.582101 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] command line args: [] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:27:13.582232 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] config_source = [] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.582524 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:27:13.583063 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] debug = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.583258 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ================================================================================ {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:27:13.583427 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.584942 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] admin_token = **** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.585092 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.585202 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] config_dir = [] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.585347 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.585459 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.585590 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.585692 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] config_source = [] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.585692 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] debug = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.585934 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.586091 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.586231 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] list_limit = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.586381 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.586493 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] log_config_append = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.586641 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.586757 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.586757 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] log_dir = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.587035 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.587388 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] log_file = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.587544 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.587656 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.587846 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] list_limit = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.588044 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.588163 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] log_config_append = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.588163 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.588438 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.588553 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] log_dir = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.588755 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.588870 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] log_file = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.589034 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.589154 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.589311 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.589415 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.589572 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.589677 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.589829 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.589940 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.590075 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.590232 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.590338 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.590482 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.590588 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.590734 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.590885 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.591003 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.591113 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.591213 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.591331 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.591430 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.591430 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.591802 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.591907 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.591907 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.592128 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.592243 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.592358 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] publish_errors = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.592358 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.592572 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.592733 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.592733 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.592964 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.593073 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.593179 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] publish_errors = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.593277 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.593387 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.593485 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] standard_threads = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.593665 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.593665 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.593915 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594020 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594125 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594125 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594312 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594409 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] use_journal = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594571 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] standard_threads = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594672 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] use_json = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594768 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594870 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] use_stderr = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.594870 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] use_syslog = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.595100 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.595100 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.595295 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.595448 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] use_journal = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.595552 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.595652 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] use_json = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.595652 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] use_stderr = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.595897 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.596009 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] use_syslog = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.596109 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.596193 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:27:13.596281 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.596384 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.596506 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.596606 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.596789 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.596901 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.597039 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.597145 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.597257 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.597357 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.597454 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.597557 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.597662 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.597771 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.597884 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.598281 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.598388 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.598486 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.598583 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.598680 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.598788 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.598897 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599003 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599102 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599205 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599303 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599418 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599527 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599650 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599776 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599884 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.599987 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.600211 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.600334 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.600456 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.600576 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.600755 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.600876 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.601017 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.601147 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.601268 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.601389 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.601509 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.601631 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.601769 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.601898 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.602021 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.602140 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.602260 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.602399 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.602521 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.602641 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.602763 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.602884 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.603001 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.603132 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.603252 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.603372 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.603495 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.603616 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.603736 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.603859 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.603970 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.604084 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.604084 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.604305 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.604439 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.604577 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.604577 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.604894 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.604894 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.605121 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.605252 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.605407 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.605543 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.605670 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.605800 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.605928 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.606050 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.606292 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.606433 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.606561 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.606682 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.606808 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.606936 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.607070 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.607180 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.607310 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.607434 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.607566 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.607755 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.607906 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.608037 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.608167 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.608290 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.608415 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.608537 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.608712 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.608841 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.608973 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.609108 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.609239 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.609361 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.609502 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.609625 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.609751 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.609876 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.609999 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.610174 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.610320 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.610452 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.610590 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.610717 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.610847 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.610988 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.611119 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.611249 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.611379 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.611508 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.611641 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.611790 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.611938 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.612081 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.612213 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.612349 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.612490 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.612745 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.612879 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.613000 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.613137 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.613250 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.613364 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.613475 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.614101 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.614226 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.614340 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.614461 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.614592 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.614714 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.614835 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.614976 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.615097 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.615224 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.615362 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.615482 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.615610 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.615751 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.615881 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.616008 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.616135 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.616263 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.616393 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.616536 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.616675 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.616787 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.616903 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.617017 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.617130 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.617260 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.617377 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.617490 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.617601 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.617709 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.617828 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.617953 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.618063 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.618172 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.618172 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.618434 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.618541 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.618658 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.618760 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.618857 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.618954 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.619052 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.619159 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.619380 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.619494 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.619597 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.619701 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.619803 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.619920 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.620042 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.620167 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.620294 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.620398 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.620511 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.620641 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.620752 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.620859 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.620977 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.621095 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.621199 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.621305 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.621411 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.621596 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.621718 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.621828 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.621932 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622033 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622125 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622230 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622322 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622434 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622547 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622639 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622728 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622830 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.622954 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.623061 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.623193 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] auth.external = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.623298 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.623408 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.623513 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] auth.external = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.623603 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.623711 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.623809 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.623918 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.624036 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] auth.password = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.624142 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.624247 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] auth.token = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.624368 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] auth.password = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.624477 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.624586 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] auth.token = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.624822 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.624933 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.625039 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.625170 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.625287 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.625402 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.625514 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.625620 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.625736 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.625860 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.625977 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.626092 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.626216 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] credential.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.626331 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.626471 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.626623 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] credential.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.626755 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.626881 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.627014 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.627148 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.627273 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.627418 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.627553 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.627685 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.627837 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.627945 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.628049 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.628181 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.628306 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.628413 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.628527 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.628675 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.628823 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.628967 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.629084 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.629412 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.629546 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.629682 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.629818 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.629962 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.630095 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.630227 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.630344 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.630459 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.630577 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] federation.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.630706 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.630833 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.630955 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] federation.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.631080 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.631221 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.631352 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.631498 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.631623 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.631744 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.631859 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.631971 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.632086 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.632212 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.632332 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.632444 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.632551 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.632690 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.632784 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.632900 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.633022 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.633144 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.633277 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.633397 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.633632 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.633741 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.633865 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.633998 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.634118 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.634236 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.634371 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.634494 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.634618 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.634750 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.634880 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.635008 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.635149 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.635149 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.635389 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.635520 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.635652 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.635782 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.635927 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.636060 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.636188 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.636311 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.636451 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.636581 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.636784 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.636920 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.637045 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.637174 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.637298 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.637430 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.637570 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.637703 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.637840 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.637959 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.638081 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.638213 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.638371 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.638502 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.638614 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.638722 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.638846 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.638977 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.639122 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.639255 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.639383 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.639509 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.639632 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.639761 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.639906 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.640038 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.640164 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.640295 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.640421 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.640421 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.640687 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.640813 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.640937 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.640937 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.641167 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.641294 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.641439 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.641568 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.641700 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.641830 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.641959 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.642088 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.642226 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.642364 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.642497 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.642630 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.642760 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.642886 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.643031 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.643165 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.643302 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.643433 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.643565 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.643696 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.643840 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.643974 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.644101 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.644224 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.644355 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.644484 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.644662 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.644954 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.645096 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.645229 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.645373 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.645503 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.645654 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.645792 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.645922 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.646050 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.646184 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.646309 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.646447 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.646586 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.646718 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.646849 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.646979 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.647114 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.647254 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.647380 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.647504 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.647504 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.647726 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.647726 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.647988 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.648134 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.648266 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.648400 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.648532 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.648808 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.648945 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.649077 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.649208 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.649339 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.649471 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.649471 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.649709 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.649844 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.649974 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.650106 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.650238 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.650382 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.650516 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.650649 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.650779 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.650905 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.651035 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.651181 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.651312 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.651441 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.651567 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.651779 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.651901 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.652041 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.652176 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.652310 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.652432 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.652563 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.652713 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.652859 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.652989 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.653120 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.653251 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.653380 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.653511 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.653650 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.653792 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.653921 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.654050 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.654182 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.654308 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.654452 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.654584 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.654715 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.654839 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.654971 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.655111 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.655254 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.655381 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.655505 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.655638 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.655769 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.655891 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.656024 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.656151 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.656282 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.656413 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.656545 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.656699 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.656851 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.656984 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.657119 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.657256 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] resource.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.657377 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.657506 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.657652 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] resource.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.657789 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.657920 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.658050 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.658183 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.658316 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.658461 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.658597 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.658729 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.658845 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.658960 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.659088 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.659341 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.659476 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.659605 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.659729 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.659854 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.659980 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] role.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.660120 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.660247 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] role.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.661044 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] role.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.661354 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.661490 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] role.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.661614 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.661758 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.661887 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.662016 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.662148 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.662277 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.662422 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.662553 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.662686 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.662817 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.662947 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.663070 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.663199 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.663325 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.663458 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.663588 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.663717 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.663848 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.663994 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.664128 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.664254 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.664376 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.664497 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.664615 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.664790 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.664916 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.664916 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.665128 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.665128 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.665343 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.665478 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.665610 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.665740 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.665871 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.666000 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.666131 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.666275 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.666411 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.666544 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.666677 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.666804 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.666925 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.667065 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.667207 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.667338 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.667470 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.667602 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.667741 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.667871 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.668002 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.668131 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.668259 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.668392 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.668531 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.668531 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.668798 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.668948 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.669064 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.669190 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.669340 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.669472 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.669599 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.669727 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.669860 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.669992 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.670130 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] token.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.670260 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] token.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.670377 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.670507 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.670640 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.670768 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.670906 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.671038 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.671169 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.671299 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.671425 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.671553 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.671699 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.671832 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.671964 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.672080 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.672203 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.672330 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.672471 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.672601 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.672753 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.672873 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.673003 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.673128 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.673279 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.673412 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.673544 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.673676 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.673804 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.673930 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.674081 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.674223 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.674383 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.674536 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.674664 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.674775 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.674892 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.connection = **** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.675004 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.connection = **** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.675106 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.675215 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.675320 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.675446 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.675566 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.675683 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.675805 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.675941 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.676222 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.676903 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.677034 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.677168 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.677297 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.677453 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.677584 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.677688 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.677793 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.677907 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.678023 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.678168 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.678302 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.678431 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.678554 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.678676 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.678797 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.678931 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679042 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679144 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679257 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679352 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679450 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679572 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679679 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679787 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679893 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.679995 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:27:13.680121 n-d-master-1 devstack@keystone.service[86425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:27:13.680261 n-d-master-1 devstack@keystone.service[86424]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86424) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:27:13.699835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.700140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.700306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.700452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.700806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.700938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.709869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.710108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.742695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.742941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.743017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.743080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.802662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.803082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.855273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.855689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.855908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:13.855908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.016715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.017060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.017280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.017470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.017663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.017856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.018045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.018274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.018474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.018662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.018662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.018662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.043195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.043437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.043563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.043684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.043809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.047552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.047730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.047856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.047979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.048103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.048223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.048347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.048470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.048591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.056677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.056906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.069725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.069967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.070111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.070256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.070386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.070548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.070688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.070806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.070941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.071074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.071221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.071362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.071493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86424) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.071618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:27:14.088965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.089309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.089492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:27:14.089685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:27:14.089859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.090031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.090201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:27:14.090378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:27:14.090536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.090692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.090848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.091008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.091173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.091316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.091485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.091649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.100935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.101197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.101374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.101522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.101660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.101801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.101938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.102094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.108835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.109046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.111749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.111958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.112140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.112289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.112432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.112574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.112808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.112951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.113108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.113242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.113377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.113512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.113647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.113784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.113916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.114051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.114181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.114181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.114446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.114565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.114673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.114777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.137194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.137569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.138680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.138964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.139116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.139344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.143662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.143952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.144106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.144246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.144384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.144601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.151289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.151579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.151823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.152122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.157566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.157875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.158132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.158280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.158448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.158590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.158723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.158858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.158973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.159093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.159256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.159386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.159524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.159648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.159769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.160046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.175736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.176545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.176839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.177141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.180606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.181044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.183898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.184173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.184373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.184651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.188441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.188925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.191540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.192922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.195638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.195938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.196154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.196322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.196467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.196610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.196783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.196923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.197078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.197211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.197403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.197785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.214289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.214594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.214844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.215103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.215239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.215532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.215803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.216103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.221919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.223034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.223984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.225111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.225509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.225780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.226638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.226915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.228406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.228716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.228997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.229285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.229600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.229746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.229896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.230161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.230454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.230846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.240879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.241170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.241452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.241727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.242100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.242259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.242416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.242556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.242698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.242836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.242963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.243302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.243598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.243899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.258676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.259741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.262110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.262765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.265244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.265693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.266690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.267206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.268133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.268425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.268688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.268864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.269017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.269372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.276132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.276350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.277643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.277834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.280512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.280740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.280938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.281130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.281280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.281420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.281560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.281708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.290067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.290277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.290420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.290555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.290711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.290836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.297532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=86424) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.297724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=86425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:27:14.297851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.298018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.298162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.298298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.298439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.298579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.298714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.298864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.299006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.299164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.299312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.299511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.299649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.299780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.299901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.300019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.300152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.300275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.300395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.300508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.300646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.300781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.300896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.301021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.301141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86424) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.301276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:27:14.335580 n-d-master-1 devstack@keystone.service[86424]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564bfb3149c0 pid: 86424 (default app) Oct 19 00:27:14.335846 n-d-master-1 devstack@keystone.service[86425]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564bfb3149c0 pid: 86425 (default app) Oct 19 00:27:14.339416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576a9f-8c3c-4bc7-a97e-517fcd08ce5f None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:14.339697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576a9f-8c3c-4bc7-a97e-517fcd08ce5f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:14.339968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576a9f-8c3c-4bc7-a97e-517fcd08ce5f None None] PATH_INFO: `/v3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:14.344188 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Oct 19 00:27:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:22.721362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166ef5-1961-463c-8f9a-3d899f9b793d None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:22.721980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166ef5-1961-463c-8f9a-3d899f9b793d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:22.721980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166ef5-1961-463c-8f9a-3d899f9b793d None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:22.727528 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:22.733818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:22.734525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:22.734525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:22.808918 n-d-master-1 devstack@keystone.service[86424]: INFO dbcounter [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] Registered counter for database keystone Oct 19 00:27:22.830976 n-d-master-1 devstack@keystone.service[86424]: DEBUG oslo_db.sqlalchemy.engines [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86424) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:27:22.838643 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writer thread running {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:27:23.038079 n-d-master-1 devstack@keystone.service[86424]: DEBUG passlib.handlers.bcrypt [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=86424) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 00:27:23.038388 n-d-master-1 devstack@keystone.service[86424]: DEBUG passlib.handlers.bcrypt [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86424) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 00:27:23.102703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:23.104519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:23.257327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:27:23.713411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16166ef5-1961-463c-8f9a-3d899f9b793d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:23.803506 n-d-master-1 devstack@keystone.service[86425]: INFO dbcounter [None req-16166ef5-1961-463c-8f9a-3d899f9b793d None None] Registered counter for database keystone Oct 19 00:27:23.826457 n-d-master-1 devstack@keystone.service[86425]: DEBUG oslo_db.sqlalchemy.engines [None req-16166ef5-1961-463c-8f9a-3d899f9b793d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:27:23.833082 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writer thread running {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:27:23.959145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16166ef5-1961-463c-8f9a-3d899f9b793d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:23.963955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b5e6d-3499-42a4-ac78-cb85eec24abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:23.964539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b5e6d-3499-42a4-ac78-cb85eec24abc admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:23.964853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b5e6d-3499-42a4-ac78-cb85eec24abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:23.965130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b5e6d-3499-42a4-ac78-cb85eec24abc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:23.974821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b5e6d-3499-42a4-ac78-cb85eec24abc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.027429 n-d-master-1 devstack@keystone.service[86425]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f58b5e6d-3499-42a4-ac78-cb85eec24abc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 00:27:24.027828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b5e6d-3499-42a4-ac78-cb85eec24abc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.039011 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Oct 19 00:27:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:27:24.045230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:24.064140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856bd26-1a77-44a4-8b17-d285b3b7c67a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:24.069201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd41a0-c263-4156-8d8d-d53e12a35660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:24.070355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd41a0-c263-4156-8d8d-d53e12a35660 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:24.070641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd41a0-c263-4156-8d8d-d53e12a35660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:24.070911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd41a0-c263-4156-8d8d-d53e12a35660 admin admin] PATH_INFO: `/v3/projects/ac0b2bfbc95a4438a5a4c53c6936c9e7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:24.072684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd41a0-c263-4156-8d8d-d53e12a35660 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac0b2bfbc95a4438a5a4c53c6936c9e7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:24.127087 n-d-master-1 devstack@keystone.service[86424]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8afd41a0-c263-4156-8d8d-d53e12a35660 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 00:27:24.127432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd41a0-c263-4156-8d8d-d53e12a35660 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:24.133087 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 19 00:27:24 2022] GET /identity/v3/projects/ac0b2bfbc95a4438a5a4c53c6936c9e7 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:26.369194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db947fc2-9615-45e3-af98-1e9d96f01980 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.369752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db947fc2-9615-45e3-af98-1e9d96f01980 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.369897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db947fc2-9615-45e3-af98-1e9d96f01980 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.375261 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:26.383363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d09af-b92f-4dbd-8bc2-1166fc114be2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.383909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d09af-b92f-4dbd-8bc2-1166fc114be2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.383909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d09af-b92f-4dbd-8bc2-1166fc114be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.406189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2c3d09af-b92f-4dbd-8bc2-1166fc114be2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:26.407737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2c3d09af-b92f-4dbd-8bc2-1166fc114be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:26.416447 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:27:26.684493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db947fc2-9615-45e3-af98-1e9d96f01980 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:26.698063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db947fc2-9615-45e3-af98-1e9d96f01980 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.702333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a326d-47a7-4670-86b7-169b56af9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.703003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a326d-47a7-4670-86b7-169b56af9827 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.703322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a326d-47a7-4670-86b7-169b56af9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.703636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a326d-47a7-4670-86b7-169b56af9827 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.712541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a326d-47a7-4670-86b7-169b56af9827 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.714359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a326d-47a7-4670-86b7-169b56af9827 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.723995 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Oct 19 00:27:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:27:26.729996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d09af-b92f-4dbd-8bc2-1166fc114be2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:26.739897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d09af-b92f-4dbd-8bc2-1166fc114be2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:26.744405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305e589-e119-4222-9b1e-66948a68c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:26.745090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e589-e119-4222-9b1e-66948a68c4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:26.745376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e589-e119-4222-9b1e-66948a68c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:26.745656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e589-e119-4222-9b1e-66948a68c4d3 admin admin] PATH_INFO: `/v3/users/0eea56facd274e79a70b3efac3a71b92` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:26.747001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305e589-e119-4222-9b1e-66948a68c4d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=0eea56facd274e79a70b3efac3a71b92)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:26.748885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305e589-e119-4222-9b1e-66948a68c4d3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:26.750476 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Oct 19 00:27:26 2022] GET /identity/v3/users/0eea56facd274e79a70b3efac3a71b92 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:29.110726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d57fa-769c-430a-b1d4-fcb687857d92 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.111340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d57fa-769c-430a-b1d4-fcb687857d92 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.111489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d57fa-769c-430a-b1d4-fcb687857d92 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.112995 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:29.119760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7f2d6-b84f-45c4-a212-31c53e1f084a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.120347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7f2d6-b84f-45c4-a212-31c53e1f084a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.120781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7f2d6-b84f-45c4-a212-31c53e1f084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.146679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f21762-0554-4f78-8b39-4668a226c8f7 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.147053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f21762-0554-4f78-8b39-4668a226c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.147339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f21762-0554-4f78-8b39-4668a226c8f7 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.148797 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:29.150744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f7e7f2d6-b84f-45c4-a212-31c53e1f084a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:29.152827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f7e7f2d6-b84f-45c4-a212-31c53e1f084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:29.154906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cf572-a333-4dea-839b-507af387c3d9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.155181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cf572-a333-4dea-839b-507af387c3d9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.155456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cf572-a333-4dea-839b-507af387c3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.201807 n-d-master-1 devstack@keystone.service[86425]: DEBUG passlib.handlers.bcrypt [None req-ae5cf572-a333-4dea-839b-507af387c3d9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=86425) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 00:27:29.202231 n-d-master-1 devstack@keystone.service[86425]: DEBUG passlib.handlers.bcrypt [None req-ae5cf572-a333-4dea-839b-507af387c3d9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86425) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 00:27:29.253665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ae5cf572-a333-4dea-839b-507af387c3d9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:29.255596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae5cf572-a333-4dea-839b-507af387c3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:29.284349 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:29.372011 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:29.562907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7f2d6-b84f-45c4-a212-31c53e1f084a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:29.610851 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:29.643683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cf572-a333-4dea-839b-507af387c3d9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:29.745638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7f2d6-b84f-45c4-a212-31c53e1f084a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:29.781484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cf572-a333-4dea-839b-507af387c3d9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:29.783718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bfe75-b8b7-4b10-a768-ce66c6f075d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:29.784460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bfe75-b8b7-4b10-a768-ce66c6f075d4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.784777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bfe75-b8b7-4b10-a768-ce66c6f075d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.785109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bfe75-b8b7-4b10-a768-ce66c6f075d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.785589 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:29.797603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bfe75-b8b7-4b10-a768-ce66c6f075d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-be2bfe75-b8b7-4b10-a768-ce66c6f075d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:29.807422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:29.809303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:27:29.810958 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:29.819931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bfe75-b8b7-4b10-a768-ce66c6f075d4 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:29.841207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:29.842201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:29.842611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:29.842955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:29.844120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:29.845785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:29.859942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.sql.core [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:27:29.859942 n-d-master-1 devstack@keystone.service[86425]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:27:29.859942 n-d-master-1 devstack@keystone.service[86425]: [parameters: {'id': '3514a4c3305a4080b3dcb1f37d292773', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:27:29.859942 n-d-master-1 devstack@keystone.service[86425]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86425) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:29.881453 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:27:29.883511 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application yield resource Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise self.value Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application session.commit() Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:27:29.885778 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:27:29.887750 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:27:29.889789 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result.read() Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:27:29.891738 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [parameters: {'id': '3514a4c3305a4080b3dcb1f37d292773', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:27:29.893616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:29.895819 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 8/15] 10.222.0.27 () {60 vars in 1137 bytes} [Wed Oct 19 00:27:29 2022] POST /identity/v3/domains => generated 190 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:29.897735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:29.940355 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:29.972348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bfe75-b8b7-4b10-a768-ce66c6f075d4 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.023226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6072e8-b4f6-419a-b0ee-1b48fab808e6 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.024539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aac5c-dfdd-4ac3-bf75-0ee347488ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.025237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aac5c-dfdd-4ac3-bf75-0ee347488ea4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.025564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aac5c-dfdd-4ac3-bf75-0ee347488ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.025954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aac5c-dfdd-4ac3-bf75-0ee347488ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.026761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4aac5c-dfdd-4ac3-bf75-0ee347488ea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:30.027166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4aac5c-dfdd-4ac3-bf75-0ee347488ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.029236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4aac5c-dfdd-4ac3-bf75-0ee347488ea4 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.044358 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 8/16] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:30.052871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aac5c-dfdd-4ac3-bf75-0ee347488ea4 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.073136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa26728-559d-45df-ba28-2953323696fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.074463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa26728-559d-45df-ba28-2953323696fe None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.074893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa26728-559d-45df-ba28-2953323696fe None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.075348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa26728-559d-45df-ba28-2953323696fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.109844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa26728-559d-45df-ba28-2953323696fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.112724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa26728-559d-45df-ba28-2953323696fe None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-2aa26728-559d-45df-ba28-2953323696fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:30.137642 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:30.138759 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:30.139660 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:30.139660 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:30.139660 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:30.140641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:30.150144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa26728-559d-45df-ba28-2953323696fe None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.175603 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:30.199801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aac5c-dfdd-4ac3-bf75-0ee347488ea4 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.256267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac2a07-d295-43bf-9aee-4d7b3478f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.257323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac2a07-d295-43bf-9aee-4d7b3478f213 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.257785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac2a07-d295-43bf-9aee-4d7b3478f213 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.258236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac2a07-d295-43bf-9aee-4d7b3478f213 None admin] PATH_INFO: `/v3/users/0eea56facd274e79a70b3efac3a71b92` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.260117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac2a07-d295-43bf-9aee-4d7b3478f213 None admin] RBAC: Authorizing `identity:get_user(user_id=0eea56facd274e79a70b3efac3a71b92)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.262457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac2a07-d295-43bf-9aee-4d7b3478f213 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.270647 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/users/0eea56facd274e79a70b3efac3a71b92 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:30.271856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac2a07-d295-43bf-9aee-4d7b3478f213 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.278168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa26728-559d-45df-ba28-2953323696fe None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.288547 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:30.322702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d0021-b132-4840-96cd-04407be94f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.323463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d0021-b132-4840-96cd-04407be94f08 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.323904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d0021-b132-4840-96cd-04407be94f08 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.324280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d0021-b132-4840-96cd-04407be94f08 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.325102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d0021-b132-4840-96cd-04407be94f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:30.325511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d0021-b132-4840-96cd-04407be94f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.327148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d0021-b132-4840-96cd-04407be94f08 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.348206 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:30.397541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac2a07-d295-43bf-9aee-4d7b3478f213 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.450247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e845010-8e1b-4c0f-984f-18c7d22be2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.450799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e845010-8e1b-4c0f-984f-18c7d22be2f4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.451080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e845010-8e1b-4c0f-984f-18c7d22be2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.451357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e845010-8e1b-4c0f-984f-18c7d22be2f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.452790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e845010-8e1b-4c0f-984f-18c7d22be2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.454346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e845010-8e1b-4c0f-984f-18c7d22be2f4 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.456065 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:30.464680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d0021-b132-4840-96cd-04407be94f08 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:30.580647 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:30.613147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d0021-b132-4840-96cd-04407be94f08 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:30.668470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dca90c-7adc-449e-a5ca-33449d0dc33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:30.669850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dca90c-7adc-449e-a5ca-33449d0dc33c None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:30.670538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dca90c-7adc-449e-a5ca-33449d0dc33c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:30.671051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dca90c-7adc-449e-a5ca-33449d0dc33c None admin] PATH_INFO: `/v3/domains/default/users/0eea56facd274e79a70b3efac3a71b92/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:30.674733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dca90c-7adc-449e-a5ca-33449d0dc33c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0eea56facd274e79a70b3efac3a71b92, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:30.677727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dca90c-7adc-449e-a5ca-33449d0dc33c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:30.895966 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 11/21] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Oct 19 00:27:30 2022] PUT /identity/v3/domains/default/users/0eea56facd274e79a70b3efac3a71b92/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:27:33.804925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b45ee-5a31-4038-91bb-866c196d9ba4 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.805435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b45ee-5a31-4038-91bb-866c196d9ba4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.805508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b45ee-5a31-4038-91bb-866c196d9ba4 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.807112 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:33.813160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a88e9-4575-4756-a007-6b0d177a4634 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.813636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a88e9-4575-4756-a007-6b0d177a4634 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.813717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a88e9-4575-4756-a007-6b0d177a4634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.839205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8e0a88e9-4575-4756-a007-6b0d177a4634 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:33.840791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8e0a88e9-4575-4756-a007-6b0d177a4634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:33.934588 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:33.944932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a74e8-0c65-448c-831a-e7f7f72e1829 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.945234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a74e8-0c65-448c-831a-e7f7f72e1829 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.945480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a74e8-0c65-448c-831a-e7f7f72e1829 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.946821 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:33.963488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cbc4d-ba13-4590-a9dd-c5f77fd925cc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:33.963810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cbc4d-ba13-4590-a9dd-c5f77fd925cc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:33.964039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cbc4d-ba13-4590-a9dd-c5f77fd925cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:33.993320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7c8cbc4d-ba13-4590-a9dd-c5f77fd925cc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:33.994581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c8cbc4d-ba13-4590-a9dd-c5f77fd925cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:34.092704 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:34.103960 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:34.435763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a74e8-0c65-448c-831a-e7f7f72e1829 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:34.556277 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:34.614959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a74e8-0c65-448c-831a-e7f7f72e1829 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:34.680387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e15d92-a6a5-4def-af37-9de97c4f167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:34.681509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e15d92-a6a5-4def-af37-9de97c4f167f None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:34.681947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e15d92-a6a5-4def-af37-9de97c4f167f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:34.682433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e15d92-a6a5-4def-af37-9de97c4f167f None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:34.683723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e15d92-a6a5-4def-af37-9de97c4f167f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:34.686185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e15d92-a6a5-4def-af37-9de97c4f167f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:34.773937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cbc4d-ba13-4590-a9dd-c5f77fd925cc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:34.877744 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 13/26] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 19 00:27:34 2022] POST /identity/v3/roles => generated 225 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:27:34.933798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cbc4d-ba13-4590-a9dd-c5f77fd925cc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:34.990782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0095b1-4f87-4617-b826-72f3861837e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:34.991835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0095b1-4f87-4617-b826-72f3861837e9 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:34.992419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0095b1-4f87-4617-b826-72f3861837e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:34.992958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0095b1-4f87-4617-b826-72f3861837e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.009693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0095b1-4f87-4617-b826-72f3861837e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:35.011426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0095b1-4f87-4617-b826-72f3861837e9 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-9d0095b1-4f87-4617-b826-72f3861837e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:27:35.033862 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:35.034794 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:27:35.035639 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:27:35.035639 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:27:35.035639 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:35.036233 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 14/27] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:35.046534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e15d92-a6a5-4def-af37-9de97c4f167f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:35.252872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e15d92-a6a5-4def-af37-9de97c4f167f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:35.299056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f303cdc-92b5-4e3f-a767-b8279884aafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:35.300079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f303cdc-92b5-4e3f-a767-b8279884aafc None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.300562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f303cdc-92b5-4e3f-a767-b8279884aafc None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.301094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f303cdc-92b5-4e3f-a767-b8279884aafc None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.302091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f303cdc-92b5-4e3f-a767-b8279884aafc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:35.302603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f303cdc-92b5-4e3f-a767-b8279884aafc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:35.304417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f303cdc-92b5-4e3f-a767-b8279884aafc None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:35.311819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbdeea-2f70-4558-ae66-d63bfccfea7a None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.312151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbdeea-2f70-4558-ae66-d63bfccfea7a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.312402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbdeea-2f70-4558-ae66-d63bfccfea7a None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.321629 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 15/28] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:35.328655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724526d-8835-4975-a3b1-81d3c5d70359 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.329252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724526d-8835-4975-a3b1-81d3c5d70359 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.329729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724526d-8835-4975-a3b1-81d3c5d70359 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.330538 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:35.331658 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 16/29] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:35.334041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff10f-8154-43e4-91b0-b1955d063b2f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.334575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff10f-8154-43e4-91b0-b1955d063b2f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.335051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff10f-8154-43e4-91b0-b1955d063b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.336680 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 14/30] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:35.344651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855aef-e3ce-40ae-84c0-c4103d6a6e08 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.344651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855aef-e3ce-40ae-84c0-c4103d6a6e08 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.344651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855aef-e3ce-40ae-84c0-c4103d6a6e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.370449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-921ff10f-8154-43e4-91b0-b1955d063b2f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:35.372665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-921ff10f-8154-43e4-91b0-b1955d063b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:35.380042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e0855aef-e3ce-40ae-84c0-c4103d6a6e08 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:35.382818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e0855aef-e3ce-40ae-84c0-c4103d6a6e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:35.458205 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:35.477298 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 15/31] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:35.478157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855aef-e3ce-40ae-84c0-c4103d6a6e08 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:35.486631 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 17/32] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:35.489150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f6608-586a-4b2d-b772-1d5bb84f8b44 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.489687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f6608-586a-4b2d-b772-1d5bb84f8b44 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.490162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f6608-586a-4b2d-b772-1d5bb84f8b44 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.492805 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 18/33] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:35.498648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105be965-6e92-4d33-af93-f40993f49eae None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.499572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105be965-6e92-4d33-af93-f40993f49eae None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.500048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105be965-6e92-4d33-af93-f40993f49eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.528754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-105be965-6e92-4d33-af93-f40993f49eae None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:35.528754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-105be965-6e92-4d33-af93-f40993f49eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:35.677770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855aef-e3ce-40ae-84c0-c4103d6a6e08 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:35.691846 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 19/34] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:35.720905 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:35.729834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05774dec-7f13-4f70-9b3b-164644ce5ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:35.730844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05774dec-7f13-4f70-9b3b-164644ce5ecf None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.731349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05774dec-7f13-4f70-9b3b-164644ce5ecf None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.731895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05774dec-7f13-4f70-9b3b-164644ce5ecf None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.732820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05774dec-7f13-4f70-9b3b-164644ce5ecf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:35.734596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05774dec-7f13-4f70-9b3b-164644ce5ecf None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:35.767250 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 16/35] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:35 2022] POST /identity/v3/projects => generated 301 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:35.838963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a8ce-a411-4916-b009-ff257647b358 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.839692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a8ce-a411-4916-b009-ff257647b358 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.840169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a8ce-a411-4916-b009-ff257647b358 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.841896 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 20/36] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:35.843331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05774dec-7f13-4f70-9b3b-164644ce5ecf None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:35.847633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed5d8c-fff4-445f-897b-a103325d2175 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:35.848254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed5d8c-fff4-445f-897b-a103325d2175 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:35.849176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed5d8c-fff4-445f-897b-a103325d2175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:35.876711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6aed5d8c-fff4-445f-897b-a103325d2175 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:35.878014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6aed5d8c-fff4-445f-897b-a103325d2175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:35.988479 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 21/37] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:35.990246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05774dec-7f13-4f70-9b3b-164644ce5ecf None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:35.991259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed5d8c-fff4-445f-897b-a103325d2175 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.059892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac189310-1921-4618-be78-cf4e896e50d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.060655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189310-1921-4618-be78-cf4e896e50d2 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.061071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189310-1921-4618-be78-cf4e896e50d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.061428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189310-1921-4618-be78-cf4e896e50d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.062199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac189310-1921-4618-be78-cf4e896e50d2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.063705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac189310-1921-4618-be78-cf4e896e50d2 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.063925 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.092082 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 17/38] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 19 00:27:35 2022] POST /identity/v3/roles => generated 219 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:36.093329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac189310-1921-4618-be78-cf4e896e50d2 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.156014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed5d8c-fff4-445f-897b-a103325d2175 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.188012 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.213425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42303dd6-26bf-498c-a5ef-b4aed43afd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.214481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42303dd6-26bf-498c-a5ef-b4aed43afd32 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.214992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42303dd6-26bf-498c-a5ef-b4aed43afd32 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.215464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42303dd6-26bf-498c-a5ef-b4aed43afd32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.217009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42303dd6-26bf-498c-a5ef-b4aed43afd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.218771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42303dd6-26bf-498c-a5ef-b4aed43afd32 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.220781 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 22/39] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:36.227530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42303dd6-26bf-498c-a5ef-b4aed43afd32 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.266758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac189310-1921-4618-be78-cf4e896e50d2 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.309176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e23fc-fe46-40d8-a02e-87588b6ba2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.309837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e23fc-fe46-40d8-a02e-87588b6ba2f8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.312202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e23fc-fe46-40d8-a02e-87588b6ba2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.312490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e23fc-fe46-40d8-a02e-87588b6ba2f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.328591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e23fc-fe46-40d8-a02e-87588b6ba2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-bf5e23fc-fe46-40d8-a02e-87588b6ba2f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:36.334739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:36.339914 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 18/40] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:36.341697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e23fc-fe46-40d8-a02e-87588b6ba2f8 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.360141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42303dd6-26bf-498c-a5ef-b4aed43afd32 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.374067 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.405291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27254b4a-1c28-4d97-bf64-0233fbc81eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.405934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27254b4a-1c28-4d97-bf64-0233fbc81eec None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.406212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27254b4a-1c28-4d97-bf64-0233fbc81eec None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.406489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27254b4a-1c28-4d97-bf64-0233fbc81eec None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.407165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27254b4a-1c28-4d97-bf64-0233fbc81eec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.408712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27254b4a-1c28-4d97-bf64-0233fbc81eec None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.445095 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 23/41] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:36 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:27:36.445986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27254b4a-1c28-4d97-bf64-0233fbc81eec None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.497213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e23fc-fe46-40d8-a02e-87588b6ba2f8 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.501775 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:36.560889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae3735-7450-417c-b57a-89f016ea791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.561905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae3735-7450-417c-b57a-89f016ea791f None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.562617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae3735-7450-417c-b57a-89f016ea791f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.563072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae3735-7450-417c-b57a-89f016ea791f None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.564506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae3735-7450-417c-b57a-89f016ea791f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.567231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae3735-7450-417c-b57a-89f016ea791f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.587382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 19/42] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 19 00:27:36 2022] POST /identity/v3/roles => generated 223 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:36.651403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27254b4a-1c28-4d97-bf64-0233fbc81eec None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.709309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f255c5-e092-4120-bffa-658e07fb5808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.710256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f255c5-e092-4120-bffa-658e07fb5808 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.710676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f255c5-e092-4120-bffa-658e07fb5808 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.711105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f255c5-e092-4120-bffa-658e07fb5808 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.712190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f255c5-e092-4120-bffa-658e07fb5808 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:36.712911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f255c5-e092-4120-bffa-658e07fb5808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.714910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f255c5-e092-4120-bffa-658e07fb5808 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.732100 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 24/43] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:36.738893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae3735-7450-417c-b57a-89f016ea791f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.893647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae3735-7450-417c-b57a-89f016ea791f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:36.935551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390559d-ec2f-4a7a-bb5c-3d829ab4b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:36.936111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390559d-ec2f-4a7a-bb5c-3d829ab4b077 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:36.936396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390559d-ec2f-4a7a-bb5c-3d829ab4b077 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:36.936708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390559d-ec2f-4a7a-bb5c-3d829ab4b077 None admin] PATH_INFO: `/v3/users/0eea56facd274e79a70b3efac3a71b92` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:36.937978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390559d-ec2f-4a7a-bb5c-3d829ab4b077 None admin] RBAC: Authorizing `identity:get_user(user_id=0eea56facd274e79a70b3efac3a71b92)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:36.939482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390559d-ec2f-4a7a-bb5c-3d829ab4b077 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:36.941763 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 20/44] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/users/0eea56facd274e79a70b3efac3a71b92 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:36.947520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f255c5-e092-4120-bffa-658e07fb5808 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:36.978093 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.081987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f255c5-e092-4120-bffa-658e07fb5808 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.125645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425c036-2eb9-457a-b845-417fed5c5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.126387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c036-2eb9-457a-b845-417fed5c5fdf None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.126733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c036-2eb9-457a-b845-417fed5c5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.127075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c036-2eb9-457a-b845-417fed5c5fdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.128370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425c036-2eb9-457a-b845-417fed5c5fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.130497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425c036-2eb9-457a-b845-417fed5c5fdf None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.132252 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 25/45] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:37.138428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390559d-ec2f-4a7a-bb5c-3d829ab4b077 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:37.175203 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:37.371570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390559d-ec2f-4a7a-bb5c-3d829ab4b077 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:37.410087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8c17e-cf15-4033-b40d-867a72f14771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:37.411095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c17e-cf15-4033-b40d-867a72f14771 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:37.411431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c17e-cf15-4033-b40d-867a72f14771 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:37.411641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c17e-cf15-4033-b40d-867a72f14771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:37.412392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c17e-cf15-4033-b40d-867a72f14771 None admin] RBAC: Adding query filter params (role.id=3c676188d9f646ba8509d3eef1e196de, scope.domain.id=default, user.id=0eea56facd274e79a70b3efac3a71b92) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:37.412735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c17e-cf15-4033-b40d-867a72f14771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:37.414278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c17e-cf15-4033-b40d-867a72f14771 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:37.423180 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 21/46] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Oct 19 00:27:37 2022] GET /identity/v3/role_assignments?user.id=0eea56facd274e79a70b3efac3a71b92&scope.domain.id=default&role.id=3c676188d9f646ba8509d3eef1e196de => generated 530 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:38.857244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04eb0a-8a46-40f5-8976-fa88abd64a8c None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:38.858043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04eb0a-8a46-40f5-8976-fa88abd64a8c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:38.858043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04eb0a-8a46-40f5-8976-fa88abd64a8c None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:38.859191 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 26/47] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:38.866083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e0f44-1c8b-4e3c-8d09-11ec0d8e19c1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:38.866651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e0f44-1c8b-4e3c-8d09-11ec0d8e19c1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:38.866747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e0f44-1c8b-4e3c-8d09-11ec0d8e19c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:38.886826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9b7e0f44-1c8b-4e3c-8d09-11ec0d8e19c1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:38.888126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9b7e0f44-1c8b-4e3c-8d09-11ec0d8e19c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:38.959631 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 22/48] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:39.236942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04eb0a-8a46-40f5-8976-fa88abd64a8c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:39.334257 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:39.345375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04eb0a-8a46-40f5-8976-fa88abd64a8c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:39.384139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c22d4-c9bf-4100-b5db-db3b6cefdea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:39.384812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c22d4-c9bf-4100-b5db-db3b6cefdea2 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:39.385096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c22d4-c9bf-4100-b5db-db3b6cefdea2 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:39.385367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c22d4-c9bf-4100-b5db-db3b6cefdea2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:39.386564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c22d4-c9bf-4100-b5db-db3b6cefdea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:39.388002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c22d4-c9bf-4100-b5db-db3b6cefdea2 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:39.389636 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 27/49] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:39.395891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e0f44-1c8b-4e3c-8d09-11ec0d8e19c1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:39.421925 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:39.501567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e0f44-1c8b-4e3c-8d09-11ec0d8e19c1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:39.538916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25f32d-ee19-4e8a-bcbd-8a1d66dcc5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:39.539543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25f32d-ee19-4e8a-bcbd-8a1d66dcc5bb None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:39.539829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25f32d-ee19-4e8a-bcbd-8a1d66dcc5bb None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:39.540109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25f32d-ee19-4e8a-bcbd-8a1d66dcc5bb None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:39.540821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25f32d-ee19-4e8a-bcbd-8a1d66dcc5bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:39.542316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25f32d-ee19-4e8a-bcbd-8a1d66dcc5bb None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:39.573692 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 23/50] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Oct 19 00:27:39 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:27:41.889457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4efb3f-8a08-4077-bd6b-23891d24577f None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.890010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4efb3f-8a08-4077-bd6b-23891d24577f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.890010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4efb3f-8a08-4077-bd6b-23891d24577f None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.891376 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 28/51] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:41.898652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab4973-7320-4a4b-a71f-1b124b919a78 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:41.899152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab4973-7320-4a4b-a71f-1b124b919a78 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:41.899650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab4973-7320-4a4b-a71f-1b124b919a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:41.929602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0cab4973-7320-4a4b-a71f-1b124b919a78 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:41.931691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0cab4973-7320-4a4b-a71f-1b124b919a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:42.049895 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 24/52] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:42.320666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4efb3f-8a08-4077-bd6b-23891d24577f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:42.547022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4efb3f-8a08-4077-bd6b-23891d24577f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:42.593697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573b72b-05fd-4e41-a60f-452abc4c860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:42.594365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573b72b-05fd-4e41-a60f-452abc4c860a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:42.594648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573b72b-05fd-4e41-a60f-452abc4c860a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:42.594923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573b72b-05fd-4e41-a60f-452abc4c860a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:42.596157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573b72b-05fd-4e41-a60f-452abc4c860a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:42.608279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573b72b-05fd-4e41-a60f-452abc4c860a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:42.610169 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 29/53] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:42.616519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab4973-7320-4a4b-a71f-1b124b919a78 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:42.625386 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:42.741578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab4973-7320-4a4b-a71f-1b124b919a78 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:42.781706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55b693-e25e-456f-b071-6ae6d48bff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:42.782379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b693-e25e-456f-b071-6ae6d48bff86 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:42.782687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b693-e25e-456f-b071-6ae6d48bff86 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:42.782991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b693-e25e-456f-b071-6ae6d48bff86 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:42.783742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55b693-e25e-456f-b071-6ae6d48bff86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:42.786261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55b693-e25e-456f-b071-6ae6d48bff86 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:42.816303 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 25/54] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:27:42 2022] POST /identity/v3/users => generated 275 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:46.960739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be5be9-ec85-4c3e-9de8-cbe7d542c4a4 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:46.961298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be5be9-ec85-4c3e-9de8-cbe7d542c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:46.961589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be5be9-ec85-4c3e-9de8-cbe7d542c4a4 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:46.964089 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 30/55] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:46.974158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f79c-8cb8-4e74-9d0f-6d40a09b6127 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:46.974674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f79c-8cb8-4e74-9d0f-6d40a09b6127 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:46.974777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f79c-8cb8-4e74-9d0f-6d40a09b6127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:46.996908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-db23f79c-8cb8-4e74-9d0f-6d40a09b6127 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:46.998185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-db23f79c-8cb8-4e74-9d0f-6d40a09b6127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:47.099010 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:47.111464 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 26/56] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:47.423498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d95130-16d5-401b-a09e-48f60f2896d5 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.424271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d95130-16d5-401b-a09e-48f60f2896d5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.424819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d95130-16d5-401b-a09e-48f60f2896d5 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.426538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 31/57] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:47.432658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d577-9a25-43f6-888b-978b81245170 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.433320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d577-9a25-43f6-888b-978b81245170 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.433813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d577-9a25-43f6-888b-978b81245170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.465780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-45d6d577-9a25-43f6-888b-978b81245170 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:47.467418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-45d6d577-9a25-43f6-888b-978b81245170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:47.568409 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 27/58] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:47.709548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d95130-16d5-401b-a09e-48f60f2896d5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:47.745764 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:47.826174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b89f-8e09-4ca5-90be-413340f7907a None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.826534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b89f-8e09-4ca5-90be-413340f7907a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.826742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b89f-8e09-4ca5-90be-413340f7907a None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.828410 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 28/59] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:47.845923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f5093-889a-44ca-91f1-9852bddfef3e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.846233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f5093-889a-44ca-91f1-9852bddfef3e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.846478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f5093-889a-44ca-91f1-9852bddfef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.874541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d95130-16d5-401b-a09e-48f60f2896d5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:47.877133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-861f5093-889a-44ca-91f1-9852bddfef3e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:47.879336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-861f5093-889a-44ca-91f1-9852bddfef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:47.968540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e59835-f0ab-4fb8-b1d2-af63a77d4536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:47.970607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59835-f0ab-4fb8-b1d2-af63a77d4536 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:47.971275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59835-f0ab-4fb8-b1d2-af63a77d4536 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:47.972189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59835-f0ab-4fb8-b1d2-af63a77d4536 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:47.995735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e59835-f0ab-4fb8-b1d2-af63a77d4536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-a9e59835-f0ab-4fb8-b1d2-af63a77d4536 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:48.009833 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:48.011800 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:27:48.013622 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:48.015325 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 29/60] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:48.018680 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 32/61] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:27:48.024704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f5093-889a-44ca-91f1-9852bddfef3e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.059622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c5ac6-56ed-45d0-9747-b48390863426 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.060426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c5ac6-56ed-45d0-9747-b48390863426 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.061116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c5ac6-56ed-45d0-9747-b48390863426 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.064035 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 33/62] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:48.079919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85504a26-7b3b-4014-b14b-3ee9e527b717 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.080701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85504a26-7b3b-4014-b14b-3ee9e527b717 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.081337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85504a26-7b3b-4014-b14b-3ee9e527b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.119324 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.131673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-85504a26-7b3b-4014-b14b-3ee9e527b717 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:48.133043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85504a26-7b3b-4014-b14b-3ee9e527b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:48.222710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f5093-889a-44ca-91f1-9852bddfef3e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.243014 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 34/63] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:48.243839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85504a26-7b3b-4014-b14b-3ee9e527b717 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.285374 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.287982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61768a5c-7d55-45e9-b8fb-aab1baa87d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.289504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768a5c-7d55-45e9-b8fb-aab1baa87d7b None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.290300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768a5c-7d55-45e9-b8fb-aab1baa87d7b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.291061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768a5c-7d55-45e9-b8fb-aab1baa87d7b None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.292606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61768a5c-7d55-45e9-b8fb-aab1baa87d7b None admin] RBAC: Adding query filter params (name=member) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:48.293538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61768a5c-7d55-45e9-b8fb-aab1baa87d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.296330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61768a5c-7d55-45e9-b8fb-aab1baa87d7b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.315646 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 30/64] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:48.334650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61768a5c-7d55-45e9-b8fb-aab1baa87d7b None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.381528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85504a26-7b3b-4014-b14b-3ee9e527b717 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.424393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69932a-c026-419b-9a7e-3c27bdfd1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.425099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69932a-c026-419b-9a7e-3c27bdfd1a93 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.426334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69932a-c026-419b-9a7e-3c27bdfd1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.426575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69932a-c026-419b-9a7e-3c27bdfd1a93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.449266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69932a-c026-419b-9a7e-3c27bdfd1a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-9a69932a-c026-419b-9a7e-3c27bdfd1a93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:48.458879 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:48.461226 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 35/65] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:48.470477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69932a-c026-419b-9a7e-3c27bdfd1a93 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.548326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61768a5c-7d55-45e9-b8fb-aab1baa87d7b None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.571847 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.588473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb70d98-9fde-4be0-a2df-ed0d89e316b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.589186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb70d98-9fde-4be0-a2df-ed0d89e316b9 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.589551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb70d98-9fde-4be0-a2df-ed0d89e316b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.589817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb70d98-9fde-4be0-a2df-ed0d89e316b9 None admin] PATH_INFO: `/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.606529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb70d98-9fde-4be0-a2df-ed0d89e316b9 None admin] RBAC: Authorizing `identity:get_user(user_id=c975a7f72c0c44ca9cc57c6e90d5b083)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.608020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb70d98-9fde-4be0-a2df-ed0d89e316b9 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.610056 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 31/66] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:48.610589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb70d98-9fde-4be0-a2df-ed0d89e316b9 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.638266 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.665435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69932a-c026-419b-9a7e-3c27bdfd1a93 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.724052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe91ef-c1c7-40c1-aa54-ebf5b730b514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.725099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe91ef-c1c7-40c1-aa54-ebf5b730b514 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.725511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe91ef-c1c7-40c1-aa54-ebf5b730b514 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.725972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe91ef-c1c7-40c1-aa54-ebf5b730b514 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.744540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe91ef-c1c7-40c1-aa54-ebf5b730b514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-f1fe91ef-c1c7-40c1-aa54-ebf5b730b514 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:48.753302 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:48.755821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:48.757340 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 36/67] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:48.758563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe91ef-c1c7-40c1-aa54-ebf5b730b514 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.802278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb70d98-9fde-4be0-a2df-ed0d89e316b9 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.861413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9db1a-47e9-409f-a92b-39fb1ee26707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.862062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9db1a-47e9-409f-a92b-39fb1ee26707 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.862342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9db1a-47e9-409f-a92b-39fb1ee26707 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.862613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9db1a-47e9-409f-a92b-39fb1ee26707 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.864536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9db1a-47e9-409f-a92b-39fb1ee26707 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:48.865808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9db1a-47e9-409f-a92b-39fb1ee26707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.867276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9db1a-47e9-409f-a92b-39fb1ee26707 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.876041 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 32/68] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:48.876961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9db1a-47e9-409f-a92b-39fb1ee26707 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.901344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe91ef-c1c7-40c1-aa54-ebf5b730b514 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:48.938625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae423440-3382-4db6-b198-5f04def35633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:48.939271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae423440-3382-4db6-b198-5f04def35633 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:48.939558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae423440-3382-4db6-b198-5f04def35633 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:48.939841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae423440-3382-4db6-b198-5f04def35633 None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:48.941128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae423440-3382-4db6-b198-5f04def35633 None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:48.941996 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:48.942800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae423440-3382-4db6-b198-5f04def35633 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:48.944748 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 37/69] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:48.945580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae423440-3382-4db6-b198-5f04def35633 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:48.954701 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:49.047290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9db1a-47e9-409f-a92b-39fb1ee26707 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:49.071089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae423440-3382-4db6-b198-5f04def35633 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:49.107621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8c87b-a6ac-453b-a9db-572927bd1232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:49.108283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8c87b-a6ac-453b-a9db-572927bd1232 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.108570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8c87b-a6ac-453b-a9db-572927bd1232 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.108875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8c87b-a6ac-453b-a9db-572927bd1232 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.117144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7670fff-42ac-428d-8e6d-1e4f0648fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:49.117775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7670fff-42ac-428d-8e6d-1e4f0648fe55 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.118052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7670fff-42ac-428d-8e6d-1e4f0648fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.118332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7670fff-42ac-428d-8e6d-1e4f0648fe55 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.119010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7670fff-42ac-428d-8e6d-1e4f0648fe55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:49.119317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7670fff-42ac-428d-8e6d-1e4f0648fe55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:49.120753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7670fff-42ac-428d-8e6d-1e4f0648fe55 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:49.121354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8c87b-a6ac-453b-a9db-572927bd1232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-b8e8c87b-a6ac-453b-a9db-572927bd1232 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:49.126845 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:49.127776 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:27:49.128578 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 33/70] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:49.130109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1168-3915-4f54-9e66-888af2fe72d9 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.130109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1168-3915-4f54-9e66-888af2fe72d9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.130234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1168-3915-4f54-9e66-888af2fe72d9 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.132660 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 34/71] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:49.132660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db1168-3915-4f54-9e66-888af2fe72d9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:49.135580 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 38/72] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:49.135580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7670fff-42ac-428d-8e6d-1e4f0648fe55 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:49.226423 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:49.275056 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:49.279901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7670fff-42ac-428d-8e6d-1e4f0648fe55 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:49.285516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db1168-3915-4f54-9e66-888af2fe72d9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:49.319248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6f0c1-0e5b-4599-a94a-a628c0e6eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:49.319942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f0c1-0e5b-4599-a94a-a628c0e6eb4b None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.320224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f0c1-0e5b-4599-a94a-a628c0e6eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.320502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f0c1-0e5b-4599-a94a-a628c0e6eb4b None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/users/c975a7f72c0c44ca9cc57c6e90d5b083/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.322641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6f0c1-0e5b-4599-a94a-a628c0e6eb4b None admin] RBAC: Authorizing `identity:create_grant(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd, user_id=c975a7f72c0c44ca9cc57c6e90d5b083, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:49.324067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6f0c1-0e5b-4599-a94a-a628c0e6eb4b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:49.324702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794ba1e-4bd2-4a15-862e-2e06e021228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:49.325362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794ba1e-4bd2-4a15-862e-2e06e021228f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.325646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794ba1e-4bd2-4a15-862e-2e06e021228f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.325922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794ba1e-4bd2-4a15-862e-2e06e021228f None admin] PATH_INFO: `/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.327146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794ba1e-4bd2-4a15-862e-2e06e021228f None admin] RBAC: Authorizing `identity:get_user(user_id=c975a7f72c0c44ca9cc57c6e90d5b083)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:49.328697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794ba1e-4bd2-4a15-862e-2e06e021228f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:49.330914 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 35/73] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:49 2022] GET /identity/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:49.332944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520cae8-4f84-47d2-ab3d-f97f5ef2d30f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.333240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520cae8-4f84-47d2-ab3d-f97f5ef2d30f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.333620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520cae8-4f84-47d2-ab3d-f97f5ef2d30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.341078 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 39/74] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:49 2022] PUT /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/users/c975a7f72c0c44ca9cc57c6e90d5b083/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:49.341961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6f0c1-0e5b-4599-a94a-a628c0e6eb4b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:49.369334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1520cae8-4f84-47d2-ab3d-f97f5ef2d30f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:49.371667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1520cae8-4f84-47d2-ab3d-f97f5ef2d30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:49.467911 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 36/75] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:49.469201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520cae8-4f84-47d2-ab3d-f97f5ef2d30f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:49.514886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6f0c1-0e5b-4599-a94a-a628c0e6eb4b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:49.558451 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:49.577446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7018-74f8-4233-950b-78b7a3943212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:49.577992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7018-74f8-4233-950b-78b7a3943212 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.578438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7018-74f8-4233-950b-78b7a3943212 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.578828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7018-74f8-4233-950b-78b7a3943212 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.579666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7018-74f8-4233-950b-78b7a3943212 None admin] RBAC: Adding query filter params (name=member) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:49.579991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7018-74f8-4233-950b-78b7a3943212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:49.581791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7018-74f8-4233-950b-78b7a3943212 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:49.597461 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 40/76] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:27:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:49.598592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7018-74f8-4233-950b-78b7a3943212 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:49.635125 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:49.651419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520cae8-4f84-47d2-ab3d-f97f5ef2d30f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:49.715256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1a1f7-5182-4588-bced-3dd5c7cc9a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:49.716561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a1f7-5182-4588-bced-3dd5c7cc9a7e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.717124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a1f7-5182-4588-bced-3dd5c7cc9a7e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.717705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a1f7-5182-4588-bced-3dd5c7cc9a7e None admin] PATH_INFO: `/v3/users/0eea56facd274e79a70b3efac3a71b92` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.720103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1a1f7-5182-4588-bced-3dd5c7cc9a7e None admin] RBAC: Authorizing `identity:get_user(user_id=0eea56facd274e79a70b3efac3a71b92)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:49.723419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1a1f7-5182-4588-bced-3dd5c7cc9a7e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:49.726812 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 37/77] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:49 2022] GET /identity/v3/users/0eea56facd274e79a70b3efac3a71b92 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:49.728289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1a1f7-5182-4588-bced-3dd5c7cc9a7e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:49.742972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7018-74f8-4233-950b-78b7a3943212 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:49.790882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc8aea-88d2-445d-91c4-dde15c5cf1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:49.791655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc8aea-88d2-445d-91c4-dde15c5cf1da None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.792151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc8aea-88d2-445d-91c4-dde15c5cf1da None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.792688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc8aea-88d2-445d-91c4-dde15c5cf1da None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.794817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc8aea-88d2-445d-91c4-dde15c5cf1da None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:49.797645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc8aea-88d2-445d-91c4-dde15c5cf1da None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:49.806112 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 41/78] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:27:49 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:49.806112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc8aea-88d2-445d-91c4-dde15c5cf1da None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:49.875168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1a1f7-5182-4588-bced-3dd5c7cc9a7e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:49.913321 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:49.919277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a24e7-cf84-4ac0-b6f1-bb25a9cfe073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:49.920371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a24e7-cf84-4ac0-b6f1-bb25a9cfe073 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:49.922392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a24e7-cf84-4ac0-b6f1-bb25a9cfe073 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:49.922392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a24e7-cf84-4ac0-b6f1-bb25a9cfe073 None admin] PATH_INFO: `/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:49.923592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a24e7-cf84-4ac0-b6f1-bb25a9cfe073 None admin] RBAC: Authorizing `identity:get_user(user_id=c975a7f72c0c44ca9cc57c6e90d5b083)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:49.926537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a24e7-cf84-4ac0-b6f1-bb25a9cfe073 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:49.929658 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 38/79] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:49 2022] GET /identity/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:49.937734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a24e7-cf84-4ac0-b6f1-bb25a9cfe073 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:49.981718 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:50.000456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc8aea-88d2-445d-91c4-dde15c5cf1da None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.047114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d1ad6-5f54-4f95-8bc2-6b87ebc57b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.048203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d1ad6-5f54-4f95-8bc2-6b87ebc57b49 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.049027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d1ad6-5f54-4f95-8bc2-6b87ebc57b49 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.049747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d1ad6-5f54-4f95-8bc2-6b87ebc57b49 None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.051965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d1ad6-5f54-4f95-8bc2-6b87ebc57b49 None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.055630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d1ad6-5f54-4f95-8bc2-6b87ebc57b49 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.067474 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 42/80] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:27:49 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:50.067474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d1ad6-5f54-4f95-8bc2-6b87ebc57b49 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.118138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a24e7-cf84-4ac0-b6f1-bb25a9cfe073 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.175175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126c50b-00ba-45bf-8742-f76fe0be274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.176764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126c50b-00ba-45bf-8742-f76fe0be274b None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.177174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126c50b-00ba-45bf-8742-f76fe0be274b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.177577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126c50b-00ba-45bf-8742-f76fe0be274b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.179122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126c50b-00ba-45bf-8742-f76fe0be274b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.181179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126c50b-00ba-45bf-8742-f76fe0be274b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.188569 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 39/81] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:50.188569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126c50b-00ba-45bf-8742-f76fe0be274b None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.257370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d1ad6-5f54-4f95-8bc2-6b87ebc57b49 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.299317 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:50.316494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864c222-0b0f-47f9-8bb0-7f60b7789620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.317772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864c222-0b0f-47f9-8bb0-7f60b7789620 None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.318060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864c222-0b0f-47f9-8bb0-7f60b7789620 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.318386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864c222-0b0f-47f9-8bb0-7f60b7789620 None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/users/c975a7f72c0c44ca9cc57c6e90d5b083/roles/36ffa4795fa248139676253d88d7e507` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.321291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864c222-0b0f-47f9-8bb0-7f60b7789620 None admin] RBAC: Authorizing `identity:create_grant(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd, user_id=c975a7f72c0c44ca9cc57c6e90d5b083, role_id=36ffa4795fa248139676253d88d7e507)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.323440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864c222-0b0f-47f9-8bb0-7f60b7789620 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.342591 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:50.356664 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 43/82] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:50 2022] PUT /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/users/c975a7f72c0c44ca9cc57c6e90d5b083/roles/36ffa4795fa248139676253d88d7e507 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:50.356884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126c50b-00ba-45bf-8742-f76fe0be274b None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.357012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864c222-0b0f-47f9-8bb0-7f60b7789620 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.410121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406a0a7-f90a-41b9-b406-ca83611873a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.411430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406a0a7-f90a-41b9-b406-ca83611873a2 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.412197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406a0a7-f90a-41b9-b406-ca83611873a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.412703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406a0a7-f90a-41b9-b406-ca83611873a2 None admin] PATH_INFO: `/v3/projects/364b002045a94340ad23e100b4eb5351` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.415042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406a0a7-f90a-41b9-b406-ca83611873a2 None admin] RBAC: Authorizing `identity:get_project(project_id=364b002045a94340ad23e100b4eb5351)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.418512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406a0a7-f90a-41b9-b406-ca83611873a2 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.421959 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 40/83] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:27:50 2022] GET /identity/v3/projects/364b002045a94340ad23e100b4eb5351 => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:50.423534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406a0a7-f90a-41b9-b406-ca83611873a2 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.520061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864c222-0b0f-47f9-8bb0-7f60b7789620 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.564490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55083de4-6f60-4fe9-831c-30291a809425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.565453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55083de4-6f60-4fe9-831c-30291a809425 None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.565922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55083de4-6f60-4fe9-831c-30291a809425 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.566361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55083de4-6f60-4fe9-831c-30291a809425 None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/users/0eea56facd274e79a70b3efac3a71b92/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.568714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55083de4-6f60-4fe9-831c-30291a809425 None admin] RBAC: Authorizing `identity:create_grant(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd, user_id=0eea56facd274e79a70b3efac3a71b92, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.570355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55083de4-6f60-4fe9-831c-30291a809425 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.574861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406a0a7-f90a-41b9-b406-ca83611873a2 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.600213 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 44/84] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:50 2022] PUT /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/users/0eea56facd274e79a70b3efac3a71b92/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:50.602162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55083de4-6f60-4fe9-831c-30291a809425 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:50.646839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ea296-5537-4d9b-9850-7f2cd7fca5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.648069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea296-5537-4d9b-9850-7f2cd7fca5ad None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.650272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea296-5537-4d9b-9850-7f2cd7fca5ad None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.650894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea296-5537-4d9b-9850-7f2cd7fca5ad None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.652317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea296-5537-4d9b-9850-7f2cd7fca5ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.655266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea296-5537-4d9b-9850-7f2cd7fca5ad None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.700658 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 41/85] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:27:50 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:50.714070 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:50.834562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55083de4-6f60-4fe9-831c-30291a809425 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:50.912675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aca569-2b3d-4a17-9a40-07216fbe25d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:50.913865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca569-2b3d-4a17-9a40-07216fbe25d7 None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:50.914370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca569-2b3d-4a17-9a40-07216fbe25d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:50.914877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca569-2b3d-4a17-9a40-07216fbe25d7 None admin] PATH_INFO: `/v3/projects/364b002045a94340ad23e100b4eb5351/users/c975a7f72c0c44ca9cc57c6e90d5b083/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:50.918569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca569-2b3d-4a17-9a40-07216fbe25d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=364b002045a94340ad23e100b4eb5351, user_id=c975a7f72c0c44ca9cc57c6e90d5b083, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:50.921439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca569-2b3d-4a17-9a40-07216fbe25d7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:50.945457 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 45/86] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:50 2022] PUT /identity/v3/projects/364b002045a94340ad23e100b4eb5351/users/c975a7f72c0c44ca9cc57c6e90d5b083/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:27:51.894925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748e1fc-5f9c-4f78-9059-853aa87de624 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.895700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748e1fc-5f9c-4f78-9059-853aa87de624 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.896340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748e1fc-5f9c-4f78-9059-853aa87de624 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.899101 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 42/87] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:51.909011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11edda3-b040-48b8-a789-f5ea2b8cee1f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:51.909524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11edda3-b040-48b8-a789-f5ea2b8cee1f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:51.910554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11edda3-b040-48b8-a789-f5ea2b8cee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:51.950820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c11edda3-b040-48b8-a789-f5ea2b8cee1f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:51.952905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c11edda3-b040-48b8-a789-f5ea2b8cee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:52.101386 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 46/88] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:52.630427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748e1fc-5f9c-4f78-9059-853aa87de624 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:52.681767 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:52.874888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748e1fc-5f9c-4f78-9059-853aa87de624 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:52.959102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25149ce3-f0df-4abe-9f81-756195dacf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:52.960159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25149ce3-f0df-4abe-9f81-756195dacf1e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:52.960671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25149ce3-f0df-4abe-9f81-756195dacf1e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:52.961154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25149ce3-f0df-4abe-9f81-756195dacf1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:52.988581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25149ce3-f0df-4abe-9f81-756195dacf1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-25149ce3-f0df-4abe-9f81-756195dacf1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:53.007196 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:53.008150 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:27:53.008988 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:27:53.009590 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 43/89] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:53.019745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11edda3-b040-48b8-a789-f5ea2b8cee1f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:53.109984 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:53.265585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11edda3-b040-48b8-a789-f5ea2b8cee1f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:53.351308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ed34-aa93-46cb-a2ea-6ce7d97e52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:53.352362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ed34-aa93-46cb-a2ea-6ce7d97e52d2 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:53.352891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ed34-aa93-46cb-a2ea-6ce7d97e52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:53.353388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ed34-aa93-46cb-a2ea-6ce7d97e52d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:53.354608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ed34-aa93-46cb-a2ea-6ce7d97e52d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:53.355165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ed34-aa93-46cb-a2ea-6ce7d97e52d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:53.357749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ed34-aa93-46cb-a2ea-6ce7d97e52d2 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:53.379122 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 47/90] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:27:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:53.388156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25149ce3-f0df-4abe-9f81-756195dacf1e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:53.547625 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:53.571181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25149ce3-f0df-4abe-9f81-756195dacf1e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:53.621209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77332f-7383-4059-a69d-0cd3058c1175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:53.621868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77332f-7383-4059-a69d-0cd3058c1175 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:53.622150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77332f-7383-4059-a69d-0cd3058c1175 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:53.622431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77332f-7383-4059-a69d-0cd3058c1175 None admin] PATH_INFO: `/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:53.624495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77332f-7383-4059-a69d-0cd3058c1175 None admin] RBAC: Authorizing `identity:get_user(user_id=c975a7f72c0c44ca9cc57c6e90d5b083)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:53.626053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77332f-7383-4059-a69d-0cd3058c1175 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:53.627746 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 44/91] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:53 2022] GET /identity/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:53.637602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ed34-aa93-46cb-a2ea-6ce7d97e52d2 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:53.818489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ed34-aa93-46cb-a2ea-6ce7d97e52d2 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:53.821163 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:53.857639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa2737-6dbd-4e18-b401-5aaf1f69134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:53.858271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa2737-6dbd-4e18-b401-5aaf1f69134d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:53.858557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa2737-6dbd-4e18-b401-5aaf1f69134d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:53.858841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa2737-6dbd-4e18-b401-5aaf1f69134d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:53.864316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a24b0-1755-4a86-b536-73e1f69d1f2b None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:53.864735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a24b0-1755-4a86-b536-73e1f69d1f2b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:53.864885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a24b0-1755-4a86-b536-73e1f69d1f2b None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:53.866274 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 45/92] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:53.874614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be63b2f-414a-4788-a105-31a17e17987f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:53.875004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be63b2f-414a-4788-a105-31a17e17987f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:53.875176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be63b2f-414a-4788-a105-31a17e17987f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:53.909640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6be63b2f-414a-4788-a105-31a17e17987f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:53.916657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6be63b2f-414a-4788-a105-31a17e17987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:53.953875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa2737-6dbd-4e18-b401-5aaf1f69134d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:53.955365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa2737-6dbd-4e18-b401-5aaf1f69134d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:54.066810 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 48/93] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:54.067895 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:54.077404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa2737-6dbd-4e18-b401-5aaf1f69134d None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:54.180094 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 46/94] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:54.248878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa2737-6dbd-4e18-b401-5aaf1f69134d None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:54.311271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d9a8-c6c0-4156-ab9d-623f01a7221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:54.312297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d9a8-c6c0-4156-ab9d-623f01a7221d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.312815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d9a8-c6c0-4156-ab9d-623f01a7221d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.313284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d9a8-c6c0-4156-ab9d-623f01a7221d None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.317841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11d9a8-c6c0-4156-ab9d-623f01a7221d None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:54.319778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11d9a8-c6c0-4156-ab9d-623f01a7221d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:54.322043 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 49/95] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:27:54 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:54.333256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be63b2f-414a-4788-a105-31a17e17987f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:54.432540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861f22-1f4e-4037-b45b-8ddc75cf0352 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.433208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861f22-1f4e-4037-b45b-8ddc75cf0352 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.433695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861f22-1f4e-4037-b45b-8ddc75cf0352 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.435433 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 50/96] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:54.448403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2475f93-56cb-4339-ad18-684629a88b10 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.449118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2475f93-56cb-4339-ad18-684629a88b10 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.449619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2475f93-56cb-4339-ad18-684629a88b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.485751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d2475f93-56cb-4339-ad18-684629a88b10 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:54.487353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d2475f93-56cb-4339-ad18-684629a88b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:54.530350 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:54.609339 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:54.610662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be63b2f-414a-4788-a105-31a17e17987f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:54.615654 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 51/97] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:27:54.676297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3993451-2af8-48f0-b909-bcb4ffb7f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:54.676954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993451-2af8-48f0-b909-bcb4ffb7f8ee None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:54.677240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993451-2af8-48f0-b909-bcb4ffb7f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:54.677501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993451-2af8-48f0-b909-bcb4ffb7f8ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:54.678253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3993451-2af8-48f0-b909-bcb4ffb7f8ee None admin] RBAC: Adding query filter params (role.id=2eefb0a36d0744ec8e25b5669af179cf, scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd, user.id=c975a7f72c0c44ca9cc57c6e90d5b083) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:54.678561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3993451-2af8-48f0-b909-bcb4ffb7f8ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:54.680040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3993451-2af8-48f0-b909-bcb4ffb7f8ee None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:54.686647 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 47/98] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:54 2022] GET /identity/v3/role_assignments?user.id=c975a7f72c0c44ca9cc57c6e90d5b083&scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd&role.id=2eefb0a36d0744ec8e25b5669af179cf => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:55.071880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2475f93-56cb-4339-ad18-684629a88b10 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.210726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2475f93-56cb-4339-ad18-684629a88b10 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.232612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c740a5-fe52-48b4-89bd-79cde1bfff39 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.234039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c740a5-fe52-48b4-89bd-79cde1bfff39 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.234812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c740a5-fe52-48b4-89bd-79cde1bfff39 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.238159 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 48/99] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:27:55.247882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028a15a-32be-46fb-836c-e8a4b04a92d4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.248585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028a15a-32be-46fb-836c-e8a4b04a92d4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.249378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028a15a-32be-46fb-836c-e8a4b04a92d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.260425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f293df-bd4e-48eb-bdee-379089c23d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.261398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f293df-bd4e-48eb-bdee-379089c23d13 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.261822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f293df-bd4e-48eb-bdee-379089c23d13 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.262242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f293df-bd4e-48eb-bdee-379089c23d13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.282672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f293df-bd4e-48eb-bdee-379089c23d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:55.287519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7028a15a-32be-46fb-836c-e8a4b04a92d4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-36f293df-bd4e-48eb-bdee-379089c23d13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:55.288815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:55.289905 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:27:55.290757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:55.292233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7028a15a-32be-46fb-836c-e8a4b04a92d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:55.292902 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 52/100] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:55.304964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f293df-bd4e-48eb-bdee-379089c23d13 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.383043 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:55.417242 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 49/101] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:55.418409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028a15a-32be-46fb-836c-e8a4b04a92d4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.438014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f293df-bd4e-48eb-bdee-379089c23d13 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.478557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803ff4-8f0b-42e7-b602-c8cf9b8a2d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.479569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803ff4-8f0b-42e7-b602-c8cf9b8a2d30 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.480056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803ff4-8f0b-42e7-b602-c8cf9b8a2d30 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.480551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4803ff4-8f0b-42e7-b602-c8cf9b8a2d30 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.481480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4803ff4-8f0b-42e7-b602-c8cf9b8a2d30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:55.481989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4803ff4-8f0b-42e7-b602-c8cf9b8a2d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:55.483689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4803ff4-8f0b-42e7-b602-c8cf9b8a2d30 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:55.493818 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 53/102] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:55.504392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803ff4-8f0b-42e7-b602-c8cf9b8a2d30 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.528850 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:55.591018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028a15a-32be-46fb-836c-e8a4b04a92d4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.629552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3229a-b237-49fd-8ff5-ac0221e14abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.632086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3229a-b237-49fd-8ff5-ac0221e14abb None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.632225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3229a-b237-49fd-8ff5-ac0221e14abb None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.632514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3229a-b237-49fd-8ff5-ac0221e14abb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.658621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3229a-b237-49fd-8ff5-ac0221e14abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-66f3229a-b237-49fd-8ff5-ac0221e14abb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:55.664539 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:55.665467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:27:55.666224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:27:55.667284 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 50/103] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:55.674833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3229a-b237-49fd-8ff5-ac0221e14abb None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.695374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4803ff4-8f0b-42e7-b602-c8cf9b8a2d30 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.765219 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:55.827233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c921277-44e4-4ca8-b2be-213d9ff16e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.828123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921277-44e4-4ca8-b2be-213d9ff16e5a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.828603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921277-44e4-4ca8-b2be-213d9ff16e5a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.829102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921277-44e4-4ca8-b2be-213d9ff16e5a None admin] PATH_INFO: `/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.831107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c921277-44e4-4ca8-b2be-213d9ff16e5a None admin] RBAC: Authorizing `identity:get_user(user_id=c975a7f72c0c44ca9cc57c6e90d5b083)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:55.841134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c921277-44e4-4ca8-b2be-213d9ff16e5a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:55.844125 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 54/104] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083 => generated 275 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:55.847603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c921277-44e4-4ca8-b2be-213d9ff16e5a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:55.903406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3229a-b237-49fd-8ff5-ac0221e14abb None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:55.937456 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:55.944050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844db09-bada-41aa-a738-50973535074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:55.944724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844db09-bada-41aa-a738-50973535074d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.945014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844db09-bada-41aa-a738-50973535074d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.945291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844db09-bada-41aa-a738-50973535074d None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.945995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844db09-bada-41aa-a738-50973535074d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:55.946305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844db09-bada-41aa-a738-50973535074d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:55.947764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844db09-bada-41aa-a738-50973535074d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:55.958415 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 51/105] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:55.959766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25535a7-4c11-483e-b6de-30110b7d06fa None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:55.960127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25535a7-4c11-483e-b6de-30110b7d06fa None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:55.960412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25535a7-4c11-483e-b6de-30110b7d06fa None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:55.961810 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 52/106] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:55.962869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25535a7-4c11-483e-b6de-30110b7d06fa None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:56.051543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c921277-44e4-4ca8-b2be-213d9ff16e5a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:56.096307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee3f5e-6ac5-4c95-8476-3cd426a7cf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.097121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee3f5e-6ac5-4c95-8476-3cd426a7cf44 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.097805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee3f5e-6ac5-4c95-8476-3cd426a7cf44 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.098762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee3f5e-6ac5-4c95-8476-3cd426a7cf44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.105910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25535a7-4c11-483e-b6de-30110b7d06fa None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:56.112469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee3f5e-6ac5-4c95-8476-3cd426a7cf44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-f7ee3f5e-6ac5-4c95-8476-3cd426a7cf44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:56.118283 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:56.120084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 55/107] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:56.121641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee3f5e-6ac5-4c95-8476-3cd426a7cf44 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:56.159334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86365aa5-9d6a-4f0d-b44d-ca1c8ac64087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.161369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86365aa5-9d6a-4f0d-b44d-ca1c8ac64087 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.161827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86365aa5-9d6a-4f0d-b44d-ca1c8ac64087 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.162167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86365aa5-9d6a-4f0d-b44d-ca1c8ac64087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.192215 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:56.250549 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:56.261599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86365aa5-9d6a-4f0d-b44d-ca1c8ac64087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:56.262134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee3f5e-6ac5-4c95-8476-3cd426a7cf44 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:56.263127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86365aa5-9d6a-4f0d-b44d-ca1c8ac64087 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:56.306552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71810687-94a6-4530-8123-38016f5a8390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.307225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71810687-94a6-4530-8123-38016f5a8390 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.307498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71810687-94a6-4530-8123-38016f5a8390 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.307811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71810687-94a6-4530-8123-38016f5a8390 None admin] PATH_INFO: `/v3/users/0eea56facd274e79a70b3efac3a71b92` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.309120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71810687-94a6-4530-8123-38016f5a8390 None admin] RBAC: Authorizing `identity:get_user(user_id=0eea56facd274e79a70b3efac3a71b92)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:56.310596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71810687-94a6-4530-8123-38016f5a8390 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:56.312510 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 56/108] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:56 2022] GET /identity/v3/users/0eea56facd274e79a70b3efac3a71b92 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:56.313966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09dbf1-35fc-4fd8-8f84-24fe90183052 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.314612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09dbf1-35fc-4fd8-8f84-24fe90183052 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.314612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09dbf1-35fc-4fd8-8f84-24fe90183052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.335145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8c09dbf1-35fc-4fd8-8f84-24fe90183052 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:56.336363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8c09dbf1-35fc-4fd8-8f84-24fe90183052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:56.410890 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 53/109] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:56.412466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b486-0f10-43b8-99b9-0fa10cbdc3b3 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.412818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b486-0f10-43b8-99b9-0fa10cbdc3b3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.413193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b486-0f10-43b8-99b9-0fa10cbdc3b3 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.414815 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 54/110] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:56.415742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8b486-0f10-43b8-99b9-0fa10cbdc3b3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:56.420557 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 57/111] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:56.421791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09dbf1-35fc-4fd8-8f84-24fe90183052 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:56.505160 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:56.563679 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:56.576110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8b486-0f10-43b8-99b9-0fa10cbdc3b3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:56.611422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09dbf1-35fc-4fd8-8f84-24fe90183052 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:56.639829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0f7d-b512-492f-a329-9f4ed08d3398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.640939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0f7d-b512-492f-a329-9f4ed08d3398 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.641439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0f7d-b512-492f-a329-9f4ed08d3398 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.641934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0f7d-b512-492f-a329-9f4ed08d3398 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.643201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0f7d-b512-492f-a329-9f4ed08d3398 None admin] RBAC: Adding query filter params (name=member) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:56.643755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0f7d-b512-492f-a329-9f4ed08d3398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:56.646698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0f7d-b512-492f-a329-9f4ed08d3398 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:56.655640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d62c3-4106-4c9b-99e0-0ad5bc8f11cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.656277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d62c3-4106-4c9b-99e0-0ad5bc8f11cb None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.656565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d62c3-4106-4c9b-99e0-0ad5bc8f11cb None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.656879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d62c3-4106-4c9b-99e0-0ad5bc8f11cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.662369 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 55/112] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:27:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:56.663628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0f7d-b512-492f-a329-9f4ed08d3398 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:56.766766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d62c3-4106-4c9b-99e0-0ad5bc8f11cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:56.768514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d62c3-4106-4c9b-99e0-0ad5bc8f11cb None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:56.797293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0f7d-b512-492f-a329-9f4ed08d3398 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:56.830620 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:56.858164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869510a-bdcf-4941-b90e-0355e23491ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:56.859273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869510a-bdcf-4941-b90e-0355e23491ea None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.859783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869510a-bdcf-4941-b90e-0355e23491ea None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.860279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869510a-bdcf-4941-b90e-0355e23491ea None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.862282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869510a-bdcf-4941-b90e-0355e23491ea None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:56.865497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869510a-bdcf-4941-b90e-0355e23491ea None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:56.868780 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 56/113] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:27:56 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:56.870737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730f7b5-e59e-4f06-903d-a4ae48ea67c0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:56.871202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730f7b5-e59e-4f06-903d-a4ae48ea67c0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:56.871651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730f7b5-e59e-4f06-903d-a4ae48ea67c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:56.898789 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 58/114] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:56.899674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d62c3-4106-4c9b-99e0-0ad5bc8f11cb None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:56.901846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3730f7b5-e59e-4f06-903d-a4ae48ea67c0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:56.903881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3730f7b5-e59e-4f06-903d-a4ae48ea67c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:56.934920 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:56.996389 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 57/115] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:27:56.998291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730f7b5-e59e-4f06-903d-a4ae48ea67c0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.066028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d62c3-4106-4c9b-99e0-0ad5bc8f11cb None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.132645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730f7b5-e59e-4f06-903d-a4ae48ea67c0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.140057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6dd7-df42-41a5-b150-a87311cdd46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.141108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6dd7-df42-41a5-b150-a87311cdd46a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.141535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6dd7-df42-41a5-b150-a87311cdd46a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.141950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6dd7-df42-41a5-b150-a87311cdd46a None admin] PATH_INFO: `/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.144242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6dd7-df42-41a5-b150-a87311cdd46a None admin] RBAC: Authorizing `identity:get_user(user_id=c975a7f72c0c44ca9cc57c6e90d5b083)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.146916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6dd7-df42-41a5-b150-a87311cdd46a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.149893 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 59/116] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:56 2022] GET /identity/v3/users/c975a7f72c0c44ca9cc57c6e90d5b083 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:57.157943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6dd7-df42-41a5-b150-a87311cdd46a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.177969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929e7e2-27f7-432d-a2d3-2f0e31cd3e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.178640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929e7e2-27f7-432d-a2d3-2f0e31cd3e37 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.178930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929e7e2-27f7-432d-a2d3-2f0e31cd3e37 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.179212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929e7e2-27f7-432d-a2d3-2f0e31cd3e37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.180431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929e7e2-27f7-432d-a2d3-2f0e31cd3e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.181956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929e7e2-27f7-432d-a2d3-2f0e31cd3e37 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.183865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 58/117] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:27:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:57.185809 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:57.189289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929e7e2-27f7-432d-a2d3-2f0e31cd3e37 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.233665 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:57.317278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6dd7-df42-41a5-b150-a87311cdd46a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.369969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cab09-4ac3-413f-aca8-c057e4ee5c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.370861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cab09-4ac3-413f-aca8-c057e4ee5c98 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.371297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cab09-4ac3-413f-aca8-c057e4ee5c98 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.371931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cab09-4ac3-413f-aca8-c057e4ee5c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.373438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cab09-4ac3-413f-aca8-c057e4ee5c98 None admin] RBAC: Adding query filter params (role.id=36ffa4795fa248139676253d88d7e507, scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd, user.id=c975a7f72c0c44ca9cc57c6e90d5b083) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:57.373939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cab09-4ac3-413f-aca8-c057e4ee5c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.376813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cab09-4ac3-413f-aca8-c057e4ee5c98 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.377896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929e7e2-27f7-432d-a2d3-2f0e31cd3e37 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.400917 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 60/118] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/role_assignments?user.id=c975a7f72c0c44ca9cc57c6e90d5b083&scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd&role.id=36ffa4795fa248139676253d88d7e507 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:57.400917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cab09-4ac3-413f-aca8-c057e4ee5c98 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.468046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10020f-491c-439d-b5f2-de2389a2f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.468677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10020f-491c-439d-b5f2-de2389a2f1f8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.468959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10020f-491c-439d-b5f2-de2389a2f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.469308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10020f-491c-439d-b5f2-de2389a2f1f8 None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.471115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10020f-491c-439d-b5f2-de2389a2f1f8 None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.472158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10020f-491c-439d-b5f2-de2389a2f1f8 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.474347 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 59/119] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:57.475096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10020f-491c-439d-b5f2-de2389a2f1f8 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.536138 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:57.586475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cab09-4ac3-413f-aca8-c057e4ee5c98 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.642382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972d42-6596-4f84-80aa-3de8c825449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.643849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972d42-6596-4f84-80aa-3de8c825449f None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.643849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972d42-6596-4f84-80aa-3de8c825449f None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.644247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972d42-6596-4f84-80aa-3de8c825449f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.663365 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:57.678883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10020f-491c-439d-b5f2-de2389a2f1f8 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.721031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff166eb1-4e8f-4fd0-b43e-c526d1e87cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.721733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff166eb1-4e8f-4fd0-b43e-c526d1e87cfe None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.722692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff166eb1-4e8f-4fd0-b43e-c526d1e87cfe None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.723055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff166eb1-4e8f-4fd0-b43e-c526d1e87cfe None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:57.723829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff166eb1-4e8f-4fd0-b43e-c526d1e87cfe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.725468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff166eb1-4e8f-4fd0-b43e-c526d1e87cfe None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.743436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba972d42-6596-4f84-80aa-3de8c825449f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:57.745389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba972d42-6596-4f84-80aa-3de8c825449f None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:57.757083 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 60/120] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:27:57 2022] POST /identity/v3/projects => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:57.758154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff166eb1-4e8f-4fd0-b43e-c526d1e87cfe None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.875222 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:57.911744 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 61/121] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:27:57.912672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972d42-6596-4f84-80aa-3de8c825449f None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:57.932068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff166eb1-4e8f-4fd0-b43e-c526d1e87cfe None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:57.994137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fc1f7-c02c-4757-91f2-e455829313eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:57.994697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fc1f7-c02c-4757-91f2-e455829313eb None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:57.994982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fc1f7-c02c-4757-91f2-e455829313eb None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:57.995425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fc1f7-c02c-4757-91f2-e455829313eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.011078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fc1f7-c02c-4757-91f2-e455829313eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-299fc1f7-c02c-4757-91f2-e455829313eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:27:58.018728 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:58.020482 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 61/122] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:58.024117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fc1f7-c02c-4757-91f2-e455829313eb None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.032004 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.138509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972d42-6596-4f84-80aa-3de8c825449f None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.185319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f38f2-dcb2-47fd-ac87-1c0da76ccb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.186757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f38f2-dcb2-47fd-ac87-1c0da76ccb3c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.187280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f38f2-dcb2-47fd-ac87-1c0da76ccb3c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.187764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f38f2-dcb2-47fd-ac87-1c0da76ccb3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.188773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f38f2-dcb2-47fd-ac87-1c0da76ccb3c None admin] RBAC: Adding query filter params (role.id=3c676188d9f646ba8509d3eef1e196de, scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd, user.id=0eea56facd274e79a70b3efac3a71b92) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:58.189293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f38f2-dcb2-47fd-ac87-1c0da76ccb3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.191601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f38f2-dcb2-47fd-ac87-1c0da76ccb3c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.202503 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 62/123] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:57 2022] GET /identity/v3/role_assignments?user.id=0eea56facd274e79a70b3efac3a71b92&scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd&role.id=3c676188d9f646ba8509d3eef1e196de => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:58.203506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f38f2-dcb2-47fd-ac87-1c0da76ccb3c None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.268595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fc1f7-c02c-4757-91f2-e455829313eb None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.312836 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.344741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51f4c5-5c10-46c3-9bc7-5f3afeb64d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.346250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51f4c5-5c10-46c3-9bc7-5f3afeb64d2f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.349156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51f4c5-5c10-46c3-9bc7-5f3afeb64d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.350010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51f4c5-5c10-46c3-9bc7-5f3afeb64d2f None admin] PATH_INFO: `/v3/projects/364b002045a94340ad23e100b4eb5351` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.352911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51f4c5-5c10-46c3-9bc7-5f3afeb64d2f None admin] RBAC: Authorizing `identity:get_project(project_id=364b002045a94340ad23e100b4eb5351)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.357317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51f4c5-5c10-46c3-9bc7-5f3afeb64d2f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.371266 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 62/124] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/projects/364b002045a94340ad23e100b4eb5351 => generated 312 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:58.372974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51f4c5-5c10-46c3-9bc7-5f3afeb64d2f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.447710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f38f2-dcb2-47fd-ac87-1c0da76ccb3c None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.478972 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.520325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f68c5f-5001-4039-a9bb-fc8ee4960f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.520610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51f4c5-5c10-46c3-9bc7-5f3afeb64d2f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.522064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f68c5f-5001-4039-a9bb-fc8ee4960f53 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.522826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f68c5f-5001-4039-a9bb-fc8ee4960f53 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.523549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f68c5f-5001-4039-a9bb-fc8ee4960f53 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.524985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f68c5f-5001-4039-a9bb-fc8ee4960f53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:58.525685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f68c5f-5001-4039-a9bb-fc8ee4960f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.528283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f68c5f-5001-4039-a9bb-fc8ee4960f53 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.547298 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 63/125] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:58.556530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f68c5f-5001-4039-a9bb-fc8ee4960f53 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.600947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07786084-04a1-4d67-bacd-5ef720c18b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.602676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07786084-04a1-4d67-bacd-5ef720c18b80 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.603320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07786084-04a1-4d67-bacd-5ef720c18b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.603930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07786084-04a1-4d67-bacd-5ef720c18b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.605009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07786084-04a1-4d67-bacd-5ef720c18b80 None admin] RBAC: Adding query filter params (role.id=2eefb0a36d0744ec8e25b5669af179cf, scope.project.id=364b002045a94340ad23e100b4eb5351, user.id=c975a7f72c0c44ca9cc57c6e90d5b083) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:58.605556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07786084-04a1-4d67-bacd-5ef720c18b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.607427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07786084-04a1-4d67-bacd-5ef720c18b80 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.617578 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 63/126] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/role_assignments?user.id=c975a7f72c0c44ca9cc57c6e90d5b083&scope.project.id=364b002045a94340ad23e100b4eb5351&role.id=2eefb0a36d0744ec8e25b5669af179cf => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:27:58.759435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f68c5f-5001-4039-a9bb-fc8ee4960f53 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:58.762117 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:58.809472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f38b1f-69c4-4137-963a-f28d896e087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:58.810225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f38b1f-69c4-4137-963a-f28d896e087a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:58.810663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f38b1f-69c4-4137-963a-f28d896e087a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:58.811128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f38b1f-69c4-4137-963a-f28d896e087a None admin] PATH_INFO: `/v3/users/9597967b2b5e477d941c9e11ae319b2a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:58.836603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f38b1f-69c4-4137-963a-f28d896e087a None admin] RBAC: Authorizing `identity:get_user(user_id=9597967b2b5e477d941c9e11ae319b2a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:58.839176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f38b1f-69c4-4137-963a-f28d896e087a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:58.842407 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 64/127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/users/9597967b2b5e477d941c9e11ae319b2a => generated 289 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:58.850681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07786084-04a1-4d67-bacd-5ef720c18b80 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:58.978307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07786084-04a1-4d67-bacd-5ef720c18b80 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:59.013579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78972c82-7d67-4cb2-a345-8255885a6193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:59.014233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972c82-7d67-4cb2-a345-8255885a6193 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:59.014518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972c82-7d67-4cb2-a345-8255885a6193 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:59.014797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972c82-7d67-4cb2-a345-8255885a6193 None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:59.016011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78972c82-7d67-4cb2-a345-8255885a6193 None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:59.017543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78972c82-7d67-4cb2-a345-8255885a6193 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:59.019890 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 64/128] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:27:58 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:59.025811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f38b1f-69c4-4137-963a-f28d896e087a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:59.134835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f38b1f-69c4-4137-963a-f28d896e087a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:59.177669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576e301-0391-49fa-b1f3-08e67c6bea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:59.178803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e301-0391-49fa-b1f3-08e67c6bea1d None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:59.179282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e301-0391-49fa-b1f3-08e67c6bea1d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:59.179776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e301-0391-49fa-b1f3-08e67c6bea1d None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/users/9597967b2b5e477d941c9e11ae319b2a/roles/b1b6bcd683ae410db592b5c0d447e25f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:59.183021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576e301-0391-49fa-b1f3-08e67c6bea1d None admin] RBAC: Authorizing `identity:create_grant(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd, user_id=9597967b2b5e477d941c9e11ae319b2a, role_id=b1b6bcd683ae410db592b5c0d447e25f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:59.185723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576e301-0391-49fa-b1f3-08e67c6bea1d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:59.202574 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 65/129] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:27:59 2022] PUT /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/users/9597967b2b5e477d941c9e11ae319b2a/roles/b1b6bcd683ae410db592b5c0d447e25f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:28:01.341813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aa489-d239-4718-a59c-19d98f8c975d None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.342634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aa489-d239-4718-a59c-19d98f8c975d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.342634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aa489-d239-4718-a59c-19d98f8c975d None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.343736 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 65/130] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:01.350980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6060c4-c33e-4024-b905-be3dcd53c0f5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.351799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6060c4-c33e-4024-b905-be3dcd53c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.351799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6060c4-c33e-4024-b905-be3dcd53c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.372980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-da6060c4-c33e-4024-b905-be3dcd53c0f5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:01.374250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-da6060c4-c33e-4024-b905-be3dcd53c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:01.392191 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:01.425892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26120-6730-4c28-87e8-7c36eee2a341 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.426387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26120-6730-4c28-87e8-7c36eee2a341 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.426884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26120-6730-4c28-87e8-7c36eee2a341 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.429540 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 66/131] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:28:01.436087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff139c-04a0-4fc7-b593-e7f2ff38f262 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.436459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff139c-04a0-4fc7-b593-e7f2ff38f262 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.436902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff139c-04a0-4fc7-b593-e7f2ff38f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.444014 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:01.460565 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 66/132] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:01.465779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2dff139c-04a0-4fc7-b593-e7f2ff38f262 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:01.467788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2dff139c-04a0-4fc7-b593-e7f2ff38f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:01.570283 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 67/133] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:01.738102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6060c4-c33e-4024-b905-be3dcd53c0f5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:01.846983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff139c-04a0-4fc7-b593-e7f2ff38f262 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:01.892518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6060c4-c33e-4024-b905-be3dcd53c0f5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:01.933170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd88fd-b481-4a7f-b7ad-bd59483a27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:01.933823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd88fd-b481-4a7f-b7ad-bd59483a27db None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:01.934101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd88fd-b481-4a7f-b7ad-bd59483a27db None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:01.934373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd88fd-b481-4a7f-b7ad-bd59483a27db None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:01.935533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd88fd-b481-4a7f-b7ad-bd59483a27db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:01.937028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd88fd-b481-4a7f-b7ad-bd59483a27db None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:01.938631 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 67/134] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:01.944868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd88fd-b481-4a7f-b7ad-bd59483a27db None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:01.966356 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:02.004404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff139c-04a0-4fc7-b593-e7f2ff38f262 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.056772 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:02.061150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd88fd-b481-4a7f-b7ad-bd59483a27db None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.062894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c1513-1edd-47c1-b4fd-4a3d1a897511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.063536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c1513-1edd-47c1-b4fd-4a3d1a897511 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.063812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c1513-1edd-47c1-b4fd-4a3d1a897511 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.064083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c1513-1edd-47c1-b4fd-4a3d1a897511 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.075851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c1513-1edd-47c1-b4fd-4a3d1a897511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-570c1513-1edd-47c1-b4fd-4a3d1a897511 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:02.088117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:02.089920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:02.091411 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 68/135] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:02.099366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c1513-1edd-47c1-b4fd-4a3d1a897511 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:02.112750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc8903-f8b9-4c7d-a868-95f538878c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.113556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc8903-f8b9-4c7d-a868-95f538878c36 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.113912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc8903-f8b9-4c7d-a868-95f538878c36 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.114251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc8903-f8b9-4c7d-a868-95f538878c36 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.115155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc8903-f8b9-4c7d-a868-95f538878c36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.116845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc8903-f8b9-4c7d-a868-95f538878c36 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.151935 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 68/136] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:01 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:28:02.245392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c1513-1edd-47c1-b4fd-4a3d1a897511 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.286734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214464-54f8-4b67-9df5-93271b0bfebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.287276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214464-54f8-4b67-9df5-93271b0bfebd None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.287556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214464-54f8-4b67-9df5-93271b0bfebd None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.287828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214464-54f8-4b67-9df5-93271b0bfebd None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.288510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c214464-54f8-4b67-9df5-93271b0bfebd None admin] RBAC: Adding query filter params (name=reader) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:02.288845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c214464-54f8-4b67-9df5-93271b0bfebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.290264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c214464-54f8-4b67-9df5-93271b0bfebd None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.299633 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 69/137] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:02.305911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc8903-f8b9-4c7d-a868-95f538878c36 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:02.393071 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:02.426565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc8903-f8b9-4c7d-a868-95f538878c36 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.464988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387c7b-2646-4d63-8db3-5322a39bf3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.465647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387c7b-2646-4d63-8db3-5322a39bf3f8 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.465934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387c7b-2646-4d63-8db3-5322a39bf3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.466208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387c7b-2646-4d63-8db3-5322a39bf3f8 None admin] PATH_INFO: `/v3/users/9597967b2b5e477d941c9e11ae319b2a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.467433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387c7b-2646-4d63-8db3-5322a39bf3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=9597967b2b5e477d941c9e11ae319b2a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.468960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387c7b-2646-4d63-8db3-5322a39bf3f8 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.470617 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 69/138] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:02 2022] GET /identity/v3/users/9597967b2b5e477d941c9e11ae319b2a => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:02.477657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214464-54f8-4b67-9df5-93271b0bfebd None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:02.563250 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:02.628047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214464-54f8-4b67-9df5-93271b0bfebd None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:02.673968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c2a10-ff22-445e-9605-659f089d9309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:02.675804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c2a10-ff22-445e-9605-659f089d9309 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:02.676243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c2a10-ff22-445e-9605-659f089d9309 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:02.676804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c2a10-ff22-445e-9605-659f089d9309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:02.772263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c2a10-ff22-445e-9605-659f089d9309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:02.773811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c2a10-ff22-445e-9605-659f089d9309 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:02.863307 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:02.959755 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 70/139] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 00:28:02.966169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387c7b-2646-4d63-8db3-5322a39bf3f8 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:03.088708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387c7b-2646-4d63-8db3-5322a39bf3f8 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:03.126996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80321af-05c5-4c85-89cb-6ac8c6d2596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:03.127582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80321af-05c5-4c85-89cb-6ac8c6d2596e None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:03.127871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80321af-05c5-4c85-89cb-6ac8c6d2596e None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:03.128845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80321af-05c5-4c85-89cb-6ac8c6d2596e None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:03.130005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80321af-05c5-4c85-89cb-6ac8c6d2596e None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:03.131514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80321af-05c5-4c85-89cb-6ac8c6d2596e None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:03.133685 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 70/140] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:02 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:03.139766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c2a10-ff22-445e-9605-659f089d9309 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:03.282672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c2a10-ff22-445e-9605-659f089d9309 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:03.350676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb1d7-fe3a-4c7c-8b60-abe4dd71a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:03.351737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb1d7-fe3a-4c7c-8b60-abe4dd71a41f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:03.352229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb1d7-fe3a-4c7c-8b60-abe4dd71a41f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:03.352781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb1d7-fe3a-4c7c-8b60-abe4dd71a41f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:03.354189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cb1d7-fe3a-4c7c-8b60-abe4dd71a41f None admin] RBAC: Adding query filter params (role.id=b1b6bcd683ae410db592b5c0d447e25f, scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd, user.id=9597967b2b5e477d941c9e11ae319b2a) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:03.354765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cb1d7-fe3a-4c7c-8b60-abe4dd71a41f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:03.357629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cb1d7-fe3a-4c7c-8b60-abe4dd71a41f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:03.370219 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 71/141] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:03 2022] GET /identity/v3/role_assignments?user.id=9597967b2b5e477d941c9e11ae319b2a&scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd&role.id=b1b6bcd683ae410db592b5c0d447e25f => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:04.853590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda203a5-f68d-4274-b239-ba3683057524 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:04.854407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda203a5-f68d-4274-b239-ba3683057524 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:04.854407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda203a5-f68d-4274-b239-ba3683057524 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:04.856050 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 71/142] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:28:04.861946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c780-cd0d-4b47-b69a-c18aff1c368d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:04.862866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c780-cd0d-4b47-b69a-c18aff1c368d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:04.862866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c780-cd0d-4b47-b69a-c18aff1c368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:04.884387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7322c780-cd0d-4b47-b69a-c18aff1c368d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:04.885902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7322c780-cd0d-4b47-b69a-c18aff1c368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:04.903323 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:04.990674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a821db-806d-4685-a1d8-36ecb58d9711 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:04.991168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a821db-806d-4685-a1d8-36ecb58d9711 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:04.991673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a821db-806d-4685-a1d8-36ecb58d9711 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:04.994596 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 72/143] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:04.996957 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 72/144] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:05.001953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171f77d-ba65-4c7b-be1e-2d411bc44ccf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.002451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171f77d-ba65-4c7b-be1e-2d411bc44ccf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.002919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171f77d-ba65-4c7b-be1e-2d411bc44ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.034955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3171f77d-ba65-4c7b-be1e-2d411bc44ccf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:05.037299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3171f77d-ba65-4c7b-be1e-2d411bc44ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:05.043489 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:05.172284 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 73/145] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:05.272255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c780-cd0d-4b47-b69a-c18aff1c368d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:05.397579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c780-cd0d-4b47-b69a-c18aff1c368d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:05.445247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d9f1-e6da-4c61-a17c-e7faaaafd461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:05.445800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d9f1-e6da-4c61-a17c-e7faaaafd461 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.446078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d9f1-e6da-4c61-a17c-e7faaaafd461 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.446351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d9f1-e6da-4c61-a17c-e7faaaafd461 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.459918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0d9f1-e6da-4c61-a17c-e7faaaafd461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-e4c0d9f1-e6da-4c61-a17c-e7faaaafd461 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:05.465452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:05.467160 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:05.468926 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 73/146] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:05.477136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171f77d-ba65-4c7b-be1e-2d411bc44ccf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:05.605876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171f77d-ba65-4c7b-be1e-2d411bc44ccf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:05.647858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83176828-3219-4e62-87ac-5cbda6f2f330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:05.648497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83176828-3219-4e62-87ac-5cbda6f2f330 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.648802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83176828-3219-4e62-87ac-5cbda6f2f330 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.649073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83176828-3219-4e62-87ac-5cbda6f2f330 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.649764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83176828-3219-4e62-87ac-5cbda6f2f330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:05.650066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83176828-3219-4e62-87ac-5cbda6f2f330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:05.651464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83176828-3219-4e62-87ac-5cbda6f2f330 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:05.661672 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 74/147] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:05.665153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d9f1-e6da-4c61-a17c-e7faaaafd461 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:05.667359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83176828-3219-4e62-87ac-5cbda6f2f330 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:05.671482 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:05.687675 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:05.825371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d9f1-e6da-4c61-a17c-e7faaaafd461 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:05.865790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83176828-3219-4e62-87ac-5cbda6f2f330 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:05.871520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fccd35-9ff4-426e-bb6e-273157ee86e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:05.872358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fccd35-9ff4-426e-bb6e-273157ee86e4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.872637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fccd35-9ff4-426e-bb6e-273157ee86e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.872988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fccd35-9ff4-426e-bb6e-273157ee86e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.887724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fccd35-9ff4-426e-bb6e-273157ee86e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-b6fccd35-9ff4-426e-bb6e-273157ee86e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:05.893477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:05.895947 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:05.897524 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 74/148] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:28:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:05.906132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1567d-24e5-466f-bf57-2d57a06fb4bb None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.906498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1567d-24e5-466f-bf57-2d57a06fb4bb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.906840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1567d-24e5-466f-bf57-2d57a06fb4bb None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.908310 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 75/149] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:05.910429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1567d-24e5-466f-bf57-2d57a06fb4bb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:05.934725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935eca-f30c-4864-8429-b39c538536c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:05.935788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935eca-f30c-4864-8429-b39c538536c0 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.936244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935eca-f30c-4864-8429-b39c538536c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.936718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935eca-f30c-4864-8429-b39c538536c0 None admin] PATH_INFO: `/v3/users/c46bfce16f654da3a2b17ed5002417c9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.961052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d935eca-f30c-4864-8429-b39c538536c0 None admin] RBAC: Authorizing `identity:get_user(user_id=c46bfce16f654da3a2b17ed5002417c9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:05.962554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d935eca-f30c-4864-8429-b39c538536c0 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:05.964598 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 75/150] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:05 2022] GET /identity/v3/users/c46bfce16f654da3a2b17ed5002417c9 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:05.965813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439b9d9-1132-41bd-aa7e-ef951e590827 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.966200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439b9d9-1132-41bd-aa7e-ef951e590827 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.966445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439b9d9-1132-41bd-aa7e-ef951e590827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.986416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e439b9d9-1132-41bd-aa7e-ef951e590827 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:05.989947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e439b9d9-1132-41bd-aa7e-ef951e590827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:05.994047 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:06.042217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1567d-24e5-466f-bf57-2d57a06fb4bb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:06.058798 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:06.073249 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 76/151] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:06.073840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439b9d9-1132-41bd-aa7e-ef951e590827 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:06.101580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1381557-53d5-4182-b437-dd4a18a4c285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:06.102220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1381557-53d5-4182-b437-dd4a18a4c285 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:06.102502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1381557-53d5-4182-b437-dd4a18a4c285 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:06.102780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1381557-53d5-4182-b437-dd4a18a4c285 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:06.103467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1381557-53d5-4182-b437-dd4a18a4c285 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:06.103770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1381557-53d5-4182-b437-dd4a18a4c285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:06.105233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1381557-53d5-4182-b437-dd4a18a4c285 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:06.115048 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 76/152] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:06.120744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1381557-53d5-4182-b437-dd4a18a4c285 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:06.227371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439b9d9-1132-41bd-aa7e-ef951e590827 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:06.274009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73a32-386e-4431-b8d1-8c50279d78dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:06.274674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73a32-386e-4431-b8d1-8c50279d78dd None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:06.274947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73a32-386e-4431-b8d1-8c50279d78dd None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:06.275396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1381557-53d5-4182-b437-dd4a18a4c285 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:06.275588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73a32-386e-4431-b8d1-8c50279d78dd None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:06.276810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a73a32-386e-4431-b8d1-8c50279d78dd None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:06.278358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a73a32-386e-4431-b8d1-8c50279d78dd None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:06.280391 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 77/153] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:06 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:06.286788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73a32-386e-4431-b8d1-8c50279d78dd None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:06.335309 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:06.345462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72f62-0d7f-4459-b666-d61cbb0c7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:06.347389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72f62-0d7f-4459-b666-d61cbb0c7648 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:06.348122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72f62-0d7f-4459-b666-d61cbb0c7648 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:06.348847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72f62-0d7f-4459-b666-d61cbb0c7648 None admin] PATH_INFO: `/v3/users/c46bfce16f654da3a2b17ed5002417c9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:06.351260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b72f62-0d7f-4459-b666-d61cbb0c7648 None admin] RBAC: Authorizing `identity:get_user(user_id=c46bfce16f654da3a2b17ed5002417c9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:06.354288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b72f62-0d7f-4459-b666-d61cbb0c7648 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:06.356989 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 77/154] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:06 2022] GET /identity/v3/users/c46bfce16f654da3a2b17ed5002417c9 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:06.363847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72f62-0d7f-4459-b666-d61cbb0c7648 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:06.384516 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:06.433379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73a32-386e-4431-b8d1-8c50279d78dd None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:06.469730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9b279-e0d4-4cd7-b4ed-159c92a41a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:06.470606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9b279-e0d4-4cd7-b4ed-159c92a41a29 None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:06.471004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9b279-e0d4-4cd7-b4ed-159c92a41a29 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:06.471289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9b279-e0d4-4cd7-b4ed-159c92a41a29 None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c/users/c46bfce16f654da3a2b17ed5002417c9/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:06.473996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9b279-e0d4-4cd7-b4ed-159c92a41a29 None admin] RBAC: Authorizing `identity:create_grant(project_id=76689a22ac724ea298a077330657115c, user_id=c46bfce16f654da3a2b17ed5002417c9, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:06.475478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9b279-e0d4-4cd7-b4ed-159c92a41a29 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:06.490161 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 78/155] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:06 2022] PUT /identity/v3/projects/76689a22ac724ea298a077330657115c/users/c46bfce16f654da3a2b17ed5002417c9/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:06.491052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9b279-e0d4-4cd7-b4ed-159c92a41a29 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:06.534890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72f62-0d7f-4459-b666-d61cbb0c7648 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:06.591358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfd84f-8891-45ec-98be-e766f53b0e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:06.592422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfd84f-8891-45ec-98be-e766f53b0e88 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:06.592927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfd84f-8891-45ec-98be-e766f53b0e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:06.593417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfd84f-8891-45ec-98be-e766f53b0e88 None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:06.594828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfd84f-8891-45ec-98be-e766f53b0e88 None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:06.596367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfd84f-8891-45ec-98be-e766f53b0e88 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:06.599065 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 78/156] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:06 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:06.608294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfd84f-8891-45ec-98be-e766f53b0e88 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:06.647794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9b279-e0d4-4cd7-b4ed-159c92a41a29 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:06.671496 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:06.698689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628063-a177-4663-9e53-1219689a4ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:06.699350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628063-a177-4663-9e53-1219689a4ec7 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:06.699631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628063-a177-4663-9e53-1219689a4ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:06.699913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628063-a177-4663-9e53-1219689a4ec7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:06.701726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628063-a177-4663-9e53-1219689a4ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:06.702980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628063-a177-4663-9e53-1219689a4ec7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:06.704713 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 79/157] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:06.715268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628063-a177-4663-9e53-1219689a4ec7 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:06.733893 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:06.787016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfd84f-8891-45ec-98be-e766f53b0e88 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:06.852718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57a1f-4bb5-412c-85be-07516b39dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:06.853835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57a1f-4bb5-412c-85be-07516b39dd38 None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:06.854312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57a1f-4bb5-412c-85be-07516b39dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:06.854779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57a1f-4bb5-412c-85be-07516b39dd38 None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c/users/c46bfce16f654da3a2b17ed5002417c9/roles/36ffa4795fa248139676253d88d7e507` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:06.858835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f57a1f-4bb5-412c-85be-07516b39dd38 None admin] RBAC: Authorizing `identity:create_grant(project_id=76689a22ac724ea298a077330657115c, user_id=c46bfce16f654da3a2b17ed5002417c9, role_id=36ffa4795fa248139676253d88d7e507)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:06.861582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f57a1f-4bb5-412c-85be-07516b39dd38 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:06.885567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628063-a177-4663-9e53-1219689a4ec7 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:06.892705 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 79/158] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:06 2022] PUT /identity/v3/projects/76689a22ac724ea298a077330657115c/users/c46bfce16f654da3a2b17ed5002417c9/roles/36ffa4795fa248139676253d88d7e507 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:28:06.939360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d13a4-58d6-4ea6-a307-16ced034424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:06.940496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d13a4-58d6-4ea6-a307-16ced034424a None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:06.941065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d13a4-58d6-4ea6-a307-16ced034424a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:06.941631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d13a4-58d6-4ea6-a307-16ced034424a None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:06.942884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d13a4-58d6-4ea6-a307-16ced034424a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:06.945834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d13a4-58d6-4ea6-a307-16ced034424a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:06.991298 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 80/159] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:06 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:08.999861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeca6e-b34a-4701-b801-349115bb334f None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:09.000729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeca6e-b34a-4701-b801-349115bb334f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:09.000993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeca6e-b34a-4701-b801-349115bb334f None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:09.005086 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 80/160] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:09.013037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf00de-4110-42ca-a2b1-e0072d450ca1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:09.013727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf00de-4110-42ca-a2b1-e0072d450ca1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:09.013983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf00de-4110-42ca-a2b1-e0072d450ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:09.052443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5dcf00de-4110-42ca-a2b1-e0072d450ca1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:09.054611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5dcf00de-4110-42ca-a2b1-e0072d450ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:09.127403 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:09.193126 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 81/161] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:09.470093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeca6e-b34a-4701-b801-349115bb334f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:09.587550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeca6e-b34a-4701-b801-349115bb334f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:09.617367 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:09.630927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c969d-d94a-42aa-b803-984a4f66465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:09.631593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c969d-d94a-42aa-b803-984a4f66465e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:09.631872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c969d-d94a-42aa-b803-984a4f66465e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:09.632202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c969d-d94a-42aa-b803-984a4f66465e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:09.645167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c969d-d94a-42aa-b803-984a4f66465e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-364c969d-d94a-42aa-b803-984a4f66465e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:09.650242 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:09.651232 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:09.652020 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 81/162] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:09.659991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf00de-4110-42ca-a2b1-e0072d450ca1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:09.813355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef261259-b10c-469c-a8de-a15e31c24948 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:09.813701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef261259-b10c-469c-a8de-a15e31c24948 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:09.813877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef261259-b10c-469c-a8de-a15e31c24948 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:09.815237 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 82/163] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:28:09.821860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8615-8874-4070-873e-62bb096f62a3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:09.822170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8615-8874-4070-873e-62bb096f62a3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:09.822413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8615-8874-4070-873e-62bb096f62a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:09.842442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3bac8615-8874-4070-873e-62bb096f62a3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:09.843432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf00de-4110-42ca-a2b1-e0072d450ca1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:09.843657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3bac8615-8874-4070-873e-62bb096f62a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:09.906762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44a89c-028d-431e-8fa3-160710c703f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:09.907846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a89c-028d-431e-8fa3-160710c703f4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:09.908251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a89c-028d-431e-8fa3-160710c703f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:09.908665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a89c-028d-431e-8fa3-160710c703f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:09.910405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44a89c-028d-431e-8fa3-160710c703f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:09.911066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44a89c-028d-431e-8fa3-160710c703f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:09.913809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44a89c-028d-431e-8fa3-160710c703f4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:09.919062 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 83/164] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:09.930784 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 82/165] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:09.938081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac8615-8874-4070-873e-62bb096f62a3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:10.060091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac8615-8874-4070-873e-62bb096f62a3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:10.102734 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:10.136004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1edeea-d9cb-4bb8-bfa0-1928b57819e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:10.137488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1edeea-d9cb-4bb8-bfa0-1928b57819e9 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:10.138206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1edeea-d9cb-4bb8-bfa0-1928b57819e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:10.138897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1edeea-d9cb-4bb8-bfa0-1928b57819e9 None admin] PATH_INFO: `/v3/users/c46bfce16f654da3a2b17ed5002417c9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:10.141117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1edeea-d9cb-4bb8-bfa0-1928b57819e9 None admin] RBAC: Authorizing `identity:get_user(user_id=c46bfce16f654da3a2b17ed5002417c9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:10.144208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1edeea-d9cb-4bb8-bfa0-1928b57819e9 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:10.147582 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 84/166] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:09 2022] GET /identity/v3/users/c46bfce16f654da3a2b17ed5002417c9 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:10.154170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44a89c-028d-431e-8fa3-160710c703f4 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:10.194992 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:10.275991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44a89c-028d-431e-8fa3-160710c703f4 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:10.301993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1edeea-d9cb-4bb8-bfa0-1928b57819e9 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:10.318716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be6237-7830-482a-9938-b6ce5a60519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:10.319387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be6237-7830-482a-9938-b6ce5a60519d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:10.319664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be6237-7830-482a-9938-b6ce5a60519d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:10.319946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be6237-7830-482a-9938-b6ce5a60519d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:10.398148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be6237-7830-482a-9938-b6ce5a60519d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:10.399949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be6237-7830-482a-9938-b6ce5a60519d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:10.437384 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:10.487324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1edeea-d9cb-4bb8-bfa0-1928b57819e9 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:10.526342 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 83/167] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:28:10.526342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad375b6f-a8d6-4800-b4c4-e24f086e72c0 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:10.526342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad375b6f-a8d6-4800-b4c4-e24f086e72c0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:10.526342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad375b6f-a8d6-4800-b4c4-e24f086e72c0 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:10.526342 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 84/168] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:10.526342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ffef-2890-4f89-9e5e-f246029f4056 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:10.526342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ffef-2890-4f89-9e5e-f246029f4056 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:10.532900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ffef-2890-4f89-9e5e-f246029f4056 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:10.533041 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 85/169] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:10.533883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46ffef-2890-4f89-9e5e-f246029f4056 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:10.539612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350732d-fc14-439f-8808-e410e04e99fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:10.540444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350732d-fc14-439f-8808-e410e04e99fb None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:10.540929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350732d-fc14-439f-8808-e410e04e99fb None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:10.541384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350732d-fc14-439f-8808-e410e04e99fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:10.557316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350732d-fc14-439f-8808-e410e04e99fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-7350732d-fc14-439f-8808-e410e04e99fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:10.562580 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:10.564315 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:10.566010 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 85/170] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:28:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:10.568488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc597d94-d8a9-4e1c-9f6d-eec02136f5db None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:10.569022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc597d94-d8a9-4e1c-9f6d-eec02136f5db None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:10.569506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc597d94-d8a9-4e1c-9f6d-eec02136f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:10.590492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cc597d94-d8a9-4e1c-9f6d-eec02136f5db None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:10.591958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cc597d94-d8a9-4e1c-9f6d-eec02136f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:10.639183 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:10.669680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46ffef-2890-4f89-9e5e-f246029f4056 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:10.670489 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 86/171] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:10.678978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5464c-300a-4f0a-8122-7f0b5645f91f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:10.678978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5464c-300a-4f0a-8122-7f0b5645f91f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:10.678978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5464c-300a-4f0a-8122-7f0b5645f91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:10.705720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-72b5464c-300a-4f0a-8122-7f0b5645f91f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:10.708154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-72b5464c-300a-4f0a-8122-7f0b5645f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:10.713206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0277c-ac67-4a7a-a63d-446d4a390efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:10.714160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0277c-ac67-4a7a-a63d-446d4a390efa None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:10.714569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0277c-ac67-4a7a-a63d-446d4a390efa None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:10.714998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0277c-ac67-4a7a-a63d-446d4a390efa None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:10.716444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0277c-ac67-4a7a-a63d-446d4a390efa None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:10.718234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0277c-ac67-4a7a-a63d-446d4a390efa None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:10.726416 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 86/172] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:10 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:10.726416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0277c-ac67-4a7a-a63d-446d4a390efa None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:10.729598 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:10.829756 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 87/173] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:10.834580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5464c-300a-4f0a-8122-7f0b5645f91f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:10.880896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0277c-ac67-4a7a-a63d-446d4a390efa None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:10.947962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd98094-500d-48b3-a4f9-860ff3d815e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:10.948888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd98094-500d-48b3-a4f9-860ff3d815e3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:10.949370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd98094-500d-48b3-a4f9-860ff3d815e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:10.949844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd98094-500d-48b3-a4f9-860ff3d815e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:10.951527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd98094-500d-48b3-a4f9-860ff3d815e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:10.952052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd98094-500d-48b3-a4f9-860ff3d815e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:10.954583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd98094-500d-48b3-a4f9-860ff3d815e3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:10.972867 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 87/174] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:10.984808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd98094-500d-48b3-a4f9-860ff3d815e3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.071743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5464c-300a-4f0a-8122-7f0b5645f91f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:11.072538 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:11.077673 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:11.127016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd98094-500d-48b3-a4f9-860ff3d815e3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:11.148888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6a75-3135-4670-8bef-bab20fc21aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:11.149830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6a75-3135-4670-8bef-bab20fc21aad None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.150320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6a75-3135-4670-8bef-bab20fc21aad None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.150792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6a75-3135-4670-8bef-bab20fc21aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.152179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f6a75-3135-4670-8bef-bab20fc21aad None admin] RBAC: Adding query filter params (role.id=3c676188d9f646ba8509d3eef1e196de, scope.project.id=76689a22ac724ea298a077330657115c, user.id=c46bfce16f654da3a2b17ed5002417c9) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:11.152741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f6a75-3135-4670-8bef-bab20fc21aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:11.155265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f6a75-3135-4670-8bef-bab20fc21aad None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:11.167481 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 88/175] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:10 2022] GET /identity/v3/role_assignments?user.id=c46bfce16f654da3a2b17ed5002417c9&scope.project.id=76689a22ac724ea298a077330657115c&role.id=3c676188d9f646ba8509d3eef1e196de => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:11.168976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6a75-3135-4670-8bef-bab20fc21aad None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.191614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071babb7-3faa-4fce-b19d-d6b96aeeecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:11.193730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071babb7-3faa-4fce-b19d-d6b96aeeecc2 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.194193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071babb7-3faa-4fce-b19d-d6b96aeeecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.194656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071babb7-3faa-4fce-b19d-d6b96aeeecc2 None admin] PATH_INFO: `/v3/users/c46bfce16f654da3a2b17ed5002417c9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.196823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071babb7-3faa-4fce-b19d-d6b96aeeecc2 None admin] RBAC: Authorizing `identity:get_user(user_id=c46bfce16f654da3a2b17ed5002417c9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:11.199621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071babb7-3faa-4fce-b19d-d6b96aeeecc2 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:11.209439 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 88/176] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:10 2022] GET /identity/v3/users/c46bfce16f654da3a2b17ed5002417c9 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:11.213551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071babb7-3faa-4fce-b19d-d6b96aeeecc2 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.353408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6a75-3135-4670-8bef-bab20fc21aad None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:11.398096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071babb7-3faa-4fce-b19d-d6b96aeeecc2 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:11.412210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2ca0-5e28-4543-85c6-46dcfad126ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:11.412443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2ca0-5e28-4543-85c6-46dcfad126ea None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.412744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2ca0-5e28-4543-85c6-46dcfad126ea None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.413178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce2ca0-5e28-4543-85c6-46dcfad126ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.431710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce2ca0-5e28-4543-85c6-46dcfad126ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-43ce2ca0-5e28-4543-85c6-46dcfad126ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:11.441224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:11.442256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:11.443063 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 89/177] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:11.443740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2ca0-5e28-4543-85c6-46dcfad126ea None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.458291 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:11.467647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b608b2-81c2-4d89-b5db-0a05f8031e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:11.468658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b608b2-81c2-4d89-b5db-0a05f8031e88 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.469104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b608b2-81c2-4d89-b5db-0a05f8031e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.469559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b608b2-81c2-4d89-b5db-0a05f8031e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.499276 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:11.598420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b608b2-81c2-4d89-b5db-0a05f8031e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:11.600543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b608b2-81c2-4d89-b5db-0a05f8031e88 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:11.609264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce2ca0-5e28-4543-85c6-46dcfad126ea None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:11.648010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12c3e2-7030-4d51-8d10-6784714ee2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:11.648666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12c3e2-7030-4d51-8d10-6784714ee2db None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.648931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12c3e2-7030-4d51-8d10-6784714ee2db None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.649204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12c3e2-7030-4d51-8d10-6784714ee2db None admin] PATH_INFO: `/v3/domains/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.650357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12c3e2-7030-4d51-8d10-6784714ee2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:11.651827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12c3e2-7030-4d51-8d10-6784714ee2db None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:11.653462 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 90/178] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:11.654716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12c3e2-7030-4d51-8d10-6784714ee2db None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.728316 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 89/179] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 00:28:11.729541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b608b2-81c2-4d89-b5db-0a05f8031e88 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.771399 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:11.785877 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:11.792434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12c3e2-7030-4d51-8d10-6784714ee2db None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:11.829582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e43c4-b079-44b2-b8a4-b8a3cb2014ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:11.830283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e43c4-b079-44b2-b8a4-b8a3cb2014ce None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.830633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e43c4-b079-44b2-b8a4-b8a3cb2014ce None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.831939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e43c4-b079-44b2-b8a4-b8a3cb2014ce None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.832781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e43c4-b079-44b2-b8a4-b8a3cb2014ce None admin] RBAC: Adding query filter params (name=member) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:11.833279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e43c4-b079-44b2-b8a4-b8a3cb2014ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:11.835182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e43c4-b079-44b2-b8a4-b8a3cb2014ce None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:11.853928 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 91/180] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:11.853928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e43c4-b079-44b2-b8a4-b8a3cb2014ce None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.871568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b608b2-81c2-4d89-b5db-0a05f8031e88 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:11.918111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04f145-3398-49b1-b989-802a6c92d12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:11.919070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04f145-3398-49b1-b989-802a6c92d12b None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.919533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04f145-3398-49b1-b989-802a6c92d12b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.919982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04f145-3398-49b1-b989-802a6c92d12b None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.921130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04f145-3398-49b1-b989-802a6c92d12b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:11.923596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04f145-3398-49b1-b989-802a6c92d12b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:11.968650 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 90/181] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:11 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:11.968650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04f145-3398-49b1-b989-802a6c92d12b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:11.986670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e43c4-b079-44b2-b8a4-b8a3cb2014ce None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:12.062401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d29971-0f02-4c1a-abf2-47ee2e2d3e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:12.063554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d29971-0f02-4c1a-abf2-47ee2e2d3e37 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:12.064060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d29971-0f02-4c1a-abf2-47ee2e2d3e37 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:12.064659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d29971-0f02-4c1a-abf2-47ee2e2d3e37 None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:12.067407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d29971-0f02-4c1a-abf2-47ee2e2d3e37 None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:12.070502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d29971-0f02-4c1a-abf2-47ee2e2d3e37 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:12.073556 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 92/182] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:11 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:12.083775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d29971-0f02-4c1a-abf2-47ee2e2d3e37 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:12.132490 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:12.158347 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:12.185181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04f145-3398-49b1-b989-802a6c92d12b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:12.250341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d29971-0f02-4c1a-abf2-47ee2e2d3e37 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:12.253638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3083401-c36e-4128-8075-0bb69ba8b63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:12.254746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3083401-c36e-4128-8075-0bb69ba8b63b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:12.255228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3083401-c36e-4128-8075-0bb69ba8b63b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:12.255656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3083401-c36e-4128-8075-0bb69ba8b63b None admin] PATH_INFO: `/v3/users/d1e40437d3e84a79b134e4b96868426c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:12.280484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3083401-c36e-4128-8075-0bb69ba8b63b None admin] RBAC: Authorizing `identity:get_user(user_id=d1e40437d3e84a79b134e4b96868426c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:12.282077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3083401-c36e-4128-8075-0bb69ba8b63b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:12.283829 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 91/183] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:11 2022] GET /identity/v3/users/d1e40437d3e84a79b134e4b96868426c => generated 297 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:12.291850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3083401-c36e-4128-8075-0bb69ba8b63b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:12.306576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67e467-69f2-4d45-ad37-0bcd8a9cfe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:12.307333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67e467-69f2-4d45-ad37-0bcd8a9cfe44 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:12.307701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67e467-69f2-4d45-ad37-0bcd8a9cfe44 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:12.307985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67e467-69f2-4d45-ad37-0bcd8a9cfe44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:12.310270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67e467-69f2-4d45-ad37-0bcd8a9cfe44 None admin] RBAC: Adding query filter params (role.id=36ffa4795fa248139676253d88d7e507, scope.project.id=76689a22ac724ea298a077330657115c, user.id=c46bfce16f654da3a2b17ed5002417c9) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:12.310483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67e467-69f2-4d45-ad37-0bcd8a9cfe44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:12.313147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67e467-69f2-4d45-ad37-0bcd8a9cfe44 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:12.326999 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 93/184] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:12 2022] GET /identity/v3/role_assignments?user.id=c46bfce16f654da3a2b17ed5002417c9&scope.project.id=76689a22ac724ea298a077330657115c&role.id=36ffa4795fa248139676253d88d7e507 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:12.496330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3083401-c36e-4128-8075-0bb69ba8b63b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:12.562544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58dccc-47c2-4c32-8b66-0b4d8749a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:12.563548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58dccc-47c2-4c32-8b66-0b4d8749a700 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:12.564033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58dccc-47c2-4c32-8b66-0b4d8749a700 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:12.564521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58dccc-47c2-4c32-8b66-0b4d8749a700 None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:12.567489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58dccc-47c2-4c32-8b66-0b4d8749a700 None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:12.570239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58dccc-47c2-4c32-8b66-0b4d8749a700 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:12.573532 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 92/185] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:12 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:12.581840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67e467-69f2-4d45-ad37-0bcd8a9cfe44 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:12.700302 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:12.712505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67e467-69f2-4d45-ad37-0bcd8a9cfe44 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:12.748604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e13d-29c2-4c5d-a59b-d45e1436a40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:12.749324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e13d-29c2-4c5d-a59b-d45e1436a40b None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:12.749602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e13d-29c2-4c5d-a59b-d45e1436a40b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:12.749873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e13d-29c2-4c5d-a59b-d45e1436a40b None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c/users/d1e40437d3e84a79b134e4b96868426c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:12.751866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88e13d-29c2-4c5d-a59b-d45e1436a40b None admin] RBAC: Authorizing `identity:create_grant(project_id=76689a22ac724ea298a077330657115c, user_id=d1e40437d3e84a79b134e4b96868426c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:12.754170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88e13d-29c2-4c5d-a59b-d45e1436a40b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:12.767743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 94/186] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:12 2022] PUT /identity/v3/projects/76689a22ac724ea298a077330657115c/users/d1e40437d3e84a79b134e4b96868426c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:14.516087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239488e0-2acd-4e40-9f44-60d9087d51f0 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:14.516721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239488e0-2acd-4e40-9f44-60d9087d51f0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:14.517155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239488e0-2acd-4e40-9f44-60d9087d51f0 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:14.520449 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 93/187] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:14.526433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d968e-c58f-42eb-9faf-29cbe5f63746 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:14.527236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d968e-c58f-42eb-9faf-29cbe5f63746 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:14.527236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d968e-c58f-42eb-9faf-29cbe5f63746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:14.530467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b34c6-454d-45bc-baf5-6bfd0521ed60 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:14.532665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b34c6-454d-45bc-baf5-6bfd0521ed60 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:14.532665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b34c6-454d-45bc-baf5-6bfd0521ed60 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:14.534611 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 94/188] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:14.544595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e6fcb-67be-4ab5-b11f-345802e94def None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:14.545356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e6fcb-67be-4ab5-b11f-345802e94def None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:14.545824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e6fcb-67be-4ab5-b11f-345802e94def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:14.549787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a50d968e-c58f-42eb-9faf-29cbe5f63746 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:14.551014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a50d968e-c58f-42eb-9faf-29cbe5f63746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:14.574637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e17e6fcb-67be-4ab5-b11f-345802e94def None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:14.576831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e17e6fcb-67be-4ab5-b11f-345802e94def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:14.596829 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:14.654861 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 95/189] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:14.715569 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 95/190] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:14.930225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d968e-c58f-42eb-9faf-29cbe5f63746 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:15.035708 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:15.065473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d968e-c58f-42eb-9faf-29cbe5f63746 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:15.113921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25abbe-1996-433b-ae4e-5e4bbb5c7941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:15.114583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25abbe-1996-433b-ae4e-5e4bbb5c7941 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.114860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25abbe-1996-433b-ae4e-5e4bbb5c7941 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.115137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25abbe-1996-433b-ae4e-5e4bbb5c7941 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.128570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25abbe-1996-433b-ae4e-5e4bbb5c7941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-7f25abbe-1996-433b-ae4e-5e4bbb5c7941 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:15.133807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:15.135319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:15.137465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:15.139291 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 96/191] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:15.141776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e6fcb-67be-4ab5-b11f-345802e94def None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:15.240054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25abbe-1996-433b-ae4e-5e4bbb5c7941 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:15.281211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e6fcb-67be-4ab5-b11f-345802e94def None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:15.334865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaccb3a-bd1a-45f5-a55e-101587fdc0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:15.335936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaccb3a-bd1a-45f5-a55e-101587fdc0e4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.336439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaccb3a-bd1a-45f5-a55e-101587fdc0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.336972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaccb3a-bd1a-45f5-a55e-101587fdc0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.338463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaccb3a-bd1a-45f5-a55e-101587fdc0e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:15.338957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaccb3a-bd1a-45f5-a55e-101587fdc0e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:15.340496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaccb3a-bd1a-45f5-a55e-101587fdc0e4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:15.351396 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 96/192] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:15.352996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05616aa4-f465-4a09-98a9-ad3932e88ae6 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.353395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05616aa4-f465-4a09-98a9-ad3932e88ae6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.353820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05616aa4-f465-4a09-98a9-ad3932e88ae6 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.355521 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 97/193] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:15.360499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05616aa4-f465-4a09-98a9-ad3932e88ae6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:15.375672 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:15.395428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25abbe-1996-433b-ae4e-5e4bbb5c7941 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:15.437923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dd523-9321-4425-9e9b-899c9132ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:15.438620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dd523-9321-4425-9e9b-899c9132ae74 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.439266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dd523-9321-4425-9e9b-899c9132ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.439266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dd523-9321-4425-9e9b-899c9132ae74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.441091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dd523-9321-4425-9e9b-899c9132ae74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:15.443758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dd523-9321-4425-9e9b-899c9132ae74 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:15.446710 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 97/194] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:15.448356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224debd2-3450-400a-b559-7ae77bfce055 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.448848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224debd2-3450-400a-b559-7ae77bfce055 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.449291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224debd2-3450-400a-b559-7ae77bfce055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.477653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-224debd2-3450-400a-b559-7ae77bfce055 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:15.479554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-224debd2-3450-400a-b559-7ae77bfce055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:15.483042 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:15.515280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05616aa4-f465-4a09-98a9-ad3932e88ae6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:15.573112 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 98/195] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:15.573962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224debd2-3450-400a-b559-7ae77bfce055 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:15.575173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbcf2b-81ea-4957-93c8-fd2900c358c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:15.576272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbcf2b-81ea-4957-93c8-fd2900c358c3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.576804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbcf2b-81ea-4957-93c8-fd2900c358c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.577288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbcf2b-81ea-4957-93c8-fd2900c358c3 None admin] PATH_INFO: `/v3/users/7a159ec36422478aac3a7676c0df1951` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.601060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbcf2b-81ea-4957-93c8-fd2900c358c3 None admin] RBAC: Authorizing `identity:get_user(user_id=7a159ec36422478aac3a7676c0df1951)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:15.602717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbcf2b-81ea-4957-93c8-fd2900c358c3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:15.605523 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 98/196] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:15 2022] GET /identity/v3/users/7a159ec36422478aac3a7676c0df1951 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:15.611749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbcf2b-81ea-4957-93c8-fd2900c358c3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:15.697157 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:15.758588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbcf2b-81ea-4957-93c8-fd2900c358c3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:15.771897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224debd2-3450-400a-b559-7ae77bfce055 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:15.821638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e71ac-7c72-4b71-900b-507632a4f96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:15.822494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e71ac-7c72-4b71-900b-507632a4f96c None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.822961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e71ac-7c72-4b71-900b-507632a4f96c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.823361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e71ac-7c72-4b71-900b-507632a4f96c None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.824230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e71ac-7c72-4b71-900b-507632a4f96c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:15.826081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e71ac-7c72-4b71-900b-507632a4f96c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:15.826590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350b94b-1d36-4f8b-b009-b31aacdd6551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:15.827682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b94b-1d36-4f8b-b009-b31aacdd6551 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.828190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b94b-1d36-4f8b-b009-b31aacdd6551 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.828720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b94b-1d36-4f8b-b009-b31aacdd6551 None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.831382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350b94b-1d36-4f8b-b009-b31aacdd6551 None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:15.834993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350b94b-1d36-4f8b-b009-b31aacdd6551 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:15.839059 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:15.839731 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 99/197] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:15 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:15.849525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350b94b-1d36-4f8b-b009-b31aacdd6551 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:15.858886 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 99/198] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:15 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:15.860731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e71ac-7c72-4b71-900b-507632a4f96c None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:16.040249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e71ac-7c72-4b71-900b-507632a4f96c None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:16.046284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350b94b-1d36-4f8b-b009-b31aacdd6551 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:16.094188 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:16.104437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a491-f158-484e-bb67-f5a1be8e86be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:16.105541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a491-f158-484e-bb67-f5a1be8e86be None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:16.105965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a491-f158-484e-bb67-f5a1be8e86be None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:16.106372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a491-f158-484e-bb67-f5a1be8e86be None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c/users/7a159ec36422478aac3a7676c0df1951/roles/b1b6bcd683ae410db592b5c0d447e25f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:16.110070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2a491-f158-484e-bb67-f5a1be8e86be None admin] RBAC: Authorizing `identity:create_grant(project_id=76689a22ac724ea298a077330657115c, user_id=7a159ec36422478aac3a7676c0df1951, role_id=b1b6bcd683ae410db592b5c0d447e25f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:16.111089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2a491-f158-484e-bb67-f5a1be8e86be None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:16.117564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcda55e-1ddd-4c5e-a1d4-c4a8e933f278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:16.118247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda55e-1ddd-4c5e-a1d4-c4a8e933f278 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:16.118524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda55e-1ddd-4c5e-a1d4-c4a8e933f278 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:16.118792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda55e-1ddd-4c5e-a1d4-c4a8e933f278 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:16.132645 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 100/199] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:15 2022] PUT /identity/v3/projects/76689a22ac724ea298a077330657115c/users/7a159ec36422478aac3a7676c0df1951/roles/b1b6bcd683ae410db592b5c0d447e25f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:28:16.137390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcda55e-1ddd-4c5e-a1d4-c4a8e933f278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-2bcda55e-1ddd-4c5e-a1d4-c4a8e933f278 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:16.148303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:16.149452 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:16.150360 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:16.153743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 100/200] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:16.158638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a491-f158-484e-bb67-f5a1be8e86be None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:16.334457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a491-f158-484e-bb67-f5a1be8e86be None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:16.386370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32fef6-4a2b-48fc-97eb-7fd93dfceace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:16.387011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32fef6-4a2b-48fc-97eb-7fd93dfceace None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:16.387289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32fef6-4a2b-48fc-97eb-7fd93dfceace None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:16.387563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32fef6-4a2b-48fc-97eb-7fd93dfceace None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:16.388265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32fef6-4a2b-48fc-97eb-7fd93dfceace None admin] RBAC: Adding query filter params (name=member) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:16.388564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32fef6-4a2b-48fc-97eb-7fd93dfceace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:16.390021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32fef6-4a2b-48fc-97eb-7fd93dfceace None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:16.406163 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 101/201] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:16.417270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcda55e-1ddd-4c5e-a1d4-c4a8e933f278 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:16.526643 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:16.618358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcda55e-1ddd-4c5e-a1d4-c4a8e933f278 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:16.685607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e7edd-2adf-49f2-b3fb-a370d8914488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:16.686704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e7edd-2adf-49f2-b3fb-a370d8914488 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:16.687200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e7edd-2adf-49f2-b3fb-a370d8914488 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:16.687679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e7edd-2adf-49f2-b3fb-a370d8914488 None admin] PATH_INFO: `/v3/users/d1e40437d3e84a79b134e4b96868426c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:16.689781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e7edd-2adf-49f2-b3fb-a370d8914488 None admin] RBAC: Authorizing `identity:get_user(user_id=d1e40437d3e84a79b134e4b96868426c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:16.693198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e7edd-2adf-49f2-b3fb-a370d8914488 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:16.696241 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 101/202] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:16 2022] GET /identity/v3/users/d1e40437d3e84a79b134e4b96868426c => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:16.705484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32fef6-4a2b-48fc-97eb-7fd93dfceace None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:16.815956 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:16.908785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32fef6-4a2b-48fc-97eb-7fd93dfceace None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:16.972810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d80fc-2358-443b-ab13-81c915da108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:16.973855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d80fc-2358-443b-ab13-81c915da108c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:16.974349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d80fc-2358-443b-ab13-81c915da108c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:16.974830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d80fc-2358-443b-ab13-81c915da108c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:17.081741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d80fc-2358-443b-ab13-81c915da108c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:17.083433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d80fc-2358-443b-ab13-81c915da108c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:17.150137 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:17.209542 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 102/203] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:28:17.213594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e7edd-2adf-49f2-b3fb-a370d8914488 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:17.382498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e7edd-2adf-49f2-b3fb-a370d8914488 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:17.427688 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:17.452738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8df492-fec0-467d-8be3-82cd06bec4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:17.453791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df492-fec0-467d-8be3-82cd06bec4ad None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:17.454252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df492-fec0-467d-8be3-82cd06bec4ad None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:17.454737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df492-fec0-467d-8be3-82cd06bec4ad None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:17.457971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8df492-fec0-467d-8be3-82cd06bec4ad None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:17.461318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8df492-fec0-467d-8be3-82cd06bec4ad None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:17.465278 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 102/204] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:17 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:17.474386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d80fc-2358-443b-ab13-81c915da108c None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:17.598658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d80fc-2358-443b-ab13-81c915da108c None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:17.641956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4d825-6ff0-4c57-8a14-28a398c48e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:17.642607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4d825-6ff0-4c57-8a14-28a398c48e8c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:17.642890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4d825-6ff0-4c57-8a14-28a398c48e8c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:17.643158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4d825-6ff0-4c57-8a14-28a398c48e8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:17.643979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4d825-6ff0-4c57-8a14-28a398c48e8c None admin] RBAC: Adding query filter params (role.id=2eefb0a36d0744ec8e25b5669af179cf, scope.project.id=76689a22ac724ea298a077330657115c, user.id=d1e40437d3e84a79b134e4b96868426c) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:17.644291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4d825-6ff0-4c57-8a14-28a398c48e8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:17.645843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4d825-6ff0-4c57-8a14-28a398c48e8c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:17.656781 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 103/205] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:17 2022] GET /identity/v3/role_assignments?user.id=d1e40437d3e84a79b134e4b96868426c&scope.project.id=76689a22ac724ea298a077330657115c&role.id=2eefb0a36d0744ec8e25b5669af179cf => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:18.689499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf2399-325d-4588-982a-6c7e8719d2dc None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:18.690319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf2399-325d-4588-982a-6c7e8719d2dc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:18.690319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf2399-325d-4588-982a-6c7e8719d2dc None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:18.691707 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 103/206] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:28:18.697350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203ede9-1524-41ea-8fc6-3d6b5dc53eb6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:18.698132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203ede9-1524-41ea-8fc6-3d6b5dc53eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:18.698132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203ede9-1524-41ea-8fc6-3d6b5dc53eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:18.718057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7203ede9-1524-41ea-8fc6-3d6b5dc53eb6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:18.719286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7203ede9-1524-41ea-8fc6-3d6b5dc53eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:18.737873 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:18.808236 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 104/207] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:19.086265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf2399-325d-4588-982a-6c7e8719d2dc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:19.236839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf2399-325d-4588-982a-6c7e8719d2dc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:19.274521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086271f-8f09-4d7d-837b-2186379b0bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:19.275326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086271f-8f09-4d7d-837b-2186379b0bbd None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.275609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086271f-8f09-4d7d-837b-2186379b0bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.275883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086271f-8f09-4d7d-837b-2186379b0bbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.287677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086271f-8f09-4d7d-837b-2186379b0bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-d086271f-8f09-4d7d-837b-2186379b0bbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:19.293175 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:19.294111 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:19.294900 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 104/208] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:19.302488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203ede9-1524-41ea-8fc6-3d6b5dc53eb6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:19.357951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504a8b7-412b-4757-b986-1c24678dd4e0 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.358427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504a8b7-412b-4757-b986-1c24678dd4e0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.358905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504a8b7-412b-4757-b986-1c24678dd4e0 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.364702 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 105/209] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:19.367867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd62b1-813e-46c9-88d2-b34f8380e575 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.368146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd62b1-813e-46c9-88d2-b34f8380e575 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.368418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd62b1-813e-46c9-88d2-b34f8380e575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.387672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b2dd62b1-813e-46c9-88d2-b34f8380e575 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:19.388916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b2dd62b1-813e-46c9-88d2-b34f8380e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:19.434701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203ede9-1524-41ea-8fc6-3d6b5dc53eb6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:19.467744 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:19.485531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21682146-94f4-4dc0-a032-d3c93d97932f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:19.487146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21682146-94f4-4dc0-a032-d3c93d97932f None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.487902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21682146-94f4-4dc0-a032-d3c93d97932f None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.488350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21682146-94f4-4dc0-a032-d3c93d97932f None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.489761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21682146-94f4-4dc0-a032-d3c93d97932f None admin] RBAC: Adding query filter params (name=member) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:19.490255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21682146-94f4-4dc0-a032-d3c93d97932f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:19.492517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21682146-94f4-4dc0-a032-d3c93d97932f None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:19.500719 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 106/210] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:19.512699 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 105/211] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:19.519283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd62b1-813e-46c9-88d2-b34f8380e575 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:19.646732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd62b1-813e-46c9-88d2-b34f8380e575 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:19.682641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9591-105b-424a-a372-11c8ad1875bd None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.683187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9591-105b-424a-a372-11c8ad1875bd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.683536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9591-105b-424a-a372-11c8ad1875bd None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.685538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 106/212] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:28:19.686514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633b7a4-76a1-4257-ad38-1791cf6ea125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:19.687168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633b7a4-76a1-4257-ad38-1791cf6ea125 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.687444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633b7a4-76a1-4257-ad38-1791cf6ea125 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.687705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633b7a4-76a1-4257-ad38-1791cf6ea125 None admin] PATH_INFO: `/v3/users/06ce3bba9c48436ba43d4c99165b998b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.692885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ac9b1-137e-49a5-a28e-51c8c5305ece None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.693324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ac9b1-137e-49a5-a28e-51c8c5305ece None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.693721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ac9b1-137e-49a5-a28e-51c8c5305ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.705703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633b7a4-76a1-4257-ad38-1791cf6ea125 None admin] RBAC: Authorizing `identity:get_user(user_id=06ce3bba9c48436ba43d4c99165b998b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:19.707893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633b7a4-76a1-4257-ad38-1791cf6ea125 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:19.710585 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 107/213] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:19 2022] GET /identity/v3/users/06ce3bba9c48436ba43d4c99165b998b => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:19.715945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3d8ac9b1-137e-49a5-a28e-51c8c5305ece None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:19.716838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633b7a4-76a1-4257-ad38-1791cf6ea125 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:19.717702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3d8ac9b1-137e-49a5-a28e-51c8c5305ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:19.721621 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:19.763722 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:19.815551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 107/214] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:19.869354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633b7a4-76a1-4257-ad38-1791cf6ea125 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:19.930082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56fc3-22fc-41e2-890f-19a8c7c9877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:19.931575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56fc3-22fc-41e2-890f-19a8c7c9877a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.932315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56fc3-22fc-41e2-890f-19a8c7c9877a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.933056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56fc3-22fc-41e2-890f-19a8c7c9877a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.934644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c56fc3-22fc-41e2-890f-19a8c7c9877a None admin] RBAC: Adding query filter params (role.id=2eefb0a36d0744ec8e25b5669af179cf, user.id=06ce3bba9c48436ba43d4c99165b998b, scope.system=all) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:19.935450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c56fc3-22fc-41e2-890f-19a8c7c9877a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:19.938444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c56fc3-22fc-41e2-890f-19a8c7c9877a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:19.948953 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 108/215] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Oct 19 00:28:19 2022] GET /identity/v3/role_assignments?user.id=06ce3bba9c48436ba43d4c99165b998b&scope.system=all&role.id=2eefb0a36d0744ec8e25b5669af179cf => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:20.029146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ac9b1-137e-49a5-a28e-51c8c5305ece None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:20.150556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56fc3-22fc-41e2-890f-19a8c7c9877a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:20.224700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ac9b1-137e-49a5-a28e-51c8c5305ece None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:20.273685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56fc3-22fc-41e2-890f-19a8c7c9877a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:20.275476 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:20.289345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907315f-1a91-4e64-af82-8108283a82c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:20.290441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907315f-1a91-4e64-af82-8108283a82c3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.290947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907315f-1a91-4e64-af82-8108283a82c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.291443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907315f-1a91-4e64-af82-8108283a82c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:20.293348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907315f-1a91-4e64-af82-8108283a82c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:20.295823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907315f-1a91-4e64-af82-8108283a82c3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:20.299028 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 108/216] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:20.307909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907315f-1a91-4e64-af82-8108283a82c3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:20.316437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26d948-b7da-4e41-a21e-01520471159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:20.317136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26d948-b7da-4e41-a21e-01520471159b None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.317409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26d948-b7da-4e41-a21e-01520471159b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.317677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26d948-b7da-4e41-a21e-01520471159b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:20.321067 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:20.332533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26d948-b7da-4e41-a21e-01520471159b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-4c26d948-b7da-4e41-a21e-01520471159b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:20.337502 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:20.339425 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:20.341067 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 109/217] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:20.345032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26d948-b7da-4e41-a21e-01520471159b None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:20.441743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907315f-1a91-4e64-af82-8108283a82c3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:20.466706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26d948-b7da-4e41-a21e-01520471159b None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:20.484556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eebc8-379b-4d2f-b18b-ad2859b9e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:20.485542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eebc8-379b-4d2f-b18b-ad2859b9e2e9 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.486032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eebc8-379b-4d2f-b18b-ad2859b9e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.486493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eebc8-379b-4d2f-b18b-ad2859b9e2e9 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:20.488526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8eebc8-379b-4d2f-b18b-ad2859b9e2e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:20.491852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8eebc8-379b-4d2f-b18b-ad2859b9e2e9 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:20.505936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7cac9-8cc6-4852-beeb-7dd8250a55a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:20.506555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7cac9-8cc6-4852-beeb-7dd8250a55a9 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.506846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7cac9-8cc6-4852-beeb-7dd8250a55a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.507106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7cac9-8cc6-4852-beeb-7dd8250a55a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:20.507775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7cac9-8cc6-4852-beeb-7dd8250a55a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:20.508074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7cac9-8cc6-4852-beeb-7dd8250a55a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:20.509529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7cac9-8cc6-4852-beeb-7dd8250a55a9 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:20.519134 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 110/218] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:20.523210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 109/219] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:20 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:28:20.525196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7cac9-8cc6-4852-beeb-7dd8250a55a9 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:20.556416 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:20.645976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7cac9-8cc6-4852-beeb-7dd8250a55a9 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:20.689124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995921b-1afd-41fa-8b9e-2fdca92df02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:20.689782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995921b-1afd-41fa-8b9e-2fdca92df02e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.690582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995921b-1afd-41fa-8b9e-2fdca92df02e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.690902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995921b-1afd-41fa-8b9e-2fdca92df02e None admin] PATH_INFO: `/v3/users/7a159ec36422478aac3a7676c0df1951` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:20.692121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995921b-1afd-41fa-8b9e-2fdca92df02e None admin] RBAC: Authorizing `identity:get_user(user_id=7a159ec36422478aac3a7676c0df1951)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:20.693672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995921b-1afd-41fa-8b9e-2fdca92df02e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:20.700073 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 111/220] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:20 2022] GET /identity/v3/users/7a159ec36422478aac3a7676c0df1951 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:20.701458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eebc8-379b-4d2f-b18b-ad2859b9e2e9 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:20.816164 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:20.885368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eebc8-379b-4d2f-b18b-ad2859b9e2e9 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:20.938510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f05a41-ac09-4998-9ef1-21f300721f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:20.939915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f05a41-ac09-4998-9ef1-21f300721f3b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:20.941242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f05a41-ac09-4998-9ef1-21f300721f3b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:20.941964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f05a41-ac09-4998-9ef1-21f300721f3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:21.042221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f05a41-ac09-4998-9ef1-21f300721f3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:21.043866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f05a41-ac09-4998-9ef1-21f300721f3b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:21.185539 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:21.270288 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 110/221] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 00:28:21.276708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995921b-1afd-41fa-8b9e-2fdca92df02e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:21.452742 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:21.473831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995921b-1afd-41fa-8b9e-2fdca92df02e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:21.538982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47d292-2eeb-4d17-9327-66fa484403a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:21.540123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47d292-2eeb-4d17-9327-66fa484403a8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:21.540611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47d292-2eeb-4d17-9327-66fa484403a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:21.541132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47d292-2eeb-4d17-9327-66fa484403a8 None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:21.543236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47d292-2eeb-4d17-9327-66fa484403a8 None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:21.545991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47d292-2eeb-4d17-9327-66fa484403a8 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:21.550325 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 112/222] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:21 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:21.560099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f05a41-ac09-4998-9ef1-21f300721f3b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:21.680531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f05a41-ac09-4998-9ef1-21f300721f3b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:21.722411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78819aa3-8534-4923-bb58-84f999300691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:21.722941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78819aa3-8534-4923-bb58-84f999300691 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:21.723217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78819aa3-8534-4923-bb58-84f999300691 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:21.723489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78819aa3-8534-4923-bb58-84f999300691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:21.724234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78819aa3-8534-4923-bb58-84f999300691 None admin] RBAC: Adding query filter params (role.id=b1b6bcd683ae410db592b5c0d447e25f, scope.project.id=76689a22ac724ea298a077330657115c, user.id=7a159ec36422478aac3a7676c0df1951) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:21.724538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78819aa3-8534-4923-bb58-84f999300691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:21.726040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78819aa3-8534-4923-bb58-84f999300691 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:21.733234 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 111/223] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:28:21 2022] GET /identity/v3/role_assignments?user.id=7a159ec36422478aac3a7676c0df1951&scope.project.id=76689a22ac724ea298a077330657115c&role.id=b1b6bcd683ae410db592b5c0d447e25f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:22.752208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea62e84-ba1e-45f4-9941-b04c0126f45a None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:22.753935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea62e84-ba1e-45f4-9941-b04c0126f45a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:22.753935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea62e84-ba1e-45f4-9941-b04c0126f45a None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:22.755844 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 113/224] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:22.761759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324870-76a1-4ef3-afc2-d23ec862a124 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:22.762720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324870-76a1-4ef3-afc2-d23ec862a124 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:22.762720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324870-76a1-4ef3-afc2-d23ec862a124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:22.783459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-47324870-76a1-4ef3-afc2-d23ec862a124 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:22.785731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-47324870-76a1-4ef3-afc2-d23ec862a124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:22.816023 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:22.873036 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 112/225] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:23.150775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea62e84-ba1e-45f4-9941-b04c0126f45a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:23.340776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea62e84-ba1e-45f4-9941-b04c0126f45a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:23.404255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7a87f-6be7-451e-9720-14e6838675e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:23.405420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7a87f-6be7-451e-9720-14e6838675e4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.405936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7a87f-6be7-451e-9720-14e6838675e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.406439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7a87f-6be7-451e-9720-14e6838675e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.427779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7a87f-6be7-451e-9720-14e6838675e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-c7d7a87f-6be7-451e-9720-14e6838675e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:23.438768 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:23.439746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:23.445664 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 114/226] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:23.447910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324870-76a1-4ef3-afc2-d23ec862a124 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:23.572554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324870-76a1-4ef3-afc2-d23ec862a124 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:23.606162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94ffc-07bf-4be0-8e78-1764d4482fc4 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.608173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94ffc-07bf-4be0-8e78-1764d4482fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.608872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94ffc-07bf-4be0-8e78-1764d4482fc4 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.612041 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 115/227] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:23.615849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37b2fc-44b6-4109-918e-1fb5487cf077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:23.616476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37b2fc-44b6-4109-918e-1fb5487cf077 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.616799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37b2fc-44b6-4109-918e-1fb5487cf077 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.617062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37b2fc-44b6-4109-918e-1fb5487cf077 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.617736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37b2fc-44b6-4109-918e-1fb5487cf077 None admin] RBAC: Adding query filter params (name=member) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:23.618038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37b2fc-44b6-4109-918e-1fb5487cf077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:23.619448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37b2fc-44b6-4109-918e-1fb5487cf077 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:23.620542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237de621-198d-40cc-936e-7a582b8f1310 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.621337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237de621-198d-40cc-936e-7a582b8f1310 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.622122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237de621-198d-40cc-936e-7a582b8f1310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.629937 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 113/228] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:23.636023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37b2fc-44b6-4109-918e-1fb5487cf077 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:23.657608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-237de621-198d-40cc-936e-7a582b8f1310 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:23.658862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-237de621-198d-40cc-936e-7a582b8f1310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:23.677437 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:23.682108 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:23.773230 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 116/229] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:23.812109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37b2fc-44b6-4109-918e-1fb5487cf077 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:23.879917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b159f-3338-4214-9faf-5c67c142ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:23.880946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b159f-3338-4214-9faf-5c67c142ec04 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.881431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b159f-3338-4214-9faf-5c67c142ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.881920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b159f-3338-4214-9faf-5c67c142ec04 None admin] PATH_INFO: `/v3/users/06ce3bba9c48436ba43d4c99165b998b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.883942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b159f-3338-4214-9faf-5c67c142ec04 None admin] RBAC: Authorizing `identity:get_user(user_id=06ce3bba9c48436ba43d4c99165b998b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:23.886597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b159f-3338-4214-9faf-5c67c142ec04 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:23.889858 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 114/230] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:23 2022] GET /identity/v3/users/06ce3bba9c48436ba43d4c99165b998b => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:23.899746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237de621-198d-40cc-936e-7a582b8f1310 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:24.081815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b159f-3338-4214-9faf-5c67c142ec04 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:24.098381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237de621-198d-40cc-936e-7a582b8f1310 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:24.173137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb680d-2fe3-4984-8133-eab9f3ed3b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:24.175313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb680d-2fe3-4984-8133-eab9f3ed3b41 None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:24.176005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb680d-2fe3-4984-8133-eab9f3ed3b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:24.176496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb680d-2fe3-4984-8133-eab9f3ed3b41 None admin] PATH_INFO: `/v3/system/users/06ce3bba9c48436ba43d4c99165b998b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:24.179087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb680d-2fe3-4984-8133-eab9f3ed3b41 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=06ce3bba9c48436ba43d4c99165b998b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:24.181765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb680d-2fe3-4984-8133-eab9f3ed3b41 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:24.199824 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 117/231] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Oct 19 00:28:23 2022] PUT /identity/v3/system/users/06ce3bba9c48436ba43d4c99165b998b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:28:24.226027 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:24.245432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b159f-3338-4214-9faf-5c67c142ec04 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:24.254684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94142-1bbe-4433-ba3a-a7baf16a1ab7 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:24.254978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94142-1bbe-4433-ba3a-a7baf16a1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:24.255232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94142-1bbe-4433-ba3a-a7baf16a1ab7 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:24.256897 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 118/232] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:28:24.264117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5542e1-124c-4196-8af4-c72c9146fa50 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:24.264611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5542e1-124c-4196-8af4-c72c9146fa50 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:24.265269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5542e1-124c-4196-8af4-c72c9146fa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:24.287812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0d5542e1-124c-4196-8af4-c72c9146fa50 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:24.289099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0d5542e1-124c-4196-8af4-c72c9146fa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:24.292001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5089e8-ed6f-4797-8e7a-1c63f29153d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:24.292709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5089e8-ed6f-4797-8e7a-1c63f29153d0 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:24.293020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5089e8-ed6f-4797-8e7a-1c63f29153d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:24.293295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5089e8-ed6f-4797-8e7a-1c63f29153d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:24.294596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5089e8-ed6f-4797-8e7a-1c63f29153d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:24.296125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5089e8-ed6f-4797-8e7a-1c63f29153d0 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:24.300661 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 115/233] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:24.305612 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:24.307319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5089e8-ed6f-4797-8e7a-1c63f29153d0 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:24.380072 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 119/234] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:24.444404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5089e8-ed6f-4797-8e7a-1c63f29153d0 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:24.490721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2d8aa-15c5-4234-89e1-6e2a5f677767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:24.491352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2d8aa-15c5-4234-89e1-6e2a5f677767 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:24.491634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2d8aa-15c5-4234-89e1-6e2a5f677767 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:24.491911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2d8aa-15c5-4234-89e1-6e2a5f677767 None admin] PATH_INFO: `/v3/groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:24.492709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2d8aa-15c5-4234-89e1-6e2a5f677767 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:24.494128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2d8aa-15c5-4234-89e1-6e2a5f677767 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:24.512998 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 116/235] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Oct 19 00:28:24 2022] POST /identity/v3/groups => generated 229 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:24.690413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5542e1-124c-4196-8af4-c72c9146fa50 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:24.831441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5542e1-124c-4196-8af4-c72c9146fa50 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:24.888781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47029d-e1d7-4b03-b7bf-22a7c5551d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:24.890167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47029d-e1d7-4b03-b7bf-22a7c5551d12 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:24.890889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47029d-e1d7-4b03-b7bf-22a7c5551d12 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:24.891587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47029d-e1d7-4b03-b7bf-22a7c5551d12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:24.912135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47029d-e1d7-4b03-b7bf-22a7c5551d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-4a47029d-e1d7-4b03-b7bf-22a7c5551d12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:24.921155 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:24.922780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:24.924866 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 120/236] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:24.936177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2d8aa-15c5-4234-89e1-6e2a5f677767 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:24.974923 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:25.162565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2d8aa-15c5-4234-89e1-6e2a5f677767 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:25.229867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17670eb5-9fdc-4068-92a7-bfe2192f2898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:25.229867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17670eb5-9fdc-4068-92a7-bfe2192f2898 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:25.229867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17670eb5-9fdc-4068-92a7-bfe2192f2898 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:25.229867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17670eb5-9fdc-4068-92a7-bfe2192f2898 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:25.230495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17670eb5-9fdc-4068-92a7-bfe2192f2898 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:25.230973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17670eb5-9fdc-4068-92a7-bfe2192f2898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:25.233526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17670eb5-9fdc-4068-92a7-bfe2192f2898 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:25.249925 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 117/237] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:25.259155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47029d-e1d7-4b03-b7bf-22a7c5551d12 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:25.266859 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:25.457783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47029d-e1d7-4b03-b7bf-22a7c5551d12 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:25.518958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846fa67-75fe-4b7d-a49e-2e6ab9e4bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:25.520032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846fa67-75fe-4b7d-a49e-2e6ab9e4bc50 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:25.520507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846fa67-75fe-4b7d-a49e-2e6ab9e4bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:25.521034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846fa67-75fe-4b7d-a49e-2e6ab9e4bc50 None admin] PATH_INFO: `/v3/users/ed0d54ae5db24f0fb0a1d3490b8ca4ca` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:25.547066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846fa67-75fe-4b7d-a49e-2e6ab9e4bc50 None admin] RBAC: Authorizing `identity:get_user(user_id=ed0d54ae5db24f0fb0a1d3490b8ca4ca)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:25.550457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846fa67-75fe-4b7d-a49e-2e6ab9e4bc50 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:25.553815 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 121/238] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:25 2022] GET /identity/v3/users/ed0d54ae5db24f0fb0a1d3490b8ca4ca => generated 293 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:25.563012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17670eb5-9fdc-4068-92a7-bfe2192f2898 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:25.714047 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:25.759187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17670eb5-9fdc-4068-92a7-bfe2192f2898 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:25.822515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdc456-d9f2-4845-8990-09ac8c546b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:25.823530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdc456-d9f2-4845-8990-09ac8c546b70 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:25.823973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdc456-d9f2-4845-8990-09ac8c546b70 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:25.824447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdc456-d9f2-4845-8990-09ac8c546b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:25.825802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdc456-d9f2-4845-8990-09ac8c546b70 None admin] RBAC: Adding query filter params (role.id=b1b6bcd683ae410db592b5c0d447e25f, user.id=ed0d54ae5db24f0fb0a1d3490b8ca4ca, scope.system=all) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:25.826313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdc456-d9f2-4845-8990-09ac8c546b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:25.828991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdc456-d9f2-4845-8990-09ac8c546b70 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:25.839708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 118/239] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Oct 19 00:28:25 2022] GET /identity/v3/role_assignments?user.id=ed0d54ae5db24f0fb0a1d3490b8ca4ca&scope.system=all&role.id=b1b6bcd683ae410db592b5c0d447e25f => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:26.590105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129e2a-fde9-44f2-afd9-a30b6f2a0f7a None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:26.590660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129e2a-fde9-44f2-afd9-a30b6f2a0f7a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:26.591082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129e2a-fde9-44f2-afd9-a30b6f2a0f7a None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:26.593708 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 122/240] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:26.600407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bd22c-1c83-46b4-a777-852e9e43ac77 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:26.601163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bd22c-1c83-46b4-a777-852e9e43ac77 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:26.601163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bd22c-1c83-46b4-a777-852e9e43ac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:26.630688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e81bd22c-1c83-46b4-a777-852e9e43ac77 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:26.631899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e81bd22c-1c83-46b4-a777-852e9e43ac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:26.710156 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 119/241] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:26.989474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b129e2a-fde9-44f2-afd9-a30b6f2a0f7a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:27.070118 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:27.137720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b129e2a-fde9-44f2-afd9-a30b6f2a0f7a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:27.203067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed87be-e78d-431a-b867-47108661cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:27.204047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed87be-e78d-431a-b867-47108661cf69 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:27.204529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed87be-e78d-431a-b867-47108661cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:27.205057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed87be-e78d-431a-b867-47108661cf69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:27.227161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed87be-e78d-431a-b867-47108661cf69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-a0ed87be-e78d-431a-b867-47108661cf69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:27.237536 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:27.238528 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:27.239316 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:27.239971 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 123/242] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:27.248990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bd22c-1c83-46b4-a777-852e9e43ac77 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:27.334131 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:27.371064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bd22c-1c83-46b4-a777-852e9e43ac77 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:27.411963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50bf6b-2a1a-4aa6-99b5-97680fe84991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:27.412593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50bf6b-2a1a-4aa6-99b5-97680fe84991 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:27.412901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50bf6b-2a1a-4aa6-99b5-97680fe84991 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:27.413175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50bf6b-2a1a-4aa6-99b5-97680fe84991 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:27.413854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50bf6b-2a1a-4aa6-99b5-97680fe84991 None admin] RBAC: Adding query filter params (name=member) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:27.414155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50bf6b-2a1a-4aa6-99b5-97680fe84991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:27.415567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50bf6b-2a1a-4aa6-99b5-97680fe84991 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:27.425904 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 120/243] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:27.432202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed87be-e78d-431a-b867-47108661cf69 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:27.627144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed87be-e78d-431a-b867-47108661cf69 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:27.671941 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:27.693940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28017d-a6d0-4951-b977-250ec326d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:27.695037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28017d-a6d0-4951-b977-250ec326d14a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:27.695519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28017d-a6d0-4951-b977-250ec326d14a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:27.695988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28017d-a6d0-4951-b977-250ec326d14a None admin] PATH_INFO: `/v3/users/06ce3bba9c48436ba43d4c99165b998b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:27.697972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28017d-a6d0-4951-b977-250ec326d14a None admin] RBAC: Authorizing `identity:get_user(user_id=06ce3bba9c48436ba43d4c99165b998b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:27.700516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28017d-a6d0-4951-b977-250ec326d14a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:27.708504 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 124/244] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:27 2022] GET /identity/v3/users/06ce3bba9c48436ba43d4c99165b998b => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:27.708913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19900-af0a-467a-93f4-702ade27d3bf None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:27.708913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19900-af0a-467a-93f4-702ade27d3bf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:27.708913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19900-af0a-467a-93f4-702ade27d3bf None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:27.709979 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 121/245] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:27.711406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28017d-a6d0-4951-b977-250ec326d14a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:27.716385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6b7cf-6baa-4d5d-9964-df8bd60b5a0f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:27.716913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6b7cf-6baa-4d5d-9964-df8bd60b5a0f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:27.717185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6b7cf-6baa-4d5d-9964-df8bd60b5a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:27.738629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-deb6b7cf-6baa-4d5d-9964-df8bd60b5a0f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:27.739820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-deb6b7cf-6baa-4d5d-9964-df8bd60b5a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:27.855411 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 122/246] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:27.894883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28017d-a6d0-4951-b977-250ec326d14a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:27.964762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c70fa-532f-4661-8e4c-047037c55d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:27.965800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c70fa-532f-4661-8e4c-047037c55d38 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:27.966290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c70fa-532f-4661-8e4c-047037c55d38 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:27.966775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c70fa-532f-4661-8e4c-047037c55d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:27.968143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c70fa-532f-4661-8e4c-047037c55d38 None admin] RBAC: Adding query filter params (role.id=2eefb0a36d0744ec8e25b5669af179cf, user.id=06ce3bba9c48436ba43d4c99165b998b, scope.system=all) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:27.968721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c70fa-532f-4661-8e4c-047037c55d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:27.971636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c70fa-532f-4661-8e4c-047037c55d38 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:27.995385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 125/247] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Oct 19 00:28:27 2022] GET /identity/v3/role_assignments?user.id=06ce3bba9c48436ba43d4c99165b998b&scope.system=all&role.id=2eefb0a36d0744ec8e25b5669af179cf => generated 510 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:28.179016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6b7cf-6baa-4d5d-9964-df8bd60b5a0f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:28.256961 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:28.309334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6b7cf-6baa-4d5d-9964-df8bd60b5a0f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:28.352792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad91ed-8cd8-4814-b3ea-b988235e915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:28.353440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad91ed-8cd8-4814-b3ea-b988235e915a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:28.353713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad91ed-8cd8-4814-b3ea-b988235e915a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:28.353983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad91ed-8cd8-4814-b3ea-b988235e915a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:28.355200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad91ed-8cd8-4814-b3ea-b988235e915a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:28.356702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad91ed-8cd8-4814-b3ea-b988235e915a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:28.358349 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 123/248] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:28.364189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c70fa-532f-4661-8e4c-047037c55d38 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:28.418289 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:28.474789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c70fa-532f-4661-8e4c-047037c55d38 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:28.523557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b555c15-c6b7-44c5-baf6-7dabb19ab8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:28.524196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b555c15-c6b7-44c5-baf6-7dabb19ab8e3 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:28.524454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b555c15-c6b7-44c5-baf6-7dabb19ab8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:28.524756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b555c15-c6b7-44c5-baf6-7dabb19ab8e3 None admin] PATH_INFO: `/v3/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:28.525417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b555c15-c6b7-44c5-baf6-7dabb19ab8e3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:28.526882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b555c15-c6b7-44c5-baf6-7dabb19ab8e3 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:28.546141 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 126/249] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Oct 19 00:28:28 2022] POST /identity/v3/groups => generated 226 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:29.494063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3965-d2dd-40e8-a411-26aff5f6f625 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:29.494582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3965-d2dd-40e8-a411-26aff5f6f625 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:29.494687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3965-d2dd-40e8-a411-26aff5f6f625 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:29.496303 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 124/250] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:28:29.506712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759a69-3d3b-4ff9-b019-d14f5b584ba5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:29.507221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759a69-3d3b-4ff9-b019-d14f5b584ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:29.507696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759a69-3d3b-4ff9-b019-d14f5b584ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:29.540134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-49759a69-3d3b-4ff9-b019-d14f5b584ba5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:29.542260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-49759a69-3d3b-4ff9-b019-d14f5b584ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:29.670064 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 127/251] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:30.280656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a3965-d2dd-40e8-a411-26aff5f6f625 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:30.510501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a3965-d2dd-40e8-a411-26aff5f6f625 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:30.579862 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:30.593925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56407dc6-286b-4bb2-9de0-541df2c47f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:30.594921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407dc6-286b-4bb2-9de0-541df2c47f12 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:30.595317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407dc6-286b-4bb2-9de0-541df2c47f12 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:30.595702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407dc6-286b-4bb2-9de0-541df2c47f12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:30.618147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56407dc6-286b-4bb2-9de0-541df2c47f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-56407dc6-286b-4bb2-9de0-541df2c47f12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:30.629147 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:30.630073 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:30.630883 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:30.635856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 125/252] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:30.637873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49759a69-3d3b-4ff9-b019-d14f5b584ba5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:30.729709 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:30.845280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49759a69-3d3b-4ff9-b019-d14f5b584ba5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:30.892712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14619320-ae64-4700-a486-52d10695731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:30.894378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14619320-ae64-4700-a486-52d10695731c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:30.894902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14619320-ae64-4700-a486-52d10695731c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:30.895406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14619320-ae64-4700-a486-52d10695731c None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:30.896294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14619320-ae64-4700-a486-52d10695731c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:30.900892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14619320-ae64-4700-a486-52d10695731c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:30.902647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14619320-ae64-4700-a486-52d10695731c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:30.913160 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 128/253] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:30.922428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56407dc6-286b-4bb2-9de0-541df2c47f12 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:31.172745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56407dc6-286b-4bb2-9de0-541df2c47f12 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:31.245150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c1ba-f368-40df-b3cc-72737d07665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:31.246197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c1ba-f368-40df-b3cc-72737d07665b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:31.246680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c1ba-f368-40df-b3cc-72737d07665b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:31.247160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c1ba-f368-40df-b3cc-72737d07665b None admin] PATH_INFO: `/v3/users/ed0d54ae5db24f0fb0a1d3490b8ca4ca` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:31.249268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631c1ba-f368-40df-b3cc-72737d07665b None admin] RBAC: Authorizing `identity:get_user(user_id=ed0d54ae5db24f0fb0a1d3490b8ca4ca)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:31.252046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631c1ba-f368-40df-b3cc-72737d07665b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:31.258679 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 126/254] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:30 2022] GET /identity/v3/users/ed0d54ae5db24f0fb0a1d3490b8ca4ca => generated 293 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:31.261502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14619320-ae64-4700-a486-52d10695731c None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:31.402686 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:31.409794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14619320-ae64-4700-a486-52d10695731c None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:31.450218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91aa00-3f09-482d-b5cf-9ed6028e3595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:31.450796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91aa00-3f09-482d-b5cf-9ed6028e3595 None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:31.451073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91aa00-3f09-482d-b5cf-9ed6028e3595 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:31.451347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91aa00-3f09-482d-b5cf-9ed6028e3595 None admin] PATH_INFO: `/v3/system/users/ed0d54ae5db24f0fb0a1d3490b8ca4ca/roles/b1b6bcd683ae410db592b5c0d447e25f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:31.457445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91aa00-3f09-482d-b5cf-9ed6028e3595 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ed0d54ae5db24f0fb0a1d3490b8ca4ca, role_id=b1b6bcd683ae410db592b5c0d447e25f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:31.458882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91aa00-3f09-482d-b5cf-9ed6028e3595 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:31.468963 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 129/255] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Oct 19 00:28:31 2022] PUT /identity/v3/system/users/ed0d54ae5db24f0fb0a1d3490b8ca4ca/roles/b1b6bcd683ae410db592b5c0d447e25f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:31.858885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaee9e-e3e2-423f-8c86-1462d6ae5455 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:31.859429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaee9e-e3e2-423f-8c86-1462d6ae5455 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:31.859795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaee9e-e3e2-423f-8c86-1462d6ae5455 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:31.863548 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 127/256] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:31.872021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c44ba-6f41-4024-a96d-62e096d32350 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:31.872544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c44ba-6f41-4024-a96d-62e096d32350 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:31.873130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c44ba-6f41-4024-a96d-62e096d32350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:31.914866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-046c44ba-6f41-4024-a96d-62e096d32350 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:31.916947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-046c44ba-6f41-4024-a96d-62e096d32350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:32.039840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 130/257] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:28:32.208313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7864d9d-47c6-458b-ab28-7db436548f37 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.209112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7864d9d-47c6-458b-ab28-7db436548f37 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.209625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7864d9d-47c6-458b-ab28-7db436548f37 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.212180 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 128/258] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:32.218017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f166-1dc5-424e-957a-cd664ead77ac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.218649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f166-1dc5-424e-957a-cd664ead77ac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.219158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f166-1dc5-424e-957a-cd664ead77ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.251426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6056f166-1dc5-424e-957a-cd664ead77ac None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:32.252740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6056f166-1dc5-424e-957a-cd664ead77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:32.261034 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 131/259] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:28:32.681831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be22b-d3b9-44b0-bf3f-5e307417f7f3 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.682575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be22b-d3b9-44b0-bf3f-5e307417f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.683065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be22b-d3b9-44b0-bf3f-5e307417f7f3 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.685071 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 129/260] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:32.692724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf211-6ba4-4498-a693-48274ca9f0c0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.693005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf211-6ba4-4498-a693-48274ca9f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.693467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf211-6ba4-4498-a693-48274ca9f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.719012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-18dbf211-6ba4-4498-a693-48274ca9f0c0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:32.720552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-18dbf211-6ba4-4498-a693-48274ca9f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:32.733162 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 132/261] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:28:32.778264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be22b-d3b9-44b0-bf3f-5e307417f7f3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:32.795216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be22b-d3b9-44b0-bf3f-5e307417f7f3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:32.801873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153faa44-4169-4780-8492-df78fc9a63cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:32.802919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153faa44-4169-4780-8492-df78fc9a63cb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.803070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbf211-6ba4-4498-a693-48274ca9f0c0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:32.803813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153faa44-4169-4780-8492-df78fc9a63cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.804322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153faa44-4169-4780-8492-df78fc9a63cb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.814278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbf211-6ba4-4498-a693-48274ca9f0c0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:32.825008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda976f-7d2d-42bf-a488-9384aa033147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:32.825744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda976f-7d2d-42bf-a488-9384aa033147 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.826056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153faa44-4169-4780-8492-df78fc9a63cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:32.826523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda976f-7d2d-42bf-a488-9384aa033147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.827155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda976f-7d2d-42bf-a488-9384aa033147 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-153faa44-4169-4780-8492-df78fc9a63cb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:32.832101 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:32.840051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:32.841621 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 130/262] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 19 00:28:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:32.845242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153faa44-4169-4780-8492-df78fc9a63cb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:32.853263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda976f-7d2d-42bf-a488-9384aa033147 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-acda976f-7d2d-42bf-a488-9384aa033147 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:32.858331 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:32.861297 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:32.865898 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 133/263] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 19 00:28:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:32.867577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153faa44-4169-4780-8492-df78fc9a63cb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:32.876053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda976f-7d2d-42bf-a488-9384aa033147 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:32.886585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:32.887498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.887782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.888056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.888773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:32.889081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:32.890945 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:28:32.890945 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:28:32.890945 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:28:32.891899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:32.904547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda976f-7d2d-42bf-a488-9384aa033147 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:32.915062 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 131/264] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 19 00:28:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:32.921532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:32.922232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.922539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.922762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.923450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] RBAC: Adding query filter params (name=member) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:32.923780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:32.924525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:32.925847 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:28:32.925847 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:28:32.925847 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:28:32.926782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:32.938467 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 134/265] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:28:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:32.941195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599642f-82af-4e76-bd2a-65cfb2bea1e5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:32.948195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:32.958546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a01c-032f-4eeb-b2a5-9060ad786084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:32.959169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a01c-032f-4eeb-b2a5-9060ad786084 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.959452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a01c-032f-4eeb-b2a5-9060ad786084 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.959734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a01c-032f-4eeb-b2a5-9060ad786084 admin admin] PATH_INFO: `/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.963847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b066c31-f234-4de1-8f72-94863a78921d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:32.969378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8a01c-032f-4eeb-b2a5-9060ad786084 admin admin] RBAC: Authorizing `identity:get_group(group_id=a51f3a372e134b3aabdccfc2e1acd25c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:32.970435 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-b1c8a01c-032f-4eeb-b2a5-9060ad786084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:28:32.970435 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:28:32.970435 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:28:32.972208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8a01c-032f-4eeb-b2a5-9060ad786084 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:32.973575 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 132/266] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 19 00:28:32 2022] GET /identity/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:32.978905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8af263-f380-4ec5-b45b-2f1695a43be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:32.979582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af263-f380-4ec5-b45b-2f1695a43be8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.979853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af263-f380-4ec5-b45b-2f1695a43be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.980113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af263-f380-4ec5-b45b-2f1695a43be8 admin admin] PATH_INFO: `/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.980698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a01c-032f-4eeb-b2a5-9060ad786084 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:32.985472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8af263-f380-4ec5-b45b-2f1695a43be8 admin admin] RBAC: Authorizing `identity:get_group(group_id=a51f3a372e134b3aabdccfc2e1acd25c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:32.986691 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-fd8af263-f380-4ec5-b45b-2f1695a43be8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:28:32.986691 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:28:32.986691 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:28:32.987947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8af263-f380-4ec5-b45b-2f1695a43be8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:32.989703 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 135/267] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 19 00:28:32 2022] GET /identity/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:32.998665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8af263-f380-4ec5-b45b-2f1695a43be8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:32.999623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a01c-032f-4eeb-b2a5-9060ad786084 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.009502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2fbb0-d1ad-41f6-87aa-c65452405982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.011374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2fbb0-d1ad-41f6-87aa-c65452405982 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.012042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2fbb0-d1ad-41f6-87aa-c65452405982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.012567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2fbb0-d1ad-41f6-87aa-c65452405982 admin admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.017781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2fbb0-d1ad-41f6-87aa-c65452405982 admin admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:33.020993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2fbb0-d1ad-41f6-87aa-c65452405982 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:33.022987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8af263-f380-4ec5-b45b-2f1695a43be8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.023659 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 133/268] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 19 00:28:32 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:33.029870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2fbb0-d1ad-41f6-87aa-c65452405982 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:33.037748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1acf72-40db-42fd-9609-b351f247aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.038088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1acf72-40db-42fd-9609-b351f247aee9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.038349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1acf72-40db-42fd-9609-b351f247aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.038617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1acf72-40db-42fd-9609-b351f247aee9 admin admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.039967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1acf72-40db-42fd-9609-b351f247aee9 admin admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:33.042883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1acf72-40db-42fd-9609-b351f247aee9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:33.045372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2fbb0-d1ad-41f6-87aa-c65452405982 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.048611 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 136/269] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 19 00:28:32 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:33.055971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad619f-b892-46bd-b940-38275045ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.057058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad619f-b892-46bd-b940-38275045ad33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.057570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad619f-b892-46bd-b940-38275045ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.058093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad619f-b892-46bd-b940-38275045ad33 admin admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/groups/a51f3a372e134b3aabdccfc2e1acd25c/roles/36ffa4795fa248139676253d88d7e507` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.058212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1acf72-40db-42fd-9609-b351f247aee9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:33.062202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad619f-b892-46bd-b940-38275045ad33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd, group_id=a51f3a372e134b3aabdccfc2e1acd25c, role_id=36ffa4795fa248139676253d88d7e507)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:33.063563 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-c2ad619f-b892-46bd-b940-38275045ad33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:28:33.063563 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:28:33.063563 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:28:33.066726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad619f-b892-46bd-b940-38275045ad33 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:33.076685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1acf72-40db-42fd-9609-b351f247aee9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.089412 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 134/270] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 19 00:28:33 2022] PUT /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/groups/a51f3a372e134b3aabdccfc2e1acd25c/roles/36ffa4795fa248139676253d88d7e507 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:28:33.092709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b03bd-8759-4034-8271-e53e6c7d7b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.092709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b03bd-8759-4034-8271-e53e6c7d7b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.092709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b03bd-8759-4034-8271-e53e6c7d7b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.092709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b03bd-8759-4034-8271-e53e6c7d7b78 admin admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c/groups/a51f3a372e134b3aabdccfc2e1acd25c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.098351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b03bd-8759-4034-8271-e53e6c7d7b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76689a22ac724ea298a077330657115c, group_id=a51f3a372e134b3aabdccfc2e1acd25c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:33.099429 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-f32b03bd-8759-4034-8271-e53e6c7d7b78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:28:33.099429 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:28:33.099429 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:28:33.101496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b03bd-8759-4034-8271-e53e6c7d7b78 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:33.127605 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 137/271] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 19 00:28:33 2022] PUT /identity/v3/projects/76689a22ac724ea298a077330657115c/groups/a51f3a372e134b3aabdccfc2e1acd25c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:28:33.429450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad619f-b892-46bd-b940-38275045ad33 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:33.458837 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:33.534654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad619f-b892-46bd-b940-38275045ad33 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.616133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cd090-4beb-432b-9f6b-b1271e23a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.617039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cd090-4beb-432b-9f6b-b1271e23a496 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.617430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cd090-4beb-432b-9f6b-b1271e23a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.617811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cd090-4beb-432b-9f6b-b1271e23a496 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.633286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cd090-4beb-432b-9f6b-b1271e23a496 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-bc6cd090-4beb-432b-9f6b-b1271e23a496 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:33.638722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:33.640040 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:33.641116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:33.644314 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 135/272] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 19 00:28:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:33.649817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b03bd-8759-4034-8271-e53e6c7d7b78 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:33.669136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f54a1-0f68-4884-ba03-867557fd7043 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.669475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f54a1-0f68-4884-ba03-867557fd7043 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.670256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f54a1-0f68-4884-ba03-867557fd7043 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.670475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b03bd-8759-4034-8271-e53e6c7d7b78 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.672130 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 136/273] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:33.678426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9aca-7da1-48fa-827c-6d5c2e72d892 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.678732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9aca-7da1-48fa-827c-6d5c2e72d892 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.678977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9aca-7da1-48fa-827c-6d5c2e72d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.686707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a33ffc-3f49-46a4-885d-c90c2de77cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.687337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a33ffc-3f49-46a4-885d-c90c2de77cbc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.687625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a33ffc-3f49-46a4-885d-c90c2de77cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.687897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a33ffc-3f49-46a4-885d-c90c2de77cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.688691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a33ffc-3f49-46a4-885d-c90c2de77cbc admin admin] RBAC: Adding query filter params (name=member) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:33.689003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a33ffc-3f49-46a4-885d-c90c2de77cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:33.691450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a33ffc-3f49-46a4-885d-c90c2de77cbc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:33.710848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d5ec9aca-7da1-48fa-827c-6d5c2e72d892 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:33.711452 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 138/274] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:28:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:33.712121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d5ec9aca-7da1-48fa-827c-6d5c2e72d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:33.719952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a33ffc-3f49-46a4-885d-c90c2de77cbc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:33.729147 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 137/275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 19 00:28:33.739614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a33ffc-3f49-46a4-885d-c90c2de77cbc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.753049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f277b0d-8612-48cc-a854-0f3d602e5201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.753730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f277b0d-8612-48cc-a854-0f3d602e5201 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.754005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f277b0d-8612-48cc-a854-0f3d602e5201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.754275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f277b0d-8612-48cc-a854-0f3d602e5201 admin admin] PATH_INFO: `/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.757376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f277b0d-8612-48cc-a854-0f3d602e5201 admin admin] RBAC: Authorizing `identity:get_group(group_id=a51f3a372e134b3aabdccfc2e1acd25c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:33.759409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f277b0d-8612-48cc-a854-0f3d602e5201 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:33.761667 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 139/276] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 19 00:28:33 2022] GET /identity/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:33.767114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9aca-7da1-48fa-827c-6d5c2e72d892 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:33.782326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9aca-7da1-48fa-827c-6d5c2e72d892 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.794675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134d45f-32d8-4fc7-9ceb-40c1be814180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.795345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134d45f-32d8-4fc7-9ceb-40c1be814180 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.795680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134d45f-32d8-4fc7-9ceb-40c1be814180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.795948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134d45f-32d8-4fc7-9ceb-40c1be814180 admin admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.797292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134d45f-32d8-4fc7-9ceb-40c1be814180 admin admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:33.799582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134d45f-32d8-4fc7-9ceb-40c1be814180 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:33.801729 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 138/277] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 19 00:28:33 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:33.807531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f277b0d-8612-48cc-a854-0f3d602e5201 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:33.825940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f277b0d-8612-48cc-a854-0f3d602e5201 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:33.839715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323e07-7896-408e-8b5b-79b773212293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:33.840819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323e07-7896-408e-8b5b-79b773212293 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:33.841278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323e07-7896-408e-8b5b-79b773212293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:33.841738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323e07-7896-408e-8b5b-79b773212293 admin admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/groups/a51f3a372e134b3aabdccfc2e1acd25c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:33.850423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f323e07-7896-408e-8b5b-79b773212293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd, group_id=a51f3a372e134b3aabdccfc2e1acd25c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:33.854523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f323e07-7896-408e-8b5b-79b773212293 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:33.880403 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 140/278] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 19 00:28:33 2022] PUT /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd/groups/a51f3a372e134b3aabdccfc2e1acd25c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:34.219373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b5acd-5c50-4732-9843-361446f6864f None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.220047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b5acd-5c50-4732-9843-361446f6864f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.220047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b5acd-5c50-4732-9843-361446f6864f None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.221617 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 139/279] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:34.228506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46464f2f-4c25-4c19-8106-5e260c8797ef None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.229048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46464f2f-4c25-4c19-8106-5e260c8797ef None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.229521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46464f2f-4c25-4c19-8106-5e260c8797ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.270848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-46464f2f-4c25-4c19-8106-5e260c8797ef None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:34.272945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-46464f2f-4c25-4c19-8106-5e260c8797ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:34.313986 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:34.355030 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 141/280] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:28:34.478048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b5acd-5c50-4732-9843-361446f6864f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:34.493532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b5acd-5c50-4732-9843-361446f6864f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:34.498176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e495da-eca1-4dda-ba9c-a9b608d76bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:34.498827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e495da-eca1-4dda-ba9c-a9b608d76bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.499112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e495da-eca1-4dda-ba9c-a9b608d76bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.499431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e495da-eca1-4dda-ba9c-a9b608d76bb8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.516560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e495da-eca1-4dda-ba9c-a9b608d76bb8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-58e495da-eca1-4dda-ba9c-a9b608d76bb8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:34.521686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:34.523426 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:34.524948 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 140/281] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 19 00:28:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:34.531121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46464f2f-4c25-4c19-8106-5e260c8797ef None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:34.544680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46464f2f-4c25-4c19-8106-5e260c8797ef None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:34.550645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab62e61-23e5-4b96-950c-4717a554b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:34.551435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab62e61-23e5-4b96-950c-4717a554b79b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.551822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab62e61-23e5-4b96-950c-4717a554b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.552202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab62e61-23e5-4b96-950c-4717a554b79b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.553036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab62e61-23e5-4b96-950c-4717a554b79b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:34.553440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab62e61-23e5-4b96-950c-4717a554b79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:34.555195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab62e61-23e5-4b96-950c-4717a554b79b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:34.565541 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 142/282] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 19 00:28:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:34.571813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e495da-eca1-4dda-ba9c-a9b608d76bb8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:34.584415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e495da-eca1-4dda-ba9c-a9b608d76bb8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:34.592875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea84e22-a9a8-4dea-b93a-bd35353089cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:34.593681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84e22-a9a8-4dea-b93a-bd35353089cb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.594069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84e22-a9a8-4dea-b93a-bd35353089cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.594446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84e22-a9a8-4dea-b93a-bd35353089cb admin admin] PATH_INFO: `/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.595710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea84e22-a9a8-4dea-b93a-bd35353089cb admin admin] RBAC: Authorizing `identity:get_group(group_id=a51f3a372e134b3aabdccfc2e1acd25c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:34.598370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea84e22-a9a8-4dea-b93a-bd35353089cb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:34.600100 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 141/283] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 19 00:28:34 2022] GET /identity/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:34.605866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab62e61-23e5-4b96-950c-4717a554b79b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:34.623716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab62e61-23e5-4b96-950c-4717a554b79b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:34.630769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ea133-3d4b-422c-b7ad-3dbc0e7bbd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:34.631615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ea133-3d4b-422c-b7ad-3dbc0e7bbd06 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.631998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ea133-3d4b-422c-b7ad-3dbc0e7bbd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.632378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ea133-3d4b-422c-b7ad-3dbc0e7bbd06 admin admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.633833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ea133-3d4b-422c-b7ad-3dbc0e7bbd06 admin admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:34.636124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ea133-3d4b-422c-b7ad-3dbc0e7bbd06 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:34.638105 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 143/284] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 19 00:28:34 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:34.644467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea84e22-a9a8-4dea-b93a-bd35353089cb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:34.655730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea84e22-a9a8-4dea-b93a-bd35353089cb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:34.663471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a73f7-e3be-4e06-81c7-9d4079ba8388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:34.664315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a73f7-e3be-4e06-81c7-9d4079ba8388 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.664724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a73f7-e3be-4e06-81c7-9d4079ba8388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.665103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a73f7-e3be-4e06-81c7-9d4079ba8388 admin admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c/groups/a51f3a372e134b3aabdccfc2e1acd25c/roles/36ffa4795fa248139676253d88d7e507` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.667463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a73f7-e3be-4e06-81c7-9d4079ba8388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76689a22ac724ea298a077330657115c, group_id=a51f3a372e134b3aabdccfc2e1acd25c, role_id=36ffa4795fa248139676253d88d7e507)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:34.670372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a73f7-e3be-4e06-81c7-9d4079ba8388 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:34.689355 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 142/285] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 19 00:28:34 2022] PUT /identity/v3/projects/76689a22ac724ea298a077330657115c/groups/a51f3a372e134b3aabdccfc2e1acd25c/roles/36ffa4795fa248139676253d88d7e507 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:34.878250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ea133-3d4b-422c-b7ad-3dbc0e7bbd06 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:34.889527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ea133-3d4b-422c-b7ad-3dbc0e7bbd06 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:34.966952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910fd4e-0378-4406-a07a-d2e6d76cf283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:34.967602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910fd4e-0378-4406-a07a-d2e6d76cf283 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.967900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910fd4e-0378-4406-a07a-d2e6d76cf283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.968153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910fd4e-0378-4406-a07a-d2e6d76cf283 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.980379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910fd4e-0378-4406-a07a-d2e6d76cf283 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-f910fd4e-0378-4406-a07a-d2e6d76cf283 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:34.986034 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:34.990418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:34.993238 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 144/286] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 19 00:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:34.996017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a73f7-e3be-4e06-81c7-9d4079ba8388 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:35.005505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a73f7-e3be-4e06-81c7-9d4079ba8388 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:35.010139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcaf48-9982-4ada-9f82-06b82107d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:35.010772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcaf48-9982-4ada-9f82-06b82107d2cd admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.011055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcaf48-9982-4ada-9f82-06b82107d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.011389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcaf48-9982-4ada-9f82-06b82107d2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.012093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcaf48-9982-4ada-9f82-06b82107d2cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:35.012395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcaf48-9982-4ada-9f82-06b82107d2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:35.016550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcaf48-9982-4ada-9f82-06b82107d2cd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:35.031202 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 143/287] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 19 00:28:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:35.037230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910fd4e-0378-4406-a07a-d2e6d76cf283 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:35.050956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910fd4e-0378-4406-a07a-d2e6d76cf283 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:35.060364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c1971-b0c4-4670-bd45-0e05e814cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:35.061046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c1971-b0c4-4670-bd45-0e05e814cf2a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.061313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c1971-b0c4-4670-bd45-0e05e814cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.061557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c1971-b0c4-4670-bd45-0e05e814cf2a admin admin] PATH_INFO: `/v3/groups/ee05683649644ea8b6c290006766afe5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.069210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c1971-b0c4-4670-bd45-0e05e814cf2a admin admin] RBAC: Authorizing `identity:get_group(group_id=ee05683649644ea8b6c290006766afe5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:35.071224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c1971-b0c4-4670-bd45-0e05e814cf2a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:35.072955 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 145/288] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 19 00:28:35 2022] GET /identity/v3/groups/ee05683649644ea8b6c290006766afe5 => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:35.078946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcaf48-9982-4ada-9f82-06b82107d2cd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:35.100668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcaf48-9982-4ada-9f82-06b82107d2cd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:35.105861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae219841-5190-41ce-b1a1-f9fbb711f510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:35.106524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae219841-5190-41ce-b1a1-f9fbb711f510 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.106854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae219841-5190-41ce-b1a1-f9fbb711f510 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.107189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae219841-5190-41ce-b1a1-f9fbb711f510 admin admin] PATH_INFO: `/v3/projects/ac0b2bfbc95a4438a5a4c53c6936c9e7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.108957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae219841-5190-41ce-b1a1-f9fbb711f510 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac0b2bfbc95a4438a5a4c53c6936c9e7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:35.110883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae219841-5190-41ce-b1a1-f9fbb711f510 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:35.113046 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 144/289] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 19 00:28:35 2022] GET /identity/v3/projects/ac0b2bfbc95a4438a5a4c53c6936c9e7 => generated 344 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:35.118755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c1971-b0c4-4670-bd45-0e05e814cf2a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:35.133561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c1971-b0c4-4670-bd45-0e05e814cf2a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:35.141372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566007f2-87c4-4325-850a-631f1a4897a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:35.142061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566007f2-87c4-4325-850a-631f1a4897a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.142320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566007f2-87c4-4325-850a-631f1a4897a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.142570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566007f2-87c4-4325-850a-631f1a4897a4 admin admin] PATH_INFO: `/v3/projects/ac0b2bfbc95a4438a5a4c53c6936c9e7/groups/ee05683649644ea8b6c290006766afe5/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.144800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566007f2-87c4-4325-850a-631f1a4897a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0b2bfbc95a4438a5a4c53c6936c9e7, group_id=ee05683649644ea8b6c290006766afe5, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:35.147481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566007f2-87c4-4325-850a-631f1a4897a4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:35.168281 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 146/290] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 19 00:28:35 2022] PUT /identity/v3/projects/ac0b2bfbc95a4438a5a4c53c6936c9e7/groups/ee05683649644ea8b6c290006766afe5/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:35.449973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c974386-a94d-48c3-b270-e30251f5b824 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.450763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c974386-a94d-48c3-b270-e30251f5b824 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.450763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c974386-a94d-48c3-b270-e30251f5b824 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.452235 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 145/291] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:35.459278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab071920-d626-4846-8fbf-7538a75325f4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.459674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab071920-d626-4846-8fbf-7538a75325f4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.459930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab071920-d626-4846-8fbf-7538a75325f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.485687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ab071920-d626-4846-8fbf-7538a75325f4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:35.487947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ab071920-d626-4846-8fbf-7538a75325f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:35.591304 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 147/292] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:36.154257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c974386-a94d-48c3-b270-e30251f5b824 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:36.223294 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:36.279659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c974386-a94d-48c3-b270-e30251f5b824 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:36.321427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cacf2-774a-4ee5-a953-992fbf124827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:36.321966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cacf2-774a-4ee5-a953-992fbf124827 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:36.322250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cacf2-774a-4ee5-a953-992fbf124827 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:36.322526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cacf2-774a-4ee5-a953-992fbf124827 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:36.336019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cacf2-774a-4ee5-a953-992fbf124827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-dd0cacf2-774a-4ee5-a953-992fbf124827 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:36.341491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:36.343269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:36.344141 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 146/293] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:36.349402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab071920-d626-4846-8fbf-7538a75325f4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:36.376064 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:36.477493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab071920-d626-4846-8fbf-7538a75325f4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:36.519741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649f32-384e-43d4-9522-8c7b36bab528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:36.520376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649f32-384e-43d4-9522-8c7b36bab528 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:36.520685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649f32-384e-43d4-9522-8c7b36bab528 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:36.520965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649f32-384e-43d4-9522-8c7b36bab528 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:36.521671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a649f32-384e-43d4-9522-8c7b36bab528 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:36.521978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a649f32-384e-43d4-9522-8c7b36bab528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:36.523436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a649f32-384e-43d4-9522-8c7b36bab528 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:36.533947 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 148/294] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:36.540111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cacf2-774a-4ee5-a953-992fbf124827 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:36.663336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cacf2-774a-4ee5-a953-992fbf124827 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:36.684528 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:36.706766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9776d2-7a84-47a8-8376-6195765c4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:36.707432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9776d2-7a84-47a8-8376-6195765c4d90 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:36.707713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9776d2-7a84-47a8-8376-6195765c4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:36.707988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9776d2-7a84-47a8-8376-6195765c4d90 None admin] PATH_INFO: `/v3/users/ed0d54ae5db24f0fb0a1d3490b8ca4ca` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:36.709257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9776d2-7a84-47a8-8376-6195765c4d90 None admin] RBAC: Authorizing `identity:get_user(user_id=ed0d54ae5db24f0fb0a1d3490b8ca4ca)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:36.710798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9776d2-7a84-47a8-8376-6195765c4d90 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:36.712498 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 147/295] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:28:36 2022] GET /identity/v3/users/ed0d54ae5db24f0fb0a1d3490b8ca4ca => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:36.718656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649f32-384e-43d4-9522-8c7b36bab528 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:36.805559 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:36.832980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649f32-384e-43d4-9522-8c7b36bab528 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:36.874300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9393be-fff7-471e-8095-f5d6b540b339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:36.874940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9393be-fff7-471e-8095-f5d6b540b339 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:36.875227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9393be-fff7-471e-8095-f5d6b540b339 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:36.875502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9393be-fff7-471e-8095-f5d6b540b339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:36.876254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9393be-fff7-471e-8095-f5d6b540b339 None admin] RBAC: Adding query filter params (role.id=b1b6bcd683ae410db592b5c0d447e25f, user.id=ed0d54ae5db24f0fb0a1d3490b8ca4ca, scope.system=all) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:36.876564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9393be-fff7-471e-8095-f5d6b540b339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:36.878633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9393be-fff7-471e-8095-f5d6b540b339 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:36.892453 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 149/296] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Oct 19 00:28:36 2022] GET /identity/v3/role_assignments?user.id=ed0d54ae5db24f0fb0a1d3490b8ca4ca&scope.system=all&role.id=b1b6bcd683ae410db592b5c0d447e25f => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:37.404545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa169-8a35-4067-b4a0-1b6d0fdabe93 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:37.404861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa169-8a35-4067-b4a0-1b6d0fdabe93 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:37.405291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa169-8a35-4067-b4a0-1b6d0fdabe93 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:37.406511 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 148/297] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:37.414072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ad4f-7d5f-49b9-a004-a5e1c7c3e78b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:37.414766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ad4f-7d5f-49b9-a004-a5e1c7c3e78b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:37.414766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ad4f-7d5f-49b9-a004-a5e1c7c3e78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:37.435413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d4e0ad4f-7d5f-49b9-a004-a5e1c7c3e78b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:37.436636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d4e0ad4f-7d5f-49b9-a004-a5e1c7c3e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:37.511958 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 150/298] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:37.795855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa169-8a35-4067-b4a0-1b6d0fdabe93 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:37.912900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa169-8a35-4067-b4a0-1b6d0fdabe93 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:37.952886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3ffb-e047-444e-8793-bd690c446c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:37.953543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3ffb-e047-444e-8793-bd690c446c37 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:37.953823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3ffb-e047-444e-8793-bd690c446c37 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:37.954099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3ffb-e047-444e-8793-bd690c446c37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:37.967396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a3ffb-e047-444e-8793-bd690c446c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-262a3ffb-e047-444e-8793-bd690c446c37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:37.972637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:37.973577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:37.974381 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 149/299] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:37.980085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ad4f-7d5f-49b9-a004-a5e1c7c3e78b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:38.049049 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:38.092296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ad4f-7d5f-49b9-a004-a5e1c7c3e78b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:38.130498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4da678-6006-42e4-bebc-5c070fef4c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:38.131131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da678-6006-42e4-bebc-5c070fef4c37 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.131431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da678-6006-42e4-bebc-5c070fef4c37 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.131697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da678-6006-42e4-bebc-5c070fef4c37 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.132380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4da678-6006-42e4-bebc-5c070fef4c37 None admin] RBAC: Adding query filter params (name=member) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:38.132716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4da678-6006-42e4-bebc-5c070fef4c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:38.134259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4da678-6006-42e4-bebc-5c070fef4c37 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:38.143194 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 151/300] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:38.148992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3ffb-e047-444e-8793-bd690c446c37 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:38.202588 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:38.264710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3ffb-e047-444e-8793-bd690c446c37 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:38.308552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767beb-82a2-4a78-bfe7-1a722c5d72f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:38.309140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767beb-82a2-4a78-bfe7-1a722c5d72f5 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.309422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767beb-82a2-4a78-bfe7-1a722c5d72f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.309700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767beb-82a2-4a78-bfe7-1a722c5d72f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.387777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767beb-82a2-4a78-bfe7-1a722c5d72f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:38.389328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767beb-82a2-4a78-bfe7-1a722c5d72f5 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:38.399611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014ed7f-70b3-416c-a879-0ebc2727d693 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.399925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014ed7f-70b3-416c-a879-0ebc2727d693 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.400160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014ed7f-70b3-416c-a879-0ebc2727d693 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.402202 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 152/301] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:38.416558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842f23-c253-4419-b2c7-5f1366ec3fde None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.417197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842f23-c253-4419-b2c7-5f1366ec3fde None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.417567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842f23-c253-4419-b2c7-5f1366ec3fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.451798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-70842f23-c253-4419-b2c7-5f1366ec3fde None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:38.453285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-70842f23-c253-4419-b2c7-5f1366ec3fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:38.456340 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:38.530659 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 150/302] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:28:38.532432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad87c5c-d257-4273-b026-5c00f1ffd88a None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.532432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad87c5c-d257-4273-b026-5c00f1ffd88a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.532807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad87c5c-d257-4273-b026-5c00f1ffd88a None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.534395 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 151/303] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:38.539886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad87c5c-d257-4273-b026-5c00f1ffd88a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:38.546360 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 153/304] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:38.548031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5039a-1ff2-4faa-8bc9-9fb8a615bf87 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.548583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5039a-1ff2-4faa-8bc9-9fb8a615bf87 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.549624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5039a-1ff2-4faa-8bc9-9fb8a615bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.570776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4fd5039a-1ff2-4faa-8bc9-9fb8a615bf87 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:38.572318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4fd5039a-1ff2-4faa-8bc9-9fb8a615bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:38.668941 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:38.693396 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 154/305] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:38.695030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed00f82-54d5-4443-8f5b-5ae1cc992c6f None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.697809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed00f82-54d5-4443-8f5b-5ae1cc992c6f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.698612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed00f82-54d5-4443-8f5b-5ae1cc992c6f None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.701368 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 155/306] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:38.711271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266f0e2-d922-46c8-8d12-7ff4f258fabf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.711767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266f0e2-d922-46c8-8d12-7ff4f258fabf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.712245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266f0e2-d922-46c8-8d12-7ff4f258fabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.729688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad87c5c-d257-4273-b026-5c00f1ffd88a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:38.754557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6266f0e2-d922-46c8-8d12-7ff4f258fabf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:38.758522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6266f0e2-d922-46c8-8d12-7ff4f258fabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:38.809440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7af0cb-6f95-411f-b637-c72792528f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:38.810100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7af0cb-6f95-411f-b637-c72792528f79 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.810388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7af0cb-6f95-411f-b637-c72792528f79 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.810666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7af0cb-6f95-411f-b637-c72792528f79 None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.811968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7af0cb-6f95-411f-b637-c72792528f79 None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:38.813472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7af0cb-6f95-411f-b637-c72792528f79 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:38.815723 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 152/307] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:38 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:38.821450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7af0cb-6f95-411f-b637-c72792528f79 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:38.846135 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:38.874526 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 156/308] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:38.949812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7af0cb-6f95-411f-b637-c72792528f79 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:38.981580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266f0e2-d922-46c8-8d12-7ff4f258fabf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:38.991344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d47269-715e-4196-9093-ffaa01e794a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:38.992437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d47269-715e-4196-9093-ffaa01e794a4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:38.992771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d47269-715e-4196-9093-ffaa01e794a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:38.993026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d47269-715e-4196-9093-ffaa01e794a4 None admin] PATH_INFO: `/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:38.994569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d47269-715e-4196-9093-ffaa01e794a4 None admin] RBAC: Authorizing `identity:get_group(group_id=a51f3a372e134b3aabdccfc2e1acd25c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:38.996118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d47269-715e-4196-9093-ffaa01e794a4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:38.998120 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 153/309] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 19 00:28:38 2022] GET /identity/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:39.004935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d47269-715e-4196-9093-ffaa01e794a4 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:39.146815 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:39.195355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d47269-715e-4196-9093-ffaa01e794a4 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:39.203389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266f0e2-d922-46c8-8d12-7ff4f258fabf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:39.235763 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:39.264431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518a34d-5ce4-4a23-bbb7-8dfa650b2936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:39.265120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a34d-5ce4-4a23-bbb7-8dfa650b2936 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.265403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a34d-5ce4-4a23-bbb7-8dfa650b2936 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.265680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a34d-5ce4-4a23-bbb7-8dfa650b2936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:39.266428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a34d-5ce4-4a23-bbb7-8dfa650b2936 None admin] RBAC: Adding query filter params (group.id=a51f3a372e134b3aabdccfc2e1acd25c, role.id=2eefb0a36d0744ec8e25b5669af179cf, scope.project.id=76689a22ac724ea298a077330657115c) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:39.266741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a34d-5ce4-4a23-bbb7-8dfa650b2936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:39.268993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b753c-0466-4997-933c-d87b903922d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:39.270147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a34d-5ce4-4a23-bbb7-8dfa650b2936 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:39.270399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b753c-0466-4997-933c-d87b903922d3 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.270865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b753c-0466-4997-933c-d87b903922d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.271330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b753c-0466-4997-933c-d87b903922d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:39.277324 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 154/310] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 19 00:28:39 2022] GET /identity/v3/role_assignments?group.id=a51f3a372e134b3aabdccfc2e1acd25c&scope.project.id=76689a22ac724ea298a077330657115c&role.id=2eefb0a36d0744ec8e25b5669af179cf => generated 611 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:39.277996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518a34d-5ce4-4a23-bbb7-8dfa650b2936 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:39.285330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b753c-0466-4997-933c-d87b903922d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-d76b753c-0466-4997-933c-d87b903922d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:39.290862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:39.291856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:39.292677 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:39.296753 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 157/311] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:28:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:39.304089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b753c-0466-4997-933c-d87b903922d3 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:39.436670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518a34d-5ce4-4a23-bbb7-8dfa650b2936 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:39.489380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64356651-53a9-4a61-a7de-c1a77f109a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:39.490060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64356651-53a9-4a61-a7de-c1a77f109a91 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.490344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64356651-53a9-4a61-a7de-c1a77f109a91 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.490623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64356651-53a9-4a61-a7de-c1a77f109a91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:39.500002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b753c-0466-4997-933c-d87b903922d3 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:39.514159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64356651-53a9-4a61-a7de-c1a77f109a91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-64356651-53a9-4a61-a7de-c1a77f109a91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:39.523572 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:39.524536 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:39.526755 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 155/312] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:39.527976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dcd35-ecc0-4640-a0d9-3b4f56a787dc None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.527976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dcd35-ecc0-4640-a0d9-3b4f56a787dc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.528124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dcd35-ecc0-4640-a0d9-3b4f56a787dc None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:39.532687 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 156/313] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:39.536854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516dcd35-ecc0-4640-a0d9-3b4f56a787dc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:39.541254 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:39.568061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02da1b5-6523-4d08-bd4e-e52e4b9e8b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:39.569441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02da1b5-6523-4d08-bd4e-e52e4b9e8b2c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.569881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02da1b5-6523-4d08-bd4e-e52e4b9e8b2c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.570496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02da1b5-6523-4d08-bd4e-e52e4b9e8b2c None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:39.572663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02da1b5-6523-4d08-bd4e-e52e4b9e8b2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:39.573354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02da1b5-6523-4d08-bd4e-e52e4b9e8b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:39.575939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02da1b5-6523-4d08-bd4e-e52e4b9e8b2c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:39.590690 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 158/314] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:39.593044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca979-b834-470a-b2d8-73712b1089a5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.594847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca979-b834-470a-b2d8-73712b1089a5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.595389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca979-b834-470a-b2d8-73712b1089a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:39.625313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d8fca979-b834-470a-b2d8-73712b1089a5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:39.626571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d8fca979-b834-470a-b2d8-73712b1089a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:39.666998 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:39.715370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516dcd35-ecc0-4640-a0d9-3b4f56a787dc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:39.732096 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 159/315] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:39.735212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fca979-b834-470a-b2d8-73712b1089a5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:39.755201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937ec6c-3c0f-4f61-a038-83e6d6e13fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:39.755820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ec6c-3c0f-4f61-a038-83e6d6e13fa8 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.756097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ec6c-3c0f-4f61-a038-83e6d6e13fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.756864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937ec6c-3c0f-4f61-a038-83e6d6e13fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:39.757547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937ec6c-3c0f-4f61-a038-83e6d6e13fa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:39.757848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937ec6c-3c0f-4f61-a038-83e6d6e13fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:39.759217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937ec6c-3c0f-4f61-a038-83e6d6e13fa8 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:39.770839 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 157/316] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:39.772013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937ec6c-3c0f-4f61-a038-83e6d6e13fa8 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:39.856420 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:39.916834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fca979-b834-470a-b2d8-73712b1089a5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:39.918525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937ec6c-3c0f-4f61-a038-83e6d6e13fa8 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:39.980459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1272-6138-4101-845c-aebe2b2bb2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:39.981176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1272-6138-4101-845c-aebe2b2bb2ca None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.981341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1272-6138-4101-845c-aebe2b2bb2ca None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.982237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1272-6138-4101-845c-aebe2b2bb2ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:40.003480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5b5c-c206-41f7-9f0f-8f9b06b1071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:40.004356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5b5c-c206-41f7-9f0f-8f9b06b1071a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:40.004660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5b5c-c206-41f7-9f0f-8f9b06b1071a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:40.004945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5b5c-c206-41f7-9f0f-8f9b06b1071a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:40.027141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b5b5c-c206-41f7-9f0f-8f9b06b1071a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-454b5b5c-c206-41f7-9f0f-8f9b06b1071a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:40.035166 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:40.037045 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 160/317] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:28:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:40.038538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5b5c-c206-41f7-9f0f-8f9b06b1071a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:40.074311 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:40.090277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c1272-6138-4101-845c-aebe2b2bb2ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:40.091774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c1272-6138-4101-845c-aebe2b2bb2ca None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:40.176792 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:40.193439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5b5c-c206-41f7-9f0f-8f9b06b1071a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:40.230929 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 158/318] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:28:40.231592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1272-6138-4101-845c-aebe2b2bb2ca None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:40.246251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ae557-768b-4aaf-a194-19f62bd75b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:40.246860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ae557-768b-4aaf-a194-19f62bd75b1d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:40.247133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ae557-768b-4aaf-a194-19f62bd75b1d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:40.247399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ae557-768b-4aaf-a194-19f62bd75b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:40.323630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ae557-768b-4aaf-a194-19f62bd75b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:40.325183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ae557-768b-4aaf-a194-19f62bd75b1d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:40.356903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1272-6138-4101-845c-aebe2b2bb2ca None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:40.357285 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:40.415669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4c3b6-003b-4f25-b985-7107df10ee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:40.416335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4c3b6-003b-4f25-b985-7107df10ee87 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:40.416650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4c3b6-003b-4f25-b985-7107df10ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:40.416946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4c3b6-003b-4f25-b985-7107df10ee87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:40.429453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4c3b6-003b-4f25-b985-7107df10ee87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-dbc4c3b6-003b-4f25-b985-7107df10ee87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:40.434570 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:40.435677 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 159/319] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:40.436982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4c3b6-003b-4f25-b985-7107df10ee87 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:40.447613 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 161/320] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:28:40.448511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ae557-768b-4aaf-a194-19f62bd75b1d None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:40.476851 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:40.563831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4c3b6-003b-4f25-b985-7107df10ee87 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:40.586044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ae557-768b-4aaf-a194-19f62bd75b1d None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:40.604564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3aaed-e6e1-4f03-a3c1-8774a5c3e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:40.605209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3aaed-e6e1-4f03-a3c1-8774a5c3e739 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:40.605485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3aaed-e6e1-4f03-a3c1-8774a5c3e739 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:40.605756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3aaed-e6e1-4f03-a3c1-8774a5c3e739 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:40.606421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3aaed-e6e1-4f03-a3c1-8774a5c3e739 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:40.606722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3aaed-e6e1-4f03-a3c1-8774a5c3e739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:40.608133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3aaed-e6e1-4f03-a3c1-8774a5c3e739 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:40.618305 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 160/321] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:40.619227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3aaed-e6e1-4f03-a3c1-8774a5c3e739 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:40.621507 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:40.633273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da9779-d7b8-4f59-9e96-99564c67bc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:40.633924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da9779-d7b8-4f59-9e96-99564c67bc97 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:40.634195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da9779-d7b8-4f59-9e96-99564c67bc97 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:40.634458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da9779-d7b8-4f59-9e96-99564c67bc97 None admin] PATH_INFO: `/v3/projects/76689a22ac724ea298a077330657115c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:40.635623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da9779-d7b8-4f59-9e96-99564c67bc97 None admin] RBAC: Authorizing `identity:get_project(project_id=76689a22ac724ea298a077330657115c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:40.637103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da9779-d7b8-4f59-9e96-99564c67bc97 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:40.638784 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 162/322] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:40 2022] GET /identity/v3/projects/76689a22ac724ea298a077330657115c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:40.642545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da9779-d7b8-4f59-9e96-99564c67bc97 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:40.721226 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:40.738471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3aaed-e6e1-4f03-a3c1-8774a5c3e739 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:40.763598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da9779-d7b8-4f59-9e96-99564c67bc97 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:40.773487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bb2a4-7b6b-4062-90ef-ed4a05821f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:40.774103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bb2a4-7b6b-4062-90ef-ed4a05821f1a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:40.774380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bb2a4-7b6b-4062-90ef-ed4a05821f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:40.774649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bb2a4-7b6b-4062-90ef-ed4a05821f1a None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:40.775320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bb2a4-7b6b-4062-90ef-ed4a05821f1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:40.775619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bb2a4-7b6b-4062-90ef-ed4a05821f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:40.777028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bb2a4-7b6b-4062-90ef-ed4a05821f1a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:40.786806 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 161/323] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:40.791712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bb2a4-7b6b-4062-90ef-ed4a05821f1a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:40.804225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b196-4390-406f-9866-65c06706032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:40.804903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b196-4390-406f-9866-65c06706032b None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:40.805177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b196-4390-406f-9866-65c06706032b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:40.805443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b196-4390-406f-9866-65c06706032b None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:40.806597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0b196-4390-406f-9866-65c06706032b None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:40.808063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0b196-4390-406f-9866-65c06706032b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:40.809760 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 163/324] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:40 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:40.810546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b196-4390-406f-9866-65c06706032b None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:40.899910 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:40.932095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bb2a4-7b6b-4062-90ef-ed4a05821f1a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:40.964178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b196-4390-406f-9866-65c06706032b None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:40.985971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4492e-fd35-444c-9e93-5dd154b67d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:40.987639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4492e-fd35-444c-9e93-5dd154b67d92 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:40.988030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4492e-fd35-444c-9e93-5dd154b67d92 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:40.988324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4492e-fd35-444c-9e93-5dd154b67d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.012002 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.015795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221f015-f419-4ce4-85cf-7cf014a038b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.016584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221f015-f419-4ce4-85cf-7cf014a038b7 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.017087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221f015-f419-4ce4-85cf-7cf014a038b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.018206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221f015-f419-4ce4-85cf-7cf014a038b7 None admin] PATH_INFO: `/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.020140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221f015-f419-4ce4-85cf-7cf014a038b7 None admin] RBAC: Authorizing `identity:get_group(group_id=a51f3a372e134b3aabdccfc2e1acd25c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.021713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221f015-f419-4ce4-85cf-7cf014a038b7 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.023562 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 164/325] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 19 00:28:40 2022] GET /identity/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.024428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221f015-f419-4ce4-85cf-7cf014a038b7 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.085232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4492e-fd35-444c-9e93-5dd154b67d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.086780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4492e-fd35-444c-9e93-5dd154b67d92 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.146803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221f015-f419-4ce4-85cf-7cf014a038b7 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.180668 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.189214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab471f-71f5-4af7-ae6a-c5306ca47220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.190337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab471f-71f5-4af7-ae6a-c5306ca47220 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.190622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab471f-71f5-4af7-ae6a-c5306ca47220 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.190892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab471f-71f5-4af7-ae6a-c5306ca47220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.209996 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 162/326] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:28:41.211195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4492e-fd35-444c-9e93-5dd154b67d92 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.271855 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.278279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab471f-71f5-4af7-ae6a-c5306ca47220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.279849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab471f-71f5-4af7-ae6a-c5306ca47220 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.331190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4492e-fd35-444c-9e93-5dd154b67d92 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.379594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a269a-09bb-40c3-9ba6-3821511aaa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.380237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a269a-09bb-40c3-9ba6-3821511aaa52 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.380522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a269a-09bb-40c3-9ba6-3821511aaa52 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.380826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a269a-09bb-40c3-9ba6-3821511aaa52 None admin] PATH_INFO: `/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.381972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a269a-09bb-40c3-9ba6-3821511aaa52 None admin] RBAC: Authorizing `identity:get_group(group_id=a51f3a372e134b3aabdccfc2e1acd25c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.383419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a269a-09bb-40c3-9ba6-3821511aaa52 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.385207 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 163/327] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.385805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a269a-09bb-40c3-9ba6-3821511aaa52 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.400029 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 165/328] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:28:41.400913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab471f-71f5-4af7-ae6a-c5306ca47220 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.431600 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.494165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a269a-09bb-40c3-9ba6-3821511aaa52 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.504025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab471f-71f5-4af7-ae6a-c5306ca47220 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.511199 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.532406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b39c5-5935-4573-a9f9-1b4efc22fed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.533665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b39c5-5935-4573-a9f9-1b4efc22fed0 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.534671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b39c5-5935-4573-a9f9-1b4efc22fed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.534671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b39c5-5935-4573-a9f9-1b4efc22fed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.535386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b39c5-5935-4573-a9f9-1b4efc22fed0 None admin] RBAC: Adding query filter params (group.id=a51f3a372e134b3aabdccfc2e1acd25c, role.id=36ffa4795fa248139676253d88d7e507, scope.project.id=76689a22ac724ea298a077330657115c) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:41.535697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b39c5-5935-4573-a9f9-1b4efc22fed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.537178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b39c5-5935-4573-a9f9-1b4efc22fed0 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.543890 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 164/329] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/role_assignments?group.id=a51f3a372e134b3aabdccfc2e1acd25c&scope.project.id=76689a22ac724ea298a077330657115c&role.id=36ffa4795fa248139676253d88d7e507 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.544564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc21b9-c247-40ff-a6bb-e9598806719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.544955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b39c5-5935-4573-a9f9-1b4efc22fed0 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.545631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc21b9-c247-40ff-a6bb-e9598806719e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.546259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc21b9-c247-40ff-a6bb-e9598806719e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.546741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc21b9-c247-40ff-a6bb-e9598806719e None admin] PATH_INFO: `/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.550098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc21b9-c247-40ff-a6bb-e9598806719e None admin] RBAC: Authorizing `identity:get_project(project_id=2db60d3f0a0c4d6fa3d706ecee08a2dd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.552601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc21b9-c247-40ff-a6bb-e9598806719e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.556288 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 166/330] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/projects/2db60d3f0a0c4d6fa3d706ecee08a2dd => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.561655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc21b9-c247-40ff-a6bb-e9598806719e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.668739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b39c5-5935-4573-a9f9-1b4efc22fed0 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.679923 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.687536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc21b9-c247-40ff-a6bb-e9598806719e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.710955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b794da-4655-434e-8683-31a3a03e1bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.711586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b794da-4655-434e-8683-31a3a03e1bab None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.711939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b794da-4655-434e-8683-31a3a03e1bab None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.712222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b794da-4655-434e-8683-31a3a03e1bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.713293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b794da-4655-434e-8683-31a3a03e1bab None admin] RBAC: Adding query filter params (group.id=a51f3a372e134b3aabdccfc2e1acd25c, role.id=2eefb0a36d0744ec8e25b5669af179cf, scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:41.713607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b794da-4655-434e-8683-31a3a03e1bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.715091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b794da-4655-434e-8683-31a3a03e1bab None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.721792 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 165/331] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/role_assignments?group.id=a51f3a372e134b3aabdccfc2e1acd25c&scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd&role.id=2eefb0a36d0744ec8e25b5669af179cf => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.722560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b794da-4655-434e-8683-31a3a03e1bab None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.735927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70fad6-3758-4911-9df0-b516aacd4011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.738379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70fad6-3758-4911-9df0-b516aacd4011 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.738888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70fad6-3758-4911-9df0-b516aacd4011 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.739339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70fad6-3758-4911-9df0-b516aacd4011 None admin] PATH_INFO: `/v3/projects/ac0b2bfbc95a4438a5a4c53c6936c9e7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.742749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70fad6-3758-4911-9df0-b516aacd4011 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0b2bfbc95a4438a5a4c53c6936c9e7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.744386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70fad6-3758-4911-9df0-b516aacd4011 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.746585 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 167/332] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/projects/ac0b2bfbc95a4438a5a4c53c6936c9e7 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.753163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70fad6-3758-4911-9df0-b516aacd4011 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.794725 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:41.866960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b794da-4655-434e-8683-31a3a03e1bab None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.891641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70fad6-3758-4911-9df0-b516aacd4011 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:41.906393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfde84-e0ed-4749-b527-eb9fdad407b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.907464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfde84-e0ed-4749-b527-eb9fdad407b7 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.907745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfde84-e0ed-4749-b527-eb9fdad407b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.908560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfde84-e0ed-4749-b527-eb9fdad407b7 None admin] PATH_INFO: `/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.909939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfde84-e0ed-4749-b527-eb9fdad407b7 None admin] RBAC: Authorizing `identity:get_group(group_id=a51f3a372e134b3aabdccfc2e1acd25c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.911634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfde84-e0ed-4749-b527-eb9fdad407b7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.913550 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 166/333] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/groups/a51f3a372e134b3aabdccfc2e1acd25c => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.919388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfde84-e0ed-4749-b527-eb9fdad407b7 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.931824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403abe16-80f2-4a0c-ac17-4d288292d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:41.932468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403abe16-80f2-4a0c-ac17-4d288292d9bc None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:41.934248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403abe16-80f2-4a0c-ac17-4d288292d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:41.934248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403abe16-80f2-4a0c-ac17-4d288292d9bc None admin] PATH_INFO: `/v3/groups/ee05683649644ea8b6c290006766afe5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:41.934433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403abe16-80f2-4a0c-ac17-4d288292d9bc None admin] RBAC: Authorizing `identity:get_group(group_id=ee05683649644ea8b6c290006766afe5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:41.936036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403abe16-80f2-4a0c-ac17-4d288292d9bc None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:41.937746 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 168/334] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/groups/ee05683649644ea8b6c290006766afe5 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:41.945319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403abe16-80f2-4a0c-ac17-4d288292d9bc None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:41.992843 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:42.045555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfde84-e0ed-4749-b527-eb9fdad407b7 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:42.061047 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:42.091744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403abe16-80f2-4a0c-ac17-4d288292d9bc None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:42.097523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78237e9e-9772-4408-b800-ba40768d203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:42.098153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78237e9e-9772-4408-b800-ba40768d203e None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:42.098429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78237e9e-9772-4408-b800-ba40768d203e None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:42.098699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78237e9e-9772-4408-b800-ba40768d203e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:42.099437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78237e9e-9772-4408-b800-ba40768d203e None admin] RBAC: Adding query filter params (group.id=a51f3a372e134b3aabdccfc2e1acd25c, role.id=36ffa4795fa248139676253d88d7e507, scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:42.099744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78237e9e-9772-4408-b800-ba40768d203e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:42.101295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78237e9e-9772-4408-b800-ba40768d203e None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:42.109653 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 167/335] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/role_assignments?group.id=a51f3a372e134b3aabdccfc2e1acd25c&scope.project.id=2db60d3f0a0c4d6fa3d706ecee08a2dd&role.id=36ffa4795fa248139676253d88d7e507 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:42.137623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5eff8-744b-453b-a8d4-dd3bb556a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:42.137623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5eff8-744b-453b-a8d4-dd3bb556a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:42.137940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5eff8-744b-453b-a8d4-dd3bb556a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:42.138165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5eff8-744b-453b-a8d4-dd3bb556a6c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:42.139040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5eff8-744b-453b-a8d4-dd3bb556a6c4 None admin] RBAC: Adding query filter params (group.id=ee05683649644ea8b6c290006766afe5, role.id=3c676188d9f646ba8509d3eef1e196de, scope.project.id=ac0b2bfbc95a4438a5a4c53c6936c9e7) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:42.139249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5eff8-744b-453b-a8d4-dd3bb556a6c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:42.140805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5eff8-744b-453b-a8d4-dd3bb556a6c4 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:42.148580 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 169/336] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 19 00:28:41 2022] GET /identity/v3/role_assignments?group.id=ee05683649644ea8b6c290006766afe5&scope.project.id=ac0b2bfbc95a4438a5a4c53c6936c9e7&role.id=3c676188d9f646ba8509d3eef1e196de => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:45.305249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd377-954d-4dce-8f85-1dfbc48246d8 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.305738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd377-954d-4dce-8f85-1dfbc48246d8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.305738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd377-954d-4dce-8f85-1dfbc48246d8 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.307338 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 168/337] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:45.313411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e927d-1a43-43c5-9e93-81b4e2293088 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.314864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e927d-1a43-43c5-9e93-81b4e2293088 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.314864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e927d-1a43-43c5-9e93-81b4e2293088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.345002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-236e927d-1a43-43c5-9e93-81b4e2293088 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:45.347153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-236e927d-1a43-43c5-9e93-81b4e2293088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:45.451684 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 170/338] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:45.651959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa92f8-3169-44cd-a7fe-cc0594aebbfb None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.652357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa92f8-3169-44cd-a7fe-cc0594aebbfb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.652535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa92f8-3169-44cd-a7fe-cc0594aebbfb None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.654233 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 169/339] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:45.659594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8544d-9afe-4862-bd0f-a0141b062e68 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.660199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8544d-9afe-4862-bd0f-a0141b062e68 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.660721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8544d-9afe-4862-bd0f-a0141b062e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.685050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f1f8544d-9afe-4862-bd0f-a0141b062e68 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:45.686590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f1f8544d-9afe-4862-bd0f-a0141b062e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:45.691638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c263d2-5102-4bee-aac4-d71d07777012 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.691638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c263d2-5102-4bee-aac4-d71d07777012 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.691638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c263d2-5102-4bee-aac4-d71d07777012 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.697080 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 170/340] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:45.698681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9f57-f665-4a2f-bd9c-4499ab5ac3ac None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:45.698970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9f57-f665-4a2f-bd9c-4499ab5ac3ac None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:45.699251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9f57-f665-4a2f-bd9c-4499ab5ac3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:45.721084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-86ed9f57-f665-4a2f-bd9c-4499ab5ac3ac None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:45.722733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-86ed9f57-f665-4a2f-bd9c-4499ab5ac3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:45.724437 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:45.803385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 171/341] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:45.804261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8544d-9afe-4862-bd0f-a0141b062e68 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:45.889868 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 171/342] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:45.977286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8544d-9afe-4862-bd0f-a0141b062e68 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:46.039084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941bd07-ce9b-4b6a-b43e-ce60ea963992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:46.039761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941bd07-ce9b-4b6a-b43e-ce60ea963992 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:46.040039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941bd07-ce9b-4b6a-b43e-ce60ea963992 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:46.040308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941bd07-ce9b-4b6a-b43e-ce60ea963992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:46.053381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941bd07-ce9b-4b6a-b43e-ce60ea963992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:46.054872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941bd07-ce9b-4b6a-b43e-ce60ea963992 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-1941bd07-ce9b-4b6a-b43e-ce60ea963992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:46.083803 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:46.084862 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:46.085709 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:46.085709 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:46.085709 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:46.085709 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 172/343] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:46.096758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9f57-f665-4a2f-bd9c-4499ab5ac3ac None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:46.191105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941bd07-ce9b-4b6a-b43e-ce60ea963992 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:46.214601 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:46.219189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9f57-f665-4a2f-bd9c-4499ab5ac3ac None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:46.248301 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:46.262031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04f1a-d74f-410b-ba65-47f010e7b6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:46.262665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04f1a-d74f-410b-ba65-47f010e7b6d3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:46.262979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04f1a-d74f-410b-ba65-47f010e7b6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:46.263255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04f1a-d74f-410b-ba65-47f010e7b6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:46.263915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b04f1a-d74f-410b-ba65-47f010e7b6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:46.264216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b04f1a-d74f-410b-ba65-47f010e7b6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:46.265652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b04f1a-d74f-410b-ba65-47f010e7b6d3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:46.279768 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 172/344] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:46.287670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04f1a-d74f-410b-ba65-47f010e7b6d3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:46.416013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941bd07-ce9b-4b6a-b43e-ce60ea963992 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:46.443996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04f1a-d74f-410b-ba65-47f010e7b6d3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:46.474535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593175e2-8f63-46d3-ae44-bb2aa1b9f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:46.475422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593175e2-8f63-46d3-ae44-bb2aa1b9f838 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:46.475793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593175e2-8f63-46d3-ae44-bb2aa1b9f838 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:46.476160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593175e2-8f63-46d3-ae44-bb2aa1b9f838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:46.491920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593175e2-8f63-46d3-ae44-bb2aa1b9f838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:46.494300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593175e2-8f63-46d3-ae44-bb2aa1b9f838 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:46.500372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bfe4b-6833-4cae-bca1-c5e66301f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:46.501287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bfe4b-6833-4cae-bca1-c5e66301f34a None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:46.501610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bfe4b-6833-4cae-bca1-c5e66301f34a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:46.501880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bfe4b-6833-4cae-bca1-c5e66301f34a None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:46.502530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bfe4b-6833-4cae-bca1-c5e66301f34a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:46.505148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bfe4b-6833-4cae-bca1-c5e66301f34a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-593175e2-8f63-46d3-ae44-bb2aa1b9f838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:46.511744 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:46.513989 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:46.515405 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:46.515405 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:46.515405 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:46.517602 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 173/345] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:46.517844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593175e2-8f63-46d3-ae44-bb2aa1b9f838 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:46.536804 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 173/346] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:46 2022] POST /identity/v3/users => generated 246 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:28:46.537878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bfe4b-6833-4cae-bca1-c5e66301f34a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:46.576142 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:46.597584 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:46.650005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593175e2-8f63-46d3-ae44-bb2aa1b9f838 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:46.706293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63004e8e-2d61-4ce0-89af-c2dbffc0bf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:46.707028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63004e8e-2d61-4ce0-89af-c2dbffc0bf71 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:46.707306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63004e8e-2d61-4ce0-89af-c2dbffc0bf71 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:46.707577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63004e8e-2d61-4ce0-89af-c2dbffc0bf71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:46.708029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bfe4b-6833-4cae-bca1-c5e66301f34a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:46.722165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63004e8e-2d61-4ce0-89af-c2dbffc0bf71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:46.724414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63004e8e-2d61-4ce0-89af-c2dbffc0bf71 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-63004e8e-2d61-4ce0-89af-c2dbffc0bf71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:46.747619 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:46.748664 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:46.749537 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:46.749537 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:46.749537 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:46.752868 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 174/347] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:46.754730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a424f2c-338a-4b68-a7ac-d685477c9d2e None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:46.755238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a424f2c-338a-4b68-a7ac-d685477c9d2e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:46.756275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a424f2c-338a-4b68-a7ac-d685477c9d2e None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:46.758404 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 175/348] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:46.759230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a424f2c-338a-4b68-a7ac-d685477c9d2e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:46.773615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d02e3-eac0-45df-947e-f928648f5af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:46.774641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d02e3-eac0-45df-947e-f928648f5af1 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:46.775812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d02e3-eac0-45df-947e-f928648f5af1 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:46.776491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d02e3-eac0-45df-947e-f928648f5af1 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:46.777858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d02e3-eac0-45df-947e-f928648f5af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:46.778507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d02e3-eac0-45df-947e-f928648f5af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:46.780333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d02e3-eac0-45df-947e-f928648f5af1 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:46.796071 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 174/349] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:46.800674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956119a2-6f28-4237-9ba9-fee4c014bdab None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:46.800866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956119a2-6f28-4237-9ba9-fee4c014bdab None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:46.801143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956119a2-6f28-4237-9ba9-fee4c014bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:46.827370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-956119a2-6f28-4237-9ba9-fee4c014bdab None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:46.828833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-956119a2-6f28-4237-9ba9-fee4c014bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:46.893073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a424f2c-338a-4b68-a7ac-d685477c9d2e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:46.908762 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:46.930384 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 175/350] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:46.931052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956119a2-6f28-4237-9ba9-fee4c014bdab None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:46.936009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e5266-d3e9-443f-b54f-2275aea2376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:46.936916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e5266-d3e9-443f-b54f-2275aea2376c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:46.937424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e5266-d3e9-443f-b54f-2275aea2376c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:46.937902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e5266-d3e9-443f-b54f-2275aea2376c None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:46.938736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e5266-d3e9-443f-b54f-2275aea2376c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:46.939293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e5266-d3e9-443f-b54f-2275aea2376c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:46.941426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e5266-d3e9-443f-b54f-2275aea2376c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:46.946855 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:46.960310 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 176/351] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:46.966296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e5266-d3e9-443f-b54f-2275aea2376c None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:47.108649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956119a2-6f28-4237-9ba9-fee4c014bdab None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:47.157443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e5266-d3e9-443f-b54f-2275aea2376c None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:47.186706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26007d-44af-48e9-bbc3-346ea9cc4f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:47.187443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26007d-44af-48e9-bbc3-346ea9cc4f74 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:47.187810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26007d-44af-48e9-bbc3-346ea9cc4f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:47.188093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26007d-44af-48e9-bbc3-346ea9cc4f74 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:47.188766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26007d-44af-48e9-bbc3-346ea9cc4f74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:47.191021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26007d-44af-48e9-bbc3-346ea9cc4f74 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:47.196588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e7947-8593-409e-8c05-4e5bd29aa13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:47.197231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e7947-8593-409e-8c05-4e5bd29aa13c None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:47.197514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e7947-8593-409e-8c05-4e5bd29aa13c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:47.197789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e7947-8593-409e-8c05-4e5bd29aa13c None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:47.198441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e7947-8593-409e-8c05-4e5bd29aa13c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:47.199867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e7947-8593-409e-8c05-4e5bd29aa13c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:47.217889 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 176/352] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:46 2022] POST /identity/v3/users => generated 248 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:47.220036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61980ce4-f6e4-4323-bcc2-1b660b53527d None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:47.220385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61980ce4-f6e4-4323-bcc2-1b660b53527d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:47.220921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61980ce4-f6e4-4323-bcc2-1b660b53527d None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:47.224500 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 177/354] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:46 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:47.227117 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 177/354] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:47.229215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f556a3-2408-4c70-b3b7-60c70a850c63 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:47.230105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f556a3-2408-4c70-b3b7-60c70a850c63 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:47.230105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f556a3-2408-4c70-b3b7-60c70a850c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:47.262035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-99f556a3-2408-4c70-b3b7-60c70a850c63 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:47.263402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-99f556a3-2408-4c70-b3b7-60c70a850c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:47.293933 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:47.308357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61980ce4-f6e4-4323-bcc2-1b660b53527d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:47.353734 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 178/355] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:47.430259 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:47.488990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61980ce4-f6e4-4323-bcc2-1b660b53527d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:47.531297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a7dd2-a81a-4a9c-a43d-98c7af416197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:47.532065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a7dd2-a81a-4a9c-a43d-98c7af416197 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:47.532368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a7dd2-a81a-4a9c-a43d-98c7af416197 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:47.532659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a7dd2-a81a-4a9c-a43d-98c7af416197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:47.550957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a7dd2-a81a-4a9c-a43d-98c7af416197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:47.552433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a7dd2-a81a-4a9c-a43d-98c7af416197 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-830a7dd2-a81a-4a9c-a43d-98c7af416197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:47.569313 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:47.570210 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:47.571051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:47.571051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:47.571051 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:47.571051 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 178/356] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:47.577769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f556a3-2408-4c70-b3b7-60c70a850c63 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:47.696827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f556a3-2408-4c70-b3b7-60c70a850c63 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:47.720065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a7dd2-a81a-4a9c-a43d-98c7af416197 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:47.748151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b592470-2ac6-49ff-a319-91966f68395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:47.749189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b592470-2ac6-49ff-a319-91966f68395a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:47.749663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b592470-2ac6-49ff-a319-91966f68395a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:47.750126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b592470-2ac6-49ff-a319-91966f68395a None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:47.750971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b592470-2ac6-49ff-a319-91966f68395a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:47.751465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b592470-2ac6-49ff-a319-91966f68395a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:47.753279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b592470-2ac6-49ff-a319-91966f68395a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:47.776108 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 179/357] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:47.781865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b592470-2ac6-49ff-a319-91966f68395a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:47.818675 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:47.831889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a7dd2-a81a-4a9c-a43d-98c7af416197 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:47.858920 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:47.882397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:47.883479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:47.883952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:47.884417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:47.885315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:47.887723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:47.910083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.sql.core [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 00:28:47.910083 n-d-master-1 devstack@keystone.service[86425]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 00:28:47.910083 n-d-master-1 devstack@keystone.service[86425]: [parameters: {'id': '31fb22f24c6044cf8ecd430fb2801f2d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 00:28:47.910083 n-d-master-1 devstack@keystone.service[86425]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86425) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result.read() Oct 19 00:28:47.917817 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return ref.to_dict() Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:28:47.918694 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application yield resource Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise self.value Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application session.commit() Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:28:47.919609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:28:47.920440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:28:47.921443 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result.read() Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:28:47.922228 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [parameters: {'id': '31fb22f24c6044cf8ecd430fb2801f2d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:47.923001 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 00:28:47.924095 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:47.928910 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 179/358] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 19 00:28:47 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:47.935015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:47.975772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b592470-2ac6-49ff-a319-91966f68395a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:48.019577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a8e11-6596-4373-a430-9103ab183d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:48.020203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a8e11-6596-4373-a430-9103ab183d0b None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:48.020485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a8e11-6596-4373-a430-9103ab183d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:48.020795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a8e11-6596-4373-a430-9103ab183d0b None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:48.021471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a8e11-6596-4373-a430-9103ab183d0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:48.025680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a8e11-6596-4373-a430-9103ab183d0b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:48.050961 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 180/359] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:47 2022] POST /identity/v3/users => generated 249 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:28:48.122105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85902a-095d-46cc-bd98-2fb1de5b547c None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:48.184204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc72a28-1f58-4680-83bd-c304e44fe5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:48.184916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72a28-1f58-4680-83bd-c304e44fe5c3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:48.185201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72a28-1f58-4680-83bd-c304e44fe5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:48.185476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72a28-1f58-4680-83bd-c304e44fe5c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:48.203582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc72a28-1f58-4680-83bd-c304e44fe5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-bdc72a28-1f58-4680-83bd-c304e44fe5c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:48.210199 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:48.211162 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:48.212042 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 180/360] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:28:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:48.218516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a8e11-6596-4373-a430-9103ab183d0b None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:48.321849 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:48.348974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a8e11-6596-4373-a430-9103ab183d0b None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:48.385759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52308d76-0913-4662-9ac1-f262c10fc1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:48.386300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308d76-0913-4662-9ac1-f262c10fc1d1 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:48.386583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308d76-0913-4662-9ac1-f262c10fc1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:48.386899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308d76-0913-4662-9ac1-f262c10fc1d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:48.387581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52308d76-0913-4662-9ac1-f262c10fc1d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:48.387882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52308d76-0913-4662-9ac1-f262c10fc1d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:48.389293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52308d76-0913-4662-9ac1-f262c10fc1d1 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:48.399032 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 181/361] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:49.350659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9d2a7-d0bb-4c73-b115-09aa4085b148 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:49.351195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9d2a7-d0bb-4c73-b115-09aa4085b148 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:49.351195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9d2a7-d0bb-4c73-b115-09aa4085b148 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:49.352854 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 181/362] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:49.365940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3633b-e555-497c-a3c4-236eff75f61f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:49.366443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3633b-e555-497c-a3c4-236eff75f61f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:49.366521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3633b-e555-497c-a3c4-236eff75f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:49.392898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-15a3633b-e555-497c-a3c4-236eff75f61f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:49.394140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-15a3633b-e555-497c-a3c4-236eff75f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:49.483226 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 182/363] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:49.934227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9d2a7-d0bb-4c73-b115-09aa4085b148 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:49.994244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149668-5d4f-47b7-a163-d4d31fcd1879 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:49.994835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149668-5d4f-47b7-a163-d4d31fcd1879 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:49.995299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149668-5d4f-47b7-a163-d4d31fcd1879 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:49.997924 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:49.998174 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 183/364] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:50.002292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a2979-b49c-44f8-9f98-3a80566834b5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:50.002573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a2979-b49c-44f8-9f98-3a80566834b5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:50.002849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a2979-b49c-44f8-9f98-3a80566834b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:50.038960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a43a2979-b49c-44f8-9f98-3a80566834b5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:50.040152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a43a2979-b49c-44f8-9f98-3a80566834b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:50.069212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9d2a7-d0bb-4c73-b115-09aa4085b148 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:50.111438 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:50.117983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1406e72-4f9b-4db3-a297-7a19bb3bde06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:50.118676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1406e72-4f9b-4db3-a297-7a19bb3bde06 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:50.118982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1406e72-4f9b-4db3-a297-7a19bb3bde06 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:50.124852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1406e72-4f9b-4db3-a297-7a19bb3bde06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:50.124989 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 184/365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:50.124989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89240-d15a-4b0e-9eaa-406fe430fab9 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:50.124989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89240-d15a-4b0e-9eaa-406fe430fab9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:50.124989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89240-d15a-4b0e-9eaa-406fe430fab9 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:50.125244 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 185/366] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:50.130957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1406e72-4f9b-4db3-a297-7a19bb3bde06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-f1406e72-4f9b-4db3-a297-7a19bb3bde06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:50.135922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:50.136835 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:50.137611 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 182/367] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:50.143576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89240-d15a-4b0e-9eaa-406fe430fab9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:50.146599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64dcd-c653-4253-8bf8-5d242455f5d5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:50.146886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64dcd-c653-4253-8bf8-5d242455f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:50.147154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64dcd-c653-4253-8bf8-5d242455f5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:50.186260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-88e64dcd-c653-4253-8bf8-5d242455f5d5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:50.187402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-88e64dcd-c653-4253-8bf8-5d242455f5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:50.326243 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 183/368] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:50.339864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89240-d15a-4b0e-9eaa-406fe430fab9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:50.389748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ea8f-e3b9-47a7-95ba-151f4bd28593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:50.390403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ea8f-e3b9-47a7-95ba-151f4bd28593 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:50.390628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ea8f-e3b9-47a7-95ba-151f4bd28593 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:50.390904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ea8f-e3b9-47a7-95ba-151f4bd28593 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:50.391646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ea8f-e3b9-47a7-95ba-151f4bd28593 None admin] RBAC: Adding query filter params (name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:50.391949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ea8f-e3b9-47a7-95ba-151f4bd28593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:50.394044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ea8f-e3b9-47a7-95ba-151f4bd28593 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:50.404651 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 186/369] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:50.411166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e64dcd-c653-4253-8bf8-5d242455f5d5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:50.419762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ea8f-e3b9-47a7-95ba-151f4bd28593 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:50.481063 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:50.491077 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:50.559552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ea8f-e3b9-47a7-95ba-151f4bd28593 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:50.592757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e64dcd-c653-4253-8bf8-5d242455f5d5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:50.596967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590eda76-33b1-4616-a2f0-f1f83caae0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:50.597616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eda76-33b1-4616-a2f0-f1f83caae0e8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:50.597898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eda76-33b1-4616-a2f0-f1f83caae0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:50.599940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eda76-33b1-4616-a2f0-f1f83caae0e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:50.609394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590eda76-33b1-4616-a2f0-f1f83caae0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-590eda76-33b1-4616-a2f0-f1f83caae0e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:50.616407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:50.617493 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:50.618396 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 187/370] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:50.627609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590eda76-33b1-4616-a2f0-f1f83caae0e8 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:50.666685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131dac0-0f3b-4058-8e45-ddca7c9dd0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:50.667741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131dac0-0f3b-4058-8e45-ddca7c9dd0ac None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:50.668224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131dac0-0f3b-4058-8e45-ddca7c9dd0ac None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:50.668725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131dac0-0f3b-4058-8e45-ddca7c9dd0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:50.685810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131dac0-0f3b-4058-8e45-ddca7c9dd0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:50.690397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131dac0-0f3b-4058-8e45-ddca7c9dd0ac None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-d131dac0-0f3b-4058-8e45-ddca7c9dd0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:50.716376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:50.717373 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:50.718219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:50.718219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:50.718219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:50.723626 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 184/371] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:50.726910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131dac0-0f3b-4058-8e45-ddca7c9dd0ac None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:50.789247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590eda76-33b1-4616-a2f0-f1f83caae0e8 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:50.817646 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:50.834119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd643882-7c70-4021-b068-e85d89859d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:50.835218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643882-7c70-4021-b068-e85d89859d7c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:50.835218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643882-7c70-4021-b068-e85d89859d7c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:50.835633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643882-7c70-4021-b068-e85d89859d7c None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:50.836415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd643882-7c70-4021-b068-e85d89859d7c None admin] RBAC: Adding query filter params (name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:50.836855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd643882-7c70-4021-b068-e85d89859d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:50.838688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd643882-7c70-4021-b068-e85d89859d7c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:50.847846 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:50.852839 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 188/372] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:50.854300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd643882-7c70-4021-b068-e85d89859d7c None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:50.870838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131dac0-0f3b-4058-8e45-ddca7c9dd0ac None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:50.912807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7d9e6-9a78-4b34-b50d-00491c0df418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:50.913670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7d9e6-9a78-4b34-b50d-00491c0df418 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:50.914093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7d9e6-9a78-4b34-b50d-00491c0df418 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:50.914693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7d9e6-9a78-4b34-b50d-00491c0df418 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:50.915954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7d9e6-9a78-4b34-b50d-00491c0df418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:50.916407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7d9e6-9a78-4b34-b50d-00491c0df418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:50.917953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7d9e6-9a78-4b34-b50d-00491c0df418 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:50.932711 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 185/373] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:50.938373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7d9e6-9a78-4b34-b50d-00491c0df418 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:50.982927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd643882-7c70-4021-b068-e85d89859d7c None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.020905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64e4cd-a767-4edb-a1da-b3f546344e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.021905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64e4cd-a767-4edb-a1da-b3f546344e2e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.022389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64e4cd-a767-4edb-a1da-b3f546344e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.022893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64e4cd-a767-4edb-a1da-b3f546344e2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.035711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64e4cd-a767-4edb-a1da-b3f546344e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-8a64e4cd-a767-4edb-a1da-b3f546344e2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:51.041724 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:51.042637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:51.043442 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:51.045931 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 189/374] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:51.046970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64e4cd-a767-4edb-a1da-b3f546344e2e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:51.068355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7d9e6-9a78-4b34-b50d-00491c0df418 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.106519 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:51.117812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae1819-c816-4d9d-8851-a44f3f75ffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.118475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae1819-c816-4d9d-8851-a44f3f75ffd7 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.118757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae1819-c816-4d9d-8851-a44f3f75ffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.119036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae1819-c816-4d9d-8851-a44f3f75ffd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.132990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae1819-c816-4d9d-8851-a44f3f75ffd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:51.133710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae1819-c816-4d9d-8851-a44f3f75ffd7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:51.142177 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-34ae1819-c816-4d9d-8851-a44f3f75ffd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:51.152403 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:51.154240 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:51.155309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:51.155309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:51.155309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:51.155309 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 186/375] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:51.155309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae1819-c816-4d9d-8851-a44f3f75ffd7 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:51.177491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64e4cd-a767-4edb-a1da-b3f546344e2e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.217131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dd9e5-b1bb-4cce-b6f4-8700e40deff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.217775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd9e5-b1bb-4cce-b6f4-8700e40deff9 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.218057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd9e5-b1bb-4cce-b6f4-8700e40deff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.218334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd9e5-b1bb-4cce-b6f4-8700e40deff9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.226600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dd9e5-b1bb-4cce-b6f4-8700e40deff9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:51.228100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dd9e5-b1bb-4cce-b6f4-8700e40deff9 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-088dd9e5-b1bb-4cce-b6f4-8700e40deff9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:28:51.241835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:51.242866 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:51.243749 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 190/376] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 19 00:28:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:51.244312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f3784-d4bd-4f8c-85d4-81ba69bc8f36 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.244932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f3784-d4bd-4f8c-85d4-81ba69bc8f36 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.244932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f3784-d4bd-4f8c-85d4-81ba69bc8f36 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.246088 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 191/377] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:51.248492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f3784-d4bd-4f8c-85d4-81ba69bc8f36 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:51.274580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae1819-c816-4d9d-8851-a44f3f75ffd7 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.318255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea31c62-06fe-480b-b708-4b5ad10b2e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.318789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea31c62-06fe-480b-b708-4b5ad10b2e88 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.319070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea31c62-06fe-480b-b708-4b5ad10b2e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.319345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea31c62-06fe-480b-b708-4b5ad10b2e88 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.320013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea31c62-06fe-480b-b708-4b5ad10b2e88 None admin] RBAC: Adding query filter params (name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:51.320318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea31c62-06fe-480b-b708-4b5ad10b2e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:51.321739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea31c62-06fe-480b-b708-4b5ad10b2e88 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:51.330950 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 187/378] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:28:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:51.332234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b0338-d377-4b97-be2f-b01996f64628 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.332519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b0338-d377-4b97-be2f-b01996f64628 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.332818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b0338-d377-4b97-be2f-b01996f64628 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.334201 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 188/379] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:51.334785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b0338-d377-4b97-be2f-b01996f64628 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:51.364110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f3784-d4bd-4f8c-85d4-81ba69bc8f36 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.365793 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:51.401576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab063975-8eb0-4af8-b7cf-96005eb0953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.402226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab063975-8eb0-4af8-b7cf-96005eb0953c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.402718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab063975-8eb0-4af8-b7cf-96005eb0953c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.402965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab063975-8eb0-4af8-b7cf-96005eb0953c None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.403692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab063975-8eb0-4af8-b7cf-96005eb0953c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:51.403846 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:51.404397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab063975-8eb0-4af8-b7cf-96005eb0953c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:51.405648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab063975-8eb0-4af8-b7cf-96005eb0953c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:51.419019 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 192/380] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:51.420369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9d70-0e74-4e95-85f1-0ec0a31692a6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.420672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9d70-0e74-4e95-85f1-0ec0a31692a6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.420934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9d70-0e74-4e95-85f1-0ec0a31692a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.442339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-681b9d70-0e74-4e95-85f1-0ec0a31692a6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:51.443564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-681b9d70-0e74-4e95-85f1-0ec0a31692a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:51.451294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b0338-d377-4b97-be2f-b01996f64628 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.492435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f4f43-4dfe-4b68-b313-bfb074053368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.493102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f4f43-4dfe-4b68-b313-bfb074053368 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.493384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f4f43-4dfe-4b68-b313-bfb074053368 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.493658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f4f43-4dfe-4b68-b313-bfb074053368 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.494441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f4f43-4dfe-4b68-b313-bfb074053368 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:51.494749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f4f43-4dfe-4b68-b313-bfb074053368 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:51.496228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f4f43-4dfe-4b68-b313-bfb074053368 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:51.517782 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 193/381] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:51.519023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9d70-0e74-4e95-85f1-0ec0a31692a6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:51.539142 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 189/382] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 19 00:28:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:51.540778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a6ad5-99dc-4633-a243-79c1de26a663 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.541239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a6ad5-99dc-4633-a243-79c1de26a663 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.541659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a6ad5-99dc-4633-a243-79c1de26a663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.561992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e89a6ad5-99dc-4633-a243-79c1de26a663 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:51.563233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e89a6ad5-99dc-4633-a243-79c1de26a663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:51.639963 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:51.645257 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 190/383] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:51.646143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a6ad5-99dc-4633-a243-79c1de26a663 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:51.660680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9d70-0e74-4e95-85f1-0ec0a31692a6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.699528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c05649-1a5e-448c-812c-4f904311d86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.700558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c05649-1a5e-448c-812c-4f904311d86a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.701043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c05649-1a5e-448c-812c-4f904311d86a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.701494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c05649-1a5e-448c-812c-4f904311d86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.702335 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:51.716430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c05649-1a5e-448c-812c-4f904311d86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:51.718836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c05649-1a5e-448c-812c-4f904311d86a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-e6c05649-1a5e-448c-812c-4f904311d86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:51.738205 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:51.739164 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:51.740021 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:51.740021 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:51.740021 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:51.742126 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 194/384] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:51.743373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c05649-1a5e-448c-812c-4f904311d86a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:51.766574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a6ad5-99dc-4633-a243-79c1de26a663 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.815046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865edb62-3cc2-4a13-a3b9-80fddc3a22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.815719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865edb62-3cc2-4a13-a3b9-80fddc3a22aa None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.815968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865edb62-3cc2-4a13-a3b9-80fddc3a22aa None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.816296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865edb62-3cc2-4a13-a3b9-80fddc3a22aa None admin] PATH_INFO: `/v3/users/glance` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.824370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865edb62-3cc2-4a13-a3b9-80fddc3a22aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:51.825819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865edb62-3cc2-4a13-a3b9-80fddc3a22aa None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-865edb62-3cc2-4a13-a3b9-80fddc3a22aa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:28:51.840287 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:51.841442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:51.842886 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 191/385] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:51.847051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865edb62-3cc2-4a13-a3b9-80fddc3a22aa None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:51.860020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c05649-1a5e-448c-812c-4f904311d86a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.897579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc9e5-860a-4d51-a4c1-7d67fa038a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.898125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc9e5-860a-4d51-a4c1-7d67fa038a5d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.898403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc9e5-860a-4d51-a4c1-7d67fa038a5d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.898692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc9e5-860a-4d51-a4c1-7d67fa038a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.910286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bc9e5-860a-4d51-a4c1-7d67fa038a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:51.912300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bc9e5-860a-4d51-a4c1-7d67fa038a5d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:51.915265 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-637bc9e5-860a-4d51-a4c1-7d67fa038a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:51.928508 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:51.929505 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:51.930983 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:51.930983 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:51.930983 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:51.930983 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 195/386] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:51.930983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc9e5-860a-4d51-a4c1-7d67fa038a5d None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:51.958389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865edb62-3cc2-4a13-a3b9-80fddc3a22aa None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:51.967807 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:51.994848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0299f42-d284-4513-ace2-ae347ecb460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:51.995491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0299f42-d284-4513-ace2-ae347ecb460c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:51.995771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0299f42-d284-4513-ace2-ae347ecb460c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:51.996044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0299f42-d284-4513-ace2-ae347ecb460c None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:51.996719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0299f42-d284-4513-ace2-ae347ecb460c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:51.997026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0299f42-d284-4513-ace2-ae347ecb460c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:51.998704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0299f42-d284-4513-ace2-ae347ecb460c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.012021 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 192/387] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:52.013181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0299f42-d284-4513-ace2-ae347ecb460c None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.034765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc9e5-860a-4d51-a4c1-7d67fa038a5d None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.070791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee3f0b-a278-459f-858b-384ad0b61a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.071418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee3f0b-a278-459f-858b-384ad0b61a5c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.071694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee3f0b-a278-459f-858b-384ad0b61a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.071964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee3f0b-a278-459f-858b-384ad0b61a5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.082509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee3f0b-a278-459f-858b-384ad0b61a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-74ee3f0b-a278-459f-858b-384ad0b61a5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:52.088000 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:52.088919 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 196/388] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:52.093464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee3f0b-a278-459f-858b-384ad0b61a5c None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.120916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0299f42-d284-4513-ace2-ae347ecb460c None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.146753 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:52.155692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11e430-1506-4d52-8c33-ef0f212197c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.156242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11e430-1506-4d52-8c33-ef0f212197c6 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.156522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11e430-1506-4d52-8c33-ef0f212197c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.156826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11e430-1506-4d52-8c33-ef0f212197c6 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.157563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11e430-1506-4d52-8c33-ef0f212197c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:52.158031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11e430-1506-4d52-8c33-ef0f212197c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.159467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11e430-1506-4d52-8c33-ef0f212197c6 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.177356 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 193/389] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:52.178288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11e430-1506-4d52-8c33-ef0f212197c6 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.193629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee3f0b-a278-459f-858b-384ad0b61a5c None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.205952 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:52.229041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d029d-ebd4-42f2-8843-5064c0f29cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.229670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d029d-ebd4-42f2-8843-5064c0f29cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.229944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d029d-ebd4-42f2-8843-5064c0f29cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.230213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d029d-ebd4-42f2-8843-5064c0f29cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.240796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d029d-ebd4-42f2-8843-5064c0f29cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.242258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d029d-ebd4-42f2-8843-5064c0f29cb3 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-627d029d-ebd4-42f2-8843-5064c0f29cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:52.256246 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:52.257409 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:52.258265 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:52.258265 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:52.258265 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:52.258265 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 197/390] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:52.258265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d029d-ebd4-42f2-8843-5064c0f29cb3 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.283602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11e430-1506-4d52-8c33-ef0f212197c6 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.317472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d661-6cfa-4947-be51-c965aeb1878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.318075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d661-6cfa-4947-be51-c965aeb1878b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.318353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d661-6cfa-4947-be51-c965aeb1878b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.318626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d661-6cfa-4947-be51-c965aeb1878b None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.319260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d661-6cfa-4947-be51-c965aeb1878b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:52.319562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d661-6cfa-4947-be51-c965aeb1878b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.320973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d661-6cfa-4947-be51-c965aeb1878b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.332102 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 194/391] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:52.332946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d661-6cfa-4947-be51-c965aeb1878b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.358892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d029d-ebd4-42f2-8843-5064c0f29cb3 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.369373 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:52.395034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b822-b0f6-44c4-bc46-e1f974441e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.395662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b822-b0f6-44c4-bc46-e1f974441e45 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.395934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b822-b0f6-44c4-bc46-e1f974441e45 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.396210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b822-b0f6-44c4-bc46-e1f974441e45 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.403665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b822-b0f6-44c4-bc46-e1f974441e45 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.405139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b822-b0f6-44c4-bc46-e1f974441e45 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-8704b822-b0f6-44c4-bc46-e1f974441e45 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:28:52.416886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:52.417896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 198/392] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:52.418793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b822-b0f6-44c4-bc46-e1f974441e45 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.426622 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:52.442422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d661-6cfa-4947-be51-c965aeb1878b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.477752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15b00-17f5-4b49-9724-4982da34d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.478373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15b00-17f5-4b49-9724-4982da34d8aa None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.478642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15b00-17f5-4b49-9724-4982da34d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.478911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15b00-17f5-4b49-9724-4982da34d8aa None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.479564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c15b00-17f5-4b49-9724-4982da34d8aa None admin] RBAC: Adding query filter params (name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:52.479864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c15b00-17f5-4b49-9724-4982da34d8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.481284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c15b00-17f5-4b49-9724-4982da34d8aa None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.489383 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 195/393] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:52.490165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15b00-17f5-4b49-9724-4982da34d8aa None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.525142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b822-b0f6-44c4-bc46-e1f974441e45 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.560719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad1f61-1ff9-4032-a517-3f5da991ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.561352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad1f61-1ff9-4032-a517-3f5da991ed24 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.561631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad1f61-1ff9-4032-a517-3f5da991ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.561907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad1f61-1ff9-4032-a517-3f5da991ed24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.572879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad1f61-1ff9-4032-a517-3f5da991ed24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.574345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad1f61-1ff9-4032-a517-3f5da991ed24 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-7bad1f61-1ff9-4032-a517-3f5da991ed24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:52.588990 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:52.590109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:52.591211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:52.591211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:52.591211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:52.591211 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 199/394] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:52.591707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15b00-17f5-4b49-9724-4982da34d8aa None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.592428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad1f61-1ff9-4032-a517-3f5da991ed24 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.614315 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:52.627505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf57c24-f9fe-4b87-b14f-e42852b1eef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.628117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf57c24-f9fe-4b87-b14f-e42852b1eef7 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.628390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf57c24-f9fe-4b87-b14f-e42852b1eef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.628685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf57c24-f9fe-4b87-b14f-e42852b1eef7 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.629323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf57c24-f9fe-4b87-b14f-e42852b1eef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:52.629623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf57c24-f9fe-4b87-b14f-e42852b1eef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.630988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf57c24-f9fe-4b87-b14f-e42852b1eef7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.642791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 196/395] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:52.643436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf57c24-f9fe-4b87-b14f-e42852b1eef7 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.653878 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:52.701503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad1f61-1ff9-4032-a517-3f5da991ed24 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.736862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e59d-576b-4bd3-ab08-48ab10b11ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.737496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e59d-576b-4bd3-ab08-48ab10b11ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.737778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e59d-576b-4bd3-ab08-48ab10b11ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.738053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e59d-576b-4bd3-ab08-48ab10b11ca5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.744725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e59d-576b-4bd3-ab08-48ab10b11ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.746169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e59d-576b-4bd3-ab08-48ab10b11ca5 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.747009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf57c24-f9fe-4b87-b14f-e42852b1eef7 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-b3f8e59d-576b-4bd3-ab08-48ab10b11ca5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:28:52.758211 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:52.759313 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 200/396] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:52.760170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e59d-576b-4bd3-ab08-48ab10b11ca5 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.786932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341ee45-9559-4dcd-898b-aea5b9e604d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.787550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341ee45-9559-4dcd-898b-aea5b9e604d3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.787831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341ee45-9559-4dcd-898b-aea5b9e604d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.788101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341ee45-9559-4dcd-898b-aea5b9e604d3 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.788868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341ee45-9559-4dcd-898b-aea5b9e604d3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:52.789170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341ee45-9559-4dcd-898b-aea5b9e604d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.790593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341ee45-9559-4dcd-898b-aea5b9e604d3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.808476 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 197/397] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:52.813488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341ee45-9559-4dcd-898b-aea5b9e604d3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.841568 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:52.861766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e59d-576b-4bd3-ab08-48ab10b11ca5 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.878678 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:52.895524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee361-2254-4bf4-9342-0b208ce68b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.896152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee361-2254-4bf4-9342-0b208ce68b65 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.896435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee361-2254-4bf4-9342-0b208ce68b65 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.896741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee361-2254-4bf4-9342-0b208ce68b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.907491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ee361-2254-4bf4-9342-0b208ce68b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.909707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ee361-2254-4bf4-9342-0b208ce68b65 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.913421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341ee45-9559-4dcd-898b-aea5b9e604d3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-ce3ee361-2254-4bf4-9342-0b208ce68b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:52.923673 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:52.924788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:52.925830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:52.925830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:52.925830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:52.925830 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 201/398] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:52.925830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee361-2254-4bf4-9342-0b208ce68b65 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:52.949919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d6b64-616d-47c8-8fcf-11afddb89a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:52.950618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d6b64-616d-47c8-8fcf-11afddb89a15 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:52.950980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d6b64-616d-47c8-8fcf-11afddb89a15 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:52.951324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d6b64-616d-47c8-8fcf-11afddb89a15 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:52.952020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d6b64-616d-47c8-8fcf-11afddb89a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:52.952272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d6b64-616d-47c8-8fcf-11afddb89a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:52.953681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d6b64-616d-47c8-8fcf-11afddb89a15 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:52.965728 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 198/399] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:52.967007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d6b64-616d-47c8-8fcf-11afddb89a15 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.027399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee361-2254-4bf4-9342-0b208ce68b65 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.057246 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:53.062760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f911-b19d-448e-a75d-6a3d85744d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.063487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f911-b19d-448e-a75d-6a3d85744d1c None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.063802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f911-b19d-448e-a75d-6a3d85744d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.065090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f911-b19d-448e-a75d-6a3d85744d1c None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.065748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255f911-b19d-448e-a75d-6a3d85744d1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.067196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255f911-b19d-448e-a75d-6a3d85744d1c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.069945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d6b64-616d-47c8-8fcf-11afddb89a15 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.089074 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 202/400] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:28:52 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:28:53.089910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f911-b19d-448e-a75d-6a3d85744d1c None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.108510 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:53.120452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0e4ff-5fda-482c-a557-a4fb88caf0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.121546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0e4ff-5fda-482c-a557-a4fb88caf0ac None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.121823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0e4ff-5fda-482c-a557-a4fb88caf0ac None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.122367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0e4ff-5fda-482c-a557-a4fb88caf0ac None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.123094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0e4ff-5fda-482c-a557-a4fb88caf0ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:53.123403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0e4ff-5fda-482c-a557-a4fb88caf0ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.124919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0e4ff-5fda-482c-a557-a4fb88caf0ac None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.145855 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 199/401] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:53.146959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0e4ff-5fda-482c-a557-a4fb88caf0ac None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.210175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f911-b19d-448e-a75d-6a3d85744d1c None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.248850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa5844-3d56-4ef9-8796-c28445550839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.249637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa5844-3d56-4ef9-8796-c28445550839 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.249984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa5844-3d56-4ef9-8796-c28445550839 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.250377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa5844-3d56-4ef9-8796-c28445550839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.263536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa5844-3d56-4ef9-8796-c28445550839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.265035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa5844-3d56-4ef9-8796-c28445550839 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.272273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0e4ff-5fda-482c-a557-a4fb88caf0ac None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-8dfa5844-3d56-4ef9-8796-c28445550839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:53.280992 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:53.281946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:53.283428 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:53.283428 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:53.283428 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:53.283428 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 203/402] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:53.283654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa5844-3d56-4ef9-8796-c28445550839 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.323697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ba31a-7b5d-49c0-9429-924a95500bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.325174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ba31a-7b5d-49c0-9429-924a95500bae None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.325462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ba31a-7b5d-49c0-9429-924a95500bae None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.325732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ba31a-7b5d-49c0-9429-924a95500bae None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.326378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ba31a-7b5d-49c0-9429-924a95500bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:53.326681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ba31a-7b5d-49c0-9429-924a95500bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.328057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ba31a-7b5d-49c0-9429-924a95500bae None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.332041 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:53.347724 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 200/403] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:53.347724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ba31a-7b5d-49c0-9429-924a95500bae None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.400207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa5844-3d56-4ef9-8796-c28445550839 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.402256 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:53.442891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff73540-b5d7-4c08-bd7a-6407b903954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.443650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73540-b5d7-4c08-bd7a-6407b903954e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.443998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73540-b5d7-4c08-bd7a-6407b903954e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.444275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73540-b5d7-4c08-bd7a-6407b903954e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.451635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff73540-b5d7-4c08-bd7a-6407b903954e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.453223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff73540-b5d7-4c08-bd7a-6407b903954e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.464680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ba31a-7b5d-49c0-9429-924a95500bae None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-9ff73540-b5d7-4c08-bd7a-6407b903954e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:28:53.466373 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:53.467250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:53.468152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:28:53.468152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:28:53.468152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:28:53.468152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:28:53.468152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:28:53.468152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:28:53.468152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:53.468152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:53.468152 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 204/404] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:53.470747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff73540-b5d7-4c08-bd7a-6407b903954e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.513092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2a75-bc50-4712-a746-7dcb3637408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.513808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2a75-bc50-4712-a746-7dcb3637408a None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.514019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2a75-bc50-4712-a746-7dcb3637408a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.514290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2a75-bc50-4712-a746-7dcb3637408a None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0165e2f8b5e34c8d8570262c777de161/roles/aceae500b40841d18a66edacfc4a12cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.531527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf2a75-bc50-4712-a746-7dcb3637408a None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=0165e2f8b5e34c8d8570262c777de161, role_id=aceae500b40841d18a66edacfc4a12cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.533301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf2a75-bc50-4712-a746-7dcb3637408a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.551538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 201/405] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:53 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0165e2f8b5e34c8d8570262c777de161/roles/aceae500b40841d18a66edacfc4a12cf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:53.552974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2a75-bc50-4712-a746-7dcb3637408a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.583338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff73540-b5d7-4c08-bd7a-6407b903954e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.585817 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:53.626258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158885f1-aebf-494d-a569-2bf6e3051741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.627994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158885f1-aebf-494d-a569-2bf6e3051741 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.628432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158885f1-aebf-494d-a569-2bf6e3051741 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.628903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158885f1-aebf-494d-a569-2bf6e3051741 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.629729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158885f1-aebf-494d-a569-2bf6e3051741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:53.630270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158885f1-aebf-494d-a569-2bf6e3051741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.631969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158885f1-aebf-494d-a569-2bf6e3051741 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.646293 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 205/406] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:53.647412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158885f1-aebf-494d-a569-2bf6e3051741 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.700099 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:53.711042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2a75-bc50-4712-a746-7dcb3637408a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.757544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33284f-593b-4eb1-9403-d3ea6920a25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.758574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33284f-593b-4eb1-9403-d3ea6920a25e None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.759071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33284f-593b-4eb1-9403-d3ea6920a25e None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.759557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33284f-593b-4eb1-9403-d3ea6920a25e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.768916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33284f-593b-4eb1-9403-d3ea6920a25e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.771006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33284f-593b-4eb1-9403-d3ea6920a25e None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-fa33284f-593b-4eb1-9403-d3ea6920a25e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:28:53.786821 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:53.787795 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:28:53.788722 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:53.794483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 202/407] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:53.794483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33284f-593b-4eb1-9403-d3ea6920a25e None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.798021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158885f1-aebf-494d-a569-2bf6e3051741 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.846771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77b959-794d-4cdf-b395-631a31c8e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.847671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77b959-794d-4cdf-b395-631a31c8e19a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.847961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77b959-794d-4cdf-b395-631a31c8e19a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.848236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77b959-794d-4cdf-b395-631a31c8e19a None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.849164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77b959-794d-4cdf-b395-631a31c8e19a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:53.849472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77b959-794d-4cdf-b395-631a31c8e19a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.851250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77b959-794d-4cdf-b395-631a31c8e19a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.875729 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 206/408] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:53.877229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77b959-794d-4cdf-b395-631a31c8e19a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:53.905759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33284f-593b-4eb1-9403-d3ea6920a25e None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:53.906426 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:53.947904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2097a-04a7-4094-aa29-416f5072cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:53.949034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2097a-04a7-4094-aa29-416f5072cb39 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.949320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2097a-04a7-4094-aa29-416f5072cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.949733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2097a-04a7-4094-aa29-416f5072cb39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.960601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2097a-04a7-4094-aa29-416f5072cb39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:53.962096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2097a-04a7-4094-aa29-416f5072cb39 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-dbe2097a-04a7-4094-aa29-416f5072cb39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:28:53.975946 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:53.976910 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:53.978179 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:28:53.978179 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:28:53.978179 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:28:53.978179 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:28:53.978179 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:28:53.978179 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:28:53.978179 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:53.978179 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:53.978179 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 203/409] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:53.978645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2097a-04a7-4094-aa29-416f5072cb39 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:54.000436 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:54.013381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77b959-794d-4cdf-b395-631a31c8e19a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:54.062574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7a84d-5b29-44a1-a0b8-b30dc0668f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:54.063281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7a84d-5b29-44a1-a0b8-b30dc0668f42 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:54.064765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7a84d-5b29-44a1-a0b8-b30dc0668f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:54.065120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7a84d-5b29-44a1-a0b8-b30dc0668f42 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:54.066236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7a84d-5b29-44a1-a0b8-b30dc0668f42 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:54.066624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7a84d-5b29-44a1-a0b8-b30dc0668f42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:54.069397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7a84d-5b29-44a1-a0b8-b30dc0668f42 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:54.107922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2097a-04a7-4094-aa29-416f5072cb39 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:54.122290 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 207/410] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Oct 19 00:28:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:54.123997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7a84d-5b29-44a1-a0b8-b30dc0668f42 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:54.153757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23cbd2-2aef-4a5f-b864-9f3f8c5670e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:54.155074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23cbd2-2aef-4a5f-b864-9f3f8c5670e9 None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:54.155699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23cbd2-2aef-4a5f-b864-9f3f8c5670e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:54.156510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23cbd2-2aef-4a5f-b864-9f3f8c5670e9 None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/6eb751f44d3b4fb3b49a0084e76176d9/roles/aceae500b40841d18a66edacfc4a12cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:54.182105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23cbd2-2aef-4a5f-b864-9f3f8c5670e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=6eb751f44d3b4fb3b49a0084e76176d9, role_id=aceae500b40841d18a66edacfc4a12cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:54.184609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23cbd2-2aef-4a5f-b864-9f3f8c5670e9 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:54.204182 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 204/411] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:53 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/6eb751f44d3b4fb3b49a0084e76176d9/roles/aceae500b40841d18a66edacfc4a12cf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:54.211445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23cbd2-2aef-4a5f-b864-9f3f8c5670e9 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:54.256478 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:54.310422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7a84d-5b29-44a1-a0b8-b30dc0668f42 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:54.364447 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:54.391242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82939e2b-3e34-4b2d-b0c7-c634a4d97da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:54.392465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82939e2b-3e34-4b2d-b0c7-c634a4d97da7 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:54.392782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82939e2b-3e34-4b2d-b0c7-c634a4d97da7 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:54.393345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82939e2b-3e34-4b2d-b0c7-c634a4d97da7 None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:54.393768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82939e2b-3e34-4b2d-b0c7-c634a4d97da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:54.394078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82939e2b-3e34-4b2d-b0c7-c634a4d97da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:54.398892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82939e2b-3e34-4b2d-b0c7-c634a4d97da7 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:54.425987 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 208/412] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:54.432988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82939e2b-3e34-4b2d-b0c7-c634a4d97da7 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:54.439346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23cbd2-2aef-4a5f-b864-9f3f8c5670e9 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:54.478177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8088a3-68a9-41b7-9ce2-0be014f0065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:54.478836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8088a3-68a9-41b7-9ce2-0be014f0065d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:54.479114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8088a3-68a9-41b7-9ce2-0be014f0065d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:54.479389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8088a3-68a9-41b7-9ce2-0be014f0065d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:54.490625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8088a3-68a9-41b7-9ce2-0be014f0065d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:54.492188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8088a3-68a9-41b7-9ce2-0be014f0065d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-9d8088a3-68a9-41b7-9ce2-0be014f0065d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:54.509376 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:54.510461 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:54.511974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:54.511974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:54.511974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:54.511974 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 205/413] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:54.516277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8088a3-68a9-41b7-9ce2-0be014f0065d None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:54.567622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82939e2b-3e34-4b2d-b0c7-c634a4d97da7 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:54.613380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56cbd-50c3-4605-bdff-a676418bf1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:54.614431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56cbd-50c3-4605-bdff-a676418bf1d6 None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:54.614944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56cbd-50c3-4605-bdff-a676418bf1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:54.615430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56cbd-50c3-4605-bdff-a676418bf1d6 None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/5f3c0c082e3044b283bfeb58543d088c/roles/aceae500b40841d18a66edacfc4a12cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:54.625922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8088a3-68a9-41b7-9ce2-0be014f0065d None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:54.638980 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:54.657258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56cbd-50c3-4605-bdff-a676418bf1d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=5f3c0c082e3044b283bfeb58543d088c, role_id=aceae500b40841d18a66edacfc4a12cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:54.660268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56cbd-50c3-4605-bdff-a676418bf1d6 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:54.665006 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:54.670805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dcf06-63ce-4da6-866e-76115d0e18fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:54.672009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcf06-63ce-4da6-866e-76115d0e18fd None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:54.672404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcf06-63ce-4da6-866e-76115d0e18fd None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:54.673042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcf06-63ce-4da6-866e-76115d0e18fd None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:54.674243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dcf06-63ce-4da6-866e-76115d0e18fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:54.674760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dcf06-63ce-4da6-866e-76115d0e18fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:54.676903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dcf06-63ce-4da6-866e-76115d0e18fd None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:54.686541 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 209/414] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:54 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/5f3c0c082e3044b283bfeb58543d088c/roles/aceae500b40841d18a66edacfc4a12cf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:28:54.693992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 206/415] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:54.699945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56cbd-50c3-4605-bdff-a676418bf1d6 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:54.869589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56cbd-50c3-4605-bdff-a676418bf1d6 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:54.919891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36f30-d48d-4003-a513-31e35afe65c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:54.920539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36f30-d48d-4003-a513-31e35afe65c1 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:54.920850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36f30-d48d-4003-a513-31e35afe65c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:54.921130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36f30-d48d-4003-a513-31e35afe65c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:54.929318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a36f30-d48d-4003-a513-31e35afe65c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:54.930793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a36f30-d48d-4003-a513-31e35afe65c1 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-96a36f30-d48d-4003-a513-31e35afe65c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:28:54.943012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:54.943908 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:54.945224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:28:54.945224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:28:54.945224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:28:54.945224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:28:54.945224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:28:54.945224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:28:54.945224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:54.945224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:54.945224 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 210/416] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:54.950242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dcf06-63ce-4da6-866e-76115d0e18fd None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:55.077389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dcf06-63ce-4da6-866e-76115d0e18fd None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:55.138715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3a2c6-6d03-47bf-ba4e-8e2f8f1e338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:55.139293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3a2c6-6d03-47bf-ba4e-8e2f8f1e338b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:55.139580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3a2c6-6d03-47bf-ba4e-8e2f8f1e338b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:55.139860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3a2c6-6d03-47bf-ba4e-8e2f8f1e338b None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:55.140592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3a2c6-6d03-47bf-ba4e-8e2f8f1e338b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:55.140928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3a2c6-6d03-47bf-ba4e-8e2f8f1e338b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:55.142749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3a2c6-6d03-47bf-ba4e-8e2f8f1e338b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:55.159677 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 207/417] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:55.165654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36f30-d48d-4003-a513-31e35afe65c1 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:55.234457 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:55.293440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36f30-d48d-4003-a513-31e35afe65c1 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:55.330264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296dcd5-bd80-4ef7-b35e-4a22a5ae6bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:55.330917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296dcd5-bd80-4ef7-b35e-4a22a5ae6bf6 None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:55.331202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296dcd5-bd80-4ef7-b35e-4a22a5ae6bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:55.331487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296dcd5-bd80-4ef7-b35e-4a22a5ae6bf6 None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/67bdb67cd5854c38b2031a1b8c26023e/roles/aceae500b40841d18a66edacfc4a12cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:55.354883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296dcd5-bd80-4ef7-b35e-4a22a5ae6bf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=67bdb67cd5854c38b2031a1b8c26023e, role_id=aceae500b40841d18a66edacfc4a12cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:55.356476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296dcd5-bd80-4ef7-b35e-4a22a5ae6bf6 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:55.375112 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 211/418] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:55 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/67bdb67cd5854c38b2031a1b8c26023e/roles/aceae500b40841d18a66edacfc4a12cf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:55.463429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342510c6-c4fa-4da5-a2f2-31a56d4f87ae None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:55.463612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342510c6-c4fa-4da5-a2f2-31a56d4f87ae None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:55.463892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342510c6-c4fa-4da5-a2f2-31a56d4f87ae None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:55.465641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 208/419] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:55.472002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b00a60-69ce-4acb-9dac-9b2d2d00c741 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:55.472329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b00a60-69ce-4acb-9dac-9b2d2d00c741 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:55.472545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b00a60-69ce-4acb-9dac-9b2d2d00c741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:55.491792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-19b00a60-69ce-4acb-9dac-9b2d2d00c741 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:55.493028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-19b00a60-69ce-4acb-9dac-9b2d2d00c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:55.592186 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 212/420] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:55.870540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342510c6-c4fa-4da5-a2f2-31a56d4f87ae None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:55.923581 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:56.002536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342510c6-c4fa-4da5-a2f2-31a56d4f87ae None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:56.057200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d0a0d-eb36-4f87-a1bb-042843da6980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:56.057843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d0a0d-eb36-4f87-a1bb-042843da6980 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:56.058124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d0a0d-eb36-4f87-a1bb-042843da6980 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:56.058398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d0a0d-eb36-4f87-a1bb-042843da6980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:56.079495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d0a0d-eb36-4f87-a1bb-042843da6980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-7f6d0a0d-eb36-4f87-a1bb-042843da6980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:56.084501 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:56.085418 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:56.086799 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 209/421] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:56.093732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b00a60-69ce-4acb-9dac-9b2d2d00c741 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:56.145799 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:56.249258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b00a60-69ce-4acb-9dac-9b2d2d00c741 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:56.286988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f2b79-a68f-4a7f-9d34-ead74bfece45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:56.287609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2b79-a68f-4a7f-9d34-ead74bfece45 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:56.287884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2b79-a68f-4a7f-9d34-ead74bfece45 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:56.288154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2b79-a68f-4a7f-9d34-ead74bfece45 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:56.288850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f2b79-a68f-4a7f-9d34-ead74bfece45 None admin] RBAC: Adding query filter params (name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:56.289152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f2b79-a68f-4a7f-9d34-ead74bfece45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:56.290539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f2b79-a68f-4a7f-9d34-ead74bfece45 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:56.299321 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 213/422] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:28:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:56.304594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d0a0d-eb36-4f87-a1bb-042843da6980 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:56.409911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52ac7d-47af-404e-aec8-e34fbf162825 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:56.410096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52ac7d-47af-404e-aec8-e34fbf162825 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:56.410499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52ac7d-47af-404e-aec8-e34fbf162825 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:56.412051 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 214/423] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:28:56.418780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67287-f8a3-478e-bc0c-83fad22ac703 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:56.419139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67287-f8a3-478e-bc0c-83fad22ac703 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:56.419493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67287-f8a3-478e-bc0c-83fad22ac703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:56.445115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cbd67287-f8a3-478e-bc0c-83fad22ac703 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:56.446446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cbd67287-f8a3-478e-bc0c-83fad22ac703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:56.468361 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:56.476289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d0a0d-eb36-4f87-a1bb-042843da6980 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:56.543294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c232-a93b-4076-9875-7c78287683c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:56.544169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c232-a93b-4076-9875-7c78287683c0 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:56.544448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c232-a93b-4076-9875-7c78287683c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:56.544742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c232-a93b-4076-9875-7c78287683c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:56.559397 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 215/424] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:28:56.568024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c232-a93b-4076-9875-7c78287683c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:56.569550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c232-a93b-4076-9875-7c78287683c0 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-c1c9c232-a93b-4076-9875-7c78287683c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:56.585633 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:56.586645 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:56.587762 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:56.587762 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:56.587762 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:56.587762 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 210/425] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:56.593688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd67287-f8a3-478e-bc0c-83fad22ac703 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:56.628429 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:56.745567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd67287-f8a3-478e-bc0c-83fad22ac703 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:56.801334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a157514-7313-40c7-b20d-f39aef4f561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:56.801953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157514-7313-40c7-b20d-f39aef4f561a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:56.802234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157514-7313-40c7-b20d-f39aef4f561a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:56.802510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157514-7313-40c7-b20d-f39aef4f561a None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:56.803161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a157514-7313-40c7-b20d-f39aef4f561a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:56.803463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a157514-7313-40c7-b20d-f39aef4f561a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:56.804960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a157514-7313-40c7-b20d-f39aef4f561a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:56.817855 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 216/426] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:56.823409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c232-a93b-4076-9875-7c78287683c0 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:56.901306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a157514-7313-40c7-b20d-f39aef4f561a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:57.020543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c232-a93b-4076-9875-7c78287683c0 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:57.062115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412d021-ce3f-4ba4-8514-7c85f2705387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:57.063158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412d021-ce3f-4ba4-8514-7c85f2705387 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.063444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412d021-ce3f-4ba4-8514-7c85f2705387 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.063777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412d021-ce3f-4ba4-8514-7c85f2705387 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.071376 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:57.072371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412d021-ce3f-4ba4-8514-7c85f2705387 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:57.074722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412d021-ce3f-4ba4-8514-7c85f2705387 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-2412d021-ce3f-4ba4-8514-7c85f2705387 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:28:57.087938 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:57.089189 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:57.090085 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 211/427] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:28:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:57.096662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412d021-ce3f-4ba4-8514-7c85f2705387 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:57.109785 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:57.115664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a157514-7313-40c7-b20d-f39aef4f561a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:57.152706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63fab-d355-4b35-8886-4443f6fdc83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:57.153348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63fab-d355-4b35-8886-4443f6fdc83e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.153686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63fab-d355-4b35-8886-4443f6fdc83e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.153963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63fab-d355-4b35-8886-4443f6fdc83e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.165765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63fab-d355-4b35-8886-4443f6fdc83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-49a63fab-d355-4b35-8886-4443f6fdc83e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:57.171183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:57.172098 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:57.172926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:57.176799 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 217/428] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:28:57.178281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d063fe-0702-4ef7-a305-1818f722d920 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.178570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d063fe-0702-4ef7-a305-1818f722d920 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.178848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d063fe-0702-4ef7-a305-1818f722d920 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.182615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 218/429] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:57.183500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d063fe-0702-4ef7-a305-1818f722d920 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:57.217713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412d021-ce3f-4ba4-8514-7c85f2705387 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:57.266148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ead967-8dd9-4c21-8fa3-05ced1456934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:57.266816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ead967-8dd9-4c21-8fa3-05ced1456934 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.267177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ead967-8dd9-4c21-8fa3-05ced1456934 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.267455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ead967-8dd9-4c21-8fa3-05ced1456934 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.268201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ead967-8dd9-4c21-8fa3-05ced1456934 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:57.268506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ead967-8dd9-4c21-8fa3-05ced1456934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:57.269980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ead967-8dd9-4c21-8fa3-05ced1456934 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:57.292883 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 212/430] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 19 00:28:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:57.294228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cce35-6fd5-405d-b503-bd21c20f146d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.294517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cce35-6fd5-405d-b503-bd21c20f146d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.294791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cce35-6fd5-405d-b503-bd21c20f146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.307319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d063fe-0702-4ef7-a305-1818f722d920 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:57.322666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-493cce35-6fd5-405d-b503-bd21c20f146d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:57.324676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-493cce35-6fd5-405d-b503-bd21c20f146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:57.349118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eee481-82ed-4ba6-9416-3ada21df63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:57.349897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eee481-82ed-4ba6-9416-3ada21df63b9 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.350181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eee481-82ed-4ba6-9416-3ada21df63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.350592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eee481-82ed-4ba6-9416-3ada21df63b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.351277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eee481-82ed-4ba6-9416-3ada21df63b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:57.351584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eee481-82ed-4ba6-9416-3ada21df63b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:57.353050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eee481-82ed-4ba6-9416-3ada21df63b9 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:57.363919 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 219/431] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:28:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:28:57.369404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eee481-82ed-4ba6-9416-3ada21df63b9 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:57.374201 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:57.410898 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:57.419479 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 213/432] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:57.420683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cce35-6fd5-405d-b503-bd21c20f146d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:57.520351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eee481-82ed-4ba6-9416-3ada21df63b9 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:57.596046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b254d-c216-4b30-b339-52458ea35cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:57.598037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b254d-c216-4b30-b339-52458ea35cd5 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.598675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b254d-c216-4b30-b339-52458ea35cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.599753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b254d-c216-4b30-b339-52458ea35cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.613548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cce35-6fd5-405d-b503-bd21c20f146d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:57.616642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b254d-c216-4b30-b339-52458ea35cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:57.618453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b254d-c216-4b30-b339-52458ea35cd5 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-817b254d-c216-4b30-b339-52458ea35cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:57.634896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:57.635857 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:57.636738 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:57.636738 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:57.636738 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:57.638881 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 220/433] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:57.644649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb0b63-533a-4e4d-aa7e-a3c5fa9d2129 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.645286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb0b63-533a-4e4d-aa7e-a3c5fa9d2129 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.645793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb0b63-533a-4e4d-aa7e-a3c5fa9d2129 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.647576 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 221/434] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:57.650371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb0b63-533a-4e4d-aa7e-a3c5fa9d2129 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:57.651938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7001c-8615-43aa-a882-4747af3f0887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:57.652787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7001c-8615-43aa-a882-4747af3f0887 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.653067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7001c-8615-43aa-a882-4747af3f0887 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.653337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7001c-8615-43aa-a882-4747af3f0887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.665233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7001c-8615-43aa-a882-4747af3f0887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:57.666692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7001c-8615-43aa-a882-4747af3f0887 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-51d7001c-8615-43aa-a882-4747af3f0887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:57.682399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:57.683356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:57.684213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:57.684213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:57.684213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:57.684213 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 214/435] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:57.685181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5aeea-a2c6-4e7e-afcb-d0ad7ad697d5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.685181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5aeea-a2c6-4e7e-afcb-d0ad7ad697d5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.691092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5aeea-a2c6-4e7e-afcb-d0ad7ad697d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.712058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dcc5aeea-a2c6-4e7e-afcb-d0ad7ad697d5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:57.713544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dcc5aeea-a2c6-4e7e-afcb-d0ad7ad697d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:57.732493 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:57.766424 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:57.786711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb0b63-533a-4e4d-aa7e-a3c5fa9d2129 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:57.791134 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 215/436] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:57.792201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5aeea-a2c6-4e7e-afcb-d0ad7ad697d5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:57.838355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70198c5-bbf7-49b0-ac39-29dcd2db11b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:57.838956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70198c5-bbf7-49b0-ac39-29dcd2db11b3 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.839308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70198c5-bbf7-49b0-ac39-29dcd2db11b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.839591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70198c5-bbf7-49b0-ac39-29dcd2db11b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.840365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70198c5-bbf7-49b0-ac39-29dcd2db11b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:57.840764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70198c5-bbf7-49b0-ac39-29dcd2db11b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:57.842421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70198c5-bbf7-49b0-ac39-29dcd2db11b3 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:57.856932 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 222/437] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:57.857746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70198c5-bbf7-49b0-ac39-29dcd2db11b3 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:57.918301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5aeea-a2c6-4e7e-afcb-d0ad7ad697d5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:57.962065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e2af5-b5e1-4103-bba4-a59934a16f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:57.963607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e2af5-b5e1-4103-bba4-a59934a16f6d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:57.964081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e2af5-b5e1-4103-bba4-a59934a16f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:57.964546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e2af5-b5e1-4103-bba4-a59934a16f6d None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:57.965595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e2af5-b5e1-4103-bba4-a59934a16f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:57.966100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e2af5-b5e1-4103-bba4-a59934a16f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:57.967728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e2af5-b5e1-4103-bba4-a59934a16f6d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:57.976565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70198c5-bbf7-49b0-ac39-29dcd2db11b3 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:57.982805 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 216/438] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:57.989567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e2af5-b5e1-4103-bba4-a59934a16f6d None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:57.998734 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.025397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4fa38-e790-4245-91e9-b51e20c792c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.026052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fa38-e790-4245-91e9-b51e20c792c7 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.026334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fa38-e790-4245-91e9-b51e20c792c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.026606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fa38-e790-4245-91e9-b51e20c792c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.038593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4fa38-e790-4245-91e9-b51e20c792c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-01b4fa38-e790-4245-91e9-b51e20c792c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:58.048883 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:58.049925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:58.051139 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 223/439] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:58.052121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4fa38-e790-4245-91e9-b51e20c792c7 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:58.053931 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.134171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e2af5-b5e1-4103-bba4-a59934a16f6d None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:58.175628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c89a-230b-45cb-b846-1d16d443ba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.176295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c89a-230b-45cb-b846-1d16d443ba36 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.176563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c89a-230b-45cb-b846-1d16d443ba36 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.176871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c89a-230b-45cb-b846-1d16d443ba36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.181078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4fa38-e790-4245-91e9-b51e20c792c7 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:58.184473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c89a-230b-45cb-b846-1d16d443ba36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:58.185991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c89a-230b-45cb-b846-1d16d443ba36 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-8d62c89a-230b-45cb-b846-1d16d443ba36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:28:58.198278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:58.199223 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:58.200068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:28:58.200068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:28:58.200068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:28:58.200068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:28:58.200068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:28:58.200068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:28:58.200068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:28:58.200068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:58.204189 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 217/440] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:58.205779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c89a-230b-45cb-b846-1d16d443ba36 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:58.228167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ea8a5-0c42-4872-9ded-ceab560f572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.228855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea8a5-0c42-4872-9ded-ceab560f572f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.229134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea8a5-0c42-4872-9ded-ceab560f572f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.229399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea8a5-0c42-4872-9ded-ceab560f572f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.237749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ea8a5-0c42-4872-9ded-ceab560f572f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:58.239250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ea8a5-0c42-4872-9ded-ceab560f572f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-904ea8a5-0c42-4872-9ded-ceab560f572f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:28:58.251998 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:58.253037 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 224/441] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 19 00:28:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:58.253931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ea8a5-0c42-4872-9ded-ceab560f572f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:58.299113 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.327510 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.331179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c89a-230b-45cb-b846-1d16d443ba36 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:58.368129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcda0a-52a6-4e2e-8be0-c038dc87eae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.368782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcda0a-52a6-4e2e-8be0-c038dc87eae7 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.369063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcda0a-52a6-4e2e-8be0-c038dc87eae7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.369345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcda0a-52a6-4e2e-8be0-c038dc87eae7 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.370010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcda0a-52a6-4e2e-8be0-c038dc87eae7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:58.370313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcda0a-52a6-4e2e-8be0-c038dc87eae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:58.371705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcda0a-52a6-4e2e-8be0-c038dc87eae7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:58.372141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ea8a5-0c42-4872-9ded-ceab560f572f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:58.380660 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 218/442] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:28:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:58.381570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcda0a-52a6-4e2e-8be0-c038dc87eae7 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:58.411921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c21fb-beb6-4e1b-8496-0174ca799405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.412535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c21fb-beb6-4e1b-8496-0174ca799405 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.412869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c21fb-beb6-4e1b-8496-0174ca799405 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.413164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c21fb-beb6-4e1b-8496-0174ca799405 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.424670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c21fb-beb6-4e1b-8496-0174ca799405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-c21c21fb-beb6-4e1b-8496-0174ca799405 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:58.429961 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:58.431009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 225/443] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:58.432038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c21fb-beb6-4e1b-8496-0174ca799405 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:58.488923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcda0a-52a6-4e2e-8be0-c038dc87eae7 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:58.523611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0546b9-ce96-4655-b2c0-f827c4d6aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.524217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0546b9-ce96-4655-b2c0-f827c4d6aa5f None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.524498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0546b9-ce96-4655-b2c0-f827c4d6aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.524801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0546b9-ce96-4655-b2c0-f827c4d6aa5f None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.525492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0546b9-ce96-4655-b2c0-f827c4d6aa5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:58.525798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0546b9-ce96-4655-b2c0-f827c4d6aa5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:58.527238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0546b9-ce96-4655-b2c0-f827c4d6aa5f None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:58.530942 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.541053 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 219/444] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:58.542330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517d8b-2553-420b-a87f-603f8537bd92 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.542617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517d8b-2553-420b-a87f-603f8537bd92 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.542894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517d8b-2553-420b-a87f-603f8537bd92 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.544271 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 220/445] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:58.546839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c21fb-beb6-4e1b-8496-0174ca799405 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:58.549487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73517d8b-2553-420b-a87f-603f8537bd92 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:58.573029 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.586482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55480f84-324c-4f7c-b736-5d0e5d4c6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.587098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55480f84-324c-4f7c-b736-5d0e5d4c6237 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.587377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55480f84-324c-4f7c-b736-5d0e5d4c6237 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.587908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55480f84-324c-4f7c-b736-5d0e5d4c6237 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.588676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55480f84-324c-4f7c-b736-5d0e5d4c6237 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:58.588980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55480f84-324c-4f7c-b736-5d0e5d4c6237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:58.590425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55480f84-324c-4f7c-b736-5d0e5d4c6237 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:58.609929 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 226/446] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 19 00:28:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:58.612013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55480f84-324c-4f7c-b736-5d0e5d4c6237 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:58.656811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73517d8b-2553-420b-a87f-603f8537bd92 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:58.693603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a09962-5ace-4667-8568-229350a0c205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.694140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a09962-5ace-4667-8568-229350a0c205 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.694476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a09962-5ace-4667-8568-229350a0c205 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.694770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a09962-5ace-4667-8568-229350a0c205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.705906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a09962-5ace-4667-8568-229350a0c205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:58.707356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a09962-5ace-4667-8568-229350a0c205 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:58.713133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55480f84-324c-4f7c-b736-5d0e5d4c6237 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-78a09962-5ace-4667-8568-229350a0c205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:58.723161 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:58.724081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:58.724995 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:58.724995 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:58.724995 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:58.724995 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 221/447] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:58.724995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a09962-5ace-4667-8568-229350a0c205 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:58.752195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aae591-866e-4a7c-b588-422cc567e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.752841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aae591-866e-4a7c-b588-422cc567e13d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.753127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aae591-866e-4a7c-b588-422cc567e13d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.755057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aae591-866e-4a7c-b588-422cc567e13d None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.755738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aae591-866e-4a7c-b588-422cc567e13d None admin] RBAC: Adding query filter params (name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:58.756042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aae591-866e-4a7c-b588-422cc567e13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:58.757450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aae591-866e-4a7c-b588-422cc567e13d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:58.772080 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 227/448] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:28:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:58.772080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b73cc-0b10-48f5-82aa-5b052f3a7c85 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.772080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b73cc-0b10-48f5-82aa-5b052f3a7c85 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.772080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b73cc-0b10-48f5-82aa-5b052f3a7c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.789173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-195b73cc-0b10-48f5-82aa-5b052f3a7c85 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:58.790461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-195b73cc-0b10-48f5-82aa-5b052f3a7c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:58.801327 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.815732 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.848213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a09962-5ace-4667-8568-229350a0c205 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:58.871209 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 228/449] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:28:58.872095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b73cc-0b10-48f5-82aa-5b052f3a7c85 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:58.896099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e616e9-5f53-4f53-910a-b0bd6add6ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:58.897374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e616e9-5f53-4f53-910a-b0bd6add6ac4 None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.897661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e616e9-5f53-4f53-910a-b0bd6add6ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.897944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e616e9-5f53-4f53-910a-b0bd6add6ac4 None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/54b7394a5d944639b1253d5d54b688e2/roles/aceae500b40841d18a66edacfc4a12cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.918405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e616e9-5f53-4f53-910a-b0bd6add6ac4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=54b7394a5d944639b1253d5d54b688e2, role_id=aceae500b40841d18a66edacfc4a12cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:58.919967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e616e9-5f53-4f53-910a-b0bd6add6ac4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:58.940009 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 222/450] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:28:58 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/54b7394a5d944639b1253d5d54b688e2/roles/aceae500b40841d18a66edacfc4a12cf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:28:58.945694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e616e9-5f53-4f53-910a-b0bd6add6ac4 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.026724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b73cc-0b10-48f5-82aa-5b052f3a7c85 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:59.112649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395de0-bde1-456d-af01-52e7764464a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:59.112649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395de0-bde1-456d-af01-52e7764464a7 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:59.112649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395de0-bde1-456d-af01-52e7764464a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:59.112649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395de0-bde1-456d-af01-52e7764464a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:59.138922 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:59.178605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e616e9-5f53-4f53-910a-b0bd6add6ac4 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:59.203708 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:59.214620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9395de0-bde1-456d-af01-52e7764464a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:59.216489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9395de0-bde1-456d-af01-52e7764464a7 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:59.217964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288cd6a-5794-46c3-8041-84bd0298faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:59.218580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288cd6a-5794-46c3-8041-84bd0298faa3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:59.218871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288cd6a-5794-46c3-8041-84bd0298faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:59.219150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288cd6a-5794-46c3-8041-84bd0298faa3 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:59.219798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288cd6a-5794-46c3-8041-84bd0298faa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:59.220205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288cd6a-5794-46c3-8041-84bd0298faa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:59.221597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288cd6a-5794-46c3-8041-84bd0298faa3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:59.234218 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 223/451] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:59.234867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288cd6a-5794-46c3-8041-84bd0298faa3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.326798 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 229/452] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:28:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:28:59.328100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395de0-bde1-456d-af01-52e7764464a7 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.349558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288cd6a-5794-46c3-8041-84bd0298faa3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:59.378429 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:59.386193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e44b-f424-48b5-a415-cbc432efb29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:59.386827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e44b-f424-48b5-a415-cbc432efb29b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:59.387108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e44b-f424-48b5-a415-cbc432efb29b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:59.387378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e44b-f424-48b5-a415-cbc432efb29b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:59.398903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e44b-f424-48b5-a415-cbc432efb29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:59.400368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e44b-f424-48b5-a415-cbc432efb29b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-9be9e44b-f424-48b5-a415-cbc432efb29b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:59.417744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:59.418742 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:59.419587 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:59.419587 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:59.419587 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:59.419587 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 224/453] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:59.420172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e44b-f424-48b5-a415-cbc432efb29b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.445587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395de0-bde1-456d-af01-52e7764464a7 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:59.458690 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:59.486508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4755eb5-8280-41c6-ab26-751651b39336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:59.487148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4755eb5-8280-41c6-ab26-751651b39336 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:59.487430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4755eb5-8280-41c6-ab26-751651b39336 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:59.487702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4755eb5-8280-41c6-ab26-751651b39336 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:59.498141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4755eb5-8280-41c6-ab26-751651b39336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-c4755eb5-8280-41c6-ab26-751651b39336 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:28:59.503136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:59.504347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 230/454] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:59.505371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4755eb5-8280-41c6-ab26-751651b39336 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.535330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e44b-f424-48b5-a415-cbc432efb29b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:59.575190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c47e5-eacf-45bd-b3da-14c2dd616818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:59.575823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c47e5-eacf-45bd-b3da-14c2dd616818 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:59.576099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c47e5-eacf-45bd-b3da-14c2dd616818 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:59.576369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c47e5-eacf-45bd-b3da-14c2dd616818 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:59.584231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c47e5-eacf-45bd-b3da-14c2dd616818 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:59.585703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c47e5-eacf-45bd-b3da-14c2dd616818 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-316c47e5-eacf-45bd-b3da-14c2dd616818 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:28:59.598321 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:59.599239 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:28:59.600132 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:28:59.604194 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 225/455] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:59.605064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c47e5-eacf-45bd-b3da-14c2dd616818 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.635708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4755eb5-8280-41c6-ab26-751651b39336 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:59.639707 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:59.682391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebed77e-ec57-4d54-8350-c5e8357f2c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:59.683402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebed77e-ec57-4d54-8350-c5e8357f2c28 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:59.683913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebed77e-ec57-4d54-8350-c5e8357f2c28 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:59.684998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebed77e-ec57-4d54-8350-c5e8357f2c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:59.697141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebed77e-ec57-4d54-8350-c5e8357f2c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:59.698617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebed77e-ec57-4d54-8350-c5e8357f2c28 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:59.707559 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-8ebed77e-ec57-4d54-8350-c5e8357f2c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:28:59.714587 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:28:59.715491 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:28:59.716334 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:28:59.716334 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:28:59.716334 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:28:59.716495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c47e5-eacf-45bd-b3da-14c2dd616818 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:59.716565 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 231/456] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:28:59.717150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebed77e-ec57-4d54-8350-c5e8357f2c28 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.757772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfb6e-3d06-49ab-85bd-e6e517e6da39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:59.758391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfb6e-3d06-49ab-85bd-e6e517e6da39 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:59.758668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfb6e-3d06-49ab-85bd-e6e517e6da39 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:59.758948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfb6e-3d06-49ab-85bd-e6e517e6da39 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:59.759598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfb6e-3d06-49ab-85bd-e6e517e6da39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:59.759903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfb6e-3d06-49ab-85bd-e6e517e6da39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:59.761317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfb6e-3d06-49ab-85bd-e6e517e6da39 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:59.773993 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 226/457] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:59.774841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfb6e-3d06-49ab-85bd-e6e517e6da39 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.831425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebed77e-ec57-4d54-8350-c5e8357f2c28 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:59.870933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1a740-e345-44b3-9618-6497e9bcc8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:59.872318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1a740-e345-44b3-9618-6497e9bcc8c6 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:59.872970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1a740-e345-44b3-9618-6497e9bcc8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:59.873499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1a740-e345-44b3-9618-6497e9bcc8c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:59.874488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1a740-e345-44b3-9618-6497e9bcc8c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:59.874972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1a740-e345-44b3-9618-6497e9bcc8c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:59.877646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1a740-e345-44b3-9618-6497e9bcc8c6 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:59.889436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfb6e-3d06-49ab-85bd-e6e517e6da39 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:59.891815 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 232/458] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:28:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:59.893256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1a740-e345-44b3-9618-6497e9bcc8c6 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.913051 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:59.932320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64513-26ef-4a44-b63a-e539f8dd84ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:59.933213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64513-26ef-4a44-b63a-e539f8dd84ce None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:59.933670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64513-26ef-4a44-b63a-e539f8dd84ce None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:59.934090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64513-26ef-4a44-b63a-e539f8dd84ce None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:59.934990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64513-26ef-4a44-b63a-e539f8dd84ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:28:59.935299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64513-26ef-4a44-b63a-e539f8dd84ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:59.936763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64513-26ef-4a44-b63a-e539f8dd84ce None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:59.956446 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 227/459] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Oct 19 00:28:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:28:59.957173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64513-26ef-4a44-b63a-e539f8dd84ce None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:59.978552 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:00.002971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1a740-e345-44b3-9618-6497e9bcc8c6 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.036223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f02a13-b6e7-477f-8420-bdb7480634d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.036961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f02a13-b6e7-477f-8420-bdb7480634d6 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.037241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f02a13-b6e7-477f-8420-bdb7480634d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.037514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f02a13-b6e7-477f-8420-bdb7480634d6 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.038154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f02a13-b6e7-477f-8420-bdb7480634d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:00.038455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f02a13-b6e7-477f-8420-bdb7480634d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:00.039829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f02a13-b6e7-477f-8420-bdb7480634d6 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:00.053556 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 233/460] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:00.054397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f02a13-b6e7-477f-8420-bdb7480634d6 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:00.081065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64513-26ef-4a44-b63a-e539f8dd84ce None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.119746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475a27-ad9c-4312-b5c5-88e3d194af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.120703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475a27-ad9c-4312-b5c5-88e3d194af55 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.121167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475a27-ad9c-4312-b5c5-88e3d194af55 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.121646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475a27-ad9c-4312-b5c5-88e3d194af55 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.129858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a475a27-ad9c-4312-b5c5-88e3d194af55 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:00.131581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a475a27-ad9c-4312-b5c5-88e3d194af55 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:00.139180 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-8a475a27-ad9c-4312-b5c5-88e3d194af55 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:00.144037 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:00.145039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:29:00.146232 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:00.149723 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 228/461] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:28:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:00.150562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475a27-ad9c-4312-b5c5-88e3d194af55 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:00.165544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f02a13-b6e7-477f-8420-bdb7480634d6 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.201144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f592ea-c85c-4205-878b-0242cca2adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.201821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f592ea-c85c-4205-878b-0242cca2adc4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.202074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f592ea-c85c-4205-878b-0242cca2adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.202344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f592ea-c85c-4205-878b-0242cca2adc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.214555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f592ea-c85c-4205-878b-0242cca2adc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:00.216054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f592ea-c85c-4205-878b-0242cca2adc4 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-38f592ea-c85c-4205-878b-0242cca2adc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:00.232856 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:00.233788 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:00.234632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:00.234632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:00.234632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:00.234632 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 234/462] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:00.234842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f592ea-c85c-4205-878b-0242cca2adc4 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:00.241002 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:00.269691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475a27-ad9c-4312-b5c5-88e3d194af55 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.306330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fdc67-90d5-4012-92ce-9e639a62fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.306950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fdc67-90d5-4012-92ce-9e639a62fdbf None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.307215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fdc67-90d5-4012-92ce-9e639a62fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.307486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fdc67-90d5-4012-92ce-9e639a62fdbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.348081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f592ea-c85c-4205-878b-0242cca2adc4 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.379221 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:00.383174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fdc67-90d5-4012-92ce-9e639a62fdbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:00.384561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fdc67-90d5-4012-92ce-9e639a62fdbf None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:00.387370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee3391-c242-4fe0-9261-8952ae5966f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.388019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3391-c242-4fe0-9261-8952ae5966f7 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.388301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3391-c242-4fe0-9261-8952ae5966f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.388576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3391-c242-4fe0-9261-8952ae5966f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.397995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee3391-c242-4fe0-9261-8952ae5966f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:00.399475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee3391-c242-4fe0-9261-8952ae5966f7 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-aaee3391-c242-4fe0-9261-8952ae5966f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:00.412986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:00.414566 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 235/463] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:00.415608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee3391-c242-4fe0-9261-8952ae5966f7 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:00.478507 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:00.513335 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 229/464] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:29:00.513335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fdc67-90d5-4012-92ce-9e639a62fdbf None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:00.531221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee3391-c242-4fe0-9261-8952ae5966f7 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.569378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321a43a-bdc4-4835-ae2b-039b8c6e3132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.569986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321a43a-bdc4-4835-ae2b-039b8c6e3132 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.570267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321a43a-bdc4-4835-ae2b-039b8c6e3132 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.570541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321a43a-bdc4-4835-ae2b-039b8c6e3132 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.571274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321a43a-bdc4-4835-ae2b-039b8c6e3132 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:00.571576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321a43a-bdc4-4835-ae2b-039b8c6e3132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:00.573041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321a43a-bdc4-4835-ae2b-039b8c6e3132 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:00.596428 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 236/465] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Oct 19 00:29:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:00.596428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321a43a-bdc4-4835-ae2b-039b8c6e3132 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:00.631898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fdc67-90d5-4012-92ce-9e639a62fdbf None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.643916 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:00.674330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196820d-a261-4c0a-a7f4-d342010d1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.675385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196820d-a261-4c0a-a7f4-d342010d1e57 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.675902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196820d-a261-4c0a-a7f4-d342010d1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.676387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196820d-a261-4c0a-a7f4-d342010d1e57 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.677255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196820d-a261-4c0a-a7f4-d342010d1e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:00.677739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196820d-a261-4c0a-a7f4-d342010d1e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:00.679463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196820d-a261-4c0a-a7f4-d342010d1e57 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:00.696921 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 230/466] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:00.698072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196820d-a261-4c0a-a7f4-d342010d1e57 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:00.713182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321a43a-bdc4-4835-ae2b-039b8c6e3132 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.738608 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:00.752744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8857f-e427-49e1-8ae0-9abdc7cf54a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.753367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8857f-e427-49e1-8ae0-9abdc7cf54a0 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.753698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8857f-e427-49e1-8ae0-9abdc7cf54a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.753916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8857f-e427-49e1-8ae0-9abdc7cf54a0 None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.754615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8857f-e427-49e1-8ae0-9abdc7cf54a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:00.754917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8857f-e427-49e1-8ae0-9abdc7cf54a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:00.756369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8857f-e427-49e1-8ae0-9abdc7cf54a0 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:00.769434 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 237/467] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:00.770202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8857f-e427-49e1-8ae0-9abdc7cf54a0 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:00.827498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196820d-a261-4c0a-a7f4-d342010d1e57 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.871301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c751a31-6376-49e4-adf9-1e157a61200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.871942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c751a31-6376-49e4-adf9-1e157a61200e None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.872218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c751a31-6376-49e4-adf9-1e157a61200e None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.872489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c751a31-6376-49e4-adf9-1e157a61200e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.884885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c751a31-6376-49e4-adf9-1e157a61200e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:00.886208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8857f-e427-49e1-8ae0-9abdc7cf54a0 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:00.886473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c751a31-6376-49e4-adf9-1e157a61200e None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:00.896437 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-9c751a31-6376-49e4-adf9-1e157a61200e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:00.904417 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:00.905578 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:00.906450 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:00.906450 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:00.906450 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:00.906450 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 231/468] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:00.906665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c751a31-6376-49e4-adf9-1e157a61200e None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:00.930109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeba596-b0ab-45d2-aa72-5c659da2e9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:00.930904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeba596-b0ab-45d2-aa72-5c659da2e9e0 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.931018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeba596-b0ab-45d2-aa72-5c659da2e9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.931265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeba596-b0ab-45d2-aa72-5c659da2e9e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.007003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeba596-b0ab-45d2-aa72-5c659da2e9e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:01.008480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeba596-b0ab-45d2-aa72-5c659da2e9e0 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:01.018616 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:01.045128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c751a31-6376-49e4-adf9-1e157a61200e None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:01.085018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bdd63-ce19-4491-a123-b0a4e4b4baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:01.088264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bdd63-ce19-4491-a123-b0a4e4b4baaf None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.088264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bdd63-ce19-4491-a123-b0a4e4b4baaf None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.088264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bdd63-ce19-4491-a123-b0a4e4b4baaf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.098360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bdd63-ce19-4491-a123-b0a4e4b4baaf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:01.099952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bdd63-ce19-4491-a123-b0a4e4b4baaf None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-638bdd63-ce19-4491-a123-b0a4e4b4baaf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:01.113115 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:01.114280 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:01.115514 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 232/469] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:29:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:01.118035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bdd63-ce19-4491-a123-b0a4e4b4baaf None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:01.138468 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 238/470] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:29:01.139709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeba596-b0ab-45d2-aa72-5c659da2e9e0 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:01.154672 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:01.256804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bdd63-ce19-4491-a123-b0a4e4b4baaf None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:01.262911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeba596-b0ab-45d2-aa72-5c659da2e9e0 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:01.296382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964987f5-c646-4245-9f59-eb551be6058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:01.296929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964987f5-c646-4245-9f59-eb551be6058a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.297214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964987f5-c646-4245-9f59-eb551be6058a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.297594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964987f5-c646-4245-9f59-eb551be6058a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.298556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964987f5-c646-4245-9f59-eb551be6058a None admin] RBAC: Adding query filter params (role.id=aceae500b40841d18a66edacfc4a12cf, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=0165e2f8b5e34c8d8570262c777de161) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:01.298701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af173b-df21-4002-bdac-a271725e2f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:01.298828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964987f5-c646-4245-9f59-eb551be6058a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:01.299312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af173b-df21-4002-bdac-a271725e2f59 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.299587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af173b-df21-4002-bdac-a271725e2f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.299855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af173b-df21-4002-bdac-a271725e2f59 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.300156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964987f5-c646-4245-9f59-eb551be6058a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:01.300497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af173b-df21-4002-bdac-a271725e2f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:01.300830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af173b-df21-4002-bdac-a271725e2f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:01.302193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af173b-df21-4002-bdac-a271725e2f59 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:01.307853 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 233/471] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:01 2022] GET /identity/v3/role_assignments?user.id=0165e2f8b5e34c8d8570262c777de161&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=aceae500b40841d18a66edacfc4a12cf => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:01.308687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964987f5-c646-4245-9f59-eb551be6058a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:01.322303 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:01.324668 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 239/472] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:01.325792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af173b-df21-4002-bdac-a271725e2f59 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:01.406479 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:01.433876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964987f5-c646-4245-9f59-eb551be6058a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:01.449137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af173b-df21-4002-bdac-a271725e2f59 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:01.475007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128f426-3bd9-4cf9-b9eb-2e465bae5eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:01.475794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f426-3bd9-4cf9-b9eb-2e465bae5eb3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.476132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f426-3bd9-4cf9-b9eb-2e465bae5eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.476406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128f426-3bd9-4cf9-b9eb-2e465bae5eb3 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.477197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128f426-3bd9-4cf9-b9eb-2e465bae5eb3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:01.477498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128f426-3bd9-4cf9-b9eb-2e465bae5eb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:01.478962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128f426-3bd9-4cf9-b9eb-2e465bae5eb3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:01.491339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6730f1a-5eb3-4206-bcdf-57fa4caa566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:01.491994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6730f1a-5eb3-4206-bcdf-57fa4caa566d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.492272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6730f1a-5eb3-4206-bcdf-57fa4caa566d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.492546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6730f1a-5eb3-4206-bcdf-57fa4caa566d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.498750 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 234/473] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Oct 19 00:29:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:01.499987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa1e9-28b7-4a57-9c21-19d85ed6d20d None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.500275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa1e9-28b7-4a57-9c21-19d85ed6d20d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.500562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa1e9-28b7-4a57-9c21-19d85ed6d20d None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.502566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 235/474] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:01.503311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa1e9-28b7-4a57-9c21-19d85ed6d20d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:01.508535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6730f1a-5eb3-4206-bcdf-57fa4caa566d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:01.510050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6730f1a-5eb3-4206-bcdf-57fa4caa566d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-d6730f1a-5eb3-4206-bcdf-57fa4caa566d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:01.527063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:01.528112 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:01.529075 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:01.529075 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:01.529075 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:01.529075 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 240/475] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:01.530916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6730f1a-5eb3-4206-bcdf-57fa4caa566d None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:01.581867 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:01.624687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa1e9-28b7-4a57-9c21-19d85ed6d20d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:01.655028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6730f1a-5eb3-4206-bcdf-57fa4caa566d None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:01.663611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca92b-86aa-41bb-8312-bd7e4343817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:01.664256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca92b-86aa-41bb-8312-bd7e4343817d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.664541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca92b-86aa-41bb-8312-bd7e4343817d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.665211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca92b-86aa-41bb-8312-bd7e4343817d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.673625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca92b-86aa-41bb-8312-bd7e4343817d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:01.675548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca92b-86aa-41bb-8312-bd7e4343817d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:01.676843 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-db5ca92b-86aa-41bb-8312-bd7e4343817d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:01.688708 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:01.689903 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:01.690757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:01.690757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:01.690757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:01.690757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:01.690757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:01.690757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:01.690757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:01.690757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:01.690757 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 236/476] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:01.691233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db083aa7-dc47-422d-83c6-8b1a3c141b20 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.691870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db083aa7-dc47-422d-83c6-8b1a3c141b20 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.691870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db083aa7-dc47-422d-83c6-8b1a3c141b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.697846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0219705-5dad-417d-a6bc-b5b09d52f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:01.698477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0219705-5dad-417d-a6bc-b5b09d52f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.698738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0219705-5dad-417d-a6bc-b5b09d52f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.699758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0219705-5dad-417d-a6bc-b5b09d52f2e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.710554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-db083aa7-dc47-422d-83c6-8b1a3c141b20 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:01.711759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db083aa7-dc47-422d-83c6-8b1a3c141b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:01.781481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0219705-5dad-417d-a6bc-b5b09d52f2e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:01.783355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0219705-5dad-417d-a6bc-b5b09d52f2e0 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:01.785878 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 237/477] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:29:01.786731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db083aa7-dc47-422d-83c6-8b1a3c141b20 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:01.879011 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:01.910625 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 241/478] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:29:01.911636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0219705-5dad-417d-a6bc-b5b09d52f2e0 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:01.940986 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:01.941184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db083aa7-dc47-422d-83c6-8b1a3c141b20 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:01.981540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235ed89-8f89-4293-af37-cde31d4c9c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:01.982181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235ed89-8f89-4293-af37-cde31d4c9c79 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:01.982508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235ed89-8f89-4293-af37-cde31d4c9c79 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:01.982790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235ed89-8f89-4293-af37-cde31d4c9c79 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:01.983662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235ed89-8f89-4293-af37-cde31d4c9c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:01.983972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235ed89-8f89-4293-af37-cde31d4c9c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:01.986417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235ed89-8f89-4293-af37-cde31d4c9c79 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.003609 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 238/479] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:02.004301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235ed89-8f89-4293-af37-cde31d4c9c79 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.054964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0219705-5dad-417d-a6bc-b5b09d52f2e0 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.094417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1891ba9-f297-45f4-825f-1fc4bd602603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.095571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1891ba9-f297-45f4-825f-1fc4bd602603 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.096249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1891ba9-f297-45f4-825f-1fc4bd602603 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.096249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1891ba9-f297-45f4-825f-1fc4bd602603 None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.096841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1891ba9-f297-45f4-825f-1fc4bd602603 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:02.097147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1891ba9-f297-45f4-825f-1fc4bd602603 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:02.098637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1891ba9-f297-45f4-825f-1fc4bd602603 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.112239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 242/480] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:02.113112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1891ba9-f297-45f4-825f-1fc4bd602603 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.131622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235ed89-8f89-4293-af37-cde31d4c9c79 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.149127 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:02.166991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eb870-fdf1-4a01-8734-de32ef117eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.167616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eb870-fdf1-4a01-8734-de32ef117eb8 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.167892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eb870-fdf1-4a01-8734-de32ef117eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.168168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eb870-fdf1-4a01-8734-de32ef117eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.179247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63eb870-fdf1-4a01-8734-de32ef117eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:02.180706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63eb870-fdf1-4a01-8734-de32ef117eb8 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-f63eb870-fdf1-4a01-8734-de32ef117eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:02.195029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:02.195948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:02.196907 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:02.196907 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:02.196907 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:02.196907 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 239/481] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:02.196907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eb870-fdf1-4a01-8734-de32ef117eb8 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.208218 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:02.230693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1891ba9-f297-45f4-825f-1fc4bd602603 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.269468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cbaf6-4698-4a6a-8916-ed9155554972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.270122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cbaf6-4698-4a6a-8916-ed9155554972 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.270401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cbaf6-4698-4a6a-8916-ed9155554972 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.270671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cbaf6-4698-4a6a-8916-ed9155554972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.277809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cbaf6-4698-4a6a-8916-ed9155554972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:02.279261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cbaf6-4698-4a6a-8916-ed9155554972 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-564cbaf6-4698-4a6a-8916-ed9155554972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:02.291920 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:02.292868 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:02.293717 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:02.293717 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:02.293717 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:02.293717 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:02.293717 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:02.293717 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:02.293717 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:02.293717 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:02.293717 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 243/482] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:02.294187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cbaf6-4698-4a6a-8916-ed9155554972 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.319169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eb870-fdf1-4a01-8734-de32ef117eb8 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.358646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c3942-6067-4d7e-be6c-f41aa43ce43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.359270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c3942-6067-4d7e-be6c-f41aa43ce43a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.359545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c3942-6067-4d7e-be6c-f41aa43ce43a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.359814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c3942-6067-4d7e-be6c-f41aa43ce43a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.370932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c3942-6067-4d7e-be6c-f41aa43ce43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-b58c3942-6067-4d7e-be6c-f41aa43ce43a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:02.377538 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:02.378517 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 240/483] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:02.384584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c3942-6067-4d7e-be6c-f41aa43ce43a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.406759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cbaf6-4698-4a6a-8916-ed9155554972 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.417664 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:02.442552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70843aa-6230-4b11-a100-1620a7594098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.443159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70843aa-6230-4b11-a100-1620a7594098 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.443459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70843aa-6230-4b11-a100-1620a7594098 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.443729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70843aa-6230-4b11-a100-1620a7594098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.444445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70843aa-6230-4b11-a100-1620a7594098 None admin] RBAC: Adding query filter params (role.id=aceae500b40841d18a66edacfc4a12cf, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=6eb751f44d3b4fb3b49a0084e76176d9) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:02.444782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70843aa-6230-4b11-a100-1620a7594098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:02.446215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70843aa-6230-4b11-a100-1620a7594098 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.451875 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 244/484] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/role_assignments?user.id=6eb751f44d3b4fb3b49a0084e76176d9&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=aceae500b40841d18a66edacfc4a12cf => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:02.452664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70843aa-6230-4b11-a100-1620a7594098 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.475823 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:02.501266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c3942-6067-4d7e-be6c-f41aa43ce43a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.548187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3b829-23a5-4e3a-a956-77853088a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.549818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3b829-23a5-4e3a-a956-77853088a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.550645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3b829-23a5-4e3a-a956-77853088a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.551225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3b829-23a5-4e3a-a956-77853088a6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.552182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3b829-23a5-4e3a-a956-77853088a6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:02.552692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3b829-23a5-4e3a-a956-77853088a6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:02.554278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3b829-23a5-4e3a-a956-77853088a6a5 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.575145 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 241/485] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:02.575145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3b829-23a5-4e3a-a956-77853088a6a5 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.602768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70843aa-6230-4b11-a100-1620a7594098 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.643362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17468d-7cd4-4a52-8b42-814c9dc3f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.644280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17468d-7cd4-4a52-8b42-814c9dc3f165 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.644792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17468d-7cd4-4a52-8b42-814c9dc3f165 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.645242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17468d-7cd4-4a52-8b42-814c9dc3f165 None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.646156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17468d-7cd4-4a52-8b42-814c9dc3f165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:02.646688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17468d-7cd4-4a52-8b42-814c9dc3f165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:02.648345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17468d-7cd4-4a52-8b42-814c9dc3f165 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.663559 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 245/486] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:02.665400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17468d-7cd4-4a52-8b42-814c9dc3f165 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.686260 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:02.702678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3b829-23a5-4e3a-a956-77853088a6a5 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.742130 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:02.749318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1f30c-c520-4e87-8719-64506e13fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.749935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1f30c-c520-4e87-8719-64506e13fb26 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.750216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1f30c-c520-4e87-8719-64506e13fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.750493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1f30c-c520-4e87-8719-64506e13fb26 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.751283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1f30c-c520-4e87-8719-64506e13fb26 None admin] RBAC: Adding query filter params (name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:02.751542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1f30c-c520-4e87-8719-64506e13fb26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:02.753219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1f30c-c520-4e87-8719-64506e13fb26 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.762355 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 242/487] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:02.763052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1f30c-c520-4e87-8719-64506e13fb26 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.787767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17468d-7cd4-4a52-8b42-814c9dc3f165 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.835421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a037-e438-48db-b406-e2b7b9ab4cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.836471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a037-e438-48db-b406-e2b7b9ab4cbf None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.837045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a037-e438-48db-b406-e2b7b9ab4cbf None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.837327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a037-e438-48db-b406-e2b7b9ab4cbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.849025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a037-e438-48db-b406-e2b7b9ab4cbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:02.850505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a037-e438-48db-b406-e2b7b9ab4cbf None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-16f1a037-e438-48db-b406-e2b7b9ab4cbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:02.868423 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:02.869377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:02.870215 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:02.870215 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:02.870215 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:02.870215 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:02.870215 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:02.870215 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:02.870215 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:02.870215 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:02.873191 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 246/488] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:02.874443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a037-e438-48db-b406-e2b7b9ab4cbf None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.885073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1f30c-c520-4e87-8719-64506e13fb26 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:02.922720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cf864-9afd-4c37-b42e-345e60ed6ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:02.923623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cf864-9afd-4c37-b42e-345e60ed6ad2 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:02.924002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cf864-9afd-4c37-b42e-345e60ed6ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:02.924369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cf864-9afd-4c37-b42e-345e60ed6ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:02.925247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cf864-9afd-4c37-b42e-345e60ed6ad2 None admin] RBAC: Adding query filter params (role.id=aceae500b40841d18a66edacfc4a12cf, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=5f3c0c082e3044b283bfeb58543d088c) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:02.925656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cf864-9afd-4c37-b42e-345e60ed6ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:02.927191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cf864-9afd-4c37-b42e-345e60ed6ad2 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:02.940963 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 243/489] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/role_assignments?user.id=5f3c0c082e3044b283bfeb58543d088c&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=aceae500b40841d18a66edacfc4a12cf => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:02.942243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cf864-9afd-4c37-b42e-345e60ed6ad2 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:02.981050 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:03.021395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a037-e438-48db-b406-e2b7b9ab4cbf None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:03.054767 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:03.069213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c2316-6fae-4273-a556-f8630b29e824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:03.069876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c2316-6fae-4273-a556-f8630b29e824 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.070156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c2316-6fae-4273-a556-f8630b29e824 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.070431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c2316-6fae-4273-a556-f8630b29e824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.088091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c2316-6fae-4273-a556-f8630b29e824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:03.088091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c2316-6fae-4273-a556-f8630b29e824 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-5c0c2316-6fae-4273-a556-f8630b29e824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:03.106999 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:03.107974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:03.109387 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:03.109387 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:03.109387 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:03.109387 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 247/490] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:03.119862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c2316-6fae-4273-a556-f8630b29e824 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:03.207986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cf864-9afd-4c37-b42e-345e60ed6ad2 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:03.251525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a57cd6-4b6e-460f-bd46-353432d00f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:03.252581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a57cd6-4b6e-460f-bd46-353432d00f14 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.252888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a57cd6-4b6e-460f-bd46-353432d00f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.253167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a57cd6-4b6e-460f-bd46-353432d00f14 None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.253876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a57cd6-4b6e-460f-bd46-353432d00f14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:03.254183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a57cd6-4b6e-460f-bd46-353432d00f14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:03.256413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a57cd6-4b6e-460f-bd46-353432d00f14 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:03.269590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c2316-6fae-4273-a556-f8630b29e824 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:03.270856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 244/491] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:03.276552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a57cd6-4b6e-460f-bd46-353432d00f14 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:03.318382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312833-eeb3-4bda-86a4-417de01cce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:03.319000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312833-eeb3-4bda-86a4-417de01cce7c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.319276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312833-eeb3-4bda-86a4-417de01cce7c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.319818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312833-eeb3-4bda-86a4-417de01cce7c None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.321433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312833-eeb3-4bda-86a4-417de01cce7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:03.321754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312833-eeb3-4bda-86a4-417de01cce7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:03.323156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312833-eeb3-4bda-86a4-417de01cce7c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:03.340002 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 248/492] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:03.345696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312833-eeb3-4bda-86a4-417de01cce7c None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:03.400656 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:03.418737 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:03.474589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312833-eeb3-4bda-86a4-417de01cce7c None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:03.490593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a57cd6-4b6e-460f-bd46-353432d00f14 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:03.513201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0b822-de89-42f5-a476-045ff66b63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:03.513794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0b822-de89-42f5-a476-045ff66b63b9 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.514071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0b822-de89-42f5-a476-045ff66b63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.514343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0b822-de89-42f5-a476-045ff66b63b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.522391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0b822-de89-42f5-a476-045ff66b63b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:03.523976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0b822-de89-42f5-a476-045ff66b63b9 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-88b0b822-de89-42f5-a476-045ff66b63b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:03.537122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:03.538106 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:03.539207 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 249/493] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:03.545970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0b822-de89-42f5-a476-045ff66b63b9 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:03.574196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef90b4-18c2-422e-b3c5-e32553f56d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:03.574834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef90b4-18c2-422e-b3c5-e32553f56d22 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.575116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef90b4-18c2-422e-b3c5-e32553f56d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.575394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef90b4-18c2-422e-b3c5-e32553f56d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.576162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef90b4-18c2-422e-b3c5-e32553f56d22 None admin] RBAC: Adding query filter params (role.id=aceae500b40841d18a66edacfc4a12cf, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=67bdb67cd5854c38b2031a1b8c26023e) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:03.576473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef90b4-18c2-422e-b3c5-e32553f56d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:03.578006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef90b4-18c2-422e-b3c5-e32553f56d22 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:03.597314 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 245/494] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:03 2022] GET /identity/v3/role_assignments?user.id=67bdb67cd5854c38b2031a1b8c26023e&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=aceae500b40841d18a66edacfc4a12cf => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:03.668798 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:03.676392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0b822-de89-42f5-a476-045ff66b63b9 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:03.687025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ef153-b365-444b-a592-21796da05511 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.687690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ef153-b365-444b-a592-21796da05511 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.688202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ef153-b365-444b-a592-21796da05511 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.691587 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 246/495] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:29:03.697842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465f686-3df7-43c7-813c-32cb7dbf55c6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.698503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465f686-3df7-43c7-813c-32cb7dbf55c6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.698985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465f686-3df7-43c7-813c-32cb7dbf55c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.743171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b465f686-3df7-43c7-813c-32cb7dbf55c6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:03.748577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b465f686-3df7-43c7-813c-32cb7dbf55c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:03.756945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481414-7b19-458e-83b1-e5cbb4b5e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:03.757960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481414-7b19-458e-83b1-e5cbb4b5e7dd None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.758465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481414-7b19-458e-83b1-e5cbb4b5e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.758955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481414-7b19-458e-83b1-e5cbb4b5e7dd None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.759915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481414-7b19-458e-83b1-e5cbb4b5e7dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:03.760433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481414-7b19-458e-83b1-e5cbb4b5e7dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:03.762276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481414-7b19-458e-83b1-e5cbb4b5e7dd None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:03.785731 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 250/496] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 19 00:29:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:03.791951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481414-7b19-458e-83b1-e5cbb4b5e7dd None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:03.871074 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 247/497] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:29:03.939276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481414-7b19-458e-83b1-e5cbb4b5e7dd None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:03.977981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0812e7-0b2f-4a9d-aba1-f95bb75d7ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:03.978680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0812e7-0b2f-4a9d-aba1-f95bb75d7ee6 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.979057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0812e7-0b2f-4a9d-aba1-f95bb75d7ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.979339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0812e7-0b2f-4a9d-aba1-f95bb75d7ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:04.015462 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:04.091830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0812e7-0b2f-4a9d-aba1-f95bb75d7ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:04.093499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0812e7-0b2f-4a9d-aba1-f95bb75d7ee6 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:04.218490 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 251/498] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:29:04.225445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465f686-3df7-43c7-813c-32cb7dbf55c6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:04.266088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0812e7-0b2f-4a9d-aba1-f95bb75d7ee6 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:04.341920 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:04.372463 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:04.423638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465f686-3df7-43c7-813c-32cb7dbf55c6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:04.429205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0812e7-0b2f-4a9d-aba1-f95bb75d7ee6 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:04.465252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249873ad-893b-46ba-b693-81fdf981fd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:04.465889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249873ad-893b-46ba-b693-81fdf981fd81 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:04.466222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249873ad-893b-46ba-b693-81fdf981fd81 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:04.466489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249873ad-893b-46ba-b693-81fdf981fd81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:04.482267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249873ad-893b-46ba-b693-81fdf981fd81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:04.483737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249873ad-893b-46ba-b693-81fdf981fd81 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-249873ad-893b-46ba-b693-81fdf981fd81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:04.499507 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:04.500510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:04.501959 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:04.501959 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:04.501959 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:04.501959 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 248/499] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:04.509091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249873ad-893b-46ba-b693-81fdf981fd81 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:04.525040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed0e22-4e7a-4af5-bbe5-977e8fe06b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:04.525611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0e22-4e7a-4af5-bbe5-977e8fe06b45 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:04.525883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0e22-4e7a-4af5-bbe5-977e8fe06b45 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:04.526158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0e22-4e7a-4af5-bbe5-977e8fe06b45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:04.549556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed0e22-4e7a-4af5-bbe5-977e8fe06b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-58ed0e22-4e7a-4af5-bbe5-977e8fe06b45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:04.556244 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:04.557288 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:04.558584 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 252/500] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:04.566414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed0e22-4e7a-4af5-bbe5-977e8fe06b45 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:04.710016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249873ad-893b-46ba-b693-81fdf981fd81 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:04.773581 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:04.779636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf6246-e02f-47ae-9470-5e78f7d6c6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:04.780477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf6246-e02f-47ae-9470-5e78f7d6c6b3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:04.781300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf6246-e02f-47ae-9470-5e78f7d6c6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:04.781721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf6246-e02f-47ae-9470-5e78f7d6c6b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:04.783229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf6246-e02f-47ae-9470-5e78f7d6c6b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:04.783681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf6246-e02f-47ae-9470-5e78f7d6c6b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:04.785253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf6246-e02f-47ae-9470-5e78f7d6c6b3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:04.799773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed0e22-4e7a-4af5-bbe5-977e8fe06b45 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:04.802060 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 249/501] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:04.807304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf6246-e02f-47ae-9470-5e78f7d6c6b3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:04.832868 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:04.881438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac66cd7-f831-4a89-8243-f79c2dbf4b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:04.882453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac66cd7-f831-4a89-8243-f79c2dbf4b8a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:04.882941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac66cd7-f831-4a89-8243-f79c2dbf4b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:04.883406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac66cd7-f831-4a89-8243-f79c2dbf4b8a None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:04.884268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac66cd7-f831-4a89-8243-f79c2dbf4b8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:04.887392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac66cd7-f831-4a89-8243-f79c2dbf4b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:04.889132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac66cd7-f831-4a89-8243-f79c2dbf4b8a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:04.915328 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 253/502] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:04.920441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac66cd7-f831-4a89-8243-f79c2dbf4b8a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:04.960115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf6246-e02f-47ae-9470-5e78f7d6c6b3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:04.998458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866992-a52a-44e4-9d8a-033e33606d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:04.999587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866992-a52a-44e4-9d8a-033e33606d17 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.000125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866992-a52a-44e4-9d8a-033e33606d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.000596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866992-a52a-44e4-9d8a-033e33606d17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.010194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d866992-a52a-44e4-9d8a-033e33606d17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:05.012235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d866992-a52a-44e4-9d8a-033e33606d17 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-8d866992-a52a-44e4-9d8a-033e33606d17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:05.027385 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:05.028332 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:05.029285 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:05.029285 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:05.029285 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:05.029285 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:05.029285 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:05.029285 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:05.029285 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:05.029285 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:05.031987 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 250/503] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:05.041811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866992-a52a-44e4-9d8a-033e33606d17 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:05.058393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac66cd7-f831-4a89-8243-f79c2dbf4b8a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:05.105323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c0933-95cc-48c4-90e3-079f99d238f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:05.105970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c0933-95cc-48c4-90e3-079f99d238f6 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.106250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c0933-95cc-48c4-90e3-079f99d238f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.106526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c0933-95cc-48c4-90e3-079f99d238f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.132976 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:05.133349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c0933-95cc-48c4-90e3-079f99d238f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:05.136878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c0933-95cc-48c4-90e3-079f99d238f6 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-fb6c0933-95cc-48c4-90e3-079f99d238f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:05.158109 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:05.159116 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:05.160094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:05.160094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:05.160094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:05.168697 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 254/504] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:05.170051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152340e-d406-4277-b7de-d8e55bddc95d None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.170342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152340e-d406-4277-b7de-d8e55bddc95d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.170613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152340e-d406-4277-b7de-d8e55bddc95d None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.171945 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 255/505] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:05.172678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152340e-d406-4277-b7de-d8e55bddc95d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:05.214346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866992-a52a-44e4-9d8a-033e33606d17 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:05.222774 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:05.256031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189933-40a2-4df2-a9fc-45a29d2bc1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:05.256944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189933-40a2-4df2-a9fc-45a29d2bc1b0 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.257375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189933-40a2-4df2-a9fc-45a29d2bc1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.257797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189933-40a2-4df2-a9fc-45a29d2bc1b0 None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.258667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189933-40a2-4df2-a9fc-45a29d2bc1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:05.259121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189933-40a2-4df2-a9fc-45a29d2bc1b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:05.260741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189933-40a2-4df2-a9fc-45a29d2bc1b0 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:05.274825 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 251/506] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:05.281337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79d433-8825-45c0-85a5-7744f482ac94 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.281842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79d433-8825-45c0-85a5-7744f482ac94 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.282866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79d433-8825-45c0-85a5-7744f482ac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.303492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7d79d433-8825-45c0-85a5-7744f482ac94 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:05.305134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d79d433-8825-45c0-85a5-7744f482ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:05.324462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152340e-d406-4277-b7de-d8e55bddc95d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:05.368552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ca4ab-bb92-49ec-91bb-6bed41a57461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:05.369570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca4ab-bb92-49ec-91bb-6bed41a57461 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.370079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca4ab-bb92-49ec-91bb-6bed41a57461 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.370555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca4ab-bb92-49ec-91bb-6bed41a57461 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.371424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ca4ab-bb92-49ec-91bb-6bed41a57461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:05.371931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ca4ab-bb92-49ec-91bb-6bed41a57461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:05.373551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ca4ab-bb92-49ec-91bb-6bed41a57461 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:05.387317 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 256/507] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:05.388454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ca4ab-bb92-49ec-91bb-6bed41a57461 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:05.412889 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 252/508] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:29:05.414109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79d433-8825-45c0-85a5-7744f482ac94 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:05.479276 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:05.529064 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:05.552507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ca4ab-bb92-49ec-91bb-6bed41a57461 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:05.605274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79d433-8825-45c0-85a5-7744f482ac94 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:05.616571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ff7e1-f94b-48f1-841a-d5c45b26b782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:05.617220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ff7e1-f94b-48f1-841a-d5c45b26b782 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.617558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ff7e1-f94b-48f1-841a-d5c45b26b782 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.617829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ff7e1-f94b-48f1-841a-d5c45b26b782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.618570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ff7e1-f94b-48f1-841a-d5c45b26b782 None admin] RBAC: Adding query filter params (role.id=aceae500b40841d18a66edacfc4a12cf, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=54b7394a5d944639b1253d5d54b688e2) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:05.618878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ff7e1-f94b-48f1-841a-d5c45b26b782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:05.620328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ff7e1-f94b-48f1-841a-d5c45b26b782 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:05.634199 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 257/509] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:05 2022] GET /identity/v3/role_assignments?user.id=54b7394a5d944639b1253d5d54b688e2&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=aceae500b40841d18a66edacfc4a12cf => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:05.668329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b3429-e994-4329-bacf-a55e29ac81ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:05.669008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b3429-e994-4329-bacf-a55e29ac81ab None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.669288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b3429-e994-4329-bacf-a55e29ac81ab None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.669564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b3429-e994-4329-bacf-a55e29ac81ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.682474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b3429-e994-4329-bacf-a55e29ac81ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:05.684002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b3429-e994-4329-bacf-a55e29ac81ab None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-633b3429-e994-4329-bacf-a55e29ac81ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:05.702781 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:05.703814 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:05.704977 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 253/510] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 19 00:29:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:05.712303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ff7e1-f94b-48f1-841a-d5c45b26b782 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:05.815426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006ac8-a53c-459b-8e22-bb8a5966cdb7 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.815609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006ac8-a53c-459b-8e22-bb8a5966cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.815887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006ac8-a53c-459b-8e22-bb8a5966cdb7 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.817585 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 254/511] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:05.823427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f4d6d-d941-4884-af96-570b2d68b24d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.824087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f4d6d-d941-4884-af96-570b2d68b24d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.824785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f4d6d-d941-4884-af96-570b2d68b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.855460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-151f4d6d-d941-4884-af96-570b2d68b24d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:05.857902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-151f4d6d-d941-4884-af96-570b2d68b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:05.873066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ff7e1-f94b-48f1-841a-d5c45b26b782 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:05.914156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1903e5-f289-4fb9-ae68-a4e97d2be9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:05.914779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1903e5-f289-4fb9-ae68-a4e97d2be9ad None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:05.915064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1903e5-f289-4fb9-ae68-a4e97d2be9ad None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:05.915337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1903e5-f289-4fb9-ae68-a4e97d2be9ad None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:05.916077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1903e5-f289-4fb9-ae68-a4e97d2be9ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:05.916382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1903e5-f289-4fb9-ae68-a4e97d2be9ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:05.918039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1903e5-f289-4fb9-ae68-a4e97d2be9ad None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:05.936962 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 258/512] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 19 00:29:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:05.937822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1903e5-f289-4fb9-ae68-a4e97d2be9ad None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:05.947502 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 255/513] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:29:05.948800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f4d6d-d941-4884-af96-570b2d68b24d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:05.953828 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:05.982138 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:06.063157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1903e5-f289-4fb9-ae68-a4e97d2be9ad None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:06.090432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f4d6d-d941-4884-af96-570b2d68b24d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:06.108378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e5bb3-27d0-4292-bd2c-be1033d1a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:06.109557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e5bb3-27d0-4292-bd2c-be1033d1a626 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.110380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e5bb3-27d0-4292-bd2c-be1033d1a626 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.110806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e5bb3-27d0-4292-bd2c-be1033d1a626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.124465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e5bb3-27d0-4292-bd2c-be1033d1a626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:06.127426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e5bb3-27d0-4292-bd2c-be1033d1a626 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:06.134367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aae25-fb5e-40a9-9708-2cb74ba85576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:06.135385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aae25-fb5e-40a9-9708-2cb74ba85576 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.135773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aae25-fb5e-40a9-9708-2cb74ba85576 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.136141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aae25-fb5e-40a9-9708-2cb74ba85576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-469e5bb3-27d0-4292-bd2c-be1033d1a626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:06.154398 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:06.155420 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:06.156305 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:06.156305 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:06.156305 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:06.158961 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 259/514] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:06.164747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e5bb3-27d0-4292-bd2c-be1033d1a626 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:06.165810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aae25-fb5e-40a9-9708-2cb74ba85576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:06.167286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aae25-fb5e-40a9-9708-2cb74ba85576 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-361aae25-fb5e-40a9-9708-2cb74ba85576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:06.191673 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:06.192734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:06.193631 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:06.193631 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:06.193631 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:06.193631 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 256/515] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:06.199857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aae25-fb5e-40a9-9708-2cb74ba85576 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:06.235000 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:06.280604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e5bb3-27d0-4292-bd2c-be1033d1a626 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:06.343322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd633471-f4d9-4c33-a5c8-21f2045eb023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:06.343892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd633471-f4d9-4c33-a5c8-21f2045eb023 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.344152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd633471-f4d9-4c33-a5c8-21f2045eb023 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.344428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd633471-f4d9-4c33-a5c8-21f2045eb023 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.345218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd633471-f4d9-4c33-a5c8-21f2045eb023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:06.345619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd633471-f4d9-4c33-a5c8-21f2045eb023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:06.347344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd633471-f4d9-4c33-a5c8-21f2045eb023 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:06.348212 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:06.368143 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 260/516] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:06.373440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd633471-f4d9-4c33-a5c8-21f2045eb023 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:06.384265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aae25-fb5e-40a9-9708-2cb74ba85576 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:06.433480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd57678-473e-469b-925d-284cc57bfc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:06.434658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd57678-473e-469b-925d-284cc57bfc39 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.435621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd57678-473e-469b-925d-284cc57bfc39 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.436080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd57678-473e-469b-925d-284cc57bfc39 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.437331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd57678-473e-469b-925d-284cc57bfc39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:06.438081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd57678-473e-469b-925d-284cc57bfc39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:06.440781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd57678-473e-469b-925d-284cc57bfc39 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:06.457518 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 257/517] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:06.458255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd57678-473e-469b-925d-284cc57bfc39 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:06.499623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd633471-f4d9-4c33-a5c8-21f2045eb023 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:06.525082 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:06.538835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95591e-5e32-40f5-bdad-5c46acdc08ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:06.539489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95591e-5e32-40f5-bdad-5c46acdc08ab None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.539771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95591e-5e32-40f5-bdad-5c46acdc08ab None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.540047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95591e-5e32-40f5-bdad-5c46acdc08ab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.540678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95591e-5e32-40f5-bdad-5c46acdc08ab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:06.542074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95591e-5e32-40f5-bdad-5c46acdc08ab None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-ba95591e-5e32-40f5-bdad-5c46acdc08ab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:06.554477 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:06.555548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:06.557049 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 261/518] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Oct 19 00:29:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:06.557884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ee8bf-e17a-447f-9495-5072aefeb909 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.557884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ee8bf-e17a-447f-9495-5072aefeb909 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.557884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ee8bf-e17a-447f-9495-5072aefeb909 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.563868 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 262/519] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:06.563868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ee8bf-e17a-447f-9495-5072aefeb909 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:06.578530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd57678-473e-469b-925d-284cc57bfc39 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:06.616605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd4f83-c703-4e50-9aa1-9dbbef0e4716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:06.617167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd4f83-c703-4e50-9aa1-9dbbef0e4716 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.617451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd4f83-c703-4e50-9aa1-9dbbef0e4716 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.617726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd4f83-c703-4e50-9aa1-9dbbef0e4716 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.618376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd4f83-c703-4e50-9aa1-9dbbef0e4716 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:06.619919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd4f83-c703-4e50-9aa1-9dbbef0e4716 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:06.628170 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:06.653097 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 258/520] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:29:06 2022] POST /identity/v3/users => generated 254 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:06.654504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd4f83-c703-4e50-9aa1-9dbbef0e4716 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:06.692782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ee8bf-e17a-447f-9495-5072aefeb909 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:06.740276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e0ec4-ac45-4cbc-b2c7-6ac441b88179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:06.741019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e0ec4-ac45-4cbc-b2c7-6ac441b88179 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.741299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e0ec4-ac45-4cbc-b2c7-6ac441b88179 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.741567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e0ec4-ac45-4cbc-b2c7-6ac441b88179 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.751609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e0ec4-ac45-4cbc-b2c7-6ac441b88179 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:06.753435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e0ec4-ac45-4cbc-b2c7-6ac441b88179 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-fb4e0ec4-ac45-4cbc-b2c7-6ac441b88179 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:06.765952 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:06.767746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:06.769303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:06.769303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:06.769303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:06.769303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:06.769303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:06.769303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:06.769303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:06.769303 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:06.769303 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 263/521] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:06.774241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3e194-1730-43d3-a418-780885749184 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.774541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3e194-1730-43d3-a418-780885749184 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.774804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3e194-1730-43d3-a418-780885749184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.796722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2da3e194-1730-43d3-a418-780885749184 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:06.798094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2da3e194-1730-43d3-a418-780885749184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:06.820311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd4f83-c703-4e50-9aa1-9dbbef0e4716 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:06.851113 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:06.872877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59562a-90e0-46e5-b869-aea88a65086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:06.873581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59562a-90e0-46e5-b869-aea88a65086a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:06.873939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59562a-90e0-46e5-b869-aea88a65086a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:06.874266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59562a-90e0-46e5-b869-aea88a65086a None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:06.875117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59562a-90e0-46e5-b869-aea88a65086a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:06.875232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59562a-90e0-46e5-b869-aea88a65086a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:06.877427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59562a-90e0-46e5-b869-aea88a65086a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:06.882733 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 259/522] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 19 00:29:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:06.883636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59562a-90e0-46e5-b869-aea88a65086a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:06.885558 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 264/523] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:29:06.889469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3e194-1730-43d3-a418-780885749184 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:06.952508 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:07.002579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3e194-1730-43d3-a418-780885749184 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:07.004363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59562a-90e0-46e5-b869-aea88a65086a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:07.041054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48bb9-29ae-4a22-a689-36095e53ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:07.042046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48bb9-29ae-4a22-a689-36095e53ea60 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:07.042439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9837d8-10f0-4b82-a1ff-b8b784f1ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:07.042787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48bb9-29ae-4a22-a689-36095e53ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:07.043058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9837d8-10f0-4b82-a1ff-b8b784f1ba8c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:07.043339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9837d8-10f0-4b82-a1ff-b8b784f1ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:07.043613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9837d8-10f0-4b82-a1ff-b8b784f1ba8c None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:07.046792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9837d8-10f0-4b82-a1ff-b8b784f1ba8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:07.046792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9837d8-10f0-4b82-a1ff-b8b784f1ba8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:07.046792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9837d8-10f0-4b82-a1ff-b8b784f1ba8c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:07.050256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48bb9-29ae-4a22-a689-36095e53ea60 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:07.051183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48bb9-29ae-4a22-a689-36095e53ea60 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:07.051709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48bb9-29ae-4a22-a689-36095e53ea60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:07.053416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48bb9-29ae-4a22-a689-36095e53ea60 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:07.059451 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 260/524] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:07.064653 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 265/525] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 19 00:29:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:07.069762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9837d8-10f0-4b82-a1ff-b8b784f1ba8c None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:07.211026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48bb9-29ae-4a22-a689-36095e53ea60 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:07.219428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9837d8-10f0-4b82-a1ff-b8b784f1ba8c None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:07.245969 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:07.265839 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:07.317425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b431b-a8dd-449f-951a-fac2ca783b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:07.318121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b431b-a8dd-449f-951a-fac2ca783b7f None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:07.318406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b431b-a8dd-449f-951a-fac2ca783b7f None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:07.318683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b431b-a8dd-449f-951a-fac2ca783b7f None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0165e2f8b5e34c8d8570262c777de161/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:07.322647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b431b-a8dd-449f-951a-fac2ca783b7f None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=0165e2f8b5e34c8d8570262c777de161, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:07.324129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b431b-a8dd-449f-951a-fac2ca783b7f None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:07.341900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48bb9-29ae-4a22-a689-36095e53ea60 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:07.363057 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 261/526] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:29:07 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0165e2f8b5e34c8d8570262c777de161/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:29:07.394173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab50190-4ebd-4102-8f32-9da3064a52e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:07.394963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50190-4ebd-4102-8f32-9da3064a52e5 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:07.395325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50190-4ebd-4102-8f32-9da3064a52e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:07.395605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50190-4ebd-4102-8f32-9da3064a52e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:07.396300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab50190-4ebd-4102-8f32-9da3064a52e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:07.397911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab50190-4ebd-4102-8f32-9da3064a52e5 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-2ab50190-4ebd-4102-8f32-9da3064a52e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:07.409869 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:07.411017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:07.412088 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 266/527] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:07 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:07.417103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b431b-a8dd-449f-951a-fac2ca783b7f None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:07.545315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b431b-a8dd-449f-951a-fac2ca783b7f None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:07.585132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039dde9-e6f0-4e8c-96aa-d9d001234fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:07.585911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039dde9-e6f0-4e8c-96aa-d9d001234fc4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:07.586075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039dde9-e6f0-4e8c-96aa-d9d001234fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:07.586274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039dde9-e6f0-4e8c-96aa-d9d001234fc4 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:07.586914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039dde9-e6f0-4e8c-96aa-d9d001234fc4 None admin] RBAC: Adding query filter params (name=network) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:07.587217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039dde9-e6f0-4e8c-96aa-d9d001234fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:07.588884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039dde9-e6f0-4e8c-96aa-d9d001234fc4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:07.594001 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 262/528] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:07.601156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab50190-4ebd-4102-8f32-9da3064a52e5 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:07.717851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab50190-4ebd-4102-8f32-9da3064a52e5 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:07.720767 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:07.756416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14a828-2509-4d83-9566-34fde13b6bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:07.757396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a828-2509-4d83-9566-34fde13b6bc4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:07.757859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a828-2509-4d83-9566-34fde13b6bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:07.758316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a828-2509-4d83-9566-34fde13b6bc4 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:07.759200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14a828-2509-4d83-9566-34fde13b6bc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:07.759734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14a828-2509-4d83-9566-34fde13b6bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:07.761339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14a828-2509-4d83-9566-34fde13b6bc4 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:07.767896 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 267/529] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:08.213764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10312c2-fa67-41d1-a5af-e8f48cfb5add None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:08.214145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10312c2-fa67-41d1-a5af-e8f48cfb5add None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:08.214350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10312c2-fa67-41d1-a5af-e8f48cfb5add None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:08.215958 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 263/530] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:08.222259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a62ace-6ded-4240-bd87-de54eda5a0de None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:08.222744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a62ace-6ded-4240-bd87-de54eda5a0de None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:08.222821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a62ace-6ded-4240-bd87-de54eda5a0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:08.248137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-93a62ace-6ded-4240-bd87-de54eda5a0de None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:08.249414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-93a62ace-6ded-4240-bd87-de54eda5a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:08.343820 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 268/531] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:29:08.772702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10312c2-fa67-41d1-a5af-e8f48cfb5add None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:08.835292 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:08.927543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10312c2-fa67-41d1-a5af-e8f48cfb5add None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:08.975865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38f63d-9d18-4dfd-bb27-200830fb87c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:08.976523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38f63d-9d18-4dfd-bb27-200830fb87c7 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:08.976833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38f63d-9d18-4dfd-bb27-200830fb87c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:08.977104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38f63d-9d18-4dfd-bb27-200830fb87c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:08.994441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38f63d-9d18-4dfd-bb27-200830fb87c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-ea38f63d-9d18-4dfd-bb27-200830fb87c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:08.999423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:09.001850 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:09.004948 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 264/532] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:09.010110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a62ace-6ded-4240-bd87-de54eda5a0de None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:09.184310 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:09.189549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a62ace-6ded-4240-bd87-de54eda5a0de None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:09.231708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1240a-1086-4eb7-8f35-acdc87adac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:09.233184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1240a-1086-4eb7-8f35-acdc87adac5b None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:09.233693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1240a-1086-4eb7-8f35-acdc87adac5b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:09.234193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1240a-1086-4eb7-8f35-acdc87adac5b None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:09.235598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1240a-1086-4eb7-8f35-acdc87adac5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:09.236237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1240a-1086-4eb7-8f35-acdc87adac5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:09.238385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1240a-1086-4eb7-8f35-acdc87adac5b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:09.248876 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 269/533] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:09.256750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38f63d-9d18-4dfd-bb27-200830fb87c7 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:09.435132 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:09.440172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38f63d-9d18-4dfd-bb27-200830fb87c7 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:09.491060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e1d16-56c4-409b-b0ec-ab8573593808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:09.491716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e1d16-56c4-409b-b0ec-ab8573593808 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:09.491991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e1d16-56c4-409b-b0ec-ab8573593808 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:09.492262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e1d16-56c4-409b-b0ec-ab8573593808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:09.507922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e1d16-56c4-409b-b0ec-ab8573593808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:09.509478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e1d16-56c4-409b-b0ec-ab8573593808 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-8e9e1d16-56c4-409b-b0ec-ab8573593808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:09.531215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:09.532567 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:09.534140 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:09.534140 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:09.534140 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:09.534140 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 265/534] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:09.538837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1240a-1086-4eb7-8f35-acdc87adac5b None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:09.695219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909ad20-29ff-456c-9a88-434a1a5c61bf None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:09.695520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909ad20-29ff-456c-9a88-434a1a5c61bf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:09.695691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909ad20-29ff-456c-9a88-434a1a5c61bf None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:09.697356 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 266/535] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:09.702303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89541b74-a2f8-4081-800a-977328aa0edd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:09.702606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89541b74-a2f8-4081-800a-977328aa0edd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:09.702861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89541b74-a2f8-4081-800a-977328aa0edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:09.717604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1240a-1086-4eb7-8f35-acdc87adac5b None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:09.745848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-89541b74-a2f8-4081-800a-977328aa0edd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:09.746874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-89541b74-a2f8-4081-800a-977328aa0edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:09.754984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1a236-e085-4577-bf5a-df5cfde8861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:09.755971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1a236-e085-4577-bf5a-df5cfde8861a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:09.756494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1a236-e085-4577-bf5a-df5cfde8861a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:09.757016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1a236-e085-4577-bf5a-df5cfde8861a None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:09.757955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1a236-e085-4577-bf5a-df5cfde8861a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:09.758464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1a236-e085-4577-bf5a-df5cfde8861a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:09.760113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1a236-e085-4577-bf5a-df5cfde8861a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:09.773405 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 270/536] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:09.780998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1a236-e085-4577-bf5a-df5cfde8861a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:09.823126 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:09.876270 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 267/537] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:29:09.964595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1a236-e085-4577-bf5a-df5cfde8861a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:10.027463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcd3de-24fa-4b6d-9e3a-9e25ab375e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:10.028101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcd3de-24fa-4b6d-9e3a-9e25ab375e2f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.028429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcd3de-24fa-4b6d-9e3a-9e25ab375e2f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.028733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcd3de-24fa-4b6d-9e3a-9e25ab375e2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.040357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcd3de-24fa-4b6d-9e3a-9e25ab375e2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:10.041928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcd3de-24fa-4b6d-9e3a-9e25ab375e2f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-65bcd3de-24fa-4b6d-9e3a-9e25ab375e2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:10.064770 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:10.065830 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:10.067343 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 271/538] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:10.071675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89541b74-a2f8-4081-800a-977328aa0edd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:10.089564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c46f3-c49c-45dd-9e84-34286325b96a None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.089874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c46f3-c49c-45dd-9e84-34286325b96a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.090098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c46f3-c49c-45dd-9e84-34286325b96a None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.091711 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 272/539] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:10.098065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba4c9-50bf-4814-81ac-d4ae380e87f7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.098324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba4c9-50bf-4814-81ac-d4ae380e87f7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.098515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba4c9-50bf-4814-81ac-d4ae380e87f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.132510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fc2ba4c9-50bf-4814-81ac-d4ae380e87f7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:10.133658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc2ba4c9-50bf-4814-81ac-d4ae380e87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:10.199713 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:10.221359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89541b74-a2f8-4081-800a-977328aa0edd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:10.227612 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 273/540] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:29:10.228477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ba4c9-50bf-4814-81ac-d4ae380e87f7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:10.253486 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:10.258468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a12f1a-84a6-4968-b507-d7b35ea26340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:10.259290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a12f1a-84a6-4968-b507-d7b35ea26340 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.259714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a12f1a-84a6-4968-b507-d7b35ea26340 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.260127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a12f1a-84a6-4968-b507-d7b35ea26340 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.261079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a12f1a-84a6-4968-b507-d7b35ea26340 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:10.261557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a12f1a-84a6-4968-b507-d7b35ea26340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:10.263131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a12f1a-84a6-4968-b507-d7b35ea26340 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:10.282352 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 268/541] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 19 00:29:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:10.288726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a12f1a-84a6-4968-b507-d7b35ea26340 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:10.408401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ba4c9-50bf-4814-81ac-d4ae380e87f7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:10.465196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a12f1a-84a6-4968-b507-d7b35ea26340 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:10.474339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd495e-2b7c-4418-b751-cb9256477185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:10.474983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd495e-2b7c-4418-b751-cb9256477185 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.475341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd495e-2b7c-4418-b751-cb9256477185 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.475786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd495e-2b7c-4418-b751-cb9256477185 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.493137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd495e-2b7c-4418-b751-cb9256477185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:10.503525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3a677-934e-4c9a-a46c-6ff0beb4ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:10.504440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a677-934e-4c9a-a46c-6ff0beb4ef9f None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.504911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a677-934e-4c9a-a46c-6ff0beb4ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.505359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a677-934e-4c9a-a46c-6ff0beb4ef9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-2efd495e-2b7c-4418-b751-cb9256477185 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:10.507054 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:10.508208 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:10.509117 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 274/542] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:10.514305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd495e-2b7c-4418-b751-cb9256477185 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:10.517276 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:10.521574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a677-934e-4c9a-a46c-6ff0beb4ef9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:10.523545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a677-934e-4c9a-a46c-6ff0beb4ef9f None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-68f3a677-934e-4c9a-a46c-6ff0beb4ef9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:10.553352 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:10.554582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:10.555692 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:10.555692 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:10.555692 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:10.557905 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 269/543] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:10.559642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2637b6-092c-4401-8e84-b09d24956439 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.560124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2637b6-092c-4401-8e84-b09d24956439 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.560530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2637b6-092c-4401-8e84-b09d24956439 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.562054 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 270/544] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:10.567516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2637b6-092c-4401-8e84-b09d24956439 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:10.604808 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:10.650604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd495e-2b7c-4418-b751-cb9256477185 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:10.684836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2637b6-092c-4401-8e84-b09d24956439 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:10.686123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350241ed-99be-4a06-b2fe-a332ef73598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:10.686760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350241ed-99be-4a06-b2fe-a332ef73598e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.687034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350241ed-99be-4a06-b2fe-a332ef73598e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.687304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350241ed-99be-4a06-b2fe-a332ef73598e None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.687990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350241ed-99be-4a06-b2fe-a332ef73598e None admin] RBAC: Adding query filter params (name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:10.688443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350241ed-99be-4a06-b2fe-a332ef73598e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:10.689877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350241ed-99be-4a06-b2fe-a332ef73598e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:10.699175 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 275/545] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:29:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:10.700267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0efa-8e49-4446-8fd0-9185628e6b18 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.700549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0efa-8e49-4446-8fd0-9185628e6b18 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.700847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0efa-8e49-4446-8fd0-9185628e6b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.720863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-320a0efa-8e49-4446-8fd0-9185628e6b18 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:10.722180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-320a0efa-8e49-4446-8fd0-9185628e6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:10.727495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fccb8-544c-494b-8d38-b928c4b56b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:10.728044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fccb8-544c-494b-8d38-b928c4b56b41 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.728318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fccb8-544c-494b-8d38-b928c4b56b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.728587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fccb8-544c-494b-8d38-b928c4b56b41 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.729257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fccb8-544c-494b-8d38-b928c4b56b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:10.729575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fccb8-544c-494b-8d38-b928c4b56b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:10.730908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fccb8-544c-494b-8d38-b928c4b56b41 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:10.742396 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 271/546] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:10.743182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fccb8-544c-494b-8d38-b928c4b56b41 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:10.791902 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 276/547] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:29:10.793310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dae628-add0-4472-8369-55f1457d472b None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.793599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dae628-add0-4472-8369-55f1457d472b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.793876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dae628-add0-4472-8369-55f1457d472b None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.795107 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 277/548] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:10.795795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dae628-add0-4472-8369-55f1457d472b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:10.796609 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:10.856475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fccb8-544c-494b-8d38-b928c4b56b41 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:10.882684 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:10.901185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340d97-bfdf-410d-9536-f347af91e6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:10.902106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340d97-bfdf-410d-9536-f347af91e6be None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.902384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340d97-bfdf-410d-9536-f347af91e6be None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.902936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340d97-bfdf-410d-9536-f347af91e6be None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.903598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340d97-bfdf-410d-9536-f347af91e6be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:10.905555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340d97-bfdf-410d-9536-f347af91e6be None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:10.923168 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 272/549] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:29:10 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:10.923168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340d97-bfdf-410d-9536-f347af91e6be None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:10.937260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dae628-add0-4472-8369-55f1457d472b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:10.979306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d86400-e459-4d12-80f8-168947a661d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:10.980179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d86400-e459-4d12-80f8-168947a661d0 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.980600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d86400-e459-4d12-80f8-168947a661d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.981112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d86400-e459-4d12-80f8-168947a661d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.995122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d86400-e459-4d12-80f8-168947a661d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:10.996773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d86400-e459-4d12-80f8-168947a661d0 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-61d86400-e459-4d12-80f8-168947a661d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:11.014797 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:11.016016 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:11.017734 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:11.017734 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:11.017734 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:11.018051 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 278/550] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:11.019558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89ce82-97e9-4852-88c1-21a119fe312b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.019955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89ce82-97e9-4852-88c1-21a119fe312b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.020314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89ce82-97e9-4852-88c1-21a119fe312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.041936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cc89ce82-97e9-4852-88c1-21a119fe312b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:11.043268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cc89ce82-97e9-4852-88c1-21a119fe312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:11.075678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340d97-bfdf-410d-9536-f347af91e6be None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.088151 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:11.117689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df80b50-8839-486a-a42b-97458f98dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.118348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df80b50-8839-486a-a42b-97458f98dd70 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.118643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df80b50-8839-486a-a42b-97458f98dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.118894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df80b50-8839-486a-a42b-97458f98dd70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.128700 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 279/551] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:29:11.128700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89ce82-97e9-4852-88c1-21a119fe312b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.129000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df80b50-8839-486a-a42b-97458f98dd70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:11.129000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df80b50-8839-486a-a42b-97458f98dd70 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-3df80b50-8839-486a-a42b-97458f98dd70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:11.151116 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:11.152257 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:11.153354 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:11.153354 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:11.153354 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:11.153354 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:11.153354 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:11.153354 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:11.153354 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:11.153354 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:11.153776 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 273/552] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:11.155755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df80b50-8839-486a-a42b-97458f98dd70 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.187038 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:11.285748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df80b50-8839-486a-a42b-97458f98dd70 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.293456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89ce82-97e9-4852-88c1-21a119fe312b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.328330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadb9f-97c1-423d-bd83-46e364f4f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.329406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadb9f-97c1-423d-bd83-46e364f4f898 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.330051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadb9f-97c1-423d-bd83-46e364f4f898 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.330469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadb9f-97c1-423d-bd83-46e364f4f898 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.343943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbadb9f-97c1-423d-bd83-46e364f4f898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-4fbadb9f-97c1-423d-bd83-46e364f4f898 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:11.352068 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:11.353261 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:11.354295 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:11.356277 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 274/553] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:11.357255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadb9f-97c1-423d-bd83-46e364f4f898 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.364588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a66fd-1174-4270-a671-b24709309bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.365282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a66fd-1174-4270-a671-b24709309bbf None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.365572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a66fd-1174-4270-a671-b24709309bbf None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.365820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a66fd-1174-4270-a671-b24709309bbf None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.366462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a66fd-1174-4270-a671-b24709309bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:11.366761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a66fd-1174-4270-a671-b24709309bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:11.368141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a66fd-1174-4270-a671-b24709309bbf None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:11.381449 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 280/554] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:11.382320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a66fd-1174-4270-a671-b24709309bbf None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.402659 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:11.491896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadb9f-97c1-423d-bd83-46e364f4f898 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.496852 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:11.499721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a66fd-1174-4270-a671-b24709309bbf None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.538119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f4dcb-fdf9-4b2b-a58a-1375057b41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.538766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f4dcb-fdf9-4b2b-a58a-1375057b41c9 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.538945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f4dcb-fdf9-4b2b-a58a-1375057b41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.539218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f4dcb-fdf9-4b2b-a58a-1375057b41c9 None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.539931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f4dcb-fdf9-4b2b-a58a-1375057b41c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:11.540236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f4dcb-fdf9-4b2b-a58a-1375057b41c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:11.541704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59f931-b1a9-4fd9-858b-4c36f26f8413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.541851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f4dcb-fdf9-4b2b-a58a-1375057b41c9 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:11.542468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59f931-b1a9-4fd9-858b-4c36f26f8413 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.542757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59f931-b1a9-4fd9-858b-4c36f26f8413 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.543028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59f931-b1a9-4fd9-858b-4c36f26f8413 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.543984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59f931-b1a9-4fd9-858b-4c36f26f8413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:11.544289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59f931-b1a9-4fd9-858b-4c36f26f8413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:11.546211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59f931-b1a9-4fd9-858b-4c36f26f8413 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:11.557249 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 275/555] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:11.562422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f4dcb-fdf9-4b2b-a58a-1375057b41c9 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.562604 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 281/556] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:29:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:11.563470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59f931-b1a9-4fd9-858b-4c36f26f8413 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.668109 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:11.681602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f4dcb-fdf9-4b2b-a58a-1375057b41c9 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.683484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59f931-b1a9-4fd9-858b-4c36f26f8413 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.720930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd3fdb-7fd4-4aee-a8c2-5e844fff1243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.721954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd3fdb-7fd4-4aee-a8c2-5e844fff1243 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.722232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd3fdb-7fd4-4aee-a8c2-5e844fff1243 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.722563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd3fdb-7fd4-4aee-a8c2-5e844fff1243 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.724988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dace8-ea7e-4e56-abb7-e0352e73cda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.725716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dace8-ea7e-4e56-abb7-e0352e73cda7 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.725900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dace8-ea7e-4e56-abb7-e0352e73cda7 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.726139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dace8-ea7e-4e56-abb7-e0352e73cda7 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.726799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dace8-ea7e-4e56-abb7-e0352e73cda7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:11.728179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dace8-ea7e-4e56-abb7-e0352e73cda7 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:11.730545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd3fdb-7fd4-4aee-a8c2-5e844fff1243 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:11.731977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd3fdb-7fd4-4aee-a8c2-5e844fff1243 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:11.745326 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 282/557] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:29:11 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-3fcd3fdb-7fd4-4aee-a8c2-5e844fff1243 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:11.745960 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:11.746892 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:29:11.747836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:11.748410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dace8-ea7e-4e56-abb7-e0352e73cda7 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.756767 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 276/558] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 19 00:29:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:11.758024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd3fdb-7fd4-4aee-a8c2-5e844fff1243 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.800099 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:11.885120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd3fdb-7fd4-4aee-a8c2-5e844fff1243 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.931875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dace8-ea7e-4e56-abb7-e0352e73cda7 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.942132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22aa50b-2d68-447a-aaa3-b9d850d72111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.942132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aa50b-2d68-447a-aaa3-b9d850d72111 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.942132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aa50b-2d68-447a-aaa3-b9d850d72111 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.942132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aa50b-2d68-447a-aaa3-b9d850d72111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.956168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22aa50b-2d68-447a-aaa3-b9d850d72111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:11.957738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22aa50b-2d68-447a-aaa3-b9d850d72111 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:11.966433 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-a22aa50b-2d68-447a-aaa3-b9d850d72111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:11.978632 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:11.979713 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:11.980680 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:11.980680 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:11.980680 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:11.980680 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 277/559] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:11.980911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22aa50b-2d68-447a-aaa3-b9d850d72111 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.989900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd5495-8f04-4ea7-9f26-a51198ce4cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.990577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5495-8f04-4ea7-9f26-a51198ce4cdd None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.990854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5495-8f04-4ea7-9f26-a51198ce4cdd None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.991131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5495-8f04-4ea7-9f26-a51198ce4cdd None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/54b7394a5d944639b1253d5d54b688e2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.993139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd5495-8f04-4ea7-9f26-a51198ce4cdd None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=54b7394a5d944639b1253d5d54b688e2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:11.994591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd5495-8f04-4ea7-9f26-a51198ce4cdd None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:12.013718 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 283/560] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:29:11 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/54b7394a5d944639b1253d5d54b688e2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:29:12.014573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd5495-8f04-4ea7-9f26-a51198ce4cdd None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:12.167554 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:12.174359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22aa50b-2d68-447a-aaa3-b9d850d72111 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:12.218622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd5495-8f04-4ea7-9f26-a51198ce4cdd None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:12.241826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55295691-91c0-4ce5-b35c-24419e8634f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:12.243171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55295691-91c0-4ce5-b35c-24419e8634f4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.243718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55295691-91c0-4ce5-b35c-24419e8634f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.244315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55295691-91c0-4ce5-b35c-24419e8634f4 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.245384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55295691-91c0-4ce5-b35c-24419e8634f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:12.245916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55295691-91c0-4ce5-b35c-24419e8634f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:12.247636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55295691-91c0-4ce5-b35c-24419e8634f4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:12.263676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037598d-ae13-4adf-83fb-036bdd05616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:12.264688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037598d-ae13-4adf-83fb-036bdd05616b None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.265157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037598d-ae13-4adf-83fb-036bdd05616b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.265642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037598d-ae13-4adf-83fb-036bdd05616b None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.267065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037598d-ae13-4adf-83fb-036bdd05616b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:12.267548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037598d-ae13-4adf-83fb-036bdd05616b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:12.268886 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 278/561] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Oct 19 00:29:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:12.269482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037598d-ae13-4adf-83fb-036bdd05616b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:12.274684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55295691-91c0-4ce5-b35c-24419e8634f4 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:12.284480 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 284/562] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:12.290280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037598d-ae13-4adf-83fb-036bdd05616b None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:12.352467 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:12.433291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037598d-ae13-4adf-83fb-036bdd05616b None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:12.434079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55295691-91c0-4ce5-b35c-24419e8634f4 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:12.489951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba98b3d-c6b1-40b7-8aa1-94f84f08a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:12.490589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98b3d-c6b1-40b7-8aa1-94f84f08a8b2 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.490865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98b3d-c6b1-40b7-8aa1-94f84f08a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.491133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98b3d-c6b1-40b7-8aa1-94f84f08a8b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.504322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba98b3d-c6b1-40b7-8aa1-94f84f08a8b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:12.505801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba98b3d-c6b1-40b7-8aa1-94f84f08a8b2 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:12.510846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d159cb4-19c5-4a7c-a69a-e64580179453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:12.511341 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:12.511517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159cb4-19c5-4a7c-a69a-e64580179453 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.511761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159cb4-19c5-4a7c-a69a-e64580179453 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.512032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159cb4-19c5-4a7c-a69a-e64580179453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-aba98b3d-c6b1-40b7-8aa1-94f84f08a8b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:12.532383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:12.533975 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:29:12.535568 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:12.536216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d159cb4-19c5-4a7c-a69a-e64580179453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:12.536216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d159cb4-19c5-4a7c-a69a-e64580179453 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:12.541366 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 285/563] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 19 00:29:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:12.543601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba98b3d-c6b1-40b7-8aa1-94f84f08a8b2 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-3d159cb4-19c5-4a7c-a69a-e64580179453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:12.566919 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:12.567912 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:12.568815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:12.568815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:12.568815 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:12.570483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 279/564] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:12.575054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d159cb4-19c5-4a7c-a69a-e64580179453 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:12.706779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba98b3d-c6b1-40b7-8aa1-94f84f08a8b2 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:12.762047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d159cb4-19c5-4a7c-a69a-e64580179453 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:12.767649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a74cd8-ff23-47d7-a6e4-d9810476e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:12.768311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a74cd8-ff23-47d7-a6e4-d9810476e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.768591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a74cd8-ff23-47d7-a6e4-d9810476e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.768948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a74cd8-ff23-47d7-a6e4-d9810476e7a8 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.769695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a74cd8-ff23-47d7-a6e4-d9810476e7a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:12.770003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a74cd8-ff23-47d7-a6e4-d9810476e7a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:12.771446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a74cd8-ff23-47d7-a6e4-d9810476e7a8 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:12.783121 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:12.790868 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 286/565] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 19 00:29:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:12.796146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a74cd8-ff23-47d7-a6e4-d9810476e7a8 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:12.881401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44fd9b-f1c1-4ab9-974e-b06f721ab0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:12.882037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44fd9b-f1c1-4ab9-974e-b06f721ab0a3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.882321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44fd9b-f1c1-4ab9-974e-b06f721ab0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.882599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44fd9b-f1c1-4ab9-974e-b06f721ab0a3 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.883092 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:12.883263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44fd9b-f1c1-4ab9-974e-b06f721ab0a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:12.883563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44fd9b-f1c1-4ab9-974e-b06f721ab0a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:12.884985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44fd9b-f1c1-4ab9-974e-b06f721ab0a3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:12.905229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a74cd8-ff23-47d7-a6e4-d9810476e7a8 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:12.921521 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 280/566] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:12.927691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44fd9b-f1c1-4ab9-974e-b06f721ab0a3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:12.977172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac75f1-9b01-4dbb-82c5-3937c391cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:12.977712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac75f1-9b01-4dbb-82c5-3937c391cb09 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.977992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac75f1-9b01-4dbb-82c5-3937c391cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.978271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac75f1-9b01-4dbb-82c5-3937c391cb09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.100927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44fd9b-f1c1-4ab9-974e-b06f721ab0a3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:13.105884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac75f1-9b01-4dbb-82c5-3937c391cb09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:13.107354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac75f1-9b01-4dbb-82c5-3937c391cb09 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:13.168453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f368e4c-6445-4c36-b9f0-b7c39a70c978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:13.169135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f368e4c-6445-4c36-b9f0-b7c39a70c978 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:13.169418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f368e4c-6445-4c36-b9f0-b7c39a70c978 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:13.169695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f368e4c-6445-4c36-b9f0-b7c39a70c978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.185402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f368e4c-6445-4c36-b9f0-b7c39a70c978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:13.186897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f368e4c-6445-4c36-b9f0-b7c39a70c978 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-0f368e4c-6445-4c36-b9f0-b7c39a70c978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:13.202640 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:13.203592 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:13.205510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:13.205510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:13.205510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:13.205510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:13.205510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:13.205510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:13.205510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:13.205510 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:13.206988 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 281/567] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:13.212823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f368e4c-6445-4c36-b9f0-b7c39a70c978 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:13.216187 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:13.273110 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:13.300561 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 287/568] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 00:29:13.306923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac75f1-9b01-4dbb-82c5-3937c391cb09 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:13.418862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac75f1-9b01-4dbb-82c5-3937c391cb09 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:13.459312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f368e4c-6445-4c36-b9f0-b7c39a70c978 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:13.463999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4c6a7-9938-41a8-bea3-e672ef042b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:13.464661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c6a7-9938-41a8-bea3-e672ef042b96 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:13.465005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c6a7-9938-41a8-bea3-e672ef042b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:13.465285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c6a7-9938-41a8-bea3-e672ef042b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.479902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c6a7-9938-41a8-bea3-e672ef042b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:13.482059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c6a7-9938-41a8-bea3-e672ef042b96 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:13.497015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820ee4e-569b-4e30-9c85-a7eb443ea192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:13.497636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820ee4e-569b-4e30-9c85-a7eb443ea192 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:13.497920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820ee4e-569b-4e30-9c85-a7eb443ea192 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:13.498197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820ee4e-569b-4e30-9c85-a7eb443ea192 None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.498897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820ee4e-569b-4e30-9c85-a7eb443ea192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:13.499201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820ee4e-569b-4e30-9c85-a7eb443ea192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:13.500698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820ee4e-569b-4e30-9c85-a7eb443ea192 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-0ae4c6a7-9938-41a8-bea3-e672ef042b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:13.501224 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:13.502185 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:13.503065 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:13.503065 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:13.503065 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:13.503239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 288/569] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:13.509254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed948c6-f2d5-4cbb-8ca0-2eb6c4f710ed None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:13.509538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed948c6-f2d5-4cbb-8ca0-2eb6c4f710ed None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:13.509816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed948c6-f2d5-4cbb-8ca0-2eb6c4f710ed None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.511398 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 289/570] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:13.512106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed948c6-f2d5-4cbb-8ca0-2eb6c4f710ed None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:13.523332 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 282/571] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:13.524741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91bed0-082d-4429-b78d-7e0766376e8e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:13.525130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91bed0-082d-4429-b78d-7e0766376e8e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:13.525508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91bed0-082d-4429-b78d-7e0766376e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.525744 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:13.546793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-df91bed0-082d-4429-b78d-7e0766376e8e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:13.548754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-df91bed0-082d-4429-b78d-7e0766376e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:13.636739 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 283/572] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:13.637785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91bed0-082d-4429-b78d-7e0766376e8e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:13.667738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed948c6-f2d5-4cbb-8ca0-2eb6c4f710ed None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:13.679922 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:13.746715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c278f-76dc-4c4f-8d46-b4eeefb5ecce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:13.747344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c278f-76dc-4c4f-8d46-b4eeefb5ecce None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:13.747626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c278f-76dc-4c4f-8d46-b4eeefb5ecce None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:13.747901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c278f-76dc-4c4f-8d46-b4eeefb5ecce None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.751021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c278f-76dc-4c4f-8d46-b4eeefb5ecce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:13.751335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c278f-76dc-4c4f-8d46-b4eeefb5ecce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:13.752759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c278f-76dc-4c4f-8d46-b4eeefb5ecce None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:13.785334 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 290/573] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:13.797424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c278f-76dc-4c4f-8d46-b4eeefb5ecce None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:13.852834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91bed0-082d-4429-b78d-7e0766376e8e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:13.901425 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:13.939978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3db0f1-b21f-433b-b9ae-babd7a296256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:13.940652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3db0f1-b21f-433b-b9ae-babd7a296256 None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:13.940944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3db0f1-b21f-433b-b9ae-babd7a296256 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:13.941223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3db0f1-b21f-433b-b9ae-babd7a296256 None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/b9187894d0574f6e887a98b8563b6d32/roles/aceae500b40841d18a66edacfc4a12cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.945610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c278f-76dc-4c4f-8d46-b4eeefb5ecce None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:13.957678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3db0f1-b21f-433b-b9ae-babd7a296256 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=b9187894d0574f6e887a98b8563b6d32, role_id=aceae500b40841d18a66edacfc4a12cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:13.959122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3db0f1-b21f-433b-b9ae-babd7a296256 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:13.974495 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 284/574] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:29:13 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/b9187894d0574f6e887a98b8563b6d32/roles/aceae500b40841d18a66edacfc4a12cf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:29:13.975458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3db0f1-b21f-433b-b9ae-babd7a296256 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:13.989717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067cf3-fdfa-4598-bc20-aac2a51c5925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:13.990397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067cf3-fdfa-4598-bc20-aac2a51c5925 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:13.990878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067cf3-fdfa-4598-bc20-aac2a51c5925 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:13.991158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067cf3-fdfa-4598-bc20-aac2a51c5925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.999543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067cf3-fdfa-4598-bc20-aac2a51c5925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:14.001999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067cf3-fdfa-4598-bc20-aac2a51c5925 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-93067cf3-fdfa-4598-bc20-aac2a51c5925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:14.017096 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:14.018123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:14.019009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:14.019009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:14.019009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:14.019009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:14.019009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:14.019009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:14.019009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:14.019009 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:14.019009 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 291/575] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:14.033947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067cf3-fdfa-4598-bc20-aac2a51c5925 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:14.056825 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:14.094996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3db0f1-b21f-433b-b9ae-babd7a296256 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:14.136766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125b75a-a953-4593-b162-d7c2ec4f0271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:14.137603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125b75a-a953-4593-b162-d7c2ec4f0271 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.137990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125b75a-a953-4593-b162-d7c2ec4f0271 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.139011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125b75a-a953-4593-b162-d7c2ec4f0271 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.139751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125b75a-a953-4593-b162-d7c2ec4f0271 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:14.141899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125b75a-a953-4593-b162-d7c2ec4f0271 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-d125b75a-a953-4593-b162-d7c2ec4f0271 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:14.155888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:14.157153 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:29:14.158088 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:14.162969 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 285/576] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Oct 19 00:29:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:14.164751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125b75a-a953-4593-b162-d7c2ec4f0271 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:14.279264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067cf3-fdfa-4598-bc20-aac2a51c5925 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:14.322449 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:14.342207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23548355-f59b-4224-aab3-1ebc7703d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:14.342992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23548355-f59b-4224-aab3-1ebc7703d70d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.343649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23548355-f59b-4224-aab3-1ebc7703d70d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.343927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23548355-f59b-4224-aab3-1ebc7703d70d None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.345199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23548355-f59b-4224-aab3-1ebc7703d70d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:14.345687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23548355-f59b-4224-aab3-1ebc7703d70d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:14.347898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23548355-f59b-4224-aab3-1ebc7703d70d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:14.352577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125b75a-a953-4593-b162-d7c2ec4f0271 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:14.368728 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 292/577] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:14.371984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2750-95fb-42e7-a798-b89f6e2bd4aa None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.372390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2750-95fb-42e7-a798-b89f6e2bd4aa None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.372787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2750-95fb-42e7-a798-b89f6e2bd4aa None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.374406 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 293/578] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:14.375192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2750-95fb-42e7-a798-b89f6e2bd4aa None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:14.402546 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:14.411469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14857f8-bd9b-4914-a4e2-d620367a3f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:14.412491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14857f8-bd9b-4914-a4e2-d620367a3f8d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.412983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14857f8-bd9b-4914-a4e2-d620367a3f8d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.413438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14857f8-bd9b-4914-a4e2-d620367a3f8d None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.414277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14857f8-bd9b-4914-a4e2-d620367a3f8d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:14.414977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14857f8-bd9b-4914-a4e2-d620367a3f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:14.417405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14857f8-bd9b-4914-a4e2-d620367a3f8d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:14.430560 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 286/579] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 19 00:29:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:14.430560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0ad71-7aa4-4b24-aa91-c1f61c8924ff None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.430560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0ad71-7aa4-4b24-aa91-c1f61c8924ff None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.430902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0ad71-7aa4-4b24-aa91-c1f61c8924ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.451950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bef0ad71-7aa4-4b24-aa91-c1f61c8924ff None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:14.454146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bef0ad71-7aa4-4b24-aa91-c1f61c8924ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:14.534739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2750-95fb-42e7-a798-b89f6e2bd4aa None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:14.573029 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 287/580] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:14.574019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0ad71-7aa4-4b24-aa91-c1f61c8924ff None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:14.587883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a84de6-b166-4afc-9deb-1c59bfd10b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:14.589678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a84de6-b166-4afc-9deb-1c59bfd10b24 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.590220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a84de6-b166-4afc-9deb-1c59bfd10b24 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.590711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a84de6-b166-4afc-9deb-1c59bfd10b24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.591803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a84de6-b166-4afc-9deb-1c59bfd10b24 None admin] RBAC: Adding query filter params (role.id=3c676188d9f646ba8509d3eef1e196de, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=0165e2f8b5e34c8d8570262c777de161) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:14.592360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a84de6-b166-4afc-9deb-1c59bfd10b24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:14.594052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a84de6-b166-4afc-9deb-1c59bfd10b24 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:14.606505 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 294/581] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:14 2022] GET /identity/v3/role_assignments?user.id=0165e2f8b5e34c8d8570262c777de161&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=3c676188d9f646ba8509d3eef1e196de => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:14.656678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa71e5-7858-4d1f-ae11-bbce3ff78d8b None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.657129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa71e5-7858-4d1f-ae11-bbce3ff78d8b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.657261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa71e5-7858-4d1f-ae11-bbce3ff78d8b None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.658934 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 295/582] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:14.664932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ac79-74a0-4586-a91a-6d96b3fa2421 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.665259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ac79-74a0-4586-a91a-6d96b3fa2421 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.665489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ac79-74a0-4586-a91a-6d96b3fa2421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.695871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f8f4ac79-74a0-4586-a91a-6d96b3fa2421 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:14.697505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8f4ac79-74a0-4586-a91a-6d96b3fa2421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:14.755974 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:14.782805 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 296/583] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:14.789542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0ad71-7aa4-4b24-aa91-c1f61c8924ff None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:14.819481 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:14.830389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6906d54-22a2-4d5c-ae21-545252a186d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:14.830937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6906d54-22a2-4d5c-ae21-545252a186d2 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.831216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6906d54-22a2-4d5c-ae21-545252a186d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.831490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6906d54-22a2-4d5c-ae21-545252a186d2 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.832137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6906d54-22a2-4d5c-ae21-545252a186d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:14.832440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6906d54-22a2-4d5c-ae21-545252a186d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:14.833890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6906d54-22a2-4d5c-ae21-545252a186d2 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:14.841167 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 288/584] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 19 00:29:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:14.847206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ac79-74a0-4586-a91a-6d96b3fa2421 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:14.956372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6906d54-22a2-4d5c-ae21-545252a186d2 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:14.971521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ac79-74a0-4586-a91a-6d96b3fa2421 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:15.018157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5eef3-5f53-4e34-b67d-3c7065fc15b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:15.018783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5eef3-5f53-4e34-b67d-3c7065fc15b2 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:15.019065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5eef3-5f53-4e34-b67d-3c7065fc15b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:15.019339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5eef3-5f53-4e34-b67d-3c7065fc15b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:15.020295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5eef3-5f53-4e34-b67d-3c7065fc15b2 None admin] RBAC: Adding query filter params (interface=public, service_id=f04118ec9a0e4559ad676f2b6ada8daf, region_id=RegionOne) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:15.020604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5eef3-5f53-4e34-b67d-3c7065fc15b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:15.022623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5eef3-5f53-4e34-b67d-3c7065fc15b2 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:15.038098 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 297/585] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 19 00:29:14 2022] GET /identity/v3/endpoints?service_id=f04118ec9a0e4559ad676f2b6ada8daf&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:15.044603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5eef3-5f53-4e34-b67d-3c7065fc15b2 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:15.101062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6906d54-22a2-4d5c-ae21-545252a186d2 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:15.114423 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:15.140198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a0d4-bdbb-48b0-81dc-3249171d45d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:15.142312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a0d4-bdbb-48b0-81dc-3249171d45d8 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:15.142881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a0d4-bdbb-48b0-81dc-3249171d45d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:15.143341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a0d4-bdbb-48b0-81dc-3249171d45d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:15.144152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699a0d4-bdbb-48b0-81dc-3249171d45d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:15.145814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699a0d4-bdbb-48b0-81dc-3249171d45d8 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-2699a0d4-bdbb-48b0-81dc-3249171d45d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:15.156177 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:15.158543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:29:15.159429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:15.162384 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 289/586] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:14 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:15.163494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a0d4-bdbb-48b0-81dc-3249171d45d8 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:15.178829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5eef3-5f53-4e34-b67d-3c7065fc15b2 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:15.220680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00e3ff-85c1-4fe0-85ae-309202b6b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:15.221504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00e3ff-85c1-4fe0-85ae-309202b6b68d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:15.221884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00e3ff-85c1-4fe0-85ae-309202b6b68d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:15.222242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00e3ff-85c1-4fe0-85ae-309202b6b68d None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:15.222929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00e3ff-85c1-4fe0-85ae-309202b6b68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:15.224719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00e3ff-85c1-4fe0-85ae-309202b6b68d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:15.230883 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:15.231480 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 298/587] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 19 00:29:15 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:15.233148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00e3ff-85c1-4fe0-85ae-309202b6b68d None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:15.297810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a0d4-bdbb-48b0-81dc-3249171d45d8 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:15.340421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd92d1e-7079-4454-96b6-637b5af9b865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:15.341033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92d1e-7079-4454-96b6-637b5af9b865 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:15.341318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92d1e-7079-4454-96b6-637b5af9b865 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:15.341589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92d1e-7079-4454-96b6-637b5af9b865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:15.355045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd92d1e-7079-4454-96b6-637b5af9b865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-cfd92d1e-7079-4454-96b6-637b5af9b865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:15.361278 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:15.362292 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:15.363144 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 290/588] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:15.368473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd92d1e-7079-4454-96b6-637b5af9b865 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:15.465363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00e3ff-85c1-4fe0-85ae-309202b6b68d None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:15.482563 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:15.514198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd92d1e-7079-4454-96b6-637b5af9b865 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:15.530890 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:15.543843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b429cf-6ae5-4b2a-9292-0468edc8f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:15.544649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b429cf-6ae5-4b2a-9292-0468edc8f421 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:15.545029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b429cf-6ae5-4b2a-9292-0468edc8f421 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:15.545426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b429cf-6ae5-4b2a-9292-0468edc8f421 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:15.546171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b429cf-6ae5-4b2a-9292-0468edc8f421 None admin] RBAC: Adding query filter params (name=network) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:15.546582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b429cf-6ae5-4b2a-9292-0468edc8f421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:15.548880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b429cf-6ae5-4b2a-9292-0468edc8f421 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:15.561958 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 299/589] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:15.567643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8aaddb-679f-4652-8e86-ff8b49083699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:15.567971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b429cf-6ae5-4b2a-9292-0468edc8f421 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:15.569153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aaddb-679f-4652-8e86-ff8b49083699 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:15.569816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aaddb-679f-4652-8e86-ff8b49083699 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:15.570495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aaddb-679f-4652-8e86-ff8b49083699 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:15.571942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8aaddb-679f-4652-8e86-ff8b49083699 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:15.572689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8aaddb-679f-4652-8e86-ff8b49083699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:15.575349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8aaddb-679f-4652-8e86-ff8b49083699 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:15.591832 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 291/590] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:29:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:15.598885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8aaddb-679f-4652-8e86-ff8b49083699 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:15.834917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8aaddb-679f-4652-8e86-ff8b49083699 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:15.846279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b429cf-6ae5-4b2a-9292-0468edc8f421 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:15.875091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1316f-9bd1-47e8-bfae-1dc62c6d3e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:15.876072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1316f-9bd1-47e8-bfae-1dc62c6d3e6b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:15.876507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1316f-9bd1-47e8-bfae-1dc62c6d3e6b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:15.876983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1316f-9bd1-47e8-bfae-1dc62c6d3e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:15.900293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1316f-9bd1-47e8-bfae-1dc62c6d3e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:15.902666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1316f-9bd1-47e8-bfae-1dc62c6d3e6b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:15.922156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ce9c5-4479-4c14-b266-dce2d3c88d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:15.922156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ce9c5-4479-4c14-b266-dce2d3c88d3f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:15.922156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ce9c5-4479-4c14-b266-dce2d3c88d3f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:15.922156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ce9c5-4479-4c14-b266-dce2d3c88d3f None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:15.923905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ce9c5-4479-4c14-b266-dce2d3c88d3f None admin] RBAC: Adding query filter params (type=network) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:15.924214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ce9c5-4479-4c14-b266-dce2d3c88d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-c4f1316f-9bd1-47e8-bfae-1dc62c6d3e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:15.926877 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:15.928019 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:15.929170 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:15.929170 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:15.929170 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:15.929720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ce9c5-4479-4c14-b266-dce2d3c88d3f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:15.931119 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 292/591] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:15.936251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1316f-9bd1-47e8-bfae-1dc62c6d3e6b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:15.938574 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 300/592] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:15.944554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ce9c5-4479-4c14-b266-dce2d3c88d3f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:15.970810 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:16.033650 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:16.070761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1316f-9bd1-47e8-bfae-1dc62c6d3e6b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:16.111897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3bf8d-e8b5-425e-942f-a4fc552d9126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:16.112432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3bf8d-e8b5-425e-942f-a4fc552d9126 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:16.112732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3bf8d-e8b5-425e-942f-a4fc552d9126 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:16.113015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3bf8d-e8b5-425e-942f-a4fc552d9126 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:16.113665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3bf8d-e8b5-425e-942f-a4fc552d9126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:16.113967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3bf8d-e8b5-425e-942f-a4fc552d9126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:16.115329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3bf8d-e8b5-425e-942f-a4fc552d9126 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:16.142244 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 293/593] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:16.147102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3bf8d-e8b5-425e-942f-a4fc552d9126 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:16.176745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ce9c5-4479-4c14-b266-dce2d3c88d3f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:16.242333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0389b51-fb6d-4bcc-9219-d294ae62388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:16.242966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0389b51-fb6d-4bcc-9219-d294ae62388f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:16.243250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0389b51-fb6d-4bcc-9219-d294ae62388f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:16.243528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0389b51-fb6d-4bcc-9219-d294ae62388f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:16.244241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0389b51-fb6d-4bcc-9219-d294ae62388f None admin] RBAC: Adding query filter params (interface=public, service_id=ac5283a5dc734b0188e121e98a2e1aa9, region_id=RegionOne) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:16.244551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0389b51-fb6d-4bcc-9219-d294ae62388f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:16.245966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0389b51-fb6d-4bcc-9219-d294ae62388f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:16.259079 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 301/594] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 19 00:29:15 2022] GET /identity/v3/endpoints?service_id=ac5283a5dc734b0188e121e98a2e1aa9&interface=public®ion_id=RegionOne => generated 194 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:16.264816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0389b51-fb6d-4bcc-9219-d294ae62388f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:16.281051 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:16.295925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3bf8d-e8b5-425e-942f-a4fc552d9126 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:16.335239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de216-7975-4472-9374-2b338ce8f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:16.335949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de216-7975-4472-9374-2b338ce8f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:16.336220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de216-7975-4472-9374-2b338ce8f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:16.336501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de216-7975-4472-9374-2b338ce8f9d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:16.345753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de216-7975-4472-9374-2b338ce8f9d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:16.347414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de216-7975-4472-9374-2b338ce8f9d1 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-e86de216-7975-4472-9374-2b338ce8f9d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:16.360236 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:16.362516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:16.364698 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 294/595] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:16.371630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de216-7975-4472-9374-2b338ce8f9d1 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:16.519004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0389b51-fb6d-4bcc-9219-d294ae62388f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:16.519456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de216-7975-4472-9374-2b338ce8f9d1 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:16.521427 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:16.560422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbde01a-191e-4d28-8593-54c1528925b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:16.561372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde01a-191e-4d28-8593-54c1528925b8 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:16.561871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde01a-191e-4d28-8593-54c1528925b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:16.562394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde01a-191e-4d28-8593-54c1528925b8 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:16.563385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbde01a-191e-4d28-8593-54c1528925b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:16.563920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbde01a-191e-4d28-8593-54c1528925b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:16.565887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbde01a-191e-4d28-8593-54c1528925b8 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:16.586565 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 295/596] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 19 00:29:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:16.595321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbde01a-191e-4d28-8593-54c1528925b8 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:16.597955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b5bcd-360b-44ee-9543-5fe64ef68bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:16.599106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b5bcd-360b-44ee-9543-5fe64ef68bf0 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:16.599584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b5bcd-360b-44ee-9543-5fe64ef68bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:16.600150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b5bcd-360b-44ee-9543-5fe64ef68bf0 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:16.601028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b5bcd-360b-44ee-9543-5fe64ef68bf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:16.602685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b5bcd-360b-44ee-9543-5fe64ef68bf0 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:16.609740 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 302/597] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 19 00:29:16 2022] GET /identity/v3/services => generated 772 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:16.619446 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:16.768282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdb159-d453-4575-93c4-04748ff73713 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:16.768987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdb159-d453-4575-93c4-04748ff73713 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:16.769469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdb159-d453-4575-93c4-04748ff73713 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:16.771278 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 303/598] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:29:16.778624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d1b4-933b-491b-a543-54462ff50779 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:16.779237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d1b4-933b-491b-a543-54462ff50779 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:16.779889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d1b4-933b-491b-a543-54462ff50779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:16.803446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-20d3d1b4-933b-491b-a543-54462ff50779 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:16.805791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-20d3d1b4-933b-491b-a543-54462ff50779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:16.817290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbde01a-191e-4d28-8593-54c1528925b8 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:16.893546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 304/599] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:16.930000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01c38-595f-4280-a1e3-33856e9eae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:16.930632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01c38-595f-4280-a1e3-33856e9eae41 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:16.930914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01c38-595f-4280-a1e3-33856e9eae41 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:16.931190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01c38-595f-4280-a1e3-33856e9eae41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.013647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd01c38-595f-4280-a1e3-33856e9eae41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:17.015100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd01c38-595f-4280-a1e3-33856e9eae41 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:17.023959 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:17.138082 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 296/600] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:29:17.144851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3d1b4-933b-491b-a543-54462ff50779 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:17.268013 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:17.274949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3d1b4-933b-491b-a543-54462ff50779 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:17.277433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01c38-595f-4280-a1e3-33856e9eae41 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:17.317090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aaa1c-f326-49ea-938e-3f681d47c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:17.317736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aaa1c-f326-49ea-938e-3f681d47c7ca None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.318013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aaa1c-f326-49ea-938e-3f681d47c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.318285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aaa1c-f326-49ea-938e-3f681d47c7ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.329906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144aaa1c-f326-49ea-938e-3f681d47c7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:17.331532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144aaa1c-f326-49ea-938e-3f681d47c7ca None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-144aaa1c-f326-49ea-938e-3f681d47c7ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:17.349413 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:17.350438 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:17.352011 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:17.352011 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:17.352011 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:17.352011 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 305/601] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:17.356700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aaa1c-f326-49ea-938e-3f681d47c7ca None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:17.475680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01c38-595f-4280-a1e3-33856e9eae41 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:17.483493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aaa1c-f326-49ea-938e-3f681d47c7ca None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:17.486253 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:17.529718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894e360-71b2-488a-ac6a-6f5d496d7a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:17.530385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e360-71b2-488a-ac6a-6f5d496d7a65 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.530655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e360-71b2-488a-ac6a-6f5d496d7a65 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.530926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e360-71b2-488a-ac6a-6f5d496d7a65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.532615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd503170-db23-48a4-b3cc-5a42fbd5942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:17.533724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503170-db23-48a4-b3cc-5a42fbd5942e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.534308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503170-db23-48a4-b3cc-5a42fbd5942e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.534780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503170-db23-48a4-b3cc-5a42fbd5942e None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.535660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503170-db23-48a4-b3cc-5a42fbd5942e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:17.536192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503170-db23-48a4-b3cc-5a42fbd5942e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:17.538077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503170-db23-48a4-b3cc-5a42fbd5942e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:17.544238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894e360-71b2-488a-ac6a-6f5d496d7a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-f894e360-71b2-488a-ac6a-6f5d496d7a65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:17.551243 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:17.552316 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:17.553215 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 297/602] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:17.561272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebefb3-4d64-47bc-beb1-b5cdd53ef07f None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.561272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebefb3-4d64-47bc-beb1-b5cdd53ef07f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.561272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebefb3-4d64-47bc-beb1-b5cdd53ef07f None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.561272 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 298/603] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:17.561272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebefb3-4d64-47bc-beb1-b5cdd53ef07f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:17.564807 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 306/604] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:17.567477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc51688-36ae-49e0-911f-edda7e0dcbcc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.568112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc51688-36ae-49e0-911f-edda7e0dcbcc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.568586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc51688-36ae-49e0-911f-edda7e0dcbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.591603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5cc51688-36ae-49e0-911f-edda7e0dcbcc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:17.593363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cc51688-36ae-49e0-911f-edda7e0dcbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:17.596496 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:17.692947 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 307/605] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:17.693681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc51688-36ae-49e0-911f-edda7e0dcbcc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:17.696238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebefb3-4d64-47bc-beb1-b5cdd53ef07f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:17.810109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed482a1-fcbb-493a-9f9c-ac5e84669a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:17.810655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed482a1-fcbb-493a-9f9c-ac5e84669a38 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.810933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed482a1-fcbb-493a-9f9c-ac5e84669a38 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.811211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed482a1-fcbb-493a-9f9c-ac5e84669a38 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.811887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed482a1-fcbb-493a-9f9c-ac5e84669a38 None admin] RBAC: Adding query filter params (name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:17.812192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed482a1-fcbb-493a-9f9c-ac5e84669a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:17.814167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed482a1-fcbb-493a-9f9c-ac5e84669a38 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:17.835998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc51688-36ae-49e0-911f-edda7e0dcbcc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:17.847026 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 299/606] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:17.852824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed482a1-fcbb-493a-9f9c-ac5e84669a38 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:17.873287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d23a0-b04d-4dc0-9404-30f4c4947490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:17.873923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d23a0-b04d-4dc0-9404-30f4c4947490 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.874198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d23a0-b04d-4dc0-9404-30f4c4947490 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.874471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d23a0-b04d-4dc0-9404-30f4c4947490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.882772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d23a0-b04d-4dc0-9404-30f4c4947490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:17.884248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d23a0-b04d-4dc0-9404-30f4c4947490 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:17.886175 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-897d23a0-b04d-4dc0-9404-30f4c4947490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:17.898454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:17.899450 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:17.900347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:17.900347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:17.900347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:17.900347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:17.900347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:17.900347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:17.900347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:17.900347 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:17.906205 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 308/607] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:17.907935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcbcfb-3075-422e-ab24-e8747b5ec6c1 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.908255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcbcfb-3075-422e-ab24-e8747b5ec6c1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.908489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcbcfb-3075-422e-ab24-e8747b5ec6c1 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.910049 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 309/608] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:17.912659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcbcfb-3075-422e-ab24-e8747b5ec6c1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:17.925476 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:18.022149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed482a1-fcbb-493a-9f9c-ac5e84669a38 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.036318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcbcfb-3075-422e-ab24-e8747b5ec6c1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.059554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a645fc-6ff7-4c23-9663-bc6f85101d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.060243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a645fc-6ff7-4c23-9663-bc6f85101d63 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.060527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a645fc-6ff7-4c23-9663-bc6f85101d63 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.060819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a645fc-6ff7-4c23-9663-bc6f85101d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.073064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a645fc-6ff7-4c23-9663-bc6f85101d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.073819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e388876-59bb-49cb-bda2-c18fe8b7b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.074433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e388876-59bb-49cb-bda2-c18fe8b7b76f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.074611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a645fc-6ff7-4c23-9663-bc6f85101d63 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.074708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e388876-59bb-49cb-bda2-c18fe8b7b76f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.074982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e388876-59bb-49cb-bda2-c18fe8b7b76f None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.075671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e388876-59bb-49cb-bda2-c18fe8b7b76f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:18.075978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e388876-59bb-49cb-bda2-c18fe8b7b76f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.077432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e388876-59bb-49cb-bda2-c18fe8b7b76f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-63a645fc-6ff7-4c23-9663-bc6f85101d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:18.089741 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:18.090726 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:18.091628 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:18.091628 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:18.091628 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:18.097968 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 310/609] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:18.097968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53de7c-8c4e-43db-9ae3-4a4445a29d5f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.097968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53de7c-8c4e-43db-9ae3-4a4445a29d5f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.097968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53de7c-8c4e-43db-9ae3-4a4445a29d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.098708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 300/610] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:18.099920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a645fc-6ff7-4c23-9663-bc6f85101d63 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.115109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cd53de7c-8c4e-43db-9ae3-4a4445a29d5f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:18.116498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd53de7c-8c4e-43db-9ae3-4a4445a29d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:18.173376 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:18.192993 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 311/611] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:18.192993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53de7c-8c4e-43db-9ae3-4a4445a29d5f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.196400 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:18.225388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a645fc-6ff7-4c23-9663-bc6f85101d63 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.263701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf486ce-a0fe-482f-b1b3-da4d4021e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.264342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf486ce-a0fe-482f-b1b3-da4d4021e175 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.264652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf486ce-a0fe-482f-b1b3-da4d4021e175 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.264974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf486ce-a0fe-482f-b1b3-da4d4021e175 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.265673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf486ce-a0fe-482f-b1b3-da4d4021e175 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.267858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf486ce-a0fe-482f-b1b3-da4d4021e175 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-3cf486ce-a0fe-482f-b1b3-da4d4021e175 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:18.277743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:18.279366 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:29:18.280303 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:18.283905 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 301/612] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:18.284836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf486ce-a0fe-482f-b1b3-da4d4021e175 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.319887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53de7c-8c4e-43db-9ae3-4a4445a29d5f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.361708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6caa63-436d-4e81-b036-34501051466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.362418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6caa63-436d-4e81-b036-34501051466d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.362771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6caa63-436d-4e81-b036-34501051466d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.363211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6caa63-436d-4e81-b036-34501051466d None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.363932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6caa63-436d-4e81-b036-34501051466d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:18.365043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6caa63-436d-4e81-b036-34501051466d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.365907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6caa63-436d-4e81-b036-34501051466d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.378414 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 312/613] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:18.379347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6caa63-436d-4e81-b036-34501051466d None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.397383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf486ce-a0fe-482f-b1b3-da4d4021e175 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.436238 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:18.437246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51650a-2d92-453a-8ba8-70ac5f6dda94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.438823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51650a-2d92-453a-8ba8-70ac5f6dda94 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.439352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51650a-2d92-453a-8ba8-70ac5f6dda94 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.439834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51650a-2d92-453a-8ba8-70ac5f6dda94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.440818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51650a-2d92-453a-8ba8-70ac5f6dda94 None admin] RBAC: Adding query filter params (role.id=3c676188d9f646ba8509d3eef1e196de, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=54b7394a5d944639b1253d5d54b688e2) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:18.441340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51650a-2d92-453a-8ba8-70ac5f6dda94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.443005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51650a-2d92-453a-8ba8-70ac5f6dda94 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.449892 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 302/614] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/role_assignments?user.id=54b7394a5d944639b1253d5d54b688e2&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=3c676188d9f646ba8509d3eef1e196de => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:18.450979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51650a-2d92-453a-8ba8-70ac5f6dda94 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.473317 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:18.522139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6caa63-436d-4e81-b036-34501051466d None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.573408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51650a-2d92-453a-8ba8-70ac5f6dda94 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.575416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff3d2e-d0be-478b-9cda-f2cc617fb905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.576282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3d2e-d0be-478b-9cda-f2cc617fb905 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.576565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3d2e-d0be-478b-9cda-f2cc617fb905 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.576908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3d2e-d0be-478b-9cda-f2cc617fb905 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.578749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff3d2e-d0be-478b-9cda-f2cc617fb905 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:18.579174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff3d2e-d0be-478b-9cda-f2cc617fb905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.580613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff3d2e-d0be-478b-9cda-f2cc617fb905 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.588788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 313/615] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:18.590065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff3d2e-d0be-478b-9cda-f2cc617fb905 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.621160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994f4f6-1eda-49dc-95a0-43bb5f1d85b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.622238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994f4f6-1eda-49dc-95a0-43bb5f1d85b4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.622728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994f4f6-1eda-49dc-95a0-43bb5f1d85b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.623251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994f4f6-1eda-49dc-95a0-43bb5f1d85b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.633280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994f4f6-1eda-49dc-95a0-43bb5f1d85b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.635109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994f4f6-1eda-49dc-95a0-43bb5f1d85b4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-3994f4f6-1eda-49dc-95a0-43bb5f1d85b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:18.648491 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:18.649683 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:29:18.650651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:18.653420 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 303/616] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:18.654584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994f4f6-1eda-49dc-95a0-43bb5f1d85b4 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.729641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff3d2e-d0be-478b-9cda-f2cc617fb905 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.746621 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:18.752235 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:18.787791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994f4f6-1eda-49dc-95a0-43bb5f1d85b4 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.789913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c558bcf-792b-47b3-b1cd-70f00e970e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.791735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c558bcf-792b-47b3-b1cd-70f00e970e93 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.792233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c558bcf-792b-47b3-b1cd-70f00e970e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.792764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c558bcf-792b-47b3-b1cd-70f00e970e93 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.793567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c558bcf-792b-47b3-b1cd-70f00e970e93 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.795165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c558bcf-792b-47b3-b1cd-70f00e970e93 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-7c558bcf-792b-47b3-b1cd-70f00e970e93 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:18.808473 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:18.809579 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:18.810417 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 314/617] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:18.811277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c558bcf-792b-47b3-b1cd-70f00e970e93 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.834361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f0655-db98-4058-87be-90a564517fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.835366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f0655-db98-4058-87be-90a564517fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.835927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f0655-db98-4058-87be-90a564517fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.836481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f0655-db98-4058-87be-90a564517fe6 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.837886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f0655-db98-4058-87be-90a564517fe6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:18.838835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f0655-db98-4058-87be-90a564517fe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.840883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f0655-db98-4058-87be-90a564517fe6 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.848848 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 304/618] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:18.850118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f0655-db98-4058-87be-90a564517fe6 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.922235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c558bcf-792b-47b3-b1cd-70f00e970e93 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.963638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56e48-77b7-48bb-8336-4397d48f3c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.964189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56e48-77b7-48bb-8336-4397d48f3c17 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.964470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56e48-77b7-48bb-8336-4397d48f3c17 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.964796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56e48-77b7-48bb-8336-4397d48f3c17 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.965530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c56e48-77b7-48bb-8336-4397d48f3c17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:18.965834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c56e48-77b7-48bb-8336-4397d48f3c17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.967390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c56e48-77b7-48bb-8336-4397d48f3c17 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.987522 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 315/619] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:18.992991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56e48-77b7-48bb-8336-4397d48f3c17 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:18.998588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f0655-db98-4058-87be-90a564517fe6 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:19.067634 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:19.078047 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:19.081084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706406fd-1bc5-4d5c-a9b9-3d229301694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:19.082924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706406fd-1bc5-4d5c-a9b9-3d229301694d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:19.085082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706406fd-1bc5-4d5c-a9b9-3d229301694d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:19.088592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706406fd-1bc5-4d5c-a9b9-3d229301694d None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:19.089642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706406fd-1bc5-4d5c-a9b9-3d229301694d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:19.090178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706406fd-1bc5-4d5c-a9b9-3d229301694d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:19.091815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706406fd-1bc5-4d5c-a9b9-3d229301694d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:19.103946 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 305/620] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:19.111773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706406fd-1bc5-4d5c-a9b9-3d229301694d None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:19.198190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56e48-77b7-48bb-8336-4397d48f3c17 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:19.258885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f3bd3-c10b-4c9a-8f6d-c26874d8f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:19.259511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f3bd3-c10b-4c9a-8f6d-c26874d8f092 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:19.259789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f3bd3-c10b-4c9a-8f6d-c26874d8f092 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:19.260326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f3bd3-c10b-4c9a-8f6d-c26874d8f092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:19.277126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706406fd-1bc5-4d5c-a9b9-3d229301694d None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:19.313357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64812f-7dee-4ac3-bd73-a66f5b657dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:19.313989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64812f-7dee-4ac3-bd73-a66f5b657dac None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:19.314308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64812f-7dee-4ac3-bd73-a66f5b657dac None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:19.314591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64812f-7dee-4ac3-bd73-a66f5b657dac None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:19.315258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64812f-7dee-4ac3-bd73-a66f5b657dac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:19.315568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64812f-7dee-4ac3-bd73-a66f5b657dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:19.316979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64812f-7dee-4ac3-bd73-a66f5b657dac None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:19.322279 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 306/621] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 19 00:29:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:19.323653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8512a-c810-4a85-93b7-963785e1f9e7 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:19.323941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8512a-c810-4a85-93b7-963785e1f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:19.324219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8512a-c810-4a85-93b7-963785e1f9e7 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:19.329813 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 307/622] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:19.330712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8512a-c810-4a85-93b7-963785e1f9e7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:19.349642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f3bd3-c10b-4c9a-8f6d-c26874d8f092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:19.351691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f3bd3-c10b-4c9a-8f6d-c26874d8f092 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:19.397611 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:19.400747 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:19.444298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8512a-c810-4a85-93b7-963785e1f9e7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:19.481851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8a3d2-224c-43ec-9aad-267f838b83b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:19.482490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8a3d2-224c-43ec-9aad-267f838b83b1 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:19.482770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8a3d2-224c-43ec-9aad-267f838b83b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:19.483050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8a3d2-224c-43ec-9aad-267f838b83b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:19.483726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8a3d2-224c-43ec-9aad-267f838b83b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:19.485208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8a3d2-224c-43ec-9aad-267f838b83b1 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:19.498498 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 316/623] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:29:19.499873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c3d1-d100-4966-b17e-bd03a1a13a87 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:19.500159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c3d1-d100-4966-b17e-bd03a1a13a87 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:19.500991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c3d1-d100-4966-b17e-bd03a1a13a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:19.526956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6410c3d1-d100-4966-b17e-bd03a1a13a87 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:19.528273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6410c3d1-d100-4966-b17e-bd03a1a13a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:19.528495 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 308/624] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:29:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:19.529367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8a3d2-224c-43ec-9aad-267f838b83b1 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:19.673342 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 317/625] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:19.737061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8a3d2-224c-43ec-9aad-267f838b83b1 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:19.768378 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:19.792995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17c930-2c9a-4d03-ab3e-9ff5a61d537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:19.793642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17c930-2c9a-4d03-ab3e-9ff5a61d537e None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:19.793937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17c930-2c9a-4d03-ab3e-9ff5a61d537e None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:19.794206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17c930-2c9a-4d03-ab3e-9ff5a61d537e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:19.806332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17c930-2c9a-4d03-ab3e-9ff5a61d537e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:19.807975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17c930-2c9a-4d03-ab3e-9ff5a61d537e None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-0e17c930-2c9a-4d03-ab3e-9ff5a61d537e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:19.823681 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:19.824757 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:19.825651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:19.825651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:19.825651 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:19.825651 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 309/626] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:19.832236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410c3d1-d100-4966-b17e-bd03a1a13a87 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:19.940946 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:20.017980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410c3d1-d100-4966-b17e-bd03a1a13a87 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:20.069451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21864-5fae-4d60-80a0-9cb77c05ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:20.070070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21864-5fae-4d60-80a0-9cb77c05ce97 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.070355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21864-5fae-4d60-80a0-9cb77c05ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.070629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21864-5fae-4d60-80a0-9cb77c05ce97 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:20.071278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b21864-5fae-4d60-80a0-9cb77c05ce97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:20.071579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b21864-5fae-4d60-80a0-9cb77c05ce97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:20.072984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b21864-5fae-4d60-80a0-9cb77c05ce97 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:20.092382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 318/627] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:20.098561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17c930-2c9a-4d03-ab3e-9ff5a61d537e None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:20.121072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21864-5fae-4d60-80a0-9cb77c05ce97 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:20.281084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17c930-2c9a-4d03-ab3e-9ff5a61d537e None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:20.313706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21864-5fae-4d60-80a0-9cb77c05ce97 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:20.351436 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:20.356835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f1903-43d1-4e11-8941-31fd0a09392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:20.358237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1903-43d1-4e11-8941-31fd0a09392b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.358798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1903-43d1-4e11-8941-31fd0a09392b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.359429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1903-43d1-4e11-8941-31fd0a09392b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:20.370616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f1903-43d1-4e11-8941-31fd0a09392b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:20.373208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f1903-43d1-4e11-8941-31fd0a09392b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:20.388835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474ab01-a8ca-4af4-b7cb-ab6d6d1f6787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:20.389899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474ab01-a8ca-4af4-b7cb-ab6d6d1f6787 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.390618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474ab01-a8ca-4af4-b7cb-ab6d6d1f6787 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.391224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474ab01-a8ca-4af4-b7cb-ab6d6d1f6787 None admin] PATH_INFO: `/v3/services/network` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:20.392194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474ab01-a8ca-4af4-b7cb-ab6d6d1f6787 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:20.394590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474ab01-a8ca-4af4-b7cb-ab6d6d1f6787 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-936f1903-43d1-4e11-8941-31fd0a09392b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:20.401832 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:20.402763 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:20.403655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:20.403655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:20.403655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:20.403655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:20.403655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:20.403655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:20.403655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:20.403655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:20.407117 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 310/628] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:20.413207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f1903-43d1-4e11-8941-31fd0a09392b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-7474ab01-a8ca-4af4-b7cb-ab6d6d1f6787 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:20.417365 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:20.418451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:29:20.419299 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:20.424302 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 319/629] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:20 2022] GET /identity/v3/services/network => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:20.436547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474ab01-a8ca-4af4-b7cb-ab6d6d1f6787 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:20.473930 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:20.560549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f1903-43d1-4e11-8941-31fd0a09392b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:20.605551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac10e85-7ab5-4222-999c-50738713affe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:20.606546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac10e85-7ab5-4222-999c-50738713affe None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.608543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac10e85-7ab5-4222-999c-50738713affe None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.609061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac10e85-7ab5-4222-999c-50738713affe None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:20.610664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac10e85-7ab5-4222-999c-50738713affe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:20.612632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac10e85-7ab5-4222-999c-50738713affe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:20.614770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac10e85-7ab5-4222-999c-50738713affe None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:20.645510 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 311/630] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:20.651740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac10e85-7ab5-4222-999c-50738713affe None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:20.708779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474ab01-a8ca-4af4-b7cb-ab6d6d1f6787 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:20.798045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47531f8-123f-44dd-b245-35fd2b6ba7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:20.798677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47531f8-123f-44dd-b245-35fd2b6ba7b5 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.798953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47531f8-123f-44dd-b245-35fd2b6ba7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.799223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47531f8-123f-44dd-b245-35fd2b6ba7b5 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:20.799868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47531f8-123f-44dd-b245-35fd2b6ba7b5 None admin] RBAC: Adding query filter params (name=network) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:20.800161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47531f8-123f-44dd-b245-35fd2b6ba7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:20.801807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47531f8-123f-44dd-b245-35fd2b6ba7b5 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:20.809111 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:20.815610 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 320/631] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:20.821081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47531f8-123f-44dd-b245-35fd2b6ba7b5 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:20.827511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac10e85-7ab5-4222-999c-50738713affe None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:20.876266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e144f9b-e708-4b41-a19f-81b7c7a1f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:20.877312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e144f9b-e708-4b41-a19f-81b7c7a1f00c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.879393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e144f9b-e708-4b41-a19f-81b7c7a1f00c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.879889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e144f9b-e708-4b41-a19f-81b7c7a1f00c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:20.880885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e144f9b-e708-4b41-a19f-81b7c7a1f00c None admin] RBAC: Adding query filter params (role.id=aceae500b40841d18a66edacfc4a12cf, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=b9187894d0574f6e887a98b8563b6d32) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:20.882571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e144f9b-e708-4b41-a19f-81b7c7a1f00c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:20.886754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e144f9b-e708-4b41-a19f-81b7c7a1f00c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:20.898581 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 312/632] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:20 2022] GET /identity/v3/role_assignments?user.id=b9187894d0574f6e887a98b8563b6d32&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=aceae500b40841d18a66edacfc4a12cf => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:20.933083 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:20.963443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e643d-f06a-4dbb-8ae4-858f9b996189 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.963792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e643d-f06a-4dbb-8ae4-858f9b996189 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.963998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e643d-f06a-4dbb-8ae4-858f9b996189 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:20.965678 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 313/633] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:20.973931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbb03e-93c3-41f4-b938-67983ed900e6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.974257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbb03e-93c3-41f4-b938-67983ed900e6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.974489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbb03e-93c3-41f4-b938-67983ed900e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:21.005753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47531f8-123f-44dd-b245-35fd2b6ba7b5 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:21.041902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-76fbb03e-93c3-41f4-b938-67983ed900e6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:21.046638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ffd83-bfc6-429d-bdc7-d752093202ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:21.047339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ffd83-bfc6-429d-bdc7-d752093202ca None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:21.047623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ffd83-bfc6-429d-bdc7-d752093202ca None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:21.047903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ffd83-bfc6-429d-bdc7-d752093202ca None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:21.048609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ffd83-bfc6-429d-bdc7-d752093202ca None admin] RBAC: Adding query filter params (type=network) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:21.048889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ffd83-bfc6-429d-bdc7-d752093202ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:21.049110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-76fbb03e-93c3-41f4-b938-67983ed900e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:21.050290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ffd83-bfc6-429d-bdc7-d752093202ca None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:21.057902 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 321/634] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:21.065837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ffd83-bfc6-429d-bdc7-d752093202ca None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:21.186932 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 314/635] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:21.238785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ffd83-bfc6-429d-bdc7-d752093202ca None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:21.253317 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:21.279864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50915990-84b4-4f00-b209-7fec26f0f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:21.280522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50915990-84b4-4f00-b209-7fec26f0f2fd None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:21.280829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50915990-84b4-4f00-b209-7fec26f0f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:21.281101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50915990-84b4-4f00-b209-7fec26f0f2fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:21.282358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50915990-84b4-4f00-b209-7fec26f0f2fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:21.283741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50915990-84b4-4f00-b209-7fec26f0f2fd None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:21.312489 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 322/636] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:29:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:21.480392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbb03e-93c3-41f4-b938-67983ed900e6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:21.503774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2113a1-8f4a-4675-9e50-c6c08403abd7 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:21.504134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2113a1-8f4a-4675-9e50-c6c08403abd7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:21.504359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2113a1-8f4a-4675-9e50-c6c08403abd7 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:21.506079 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 323/637] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:21.511407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f1289-d253-4f2e-8afb-0a51f62030fa None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:21.511691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f1289-d253-4f2e-8afb-0a51f62030fa None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:21.511959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f1289-d253-4f2e-8afb-0a51f62030fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:21.531142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3f5f1289-d253-4f2e-8afb-0a51f62030fa None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:21.532436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3f5f1289-d253-4f2e-8afb-0a51f62030fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:21.584734 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:21.611380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbb03e-93c3-41f4-b938-67983ed900e6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:21.622004 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 324/638] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:21.653571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bf21e-3778-4e4f-8d2c-5207151903f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:21.654471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bf21e-3778-4e4f-8d2c-5207151903f6 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:21.654925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bf21e-3778-4e4f-8d2c-5207151903f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:21.655348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bf21e-3778-4e4f-8d2c-5207151903f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:21.656082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bf21e-3778-4e4f-8d2c-5207151903f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:21.658179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bf21e-3778-4e4f-8d2c-5207151903f6 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-816bf21e-3778-4e4f-8d2c-5207151903f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:21.668471 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:21.669746 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:21.670806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:21.676721 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 315/639] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:21.681752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f1289-d253-4f2e-8afb-0a51f62030fa None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:21.796800 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:21.807114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f1289-d253-4f2e-8afb-0a51f62030fa None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:21.848141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae72be-0b0d-498c-9f68-555020e948a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:21.848800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae72be-0b0d-498c-9f68-555020e948a2 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:21.849079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae72be-0b0d-498c-9f68-555020e948a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:21.849350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae72be-0b0d-498c-9f68-555020e948a2 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:21.849981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae72be-0b0d-498c-9f68-555020e948a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:21.850277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae72be-0b0d-498c-9f68-555020e948a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:21.851659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae72be-0b0d-498c-9f68-555020e948a2 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:21.859427 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 325/640] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:21.865182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bf21e-3778-4e4f-8d2c-5207151903f6 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:21.927886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae72be-0b0d-498c-9f68-555020e948a2 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:21.974224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bf21e-3778-4e4f-8d2c-5207151903f6 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:22.018650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6cb4-2db9-4a4b-81e8-8e5c68188532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:22.019271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6cb4-2db9-4a4b-81e8-8e5c68188532 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:22.019552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6cb4-2db9-4a4b-81e8-8e5c68188532 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:22.019825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6cb4-2db9-4a4b-81e8-8e5c68188532 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:22.020459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6cb4-2db9-4a4b-81e8-8e5c68188532 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:22.020794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6cb4-2db9-4a4b-81e8-8e5c68188532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:22.022738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6cb4-2db9-4a4b-81e8-8e5c68188532 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:22.029209 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 316/641] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:22.066112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae72be-0b0d-498c-9f68-555020e948a2 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:22.112434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc79d9-3d5b-46c0-ab63-ffc748b903c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:22.113096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc79d9-3d5b-46c0-ab63-ffc748b903c2 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:22.113446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc79d9-3d5b-46c0-ab63-ffc748b903c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:22.113723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc79d9-3d5b-46c0-ab63-ffc748b903c2 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:22.114389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc79d9-3d5b-46c0-ab63-ffc748b903c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:22.115784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc79d9-3d5b-46c0-ab63-ffc748b903c2 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:22.133619 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 326/642] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:29:21 2022] POST /identity/v3/services => generated 269 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:29:22.300266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b5e00-1dcf-4f3b-a227-d58c0badf68c None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:22.300266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b5e00-1dcf-4f3b-a227-d58c0badf68c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:22.300266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b5e00-1dcf-4f3b-a227-d58c0badf68c None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:22.301003 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 317/643] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:22.310293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5569-72b0-4a60-9d77-2b104a9340fe None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:22.310293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5569-72b0-4a60-9d77-2b104a9340fe None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:22.310293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5569-72b0-4a60-9d77-2b104a9340fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:22.327937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8ecf5569-72b0-4a60-9d77-2b104a9340fe None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:22.329372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8ecf5569-72b0-4a60-9d77-2b104a9340fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:22.344990 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:22.416724 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 327/644] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:22.680754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b5e00-1dcf-4f3b-a227-d58c0badf68c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:22.694642 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:22.792122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b5e00-1dcf-4f3b-a227-d58c0badf68c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:22.829139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f9403-35ae-4376-8b5c-2125f8b0e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:22.830358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f9403-35ae-4376-8b5c-2125f8b0e10d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:22.830893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f9403-35ae-4376-8b5c-2125f8b0e10d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:22.831370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f9403-35ae-4376-8b5c-2125f8b0e10d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:22.832156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f9403-35ae-4376-8b5c-2125f8b0e10d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:22.833825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f9403-35ae-4376-8b5c-2125f8b0e10d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-2c4f9403-35ae-4376-8b5c-2125f8b0e10d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:22.843716 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:22.845618 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:29:22.846472 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:22.852763 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 318/645] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:29:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:22.855649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5569-72b0-4a60-9d77-2b104a9340fe None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:22.965143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5569-72b0-4a60-9d77-2b104a9340fe None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:23.001004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b199f6-31c6-4b56-b73c-0a4e66104739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:23.001637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b199f6-31c6-4b56-b73c-0a4e66104739 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:23.001941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b199f6-31c6-4b56-b73c-0a4e66104739 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:23.002180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b199f6-31c6-4b56-b73c-0a4e66104739 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:23.002821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b199f6-31c6-4b56-b73c-0a4e66104739 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:23.003120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b199f6-31c6-4b56-b73c-0a4e66104739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:23.004489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b199f6-31c6-4b56-b73c-0a4e66104739 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:23.009802 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 328/646] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:29:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:23.015411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f9403-35ae-4376-8b5c-2125f8b0e10d None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:23.102564 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:23.130072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f9403-35ae-4376-8b5c-2125f8b0e10d None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:23.164865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35293bf3-4290-41b9-b024-7341b892ae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:23.165475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35293bf3-4290-41b9-b024-7341b892ae90 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:23.165751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35293bf3-4290-41b9-b024-7341b892ae90 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:23.166018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35293bf3-4290-41b9-b024-7341b892ae90 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:23.166710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35293bf3-4290-41b9-b024-7341b892ae90 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:23.167010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35293bf3-4290-41b9-b024-7341b892ae90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:23.168423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35293bf3-4290-41b9-b024-7341b892ae90 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:23.173584 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 319/647] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:29:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:23.673483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2789736-3779-431b-b117-da0fe262b36c None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:23.674029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2789736-3779-431b-b117-da0fe262b36c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:23.674270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2789736-3779-431b-b117-da0fe262b36c None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:23.676036 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 329/648] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:23.681444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e8588-61e4-4ef2-9cdc-6fd164015684 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:23.681857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e8588-61e4-4ef2-9cdc-6fd164015684 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:23.681962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e8588-61e4-4ef2-9cdc-6fd164015684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:23.700901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e72e8588-61e4-4ef2-9cdc-6fd164015684 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:23.702088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e72e8588-61e4-4ef2-9cdc-6fd164015684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:23.774043 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 320/649] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:23 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:24.152108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2789736-3779-431b-b117-da0fe262b36c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:24.173532 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:24.276127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4046f3-a11f-435e-8265-ba143685e2b5 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.276490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4046f3-a11f-435e-8265-ba143685e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.276717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4046f3-a11f-435e-8265-ba143685e2b5 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.278422 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 321/650] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:29:24.281069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2789736-3779-431b-b117-da0fe262b36c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:24.284472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e9db-6f26-4831-9dcd-b6481fa0aec4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.284774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e9db-6f26-4831-9dcd-b6481fa0aec4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.285051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e9db-6f26-4831-9dcd-b6481fa0aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.305174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3131e9db-6f26-4831-9dcd-b6481fa0aec4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:24.306660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3131e9db-6f26-4831-9dcd-b6481fa0aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:24.329743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b3880-5606-4323-8b27-c2a59ca2e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:24.330427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b3880-5606-4323-8b27-c2a59ca2e015 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.330711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b3880-5606-4323-8b27-c2a59ca2e015 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.330986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b3880-5606-4323-8b27-c2a59ca2e015 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.348199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b3880-5606-4323-8b27-c2a59ca2e015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-930b3880-5606-4323-8b27-c2a59ca2e015 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:24.353422 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:24.354513 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:24.355407 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 330/651] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 19 00:29:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:24.366293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b3880-5606-4323-8b27-c2a59ca2e015 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:24.417212 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:24.437064 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 322/652] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:24.449098 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:24.465052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7298-e90e-4678-8698-b478fc622ede None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.465355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7298-e90e-4678-8698-b478fc622ede None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.465612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7298-e90e-4678-8698-b478fc622ede None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.467547 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 323/653] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:29:24.473637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb615-839e-475f-8e93-d9906a7a1981 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.473917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb615-839e-475f-8e93-d9906a7a1981 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.474194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb615-839e-475f-8e93-d9906a7a1981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.492865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f7ecb615-839e-475f-8e93-d9906a7a1981 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:24.494198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f7ecb615-839e-475f-8e93-d9906a7a1981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:24.498355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b3880-5606-4323-8b27-c2a59ca2e015 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:24.547814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55b784-9bcf-45ed-9964-068855f0eeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:24.548344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55b784-9bcf-45ed-9964-068855f0eeb1 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.548724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55b784-9bcf-45ed-9964-068855f0eeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.549001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55b784-9bcf-45ed-9964-068855f0eeb1 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.549860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55b784-9bcf-45ed-9964-068855f0eeb1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:24.550030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55b784-9bcf-45ed-9964-068855f0eeb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:24.551401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55b784-9bcf-45ed-9964-068855f0eeb1 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:24.560740 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 331/654] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Oct 19 00:29:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:24.568019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55b784-9bcf-45ed-9964-068855f0eeb1 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:24.582978 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 324/655] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:24.680807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55b784-9bcf-45ed-9964-068855f0eeb1 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:24.715051 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:24.722190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae148a-beab-489d-a056-c33a55b4b070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:24.723146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae148a-beab-489d-a056-c33a55b4b070 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.723636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae148a-beab-489d-a056-c33a55b4b070 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.724127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae148a-beab-489d-a056-c33a55b4b070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.735969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae148a-beab-489d-a056-c33a55b4b070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:24.737827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae148a-beab-489d-a056-c33a55b4b070 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-e1ae148a-beab-489d-a056-c33a55b4b070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:24.753511 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:24.754533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:24.755433 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:24.755433 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:24.755433 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:24.757613 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 332/656] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:24.763110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb615-839e-475f-8e93-d9906a7a1981 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:24.779160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae148a-beab-489d-a056-c33a55b4b070 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:24.895454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb615-839e-475f-8e93-d9906a7a1981 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:24.923880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae148a-beab-489d-a056-c33a55b4b070 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:24.928071 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:24.937795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a475e-00e3-4de7-969d-d80591eb4505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:24.938421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a475e-00e3-4de7-969d-d80591eb4505 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.938703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a475e-00e3-4de7-969d-d80591eb4505 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.938984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a475e-00e3-4de7-969d-d80591eb4505 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.939629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a475e-00e3-4de7-969d-d80591eb4505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:24.939933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a475e-00e3-4de7-969d-d80591eb4505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:24.941472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a475e-00e3-4de7-969d-d80591eb4505 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:24.959168 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 325/657] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:24.959168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a475e-00e3-4de7-969d-d80591eb4505 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:24.971858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38446c0-e089-463d-8ba4-f4e9c345a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:24.972454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38446c0-e089-463d-8ba4-f4e9c345a796 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.972792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38446c0-e089-463d-8ba4-f4e9c345a796 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.973069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38446c0-e089-463d-8ba4-f4e9c345a796 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.973769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38446c0-e089-463d-8ba4-f4e9c345a796 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:24.975174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38446c0-e089-463d-8ba4-f4e9c345a796 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:24.992354 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 333/658] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:29:24 2022] POST /identity/v3/services => generated 241 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:29:24.993300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38446c0-e089-463d-8ba4-f4e9c345a796 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:25.051764 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:25.116808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a475e-00e3-4de7-969d-d80591eb4505 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:25.148895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38446c0-e089-463d-8ba4-f4e9c345a796 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:25.170283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e04a-95a1-4729-977f-fd31e6e12cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:25.171249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e04a-95a1-4729-977f-fd31e6e12cad None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:25.171773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e04a-95a1-4729-977f-fd31e6e12cad None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:25.172301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e04a-95a1-4729-977f-fd31e6e12cad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:25.173439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252e04a-95a1-4729-977f-fd31e6e12cad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:25.175646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252e04a-95a1-4729-977f-fd31e6e12cad None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-c252e04a-95a1-4729-977f-fd31e6e12cad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:25.189340 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:25.190431 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:29:25.191371 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:25.199212 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 326/659] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 19 00:29:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:25.201704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e04a-95a1-4729-977f-fd31e6e12cad None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:25.208063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169cb54-4569-49fa-8fbf-e183160a4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:25.209302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169cb54-4569-49fa-8fbf-e183160a4c4e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:25.209823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169cb54-4569-49fa-8fbf-e183160a4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:25.210386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169cb54-4569-49fa-8fbf-e183160a4c4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:25.221137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169cb54-4569-49fa-8fbf-e183160a4c4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:25.223026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169cb54-4569-49fa-8fbf-e183160a4c4e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-1169cb54-4569-49fa-8fbf-e183160a4c4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:25.236900 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:25.237934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:29:25.238932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:25.240919 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 334/660] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 19 00:29:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:25.246797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169cb54-4569-49fa-8fbf-e183160a4c4e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:25.288434 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:25.354439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e04a-95a1-4729-977f-fd31e6e12cad None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:25.383711 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:25.389229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169cb54-4569-49fa-8fbf-e183160a4c4e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:25.397200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7a3ba-c01c-4982-ac62-25d07c22441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:25.397838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7a3ba-c01c-4982-ac62-25d07c22441e None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:25.398111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7a3ba-c01c-4982-ac62-25d07c22441e None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:25.398385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7a3ba-c01c-4982-ac62-25d07c22441e None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:25.399091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7a3ba-c01c-4982-ac62-25d07c22441e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:25.399347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7a3ba-c01c-4982-ac62-25d07c22441e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:25.400751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7a3ba-c01c-4982-ac62-25d07c22441e None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:25.411656 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 327/661] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:25.413185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7a3ba-c01c-4982-ac62-25d07c22441e None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:25.439514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1e10-3b9b-4628-802e-ab4229f3766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:25.440391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1e10-3b9b-4628-802e-ab4229f3766b None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:25.440875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1e10-3b9b-4628-802e-ab4229f3766b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:25.441303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1e10-3b9b-4628-802e-ab4229f3766b None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:25.442309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1e10-3b9b-4628-802e-ab4229f3766b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:25.442765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1e10-3b9b-4628-802e-ab4229f3766b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:25.444388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1e10-3b9b-4628-802e-ab4229f3766b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:25.471157 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 335/662] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Oct 19 00:29:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:25.485348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1e10-3b9b-4628-802e-ab4229f3766b None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:25.555106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7a3ba-c01c-4982-ac62-25d07c22441e None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:25.581177 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:25.603709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233a258-7c42-492a-86c5-feadefdb303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:25.604328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233a258-7c42-492a-86c5-feadefdb303b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:25.604799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233a258-7c42-492a-86c5-feadefdb303b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:25.605218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233a258-7c42-492a-86c5-feadefdb303b None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:25.605859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233a258-7c42-492a-86c5-feadefdb303b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:25.606167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233a258-7c42-492a-86c5-feadefdb303b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:25.607541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233a258-7c42-492a-86c5-feadefdb303b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:25.614215 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 328/663] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:25.620483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557627fa-63b7-41c8-9af6-785b7af95871 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:25.620822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557627fa-63b7-41c8-9af6-785b7af95871 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:25.621072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557627fa-63b7-41c8-9af6-785b7af95871 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:25.622014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1e10-3b9b-4628-802e-ab4229f3766b None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:25.624745 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 329/664] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:25.624745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557627fa-63b7-41c8-9af6-785b7af95871 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:25.668605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb7bfc-6108-48f0-b715-1381ab23e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:25.669547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7bfc-6108-48f0-b715-1381ab23e566 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:25.669825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7bfc-6108-48f0-b715-1381ab23e566 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:25.670094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7bfc-6108-48f0-b715-1381ab23e566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:25.682494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb7bfc-6108-48f0-b715-1381ab23e566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:25.684102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb7bfc-6108-48f0-b715-1381ab23e566 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-e7eb7bfc-6108-48f0-b715-1381ab23e566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:25.702451 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:25.704402 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:25.705805 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:25.705805 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:25.705805 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:25.705805 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 336/665] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:25.705805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccc82c-c1e1-4432-ba9b-5dc3b81d836a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:25.705805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccc82c-c1e1-4432-ba9b-5dc3b81d836a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:25.705805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccc82c-c1e1-4432-ba9b-5dc3b81d836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:25.724444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-57ccc82c-c1e1-4432-ba9b-5dc3b81d836a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:25.725714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-57ccc82c-c1e1-4432-ba9b-5dc3b81d836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:25.728003 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:25.768636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557627fa-63b7-41c8-9af6-785b7af95871 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:25.810880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cb0a3-c50f-4a80-b0de-11fa6f7e56f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:25.811501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb0a3-c50f-4a80-b0de-11fa6f7e56f8 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:25.811783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb0a3-c50f-4a80-b0de-11fa6f7e56f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:25.812060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb0a3-c50f-4a80-b0de-11fa6f7e56f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:25.813524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cb0a3-c50f-4a80-b0de-11fa6f7e56f8 None admin] RBAC: Adding query filter params (interface=public, service_id=4f7f73b282fe4b059764cfc3bcd120aa, region_id=RegionOne) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:25.813838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cb0a3-c50f-4a80-b0de-11fa6f7e56f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:25.814849 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 337/666] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:25 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:25.815402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cb0a3-c50f-4a80-b0de-11fa6f7e56f8 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:25.816102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccc82c-c1e1-4432-ba9b-5dc3b81d836a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:25.832599 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 330/667] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 19 00:29:25 2022] GET /identity/v3/endpoints?service_id=4f7f73b282fe4b059764cfc3bcd120aa&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:25.838377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cb0a3-c50f-4a80-b0de-11fa6f7e56f8 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:25.899527 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:25.954822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccc82c-c1e1-4432-ba9b-5dc3b81d836a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:25.964481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cb0a3-c50f-4a80-b0de-11fa6f7e56f8 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:26.003842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b22b1-33a5-42ec-98b1-99d5d16ee45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:26.004090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11126-b86f-4641-bf03-a524fcc4feb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:26.004605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11126-b86f-4641-bf03-a524fcc4feb2 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:26.004912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11126-b86f-4641-bf03-a524fcc4feb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:26.005023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b22b1-33a5-42ec-98b1-99d5d16ee45a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:26.005180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11126-b86f-4641-bf03-a524fcc4feb2 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:26.005451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b22b1-33a5-42ec-98b1-99d5d16ee45a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:26.005824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b22b1-33a5-42ec-98b1-99d5d16ee45a None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:26.005932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a11126-b86f-4641-bf03-a524fcc4feb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:26.006122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a11126-b86f-4641-bf03-a524fcc4feb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:26.006808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b22b1-33a5-42ec-98b1-99d5d16ee45a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:26.007522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a11126-b86f-4641-bf03-a524fcc4feb2 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:26.008573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b22b1-33a5-42ec-98b1-99d5d16ee45a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:26.016849 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:26.019197 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 331/668] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 19 00:29:25 2022] GET /identity/v3/services => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:29:26.026419 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 338/669] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:26.033505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b22b1-33a5-42ec-98b1-99d5d16ee45a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:26.144082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11126-b86f-4641-bf03-a524fcc4feb2 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:26.156872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b22b1-33a5-42ec-98b1-99d5d16ee45a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:26.168654 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:26.199087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac7b2-ffc0-4adf-9ca1-74cd1bba4c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:26.199736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac7b2-ffc0-4adf-9ca1-74cd1bba4c06 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:26.200014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac7b2-ffc0-4adf-9ca1-74cd1bba4c06 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:26.200289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac7b2-ffc0-4adf-9ca1-74cd1bba4c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:26.210127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac7b2-ffc0-4adf-9ca1-74cd1bba4c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:26.211532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac7b2-ffc0-4adf-9ca1-74cd1bba4c06 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-a50ac7b2-ffc0-4adf-9ca1-74cd1bba4c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:26.225194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:26.226205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:26.227105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:26.227105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:26.227105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:26.227105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:26.227105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:26.227105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:26.227105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:26.227105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:26.227105 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 332/670] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:26.235187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac7b2-ffc0-4adf-9ca1-74cd1bba4c06 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:26.295896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11126-b86f-4641-bf03-a524fcc4feb2 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:26.338311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534979-16aa-44b4-b253-b5838ab3cb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:26.339080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534979-16aa-44b4-b253-b5838ab3cb81 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:26.339436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534979-16aa-44b4-b253-b5838ab3cb81 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:26.339799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534979-16aa-44b4-b253-b5838ab3cb81 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:26.340492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2534979-16aa-44b4-b253-b5838ab3cb81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:26.342147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2534979-16aa-44b4-b253-b5838ab3cb81 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:26.365856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac7b2-ffc0-4adf-9ca1-74cd1bba4c06 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:26.367428 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 339/671] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:29:26 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:29:26.432223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282fd8d-9c0a-491e-be2b-65bc31d3fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:26.432949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fd8d-9c0a-491e-be2b-65bc31d3fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:26.433230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fd8d-9c0a-491e-be2b-65bc31d3fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:26.433552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fd8d-9c0a-491e-be2b-65bc31d3fdd7 None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:26.434325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282fd8d-9c0a-491e-be2b-65bc31d3fdd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:26.434632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282fd8d-9c0a-491e-be2b-65bc31d3fdd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:26.436556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282fd8d-9c0a-491e-be2b-65bc31d3fdd7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:26.454904 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 333/672] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:26.463853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534979-16aa-44b4-b253-b5838ab3cb81 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:26.571385 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:26.634705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534979-16aa-44b4-b253-b5838ab3cb81 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:26.675061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c615e9-6496-4731-9eec-336559412a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:26.676119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c615e9-6496-4731-9eec-336559412a4e None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:26.676610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c615e9-6496-4731-9eec-336559412a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:26.677110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c615e9-6496-4731-9eec-336559412a4e None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/b9187894d0574f6e887a98b8563b6d32/roles/56da0eaf554e400ebd2272a01016c3ab` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:26.679601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c615e9-6496-4731-9eec-336559412a4e None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=b9187894d0574f6e887a98b8563b6d32, role_id=56da0eaf554e400ebd2272a01016c3ab)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:26.681508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c615e9-6496-4731-9eec-336559412a4e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:26.696422 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 340/673] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:29:26 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/b9187894d0574f6e887a98b8563b6d32/roles/56da0eaf554e400ebd2272a01016c3ab => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:29:27.401655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb910965-803d-471d-8543-cd7bf23556ef None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:27.402211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb910965-803d-471d-8543-cd7bf23556ef None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:27.402211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb910965-803d-471d-8543-cd7bf23556ef None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:27.403836 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 334/674] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:27.409772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd283c94-c83d-42fb-9c0e-c88c3ecbb184 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:27.410062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd283c94-c83d-42fb-9c0e-c88c3ecbb184 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:27.410346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd283c94-c83d-42fb-9c0e-c88c3ecbb184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:27.430070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dd283c94-c83d-42fb-9c0e-c88c3ecbb184 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:27.431354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dd283c94-c83d-42fb-9c0e-c88c3ecbb184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:27.516756 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 341/675] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:27.797055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb910965-803d-471d-8543-cd7bf23556ef None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:27.824892 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:27.912410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb910965-803d-471d-8543-cd7bf23556ef None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:27.950351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a32c-e75b-433a-b6d3-b00415a5d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:27.951009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a32c-e75b-433a-b6d3-b00415a5d694 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:27.951334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a32c-e75b-433a-b6d3-b00415a5d694 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:27.951648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a32c-e75b-433a-b6d3-b00415a5d694 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:27.952270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8a32c-e75b-433a-b6d3-b00415a5d694 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:27.953825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8a32c-e75b-433a-b6d3-b00415a5d694 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-0cf8a32c-e75b-433a-b6d3-b00415a5d694 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:27.963844 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:27.964925 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:27.965749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:27.968837 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 335/676] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:27.971812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd283c94-c83d-42fb-9c0e-c88c3ecbb184 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:28.025596 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:28.089238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd283c94-c83d-42fb-9c0e-c88c3ecbb184 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:28.126897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80282758-2d50-425b-83d3-1c03b5921543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:28.127566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80282758-2d50-425b-83d3-1c03b5921543 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:28.127855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80282758-2d50-425b-83d3-1c03b5921543 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:28.128132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80282758-2d50-425b-83d3-1c03b5921543 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:28.128880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80282758-2d50-425b-83d3-1c03b5921543 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:28.129190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80282758-2d50-425b-83d3-1c03b5921543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:28.130577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80282758-2d50-425b-83d3-1c03b5921543 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:28.141196 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 342/677] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:28.143301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a32c-e75b-433a-b6d3-b00415a5d694 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:28.261299 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:28.277746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a32c-e75b-433a-b6d3-b00415a5d694 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:28.319988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593c9a5-3833-44e4-925f-11bec29f0b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:28.321109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593c9a5-3833-44e4-925f-11bec29f0b80 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:28.321596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593c9a5-3833-44e4-925f-11bec29f0b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:28.322081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593c9a5-3833-44e4-925f-11bec29f0b80 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:28.322970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593c9a5-3833-44e4-925f-11bec29f0b80 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:28.323664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593c9a5-3833-44e4-925f-11bec29f0b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:28.325502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593c9a5-3833-44e4-925f-11bec29f0b80 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:28.336757 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 336/678] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:28.340724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80282758-2d50-425b-83d3-1c03b5921543 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:28.470856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80282758-2d50-425b-83d3-1c03b5921543 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:28.489040 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:28.518463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71925715-62eb-4896-be83-f7f6644b5b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:28.519191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71925715-62eb-4896-be83-f7f6644b5b01 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:28.519473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71925715-62eb-4896-be83-f7f6644b5b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:28.519880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71925715-62eb-4896-be83-f7f6644b5b01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:28.520600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71925715-62eb-4896-be83-f7f6644b5b01 None admin] RBAC: Adding query filter params (interface=public, service_id=091fec89d02d4082a23719930206bee0, region_id=RegionOne) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:28.520945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71925715-62eb-4896-be83-f7f6644b5b01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:28.522447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71925715-62eb-4896-be83-f7f6644b5b01 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:28.528968 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 343/679] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 19 00:29:28 2022] GET /identity/v3/endpoints?service_id=091fec89d02d4082a23719930206bee0&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:28.535711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c9c4e-6ff6-4708-a1eb-dc2c073321f2 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:28.536248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c9c4e-6ff6-4708-a1eb-dc2c073321f2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:28.536248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c9c4e-6ff6-4708-a1eb-dc2c073321f2 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:28.537838 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 337/680] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:28.541745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71925715-62eb-4896-be83-f7f6644b5b01 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:28.543304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aeaca-2f88-4f51-885b-d0102388f6a6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:28.543739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aeaca-2f88-4f51-885b-d0102388f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:28.544163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aeaca-2f88-4f51-885b-d0102388f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:28.570722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-525aeaca-2f88-4f51-885b-d0102388f6a6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:28.572527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-525aeaca-2f88-4f51-885b-d0102388f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:28.656952 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 338/681] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:28.722399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71925715-62eb-4896-be83-f7f6644b5b01 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:28.763256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dae2f-e31b-4ec5-9431-f5835848f991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:28.764003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dae2f-e31b-4ec5-9431-f5835848f991 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:28.764284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dae2f-e31b-4ec5-9431-f5835848f991 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:28.764562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dae2f-e31b-4ec5-9431-f5835848f991 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:28.765289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dae2f-e31b-4ec5-9431-f5835848f991 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:28.767651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dae2f-e31b-4ec5-9431-f5835848f991 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:28.774933 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 344/682] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 19 00:29:28 2022] GET /identity/v3/services => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:29:28.952873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aeaca-2f88-4f51-885b-d0102388f6a6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:29.067299 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:29.071603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15c85c-70e5-44d9-ae99-bb9512f0687b None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:29.072111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15c85c-70e5-44d9-ae99-bb9512f0687b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:29.072191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15c85c-70e5-44d9-ae99-bb9512f0687b None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:29.074557 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 345/683] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:29.081596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4575a8-459f-4377-a64e-bc7315bbbe44 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:29.081971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4575a8-459f-4377-a64e-bc7315bbbe44 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:29.082378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4575a8-459f-4377-a64e-bc7315bbbe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:29.085363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aeaca-2f88-4f51-885b-d0102388f6a6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:29.106554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0d4575a8-459f-4377-a64e-bc7315bbbe44 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:29.107814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0d4575a8-459f-4377-a64e-bc7315bbbe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:29.136187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f1af9-ce00-4b26-b256-19efd776fc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:29.136858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f1af9-ce00-4b26-b256-19efd776fc98 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:29.137136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f1af9-ce00-4b26-b256-19efd776fc98 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:29.137408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f1af9-ce00-4b26-b256-19efd776fc98 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:29.138028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f1af9-ce00-4b26-b256-19efd776fc98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:29.139394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f1af9-ce00-4b26-b256-19efd776fc98 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-d70f1af9-ce00-4b26-b256-19efd776fc98 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:29.149988 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:29.151732 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:29.154423 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 339/684] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 19 00:29:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:29.156777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b6584-43fe-4c36-86f3-fe37ae1f0a36 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:29.156777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b6584-43fe-4c36-86f3-fe37ae1f0a36 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:29.156777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b6584-43fe-4c36-86f3-fe37ae1f0a36 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:29.156777 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 340/685] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:29.159684 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:29.159983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b6584-43fe-4c36-86f3-fe37ae1f0a36 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:29.216509 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 346/686] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:29.221449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e8f01-1966-48b0-81d0-af7e0ff9fa81 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:29.222043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e8f01-1966-48b0-81d0-af7e0ff9fa81 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:29.222594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e8f01-1966-48b0-81d0-af7e0ff9fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:29.258765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2d8e8f01-1966-48b0-81d0-af7e0ff9fa81 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:29.261342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2d8e8f01-1966-48b0-81d0-af7e0ff9fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:29.295672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b6584-43fe-4c36-86f3-fe37ae1f0a36 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:29.341744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23209f5e-6123-447d-bd33-52a1a316675b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:29.342381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23209f5e-6123-447d-bd33-52a1a316675b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:29.342759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23209f5e-6123-447d-bd33-52a1a316675b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:29.343020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23209f5e-6123-447d-bd33-52a1a316675b None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:29.343896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23209f5e-6123-447d-bd33-52a1a316675b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:29.344887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23209f5e-6123-447d-bd33-52a1a316675b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:29.346516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23209f5e-6123-447d-bd33-52a1a316675b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:29.357453 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 341/687] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:29.358346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23209f5e-6123-447d-bd33-52a1a316675b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:29.373879 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:29.382337 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 347/688] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:29.543808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e8f01-1966-48b0-81d0-af7e0ff9fa81 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:29.555213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23209f5e-6123-447d-bd33-52a1a316675b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:29.598794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6ded-a37e-455c-97d8-f4ef0a3f9fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:29.599417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6ded-a37e-455c-97d8-f4ef0a3f9fd9 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:29.599773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6ded-a37e-455c-97d8-f4ef0a3f9fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:29.600048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6ded-a37e-455c-97d8-f4ef0a3f9fd9 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:29.600904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6ded-a37e-455c-97d8-f4ef0a3f9fd9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:29.601244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6ded-a37e-455c-97d8-f4ef0a3f9fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:29.602802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6ded-a37e-455c-97d8-f4ef0a3f9fd9 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:29.609117 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 342/689] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:29.618614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6ded-a37e-455c-97d8-f4ef0a3f9fd9 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:29.696765 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:29.702110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e8f01-1966-48b0-81d0-af7e0ff9fa81 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:29.727630 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:29.760346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6ded-a37e-455c-97d8-f4ef0a3f9fd9 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:29.761465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fba686-a217-4867-8b48-ef5782b4d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:29.762286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fba686-a217-4867-8b48-ef5782b4d646 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:29.762564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fba686-a217-4867-8b48-ef5782b4d646 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:29.762870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fba686-a217-4867-8b48-ef5782b4d646 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:29.763500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fba686-a217-4867-8b48-ef5782b4d646 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:29.765310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fba686-a217-4867-8b48-ef5782b4d646 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-50fba686-a217-4867-8b48-ef5782b4d646 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:29.776082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:29.778032 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:29.779624 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 348/690] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:29:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:29.785292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fba686-a217-4867-8b48-ef5782b4d646 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:29.819887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6f205-6046-496e-8f60-006a489de380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:29.820851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6f205-6046-496e-8f60-006a489de380 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:29.821145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6f205-6046-496e-8f60-006a489de380 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:29.821421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6f205-6046-496e-8f60-006a489de380 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:29.822220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6f205-6046-496e-8f60-006a489de380 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:29.823755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6f205-6046-496e-8f60-006a489de380 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:29.852743 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 343/691] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:29:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:29.862110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6f205-6046-496e-8f60-006a489de380 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:29.950600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fba686-a217-4867-8b48-ef5782b4d646 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:30.022010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11c987-df30-482e-81d5-4f095d63de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:30.023143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c987-df30-482e-81d5-4f095d63de2d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.023667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c987-df30-482e-81d5-4f095d63de2d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.024250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c987-df30-482e-81d5-4f095d63de2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.041861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6f205-6046-496e-8f60-006a489de380 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:30.042135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11c987-df30-482e-81d5-4f095d63de2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-ac11c987-df30-482e-81d5-4f095d63de2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:30.053002 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:30.054826 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:29:30.057312 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:30.068152 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 349/692] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 19 00:29:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:30.069774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11c987-df30-482e-81d5-4f095d63de2d None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:30.084435 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:30.096437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3296d3-cdf7-4c93-8006-53a2bd4e289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:30.097281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3296d3-cdf7-4c93-8006-53a2bd4e289a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.097572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3296d3-cdf7-4c93-8006-53a2bd4e289a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.098787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3296d3-cdf7-4c93-8006-53a2bd4e289a None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.099446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3296d3-cdf7-4c93-8006-53a2bd4e289a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:30.099752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3296d3-cdf7-4c93-8006-53a2bd4e289a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:30.101200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3296d3-cdf7-4c93-8006-53a2bd4e289a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:30.103568 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:30.115654 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 344/693] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:29:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:30.117157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3296d3-cdf7-4c93-8006-53a2bd4e289a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:30.218258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11c987-df30-482e-81d5-4f095d63de2d None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:30.252271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3296d3-cdf7-4c93-8006-53a2bd4e289a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:30.258538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e0d6f-5f3b-45f7-8eb9-f40c56c916ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:30.259758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e0d6f-5f3b-45f7-8eb9-f40c56c916ab None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.260544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e0d6f-5f3b-45f7-8eb9-f40c56c916ab None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.261132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e0d6f-5f3b-45f7-8eb9-f40c56c916ab None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.261976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e0d6f-5f3b-45f7-8eb9-f40c56c916ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:30.262563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e0d6f-5f3b-45f7-8eb9-f40c56c916ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:30.264252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e0d6f-5f3b-45f7-8eb9-f40c56c916ab None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:30.276054 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 350/694] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Oct 19 00:29:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:30.284190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e0d6f-5f3b-45f7-8eb9-f40c56c916ab None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:30.299464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb7cc3-823a-4efe-932b-dd9102e2ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:30.300090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb7cc3-823a-4efe-932b-dd9102e2ba5f None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.301079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb7cc3-823a-4efe-932b-dd9102e2ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.301079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb7cc3-823a-4efe-932b-dd9102e2ba5f None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.301467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb7cc3-823a-4efe-932b-dd9102e2ba5f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:30.301772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb7cc3-823a-4efe-932b-dd9102e2ba5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:30.303152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb7cc3-823a-4efe-932b-dd9102e2ba5f None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:30.314862 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 345/695] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:29:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:30.316383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb7cc3-823a-4efe-932b-dd9102e2ba5f None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:30.400974 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:30.431818 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:30.454387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e0d6f-5f3b-45f7-8eb9-f40c56c916ab None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:30.463511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb7cc3-823a-4efe-932b-dd9102e2ba5f None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:30.494813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8d4f-189f-4472-b0e5-0634cf783555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:30.496051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8d4f-189f-4472-b0e5-0634cf783555 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.496051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8d4f-189f-4472-b0e5-0634cf783555 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.496249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8d4f-189f-4472-b0e5-0634cf783555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.509553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff8d4f-189f-4472-b0e5-0634cf783555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:30.511427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff8d4f-189f-4472-b0e5-0634cf783555 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:30.516406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d167e1b-2454-47b8-9453-7b128b9c9b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:30.517529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167e1b-2454-47b8-9453-7b128b9c9b0a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.518041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167e1b-2454-47b8-9453-7b128b9c9b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.518520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167e1b-2454-47b8-9453-7b128b9c9b0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.519691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d167e1b-2454-47b8-9453-7b128b9c9b0a None admin] RBAC: Adding query filter params (interface=public, service_id=11c163a9346740b598d8c5982ce940c6, region_id=RegionOne) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:30.520899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d167e1b-2454-47b8-9453-7b128b9c9b0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:30.523646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d167e1b-2454-47b8-9453-7b128b9c9b0a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-bfff8d4f-189f-4472-b0e5-0634cf783555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:30.529593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:30.530720 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:30.532216 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:30.532216 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:30.532216 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:30.538735 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 351/696] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:30.538735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8d4f-189f-4472-b0e5-0634cf783555 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:30.539409 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 346/697] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 19 00:29:30 2022] GET /identity/v3/endpoints?service_id=11c163a9346740b598d8c5982ce940c6&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:30.540570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d167e1b-2454-47b8-9453-7b128b9c9b0a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:30.674247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8d4f-189f-4472-b0e5-0634cf783555 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:30.716470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d167e1b-2454-47b8-9453-7b128b9c9b0a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:30.738546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb570d7-0abe-4b68-9338-d8b433dad643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:30.739551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb570d7-0abe-4b68-9338-d8b433dad643 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.740019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb570d7-0abe-4b68-9338-d8b433dad643 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.740505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb570d7-0abe-4b68-9338-d8b433dad643 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.741787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb570d7-0abe-4b68-9338-d8b433dad643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:30.742308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb570d7-0abe-4b68-9338-d8b433dad643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:30.744859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb570d7-0abe-4b68-9338-d8b433dad643 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:30.747905 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:30.774609 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 352/698] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:30.776064 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:30.776454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb570d7-0abe-4b68-9338-d8b433dad643 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:30.791202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8c6e-ef0e-4bdd-acb4-6c00683af118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:30.792122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8c6e-ef0e-4bdd-acb4-6c00683af118 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.792591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8c6e-ef0e-4bdd-acb4-6c00683af118 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.793153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8c6e-ef0e-4bdd-acb4-6c00683af118 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.794368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8c6e-ef0e-4bdd-acb4-6c00683af118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:30.796325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8c6e-ef0e-4bdd-acb4-6c00683af118 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:30.807720 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 347/699] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 19 00:29:30 2022] GET /identity/v3/services => generated 1497 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:29:30.913732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb570d7-0abe-4b68-9338-d8b433dad643 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:30.971650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0dca2-7062-49ba-8d0f-e8f2ebec61d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:30.973178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0dca2-7062-49ba-8d0f-e8f2ebec61d7 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.973913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0dca2-7062-49ba-8d0f-e8f2ebec61d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.974656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0dca2-7062-49ba-8d0f-e8f2ebec61d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.989572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0dca2-7062-49ba-8d0f-e8f2ebec61d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:30.992687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0dca2-7062-49ba-8d0f-e8f2ebec61d7 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-dda0dca2-7062-49ba-8d0f-e8f2ebec61d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:31.012560 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:31.014007 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:31.015017 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 353/700] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 19 00:29:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:31.021828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8c6e-ef0e-4bdd-acb4-6c00683af118 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:31.177124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8c6e-ef0e-4bdd-acb4-6c00683af118 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:31.228852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928def3-e94c-4eae-8487-4f07f45520a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:31.229752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928def3-e94c-4eae-8487-4f07f45520a8 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:31.230177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928def3-e94c-4eae-8487-4f07f45520a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:31.230589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928def3-e94c-4eae-8487-4f07f45520a8 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:31.231537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928def3-e94c-4eae-8487-4f07f45520a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:31.231999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928def3-e94c-4eae-8487-4f07f45520a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:31.233898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928def3-e94c-4eae-8487-4f07f45520a8 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:31.257199 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 348/701] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Oct 19 00:29:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:31.266287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0dca2-7062-49ba-8d0f-e8f2ebec61d7 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:31.339407 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:31.352183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510cf88-0244-4bb7-8486-b94c0474ef6d None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:31.352865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510cf88-0244-4bb7-8486-b94c0474ef6d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:31.353376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510cf88-0244-4bb7-8486-b94c0474ef6d None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:31.355110 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 349/702] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:29:31.364711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb3bf-bda2-4f8e-b7a8-29262bb2a4ef None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:31.365178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb3bf-bda2-4f8e-b7a8-29262bb2a4ef None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:31.365639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb3bf-bda2-4f8e-b7a8-29262bb2a4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:31.398906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-253bb3bf-bda2-4f8e-b7a8-29262bb2a4ef None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:31.401836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-253bb3bf-bda2-4f8e-b7a8-29262bb2a4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:31.404431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0dca2-7062-49ba-8d0f-e8f2ebec61d7 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:31.447499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f7345-fc16-4328-98d4-6d8e53972ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:31.448221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f7345-fc16-4328-98d4-6d8e53972ab6 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:31.448512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f7345-fc16-4328-98d4-6d8e53972ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:31.448816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f7345-fc16-4328-98d4-6d8e53972ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:31.497911 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:31.549811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f7345-fc16-4328-98d4-6d8e53972ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:31.552603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f7345-fc16-4328-98d4-6d8e53972ab6 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:31.561954 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 350/703] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:31.657067 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:31.748957 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 354/704] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:31 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:29:31.753802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb3bf-bda2-4f8e-b7a8-29262bb2a4ef None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:31.913401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb3bf-bda2-4f8e-b7a8-29262bb2a4ef None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:31.967676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af82a57-01be-4434-86f8-7eb9d2e20e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:31.968937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af82a57-01be-4434-86f8-7eb9d2e20e5a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:31.969909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af82a57-01be-4434-86f8-7eb9d2e20e5a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:31.970409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af82a57-01be-4434-86f8-7eb9d2e20e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:31.983050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af82a57-01be-4434-86f8-7eb9d2e20e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:31.984932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af82a57-01be-4434-86f8-7eb9d2e20e5a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-9af82a57-01be-4434-86f8-7eb9d2e20e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:32.001231 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:32.002205 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:32.003169 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:32.003169 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:32.003169 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:32.005640 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 351/705] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:32.013788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f7345-fc16-4328-98d4-6d8e53972ab6 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:32.068469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af82a57-01be-4434-86f8-7eb9d2e20e5a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:32.126521 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:32.167128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f7345-fc16-4328-98d4-6d8e53972ab6 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:32.206171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3700a6d-cca9-44fc-a2f4-f6d47c2297bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:32.206891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3700a6d-cca9-44fc-a2f4-f6d47c2297bf None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.207246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3700a6d-cca9-44fc-a2f4-f6d47c2297bf None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.207596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3700a6d-cca9-44fc-a2f4-f6d47c2297bf None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.208318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3700a6d-cca9-44fc-a2f4-f6d47c2297bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:32.208741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3700a6d-cca9-44fc-a2f4-f6d47c2297bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:32.210214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3700a6d-cca9-44fc-a2f4-f6d47c2297bf None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:32.225233 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 355/706] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:32.233167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3700a6d-cca9-44fc-a2f4-f6d47c2297bf None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:32.237753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af82a57-01be-4434-86f8-7eb9d2e20e5a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:32.269604 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:32.285927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ae2c4-e16f-461b-9025-3b2b97257b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:32.287747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ae2c4-e16f-461b-9025-3b2b97257b56 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.288215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ae2c4-e16f-461b-9025-3b2b97257b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.288708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ae2c4-e16f-461b-9025-3b2b97257b56 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.289853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ae2c4-e16f-461b-9025-3b2b97257b56 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:32.291690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ae2c4-e16f-461b-9025-3b2b97257b56 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-535ae2c4-e16f-461b-9025-3b2b97257b56 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:32.304296 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:32.305375 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:32.306227 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:32.308925 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 352/707] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:32.318597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ae2c4-e16f-461b-9025-3b2b97257b56 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:32.394852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3700a6d-cca9-44fc-a2f4-f6d47c2297bf None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:32.434577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f22cd4-59fe-47ed-b7b8-d5e9ee541fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:32.435589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f22cd4-59fe-47ed-b7b8-d5e9ee541fce None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.436056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f22cd4-59fe-47ed-b7b8-d5e9ee541fce None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.436526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f22cd4-59fe-47ed-b7b8-d5e9ee541fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.445197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f22cd4-59fe-47ed-b7b8-d5e9ee541fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:32.447066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f22cd4-59fe-47ed-b7b8-d5e9ee541fce None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-75f22cd4-59fe-47ed-b7b8-d5e9ee541fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:32.459980 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:32.460934 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:32.461843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:32.461843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:32.461843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:32.461843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:32.461843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:32.461843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:32.461843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:32.461843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:32.463015 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 356/708] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:32.472094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f22cd4-59fe-47ed-b7b8-d5e9ee541fce None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:32.498676 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:32.515025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ae2c4-e16f-461b-9025-3b2b97257b56 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:32.564500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dcba6-cd24-415c-9470-70e4ad9e8f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:32.565083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dcba6-cd24-415c-9470-70e4ad9e8f58 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.565367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dcba6-cd24-415c-9470-70e4ad9e8f58 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.565644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dcba6-cd24-415c-9470-70e4ad9e8f58 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.566424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dcba6-cd24-415c-9470-70e4ad9e8f58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:32.566736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dcba6-cd24-415c-9470-70e4ad9e8f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:32.568132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dcba6-cd24-415c-9470-70e4ad9e8f58 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:32.583044 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 353/709] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:32.584401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dcba6-cd24-415c-9470-70e4ad9e8f58 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:32.590921 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:32.633954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f22cd4-59fe-47ed-b7b8-d5e9ee541fce None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:32.674197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b2b70-eed5-474b-a91f-6cd5d36e51cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:32.674836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2b70-eed5-474b-a91f-6cd5d36e51cc None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.675295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2b70-eed5-474b-a91f-6cd5d36e51cc None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.675575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b2b70-eed5-474b-a91f-6cd5d36e51cc None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.676302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b2b70-eed5-474b-a91f-6cd5d36e51cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:32.676607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b2b70-eed5-474b-a91f-6cd5d36e51cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:32.678731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b2b70-eed5-474b-a91f-6cd5d36e51cc None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:32.692355 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 357/710] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:32.698679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdde34-4b84-4f65-9a78-d980f06c1e16 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.699014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdde34-4b84-4f65-9a78-d980f06c1e16 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.699237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdde34-4b84-4f65-9a78-d980f06c1e16 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.700670 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 358/711] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:32.705106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdde34-4b84-4f65-9a78-d980f06c1e16 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:32.714431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dcba6-cd24-415c-9470-70e4ad9e8f58 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:32.758637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64ef55-6953-4845-81b8-152a2d9844ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:32.759326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64ef55-6953-4845-81b8-152a2d9844ac None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.759566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64ef55-6953-4845-81b8-152a2d9844ac None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.759803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64ef55-6953-4845-81b8-152a2d9844ac None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.760456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64ef55-6953-4845-81b8-152a2d9844ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:32.760801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64ef55-6953-4845-81b8-152a2d9844ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:32.762226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64ef55-6953-4845-81b8-152a2d9844ac None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:32.774273 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 354/712] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:32.774273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec07f3-1aac-4f5d-9122-4b0fd715bfe9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.774273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec07f3-1aac-4f5d-9122-4b0fd715bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.774273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec07f3-1aac-4f5d-9122-4b0fd715bfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.791652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b9ec07f3-1aac-4f5d-9122-4b0fd715bfe9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:32.792916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b9ec07f3-1aac-4f5d-9122-4b0fd715bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:32.809170 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:32.837038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdde34-4b84-4f65-9a78-d980f06c1e16 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:32.884663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfd044-6626-47c7-8335-64df97ac9c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:32.884887 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 355/713] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:32.885033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfd044-6626-47c7-8335-64df97ac9c89 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.885116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec07f3-1aac-4f5d-9122-4b0fd715bfe9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:32.885189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfd044-6626-47c7-8335-64df97ac9c89 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.885189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfd044-6626-47c7-8335-64df97ac9c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.885189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfd044-6626-47c7-8335-64df97ac9c89 None admin] RBAC: Adding query filter params (role.id=56da0eaf554e400ebd2272a01016c3ab, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=b9187894d0574f6e887a98b8563b6d32) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:32.885189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfd044-6626-47c7-8335-64df97ac9c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:32.885189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfd044-6626-47c7-8335-64df97ac9c89 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:32.885705 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:32.901183 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 359/714] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:32 2022] GET /identity/v3/role_assignments?user.id=b9187894d0574f6e887a98b8563b6d32&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=56da0eaf554e400ebd2272a01016c3ab => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:33.086033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec07f3-1aac-4f5d-9122-4b0fd715bfe9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:33.125811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09bf17-732b-453b-a0c8-4b534b04c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:33.126353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09bf17-732b-453b-a0c8-4b534b04c816 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.126639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09bf17-732b-453b-a0c8-4b534b04c816 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.126914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09bf17-732b-453b-a0c8-4b534b04c816 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.127584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09bf17-732b-453b-a0c8-4b534b04c816 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:33.128996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09bf17-732b-453b-a0c8-4b534b04c816 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:33.151872 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 356/715] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:29:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:33.322279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfd044-6626-47c7-8335-64df97ac9c89 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:33.337947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8d5e3-52e9-47fb-9603-8e1eedc1b187 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.338237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8d5e3-52e9-47fb-9603-8e1eedc1b187 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.338518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8d5e3-52e9-47fb-9603-8e1eedc1b187 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.339876 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 357/716] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:33.345776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e84de-3f80-47b7-b5c4-93e3dccda701 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.346053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e84de-3f80-47b7-b5c4-93e3dccda701 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.346314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e84de-3f80-47b7-b5c4-93e3dccda701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.355589 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:33.375477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-351e84de-3f80-47b7-b5c4-93e3dccda701 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:33.377608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-351e84de-3f80-47b7-b5c4-93e3dccda701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:33.473914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfd044-6626-47c7-8335-64df97ac9c89 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:33.495925 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 358/717] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:33.517218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4657d40-5aab-496e-9098-f975d0b23543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:33.517863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4657d40-5aab-496e-9098-f975d0b23543 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.518138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4657d40-5aab-496e-9098-f975d0b23543 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.518440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4657d40-5aab-496e-9098-f975d0b23543 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.519100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4657d40-5aab-496e-9098-f975d0b23543 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:33.520510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4657d40-5aab-496e-9098-f975d0b23543 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-b4657d40-5aab-496e-9098-f975d0b23543 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:33.530115 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:33.531696 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:33.532572 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 360/718] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:33.541047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e84de-3f80-47b7-b5c4-93e3dccda701 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:33.654427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e84de-3f80-47b7-b5c4-93e3dccda701 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:33.689034 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:33.696233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14b2e-4d71-437a-b843-b4bba9b02969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:33.697874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14b2e-4d71-437a-b843-b4bba9b02969 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.697874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14b2e-4d71-437a-b843-b4bba9b02969 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.698218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14b2e-4d71-437a-b843-b4bba9b02969 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.698762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14b2e-4d71-437a-b843-b4bba9b02969 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:33.699072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14b2e-4d71-437a-b843-b4bba9b02969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:33.700504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14b2e-4d71-437a-b843-b4bba9b02969 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:33.706571 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 359/719] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:33.712866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4657d40-5aab-496e-9098-f975d0b23543 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:33.768375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14b2e-4d71-437a-b843-b4bba9b02969 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:33.794238 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:33.842476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4657d40-5aab-496e-9098-f975d0b23543 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:33.884216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a168f0c-f415-4cc7-887a-4b32975f3f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:33.884966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a168f0c-f415-4cc7-887a-4b32975f3f93 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.885242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a168f0c-f415-4cc7-887a-4b32975f3f93 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.885610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a168f0c-f415-4cc7-887a-4b32975f3f93 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.886250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a168f0c-f415-4cc7-887a-4b32975f3f93 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:33.886549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a168f0c-f415-4cc7-887a-4b32975f3f93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:33.887943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a168f0c-f415-4cc7-887a-4b32975f3f93 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:33.888388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14b2e-4d71-437a-b843-b4bba9b02969 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:33.893921 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 361/720] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:33.936426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209e0a-603d-4c48-b347-f8e006cfbf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:33.937113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209e0a-603d-4c48-b347-f8e006cfbf1b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.937525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209e0a-603d-4c48-b347-f8e006cfbf1b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.937798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209e0a-603d-4c48-b347-f8e006cfbf1b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.938457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209e0a-603d-4c48-b347-f8e006cfbf1b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:33.939865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209e0a-603d-4c48-b347-f8e006cfbf1b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-1f209e0a-603d-4c48-b347-f8e006cfbf1b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:33.950035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:33.952485 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:33.961475 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 360/721] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:29:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:33.963806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a168f0c-f415-4cc7-887a-4b32975f3f93 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:34.086166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a168f0c-f415-4cc7-887a-4b32975f3f93 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:34.118122 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:34.129123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01e9c0-2a96-45b7-aa14-6d7cf7113b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:34.129752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01e9c0-2a96-45b7-aa14-6d7cf7113b22 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:34.130036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01e9c0-2a96-45b7-aa14-6d7cf7113b22 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:34.130302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01e9c0-2a96-45b7-aa14-6d7cf7113b22 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:34.130952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01e9c0-2a96-45b7-aa14-6d7cf7113b22 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:34.131255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01e9c0-2a96-45b7-aa14-6d7cf7113b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:34.132662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01e9c0-2a96-45b7-aa14-6d7cf7113b22 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:34.138601 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 362/722] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:29:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:34.144569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209e0a-603d-4c48-b347-f8e006cfbf1b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:34.213829 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:34.279360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209e0a-603d-4c48-b347-f8e006cfbf1b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:34.329633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5d2aa-618d-4214-83c5-bdb5f2f0fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:34.330261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5d2aa-618d-4214-83c5-bdb5f2f0fe5d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:34.330603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5d2aa-618d-4214-83c5-bdb5f2f0fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:34.330877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5d2aa-618d-4214-83c5-bdb5f2f0fe5d None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:34.331515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5d2aa-618d-4214-83c5-bdb5f2f0fe5d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:34.331813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5d2aa-618d-4214-83c5-bdb5f2f0fe5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:34.333220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5d2aa-618d-4214-83c5-bdb5f2f0fe5d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:34.339351 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 361/723] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 19 00:29:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:34.346548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01e9c0-2a96-45b7-aa14-6d7cf7113b22 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:34.487863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01e9c0-2a96-45b7-aa14-6d7cf7113b22 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:34.524280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06d898-c46f-4955-8fd3-7fdc756559e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:34.524930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06d898-c46f-4955-8fd3-7fdc756559e1 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:34.525198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06d898-c46f-4955-8fd3-7fdc756559e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:34.525470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06d898-c46f-4955-8fd3-7fdc756559e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:34.526158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06d898-c46f-4955-8fd3-7fdc756559e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:34.527523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06d898-c46f-4955-8fd3-7fdc756559e1 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:34.551475 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 363/724] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:29:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:35.338933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48e5f3-141f-41f0-b01b-926b21f2eec7 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:35.339990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48e5f3-141f-41f0-b01b-926b21f2eec7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:35.340485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48e5f3-141f-41f0-b01b-926b21f2eec7 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:35.343038 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 362/725] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:35.349958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff779fda-fa41-4fa7-9de5-c0eb6450686b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:35.350890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff779fda-fa41-4fa7-9de5-c0eb6450686b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:35.351399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff779fda-fa41-4fa7-9de5-c0eb6450686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:35.377155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ff779fda-fa41-4fa7-9de5-c0eb6450686b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:35.378966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ff779fda-fa41-4fa7-9de5-c0eb6450686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:35.441912 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:35.496880 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 364/726] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:35.729716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2578d-f1f3-45d1-9339-ac711ff17256 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:35.730373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2578d-f1f3-45d1-9339-ac711ff17256 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:35.730853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2578d-f1f3-45d1-9339-ac711ff17256 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:35.732769 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 363/727] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:35.739130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439eb43-2611-48fa-9350-419347c1cca7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:35.739724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439eb43-2611-48fa-9350-419347c1cca7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:35.740200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439eb43-2611-48fa-9350-419347c1cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:35.759681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0439eb43-2611-48fa-9350-419347c1cca7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:35.761301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0439eb43-2611-48fa-9350-419347c1cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:35.836658 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 365/728] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:35.904586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2578d-f1f3-45d1-9339-ac711ff17256 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:36.024950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2578d-f1f3-45d1-9339-ac711ff17256 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:36.057437 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:36.063286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50849877-5dad-46c5-8a91-d25808ea67ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:36.063933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50849877-5dad-46c5-8a91-d25808ea67ed None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.064210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50849877-5dad-46c5-8a91-d25808ea67ed None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.064479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50849877-5dad-46c5-8a91-d25808ea67ed None admin] PATH_INFO: `/v3/services/image` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.065091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50849877-5dad-46c5-8a91-d25808ea67ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:36.066458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50849877-5dad-46c5-8a91-d25808ea67ed None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-50849877-5dad-46c5-8a91-d25808ea67ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:36.076556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:36.077665 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:36.078908 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 364/729] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Oct 19 00:29:35 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:36.085060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439eb43-2611-48fa-9350-419347c1cca7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:36.140578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50849877-5dad-46c5-8a91-d25808ea67ed None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:36.250646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439eb43-2611-48fa-9350-419347c1cca7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:36.252920 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:36.308363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50849877-5dad-46c5-8a91-d25808ea67ed None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:36.320830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe92d9-8a5d-45bd-a222-61ca190bcd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:36.321862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe92d9-8a5d-45bd-a222-61ca190bcd0e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.322409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe92d9-8a5d-45bd-a222-61ca190bcd0e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.322892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe92d9-8a5d-45bd-a222-61ca190bcd0e None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.323869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe92d9-8a5d-45bd-a222-61ca190bcd0e None admin] RBAC: Adding query filter params (name=image) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:36.324399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe92d9-8a5d-45bd-a222-61ca190bcd0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:36.326048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe92d9-8a5d-45bd-a222-61ca190bcd0e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:36.335441 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 366/730] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:36.341332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe92d9-8a5d-45bd-a222-61ca190bcd0e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:36.364085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4a4b0-f667-42f6-bfd0-3731fdda094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:36.364795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4a4b0-f667-42f6-bfd0-3731fdda094a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.365132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4a4b0-f667-42f6-bfd0-3731fdda094a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.365577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4a4b0-f667-42f6-bfd0-3731fdda094a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.366414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4a4b0-f667-42f6-bfd0-3731fdda094a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:36.367931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4a4b0-f667-42f6-bfd0-3731fdda094a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-a1f4a4b0-f667-42f6-bfd0-3731fdda094a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:36.378276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:36.379377 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:36.380213 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:36.387445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 365/731] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:36.388740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4a4b0-f667-42f6-bfd0-3731fdda094a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:36.469296 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:36.513554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe92d9-8a5d-45bd-a222-61ca190bcd0e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:36.538283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4a4b0-f667-42f6-bfd0-3731fdda094a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:36.555676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0393f26-4136-4e1a-8fac-e9e9b08564b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:36.556918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0393f26-4136-4e1a-8fac-e9e9b08564b5 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.557502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0393f26-4136-4e1a-8fac-e9e9b08564b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.558086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0393f26-4136-4e1a-8fac-e9e9b08564b5 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.559181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0393f26-4136-4e1a-8fac-e9e9b08564b5 None admin] RBAC: Adding query filter params (type=image) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:36.559658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0393f26-4136-4e1a-8fac-e9e9b08564b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:36.561719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0393f26-4136-4e1a-8fac-e9e9b08564b5 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:36.577325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b068c5-9a22-465d-924c-68994acf87b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:36.578363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b068c5-9a22-465d-924c-68994acf87b5 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.578640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b068c5-9a22-465d-924c-68994acf87b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.578909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b068c5-9a22-465d-924c-68994acf87b5 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.579570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b068c5-9a22-465d-924c-68994acf87b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:36.579934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b068c5-9a22-465d-924c-68994acf87b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:36.581134 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 367/732] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:36.581388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b068c5-9a22-465d-924c-68994acf87b5 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:36.583039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1e7f4-8272-4149-ad3d-c772da2e35a1 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.583514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1e7f4-8272-4149-ad3d-c772da2e35a1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.584111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1e7f4-8272-4149-ad3d-c772da2e35a1 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.586407 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 368/733] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:36.601897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891791a9-79ce-4109-acb8-ad308f5789d1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.602672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891791a9-79ce-4109-acb8-ad308f5789d1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.603262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891791a9-79ce-4109-acb8-ad308f5789d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.604232 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 366/734] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:36.605412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b068c5-9a22-465d-924c-68994acf87b5 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:36.629846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-891791a9-79ce-4109-acb8-ad308f5789d1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:36.631572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-891791a9-79ce-4109-acb8-ad308f5789d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:36.672549 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:36.745082 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 369/735] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:36.776126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b068c5-9a22-465d-924c-68994acf87b5 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:36.805205 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:36.833669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337880-1f0e-4bb0-a647-f8569f4ea15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:36.834399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337880-1f0e-4bb0-a647-f8569f4ea15c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.834675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337880-1f0e-4bb0-a647-f8569f4ea15c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.834973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337880-1f0e-4bb0-a647-f8569f4ea15c None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.835701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2337880-1f0e-4bb0-a647-f8569f4ea15c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:36.836005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2337880-1f0e-4bb0-a647-f8569f4ea15c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:36.838027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2337880-1f0e-4bb0-a647-f8569f4ea15c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:36.845277 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 367/736] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:36.851628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891791a9-79ce-4109-acb8-ad308f5789d1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:36.860713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415842c5-e9a0-4d89-867c-9bbc22c23ef9 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.861379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415842c5-e9a0-4d89-867c-9bbc22c23ef9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.862191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415842c5-e9a0-4d89-867c-9bbc22c23ef9 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.866351 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 368/737] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:29:36.871259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57206-142a-4154-828f-05ca8bbd1506 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.871795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57206-142a-4154-828f-05ca8bbd1506 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.872279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57206-142a-4154-828f-05ca8bbd1506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.892554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d6f57206-142a-4154-828f-05ca8bbd1506 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:36.894247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d6f57206-142a-4154-828f-05ca8bbd1506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:36.992679 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 369/738] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:37.009359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891791a9-79ce-4109-acb8-ad308f5789d1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:37.054937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57206-142a-4154-828f-05ca8bbd1506 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:37.066230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f653-f425-4e81-a817-06eeeafff03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:37.066967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f653-f425-4e81-a817-06eeeafff03b None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:37.067250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f653-f425-4e81-a817-06eeeafff03b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:37.067521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f653-f425-4e81-a817-06eeeafff03b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:37.068240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94f653-f425-4e81-a817-06eeeafff03b None admin] RBAC: Adding query filter params (interface=admin, service_id=091fec89d02d4082a23719930206bee0, region_id=RegionOne) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:37.068548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94f653-f425-4e81-a817-06eeeafff03b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:37.070072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94f653-f425-4e81-a817-06eeeafff03b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:37.076512 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 370/739] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Oct 19 00:29:36 2022] GET /identity/v3/endpoints?service_id=091fec89d02d4082a23719930206bee0&interface=admin®ion_id=RegionOne => generated 193 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:37.083012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f653-f425-4e81-a817-06eeeafff03b None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:37.121532 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:37.209476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f653-f425-4e81-a817-06eeeafff03b None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:37.211328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57206-142a-4154-828f-05ca8bbd1506 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:37.229774 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:37.249916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da63fa-80a3-4e94-9b3d-e3e6d4b54bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:37.250801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da63fa-80a3-4e94-9b3d-e3e6d4b54bf8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:37.251221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da63fa-80a3-4e94-9b3d-e3e6d4b54bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:37.251634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da63fa-80a3-4e94-9b3d-e3e6d4b54bf8 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:37.252437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da63fa-80a3-4e94-9b3d-e3e6d4b54bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:37.254005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da63fa-80a3-4e94-9b3d-e3e6d4b54bf8 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:37.261413 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 371/740] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 19 00:29:37 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:29:37.278948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cbd03-f19c-4b04-b230-ea974b73771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:37.279886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cbd03-f19c-4b04-b230-ea974b73771f None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:37.280397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cbd03-f19c-4b04-b230-ea974b73771f None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:37.280967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cbd03-f19c-4b04-b230-ea974b73771f None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:37.281879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cbd03-f19c-4b04-b230-ea974b73771f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:37.283773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cbd03-f19c-4b04-b230-ea974b73771f None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:37.291408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da63fa-80a3-4e94-9b3d-e3e6d4b54bf8 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:37.304563 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 370/741] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:29:37 2022] POST /identity/v3/services => generated 242 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:29:37.416653 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:37.432031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da63fa-80a3-4e94-9b3d-e3e6d4b54bf8 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:37.484785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:37.485531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:37.485811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:37.486084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:37.486760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:37.488253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:37.491035 n-d-master-1 devstack@keystone.service[86424]: WARNING keystone.server.flask.common [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 19 00:29:37.511913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.sql.core [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 00:29:37.511913 n-d-master-1 devstack@keystone.service[86424]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:29:37.511913 n-d-master-1 devstack@keystone.service[86424]: [parameters: {'id': 'bdf843f564a2491abfaee495d58d47d6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 00:29:37.511913 n-d-master-1 devstack@keystone.service[86424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bdf843f564a2491abfaee495d58d47d6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bdf843f564a2491abfaee495d58d47d6. Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:29:37.529831 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result.read() Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:29:37.531898 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application yield resource Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise self.value Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application session.commit() Oct 19 00:29:37.532974 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:29:37.534808 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:29:37.535976 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result.read() Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:29:37.537012 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [parameters: {'id': 'bdf843f564a2491abfaee495d58d47d6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:37.538256 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:37.545469 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bdf843f564a2491abfaee495d58d47d6. Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:37.546424 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 372/742] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Oct 19 00:29:37 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:37.547150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cbd03-f19c-4b04-b230-ea974b73771f None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:37.661846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cbd03-f19c-4b04-b230-ea974b73771f None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:37.698945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bc4e3-cbb7-4c9a-a45c-f97e6c38e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:37.699936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc4e3-cbb7-4c9a-a45c-f97e6c38e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:37.700425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc4e3-cbb7-4c9a-a45c-f97e6c38e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:37.700959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc4e3-cbb7-4c9a-a45c-f97e6c38e5e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:37.709281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bc4e3-cbb7-4c9a-a45c-f97e6c38e5e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:37.711055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bc4e3-cbb7-4c9a-a45c-f97e6c38e5e0 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-293bc4e3-cbb7-4c9a-a45c-f97e6c38e5e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:37.723556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:37.724493 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:37.725457 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:37.725457 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:37.725457 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:37.725457 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:37.725457 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:37.725457 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:37.725457 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:37.725457 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:37.727835 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 371/743] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:37.733815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:37.846781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d2b33-2df0-4c10-b33c-0d3d2e2568d8 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:37.882793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed45db4-bc72-4867-b328-5d2008820ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:37.883403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45db4-bc72-4867-b328-5d2008820ee8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:37.883679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45db4-bc72-4867-b328-5d2008820ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:37.883946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45db4-bc72-4867-b328-5d2008820ee8 None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:37.884611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed45db4-bc72-4867-b328-5d2008820ee8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:37.884932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed45db4-bc72-4867-b328-5d2008820ee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:37.886572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed45db4-bc72-4867-b328-5d2008820ee8 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:37.902186 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:37.912325 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 373/744] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:39.013856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0fff0-2d94-42ff-8dc8-7516376e494b None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:39.014403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0fff0-2d94-42ff-8dc8-7516376e494b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:39.014654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0fff0-2d94-42ff-8dc8-7516376e494b None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:39.016691 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 372/745] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:39.022182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8d2f3-3c32-47b1-985e-5155cd262ada None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:39.022659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8d2f3-3c32-47b1-985e-5155cd262ada None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:39.022740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8d2f3-3c32-47b1-985e-5155cd262ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:39.042728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4ae8d2f3-3c32-47b1-985e-5155cd262ada None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:39.044721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4ae8d2f3-3c32-47b1-985e-5155cd262ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:39.117906 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 374/746] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:39.400161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0fff0-2d94-42ff-8dc8-7516376e494b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:39.431445 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:39.519310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0fff0-2d94-42ff-8dc8-7516376e494b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:39.562936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a924c6-4d43-4f4c-b9a6-a02138993955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:39.563798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a924c6-4d43-4f4c-b9a6-a02138993955 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:39.564083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a924c6-4d43-4f4c-b9a6-a02138993955 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:39.564358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a924c6-4d43-4f4c-b9a6-a02138993955 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:39.565068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a924c6-4d43-4f4c-b9a6-a02138993955 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:39.566447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a924c6-4d43-4f4c-b9a6-a02138993955 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:39.583489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 373/747] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:29:39 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:39.634801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2830e-d603-44fe-9ea8-aeae61069442 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:39.635146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2830e-d603-44fe-9ea8-aeae61069442 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:39.635371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2830e-d603-44fe-9ea8-aeae61069442 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:39.637189 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 375/748] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:39.643388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa48c5-e068-40f0-b59c-b5bef8266265 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:39.643747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa48c5-e068-40f0-b59c-b5bef8266265 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:39.643959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa48c5-e068-40f0-b59c-b5bef8266265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:39.648056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5f8b-0c58-47ce-ba20-762feb332dbc None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:39.648405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5f8b-0c58-47ce-ba20-762feb332dbc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:39.648608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5f8b-0c58-47ce-ba20-762feb332dbc None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:39.650573 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 376/749] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:39.657103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743ecb1-6cf0-47a7-83ed-2c19c704e932 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:39.657427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743ecb1-6cf0-47a7-83ed-2c19c704e932 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:39.657662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743ecb1-6cf0-47a7-83ed-2c19c704e932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:39.669603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-44fa48c5-e068-40f0-b59c-b5bef8266265 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:39.670904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-44fa48c5-e068-40f0-b59c-b5bef8266265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:39.678256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3743ecb1-6cf0-47a7-83ed-2c19c704e932 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:39.679538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3743ecb1-6cf0-47a7-83ed-2c19c704e932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:39.775187 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 374/750] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:39 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:39.780091 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 377/751] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:39 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:40.055389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa48c5-e068-40f0-b59c-b5bef8266265 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.072506 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:40.076142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743ecb1-6cf0-47a7-83ed-2c19c704e932 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.154245 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:40.184241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa48c5-e068-40f0-b59c-b5bef8266265 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:40.221894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743ecb1-6cf0-47a7-83ed-2c19c704e932 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:40.226747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd120a8e-d893-452d-bbee-3cd3b1357cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:40.227628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd120a8e-d893-452d-bbee-3cd3b1357cbd None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.227926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd120a8e-d893-452d-bbee-3cd3b1357cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.228331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd120a8e-d893-452d-bbee-3cd3b1357cbd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.229065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd120a8e-d893-452d-bbee-3cd3b1357cbd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:40.230924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd120a8e-d893-452d-bbee-3cd3b1357cbd None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-bd120a8e-d893-452d-bbee-3cd3b1357cbd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:40.244743 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:40.246018 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:40.247183 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 375/752] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 19 00:29:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:40.255465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd120a8e-d893-452d-bbee-3cd3b1357cbd None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.279831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a7669-a39f-4a60-8b39-4d0cc8f88394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:40.281216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a7669-a39f-4a60-8b39-4d0cc8f88394 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.281533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a7669-a39f-4a60-8b39-4d0cc8f88394 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.281836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a7669-a39f-4a60-8b39-4d0cc8f88394 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.282686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a7669-a39f-4a60-8b39-4d0cc8f88394 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:40.284236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a7669-a39f-4a60-8b39-4d0cc8f88394 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-934a7669-a39f-4a60-8b39-4d0cc8f88394 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:40.297512 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:40.298949 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:40.305538 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 378/753] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:40.307823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a7669-a39f-4a60-8b39-4d0cc8f88394 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.371192 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:40.397124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd120a8e-d893-452d-bbee-3cd3b1357cbd None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:40.423539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a7669-a39f-4a60-8b39-4d0cc8f88394 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:40.437713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff76f9f-5297-4663-b888-9524298fb15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:40.438443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff76f9f-5297-4663-b888-9524298fb15c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.438715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff76f9f-5297-4663-b888-9524298fb15c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.438986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff76f9f-5297-4663-b888-9524298fb15c None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.439611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff76f9f-5297-4663-b888-9524298fb15c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:40.439912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff76f9f-5297-4663-b888-9524298fb15c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:40.441315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff76f9f-5297-4663-b888-9524298fb15c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:40.444872 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:40.455103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 376/754] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:40.455103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004ac1e-7115-43a7-a2a6-a310a6427c93 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.455103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004ac1e-7115-43a7-a2a6-a310a6427c93 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.455103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004ac1e-7115-43a7-a2a6-a310a6427c93 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.455103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 377/755] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:40.455103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004ac1e-7115-43a7-a2a6-a310a6427c93 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.461878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42e04-5ab6-4ab3-9032-f4e57a601c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:40.462753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42e04-5ab6-4ab3-9032-f4e57a601c6a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.463036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42e04-5ab6-4ab3-9032-f4e57a601c6a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.463333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42e04-5ab6-4ab3-9032-f4e57a601c6a None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.463952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42e04-5ab6-4ab3-9032-f4e57a601c6a None admin] RBAC: Adding query filter params (name=compute) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:40.464255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42e04-5ab6-4ab3-9032-f4e57a601c6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:40.465697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42e04-5ab6-4ab3-9032-f4e57a601c6a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:40.475881 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 379/756] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:40.477214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55163a-a5c7-4b03-bc03-2e4931930162 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.477502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55163a-a5c7-4b03-bc03-2e4931930162 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.477781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55163a-a5c7-4b03-bc03-2e4931930162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.495718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3e55163a-a5c7-4b03-bc03-2e4931930162 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:40.496959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3e55163a-a5c7-4b03-bc03-2e4931930162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:40.566694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004ac1e-7115-43a7-a2a6-a310a6427c93 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:40.584650 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 380/757] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:40 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:40.584650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55163a-a5c7-4b03-bc03-2e4931930162 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.608876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab3d9b-f915-45d5-8e23-017317ade069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:40.610035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab3d9b-f915-45d5-8e23-017317ade069 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.610315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab3d9b-f915-45d5-8e23-017317ade069 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.610734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab3d9b-f915-45d5-8e23-017317ade069 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.611500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab3d9b-f915-45d5-8e23-017317ade069 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:40.611804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab3d9b-f915-45d5-8e23-017317ade069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:40.614166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab3d9b-f915-45d5-8e23-017317ade069 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:40.621638 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 378/758] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 19 00:29:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:40.627928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab3d9b-f915-45d5-8e23-017317ade069 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.639754 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:40.704120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55163a-a5c7-4b03-bc03-2e4931930162 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:40.721908 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:40.754417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94ba17-d83e-42d0-96e6-e323a8a44717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:40.755033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94ba17-d83e-42d0-96e6-e323a8a44717 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.755311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94ba17-d83e-42d0-96e6-e323a8a44717 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.755585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94ba17-d83e-42d0-96e6-e323a8a44717 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.756220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94ba17-d83e-42d0-96e6-e323a8a44717 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:40.756537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94ba17-d83e-42d0-96e6-e323a8a44717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:40.757947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94ba17-d83e-42d0-96e6-e323a8a44717 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:40.771778 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 381/759] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:40.771990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab3d9b-f915-45d5-8e23-017317ade069 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:40.774204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94ba17-d83e-42d0-96e6-e323a8a44717 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.814581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad37996-b3fb-4ddc-b616-722cabe749a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:40.815822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad37996-b3fb-4ddc-b616-722cabe749a1 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.816786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad37996-b3fb-4ddc-b616-722cabe749a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.817405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad37996-b3fb-4ddc-b616-722cabe749a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.818320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad37996-b3fb-4ddc-b616-722cabe749a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:40.820096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad37996-b3fb-4ddc-b616-722cabe749a1 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:40.842740 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 379/760] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:29:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:40.862263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad37996-b3fb-4ddc-b616-722cabe749a1 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.929765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94ba17-d83e-42d0-96e6-e323a8a44717 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:40.951115 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:40.999931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f311-ceb1-4175-b95d-37fa13b14a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:41.001143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f311-ceb1-4175-b95d-37fa13b14a2e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:41.001715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f311-ceb1-4175-b95d-37fa13b14a2e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:41.002001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f311-ceb1-4175-b95d-37fa13b14a2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:41.002739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5f311-ceb1-4175-b95d-37fa13b14a2e None admin] RBAC: Adding query filter params (interface=public, service_id=a6afb4519bc94d48a440d027918d3f38, region_id=RegionOne) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:41.003060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5f311-ceb1-4175-b95d-37fa13b14a2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:41.004651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad37996-b3fb-4ddc-b616-722cabe749a1 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:41.004803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5f311-ceb1-4175-b95d-37fa13b14a2e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:41.017298 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 382/761] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 19 00:29:40 2022] GET /identity/v3/endpoints?service_id=a6afb4519bc94d48a440d027918d3f38&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:41.019045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f311-ceb1-4175-b95d-37fa13b14a2e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:41.050995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:41.051691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:41.052039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:41.052386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:41.053146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:41.054640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:41.057239 n-d-master-1 devstack@keystone.service[86425]: WARNING keystone.server.flask.common [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 19 00:29:41.070419 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:41.071428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.sql.core [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 00:29:41.071428 n-d-master-1 devstack@keystone.service[86425]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 00:29:41.071428 n-d-master-1 devstack@keystone.service[86425]: [parameters: {'user_id': '8678fdc55a96461986a38151f9f55eb5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 00:29:41.071428 n-d-master-1 devstack@keystone.service[86425]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86425) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result.read() Oct 19 00:29:41.079852 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:29:41.080968 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application yield resource Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise self.value Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application session.commit() Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:29:41.081993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:29:41.082873 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:29:41.083744 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result.read() Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:29:41.084601 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [parameters: {'user_id': '8678fdc55a96461986a38151f9f55eb5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:41.085529 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 19 00:29:41.086337 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 19 00:29:41.087521 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 19 00:29:41.087521 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 19 00:29:41.087521 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:29:41.087521 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:29:41.087521 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 00:29:41.087521 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:41.087521 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 380/762] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 19 00:29:40 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:41.095725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:41.161118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f311-ceb1-4175-b95d-37fa13b14a2e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:41.205009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c669fa0-15e9-45b5-af09-6fb1cb7fb932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:41.206144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c669fa0-15e9-45b5-af09-6fb1cb7fb932 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:41.206440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c669fa0-15e9-45b5-af09-6fb1cb7fb932 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:41.206714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c669fa0-15e9-45b5-af09-6fb1cb7fb932 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:41.207608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c669fa0-15e9-45b5-af09-6fb1cb7fb932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:41.209185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c669fa0-15e9-45b5-af09-6fb1cb7fb932 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:41.219605 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 383/763] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 19 00:29:41 2022] GET /identity/v3/services => generated 1957 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:29:41.220259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f001f-3b10-4e93-bc2d-54fdc9540791 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:41.270400 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:41.282860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244d21a-f979-464e-b360-946fcea1fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:41.283891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244d21a-f979-464e-b360-946fcea1fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:41.284212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244d21a-f979-464e-b360-946fcea1fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:41.284587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244d21a-f979-464e-b360-946fcea1fdd2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:41.295826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244d21a-f979-464e-b360-946fcea1fdd2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:41.298268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244d21a-f979-464e-b360-946fcea1fdd2 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-8244d21a-f979-464e-b360-946fcea1fdd2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:41.312542 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:41.313577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:41.314674 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 381/764] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:29:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:41.320702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c669fa0-15e9-45b5-af09-6fb1cb7fb932 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:41.436678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c669fa0-15e9-45b5-af09-6fb1cb7fb932 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:41.438517 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:41.483527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844947c4-2867-4e7e-901f-e99ea60ab5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:41.485184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844947c4-2867-4e7e-901f-e99ea60ab5e1 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:41.485685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844947c4-2867-4e7e-901f-e99ea60ab5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:41.486211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844947c4-2867-4e7e-901f-e99ea60ab5e1 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:41.487281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844947c4-2867-4e7e-901f-e99ea60ab5e1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:41.487824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844947c4-2867-4e7e-901f-e99ea60ab5e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:41.489685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844947c4-2867-4e7e-901f-e99ea60ab5e1 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:41.537146 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 384/765] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 19 00:29:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:41.892152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066787b9-0d62-4949-8536-8214a8745711 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:41.892529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066787b9-0d62-4949-8536-8214a8745711 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:41.892819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066787b9-0d62-4949-8536-8214a8745711 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:41.897152 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 382/766] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:41.903188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d56a-b03e-4f66-b5a6-9f513d85ec09 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:41.903488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d56a-b03e-4f66-b5a6-9f513d85ec09 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:41.903753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d56a-b03e-4f66-b5a6-9f513d85ec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:41.922039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c526d56a-b03e-4f66-b5a6-9f513d85ec09 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:41.923231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c526d56a-b03e-4f66-b5a6-9f513d85ec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:41.996799 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 385/767] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:41 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:42.267461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066787b9-0d62-4949-8536-8214a8745711 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:42.372669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066787b9-0d62-4949-8536-8214a8745711 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:42.408004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76902f-25fe-4360-9f2e-26c626e3b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:42.408661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76902f-25fe-4360-9f2e-26c626e3b8bf None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:42.408946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76902f-25fe-4360-9f2e-26c626e3b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:42.409219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76902f-25fe-4360-9f2e-26c626e3b8bf None admin] PATH_INFO: `/v3/services/image` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:42.409801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76902f-25fe-4360-9f2e-26c626e3b8bf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:42.411164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76902f-25fe-4360-9f2e-26c626e3b8bf None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-be76902f-25fe-4360-9f2e-26c626e3b8bf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:42.420269 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:42.421347 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:29:42.422356 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:42.424953 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 383/768] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Oct 19 00:29:42 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:42.427286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d56a-b03e-4f66-b5a6-9f513d85ec09 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:42.520414 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:42.532272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d56a-b03e-4f66-b5a6-9f513d85ec09 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:42.567921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae598-14ae-43f6-b8f6-5f0b2a21282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:42.568735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae598-14ae-43f6-b8f6-5f0b2a21282d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:42.569021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae598-14ae-43f6-b8f6-5f0b2a21282d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:42.569345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae598-14ae-43f6-b8f6-5f0b2a21282d None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:42.569987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae598-14ae-43f6-b8f6-5f0b2a21282d None admin] RBAC: Adding query filter params (name=image) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:42.570291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae598-14ae-43f6-b8f6-5f0b2a21282d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:42.571681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae598-14ae-43f6-b8f6-5f0b2a21282d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:42.580911 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 386/769] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:42.582601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76902f-25fe-4360-9f2e-26c626e3b8bf None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:42.638655 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:42.688660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76902f-25fe-4360-9f2e-26c626e3b8bf None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:42.722748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f578eb-7088-4c8f-ba3a-18ea7f04a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:42.723355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f578eb-7088-4c8f-ba3a-18ea7f04a577 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:42.723630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f578eb-7088-4c8f-ba3a-18ea7f04a577 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:42.723900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f578eb-7088-4c8f-ba3a-18ea7f04a577 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:42.724522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f578eb-7088-4c8f-ba3a-18ea7f04a577 None admin] RBAC: Adding query filter params (type=image) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:42.724849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f578eb-7088-4c8f-ba3a-18ea7f04a577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:42.726201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f578eb-7088-4c8f-ba3a-18ea7f04a577 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:42.731641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 384/770] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:42.737516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae598-14ae-43f6-b8f6-5f0b2a21282d None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:42.839626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae598-14ae-43f6-b8f6-5f0b2a21282d None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:42.877688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce58c-d367-4c82-83de-f30e12ce640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:42.878324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce58c-d367-4c82-83de-f30e12ce640e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:42.878599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce58c-d367-4c82-83de-f30e12ce640e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:42.878866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce58c-d367-4c82-83de-f30e12ce640e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:42.879586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce58c-d367-4c82-83de-f30e12ce640e None admin] RBAC: Adding query filter params (interface=public, service_id=afccf1a9f5ea460b904e1f5d09bb5d2c, region_id=RegionOne) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:42.879888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce58c-d367-4c82-83de-f30e12ce640e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:42.881354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce58c-d367-4c82-83de-f30e12ce640e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:42.892108 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 387/771] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 19 00:29:42 2022] GET /identity/v3/endpoints?service_id=afccf1a9f5ea460b904e1f5d09bb5d2c&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:42.893596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f578eb-7088-4c8f-ba3a-18ea7f04a577 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:43.005997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f578eb-7088-4c8f-ba3a-18ea7f04a577 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:43.025030 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:43.052663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0834c-3762-4433-92f6-f518b9b4e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:43.053305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0834c-3762-4433-92f6-f518b9b4e633 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:43.053584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0834c-3762-4433-92f6-f518b9b4e633 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:43.053853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0834c-3762-4433-92f6-f518b9b4e633 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:43.054464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0834c-3762-4433-92f6-f518b9b4e633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:43.055834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0834c-3762-4433-92f6-f518b9b4e633 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:43.068655 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 385/772] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 19 00:29:42 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:29:43.241433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f197-1e16-4041-a8f3-1f386c829cc6 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:43.241629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f197-1e16-4041-a8f3-1f386c829cc6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:43.241915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f197-1e16-4041-a8f3-1f386c829cc6 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:43.243437 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 388/773] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:43.248962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35b21-0e8e-455c-8a0c-1e2669f2b00d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:43.249272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35b21-0e8e-455c-8a0c-1e2669f2b00d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:43.249693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35b21-0e8e-455c-8a0c-1e2669f2b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:43.269289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0ac35b21-0e8e-455c-8a0c-1e2669f2b00d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:43.270826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0ac35b21-0e8e-455c-8a0c-1e2669f2b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:43.345330 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 386/774] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:43.477901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a469ad-d208-4756-b4b2-705deb375447 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:43.478424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a469ad-d208-4756-b4b2-705deb375447 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:43.478531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a469ad-d208-4756-b4b2-705deb375447 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:43.479932 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 389/775] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:43.485023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b6ade-5512-41fe-b17f-934ff30d3588 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:43.485311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b6ade-5512-41fe-b17f-934ff30d3588 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:43.485583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b6ade-5512-41fe-b17f-934ff30d3588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:43.504294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-772b6ade-5512-41fe-b17f-934ff30d3588 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:43.505436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-772b6ade-5512-41fe-b17f-934ff30d3588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:43.576926 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 387/776] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:43.619934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a469ad-d208-4756-b4b2-705deb375447 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:43.641564 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:43.727803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a469ad-d208-4756-b4b2-705deb375447 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:43.764126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573443f-1b58-453a-9dea-50b90e5fd59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:43.764712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573443f-1b58-453a-9dea-50b90e5fd59f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:43.765576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573443f-1b58-453a-9dea-50b90e5fd59f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:43.765916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573443f-1b58-453a-9dea-50b90e5fd59f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:43.767174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573443f-1b58-453a-9dea-50b90e5fd59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:43.768636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573443f-1b58-453a-9dea-50b90e5fd59f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:43.772666 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 390/777] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:43.775938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b6ade-5512-41fe-b17f-934ff30d3588 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:43.849239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573443f-1b58-453a-9dea-50b90e5fd59f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:43.940318 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:43.951912 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:43.970528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573443f-1b58-453a-9dea-50b90e5fd59f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:44.008131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b6ade-5512-41fe-b17f-934ff30d3588 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:44.012818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704cb0b-216b-417d-90c1-3c64cf037644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:44.013471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704cb0b-216b-417d-90c1-3c64cf037644 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:44.013754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704cb0b-216b-417d-90c1-3c64cf037644 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:44.014029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704cb0b-216b-417d-90c1-3c64cf037644 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:44.014668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704cb0b-216b-417d-90c1-3c64cf037644 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:44.016217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704cb0b-216b-417d-90c1-3c64cf037644 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-4704cb0b-216b-417d-90c1-3c64cf037644 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:44.025454 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:44.026490 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:44.027340 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 391/778] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:44.033094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704cb0b-216b-417d-90c1-3c64cf037644 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:44.052015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a83a4c-c005-476c-88b8-c0aafe1bbf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:44.052655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a83a4c-c005-476c-88b8-c0aafe1bbf15 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:44.052926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a83a4c-c005-476c-88b8-c0aafe1bbf15 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:44.053202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a83a4c-c005-476c-88b8-c0aafe1bbf15 None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:44.053854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a83a4c-c005-476c-88b8-c0aafe1bbf15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:44.055278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a83a4c-c005-476c-88b8-c0aafe1bbf15 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:44.100654 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 388/779] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:29:43 2022] POST /identity/v3/projects => generated 311 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:44.158562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704cb0b-216b-417d-90c1-3c64cf037644 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:44.197445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807141f-87b9-4ca6-b1b7-4e9f07241e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:44.198079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807141f-87b9-4ca6-b1b7-4e9f07241e4e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:44.198362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807141f-87b9-4ca6-b1b7-4e9f07241e4e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:44.198644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807141f-87b9-4ca6-b1b7-4e9f07241e4e None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:44.199293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807141f-87b9-4ca6-b1b7-4e9f07241e4e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:44.199600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807141f-87b9-4ca6-b1b7-4e9f07241e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:44.201045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807141f-87b9-4ca6-b1b7-4e9f07241e4e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:44.212273 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 392/780] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:44.213460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a83a4c-c005-476c-88b8-c0aafe1bbf15 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:44.315393 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:44.325226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a83a4c-c005-476c-88b8-c0aafe1bbf15 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:44.363048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e1f94-7d14-40bf-97ab-7dc079fa056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:44.363668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e1f94-7d14-40bf-97ab-7dc079fa056b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:44.363947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e1f94-7d14-40bf-97ab-7dc079fa056b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:44.364217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e1f94-7d14-40bf-97ab-7dc079fa056b None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:44.364885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e1f94-7d14-40bf-97ab-7dc079fa056b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:44.365191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e1f94-7d14-40bf-97ab-7dc079fa056b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:44.366561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e1f94-7d14-40bf-97ab-7dc079fa056b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:44.374967 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 389/781] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 19 00:29:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:44.378536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807141f-87b9-4ca6-b1b7-4e9f07241e4e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:44.395459 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:44.485162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807141f-87b9-4ca6-b1b7-4e9f07241e4e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:44.519619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ff9f0-d511-4df4-809d-167c179cb55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:44.520233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ff9f0-d511-4df4-809d-167c179cb55b None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:44.520510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ff9f0-d511-4df4-809d-167c179cb55b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:44.520820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ff9f0-d511-4df4-809d-167c179cb55b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:44.521493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ff9f0-d511-4df4-809d-167c179cb55b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:44.522868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ff9f0-d511-4df4-809d-167c179cb55b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:44.545275 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 393/782] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:29:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:45.311982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5289d-e36f-4d35-a47b-473ad4306b31 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:45.312229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5289d-e36f-4d35-a47b-473ad4306b31 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:45.312456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5289d-e36f-4d35-a47b-473ad4306b31 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:45.313988 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 390/783] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:45.319169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c1d6-17d5-4c46-9eb6-4338a95af25f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:45.319462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c1d6-17d5-4c46-9eb6-4338a95af25f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:45.319738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c1d6-17d5-4c46-9eb6-4338a95af25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:45.339381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9ff7c1d6-17d5-4c46-9eb6-4338a95af25f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:45.340598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9ff7c1d6-17d5-4c46-9eb6-4338a95af25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:45.409193 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:45.423221 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 394/784] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:45.700395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5289d-e36f-4d35-a47b-473ad4306b31 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:45.806933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5289d-e36f-4d35-a47b-473ad4306b31 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:45.841399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52cde0-cc55-4081-8c1f-ebe451b6e34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:45.842033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52cde0-cc55-4081-8c1f-ebe451b6e34f None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:45.842314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52cde0-cc55-4081-8c1f-ebe451b6e34f None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:45.842585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52cde0-cc55-4081-8c1f-ebe451b6e34f None admin] PATH_INFO: `/v3/services/image` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:45.843718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52cde0-cc55-4081-8c1f-ebe451b6e34f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:45.845101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52cde0-cc55-4081-8c1f-ebe451b6e34f None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-1c52cde0-cc55-4081-8c1f-ebe451b6e34f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:45.854069 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:45.855156 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:29:45.855986 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:45.863289 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 391/785] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Oct 19 00:29:45 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:45.863536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c1d6-17d5-4c46-9eb6-4338a95af25f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:45.964828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c1d6-17d5-4c46-9eb6-4338a95af25f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:46.000599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5f523-c7e0-4ca1-8911-70ef634903df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:46.001233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5f523-c7e0-4ca1-8911-70ef634903df None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.001513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5f523-c7e0-4ca1-8911-70ef634903df None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.001787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5f523-c7e0-4ca1-8911-70ef634903df None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.002406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5f523-c7e0-4ca1-8911-70ef634903df None admin] RBAC: Adding query filter params (name=image) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:46.002710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5f523-c7e0-4ca1-8911-70ef634903df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:46.004347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5f523-c7e0-4ca1-8911-70ef634903df None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:46.014775 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 395/786] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:46.017100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52cde0-cc55-4081-8c1f-ebe451b6e34f None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.040737 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:46.140499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52cde0-cc55-4081-8c1f-ebe451b6e34f None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:46.178991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb6703-ed6b-4771-af80-9d4ce553a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:46.179613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb6703-ed6b-4771-af80-9d4ce553a173 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.179887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb6703-ed6b-4771-af80-9d4ce553a173 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.180157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb6703-ed6b-4771-af80-9d4ce553a173 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.180826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb6703-ed6b-4771-af80-9d4ce553a173 None admin] RBAC: Adding query filter params (type=image) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:46.181134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb6703-ed6b-4771-af80-9d4ce553a173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:46.182522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb6703-ed6b-4771-af80-9d4ce553a173 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:46.189154 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 392/787] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:46.194846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5f523-c7e0-4ca1-8911-70ef634903df None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.263590 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:46.309732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5f523-c7e0-4ca1-8911-70ef634903df None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:46.348608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721c3b-ac9a-43bb-96e7-cccc1a598626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:46.349249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721c3b-ac9a-43bb-96e7-cccc1a598626 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.349522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721c3b-ac9a-43bb-96e7-cccc1a598626 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.349789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721c3b-ac9a-43bb-96e7-cccc1a598626 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.350464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d721c3b-ac9a-43bb-96e7-cccc1a598626 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:46.351837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d721c3b-ac9a-43bb-96e7-cccc1a598626 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:46.359270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c6881-6a82-4bd7-895e-6cbcb44d38d6 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.359683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c6881-6a82-4bd7-895e-6cbcb44d38d6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.359879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c6881-6a82-4bd7-895e-6cbcb44d38d6 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.361468 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 393/788] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:46.367478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f035-a347-42ac-9435-8343d854a549 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.367766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f035-a347-42ac-9435-8343d854a549 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.368039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f035-a347-42ac-9435-8343d854a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.377622 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 396/789] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:29:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:46.398396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7385f035-a347-42ac-9435-8343d854a549 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:46.399638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7385f035-a347-42ac-9435-8343d854a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:46.492678 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 394/790] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:46.758757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721c3b-ac9a-43bb-96e7-cccc1a598626 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.861442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c39e-8e66-41ba-ae52-4b3a20e4db1a None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.861968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c39e-8e66-41ba-ae52-4b3a20e4db1a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.861968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c39e-8e66-41ba-ae52-4b3a20e4db1a None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.863573 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 395/791] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:46.868168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721c3b-ac9a-43bb-96e7-cccc1a598626 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:46.868644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca3386-0e3a-4888-8c7b-619c4f25d7e1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.868644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca3386-0e3a-4888-8c7b-619c4f25d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.868912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca3386-0e3a-4888-8c7b-619c4f25d7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.886342 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:46.888653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-33ca3386-0e3a-4888-8c7b-619c4f25d7e1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:46.889968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-33ca3386-0e3a-4888-8c7b-619c4f25d7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:46.893260 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:46.908519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6438a1a-f44b-4184-8d0c-08d2251500f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:46.909436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6438a1a-f44b-4184-8d0c-08d2251500f8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:46.909716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6438a1a-f44b-4184-8d0c-08d2251500f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:46.909992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6438a1a-f44b-4184-8d0c-08d2251500f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:46.911095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6438a1a-f44b-4184-8d0c-08d2251500f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:46.912523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6438a1a-f44b-4184-8d0c-08d2251500f8 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:46.914139 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 397/792] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:46.919764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6438a1a-f44b-4184-8d0c-08d2251500f8 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:46.969062 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 396/793] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:47.027044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6438a1a-f44b-4184-8d0c-08d2251500f8 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:47.063459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e771-8d9d-4bc5-af69-caac86c8cf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:47.064072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e771-8d9d-4bc5-af69-caac86c8cf08 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:47.064346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e771-8d9d-4bc5-af69-caac86c8cf08 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:47.064613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e771-8d9d-4bc5-af69-caac86c8cf08 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:47.065293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e771-8d9d-4bc5-af69-caac86c8cf08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:47.066707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e771-8d9d-4bc5-af69-caac86c8cf08 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:47.092365 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 398/794] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:29:46 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:29:47.240053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca3386-0e3a-4888-8c7b-619c4f25d7e1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:47.351445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca3386-0e3a-4888-8c7b-619c4f25d7e1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:47.387755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98d63f-485b-4dae-bacf-87207f3ea29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:47.388386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98d63f-485b-4dae-bacf-87207f3ea29c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:47.388686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98d63f-485b-4dae-bacf-87207f3ea29c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:47.388959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98d63f-485b-4dae-bacf-87207f3ea29c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:47.397531 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:47.401104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98d63f-485b-4dae-bacf-87207f3ea29c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-2e98d63f-485b-4dae-bacf-87207f3ea29c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:47.406867 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:47.408050 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:29:47.409129 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:47.411718 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 397/795] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 19 00:29:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:47.417369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e771-8d9d-4bc5-af69-caac86c8cf08 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:47.460229 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:47.522742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e771-8d9d-4bc5-af69-caac86c8cf08 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:47.557324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af8cbc-6e6c-4b21-9af1-46620e9985fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:47.557934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af8cbc-6e6c-4b21-9af1-46620e9985fe None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:47.558209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af8cbc-6e6c-4b21-9af1-46620e9985fe None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:47.558476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af8cbc-6e6c-4b21-9af1-46620e9985fe None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:47.559140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af8cbc-6e6c-4b21-9af1-46620e9985fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:47.559440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af8cbc-6e6c-4b21-9af1-46620e9985fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:47.560840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af8cbc-6e6c-4b21-9af1-46620e9985fe None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:47.575851 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 399/796] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Oct 19 00:29:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:47.577491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98d63f-485b-4dae-bacf-87207f3ea29c None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:47.680651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98d63f-485b-4dae-bacf-87207f3ea29c None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:47.716388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4c0c-026f-455a-8445-de4f05503f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:47.717048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4c0c-026f-455a-8445-de4f05503f89 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:47.717330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4c0c-026f-455a-8445-de4f05503f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:47.717606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4c0c-026f-455a-8445-de4f05503f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:47.728189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4c0c-026f-455a-8445-de4f05503f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:47.729676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4c0c-026f-455a-8445-de4f05503f89 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-c24b4c0c-026f-455a-8445-de4f05503f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:47.744951 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:47.745922 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:47.746920 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:47.746920 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:47.746920 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:47.746920 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 398/797] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:47.754070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af8cbc-6e6c-4b21-9af1-46620e9985fe None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:47.858364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af8cbc-6e6c-4b21-9af1-46620e9985fe None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:47.860259 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:47.899398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0e643-5268-42b1-a410-f7d0a599c0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:47.900045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0e643-5268-42b1-a410-f7d0a599c0dd None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:47.900386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0e643-5268-42b1-a410-f7d0a599c0dd None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:47.900582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0e643-5268-42b1-a410-f7d0a599c0dd None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:47.901237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0e643-5268-42b1-a410-f7d0a599c0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:47.901543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0e643-5268-42b1-a410-f7d0a599c0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:47.902919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0e643-5268-42b1-a410-f7d0a599c0dd None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:47.920023 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 400/798] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:47.921801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4c0c-026f-455a-8445-de4f05503f89 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:47.976748 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:48.026975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4c0c-026f-455a-8445-de4f05503f89 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:48.068660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b565c94-43b1-43eb-b023-6c2ed130550d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:48.069288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565c94-43b1-43eb-b023-6c2ed130550d None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:48.069573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565c94-43b1-43eb-b023-6c2ed130550d None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:48.069845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565c94-43b1-43eb-b023-6c2ed130550d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:48.077617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565c94-43b1-43eb-b023-6c2ed130550d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:48.079053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565c94-43b1-43eb-b023-6c2ed130550d None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-4b565c94-43b1-43eb-b023-6c2ed130550d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:48.091749 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:48.093357 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:48.094490 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 399/799] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 19 00:29:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:48.101166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0e643-5268-42b1-a410-f7d0a599c0dd None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:48.208803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0e643-5268-42b1-a410-f7d0a599c0dd None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:48.243236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47ccde-3658-4b7d-a03b-b72efcc4103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:48.243760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ccde-3658-4b7d-a03b-b72efcc4103c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:48.244040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ccde-3658-4b7d-a03b-b72efcc4103c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:48.244315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ccde-3658-4b7d-a03b-b72efcc4103c None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:48.245070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47ccde-3658-4b7d-a03b-b72efcc4103c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:48.245376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47ccde-3658-4b7d-a03b-b72efcc4103c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:48.246822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47ccde-3658-4b7d-a03b-b72efcc4103c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:48.265184 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 401/800] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 19 00:29:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:48.270775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b565c94-43b1-43eb-b023-6c2ed130550d None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:48.372246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b565c94-43b1-43eb-b023-6c2ed130550d None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:48.387852 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:48.410660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded7c82-7fd2-4be5-bd06-e7dbc9f7c9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:48.411290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded7c82-7fd2-4be5-bd06-e7dbc9f7c9d1 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:48.411561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded7c82-7fd2-4be5-bd06-e7dbc9f7c9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:48.411824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded7c82-7fd2-4be5-bd06-e7dbc9f7c9d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:48.422829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded7c82-7fd2-4be5-bd06-e7dbc9f7c9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:48.424259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded7c82-7fd2-4be5-bd06-e7dbc9f7c9d1 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-2ded7c82-7fd2-4be5-bd06-e7dbc9f7c9d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:48.438637 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:48.439616 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:48.445320 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:48.445320 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:48.445320 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:48.445320 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 400/801] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:48.445846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47ccde-3658-4b7d-a03b-b72efcc4103c None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:48.469220 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:48.559893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47ccde-3658-4b7d-a03b-b72efcc4103c None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:48.594849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722ada8-fcce-40de-9652-87f68b29455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:48.595464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722ada8-fcce-40de-9652-87f68b29455d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:48.595744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722ada8-fcce-40de-9652-87f68b29455d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:48.596016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722ada8-fcce-40de-9652-87f68b29455d None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:48.596679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722ada8-fcce-40de-9652-87f68b29455d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:48.596983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722ada8-fcce-40de-9652-87f68b29455d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:48.598347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722ada8-fcce-40de-9652-87f68b29455d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:48.614932 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 402/802] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:48.616171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded7c82-7fd2-4be5-bd06-e7dbc9f7c9d1 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:48.635228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34640d4-48b7-4bf4-8bcc-7fca9d8a04a4 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:48.635515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34640d4-48b7-4bf4-8bcc-7fca9d8a04a4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:48.635797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34640d4-48b7-4bf4-8bcc-7fca9d8a04a4 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:48.637284 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 403/803] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:48.644240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd86d-39c8-461a-8cdd-1b192d302a9e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:48.644473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd86d-39c8-461a-8cdd-1b192d302a9e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:48.644705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd86d-39c8-461a-8cdd-1b192d302a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:48.663720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ee2bd86d-39c8-461a-8cdd-1b192d302a9e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:48.665011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ee2bd86d-39c8-461a-8cdd-1b192d302a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:48.730472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded7c82-7fd2-4be5-bd06-e7dbc9f7c9d1 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:48.738868 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 404/804] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:48.768966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bb6d6-6db4-48e1-91b8-bb9f65ec8836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:48.769598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bb6d6-6db4-48e1-91b8-bb9f65ec8836 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:48.769875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bb6d6-6db4-48e1-91b8-bb9f65ec8836 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:48.770145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bb6d6-6db4-48e1-91b8-bb9f65ec8836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:48.776996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bb6d6-6db4-48e1-91b8-bb9f65ec8836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:48.778422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bb6d6-6db4-48e1-91b8-bb9f65ec8836 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-a74bb6d6-6db4-48e1-91b8-bb9f65ec8836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:48.789582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:48.790537 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:48.791423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:48.791423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:48.791423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:48.791423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:48.791423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:48.791423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:48.791423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:48.791423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:48.791423 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 401/805] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:48.798123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bd86d-39c8-461a-8cdd-1b192d302a9e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:48.810219 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:48.900566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bd86d-39c8-461a-8cdd-1b192d302a9e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:48.934800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8008a81-f7cd-47bd-b0f6-4ad5921aaa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:48.935425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8008a81-f7cd-47bd-b0f6-4ad5921aaa36 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:48.935697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8008a81-f7cd-47bd-b0f6-4ad5921aaa36 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:48.935972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8008a81-f7cd-47bd-b0f6-4ad5921aaa36 None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:48.936856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8008a81-f7cd-47bd-b0f6-4ad5921aaa36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:48.937169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8008a81-f7cd-47bd-b0f6-4ad5921aaa36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:48.938780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8008a81-f7cd-47bd-b0f6-4ad5921aaa36 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:48.956012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 405/806] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:48.957225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bb6d6-6db4-48e1-91b8-bb9f65ec8836 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:48.985974 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:49.020382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8008a81-f7cd-47bd-b0f6-4ad5921aaa36 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:49.065111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bb6d6-6db4-48e1-91b8-bb9f65ec8836 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:49.103393 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:49.105830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98ddfe-97cd-4b23-9d93-d034f56de6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:49.106499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98ddfe-97cd-4b23-9d93-d034f56de6c7 None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:49.106769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98ddfe-97cd-4b23-9d93-d034f56de6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:49.107048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98ddfe-97cd-4b23-9d93-d034f56de6c7 None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0165e2f8b5e34c8d8570262c777de161/roles/56da0eaf554e400ebd2272a01016c3ab` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:49.109813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98ddfe-97cd-4b23-9d93-d034f56de6c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=0165e2f8b5e34c8d8570262c777de161, role_id=56da0eaf554e400ebd2272a01016c3ab)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:49.111242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98ddfe-97cd-4b23-9d93-d034f56de6c7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:49.125178 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 402/807] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:29:48 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0165e2f8b5e34c8d8570262c777de161/roles/56da0eaf554e400ebd2272a01016c3ab => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:29:49.143298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8008a81-f7cd-47bd-b0f6-4ad5921aaa36 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:49.184229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef2285-aa18-4ef0-84eb-e63de5dd1068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:49.185160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef2285-aa18-4ef0-84eb-e63de5dd1068 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:49.185596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef2285-aa18-4ef0-84eb-e63de5dd1068 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:49.186125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef2285-aa18-4ef0-84eb-e63de5dd1068 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:49.187152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef2285-aa18-4ef0-84eb-e63de5dd1068 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:49.188925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef2285-aa18-4ef0-84eb-e63de5dd1068 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:49.197787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.sql.core [None req-7fef2285-aa18-4ef0-84eb-e63de5dd1068 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:29:49.197787 n-d-master-1 devstack@keystone.service[86424]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:29:49.197787 n-d-master-1 devstack@keystone.service[86424]: [parameters: {'id': 'f0ca964cb11b4b088f1af74504aa02e8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:29:49.197787 n-d-master-1 devstack@keystone.service[86424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-7fef2285-aa18-4ef0-84eb-e63de5dd1068 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:29:49.207386 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result.read() Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:29:49.208517 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application yield resource Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise self.value Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application session.commit() Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:29:49.209736 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:29:49.210896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:29:49.212414 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result.read() Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:29:49.214156 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [parameters: {'id': 'f0ca964cb11b4b088f1af74504aa02e8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:29:49.216487 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:49.218622 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:49.221143 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 406/808] 10.222.0.27 () {60 vars in 1137 bytes} [Wed Oct 19 00:29:49 2022] POST /identity/v3/domains => generated 190 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:49.221851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98ddfe-97cd-4b23-9d93-d034f56de6c7 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:49.327050 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:49.348372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98ddfe-97cd-4b23-9d93-d034f56de6c7 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:49.368276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db47fa9-84ed-456b-8987-830246b544bd None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:49.368571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db47fa9-84ed-456b-8987-830246b544bd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:49.369039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db47fa9-84ed-456b-8987-830246b544bd None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:49.370463 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 407/809] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:29:49.376513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d4f2-6762-42f9-a4b2-3b5051653efb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:49.376833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d4f2-6762-42f9-a4b2-3b5051653efb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:49.377113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d4f2-6762-42f9-a4b2-3b5051653efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:49.390256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38e590-3ee1-450d-84d5-ea176e3da704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:49.390907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38e590-3ee1-450d-84d5-ea176e3da704 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:49.391182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38e590-3ee1-450d-84d5-ea176e3da704 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:49.391449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38e590-3ee1-450d-84d5-ea176e3da704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:49.396169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5046d4f2-6762-42f9-a4b2-3b5051653efb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:49.397456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5046d4f2-6762-42f9-a4b2-3b5051653efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:49.407757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38e590-3ee1-450d-84d5-ea176e3da704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:49.409373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38e590-3ee1-450d-84d5-ea176e3da704 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-7c38e590-3ee1-450d-84d5-ea176e3da704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:49.425219 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:49.426412 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:49.427484 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:49.427484 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:49.427484 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:49.427484 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 403/810] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:49.432473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38e590-3ee1-450d-84d5-ea176e3da704 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:49.484945 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 408/811] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:49.551633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38e590-3ee1-450d-84d5-ea176e3da704 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:49.587614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645585d-bf8e-44e3-98da-ddbd8f94f719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:49.588244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645585d-bf8e-44e3-98da-ddbd8f94f719 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:49.588524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645585d-bf8e-44e3-98da-ddbd8f94f719 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:49.588833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645585d-bf8e-44e3-98da-ddbd8f94f719 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:49.589502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645585d-bf8e-44e3-98da-ddbd8f94f719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:49.589812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645585d-bf8e-44e3-98da-ddbd8f94f719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:49.591229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645585d-bf8e-44e3-98da-ddbd8f94f719 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:49.594775 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:49.616651 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 404/812] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:49.758244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d4f2-6762-42f9-a4b2-3b5051653efb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:49.825010 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:49.867646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d4f2-6762-42f9-a4b2-3b5051653efb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:49.905939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb14e9c-01eb-46a5-9091-fdf631c059a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:49.906730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14e9c-01eb-46a5-9091-fdf631c059a0 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:49.906850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14e9c-01eb-46a5-9091-fdf631c059a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:49.907106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14e9c-01eb-46a5-9091-fdf631c059a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:49.918185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb14e9c-01eb-46a5-9091-fdf631c059a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-efb14e9c-01eb-46a5-9091-fdf631c059a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:49.923652 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:49.924880 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:49.925746 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 409/813] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:49.931127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645585d-bf8e-44e3-98da-ddbd8f94f719 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:50.038640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645585d-bf8e-44e3-98da-ddbd8f94f719 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:50.075109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc5a94-a5b7-49f3-ab23-cc43fffaef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:50.075707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc5a94-a5b7-49f3-ab23-cc43fffaef83 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:50.075989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc5a94-a5b7-49f3-ab23-cc43fffaef83 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:50.076254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc5a94-a5b7-49f3-ab23-cc43fffaef83 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:50.076930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc5a94-a5b7-49f3-ab23-cc43fffaef83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:50.077296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc5a94-a5b7-49f3-ab23-cc43fffaef83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:50.078906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc5a94-a5b7-49f3-ab23-cc43fffaef83 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:50.087276 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 405/814] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:50.094084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb14e9c-01eb-46a5-9091-fdf631c059a0 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:50.200851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb14e9c-01eb-46a5-9091-fdf631c059a0 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:50.224253 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:50.235321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7db78-091d-4989-964f-c37e46c5d4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:50.235956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7db78-091d-4989-964f-c37e46c5d4de None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:50.236240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7db78-091d-4989-964f-c37e46c5d4de None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:50.236517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7db78-091d-4989-964f-c37e46c5d4de None admin] PATH_INFO: `/v3/users/cc551120671342c89bc6b0f04b74ff89` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:50.250299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7db78-091d-4989-964f-c37e46c5d4de None admin] RBAC: Authorizing `identity:get_user(user_id=cc551120671342c89bc6b0f04b74ff89)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:50.251761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7db78-091d-4989-964f-c37e46c5d4de None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:50.253446 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 410/815] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:29:50 2022] GET /identity/v3/users/cc551120671342c89bc6b0f04b74ff89 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:50.259341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc5a94-a5b7-49f3-ab23-cc43fffaef83 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:50.319579 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:50.363115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc5a94-a5b7-49f3-ab23-cc43fffaef83 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:50.398537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf2085-9e45-4c66-810b-be9d04eda870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:50.399172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2085-9e45-4c66-810b-be9d04eda870 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:50.399452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2085-9e45-4c66-810b-be9d04eda870 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:50.399727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf2085-9e45-4c66-810b-be9d04eda870 None admin] PATH_INFO: `/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:50.400883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf2085-9e45-4c66-810b-be9d04eda870 None admin] RBAC: Authorizing `identity:get_project(project_id=fc60f3d5ad6047c2b1d3873c470ce3a2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:50.402323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf2085-9e45-4c66-810b-be9d04eda870 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:50.403980 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 406/816] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:29:50 2022] GET /identity/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:50.410614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7db78-091d-4989-964f-c37e46c5d4de None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:50.511007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7db78-091d-4989-964f-c37e46c5d4de None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:50.552590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f432038-29c4-47bb-b6a8-ef19dfc6ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:50.553287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432038-29c4-47bb-b6a8-ef19dfc6ea4a None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:50.553562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432038-29c4-47bb-b6a8-ef19dfc6ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:50.553833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432038-29c4-47bb-b6a8-ef19dfc6ea4a None admin] PATH_INFO: `/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2/users/cc551120671342c89bc6b0f04b74ff89/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:50.555683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f432038-29c4-47bb-b6a8-ef19dfc6ea4a None admin] RBAC: Authorizing `identity:create_grant(project_id=fc60f3d5ad6047c2b1d3873c470ce3a2, user_id=cc551120671342c89bc6b0f04b74ff89, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:50.557137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f432038-29c4-47bb-b6a8-ef19dfc6ea4a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:50.570347 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 411/817] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:29:50 2022] PUT /identity/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2/users/cc551120671342c89bc6b0f04b74ff89/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:29:51.392232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520e4a7-fa03-46c6-aea7-fbf4cf32e2b1 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:51.392787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520e4a7-fa03-46c6-aea7-fbf4cf32e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:51.392930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520e4a7-fa03-46c6-aea7-fbf4cf32e2b1 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:51.394283 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 407/818] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:51.399626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c38fb-db38-4d2b-a6e0-9977b1246089 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:51.400041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c38fb-db38-4d2b-a6e0-9977b1246089 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:51.400219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c38fb-db38-4d2b-a6e0-9977b1246089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:51.419413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ea8c38fb-db38-4d2b-a6e0-9977b1246089 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:51.420641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ea8c38fb-db38-4d2b-a6e0-9977b1246089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:51.460293 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:51.495926 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 412/819] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:51.773085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520e4a7-fa03-46c6-aea7-fbf4cf32e2b1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:51.879037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520e4a7-fa03-46c6-aea7-fbf4cf32e2b1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:51.906173 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:51.915400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246d1ce-9379-4210-92ac-a731545d09dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:51.916016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246d1ce-9379-4210-92ac-a731545d09dc None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:51.916294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246d1ce-9379-4210-92ac-a731545d09dc None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:51.916561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246d1ce-9379-4210-92ac-a731545d09dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:51.927296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246d1ce-9379-4210-92ac-a731545d09dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-3246d1ce-9379-4210-92ac-a731545d09dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:51.932047 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:51.933198 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:51.934063 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 408/820] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 19 00:29:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:51.939829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c38fb-db38-4d2b-a6e0-9977b1246089 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.043306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c38fb-db38-4d2b-a6e0-9977b1246089 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.076778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad6da2-020e-45e1-a074-435c8d0b8808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.078131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6da2-020e-45e1-a074-435c8d0b8808 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.078383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6da2-020e-45e1-a074-435c8d0b8808 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.078654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6da2-020e-45e1-a074-435c8d0b8808 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.079312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad6da2-020e-45e1-a074-435c8d0b8808 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:52.079639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad6da2-020e-45e1-a074-435c8d0b8808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.080991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad6da2-020e-45e1-a074-435c8d0b8808 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.096669 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 413/821] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Oct 19 00:29:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:52.097877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246d1ce-9379-4210-92ac-a731545d09dc None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.200977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246d1ce-9379-4210-92ac-a731545d09dc None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.236968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f3d8f-3d0d-4d97-9b6a-0367829a1180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.237599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3d8f-3d0d-4d97-9b6a-0367829a1180 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.237875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3d8f-3d0d-4d97-9b6a-0367829a1180 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.238147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3d8f-3d0d-4d97-9b6a-0367829a1180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.248259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f3d8f-3d0d-4d97-9b6a-0367829a1180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.250351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f3d8f-3d0d-4d97-9b6a-0367829a1180 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-536f3d8f-3d0d-4d97-9b6a-0367829a1180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:52.265108 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:52.266092 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:52.266982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:52.266982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:52.266982 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:52.266982 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 409/822] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:29:52.272642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad6da2-020e-45e1-a074-435c8d0b8808 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.307652 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:52.376011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad6da2-020e-45e1-a074-435c8d0b8808 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.409798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a2d5-d470-4b20-95f1-20552b249dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.410431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a2d5-d470-4b20-95f1-20552b249dfd None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.410683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a2d5-d470-4b20-95f1-20552b249dfd None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.410958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a2d5-d470-4b20-95f1-20552b249dfd None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.411605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898a2d5-d470-4b20-95f1-20552b249dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:52.411907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898a2d5-d470-4b20-95f1-20552b249dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.413370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898a2d5-d470-4b20-95f1-20552b249dfd None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.426204 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 414/823] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:52.431891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f3d8f-3d0d-4d97-9b6a-0367829a1180 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.473183 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:52.533630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f3d8f-3d0d-4d97-9b6a-0367829a1180 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.568151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa31f3f-97f3-4327-a7bd-78ae69c24da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.568723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa31f3f-97f3-4327-a7bd-78ae69c24da8 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.569002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa31f3f-97f3-4327-a7bd-78ae69c24da8 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.569269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa31f3f-97f3-4327-a7bd-78ae69c24da8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.576388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa31f3f-97f3-4327-a7bd-78ae69c24da8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.578446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa31f3f-97f3-4327-a7bd-78ae69c24da8 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-2aa31f3f-97f3-4327-a7bd-78ae69c24da8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:29:52.590344 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:52.591543 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:52.593100 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 410/824] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:52.597695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a2d5-d470-4b20-95f1-20552b249dfd None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.696597 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:52.704711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a2d5-d470-4b20-95f1-20552b249dfd None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.715208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb553979-5af7-40d6-a712-d1f0ab776966 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.715519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb553979-5af7-40d6-a712-d1f0ab776966 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.715793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb553979-5af7-40d6-a712-d1f0ab776966 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.717277 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 411/825] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:29:52.723236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2779-6ebd-44a9-a987-686598519faf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.723518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2779-6ebd-44a9-a987-686598519faf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.723793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2779-6ebd-44a9-a987-686598519faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.743379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cb3e2779-6ebd-44a9-a987-686598519faf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:52.743618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a432b0-f31f-4492-aa11-42a3fcf0c593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.744178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a432b0-f31f-4492-aa11-42a3fcf0c593 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.744464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a432b0-f31f-4492-aa11-42a3fcf0c593 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.744660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cb3e2779-6ebd-44a9-a987-686598519faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:52.744756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a432b0-f31f-4492-aa11-42a3fcf0c593 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:52.745488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a432b0-f31f-4492-aa11-42a3fcf0c593 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:52.745792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a432b0-f31f-4492-aa11-42a3fcf0c593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:52.747248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a432b0-f31f-4492-aa11-42a3fcf0c593 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:52.765754 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 415/826] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:52.771533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a432b0-f31f-4492-aa11-42a3fcf0c593 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:52.815882 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 412/827] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:52.868983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a432b0-f31f-4492-aa11-42a3fcf0c593 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:52.902547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71b3e-34fe-49d2-9b17-2ec6f4ee5aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:52.903143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71b3e-34fe-49d2-9b17-2ec6f4ee5aed None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:52.903420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71b3e-34fe-49d2-9b17-2ec6f4ee5aed None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:52.903690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71b3e-34fe-49d2-9b17-2ec6f4ee5aed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:53.048220 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:53.102255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e2779-6ebd-44a9-a987-686598519faf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.103915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d71b3e-34fe-49d2-9b17-2ec6f4ee5aed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:53.105447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d71b3e-34fe-49d2-9b17-2ec6f4ee5aed None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:53.131477 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:53.215233 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 416/828] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 00:29:53.215445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e2779-6ebd-44a9-a987-686598519faf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:53.216380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71b3e-34fe-49d2-9b17-2ec6f4ee5aed None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.253754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730a495-241e-49d4-9af6-d192a486e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:53.254387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730a495-241e-49d4-9af6-d192a486e1d4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:53.254669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730a495-241e-49d4-9af6-d192a486e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:53.254944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730a495-241e-49d4-9af6-d192a486e1d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:53.266307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730a495-241e-49d4-9af6-d192a486e1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:29:53.270749 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-e730a495-241e-49d4-9af6-d192a486e1d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:29:53.271175 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:53.272081 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:29:53.272954 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 413/829] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:53.278305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730a495-241e-49d4-9af6-d192a486e1d4 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.321346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71b3e-34fe-49d2-9b17-2ec6f4ee5aed None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:53.355871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51239ed-d112-43b5-b9a3-519c39b64800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:53.356647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51239ed-d112-43b5-b9a3-519c39b64800 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:53.356923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51239ed-d112-43b5-b9a3-519c39b64800 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:53.357200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51239ed-d112-43b5-b9a3-519c39b64800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:53.367138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51239ed-d112-43b5-b9a3-519c39b64800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:53.368593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51239ed-d112-43b5-b9a3-519c39b64800 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:53.369287 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:53.382162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730a495-241e-49d4-9af6-d192a486e1d4 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-b51239ed-d112-43b5-b9a3-519c39b64800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:29:53.384375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:53.385464 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:29:53.386353 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:29:53.386353 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:29:53.386353 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:53.386353 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 417/830] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:53.392152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51239ed-d112-43b5-b9a3-519c39b64800 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.416035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603547c6-4f9e-4bb0-b49b-297a50b8f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:53.416591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603547c6-4f9e-4bb0-b49b-297a50b8f25a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:53.416928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603547c6-4f9e-4bb0-b49b-297a50b8f25a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:53.417207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603547c6-4f9e-4bb0-b49b-297a50b8f25a None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:53.417878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603547c6-4f9e-4bb0-b49b-297a50b8f25a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:53.418187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603547c6-4f9e-4bb0-b49b-297a50b8f25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:53.419568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603547c6-4f9e-4bb0-b49b-297a50b8f25a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:53.428230 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 414/831] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:53.434115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603547c6-4f9e-4bb0-b49b-297a50b8f25a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.495917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51239ed-d112-43b5-b9a3-519c39b64800 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:53.498248 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:53.532472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2025a-93c7-48a9-9fce-0c3df4c167ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:53.533117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2025a-93c7-48a9-9fce-0c3df4c167ba None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:53.533397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2025a-93c7-48a9-9fce-0c3df4c167ba None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:53.533665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2025a-93c7-48a9-9fce-0c3df4c167ba None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:53.534306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2025a-93c7-48a9-9fce-0c3df4c167ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:53.534605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2025a-93c7-48a9-9fce-0c3df4c167ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:53.535011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603547c6-4f9e-4bb0-b49b-297a50b8f25a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:53.535974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2025a-93c7-48a9-9fce-0c3df4c167ba None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:53.553363 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 418/832] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:53.554373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2025a-93c7-48a9-9fce-0c3df4c167ba None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.570038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07645c-4427-494e-99bb-3110d233ccf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:53.570664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07645c-4427-494e-99bb-3110d233ccf4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:53.570939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07645c-4427-494e-99bb-3110d233ccf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:53.571209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07645c-4427-494e-99bb-3110d233ccf4 None admin] PATH_INFO: `/v3/users/cc551120671342c89bc6b0f04b74ff89` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:53.572334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07645c-4427-494e-99bb-3110d233ccf4 None admin] RBAC: Authorizing `identity:get_user(user_id=cc551120671342c89bc6b0f04b74ff89)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:53.573817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07645c-4427-494e-99bb-3110d233ccf4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:53.575597 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 415/833] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/users/cc551120671342c89bc6b0f04b74ff89 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:53.581730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07645c-4427-494e-99bb-3110d233ccf4 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.601850 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:53.654496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2025a-93c7-48a9-9fce-0c3df4c167ba None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:53.683384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07645c-4427-494e-99bb-3110d233ccf4 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:53.688878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc524d-4801-4a8f-b44e-fe4b17b71f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:53.689521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc524d-4801-4a8f-b44e-fe4b17b71f1f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:53.689803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc524d-4801-4a8f-b44e-fe4b17b71f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:53.690079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc524d-4801-4a8f-b44e-fe4b17b71f1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:53.696920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc524d-4801-4a8f-b44e-fe4b17b71f1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:53.698355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc524d-4801-4a8f-b44e-fe4b17b71f1f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-7bcc524d-4801-4a8f-b44e-fe4b17b71f1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:29:53.710986 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:29:53.712357 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:29:53.713480 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:29:53.713480 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:29:53.713480 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:29:53.713480 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:29:53.713480 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:29:53.713480 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:29:53.713480 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:29:53.713480 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:29:53.713480 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 419/834] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:29:53.718846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc524d-4801-4a8f-b44e-fe4b17b71f1f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.722253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa14d15-7d62-4329-b378-17cbe46c5b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:53.722864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa14d15-7d62-4329-b378-17cbe46c5b3b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:53.723147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa14d15-7d62-4329-b378-17cbe46c5b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:53.723422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa14d15-7d62-4329-b378-17cbe46c5b3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:53.743739 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:53.793046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa14d15-7d62-4329-b378-17cbe46c5b3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:53.794487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa14d15-7d62-4329-b378-17cbe46c5b3b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:53.813167 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:53.820360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc524d-4801-4a8f-b44e-fe4b17b71f1f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:53.854610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb64e9-f5de-4000-a574-08f02669211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:53.855209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb64e9-f5de-4000-a574-08f02669211d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:53.855482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb64e9-f5de-4000-a574-08f02669211d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:53.855749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb64e9-f5de-4000-a574-08f02669211d None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:53.856429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb64e9-f5de-4000-a574-08f02669211d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:53.858541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb64e9-f5de-4000-a574-08f02669211d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:53.859460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb64e9-f5de-4000-a574-08f02669211d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:53.871098 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 420/835] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:53.877790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb64e9-f5de-4000-a574-08f02669211d None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.897541 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 416/836] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 00:29:53.903317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa14d15-7d62-4329-b378-17cbe46c5b3b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:53.963853 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:53.981289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb64e9-f5de-4000-a574-08f02669211d None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:54.010859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa14d15-7d62-4329-b378-17cbe46c5b3b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:54.018686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66373ac4-0978-41b1-92d0-174f3f567555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:54.019301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66373ac4-0978-41b1-92d0-174f3f567555 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:54.019575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66373ac4-0978-41b1-92d0-174f3f567555 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:54.019842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66373ac4-0978-41b1-92d0-174f3f567555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:54.020579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66373ac4-0978-41b1-92d0-174f3f567555 None admin] RBAC: Adding query filter params (role.id=56da0eaf554e400ebd2272a01016c3ab, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=0165e2f8b5e34c8d8570262c777de161) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:54.020915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66373ac4-0978-41b1-92d0-174f3f567555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:54.022347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66373ac4-0978-41b1-92d0-174f3f567555 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:54.028555 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 421/837] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/role_assignments?user.id=0165e2f8b5e34c8d8570262c777de161&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=56da0eaf554e400ebd2272a01016c3ab => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:54.031319 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:54.053675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700da89-da11-4eb3-a765-4f3f5a66084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:54.054337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700da89-da11-4eb3-a765-4f3f5a66084a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:54.054617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700da89-da11-4eb3-a765-4f3f5a66084a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:54.054892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700da89-da11-4eb3-a765-4f3f5a66084a None admin] PATH_INFO: `/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:54.056128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700da89-da11-4eb3-a765-4f3f5a66084a None admin] RBAC: Authorizing `identity:get_project(project_id=fc60f3d5ad6047c2b1d3873c470ce3a2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:54.057686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700da89-da11-4eb3-a765-4f3f5a66084a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:54.059445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 417/838] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:29:53 2022] GET /identity/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:29:54.066574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66373ac4-0978-41b1-92d0-174f3f567555 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:54.177000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66373ac4-0978-41b1-92d0-174f3f567555 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:54.213666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4602a0-2af5-4a91-98bf-5a3368d0085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:54.214318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4602a0-2af5-4a91-98bf-5a3368d0085d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:54.214548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4602a0-2af5-4a91-98bf-5a3368d0085d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:54.214816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4602a0-2af5-4a91-98bf-5a3368d0085d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:54.215536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4602a0-2af5-4a91-98bf-5a3368d0085d None admin] RBAC: Adding query filter params (role.id=3c676188d9f646ba8509d3eef1e196de, scope.project.id=fc60f3d5ad6047c2b1d3873c470ce3a2, user.id=cc551120671342c89bc6b0f04b74ff89) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:29:54.215840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4602a0-2af5-4a91-98bf-5a3368d0085d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:54.217307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4602a0-2af5-4a91-98bf-5a3368d0085d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:54.223278 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 422/839] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:29:54 2022] GET /identity/v3/role_assignments?user.id=cc551120671342c89bc6b0f04b74ff89&scope.project.id=fc60f3d5ad6047c2b1d3873c470ce3a2&role.id=3c676188d9f646ba8509d3eef1e196de => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:56.414162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9a06-1ddd-4e9f-8f6c-f45f20124569 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:56.414766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9a06-1ddd-4e9f-8f6c-f45f20124569 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:56.414766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9a06-1ddd-4e9f-8f6c-f45f20124569 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:56.416239 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 418/840] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:56.422122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e86e1-c3c6-4199-a91a-0510ab217733 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:56.422530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e86e1-c3c6-4199-a91a-0510ab217733 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:56.422670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e86e1-c3c6-4199-a91a-0510ab217733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:56.441123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a92e86e1-c3c6-4199-a91a-0510ab217733 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:56.442341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a92e86e1-c3c6-4199-a91a-0510ab217733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:56.449981 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:56.509335 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 423/841] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:29:56.785298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a9a06-1ddd-4e9f-8f6c-f45f20124569 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:56.884578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a9a06-1ddd-4e9f-8f6c-f45f20124569 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:56.918051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e563d7-8c3c-4a37-b3c8-04683010064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:56.918702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e563d7-8c3c-4a37-b3c8-04683010064c None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:56.918979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e563d7-8c3c-4a37-b3c8-04683010064c None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:56.919249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e563d7-8c3c-4a37-b3c8-04683010064c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:56.920438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e563d7-8c3c-4a37-b3c8-04683010064c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:56.921959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e563d7-8c3c-4a37-b3c8-04683010064c None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:56.923624 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 419/842] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:29:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:56.929839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e86e1-c3c6-4199-a91a-0510ab217733 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:57.041710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e86e1-c3c6-4199-a91a-0510ab217733 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:57.080292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c285d-af8c-457a-8374-f519389f7612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:57.081262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c285d-af8c-457a-8374-f519389f7612 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:57.081606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c285d-af8c-457a-8374-f519389f7612 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:57.081982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c285d-af8c-457a-8374-f519389f7612 None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:57.082944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c285d-af8c-457a-8374-f519389f7612 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:57.084422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c285d-af8c-457a-8374-f519389f7612 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:57.102221 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:57.111959 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 424/843] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:29:56 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:29:59.361666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b7559-7940-4722-a1a6-3f7725302911 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:59.362197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b7559-7940-4722-a1a6-3f7725302911 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:59.362197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b7559-7940-4722-a1a6-3f7725302911 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:59.363535 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 420/844] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:59.368913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7244-ec3e-45f2-b3ff-2fdb07d4a73a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:59.369347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7244-ec3e-45f2-b3ff-2fdb07d4a73a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:59.369500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7244-ec3e-45f2-b3ff-2fdb07d4a73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:59.388942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-300a7244-ec3e-45f2-b3ff-2fdb07d4a73a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:59.390912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-300a7244-ec3e-45f2-b3ff-2fdb07d4a73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:59.455673 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 425/845] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:29:59.724982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b7559-7940-4722-a1a6-3f7725302911 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:59.779793 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:59.824927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b7559-7940-4722-a1a6-3f7725302911 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:59.858844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37dee2-2d39-4c15-8350-b25731d25234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:59.859460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37dee2-2d39-4c15-8350-b25731d25234 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:59.859739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37dee2-2d39-4c15-8350-b25731d25234 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:59.860017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37dee2-2d39-4c15-8350-b25731d25234 None admin] PATH_INFO: `/v3/roles/36ffa4795fa248139676253d88d7e507` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:59.861426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37dee2-2d39-4c15-8350-b25731d25234 None admin] RBAC: Authorizing `identity:get_role(role_id=36ffa4795fa248139676253d88d7e507)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:59.862773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37dee2-2d39-4c15-8350-b25731d25234 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:59.864088 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 421/846] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:29:59 2022] GET /identity/v3/roles/36ffa4795fa248139676253d88d7e507 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:29:59.869929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7244-ec3e-45f2-b3ff-2fdb07d4a73a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:59.971576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7244-ec3e-45f2-b3ff-2fdb07d4a73a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:59.997712 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:00.007428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0fc14-4df3-4983-88b0-ec0622703d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:00.008222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0fc14-4df3-4983-88b0-ec0622703d3e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.008563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0fc14-4df3-4983-88b0-ec0622703d3e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.008922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0fc14-4df3-4983-88b0-ec0622703d3e None admin] PATH_INFO: `/v3/users/e1b2bc400e014909a2abefcfce423512` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.025364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0fc14-4df3-4983-88b0-ec0622703d3e None admin] RBAC: Authorizing `identity:get_user(user_id=e1b2bc400e014909a2abefcfce423512)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:00.026818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0fc14-4df3-4983-88b0-ec0622703d3e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:00.028515 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 426/847] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:29:59 2022] GET /identity/v3/users/e1b2bc400e014909a2abefcfce423512 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:00.034705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37dee2-2d39-4c15-8350-b25731d25234 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:00.144163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37dee2-2d39-4c15-8350-b25731d25234 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:00.168186 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:00.180999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de3a58-73db-4b38-90e5-8841b7359c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:00.181621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de3a58-73db-4b38-90e5-8841b7359c09 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.181900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de3a58-73db-4b38-90e5-8841b7359c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.182171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de3a58-73db-4b38-90e5-8841b7359c09 None admin] PATH_INFO: `/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.183285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de3a58-73db-4b38-90e5-8841b7359c09 None admin] RBAC: Authorizing `identity:get_project(project_id=fc60f3d5ad6047c2b1d3873c470ce3a2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:00.184726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de3a58-73db-4b38-90e5-8841b7359c09 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:00.187044 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 422/848] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:30:00 2022] GET /identity/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:00.193028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0fc14-4df3-4983-88b0-ec0622703d3e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:00.296892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0fc14-4df3-4983-88b0-ec0622703d3e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:00.332052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797b519-28ad-4675-baa6-3bf162aa18a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:00.332742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b519-28ad-4675-baa6-3bf162aa18a3 None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.333024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b519-28ad-4675-baa6-3bf162aa18a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.333298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b519-28ad-4675-baa6-3bf162aa18a3 None admin] PATH_INFO: `/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2/users/e1b2bc400e014909a2abefcfce423512/roles/36ffa4795fa248139676253d88d7e507` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.335455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797b519-28ad-4675-baa6-3bf162aa18a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc60f3d5ad6047c2b1d3873c470ce3a2, user_id=e1b2bc400e014909a2abefcfce423512, role_id=36ffa4795fa248139676253d88d7e507)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:00.337189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797b519-28ad-4675-baa6-3bf162aa18a3 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:00.351058 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 427/849] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:30:00 2022] PUT /identity/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2/users/e1b2bc400e014909a2abefcfce423512/roles/36ffa4795fa248139676253d88d7e507 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:30:02.501235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a655b64-fa5c-428b-a18b-8edcfc085345 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:02.501793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a655b64-fa5c-428b-a18b-8edcfc085345 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:02.501793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a655b64-fa5c-428b-a18b-8edcfc085345 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:02.503105 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 423/850] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:02.508634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff814e-3b34-4973-b013-06a26d65be55 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:02.509072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff814e-3b34-4973-b013-06a26d65be55 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:02.509188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff814e-3b34-4973-b013-06a26d65be55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:02.527975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-77ff814e-3b34-4973-b013-06a26d65be55 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:02.529213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-77ff814e-3b34-4973-b013-06a26d65be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:02.573486 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:02.602866 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 428/851] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:02.872803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a655b64-fa5c-428b-a18b-8edcfc085345 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:02.978128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a655b64-fa5c-428b-a18b-8edcfc085345 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:03.013138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93672d7-6140-48ec-bd63-7100264441ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:03.013769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93672d7-6140-48ec-bd63-7100264441ab None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:03.014162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93672d7-6140-48ec-bd63-7100264441ab None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:03.014941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93672d7-6140-48ec-bd63-7100264441ab None admin] PATH_INFO: `/v3/roles/36ffa4795fa248139676253d88d7e507` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:03.016369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93672d7-6140-48ec-bd63-7100264441ab None admin] RBAC: Authorizing `identity:get_role(role_id=36ffa4795fa248139676253d88d7e507)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:03.017767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93672d7-6140-48ec-bd63-7100264441ab None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:03.019098 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 424/852] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:30:02 2022] GET /identity/v3/roles/36ffa4795fa248139676253d88d7e507 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:03.025359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff814e-3b34-4973-b013-06a26d65be55 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:03.136152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff814e-3b34-4973-b013-06a26d65be55 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:03.171690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e8b28-cee9-46b5-b430-d626ab86acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:03.172329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e8b28-cee9-46b5-b430-d626ab86acea None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:03.172612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e8b28-cee9-46b5-b430-d626ab86acea None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:03.172913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e8b28-cee9-46b5-b430-d626ab86acea None admin] PATH_INFO: `/v3/users/e1b2bc400e014909a2abefcfce423512` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:03.174052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e8b28-cee9-46b5-b430-d626ab86acea None admin] RBAC: Authorizing `identity:get_user(user_id=e1b2bc400e014909a2abefcfce423512)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:03.175485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e8b28-cee9-46b5-b430-d626ab86acea None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:03.177212 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 429/853] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:30:03 2022] GET /identity/v3/users/e1b2bc400e014909a2abefcfce423512 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:03.183090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93672d7-6140-48ec-bd63-7100264441ab None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:03.244348 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:03.289131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93672d7-6140-48ec-bd63-7100264441ab None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:03.322647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8de6b8-e888-44c3-b80f-eb50ae1a7671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:03.323257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8de6b8-e888-44c3-b80f-eb50ae1a7671 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:03.323536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8de6b8-e888-44c3-b80f-eb50ae1a7671 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:03.323809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8de6b8-e888-44c3-b80f-eb50ae1a7671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:03.392755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8de6b8-e888-44c3-b80f-eb50ae1a7671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:03.394135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8de6b8-e888-44c3-b80f-eb50ae1a7671 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:03.453707 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:03.497932 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 425/854] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:30:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:30:03.504142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e8b28-cee9-46b5-b430-d626ab86acea None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:03.552012 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:03.607552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e8b28-cee9-46b5-b430-d626ab86acea None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:03.643512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21bce8-13ea-4b12-be2b-72a3f53d489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:03.644074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21bce8-13ea-4b12-be2b-72a3f53d489c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:03.644349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21bce8-13ea-4b12-be2b-72a3f53d489c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:03.644654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21bce8-13ea-4b12-be2b-72a3f53d489c None admin] PATH_INFO: `/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:03.645765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21bce8-13ea-4b12-be2b-72a3f53d489c None admin] RBAC: Authorizing `identity:get_project(project_id=fc60f3d5ad6047c2b1d3873c470ce3a2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:03.647186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21bce8-13ea-4b12-be2b-72a3f53d489c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:03.648840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 430/855] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:30:03 2022] GET /identity/v3/projects/fc60f3d5ad6047c2b1d3873c470ce3a2 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:03.656082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8de6b8-e888-44c3-b80f-eb50ae1a7671 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:03.755993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8de6b8-e888-44c3-b80f-eb50ae1a7671 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:03.792701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997272a1-57a4-4d8a-8e57-0f725886f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:03.793314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997272a1-57a4-4d8a-8e57-0f725886f816 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:03.793598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997272a1-57a4-4d8a-8e57-0f725886f816 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:03.793875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997272a1-57a4-4d8a-8e57-0f725886f816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:03.794601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997272a1-57a4-4d8a-8e57-0f725886f816 None admin] RBAC: Adding query filter params (role.id=36ffa4795fa248139676253d88d7e507, scope.project.id=fc60f3d5ad6047c2b1d3873c470ce3a2, user.id=e1b2bc400e014909a2abefcfce423512) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:03.794911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997272a1-57a4-4d8a-8e57-0f725886f816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:03.797229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997272a1-57a4-4d8a-8e57-0f725886f816 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:03.803153 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 426/856] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:30:03 2022] GET /identity/v3/role_assignments?user.id=e1b2bc400e014909a2abefcfce423512&scope.project.id=fc60f3d5ad6047c2b1d3873c470ce3a2&role.id=36ffa4795fa248139676253d88d7e507 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:05.994310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973b9db-2be1-4523-8646-f6ffbed9457b None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:05.994866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973b9db-2be1-4523-8646-f6ffbed9457b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:05.994969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973b9db-2be1-4523-8646-f6ffbed9457b None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:05.996311 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 431/857] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:06.001866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3c5a8-c055-4d96-97b6-2b37e3a211f1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:06.002312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3c5a8-c055-4d96-97b6-2b37e3a211f1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:06.002406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3c5a8-c055-4d96-97b6-2b37e3a211f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:06.020375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b2d3c5a8-c055-4d96-97b6-2b37e3a211f1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:06.021635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b2d3c5a8-c055-4d96-97b6-2b37e3a211f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:06.040285 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:06.091194 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 427/858] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:06.362681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973b9db-2be1-4523-8646-f6ffbed9457b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:06.468087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973b9db-2be1-4523-8646-f6ffbed9457b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:06.481705 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:06.505169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165b22-22c1-457a-817e-44daa91b3c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:06.505824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165b22-22c1-457a-817e-44daa91b3c83 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:06.506083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165b22-22c1-457a-817e-44daa91b3c83 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:06.506352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165b22-22c1-457a-817e-44daa91b3c83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:06.507471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91165b22-22c1-457a-817e-44daa91b3c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:06.508960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91165b22-22c1-457a-817e-44daa91b3c83 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:06.510541 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 432/859] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:30:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:06.516535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3c5a8-c055-4d96-97b6-2b37e3a211f1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:06.621702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3c5a8-c055-4d96-97b6-2b37e3a211f1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:06.654444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d2f38-a49d-4c8e-8030-64b353e32ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:06.655608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d2f38-a49d-4c8e-8030-64b353e32ead None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:06.655831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d2f38-a49d-4c8e-8030-64b353e32ead None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:06.656105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d2f38-a49d-4c8e-8030-64b353e32ead None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:06.656783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d2f38-a49d-4c8e-8030-64b353e32ead None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:06.658213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d2f38-a49d-4c8e-8030-64b353e32ead None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:06.685371 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 428/860] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:30:06 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:30:08.885111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1f57-e232-4825-be05-65f290eeed99 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:08.885647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1f57-e232-4825-be05-65f290eeed99 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:08.885647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1f57-e232-4825-be05-65f290eeed99 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:08.887012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 433/861] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:08.892871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc01ff-60e5-4059-b121-c4d70aa16789 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:08.893262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc01ff-60e5-4059-b121-c4d70aa16789 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:08.893411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc01ff-60e5-4059-b121-c4d70aa16789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:08.900709 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:08.911979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-62cc01ff-60e5-4059-b121-c4d70aa16789 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:08.913194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-62cc01ff-60e5-4059-b121-c4d70aa16789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:08.978090 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 429/862] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:09.254178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb1f57-e232-4825-be05-65f290eeed99 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:09.356369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb1f57-e232-4825-be05-65f290eeed99 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:09.390185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e5bc5-501a-4e02-82d9-bddab3019e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:09.390798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e5bc5-501a-4e02-82d9-bddab3019e70 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:09.391077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e5bc5-501a-4e02-82d9-bddab3019e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:09.391348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e5bc5-501a-4e02-82d9-bddab3019e70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:09.392455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e5bc5-501a-4e02-82d9-bddab3019e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:09.393900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e5bc5-501a-4e02-82d9-bddab3019e70 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:09.395455 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 434/863] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:30:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:09.401240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc01ff-60e5-4059-b121-c4d70aa16789 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:09.506520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc01ff-60e5-4059-b121-c4d70aa16789 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:09.540791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d357dd7-c412-44a0-9c99-918d1fd75be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:09.541406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d357dd7-c412-44a0-9c99-918d1fd75be9 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:09.541690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d357dd7-c412-44a0-9c99-918d1fd75be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:09.541966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d357dd7-c412-44a0-9c99-918d1fd75be9 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:09.542626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d357dd7-c412-44a0-9c99-918d1fd75be9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:09.544060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d357dd7-c412-44a0-9c99-918d1fd75be9 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:09.552289 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:09.566471 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 430/864] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:30:09 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:30:11.863868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18490-25d8-4645-b60a-ff30b6b6c677 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:11.864423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18490-25d8-4645-b60a-ff30b6b6c677 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:11.864423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18490-25d8-4645-b60a-ff30b6b6c677 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:11.865817 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 435/865] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:11.871265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a349e2a-3e10-4765-8164-988eca99234f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:11.871687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a349e2a-3e10-4765-8164-988eca99234f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:11.871806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a349e2a-3e10-4765-8164-988eca99234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:11.891292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9a349e2a-3e10-4765-8164-988eca99234f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:11.892494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9a349e2a-3e10-4765-8164-988eca99234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:11.959899 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 431/866] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:30:12.239043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb18490-25d8-4645-b60a-ff30b6b6c677 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:12.289609 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:12.344846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb18490-25d8-4645-b60a-ff30b6b6c677 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:12.379454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b783b34-50dd-4f5a-b791-b2458113611f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:12.380088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783b34-50dd-4f5a-b791-b2458113611f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:12.380371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783b34-50dd-4f5a-b791-b2458113611f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:12.380669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783b34-50dd-4f5a-b791-b2458113611f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:12.391134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b783b34-50dd-4f5a-b791-b2458113611f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-4b783b34-50dd-4f5a-b791-b2458113611f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:30:12.395938 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:12.397141 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:30:12.398403 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 436/867] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:30:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:12.403131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a349e2a-3e10-4765-8164-988eca99234f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:12.501450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a349e2a-3e10-4765-8164-988eca99234f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:12.521161 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:12.536202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa743d50-b68b-4e03-910e-029f62cf1165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:12.536841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa743d50-b68b-4e03-910e-029f62cf1165 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:12.537121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa743d50-b68b-4e03-910e-029f62cf1165 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:12.537394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa743d50-b68b-4e03-910e-029f62cf1165 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:12.538062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa743d50-b68b-4e03-910e-029f62cf1165 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:12.538370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa743d50-b68b-4e03-910e-029f62cf1165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:12.539752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa743d50-b68b-4e03-910e-029f62cf1165 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:12.550482 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 432/868] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:12.561890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b783b34-50dd-4f5a-b791-b2458113611f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:12.660868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b783b34-50dd-4f5a-b791-b2458113611f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:12.669791 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:12.695408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49398844-1b53-4817-a8b5-f7ffa794dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:12.696032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49398844-1b53-4817-a8b5-f7ffa794dd9f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:12.696320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49398844-1b53-4817-a8b5-f7ffa794dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:12.696596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49398844-1b53-4817-a8b5-f7ffa794dd9f None admin] PATH_INFO: `/v3/users/809890d6fa874e829cfb16cd3e61aeec` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:12.710019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49398844-1b53-4817-a8b5-f7ffa794dd9f None admin] RBAC: Authorizing `identity:get_user(user_id=809890d6fa874e829cfb16cd3e61aeec)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:12.711455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49398844-1b53-4817-a8b5-f7ffa794dd9f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:12.713357 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 437/869] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:30:12 2022] GET /identity/v3/users/809890d6fa874e829cfb16cd3e61aeec => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:12.720248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa743d50-b68b-4e03-910e-029f62cf1165 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:12.824882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa743d50-b68b-4e03-910e-029f62cf1165 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:12.862462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d192e-9087-47d6-b856-a1883cb65bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:12.863085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d192e-9087-47d6-b856-a1883cb65bda None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:12.863367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d192e-9087-47d6-b856-a1883cb65bda None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:12.863635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d192e-9087-47d6-b856-a1883cb65bda None admin] PATH_INFO: `/v3/projects/0ca9354ad0bf459d8bbe3d524c3d82e2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:12.864804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d192e-9087-47d6-b856-a1883cb65bda None admin] RBAC: Authorizing `identity:get_project(project_id=0ca9354ad0bf459d8bbe3d524c3d82e2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:12.866256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d192e-9087-47d6-b856-a1883cb65bda None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:12.867899 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 433/870] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:30:12 2022] GET /identity/v3/projects/0ca9354ad0bf459d8bbe3d524c3d82e2 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:12.874495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49398844-1b53-4817-a8b5-f7ffa794dd9f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:12.974448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49398844-1b53-4817-a8b5-f7ffa794dd9f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:13.008561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05f6a2-d9c2-4b36-bd7f-6bba833988d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:13.009238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05f6a2-d9c2-4b36-bd7f-6bba833988d6 None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:13.009519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05f6a2-d9c2-4b36-bd7f-6bba833988d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:13.009793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05f6a2-d9c2-4b36-bd7f-6bba833988d6 None admin] PATH_INFO: `/v3/projects/0ca9354ad0bf459d8bbe3d524c3d82e2/users/809890d6fa874e829cfb16cd3e61aeec/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:13.011678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05f6a2-d9c2-4b36-bd7f-6bba833988d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca9354ad0bf459d8bbe3d524c3d82e2, user_id=809890d6fa874e829cfb16cd3e61aeec, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:13.013150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05f6a2-d9c2-4b36-bd7f-6bba833988d6 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:13.025727 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 438/871] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:30:12 2022] PUT /identity/v3/projects/0ca9354ad0bf459d8bbe3d524c3d82e2/users/809890d6fa874e829cfb16cd3e61aeec/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:30:15.225280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37452a93-d418-4bae-bb23-e46d7101de5c None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:15.225799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37452a93-d418-4bae-bb23-e46d7101de5c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:15.225799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37452a93-d418-4bae-bb23-e46d7101de5c None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:15.227164 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 434/872] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:15.233011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9e97-64e4-471a-9e7b-418672cc6b4a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:15.233409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9e97-64e4-471a-9e7b-418672cc6b4a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:15.233555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9e97-64e4-471a-9e7b-418672cc6b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:15.252405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-615d9e97-64e4-471a-9e7b-418672cc6b4a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:15.253638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-615d9e97-64e4-471a-9e7b-418672cc6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:15.273686 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:15.320709 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 439/873] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:15.598561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37452a93-d418-4bae-bb23-e46d7101de5c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:15.649342 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:15.699653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37452a93-d418-4bae-bb23-e46d7101de5c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:15.734078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafc011-6c19-47cf-8a26-e9888ded4412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:15.734697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafc011-6c19-47cf-8a26-e9888ded4412 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:15.734978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafc011-6c19-47cf-8a26-e9888ded4412 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:15.735251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafc011-6c19-47cf-8a26-e9888ded4412 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:15.745440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafc011-6c19-47cf-8a26-e9888ded4412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-eeafc011-6c19-47cf-8a26-e9888ded4412 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:30:15.751074 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:15.752157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:30:15.753085 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 435/874] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:30:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:15.758257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d9e97-64e4-471a-9e7b-418672cc6b4a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:15.856000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d9e97-64e4-471a-9e7b-418672cc6b4a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:15.891138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50669c4-7798-48cf-8e62-d8a1497cf2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:15.891736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50669c4-7798-48cf-8e62-d8a1497cf2fe None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:15.892015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50669c4-7798-48cf-8e62-d8a1497cf2fe None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:15.892289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50669c4-7798-48cf-8e62-d8a1497cf2fe None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:15.892973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50669c4-7798-48cf-8e62-d8a1497cf2fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:15.893275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50669c4-7798-48cf-8e62-d8a1497cf2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:15.894637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50669c4-7798-48cf-8e62-d8a1497cf2fe None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:15.902382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 440/875] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:30:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:15.909205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafc011-6c19-47cf-8a26-e9888ded4412 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:16.010163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafc011-6c19-47cf-8a26-e9888ded4412 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:16.021622 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:16.047385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735b10c-9e85-42fc-a0d0-f46236fc0507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:16.048019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735b10c-9e85-42fc-a0d0-f46236fc0507 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:16.048299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735b10c-9e85-42fc-a0d0-f46236fc0507 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:16.048576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735b10c-9e85-42fc-a0d0-f46236fc0507 None admin] PATH_INFO: `/v3/users/809890d6fa874e829cfb16cd3e61aeec` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:16.049752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735b10c-9e85-42fc-a0d0-f46236fc0507 None admin] RBAC: Authorizing `identity:get_user(user_id=809890d6fa874e829cfb16cd3e61aeec)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:16.051178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735b10c-9e85-42fc-a0d0-f46236fc0507 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:16.052790 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 436/876] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:30:15 2022] GET /identity/v3/users/809890d6fa874e829cfb16cd3e61aeec => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:16.058510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50669c4-7798-48cf-8e62-d8a1497cf2fe None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:16.078476 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:16.158807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50669c4-7798-48cf-8e62-d8a1497cf2fe None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:16.190753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084ec6-e63e-4685-81b4-4a1c55264d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:16.191352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084ec6-e63e-4685-81b4-4a1c55264d9e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:16.191633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084ec6-e63e-4685-81b4-4a1c55264d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:16.191906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084ec6-e63e-4685-81b4-4a1c55264d9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:16.257965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22084ec6-e63e-4685-81b4-4a1c55264d9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:16.259413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22084ec6-e63e-4685-81b4-4a1c55264d9e None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:16.277621 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:16.356747 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 441/877] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:30:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:30:16.362932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735b10c-9e85-42fc-a0d0-f46236fc0507 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:16.467448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735b10c-9e85-42fc-a0d0-f46236fc0507 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:16.501005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c583762-1700-4f4d-958d-91ee43775373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:16.501680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c583762-1700-4f4d-958d-91ee43775373 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:16.501955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c583762-1700-4f4d-958d-91ee43775373 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:16.502218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c583762-1700-4f4d-958d-91ee43775373 None admin] PATH_INFO: `/v3/projects/0ca9354ad0bf459d8bbe3d524c3d82e2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:16.503386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c583762-1700-4f4d-958d-91ee43775373 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca9354ad0bf459d8bbe3d524c3d82e2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:16.504839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c583762-1700-4f4d-958d-91ee43775373 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:16.506474 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 437/878] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:30:16 2022] GET /identity/v3/projects/0ca9354ad0bf459d8bbe3d524c3d82e2 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:16.512870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084ec6-e63e-4685-81b4-4a1c55264d9e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:16.617416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084ec6-e63e-4685-81b4-4a1c55264d9e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:16.635451 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:16.654542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f08b5-c465-42d7-a0c1-3f6fc2c3f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:16.655249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f08b5-c465-42d7-a0c1-3f6fc2c3f889 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:16.655528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f08b5-c465-42d7-a0c1-3f6fc2c3f889 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:16.655804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f08b5-c465-42d7-a0c1-3f6fc2c3f889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:16.656535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f08b5-c465-42d7-a0c1-3f6fc2c3f889 None admin] RBAC: Adding query filter params (role.id=3c676188d9f646ba8509d3eef1e196de, scope.project.id=0ca9354ad0bf459d8bbe3d524c3d82e2, user.id=809890d6fa874e829cfb16cd3e61aeec) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:16.656875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f08b5-c465-42d7-a0c1-3f6fc2c3f889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:16.658320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f08b5-c465-42d7-a0c1-3f6fc2c3f889 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:16.664496 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 442/879] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:30:16 2022] GET /identity/v3/role_assignments?user.id=809890d6fa874e829cfb16cd3e61aeec&scope.project.id=0ca9354ad0bf459d8bbe3d524c3d82e2&role.id=3c676188d9f646ba8509d3eef1e196de => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:18.974812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e0f03-25a8-4d4e-95e9-6ce78008a214 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:18.975368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e0f03-25a8-4d4e-95e9-6ce78008a214 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:18.975524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e0f03-25a8-4d4e-95e9-6ce78008a214 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:18.976996 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 438/880] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:18.983323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5cac1-3a4b-4af7-b7df-e8d40c948b83 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:18.983888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5cac1-3a4b-4af7-b7df-e8d40c948b83 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:18.983888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5cac1-3a4b-4af7-b7df-e8d40c948b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:19.003677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-45f5cac1-3a4b-4af7-b7df-e8d40c948b83 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:19.004916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-45f5cac1-3a4b-4af7-b7df-e8d40c948b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:19.079189 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 443/881] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:19.361319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e0f03-25a8-4d4e-95e9-6ce78008a214 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:19.419519 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:19.482852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e0f03-25a8-4d4e-95e9-6ce78008a214 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:19.518616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eca97-7d60-46a3-a18a-ba6229e21b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:19.519227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eca97-7d60-46a3-a18a-ba6229e21b80 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:19.519509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eca97-7d60-46a3-a18a-ba6229e21b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:19.519785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eca97-7d60-46a3-a18a-ba6229e21b80 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:19.520470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eca97-7d60-46a3-a18a-ba6229e21b80 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:19.521872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eca97-7d60-46a3-a18a-ba6229e21b80 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:19.539602 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 439/882] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Oct 19 00:30:19 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:30:21.945623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e633-ceb4-4c33-94fa-6296d63ee3e1 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:21.946173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e633-ceb4-4c33-94fa-6296d63ee3e1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:21.946173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e633-ceb4-4c33-94fa-6296d63ee3e1 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:21.947520 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 444/883] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:21.954729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13641a27-0d35-4987-a57c-289d0ddbe46c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:21.955254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13641a27-0d35-4987-a57c-289d0ddbe46c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:21.955421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13641a27-0d35-4987-a57c-289d0ddbe46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:21.981596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-13641a27-0d35-4987-a57c-289d0ddbe46c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:21.982848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-13641a27-0d35-4987-a57c-289d0ddbe46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:22.078227 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 440/884] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:22.422946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e633-ceb4-4c33-94fa-6296d63ee3e1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:22.545124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e633-ceb4-4c33-94fa-6296d63ee3e1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:22.559856 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:22.584223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5572e88-c31f-4d14-b038-cac7d7973035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:22.584890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5572e88-c31f-4d14-b038-cac7d7973035 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:22.585172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5572e88-c31f-4d14-b038-cac7d7973035 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:22.585448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5572e88-c31f-4d14-b038-cac7d7973035 None admin] PATH_INFO: `/v3/domains/0e4e7b78b0644f01bbd2e4d4d9f14d88` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:22.598106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5572e88-c31f-4d14-b038-cac7d7973035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0e4e7b78b0644f01bbd2e4d4d9f14d88)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:22.599783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5572e88-c31f-4d14-b038-cac7d7973035 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:22.601800 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 445/885] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Oct 19 00:30:22 2022] GET /identity/v3/domains/0e4e7b78b0644f01bbd2e4d4d9f14d88 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:30:22.609619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13641a27-0d35-4987-a57c-289d0ddbe46c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:22.660644 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:22.735870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13641a27-0d35-4987-a57c-289d0ddbe46c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:22.775162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7db6c-5d61-41af-8a0d-7134a0e6f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:22.775842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7db6c-5d61-41af-8a0d-7134a0e6f1cd None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:22.776124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7db6c-5d61-41af-8a0d-7134a0e6f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:22.776464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7db6c-5d61-41af-8a0d-7134a0e6f1cd None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:22.777264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7db6c-5d61-41af-8a0d-7134a0e6f1cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:22.778891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7db6c-5d61-41af-8a0d-7134a0e6f1cd None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:22.820204 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 441/886] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:30:22 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:30:25.354353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6398-6820-4e4e-aa60-79577ee767f3 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:25.355013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6398-6820-4e4e-aa60-79577ee767f3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:25.355013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6398-6820-4e4e-aa60-79577ee767f3 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:25.356290 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 446/887] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:25.362809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484e4fa-23ca-4d7f-942f-8762e151bc60 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:25.363416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484e4fa-23ca-4d7f-942f-8762e151bc60 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:25.363416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484e4fa-23ca-4d7f-942f-8762e151bc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:25.384524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e484e4fa-23ca-4d7f-942f-8762e151bc60 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:25.385984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e484e4fa-23ca-4d7f-942f-8762e151bc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:25.469919 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 442/888] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:25.776796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d6398-6820-4e4e-aa60-79577ee767f3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:25.895420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d6398-6820-4e4e-aa60-79577ee767f3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:25.931254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a03ef0-21a6-4d5a-b48f-24aa13b7b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:25.931895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a03ef0-21a6-4d5a-b48f-24aa13b7b3ce None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:25.932171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a03ef0-21a6-4d5a-b48f-24aa13b7b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:25.932440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a03ef0-21a6-4d5a-b48f-24aa13b7b3ce None admin] PATH_INFO: `/v3/domains/0e4e7b78b0644f01bbd2e4d4d9f14d88` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:25.933593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a03ef0-21a6-4d5a-b48f-24aa13b7b3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=0e4e7b78b0644f01bbd2e4d4d9f14d88)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:25.935612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a03ef0-21a6-4d5a-b48f-24aa13b7b3ce None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:25.937229 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 447/889] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Oct 19 00:30:25 2022] GET /identity/v3/domains/0e4e7b78b0644f01bbd2e4d4d9f14d88 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:25.943148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484e4fa-23ca-4d7f-942f-8762e151bc60 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:25.963832 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:26.054583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484e4fa-23ca-4d7f-942f-8762e151bc60 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:26.100278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9cfb-1627-430c-b58c-20d1609644db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:26.100991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9cfb-1627-430c-b58c-20d1609644db None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:26.101292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9cfb-1627-430c-b58c-20d1609644db None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:26.101578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9cfb-1627-430c-b58c-20d1609644db None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:26.102308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9cfb-1627-430c-b58c-20d1609644db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:26.103765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9cfb-1627-430c-b58c-20d1609644db None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:26.128725 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 443/890] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:30:25 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:30:28.593372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b23b5-d8f3-4041-a91a-4c2734fb72fa None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:28.594003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b23b5-d8f3-4041-a91a-4c2734fb72fa None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:28.594295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b23b5-d8f3-4041-a91a-4c2734fb72fa None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:28.596667 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 448/891] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:28.605877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c747534-b200-4640-a961-70b0f6d7b71d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:28.606637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c747534-b200-4640-a961-70b0f6d7b71d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:28.607585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c747534-b200-4640-a961-70b0f6d7b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:28.637006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9c747534-b200-4640-a961-70b0f6d7b71d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:28.638993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9c747534-b200-4640-a961-70b0f6d7b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:28.760071 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 444/892] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:29.052437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b23b5-d8f3-4041-a91a-4c2734fb72fa None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:29.106423 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:29.178978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b23b5-d8f3-4041-a91a-4c2734fb72fa None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:29.243748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ff343-9ca1-4dc4-87f5-e6da6a8b7471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:29.244852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff343-9ca1-4dc4-87f5-e6da6a8b7471 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:29.245325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff343-9ca1-4dc4-87f5-e6da6a8b7471 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:29.245768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff343-9ca1-4dc4-87f5-e6da6a8b7471 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:29.265515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ff343-9ca1-4dc4-87f5-e6da6a8b7471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-152ff343-9ca1-4dc4-87f5-e6da6a8b7471 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:30:29.274142 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:29.275488 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:30:29.276752 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 449/893] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:29.284092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c747534-b200-4640-a961-70b0f6d7b71d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:29.288081 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:29.408938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c747534-b200-4640-a961-70b0f6d7b71d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:29.448998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a92d1-6996-4bd4-9d47-892de7c49980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:29.450052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a92d1-6996-4bd4-9d47-892de7c49980 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:29.451006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a92d1-6996-4bd4-9d47-892de7c49980 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:29.451311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a92d1-6996-4bd4-9d47-892de7c49980 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:29.452572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a92d1-6996-4bd4-9d47-892de7c49980 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:29.453155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a92d1-6996-4bd4-9d47-892de7c49980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:29.455779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a92d1-6996-4bd4-9d47-892de7c49980 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:29.472797 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 445/894] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:30:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:29.482698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ff343-9ca1-4dc4-87f5-e6da6a8b7471 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:29.633344 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:29.638460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ff343-9ca1-4dc4-87f5-e6da6a8b7471 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:29.690987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b863e-5a8c-4b88-8bdd-ff3b071e40bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:29.691693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b863e-5a8c-4b88-8bdd-ff3b071e40bc None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:29.692044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b863e-5a8c-4b88-8bdd-ff3b071e40bc None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:29.692390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b863e-5a8c-4b88-8bdd-ff3b071e40bc None admin] PATH_INFO: `/v3/users/b3cf7341ca0241f38cba24308d157772` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:29.708778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b863e-5a8c-4b88-8bdd-ff3b071e40bc None admin] RBAC: Authorizing `identity:get_user(user_id=b3cf7341ca0241f38cba24308d157772)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:29.710347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b863e-5a8c-4b88-8bdd-ff3b071e40bc None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:29.712390 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 450/895] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:30:29 2022] GET /identity/v3/users/b3cf7341ca0241f38cba24308d157772 => generated 311 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:29.719710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a92d1-6996-4bd4-9d47-892de7c49980 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:29.815113 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:29.857077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a92d1-6996-4bd4-9d47-892de7c49980 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:29.908273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d36b9-fe4c-47c0-a82c-4d5613e54b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:29.908966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d36b9-fe4c-47c0-a82c-4d5613e54b7e None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:29.909248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d36b9-fe4c-47c0-a82c-4d5613e54b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:29.909532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d36b9-fe4c-47c0-a82c-4d5613e54b7e None admin] PATH_INFO: `/v3/projects/a4e2f301bbaa45dfbbb373324a0d37bd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:29.910732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d36b9-fe4c-47c0-a82c-4d5613e54b7e None admin] RBAC: Authorizing `identity:get_project(project_id=a4e2f301bbaa45dfbbb373324a0d37bd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:29.912185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d36b9-fe4c-47c0-a82c-4d5613e54b7e None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:29.913919 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 446/896] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:30:29 2022] GET /identity/v3/projects/a4e2f301bbaa45dfbbb373324a0d37bd => generated 361 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:29.920908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b863e-5a8c-4b88-8bdd-ff3b071e40bc None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:30.030553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b863e-5a8c-4b88-8bdd-ff3b071e40bc None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:30.071996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5817ef8-48f3-4a1d-a24b-6eef7178f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:30.072841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5817ef8-48f3-4a1d-a24b-6eef7178f7f9 None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:30.073130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5817ef8-48f3-4a1d-a24b-6eef7178f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:30.073441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5817ef8-48f3-4a1d-a24b-6eef7178f7f9 None admin] PATH_INFO: `/v3/projects/a4e2f301bbaa45dfbbb373324a0d37bd/users/b3cf7341ca0241f38cba24308d157772/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:30.075651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5817ef8-48f3-4a1d-a24b-6eef7178f7f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4e2f301bbaa45dfbbb373324a0d37bd, user_id=b3cf7341ca0241f38cba24308d157772, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:30.077295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5817ef8-48f3-4a1d-a24b-6eef7178f7f9 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:30.093187 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 451/897] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:30:29 2022] PUT /identity/v3/projects/a4e2f301bbaa45dfbbb373324a0d37bd/users/b3cf7341ca0241f38cba24308d157772/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:30:32.488434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554fb4-6fdf-47cf-98c3-2c50e6e418f7 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:32.489032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554fb4-6fdf-47cf-98c3-2c50e6e418f7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:32.489032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554fb4-6fdf-47cf-98c3-2c50e6e418f7 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:32.490361 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 447/898] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:32.497990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a87f36-b430-4d3f-92ba-520a2c4163be None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:32.498533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a87f36-b430-4d3f-92ba-520a2c4163be None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:32.498533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a87f36-b430-4d3f-92ba-520a2c4163be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:32.519804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e1a87f36-b430-4d3f-92ba-520a2c4163be None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:32.521145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e1a87f36-b430-4d3f-92ba-520a2c4163be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:32.537262 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:32.604167 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 452/899] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:30:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:30:32.891301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554fb4-6fdf-47cf-98c3-2c50e6e418f7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:33.024383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554fb4-6fdf-47cf-98c3-2c50e6e418f7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:33.070754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a7739-9311-4dd1-8913-d8cfccf120dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:33.071486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a7739-9311-4dd1-8913-d8cfccf120dc None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:33.071870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a7739-9311-4dd1-8913-d8cfccf120dc None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:33.072155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a7739-9311-4dd1-8913-d8cfccf120dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:33.074733 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:33.086923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a7739-9311-4dd1-8913-d8cfccf120dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-910a7739-9311-4dd1-8913-d8cfccf120dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:30:33.092690 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:30:33.093882 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:30:33.094974 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 448/900] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:30:33.101176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a87f36-b430-4d3f-92ba-520a2c4163be None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:33.217148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a87f36-b430-4d3f-92ba-520a2c4163be None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:33.260803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1385d-49df-4810-84e1-4042f505ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:33.261557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1385d-49df-4810-84e1-4042f505ee55 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:33.261844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1385d-49df-4810-84e1-4042f505ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:33.262122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1385d-49df-4810-84e1-4042f505ee55 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:33.263184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1385d-49df-4810-84e1-4042f505ee55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:33.263516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1385d-49df-4810-84e1-4042f505ee55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:33.265219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1385d-49df-4810-84e1-4042f505ee55 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:33.276448 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 453/901] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:33.285618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a7739-9311-4dd1-8913-d8cfccf120dc None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:33.421515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a7739-9311-4dd1-8913-d8cfccf120dc None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:33.469557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692b75f-09ae-4340-b0dc-63285dc40eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:33.470105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692b75f-09ae-4340-b0dc-63285dc40eed None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:33.470379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692b75f-09ae-4340-b0dc-63285dc40eed None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:33.470648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692b75f-09ae-4340-b0dc-63285dc40eed None admin] PATH_INFO: `/v3/users/b3cf7341ca0241f38cba24308d157772` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:33.471821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692b75f-09ae-4340-b0dc-63285dc40eed None admin] RBAC: Authorizing `identity:get_user(user_id=b3cf7341ca0241f38cba24308d157772)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:33.473382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692b75f-09ae-4340-b0dc-63285dc40eed None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:33.475221 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 449/902] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 19 00:30:33 2022] GET /identity/v3/users/b3cf7341ca0241f38cba24308d157772 => generated 311 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:33.482656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1385d-49df-4810-84e1-4042f505ee55 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:33.498626 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:33.602811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1385d-49df-4810-84e1-4042f505ee55 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:33.640809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2adb16-9dc8-411d-8c1a-e33d7108eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:33.641427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2adb16-9dc8-411d-8c1a-e33d7108eed4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:33.641708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2adb16-9dc8-411d-8c1a-e33d7108eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:33.641972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2adb16-9dc8-411d-8c1a-e33d7108eed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:33.719887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2adb16-9dc8-411d-8c1a-e33d7108eed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:33.721466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2adb16-9dc8-411d-8c1a-e33d7108eed4 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:33.735547 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:33.862139 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 454/903] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:30:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 00:30:33.868146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692b75f-09ae-4340-b0dc-63285dc40eed None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:33.937079 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:33.979714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692b75f-09ae-4340-b0dc-63285dc40eed None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:34.016449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59352eec-fd51-409f-ad19-3236e628d9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:34.017191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352eec-fd51-409f-ad19-3236e628d9f3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:34.017473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352eec-fd51-409f-ad19-3236e628d9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:34.017744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352eec-fd51-409f-ad19-3236e628d9f3 None admin] PATH_INFO: `/v3/projects/a4e2f301bbaa45dfbbb373324a0d37bd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:34.018939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59352eec-fd51-409f-ad19-3236e628d9f3 None admin] RBAC: Authorizing `identity:get_project(project_id=a4e2f301bbaa45dfbbb373324a0d37bd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:34.020374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59352eec-fd51-409f-ad19-3236e628d9f3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:34.022079 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 450/904] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 19 00:30:33 2022] GET /identity/v3/projects/a4e2f301bbaa45dfbbb373324a0d37bd => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:34.028402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2adb16-9dc8-411d-8c1a-e33d7108eed4 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:34.150676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2adb16-9dc8-411d-8c1a-e33d7108eed4 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:34.164601 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:34.195154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d978b18-45f9-4f87-93d8-8cf042e71a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:34.195752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d978b18-45f9-4f87-93d8-8cf042e71a26 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:34.196027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d978b18-45f9-4f87-93d8-8cf042e71a26 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:34.196296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d978b18-45f9-4f87-93d8-8cf042e71a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:34.197059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d978b18-45f9-4f87-93d8-8cf042e71a26 None admin] RBAC: Adding query filter params (role.id=3c676188d9f646ba8509d3eef1e196de, scope.project.id=a4e2f301bbaa45dfbbb373324a0d37bd, user.id=b3cf7341ca0241f38cba24308d157772) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:30:34.197363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d978b18-45f9-4f87-93d8-8cf042e71a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:34.198797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d978b18-45f9-4f87-93d8-8cf042e71a26 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:34.206003 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 455/905] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:30:34 2022] GET /identity/v3/role_assignments?user.id=b3cf7341ca0241f38cba24308d157772&scope.project.id=a4e2f301bbaa45dfbbb373324a0d37bd&role.id=3c676188d9f646ba8509d3eef1e196de => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:30:44.013179 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=35 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:44.202579 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=13 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:34.247224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc950a6-ae7a-401c-b0f5-a271b484c946 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:34.247840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc950a6-ae7a-401c-b0f5-a271b484c946 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:34.247840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc950a6-ae7a-401c-b0f5-a271b484c946 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:34.249313 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 451/906] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:34.255308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527493ea-9431-4061-bdfe-bf964ae2de51 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:34.255831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527493ea-9431-4061-bdfe-bf964ae2de51 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:34.255831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527493ea-9431-4061-bdfe-bf964ae2de51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:34.277701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-527493ea-9431-4061-bdfe-bf964ae2de51 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:34.278927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-527493ea-9431-4061-bdfe-bf964ae2de51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:34.372297 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 456/907] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:31:34.682957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc950a6-ae7a-401c-b0f5-a271b484c946 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:34.827933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc950a6-ae7a-401c-b0f5-a271b484c946 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:34.873219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0dc64-fd3c-4d2e-88a1-27f120ccdb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:34.873899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0dc64-fd3c-4d2e-88a1-27f120ccdb1b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:34.874187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0dc64-fd3c-4d2e-88a1-27f120ccdb1b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:34.874494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0dc64-fd3c-4d2e-88a1-27f120ccdb1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:34.888715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0dc64-fd3c-4d2e-88a1-27f120ccdb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:34.890448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0dc64-fd3c-4d2e-88a1-27f120ccdb1b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-67d0dc64-fd3c-4d2e-88a1-27f120ccdb1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:31:34.908031 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:34.909193 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:31:34.910183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:31:34.910183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:34.910183 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:34.910183 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 452/908] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:34.916958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527493ea-9431-4061-bdfe-bf964ae2de51 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:35.046269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527493ea-9431-4061-bdfe-bf964ae2de51 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:35.081129 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:35.089033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521ee3e-ee36-48a3-a162-694bb9b3d171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:35.090556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ee3e-ee36-48a3-a162-694bb9b3d171 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:35.091043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ee3e-ee36-48a3-a162-694bb9b3d171 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:35.091690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ee3e-ee36-48a3-a162-694bb9b3d171 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:35.092781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521ee3e-ee36-48a3-a162-694bb9b3d171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:35.093281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521ee3e-ee36-48a3-a162-694bb9b3d171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:35.094884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521ee3e-ee36-48a3-a162-694bb9b3d171 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:35.116156 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 457/909] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:31:35.122487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0dc64-fd3c-4d2e-88a1-27f120ccdb1b None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:35.203197 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:35.278881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0dc64-fd3c-4d2e-88a1-27f120ccdb1b None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:35.326438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271829f9-87c7-4b3f-96fd-8f9b4717f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:35.326972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271829f9-87c7-4b3f-96fd-8f9b4717f356 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:35.327231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271829f9-87c7-4b3f-96fd-8f9b4717f356 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:35.327528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271829f9-87c7-4b3f-96fd-8f9b4717f356 None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:35.328379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271829f9-87c7-4b3f-96fd-8f9b4717f356 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:35.330136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271829f9-87c7-4b3f-96fd-8f9b4717f356 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:35.369640 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 453/910] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 19 00:31:35 2022] POST /identity/v3/users => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:31:37.928193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dcc00-20da-463d-807c-613c0542b9d3 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:37.928926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dcc00-20da-463d-807c-613c0542b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:37.928926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dcc00-20da-463d-807c-613c0542b9d3 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:37.930461 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 458/911] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:37.937521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e478a-05f8-4703-8019-eae910a422fc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:37.938049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e478a-05f8-4703-8019-eae910a422fc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:37.938049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e478a-05f8-4703-8019-eae910a422fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:37.963779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-440e478a-05f8-4703-8019-eae910a422fc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:37.965239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-440e478a-05f8-4703-8019-eae910a422fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:38.046015 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 454/912] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:31:38.383588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dcc00-20da-463d-807c-613c0542b9d3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:38.555042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dcc00-20da-463d-807c-613c0542b9d3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:38.597683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9dc02-5619-4ddb-813f-5295edc2826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:38.598322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9dc02-5619-4ddb-813f-5295edc2826d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:38.598604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9dc02-5619-4ddb-813f-5295edc2826d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:38.598880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9dc02-5619-4ddb-813f-5295edc2826d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:38.615875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9dc02-5619-4ddb-813f-5295edc2826d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-c1e9dc02-5619-4ddb-813f-5295edc2826d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:31:38.624780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:38.626655 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:38.627779 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 459/913] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:31:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:38.635809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e478a-05f8-4703-8019-eae910a422fc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:38.724021 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:38.863781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e478a-05f8-4703-8019-eae910a422fc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:38.928801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86b61-5bc8-41fb-adc3-df9550294c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:38.929725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86b61-5bc8-41fb-adc3-df9550294c57 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:38.930267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86b61-5bc8-41fb-adc3-df9550294c57 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:38.930827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86b61-5bc8-41fb-adc3-df9550294c57 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:38.933116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86b61-5bc8-41fb-adc3-df9550294c57 None admin] RBAC: Adding query filter params (name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:38.933843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86b61-5bc8-41fb-adc3-df9550294c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:38.937560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86b61-5bc8-41fb-adc3-df9550294c57 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:38.964678 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 455/914] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:31:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:38.966477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9dc02-5619-4ddb-813f-5295edc2826d None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:39.037586 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:39.105012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9dc02-5619-4ddb-813f-5295edc2826d None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:39.145923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c215be-8710-4a49-8207-4a5b809b3cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:39.147091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c215be-8710-4a49-8207-4a5b809b3cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:39.147091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c215be-8710-4a49-8207-4a5b809b3cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:39.147296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c215be-8710-4a49-8207-4a5b809b3cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:39.161444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c215be-8710-4a49-8207-4a5b809b3cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:39.162814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c215be-8710-4a49-8207-4a5b809b3cb3 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-10c215be-8710-4a49-8207-4a5b809b3cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:31:39.179122 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:39.180183 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:31:39.181311 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:31:39.181311 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:39.181311 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:39.184869 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 460/915] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:31:39.186376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86b61-5bc8-41fb-adc3-df9550294c57 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:39.321713 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:39.326131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86b61-5bc8-41fb-adc3-df9550294c57 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:39.375356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499bcaa-b243-4ff2-b808-4b7fae3166ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:39.376333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499bcaa-b243-4ff2-b808-4b7fae3166ef None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:39.376914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499bcaa-b243-4ff2-b808-4b7fae3166ef None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:39.377346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499bcaa-b243-4ff2-b808-4b7fae3166ef None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:39.378308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499bcaa-b243-4ff2-b808-4b7fae3166ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:39.378741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499bcaa-b243-4ff2-b808-4b7fae3166ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:39.380928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499bcaa-b243-4ff2-b808-4b7fae3166ef None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:39.401987 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 456/916] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:39.409789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c215be-8710-4a49-8207-4a5b809b3cb3 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:39.555302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c215be-8710-4a49-8207-4a5b809b3cb3 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:39.558073 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:39.600127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ce772-1910-4e27-abab-6413f08675f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:39.600886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ce772-1910-4e27-abab-6413f08675f8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:39.601206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ce772-1910-4e27-abab-6413f08675f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:39.601495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ce772-1910-4e27-abab-6413f08675f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:39.612078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ce772-1910-4e27-abab-6413f08675f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:39.613777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ce772-1910-4e27-abab-6413f08675f8 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-b32ce772-1910-4e27-abab-6413f08675f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:31:39.627926 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:39.630103 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:39.631082 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 461/917] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:31:39.636359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499bcaa-b243-4ff2-b808-4b7fae3166ef None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:39.764806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499bcaa-b243-4ff2-b808-4b7fae3166ef None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:39.806484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be61c9b-8ef2-49bf-b628-ea64647ff92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:39.807011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be61c9b-8ef2-49bf-b628-ea64647ff92a None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:39.807291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be61c9b-8ef2-49bf-b628-ea64647ff92a None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:39.807565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be61c9b-8ef2-49bf-b628-ea64647ff92a None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:39.808306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be61c9b-8ef2-49bf-b628-ea64647ff92a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:39.808611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be61c9b-8ef2-49bf-b628-ea64647ff92a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:39.810090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be61c9b-8ef2-49bf-b628-ea64647ff92a None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:39.831401 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 457/918] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Oct 19 00:31:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:39.836928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ce772-1910-4e27-abab-6413f08675f8 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:39.949991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ce772-1910-4e27-abab-6413f08675f8 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:39.997316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18f942-ad8d-4376-bb0e-035f54bbd100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:39.998443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18f942-ad8d-4376-bb0e-035f54bbd100 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:39.998927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18f942-ad8d-4376-bb0e-035f54bbd100 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:39.999393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18f942-ad8d-4376-bb0e-035f54bbd100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:40.017817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18f942-ad8d-4376-bb0e-035f54bbd100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:40.020610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18f942-ad8d-4376-bb0e-035f54bbd100 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-be18f942-ad8d-4376-bb0e-035f54bbd100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:31:40.047623 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:40.049787 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:31:40.051499 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:31:40.051499 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:40.051499 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:40.051499 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 462/919] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:31:40.054274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be61c9b-8ef2-49bf-b628-ea64647ff92a None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:40.085983 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:40.216614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be61c9b-8ef2-49bf-b628-ea64647ff92a None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:40.256866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3369a1f-c0fb-438f-9e8a-c2406409d626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:40.257493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3369a1f-c0fb-438f-9e8a-c2406409d626 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:40.257773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3369a1f-c0fb-438f-9e8a-c2406409d626 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:40.258047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3369a1f-c0fb-438f-9e8a-c2406409d626 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:40.258695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3369a1f-c0fb-438f-9e8a-c2406409d626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:40.259016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3369a1f-c0fb-438f-9e8a-c2406409d626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:40.261363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3369a1f-c0fb-438f-9e8a-c2406409d626 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:40.277502 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 458/920] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:31:40.283708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18f942-ad8d-4376-bb0e-035f54bbd100 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:40.308978 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:40.409236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18f942-ad8d-4376-bb0e-035f54bbd100 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:40.447921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8605510-1c9b-4532-b861-cc49b8240c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:40.448690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8605510-1c9b-4532-b861-cc49b8240c64 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:40.448974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8605510-1c9b-4532-b861-cc49b8240c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:40.449240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8605510-1c9b-4532-b861-cc49b8240c64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:40.456170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8605510-1c9b-4532-b861-cc49b8240c64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:40.457631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8605510-1c9b-4532-b861-cc49b8240c64 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-e8605510-1c9b-4532-b861-cc49b8240c64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:31:40.469052 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:40.470101 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:40.470973 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:31:40.470973 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:31:40.470973 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:31:40.470973 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:31:40.470973 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:31:40.470973 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:31:40.470973 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:31:40.470973 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:40.470973 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 463/921] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:31:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:40.476850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3369a1f-c0fb-438f-9e8a-c2406409d626 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:40.573854 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:40.600609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3369a1f-c0fb-438f-9e8a-c2406409d626 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:40.638109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd9f7a-3fa8-4cdf-979f-70c92cb69f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:40.638727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd9f7a-3fa8-4cdf-979f-70c92cb69f27 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:40.639058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd9f7a-3fa8-4cdf-979f-70c92cb69f27 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:40.639282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd9f7a-3fa8-4cdf-979f-70c92cb69f27 None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:40.639983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd9f7a-3fa8-4cdf-979f-70c92cb69f27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:40.640283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd9f7a-3fa8-4cdf-979f-70c92cb69f27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:40.641748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd9f7a-3fa8-4cdf-979f-70c92cb69f27 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:40.656668 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 459/922] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:31:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:40.662664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8605510-1c9b-4532-b861-cc49b8240c64 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:40.748118 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:40.778326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8605510-1c9b-4532-b861-cc49b8240c64 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:40.820116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc884228-e05d-46d5-8ed9-333f281cf66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:40.821108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884228-e05d-46d5-8ed9-333f281cf66b None admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:40.821387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884228-e05d-46d5-8ed9-333f281cf66b None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:40.822295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc884228-e05d-46d5-8ed9-333f281cf66b None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0a618510905146ceadcdddc97187e364/roles/aceae500b40841d18a66edacfc4a12cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:40.840513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc884228-e05d-46d5-8ed9-333f281cf66b None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=0a618510905146ceadcdddc97187e364, role_id=aceae500b40841d18a66edacfc4a12cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:40.842173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc884228-e05d-46d5-8ed9-333f281cf66b None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:40.855875 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 464/923] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:31:40 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0a618510905146ceadcdddc97187e364/roles/aceae500b40841d18a66edacfc4a12cf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:31:43.166974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169bdf9-fa78-4a37-aee8-7c493ab73ec2 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:43.167569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169bdf9-fa78-4a37-aee8-7c493ab73ec2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:43.167569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169bdf9-fa78-4a37-aee8-7c493ab73ec2 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:43.168932 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 460/924] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:43.174386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b01ee-1d68-4a7f-9b7d-0808ad93d33f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:43.174927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b01ee-1d68-4a7f-9b7d-0808ad93d33f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:43.174927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b01ee-1d68-4a7f-9b7d-0808ad93d33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:43.203297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-192b01ee-1d68-4a7f-9b7d-0808ad93d33f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:43.205643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-192b01ee-1d68-4a7f-9b7d-0808ad93d33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:43.306530 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 465/925] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:31:43.618112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169bdf9-fa78-4a37-aee8-7c493ab73ec2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:43.737004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169bdf9-fa78-4a37-aee8-7c493ab73ec2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:43.784523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca81a56-a7c5-45de-8c62-66d01ff4e235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:43.785197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca81a56-a7c5-45de-8c62-66d01ff4e235 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:43.785478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca81a56-a7c5-45de-8c62-66d01ff4e235 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:43.785749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca81a56-a7c5-45de-8c62-66d01ff4e235 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:43.795514 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:43.800317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca81a56-a7c5-45de-8c62-66d01ff4e235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-cca81a56-a7c5-45de-8c62-66d01ff4e235 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:31:43.805516 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:43.808002 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:43.809157 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 461/926] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 19 00:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:43.814160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b01ee-1d68-4a7f-9b7d-0808ad93d33f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:43.881063 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:43.932251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b01ee-1d68-4a7f-9b7d-0808ad93d33f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:43.975564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f4c57-9a46-48e3-8738-5286dae98027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:43.976331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f4c57-9a46-48e3-8738-5286dae98027 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:43.976684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f4c57-9a46-48e3-8738-5286dae98027 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:43.977032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f4c57-9a46-48e3-8738-5286dae98027 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:43.978311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f4c57-9a46-48e3-8738-5286dae98027 None admin] RBAC: Adding query filter params (name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:43.978645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f4c57-9a46-48e3-8738-5286dae98027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:43.980217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f4c57-9a46-48e3-8738-5286dae98027 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:43.990152 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 466/927] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 19 00:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:43.997305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca81a56-a7c5-45de-8c62-66d01ff4e235 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:44.132387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca81a56-a7c5-45de-8c62-66d01ff4e235 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:44.169971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99588069-36f7-4eef-8bb2-ab1e5db6e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:44.170838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99588069-36f7-4eef-8bb2-ab1e5db6e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:44.170928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99588069-36f7-4eef-8bb2-ab1e5db6e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:44.171236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99588069-36f7-4eef-8bb2-ab1e5db6e2f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:44.182731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99588069-36f7-4eef-8bb2-ab1e5db6e2f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:44.184427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99588069-36f7-4eef-8bb2-ab1e5db6e2f3 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-99588069-36f7-4eef-8bb2-ab1e5db6e2f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:31:44.201114 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:44.202440 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:31:44.203331 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:31:44.203331 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:44.203331 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:44.203331 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 462/928] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:44.208739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f4c57-9a46-48e3-8738-5286dae98027 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:44.329255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f4c57-9a46-48e3-8738-5286dae98027 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:44.350605 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:44.375982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc98bbc-a939-4d26-bbdc-f93a0edd81a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:44.376767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98bbc-a939-4d26-bbdc-f93a0edd81a6 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:44.377051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98bbc-a939-4d26-bbdc-f93a0edd81a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:44.377323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98bbc-a939-4d26-bbdc-f93a0edd81a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:44.377996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98bbc-a939-4d26-bbdc-f93a0edd81a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:44.378298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98bbc-a939-4d26-bbdc-f93a0edd81a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:44.379755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98bbc-a939-4d26-bbdc-f93a0edd81a6 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:44.394863 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 467/929] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:44.401426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99588069-36f7-4eef-8bb2-ab1e5db6e2f3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:44.466237 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:44.526600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99588069-36f7-4eef-8bb2-ab1e5db6e2f3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:44.577104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e6d7-b1fa-48a3-9d7a-05ec0d99b7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:44.577811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e6d7-b1fa-48a3-9d7a-05ec0d99b7d1 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:44.578058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e6d7-b1fa-48a3-9d7a-05ec0d99b7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:44.578328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e6d7-b1fa-48a3-9d7a-05ec0d99b7d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:44.590484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79e6d7-b1fa-48a3-9d7a-05ec0d99b7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:44.592055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79e6d7-b1fa-48a3-9d7a-05ec0d99b7d1 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-fc79e6d7-b1fa-48a3-9d7a-05ec0d99b7d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:31:44.606058 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:44.608399 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:44.609609 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 463/930] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:44.614068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc98bbc-a939-4d26-bbdc-f93a0edd81a6 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:44.737303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc98bbc-a939-4d26-bbdc-f93a0edd81a6 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:44.784909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c802bab-8486-4c29-a28d-06e875def2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:44.786081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c802bab-8486-4c29-a28d-06e875def2fe None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:44.786613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c802bab-8486-4c29-a28d-06e875def2fe None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:44.787086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c802bab-8486-4c29-a28d-06e875def2fe None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:44.787830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c802bab-8486-4c29-a28d-06e875def2fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:44.788126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c802bab-8486-4c29-a28d-06e875def2fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:44.789930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c802bab-8486-4c29-a28d-06e875def2fe None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:44.811085 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 468/931] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Oct 19 00:31:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:44.817662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e6d7-b1fa-48a3-9d7a-05ec0d99b7d1 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:44.941468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e6d7-b1fa-48a3-9d7a-05ec0d99b7d1 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:44.953369 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:44.986299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb8fd-59e6-48aa-86ca-e2749c9cfdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:44.987164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb8fd-59e6-48aa-86ca-e2749c9cfdd1 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:44.987568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb8fd-59e6-48aa-86ca-e2749c9cfdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:44.987887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb8fd-59e6-48aa-86ca-e2749c9cfdd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:45.085241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb8fd-59e6-48aa-86ca-e2749c9cfdd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:45.086843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb8fd-59e6-48aa-86ca-e2749c9cfdd1 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:45.213901 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 464/932] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:31:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:31:45.221378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c802bab-8486-4c29-a28d-06e875def2fe None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:45.263979 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:45.346096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c802bab-8486-4c29-a28d-06e875def2fe None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:45.390602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c2151-679a-4391-9382-baff7bd0576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:45.391299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c2151-679a-4391-9382-baff7bd0576a None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:45.391640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c2151-679a-4391-9382-baff7bd0576a None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:45.391837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c2151-679a-4391-9382-baff7bd0576a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:45.405255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c2151-679a-4391-9382-baff7bd0576a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:45.406830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c2151-679a-4391-9382-baff7bd0576a None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-013c2151-679a-4391-9382-baff7bd0576a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:31:45.425815 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:45.427060 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:31:45.427946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:31:45.427946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:45.427946 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:45.427946 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 469/933] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:45.433168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb8fd-59e6-48aa-86ca-e2749c9cfdd1 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:45.448848 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:45.563099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb8fd-59e6-48aa-86ca-e2749c9cfdd1 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:45.602556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f005e-ac5f-4ee4-a989-d54e31d628d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:45.603616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f005e-ac5f-4ee4-a989-d54e31d628d4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:45.604049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f005e-ac5f-4ee4-a989-d54e31d628d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:45.604049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f005e-ac5f-4ee4-a989-d54e31d628d4 None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:45.604593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f005e-ac5f-4ee4-a989-d54e31d628d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:45.604926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f005e-ac5f-4ee4-a989-d54e31d628d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:45.606341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f005e-ac5f-4ee4-a989-d54e31d628d4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:45.618226 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 465/934] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:45.625104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c2151-679a-4391-9382-baff7bd0576a None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:45.734195 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:45.754033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c2151-679a-4391-9382-baff7bd0576a None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:45.797037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc960370-e6cc-4c0b-b5ed-335619dc787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:45.797724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc960370-e6cc-4c0b-b5ed-335619dc787f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:45.798036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc960370-e6cc-4c0b-b5ed-335619dc787f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:45.798337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc960370-e6cc-4c0b-b5ed-335619dc787f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:45.805697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc960370-e6cc-4c0b-b5ed-335619dc787f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:45.807693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc960370-e6cc-4c0b-b5ed-335619dc787f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-fc960370-e6cc-4c0b-b5ed-335619dc787f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:31:45.819878 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:45.820846 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:45.821925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:31:45.821925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:31:45.821925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:31:45.821925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:31:45.821925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:31:45.821925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:31:45.821925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:31:45.821925 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:45.826364 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 470/935] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:45.827331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f005e-ac5f-4ee4-a989-d54e31d628d4 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:45.906450 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:45.948256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f005e-ac5f-4ee4-a989-d54e31d628d4 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:45.991658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab0727-7a64-4957-9884-42af046b9a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:45.992304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab0727-7a64-4957-9884-42af046b9a78 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:45.992587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab0727-7a64-4957-9884-42af046b9a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:45.992961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab0727-7a64-4957-9884-42af046b9a78 None admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:45.993765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab0727-7a64-4957-9884-42af046b9a78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:45.994147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab0727-7a64-4957-9884-42af046b9a78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:45.995927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab0727-7a64-4957-9884-42af046b9a78 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:46.010885 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 466/936] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:31:46.017656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc960370-e6cc-4c0b-b5ed-335619dc787f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:46.165085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc960370-e6cc-4c0b-b5ed-335619dc787f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:46.204927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad910a-47ce-40cd-b736-a3a1a8dca372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:46.205583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad910a-47ce-40cd-b736-a3a1a8dca372 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:46.205867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad910a-47ce-40cd-b736-a3a1a8dca372 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:46.206160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad910a-47ce-40cd-b736-a3a1a8dca372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:46.206967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad910a-47ce-40cd-b736-a3a1a8dca372 None admin] RBAC: Adding query filter params (role.id=aceae500b40841d18a66edacfc4a12cf, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=0a618510905146ceadcdddc97187e364) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:46.207291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad910a-47ce-40cd-b736-a3a1a8dca372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:46.208811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad910a-47ce-40cd-b736-a3a1a8dca372 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:46.216404 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 471/937] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:31:46 2022] GET /identity/v3/role_assignments?user.id=0a618510905146ceadcdddc97187e364&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=aceae500b40841d18a66edacfc4a12cf => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:31:48.621029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43e24b-f610-4a38-bbed-9beeab0e7d7a None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:48.621624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43e24b-f610-4a38-bbed-9beeab0e7d7a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:48.621719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43e24b-f610-4a38-bbed-9beeab0e7d7a None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:48.623243 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 467/938] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:48.629251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427da1f9-f5a7-462e-bc01-6fe44245ef81 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:48.629692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427da1f9-f5a7-462e-bc01-6fe44245ef81 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:48.629882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427da1f9-f5a7-462e-bc01-6fe44245ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:48.652109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-427da1f9-f5a7-462e-bc01-6fe44245ef81 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:48.654051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-427da1f9-f5a7-462e-bc01-6fe44245ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:48.658372 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:48.736314 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 472/939] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:31:49.066234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43e24b-f610-4a38-bbed-9beeab0e7d7a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:49.202774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43e24b-f610-4a38-bbed-9beeab0e7d7a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:49.232772 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:49.239792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082859de-141b-491e-a31f-d7c2035945a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:49.240462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082859de-141b-491e-a31f-d7c2035945a3 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:49.240732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082859de-141b-491e-a31f-d7c2035945a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:49.241004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082859de-141b-491e-a31f-d7c2035945a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:49.255651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082859de-141b-491e-a31f-d7c2035945a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-082859de-141b-491e-a31f-d7c2035945a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:31:49.261552 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:49.265194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:49.266035 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 468/940] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:31:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:49.270841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427da1f9-f5a7-462e-bc01-6fe44245ef81 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:49.395276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427da1f9-f5a7-462e-bc01-6fe44245ef81 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:49.435418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1d1a-4878-4277-89c9-f9b677d23b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:49.436024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1d1a-4878-4277-89c9-f9b677d23b41 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:49.436301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1d1a-4878-4277-89c9-f9b677d23b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:49.436571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1d1a-4878-4277-89c9-f9b677d23b41 None admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:49.437280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e1d1a-4878-4277-89c9-f9b677d23b41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:49.437573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e1d1a-4878-4277-89c9-f9b677d23b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:49.438933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e1d1a-4878-4277-89c9-f9b677d23b41 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:49.447754 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 473/941] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:31:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:49.453579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082859de-141b-491e-a31f-d7c2035945a3 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:49.581744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082859de-141b-491e-a31f-d7c2035945a3 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:49.622369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a242-cf4f-40fd-a3ae-71bf7d32b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:49.623025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a242-cf4f-40fd-a3ae-71bf7d32b7ef None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:49.623382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a242-cf4f-40fd-a3ae-71bf7d32b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:49.623584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a242-cf4f-40fd-a3ae-71bf7d32b7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:49.637515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4a242-cf4f-40fd-a3ae-71bf7d32b7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:49.639329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4a242-cf4f-40fd-a3ae-71bf7d32b7ef None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-63a4a242-cf4f-40fd-a3ae-71bf7d32b7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:31:49.656851 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:49.658026 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:31:49.659389 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:31:49.659389 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:49.659389 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:49.659389 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 469/942] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:49.664522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1d1a-4878-4277-89c9-f9b677d23b41 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:49.668661 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:49.791457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1d1a-4878-4277-89c9-f9b677d23b41 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:49.826761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb97ab-b5a6-4085-b032-543382a1b797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:49.827401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb97ab-b5a6-4085-b032-543382a1b797 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:49.827698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb97ab-b5a6-4085-b032-543382a1b797 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:49.827952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb97ab-b5a6-4085-b032-543382a1b797 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:49.828595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb97ab-b5a6-4085-b032-543382a1b797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:49.828924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb97ab-b5a6-4085-b032-543382a1b797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:49.830290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb97ab-b5a6-4085-b032-543382a1b797 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:49.844093 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 474/943] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:49.849879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a242-cf4f-40fd-a3ae-71bf7d32b7ef None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:49.896301 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:49.957645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a242-cf4f-40fd-a3ae-71bf7d32b7ef None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:49.996916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78232187-02e4-49e6-b41a-472332fd10ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:49.997553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78232187-02e4-49e6-b41a-472332fd10ee None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:49.997839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78232187-02e4-49e6-b41a-472332fd10ee None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:49.998118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78232187-02e4-49e6-b41a-472332fd10ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:50.006428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78232187-02e4-49e6-b41a-472332fd10ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:50.007920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78232187-02e4-49e6-b41a-472332fd10ee None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-78232187-02e4-49e6-b41a-472332fd10ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:31:50.020648 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:50.021836 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:50.022797 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 470/944] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:31:50.028596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb97ab-b5a6-4085-b032-543382a1b797 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:50.107031 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:50.148198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb97ab-b5a6-4085-b032-543382a1b797 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:50.189424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f86860-fd06-48e1-b771-7ac18df9d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:50.190105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f86860-fd06-48e1-b771-7ac18df9d83c None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:50.190378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f86860-fd06-48e1-b771-7ac18df9d83c None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:50.190758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f86860-fd06-48e1-b771-7ac18df9d83c None admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:50.191606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f86860-fd06-48e1-b771-7ac18df9d83c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:50.191972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f86860-fd06-48e1-b771-7ac18df9d83c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:50.193924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f86860-fd06-48e1-b771-7ac18df9d83c None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:50.215266 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 475/945] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Oct 19 00:31:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:50.221617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78232187-02e4-49e6-b41a-472332fd10ee None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:50.342797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78232187-02e4-49e6-b41a-472332fd10ee None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:50.344576 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:50.390980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94918b-bfa8-4ec3-a59e-e7539dbc199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:50.391620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94918b-bfa8-4ec3-a59e-e7539dbc199e None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:50.391911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94918b-bfa8-4ec3-a59e-e7539dbc199e None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:50.392189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94918b-bfa8-4ec3-a59e-e7539dbc199e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:50.403490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94918b-bfa8-4ec3-a59e-e7539dbc199e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:50.405034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94918b-bfa8-4ec3-a59e-e7539dbc199e None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-5b94918b-bfa8-4ec3-a59e-e7539dbc199e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:31:50.421402 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:50.422691 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:31:50.423734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:31:50.423734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:50.423734 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:50.423734 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 471/946] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:50.428690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f86860-fd06-48e1-b771-7ac18df9d83c None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:50.550445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f86860-fd06-48e1-b771-7ac18df9d83c None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:50.575495 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:50.595354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faa6cf-704c-4947-9e7f-cd730f921535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:50.596202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faa6cf-704c-4947-9e7f-cd730f921535 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:50.596594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faa6cf-704c-4947-9e7f-cd730f921535 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:50.596984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faa6cf-704c-4947-9e7f-cd730f921535 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:50.597852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82faa6cf-704c-4947-9e7f-cd730f921535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:50.598246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82faa6cf-704c-4947-9e7f-cd730f921535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:50.600036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82faa6cf-704c-4947-9e7f-cd730f921535 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:50.625377 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 476/947] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:31:50.626657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94918b-bfa8-4ec3-a59e-e7539dbc199e None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:50.740095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94918b-bfa8-4ec3-a59e-e7539dbc199e None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:50.778656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb521ca-a1a3-4363-a382-5f197dc84004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:50.779322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb521ca-a1a3-4363-a382-5f197dc84004 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:50.779610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb521ca-a1a3-4363-a382-5f197dc84004 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:50.779882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb521ca-a1a3-4363-a382-5f197dc84004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:50.789526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb521ca-a1a3-4363-a382-5f197dc84004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:50.791658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb521ca-a1a3-4363-a382-5f197dc84004 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-edb521ca-a1a3-4363-a382-5f197dc84004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:31:50.803689 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:50.804953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:50.806582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:31:50.806582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:31:50.806582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:31:50.806582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:31:50.806582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:31:50.806582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:31:50.806582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:31:50.806582 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:50.806582 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 472/948] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:31:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:50.811365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faa6cf-704c-4947-9e7f-cd730f921535 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:50.926394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faa6cf-704c-4947-9e7f-cd730f921535 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:50.969753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca8626-4c20-46fe-b275-a3e5c40e6012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:50.970430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca8626-4c20-46fe-b275-a3e5c40e6012 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:50.970805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca8626-4c20-46fe-b275-a3e5c40e6012 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:50.971056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca8626-4c20-46fe-b275-a3e5c40e6012 None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:50.971762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca8626-4c20-46fe-b275-a3e5c40e6012 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:50.972066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca8626-4c20-46fe-b275-a3e5c40e6012 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:50.973676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca8626-4c20-46fe-b275-a3e5c40e6012 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:50.989621 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 477/949] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:31:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:50.996827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb521ca-a1a3-4363-a382-5f197dc84004 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:51.016257 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:51.115330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb521ca-a1a3-4363-a382-5f197dc84004 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:51.153980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a9533-c2d7-4fcd-b649-33322aef2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:51.154657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a9533-c2d7-4fcd-b649-33322aef2af2 None admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:51.154935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a9533-c2d7-4fcd-b649-33322aef2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:51.155210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a9533-c2d7-4fcd-b649-33322aef2af2 None admin] PATH_INFO: `/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0a618510905146ceadcdddc97187e364/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:51.157482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a9533-c2d7-4fcd-b649-33322aef2af2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f743cd924f045c2a026670ff8d6a5ac, user_id=0a618510905146ceadcdddc97187e364, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:51.158925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a9533-c2d7-4fcd-b649-33322aef2af2 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:51.175668 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 473/950] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 19 00:31:50 2022] PUT /identity/v3/projects/6f743cd924f045c2a026670ff8d6a5ac/users/0a618510905146ceadcdddc97187e364/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:31:53.733601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61809-a6ca-4476-9098-98db001c3627 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:53.734157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61809-a6ca-4476-9098-98db001c3627 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:53.734254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a61809-a6ca-4476-9098-98db001c3627 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:53.741756 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 478/951] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:53.745229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b03d1c-4fff-4ea7-b84a-e3da826f5107 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:53.745229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b03d1c-4fff-4ea7-b84a-e3da826f5107 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:53.745229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b03d1c-4fff-4ea7-b84a-e3da826f5107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:53.764302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e4b03d1c-4fff-4ea7-b84a-e3da826f5107 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:53.765720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e4b03d1c-4fff-4ea7-b84a-e3da826f5107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:53.845743 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 474/952] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:31:54.135449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61809-a6ca-4476-9098-98db001c3627 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:54.198542 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:54.270344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a61809-a6ca-4476-9098-98db001c3627 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:54.307453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335d7a-934b-4213-a587-43492a96728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:54.308055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335d7a-934b-4213-a587-43492a96728e None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:54.308348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335d7a-934b-4213-a587-43492a96728e None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:54.308643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335d7a-934b-4213-a587-43492a96728e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:54.320281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac335d7a-934b-4213-a587-43492a96728e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-ac335d7a-934b-4213-a587-43492a96728e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:31:54.325742 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:54.326917 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:54.327755 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 479/953] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 19 00:31:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:54.333094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b03d1c-4fff-4ea7-b84a-e3da826f5107 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:54.336740 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:54.449844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b03d1c-4fff-4ea7-b84a-e3da826f5107 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:54.491151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9b33-5f8f-47d9-9bbf-bc7805301404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:54.491764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9b33-5f8f-47d9-9bbf-bc7805301404 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:54.492103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9b33-5f8f-47d9-9bbf-bc7805301404 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:54.492373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9b33-5f8f-47d9-9bbf-bc7805301404 None admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:54.493641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9b33-5f8f-47d9-9bbf-bc7805301404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:54.494114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9b33-5f8f-47d9-9bbf-bc7805301404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:54.496631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9b33-5f8f-47d9-9bbf-bc7805301404 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:54.510120 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 475/954] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 19 00:31:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:54.517269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335d7a-934b-4213-a587-43492a96728e None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:54.637984 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:54.641580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335d7a-934b-4213-a587-43492a96728e None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:54.693558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049f614-ba94-4fa7-8a13-c43023366ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:54.694577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049f614-ba94-4fa7-8a13-c43023366ee8 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:54.695061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049f614-ba94-4fa7-8a13-c43023366ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:54.695445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049f614-ba94-4fa7-8a13-c43023366ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:54.710187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049f614-ba94-4fa7-8a13-c43023366ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:54.712446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049f614-ba94-4fa7-8a13-c43023366ee8 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-9049f614-ba94-4fa7-8a13-c43023366ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:31:54.731078 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:54.732412 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:31:54.733418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:31:54.733418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:54.733418 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:54.733418 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 480/955] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:31:54.738754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9b33-5f8f-47d9-9bbf-bc7805301404 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:54.813447 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:54.852692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9b33-5f8f-47d9-9bbf-bc7805301404 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:54.894681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af2f8-8b8c-4390-b41e-c6a5583991da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:54.895297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af2f8-8b8c-4390-b41e-c6a5583991da None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:54.895684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af2f8-8b8c-4390-b41e-c6a5583991da None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:54.895901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7af2f8-8b8c-4390-b41e-c6a5583991da None admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:54.896605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7af2f8-8b8c-4390-b41e-c6a5583991da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:54.896988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7af2f8-8b8c-4390-b41e-c6a5583991da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:54.898436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7af2f8-8b8c-4390-b41e-c6a5583991da None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:54.912349 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 476/956] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:54.919197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049f614-ba94-4fa7-8a13-c43023366ee8 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:55.045478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049f614-ba94-4fa7-8a13-c43023366ee8 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:55.099888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f6eaa-db2a-4244-b310-72255b2e59c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:55.100553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f6eaa-db2a-4244-b310-72255b2e59c4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:55.100887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f6eaa-db2a-4244-b310-72255b2e59c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:55.101161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f6eaa-db2a-4244-b310-72255b2e59c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:55.110327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f6eaa-db2a-4244-b310-72255b2e59c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:55.111869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f6eaa-db2a-4244-b310-72255b2e59c4 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-e06f6eaa-db2a-4244-b310-72255b2e59c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:31:55.125257 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:55.126647 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:55.127692 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 481/957] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:55.132543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af2f8-8b8c-4390-b41e-c6a5583991da None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:55.249123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7af2f8-8b8c-4390-b41e-c6a5583991da None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:55.278550 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:55.288531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ea9d4-4c56-41fc-a546-79c6d803581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:55.289171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ea9d4-4c56-41fc-a546-79c6d803581e None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:55.289454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ea9d4-4c56-41fc-a546-79c6d803581e None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:55.289912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ea9d4-4c56-41fc-a546-79c6d803581e None admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:55.290567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ea9d4-4c56-41fc-a546-79c6d803581e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:55.290874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ea9d4-4c56-41fc-a546-79c6d803581e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:55.292353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ea9d4-4c56-41fc-a546-79c6d803581e None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:55.314250 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 477/958] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Oct 19 00:31:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:55.320802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f6eaa-db2a-4244-b310-72255b2e59c4 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:55.338978 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:55.449181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f6eaa-db2a-4244-b310-72255b2e59c4 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:55.487591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443fb8f-9ad0-4b3e-979b-17e95169de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:55.488218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fb8f-9ad0-4b3e-979b-17e95169de88 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:55.488518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fb8f-9ad0-4b3e-979b-17e95169de88 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:55.488837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fb8f-9ad0-4b3e-979b-17e95169de88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:55.573892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443fb8f-9ad0-4b3e-979b-17e95169de88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:55.575271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443fb8f-9ad0-4b3e-979b-17e95169de88 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:55.592106 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:55.695810 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 482/959] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 19 00:31:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:31:55.702217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ea9d4-4c56-41fc-a546-79c6d803581e None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:55.824647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ea9d4-4c56-41fc-a546-79c6d803581e None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:55.865621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097ccfb-94cc-44fb-91e9-f614688ec0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:55.866307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097ccfb-94cc-44fb-91e9-f614688ec0d7 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:55.866590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097ccfb-94cc-44fb-91e9-f614688ec0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:55.866862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097ccfb-94cc-44fb-91e9-f614688ec0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:55.878800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097ccfb-94cc-44fb-91e9-f614688ec0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:55.880603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097ccfb-94cc-44fb-91e9-f614688ec0d7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-7097ccfb-94cc-44fb-91e9-f614688ec0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:31:55.898126 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:55.899309 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:31:55.900414 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:31:55.900414 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:31:55.900414 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:55.905996 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 478/960] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:55.907405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443fb8f-9ad0-4b3e-979b-17e95169de88 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:56.021960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443fb8f-9ad0-4b3e-979b-17e95169de88 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:56.041266 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:56.072493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fc477-1b3a-48b7-8d87-9d588ed71481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:56.073252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fc477-1b3a-48b7-8d87-9d588ed71481 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:56.073571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fc477-1b3a-48b7-8d87-9d588ed71481 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:56.073878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fc477-1b3a-48b7-8d87-9d588ed71481 None admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:56.074727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fc477-1b3a-48b7-8d87-9d588ed71481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:56.075163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fc477-1b3a-48b7-8d87-9d588ed71481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:56.076830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fc477-1b3a-48b7-8d87-9d588ed71481 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:56.096613 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 483/961] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 19 00:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:56.103364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097ccfb-94cc-44fb-91e9-f614688ec0d7 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:56.139921 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:56.213011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097ccfb-94cc-44fb-91e9-f614688ec0d7 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:56.250427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31add7f1-c9e6-4612-9772-3e7659b6b542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:56.251065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31add7f1-c9e6-4612-9772-3e7659b6b542 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:56.251342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31add7f1-c9e6-4612-9772-3e7659b6b542 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:56.251612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31add7f1-c9e6-4612-9772-3e7659b6b542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:56.259232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31add7f1-c9e6-4612-9772-3e7659b6b542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:56.260901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31add7f1-c9e6-4612-9772-3e7659b6b542 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-31add7f1-c9e6-4612-9772-3e7659b6b542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:31:56.273416 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:56.275105 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:56.281423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:31:56.281423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:31:56.281423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:31:56.281423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:31:56.281423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:31:56.281423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:31:56.281423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:31:56.281423 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:31:56.281423 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 479/962] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 19 00:31:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:56.283739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fc477-1b3a-48b7-8d87-9d588ed71481 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:56.394980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fc477-1b3a-48b7-8d87-9d588ed71481 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:56.432690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13ee58-a9a8-4af5-829a-2c6f4897811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:56.433318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13ee58-a9a8-4af5-829a-2c6f4897811d None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:56.433598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13ee58-a9a8-4af5-829a-2c6f4897811d None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:56.433872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13ee58-a9a8-4af5-829a-2c6f4897811d None admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:56.434579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13ee58-a9a8-4af5-829a-2c6f4897811d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:56.434882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13ee58-a9a8-4af5-829a-2c6f4897811d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:56.436314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13ee58-a9a8-4af5-829a-2c6f4897811d None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:56.449241 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 484/963] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 19 00:31:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:56.455674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31add7f1-c9e6-4612-9772-3e7659b6b542 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:56.563093 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:56.570695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31add7f1-c9e6-4612-9772-3e7659b6b542 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:56.607387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2962e5-e781-4c73-80f5-090b6c6575b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:56.607980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2962e5-e781-4c73-80f5-090b6c6575b7 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:56.608255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2962e5-e781-4c73-80f5-090b6c6575b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:56.608525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2962e5-e781-4c73-80f5-090b6c6575b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:56.609274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2962e5-e781-4c73-80f5-090b6c6575b7 None admin] RBAC: Adding query filter params (role.id=3c676188d9f646ba8509d3eef1e196de, scope.project.id=6f743cd924f045c2a026670ff8d6a5ac, user.id=0a618510905146ceadcdddc97187e364) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:56.609578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2962e5-e781-4c73-80f5-090b6c6575b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:56.610989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2962e5-e781-4c73-80f5-090b6c6575b7 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:56.616652 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 480/964] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 19 00:31:56 2022] GET /identity/v3/role_assignments?user.id=0a618510905146ceadcdddc97187e364&scope.project.id=6f743cd924f045c2a026670ff8d6a5ac&role.id=3c676188d9f646ba8509d3eef1e196de => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:58.829800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c438cf1-8123-4b5e-8097-75bbfb3786ba None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:58.830389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c438cf1-8123-4b5e-8097-75bbfb3786ba None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:58.830389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c438cf1-8123-4b5e-8097-75bbfb3786ba None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:58.831681 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 485/965] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:58.837341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9e45-e6a1-4639-b5e2-8001d773809e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:58.837773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9e45-e6a1-4639-b5e2-8001d773809e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:58.837874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9e45-e6a1-4639-b5e2-8001d773809e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:58.856529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-61fc9e45-e6a1-4639-b5e2-8001d773809e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:58.857750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-61fc9e45-e6a1-4639-b5e2-8001d773809e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:58.923978 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 481/966] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:31:59.215536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c438cf1-8123-4b5e-8097-75bbfb3786ba None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:59.249120 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:59.324837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c438cf1-8123-4b5e-8097-75bbfb3786ba None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:59.360360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478540d-50f9-42da-9c4d-1c7e1393f856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:59.361025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478540d-50f9-42da-9c4d-1c7e1393f856 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:59.361305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478540d-50f9-42da-9c4d-1c7e1393f856 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:59.361578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478540d-50f9-42da-9c4d-1c7e1393f856 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:59.362167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478540d-50f9-42da-9c4d-1c7e1393f856 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:59.363545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478540d-50f9-42da-9c4d-1c7e1393f856 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-9478540d-50f9-42da-9c4d-1c7e1393f856 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:31:59.373593 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:31:59.375087 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:31:59.376406 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 486/967] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 19 00:31:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:31:59.380830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9e45-e6a1-4639-b5e2-8001d773809e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:59.473948 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:59.484701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9e45-e6a1-4639-b5e2-8001d773809e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:59.521213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c842-a512-49ca-9aa5-33e982fb4102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:59.521831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c842-a512-49ca-9aa5-33e982fb4102 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:59.522113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c842-a512-49ca-9aa5-33e982fb4102 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:59.522386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c842-a512-49ca-9aa5-33e982fb4102 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:59.523022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c842-a512-49ca-9aa5-33e982fb4102 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:59.523329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c842-a512-49ca-9aa5-33e982fb4102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:59.525252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c842-a512-49ca-9aa5-33e982fb4102 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:59.530640 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 482/968] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Oct 19 00:31:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:31:59.536867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478540d-50f9-42da-9c4d-1c7e1393f856 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:59.637154 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:59.644930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478540d-50f9-42da-9c4d-1c7e1393f856 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:59.687638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a96df-92ff-48fb-aed6-ac3e382e0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:59.688262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a96df-92ff-48fb-aed6-ac3e382e0da4 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:59.688541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a96df-92ff-48fb-aed6-ac3e382e0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:59.688840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a96df-92ff-48fb-aed6-ac3e382e0da4 None admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:59.689490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a96df-92ff-48fb-aed6-ac3e382e0da4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:31:59.689793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a96df-92ff-48fb-aed6-ac3e382e0da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:59.691225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a96df-92ff-48fb-aed6-ac3e382e0da4 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:59.697044 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 487/969] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Oct 19 00:31:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:32:01.934087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52cde0-e3c3-4483-ad14-dba271823597 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:01.934629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52cde0-e3c3-4483-ad14-dba271823597 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:01.934629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52cde0-e3c3-4483-ad14-dba271823597 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:01.936005 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 483/970] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:01.941868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798f94e-3792-40e2-a1e3-811833be15cd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:01.942353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798f94e-3792-40e2-a1e3-811833be15cd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:01.942480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798f94e-3792-40e2-a1e3-811833be15cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:01.962375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9798f94e-3792-40e2-a1e3-811833be15cd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:01.963650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9798f94e-3792-40e2-a1e3-811833be15cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:02.035122 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 488/971] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:32:02.327888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52cde0-e3c3-4483-ad14-dba271823597 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:02.447484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52cde0-e3c3-4483-ad14-dba271823597 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:02.485226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba5b4b-319c-4065-b4c3-e7f5918c5071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:02.485849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba5b4b-319c-4065-b4c3-e7f5918c5071 None admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:02.486126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba5b4b-319c-4065-b4c3-e7f5918c5071 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:02.486399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba5b4b-319c-4065-b4c3-e7f5918c5071 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:02.487080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba5b4b-319c-4065-b4c3-e7f5918c5071 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:02.488473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba5b4b-319c-4065-b4c3-e7f5918c5071 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:02.505667 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 484/972] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 19 00:32:02 2022] POST /identity/v3/services => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:32:04.723668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3238ed-747e-451a-9a06-0794e2d78bc3 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:04.724242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3238ed-747e-451a-9a06-0794e2d78bc3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:04.724242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3238ed-747e-451a-9a06-0794e2d78bc3 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:04.725624 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 489/973] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:32:04.734519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368da9-1fe6-4311-a021-5c0ee67ce135 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:04.735068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368da9-1fe6-4311-a021-5c0ee67ce135 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:04.735068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368da9-1fe6-4311-a021-5c0ee67ce135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:04.754326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c9368da9-1fe6-4311-a021-5c0ee67ce135 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:04.755534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c9368da9-1fe6-4311-a021-5c0ee67ce135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:04.766694 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:04.833851 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 485/974] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:32:05.103835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3238ed-747e-451a-9a06-0794e2d78bc3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:05.207377 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:05.218906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3238ed-747e-451a-9a06-0794e2d78bc3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:05.254192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c989d-ac26-4a5d-8e62-d45376b0207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:05.254840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c989d-ac26-4a5d-8e62-d45376b0207f None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:05.255121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c989d-ac26-4a5d-8e62-d45376b0207f None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:05.255393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c989d-ac26-4a5d-8e62-d45376b0207f None admin] PATH_INFO: `/v3/services/placement` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:05.255976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c989d-ac26-4a5d-8e62-d45376b0207f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:05.257383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c989d-ac26-4a5d-8e62-d45376b0207f None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-be1c989d-ac26-4a5d-8e62-d45376b0207f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:32:05.266270 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:32:05.267465 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:32:05.268516 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 490/975] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 19 00:32:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:32:05.276856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368da9-1fe6-4311-a021-5c0ee67ce135 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:05.387319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368da9-1fe6-4311-a021-5c0ee67ce135 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:05.423675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b63db-7d30-44c1-a832-2a8382e553f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:05.424287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b63db-7d30-44c1-a832-2a8382e553f4 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:05.424563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b63db-7d30-44c1-a832-2a8382e553f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:05.424863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b63db-7d30-44c1-a832-2a8382e553f4 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:05.425494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b63db-7d30-44c1-a832-2a8382e553f4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:32:05.425795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b63db-7d30-44c1-a832-2a8382e553f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:05.427258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b63db-7d30-44c1-a832-2a8382e553f4 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:05.434887 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 486/976] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Oct 19 00:32:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:32:05.441295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c989d-ac26-4a5d-8e62-d45376b0207f None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:05.580007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c989d-ac26-4a5d-8e62-d45376b0207f None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:05.623659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3de72-db85-4f46-91f9-88ad3de08037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:05.624375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3de72-db85-4f46-91f9-88ad3de08037 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:05.624751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3de72-db85-4f46-91f9-88ad3de08037 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:05.625073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3de72-db85-4f46-91f9-88ad3de08037 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:05.625877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3de72-db85-4f46-91f9-88ad3de08037 None admin] RBAC: Adding query filter params (interface=public, service_id=c0862c84a54947629f192734cd1479ef, region_id=RegionOne) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:32:05.626230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3de72-db85-4f46-91f9-88ad3de08037 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:05.627791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3de72-db85-4f46-91f9-88ad3de08037 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:05.634692 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 491/977] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 19 00:32:05 2022] GET /identity/v3/endpoints?service_id=c0862c84a54947629f192734cd1479ef&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:32:05.644418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b63db-7d30-44c1-a832-2a8382e553f4 None admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:05.651444 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:05.753823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b63db-7d30-44c1-a832-2a8382e553f4 None admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:05.790046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83e71f-8dee-419d-a19a-da0512ce3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:05.790781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e71f-8dee-419d-a19a-da0512ce3388 None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:05.791156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e71f-8dee-419d-a19a-da0512ce3388 None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:05.791517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e71f-8dee-419d-a19a-da0512ce3388 None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:05.792219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83e71f-8dee-419d-a19a-da0512ce3388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:05.793729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83e71f-8dee-419d-a19a-da0512ce3388 None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:05.800977 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 487/978] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 19 00:32:05 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:32:08.088178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9a1d-769e-466a-9368-7a00d12942a4 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:08.089190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9a1d-769e-466a-9368-7a00d12942a4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:08.089190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae9a1d-769e-466a-9368-7a00d12942a4 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:08.091485 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 492/979] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:32:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:08.097280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42394b-520d-4d9a-951c-27ce24c4a701 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:08.098378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42394b-520d-4d9a-951c-27ce24c4a701 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:08.098378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42394b-520d-4d9a-951c-27ce24c4a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:08.118719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ea42394b-520d-4d9a-951c-27ce24c4a701 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:08.119920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea42394b-520d-4d9a-951c-27ce24c4a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:08.192714 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:08.199703 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 488/980] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:32:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:32:08.471152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae9a1d-769e-466a-9368-7a00d12942a4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:08.491457 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:08.594581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae9a1d-769e-466a-9368-7a00d12942a4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:08.636276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c164217-057c-47c9-9445-03cf94f78507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:08.636961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c164217-057c-47c9-9445-03cf94f78507 None admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:08.637239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c164217-057c-47c9-9445-03cf94f78507 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:08.637511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c164217-057c-47c9-9445-03cf94f78507 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:08.638108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c164217-057c-47c9-9445-03cf94f78507 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:08.639519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c164217-057c-47c9-9445-03cf94f78507 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-8c164217-057c-47c9-9445-03cf94f78507 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:32:08.649385 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:32:08.651298 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:32:08.652882 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:32:08.655522 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 493/981] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 19 00:32:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:32:08.656673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42394b-520d-4d9a-951c-27ce24c4a701 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:08.769145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42394b-520d-4d9a-951c-27ce24c4a701 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:08.808246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf3845-7a69-4afa-827f-9b0dc6307e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:08.808964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf3845-7a69-4afa-827f-9b0dc6307e8b None admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:08.809289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf3845-7a69-4afa-827f-9b0dc6307e8b None admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:08.809609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf3845-7a69-4afa-827f-9b0dc6307e8b None admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:08.810350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf3845-7a69-4afa-827f-9b0dc6307e8b None admin] RBAC: Adding query filter params (name=placement) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:32:08.810701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf3845-7a69-4afa-827f-9b0dc6307e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:08.812164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf3845-7a69-4afa-827f-9b0dc6307e8b None admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:08.818135 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 489/982] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Oct 19 00:32:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:32:08.827376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c164217-057c-47c9-9445-03cf94f78507 None admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:08.923001 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:08.942664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c164217-057c-47c9-9445-03cf94f78507 None admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:08.980383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1541fb-63e8-4a6b-8133-f94522e3d6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:08.981037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1541fb-63e8-4a6b-8133-f94522e3d6a4 None admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:08.981316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1541fb-63e8-4a6b-8133-f94522e3d6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:08.981591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1541fb-63e8-4a6b-8133-f94522e3d6a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:08.982271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1541fb-63e8-4a6b-8133-f94522e3d6a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:08.983653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1541fb-63e8-4a6b-8133-f94522e3d6a4 None admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:09.006024 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 494/983] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:32:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:32:18.815158 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=69 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:19.000894 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:18.232914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fad2fa-e4c5-4155-866e-9df7c7b0757e None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:18.234885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fad2fa-e4c5-4155-866e-9df7c7b0757e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:18.237046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fad2fa-e4c5-4155-866e-9df7c7b0757e None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:18.251294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b521-782d-46d7-afd5-8a0021713d5d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:18.251294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b521-782d-46d7-afd5-8a0021713d5d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:18.251294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b521-782d-46d7-afd5-8a0021713d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:18.252941 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 490/984] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:18 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:18.409338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1240b521-782d-46d7-afd5-8a0021713d5d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:18.410723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1240b521-782d-46d7-afd5-8a0021713d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:18.689953 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 495/985] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:33:19.088131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611654d-9572-4bf7-81f0-ff43157b1463 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:19.088131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611654d-9572-4bf7-81f0-ff43157b1463 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:19.088131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611654d-9572-4bf7-81f0-ff43157b1463 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:19.089314 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 491/986] 10.222.0.27 () {54 vars in 964 bytes} [Wed Oct 19 00:33:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:19.099476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f498-cd56-4368-a612-c164954ba338 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:19.100271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f498-cd56-4368-a612-c164954ba338 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:19.100825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f498-cd56-4368-a612-c164954ba338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:19.204433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5b19f498-cd56-4368-a612-c164954ba338 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:19.206160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5b19f498-cd56-4368-a612-c164954ba338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:19.231781 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:19.309364 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 496/987] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Oct 19 00:33:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:33:19.310659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611654d-9572-4bf7-81f0-ff43157b1463 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:19.314395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9611654d-9572-4bf7-81f0-ff43157b1463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:19.548927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611654d-9572-4bf7-81f0-ff43157b1463 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:19.698517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3636c3c-ee31-4a66-9c5b-315352bd8b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:19.699134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3636c3c-ee31-4a66-9c5b-315352bd8b12 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:19.699407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3636c3c-ee31-4a66-9c5b-315352bd8b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:19.699663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3636c3c-ee31-4a66-9c5b-315352bd8b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:19.701450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d3636c3c-ee31-4a66-9c5b-315352bd8b12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:19.767573 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:19.830344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3636c3c-ee31-4a66-9c5b-315352bd8b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:19.831690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3636c3c-ee31-4a66-9c5b-315352bd8b12 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:19.854566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 492/988] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:22.621220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28554aa-3487-4d12-9d71-e72a48022b75 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:22.621767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28554aa-3487-4d12-9d71-e72a48022b75 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:22.621767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28554aa-3487-4d12-9d71-e72a48022b75 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:22.623150 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 497/989] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:22.630507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d8db-d0d0-4115-97af-713870cdc254 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:22.630969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d8db-d0d0-4115-97af-713870cdc254 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:22.631059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d8db-d0d0-4115-97af-713870cdc254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:22.714991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f210d8db-d0d0-4115-97af-713870cdc254 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:22.715864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f210d8db-d0d0-4115-97af-713870cdc254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:22.816538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 493/990] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:23.102852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28554aa-3487-4d12-9d71-e72a48022b75 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:23.104426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b28554aa-3487-4d12-9d71-e72a48022b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:23.212468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28554aa-3487-4d12-9d71-e72a48022b75 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:23.288003 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:23.292185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb3052-c4dc-4a80-9fac-b29cb444362d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:23.292842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb3052-c4dc-4a80-9fac-b29cb444362d service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:23.293370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb3052-c4dc-4a80-9fac-b29cb444362d service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:23.293651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb3052-c4dc-4a80-9fac-b29cb444362d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:23.295354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-42fb3052-c4dc-4a80-9fac-b29cb444362d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:23.412965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb3052-c4dc-4a80-9fac-b29cb444362d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:23.414431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb3052-c4dc-4a80-9fac-b29cb444362d service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:23.435267 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 498/991] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:26.096347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66665-35b6-4c78-a40b-9fc99a361143 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:26.096955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66665-35b6-4c78-a40b-9fc99a361143 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:26.096955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66665-35b6-4c78-a40b-9fc99a361143 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:26.098971 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 494/992] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:26.104813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a73f5-8e7a-48eb-900e-003de22af734 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:26.105335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a73f5-8e7a-48eb-900e-003de22af734 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:26.105428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a73f5-8e7a-48eb-900e-003de22af734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:26.179856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6f8a73f5-8e7a-48eb-900e-003de22af734 None None] MFA Rules not processed for user `c975a7f72c0c44ca9cc57c6e90d5b083`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:26.181282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6f8a73f5-8e7a-48eb-900e-003de22af734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:26.235747 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:26.285165 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 499/993] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:26.582330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66665-35b6-4c78-a40b-9fc99a361143 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:26.584180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d4d66665-35b6-4c78-a40b-9fc99a361143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:26.594149 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:26.695598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66665-35b6-4c78-a40b-9fc99a361143 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:26.773055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dece57-60c7-4f3f-be55-6dac6b27aaa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:26.773663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dece57-60c7-4f3f-be55-6dac6b27aaa6 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:26.773935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dece57-60c7-4f3f-be55-6dac6b27aaa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:26.774203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dece57-60c7-4f3f-be55-6dac6b27aaa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:26.775796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-71dece57-60c7-4f3f-be55-6dac6b27aaa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:26.839481 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:26.899334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dece57-60c7-4f3f-be55-6dac6b27aaa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:26.900821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dece57-60c7-4f3f-be55-6dac6b27aaa6 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:26.921717 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 495/994] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:33:30.015536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252617f3-69f8-47b8-a70d-d56790cb979f None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:30.016294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252617f3-69f8-47b8-a70d-d56790cb979f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:30.016294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252617f3-69f8-47b8-a70d-d56790cb979f None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:30.017500 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 500/995] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:30.025235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06435b1-ea6d-4bf6-9afe-a5087f2acf8f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:30.026056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06435b1-ea6d-4bf6-9afe-a5087f2acf8f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:30.026056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06435b1-ea6d-4bf6-9afe-a5087f2acf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:30.107584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a06435b1-ea6d-4bf6-9afe-a5087f2acf8f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:30.108943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a06435b1-ea6d-4bf6-9afe-a5087f2acf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:30.221436 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 496/996] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:30.583653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252617f3-69f8-47b8-a70d-d56790cb979f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:30.585264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-252617f3-69f8-47b8-a70d-d56790cb979f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:30.716825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252617f3-69f8-47b8-a70d-d56790cb979f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:30.799965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d473e9-54ac-4427-a308-d3d84fe2db31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:30.800759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d473e9-54ac-4427-a308-d3d84fe2db31 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:30.801043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d473e9-54ac-4427-a308-d3d84fe2db31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:30.801579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d473e9-54ac-4427-a308-d3d84fe2db31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:30.803224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-35d473e9-54ac-4427-a308-d3d84fe2db31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:30.810755 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:30.919348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d473e9-54ac-4427-a308-d3d84fe2db31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:30.920835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d473e9-54ac-4427-a308-d3d84fe2db31 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:30.946808 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 501/997] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:33:33.855477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646b44d-333a-4a07-9961-9a90ffc16d84 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:33.856132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646b44d-333a-4a07-9961-9a90ffc16d84 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:33.856132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646b44d-333a-4a07-9961-9a90ffc16d84 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:33.857403 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 497/998] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:33.863665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487e72-6b94-4a38-9673-8d8d6cf4a51f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:33.864239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487e72-6b94-4a38-9673-8d8d6cf4a51f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:33.864450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487e72-6b94-4a38-9673-8d8d6cf4a51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:33.957972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a0487e72-6b94-4a38-9673-8d8d6cf4a51f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:33.959357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a0487e72-6b94-4a38-9673-8d8d6cf4a51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:34.023710 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:34.086862 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 502/999] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:34.385034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11d85a-0cfa-4a12-a731-70d7f809619a None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:34.385317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11d85a-0cfa-4a12-a731-70d7f809619a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:34.385595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11d85a-0cfa-4a12-a731-70d7f809619a None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:34.387018 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 498/1000] 10.222.0.27 () {54 vars in 964 bytes} [Wed Oct 19 00:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:33:34.394285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52dd63-cb62-4b6b-806b-07d7d7734b32 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:34.394285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52dd63-cb62-4b6b-806b-07d7d7734b32 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:34.394285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52dd63-cb62-4b6b-806b-07d7d7734b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:34.500230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2b52dd63-cb62-4b6b-806b-07d7d7734b32 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:34.501533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2b52dd63-cb62-4b6b-806b-07d7d7734b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:34.598639 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 503/1001] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Oct 19 00:33:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:34.608025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11d85a-0cfa-4a12-a731-70d7f809619a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:34.609649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4e11d85a-0cfa-4a12-a731-70d7f809619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:34.633396 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:34.734257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11d85a-0cfa-4a12-a731-70d7f809619a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:34.819055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551508-cd82-4c3d-8af6-15dd958d921b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:34.819588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551508-cd82-4c3d-8af6-15dd958d921b service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:34.819872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551508-cd82-4c3d-8af6-15dd958d921b service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:34.820147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551508-cd82-4c3d-8af6-15dd958d921b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:34.821823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d551508-cd82-4c3d-8af6-15dd958d921b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:34.910367 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:34.952443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d551508-cd82-4c3d-8af6-15dd958d921b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:34.953922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d551508-cd82-4c3d-8af6-15dd958d921b service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:34.975351 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 499/1002] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:38.087273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ca976-fa14-42e8-99c4-b7e395f72903 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:38.087996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ca976-fa14-42e8-99c4-b7e395f72903 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:38.087996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ca976-fa14-42e8-99c4-b7e395f72903 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:38.089532 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 504/1003] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:38.095308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d7838-3dd1-465d-bed6-3b3fbd675f1f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:38.095809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d7838-3dd1-465d-bed6-3b3fbd675f1f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:38.095984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d7838-3dd1-465d-bed6-3b3fbd675f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:38.182511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ca5d7838-3dd1-465d-bed6-3b3fbd675f1f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:38.183937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ca5d7838-3dd1-465d-bed6-3b3fbd675f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:38.294873 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 500/1004] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:38.576039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ca976-fa14-42e8-99c4-b7e395f72903 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:38.577687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2f7ca976-fa14-42e8-99c4-b7e395f72903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:38.645212 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:38.697748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ca976-fa14-42e8-99c4-b7e395f72903 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:38.781079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6ae1c-7581-475f-a5cb-5995aa2df8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:38.781739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6ae1c-7581-475f-a5cb-5995aa2df8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:38.782000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6ae1c-7581-475f-a5cb-5995aa2df8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:38.782310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6ae1c-7581-475f-a5cb-5995aa2df8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:38.783972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a3a6ae1c-7581-475f-a5cb-5995aa2df8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:38.921179 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:38.924603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6ae1c-7581-475f-a5cb-5995aa2df8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:38.927030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6ae1c-7581-475f-a5cb-5995aa2df8a1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:38.950835 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 505/1005] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:41.333797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19380d-13c5-4f75-8a2c-17014e5b492b None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:41.334346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19380d-13c5-4f75-8a2c-17014e5b492b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:41.335019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19380d-13c5-4f75-8a2c-17014e5b492b None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:41.337610 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 501/1006] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:41.347613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1ef35-b2e5-4e69-94e7-d67a445cb18f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:41.348306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1ef35-b2e5-4e69-94e7-d67a445cb18f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:41.348550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1ef35-b2e5-4e69-94e7-d67a445cb18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:41.446006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3be1ef35-b2e5-4e69-94e7-d67a445cb18f None None] MFA Rules not processed for user `c975a7f72c0c44ca9cc57c6e90d5b083`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:41.447255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3be1ef35-b2e5-4e69-94e7-d67a445cb18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:41.561762 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 506/1007] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:33:41.851991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19380d-13c5-4f75-8a2c-17014e5b492b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:41.853703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9f19380d-13c5-4f75-8a2c-17014e5b492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:41.892361 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:41.986794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19380d-13c5-4f75-8a2c-17014e5b492b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:42.106225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d622827-4d12-437e-9a7e-578a93b14e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:42.106851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d622827-4d12-437e-9a7e-578a93b14e47 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:42.107115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d622827-4d12-437e-9a7e-578a93b14e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:42.107387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d622827-4d12-437e-9a7e-578a93b14e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:42.109089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0d622827-4d12-437e-9a7e-578a93b14e47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:42.252568 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:42.311154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d622827-4d12-437e-9a7e-578a93b14e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:42.313488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d622827-4d12-437e-9a7e-578a93b14e47 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:42.341520 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 502/1008] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:44.810013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d5a82-e6ed-4994-86b9-9cd135b362ca None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:44.810522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d5a82-e6ed-4994-86b9-9cd135b362ca None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:44.810522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d5a82-e6ed-4994-86b9-9cd135b362ca None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:44.811846 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 507/1009] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:44.819897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065844e-f029-46ac-9fbb-d5fd0b99ed49 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:44.820542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065844e-f029-46ac-9fbb-d5fd0b99ed49 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:44.820542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065844e-f029-46ac-9fbb-d5fd0b99ed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:44.892304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d065844e-f029-46ac-9fbb-d5fd0b99ed49 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:44.894126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d065844e-f029-46ac-9fbb-d5fd0b99ed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:44.996047 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 503/1010] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:45.278748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d5a82-e6ed-4994-86b9-9cd135b362ca None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:45.280326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e10d5a82-e6ed-4994-86b9-9cd135b362ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:45.357435 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:45.395535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d5a82-e6ed-4994-86b9-9cd135b362ca None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:45.475298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c1ee7-0c64-4740-aa24-b536696a38fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:45.475909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c1ee7-0c64-4740-aa24-b536696a38fb service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:45.476203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c1ee7-0c64-4740-aa24-b536696a38fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:45.476469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c1ee7-0c64-4740-aa24-b536696a38fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:45.478131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3d7c1ee7-0c64-4740-aa24-b536696a38fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:45.608017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c1ee7-0c64-4740-aa24-b536696a38fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:45.609509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c1ee7-0c64-4740-aa24-b536696a38fb service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:45.620638 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:45.631274 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 508/1011] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:47.969123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5d62-3c7e-40a6-a160-a110e184e9f8 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:47.969695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5d62-3c7e-40a6-a160-a110e184e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:47.969695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5d62-3c7e-40a6-a160-a110e184e9f8 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:47.971039 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 504/1012] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:47.979056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc142e2f-ce11-4cbe-849d-17ba31b45a18 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:47.979574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc142e2f-ce11-4cbe-849d-17ba31b45a18 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:47.980036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc142e2f-ce11-4cbe-849d-17ba31b45a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:48.094905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fc142e2f-ce11-4cbe-849d-17ba31b45a18 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:48.096138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc142e2f-ce11-4cbe-849d-17ba31b45a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:48.202743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 509/1013] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:48.503425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5d62-3c7e-40a6-a160-a110e184e9f8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:48.505037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e7bb5d62-3c7e-40a6-a160-a110e184e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:48.559437 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:48.627698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5d62-3c7e-40a6-a160-a110e184e9f8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:48.706571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756927f-f2ce-4bf1-955c-c9e05e91e675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:48.707179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756927f-f2ce-4bf1-955c-c9e05e91e675 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:48.707856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756927f-f2ce-4bf1-955c-c9e05e91e675 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:48.708351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756927f-f2ce-4bf1-955c-c9e05e91e675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:48.711559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5756927f-f2ce-4bf1-955c-c9e05e91e675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:48.828785 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:48.865495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756927f-f2ce-4bf1-955c-c9e05e91e675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:48.866950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756927f-f2ce-4bf1-955c-c9e05e91e675 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:48.885633 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 505/1014] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:51.557631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24abe-e937-46e8-aab5-d2db90ef6b91 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:51.558197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24abe-e937-46e8-aab5-d2db90ef6b91 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:51.558291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24abe-e937-46e8-aab5-d2db90ef6b91 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:51.559654 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 510/1015] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:33:51.565568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c8cd-cf3f-4967-b467-ddc55b31fecb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:51.566337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c8cd-cf3f-4967-b467-ddc55b31fecb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:51.566620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c8cd-cf3f-4967-b467-ddc55b31fecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:51.637345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ff95c8cd-cf3f-4967-b467-ddc55b31fecb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:51.638575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ff95c8cd-cf3f-4967-b467-ddc55b31fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:51.743196 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 506/1016] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:33:52.034084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24abe-e937-46e8-aab5-d2db90ef6b91 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:52.035971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-95a24abe-e937-46e8-aab5-d2db90ef6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:52.116660 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:52.155412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24abe-e937-46e8-aab5-d2db90ef6b91 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:52.285749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c538-c84c-44b1-b07a-eacb2da3f2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:52.286258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c538-c84c-44b1-b07a-eacb2da3f2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:52.286532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c538-c84c-44b1-b07a-eacb2da3f2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:52.286797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c538-c84c-44b1-b07a-eacb2da3f2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:52.288405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f058c538-c84c-44b1-b07a-eacb2da3f2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:52.404467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058c538-c84c-44b1-b07a-eacb2da3f2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:52.406183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058c538-c84c-44b1-b07a-eacb2da3f2a8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:52.426948 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 511/1017] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:56.965886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ac850-9983-4204-9a59-832143e5b282 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:56.966454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ac850-9983-4204-9a59-832143e5b282 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:56.966454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ac850-9983-4204-9a59-832143e5b282 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:56.967802 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 507/1018] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:33:56.974345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a206a22-5475-4cbd-9ca8-3022ffff71b1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:56.974813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a206a22-5475-4cbd-9ca8-3022ffff71b1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:56.974909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a206a22-5475-4cbd-9ca8-3022ffff71b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:56.980473 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:57.048138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0a206a22-5475-4cbd-9ca8-3022ffff71b1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:33:57.049917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a206a22-5475-4cbd-9ca8-3022ffff71b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:57.159321 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 512/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:33:57.453556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ac850-9983-4204-9a59-832143e5b282 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:33:57.455378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c15ac850-9983-4204-9a59-832143e5b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:57.511224 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:57.576027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ac850-9983-4204-9a59-832143e5b282 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:33:57.660605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6155-5d0b-4cde-83e7-2f921099e914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:33:57.661231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6155-5d0b-4cde-83e7-2f921099e914 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:33:57.662230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6155-5d0b-4cde-83e7-2f921099e914 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:33:57.662624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6155-5d0b-4cde-83e7-2f921099e914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:33:57.664821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-73eb6155-5d0b-4cde-83e7-2f921099e914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:33:57.766800 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:57.785686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb6155-5d0b-4cde-83e7-2f921099e914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:33:57.787119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb6155-5d0b-4cde-83e7-2f921099e914 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:33:57.808662 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 508/1020] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:01.176511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9b24b-ed38-4bd0-afac-4ad524ec798b None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:01.177128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9b24b-ed38-4bd0-afac-4ad524ec798b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:01.177128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9b24b-ed38-4bd0-afac-4ad524ec798b None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:01.178614 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 513/1021] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:01.184563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502bcfb-315c-4210-9dac-514bed6e32c1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:01.185103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502bcfb-315c-4210-9dac-514bed6e32c1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:01.185271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502bcfb-315c-4210-9dac-514bed6e32c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:01.260539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d502bcfb-315c-4210-9dac-514bed6e32c1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:01.261860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d502bcfb-315c-4210-9dac-514bed6e32c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:01.384278 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 509/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:01.697408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9b24b-ed38-4bd0-afac-4ad524ec798b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:01.699058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d6d9b24b-ed38-4bd0-afac-4ad524ec798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:01.826513 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:01.853072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9b24b-ed38-4bd0-afac-4ad524ec798b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:01.937839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2bd32-ef49-455a-a069-27b4d85d534e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:01.938453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2bd32-ef49-455a-a069-27b4d85d534e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:01.938733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2bd32-ef49-455a-a069-27b4d85d534e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:01.939006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2bd32-ef49-455a-a069-27b4d85d534e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:01.941367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1ae2bd32-ef49-455a-a069-27b4d85d534e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:02.067754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2bd32-ef49-455a-a069-27b4d85d534e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:02.069248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2bd32-ef49-455a-a069-27b4d85d534e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:02.091667 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 514/1023] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:06.602790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d23c7-3784-4f6e-bfbc-199b355cc96b None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:06.603248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d23c7-3784-4f6e-bfbc-199b355cc96b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:06.603365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d23c7-3784-4f6e-bfbc-199b355cc96b None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:06.607630 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 510/1024] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:34:06.610993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ce9c4-1bad-440f-859a-b90da41034ef None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:06.612029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ce9c4-1bad-440f-859a-b90da41034ef None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:06.612029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ce9c4-1bad-440f-859a-b90da41034ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:06.627233 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:06.687238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-016ce9c4-1bad-440f-859a-b90da41034ef None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:06.688609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-016ce9c4-1bad-440f-859a-b90da41034ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:06.799315 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 515/1025] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:07.091425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d23c7-3784-4f6e-bfbc-199b355cc96b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:07.093011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4c1d23c7-3784-4f6e-bfbc-199b355cc96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:07.154217 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:07.201729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d23c7-3784-4f6e-bfbc-199b355cc96b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:07.283996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f65bcd-1887-477d-a5d7-064e4db54370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:07.284608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65bcd-1887-477d-a5d7-064e4db54370 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:07.284915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65bcd-1887-477d-a5d7-064e4db54370 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:07.285186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65bcd-1887-477d-a5d7-064e4db54370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:07.286866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1f65bcd-1887-477d-a5d7-064e4db54370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:07.398727 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:07.402923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f65bcd-1887-477d-a5d7-064e4db54370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:07.404365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f65bcd-1887-477d-a5d7-064e4db54370 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:07.422392 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 511/1026] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:12.526566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3c4fc-7f7b-4405-a8af-72dc8d6d609e None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:12.527005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3c4fc-7f7b-4405-a8af-72dc8d6d609e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:12.527083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3c4fc-7f7b-4405-a8af-72dc8d6d609e None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:12.528447 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 516/1027] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:12.539466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df100-3abf-4052-ab02-b9a9556d543c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:12.539466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df100-3abf-4052-ab02-b9a9556d543c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:12.539466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df100-3abf-4052-ab02-b9a9556d543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:12.645942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a71df100-3abf-4052-ab02-b9a9556d543c None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:12.647251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a71df100-3abf-4052-ab02-b9a9556d543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:12.795174 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 512/1028] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:34:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:16.797184 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=59 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:17.549726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf493ae-5282-4882-a11d-60f84bb58ad7 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:17.550346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf493ae-5282-4882-a11d-60f84bb58ad7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:17.550844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf493ae-5282-4882-a11d-60f84bb58ad7 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:17.552639 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 517/1029] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:17.558245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7853ea-5ef6-4166-be64-9dd1fd7ab609 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:17.558771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7853ea-5ef6-4166-be64-9dd1fd7ab609 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:17.558857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7853ea-5ef6-4166-be64-9dd1fd7ab609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:17.625325 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:17.652381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ce7853ea-5ef6-4166-be64-9dd1fd7ab609 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:17.654466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ce7853ea-5ef6-4166-be64-9dd1fd7ab609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:17.781418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 513/1030] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:34:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:19.162798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47914f8d-a542-47b5-9c68-0defc2ed14d6 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:19.163324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47914f8d-a542-47b5-9c68-0defc2ed14d6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:19.163324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47914f8d-a542-47b5-9c68-0defc2ed14d6 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:19.164719 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 518/1031] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:19.169965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8b23-945f-4505-8a8d-b3353c099edf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:19.170422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8b23-945f-4505-8a8d-b3353c099edf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:19.170642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8b23-945f-4505-8a8d-b3353c099edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:19.258123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3d4c8b23-945f-4505-8a8d-b3353c099edf None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:19.259373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3d4c8b23-945f-4505-8a8d-b3353c099edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:19.307274 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:19.389834 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 514/1032] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:34:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:22.898519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece3db-9bc1-40cc-827c-6963c8ac0236 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:22.899380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece3db-9bc1-40cc-827c-6963c8ac0236 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:22.899810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece3db-9bc1-40cc-827c-6963c8ac0236 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:22.901689 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 519/1033] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:22.907467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a874c-5917-43c3-ba64-625f7957b1cf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:22.908289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a874c-5917-43c3-ba64-625f7957b1cf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:22.909429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a874c-5917-43c3-ba64-625f7957b1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:22.995201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-724a874c-5917-43c3-ba64-625f7957b1cf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:22.996547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-724a874c-5917-43c3-ba64-625f7957b1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:23.120705 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 515/1034] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:23.428450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31d52-bbad-4d27-a330-0f8a70f1c925 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:23.429014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31d52-bbad-4d27-a330-0f8a70f1c925 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:23.429488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31d52-bbad-4d27-a330-0f8a70f1c925 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:23.431823 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 520/1035] 10.222.0.27 () {54 vars in 961 bytes} [Wed Oct 19 00:34:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:23.449135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3bc73-c5ae-49a1-bb47-0a13f0ca58fb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:23.449891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3bc73-c5ae-49a1-bb47-0a13f0ca58fb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:23.451472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3bc73-c5ae-49a1-bb47-0a13f0ca58fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:23.471694 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:23.541282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e3d3bc73-c5ae-49a1-bb47-0a13f0ca58fb None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:23.542648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e3d3bc73-c5ae-49a1-bb47-0a13f0ca58fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:23.682807 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 516/1036] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 00:34:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:34:23.692677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31d52-bbad-4d27-a330-0f8a70f1c925 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:23.694415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3fb31d52-bbad-4d27-a330-0f8a70f1c925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:23.865933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31d52-bbad-4d27-a330-0f8a70f1c925 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:23.947824 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:24.001391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef98d05-4d9e-45b4-963b-1df665af6b06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:24.002695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef98d05-4d9e-45b4-963b-1df665af6b06 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:24.002977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef98d05-4d9e-45b4-963b-1df665af6b06 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:24.003256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef98d05-4d9e-45b4-963b-1df665af6b06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:24.006378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aef98d05-4d9e-45b4-963b-1df665af6b06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:24.139442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef98d05-4d9e-45b4-963b-1df665af6b06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:24.141130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef98d05-4d9e-45b4-963b-1df665af6b06 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:24.162857 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 521/1037] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:26.615617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871167e6-7b61-4280-b03f-5837ef5cbef1 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:26.616097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871167e6-7b61-4280-b03f-5837ef5cbef1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:26.616097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871167e6-7b61-4280-b03f-5837ef5cbef1 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:26.621543 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 517/1038] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:26.622966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153f7a-5c98-48fe-b5b2-48eda44b32ef None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:26.623345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153f7a-5c98-48fe-b5b2-48eda44b32ef None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:26.623620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64153f7a-5c98-48fe-b5b2-48eda44b32ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:26.707371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-64153f7a-5c98-48fe-b5b2-48eda44b32ef None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:26.708612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-64153f7a-5c98-48fe-b5b2-48eda44b32ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:26.759495 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:26.836263 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 522/1039] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:34:27.140278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871167e6-7b61-4280-b03f-5837ef5cbef1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:27.142551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-871167e6-7b61-4280-b03f-5837ef5cbef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:27.229010 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:27.359835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871167e6-7b61-4280-b03f-5837ef5cbef1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:27.502858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17311a9f-5f81-409f-b26f-410697ebe9e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:27.503502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311a9f-5f81-409f-b26f-410697ebe9e0 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:27.503786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311a9f-5f81-409f-b26f-410697ebe9e0 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:27.504053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311a9f-5f81-409f-b26f-410697ebe9e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:27.505744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-17311a9f-5f81-409f-b26f-410697ebe9e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:27.533278 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:27.612749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311a9f-5f81-409f-b26f-410697ebe9e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:27.614370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311a9f-5f81-409f-b26f-410697ebe9e0 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:27.634499 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 518/1040] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:30.206826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b39579-bbd9-4197-9e4b-d7dcd8ad637a None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:30.207419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b39579-bbd9-4197-9e4b-d7dcd8ad637a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:30.207419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b39579-bbd9-4197-9e4b-d7dcd8ad637a None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:30.210206 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 523/1041] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:30.215465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9958bc-5a4a-49a6-9b99-6429934c3163 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:30.215945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9958bc-5a4a-49a6-9b99-6429934c3163 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:30.216506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9958bc-5a4a-49a6-9b99-6429934c3163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:30.311736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3f9958bc-5a4a-49a6-9b99-6429934c3163 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:30.313781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3f9958bc-5a4a-49a6-9b99-6429934c3163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:30.472780 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:30.472780 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 519/1042] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:34:30.767674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060330-a316-40ea-9ee7-99e40bb3c2fa None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:30.767953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060330-a316-40ea-9ee7-99e40bb3c2fa None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:30.768230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060330-a316-40ea-9ee7-99e40bb3c2fa None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:30.770518 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 524/1043] 10.222.0.27 () {54 vars in 961 bytes} [Wed Oct 19 00:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:30.778757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107315-e813-48f4-bb95-822402beb96d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:30.781850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107315-e813-48f4-bb95-822402beb96d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:30.782419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107315-e813-48f4-bb95-822402beb96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:30.914336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-99107315-e813-48f4-bb95-822402beb96d None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:30.915719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-99107315-e813-48f4-bb95-822402beb96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:31.124607 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 520/1044] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 00:34:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:31.140856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060330-a316-40ea-9ee7-99e40bb3c2fa None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:31.142851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e060330-a316-40ea-9ee7-99e40bb3c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:31.394151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060330-a316-40ea-9ee7-99e40bb3c2fa None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:31.420418 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:31.583850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a7d0d-55a9-4679-a6df-a2f0659fa736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:31.585262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a7d0d-55a9-4679-a6df-a2f0659fa736 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:31.585945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a7d0d-55a9-4679-a6df-a2f0659fa736 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:31.586382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a7d0d-55a9-4679-a6df-a2f0659fa736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:31.588573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6f1a7d0d-55a9-4679-a6df-a2f0659fa736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:31.737125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a7d0d-55a9-4679-a6df-a2f0659fa736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:31.739145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a7d0d-55a9-4679-a6df-a2f0659fa736 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:31.773642 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 525/1045] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:34.240667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504356-d18c-4306-bbe8-94b150551440 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:34.241897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504356-d18c-4306-bbe8-94b150551440 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:34.242442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504356-d18c-4306-bbe8-94b150551440 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:34.248774 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 521/1046] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:34.251349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172414c-a446-432c-8d86-c2790522f0e3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:34.251349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172414c-a446-432c-8d86-c2790522f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:34.252227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172414c-a446-432c-8d86-c2790522f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:34.293595 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:34.349770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a172414c-a446-432c-8d86-c2790522f0e3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:34.351399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a172414c-a446-432c-8d86-c2790522f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:34.560660 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 526/1047] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:34:35.002439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4504356-d18c-4306-bbe8-94b150551440 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:35.003897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a4504356-d18c-4306-bbe8-94b150551440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:35.068995 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:35.182427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4504356-d18c-4306-bbe8-94b150551440 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:35.314677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e15a3-b9c0-4a72-9843-58e16b506872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:35.315957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e15a3-b9c0-4a72-9843-58e16b506872 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:35.316386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e15a3-b9c0-4a72-9843-58e16b506872 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:35.316859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e15a3-b9c0-4a72-9843-58e16b506872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:35.318896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-436e15a3-b9c0-4a72-9843-58e16b506872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:35.330052 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:35.350851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e886-4950-4e49-ae41-8d92e08dc76d None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:35.351826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e886-4950-4e49-ae41-8d92e08dc76d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:35.352346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e886-4950-4e49-ae41-8d92e08dc76d None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:35.353973 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 527/1048] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:34:35.360259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992069ad-b40d-4352-9027-d8a348b50fd2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:35.360940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992069ad-b40d-4352-9027-d8a348b50fd2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:35.361231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992069ad-b40d-4352-9027-d8a348b50fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:35.431245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e15a3-b9c0-4a72-9843-58e16b506872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:35.433070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e15a3-b9c0-4a72-9843-58e16b506872 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:35.436736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-992069ad-b40d-4352-9027-d8a348b50fd2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:35.438028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-992069ad-b40d-4352-9027-d8a348b50fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:35.456526 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 522/1049] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:35.501280 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:35.556205 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 528/1050] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:34:35.860839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c4e58-055c-491b-858d-ada1332976f6 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:35.861197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c4e58-055c-491b-858d-ada1332976f6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:35.861393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c4e58-055c-491b-858d-ada1332976f6 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:35.862898 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 523/1051] 10.222.0.27 () {54 vars in 963 bytes} [Wed Oct 19 00:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:35.867960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb4cf9-e683-454f-8281-f9d0776b6795 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:35.868358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb4cf9-e683-454f-8281-f9d0776b6795 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:35.868553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb4cf9-e683-454f-8281-f9d0776b6795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:35.957657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3ceb4cf9-e683-454f-8281-f9d0776b6795 None None] MFA Rules not processed for user `5f3c0c082e3044b283bfeb58543d088c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:35.958935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3ceb4cf9-e683-454f-8281-f9d0776b6795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:36.055428 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 529/1052] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Oct 19 00:34:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:36.064764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c4e58-055c-491b-858d-ada1332976f6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:36.066364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bb1c4e58-055c-491b-858d-ada1332976f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:36.199589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c4e58-055c-491b-858d-ada1332976f6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:36.242497 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:36.294402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd08a1-da85-403d-b947-b657323c4ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:36.295253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd08a1-da85-403d-b947-b657323c4ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:36.295511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd08a1-da85-403d-b947-b657323c4ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:36.295717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd08a1-da85-403d-b947-b657323c4ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:36.297553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a2fd08a1-da85-403d-b947-b657323c4ee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:36.432668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd08a1-da85-403d-b947-b657323c4ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:36.433393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd08a1-da85-403d-b947-b657323c4ee4 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:36.461123 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 524/1053] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:37.753493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8bf4e-799f-46c6-9af9-4d0a4fa6da11 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:37.754058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8bf4e-799f-46c6-9af9-4d0a4fa6da11 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:37.754058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8bf4e-799f-46c6-9af9-4d0a4fa6da11 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:37.755381 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 530/1054] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:37.760973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfe13-d2f0-4070-b417-47b3d7c32fda None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:37.761411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfe13-d2f0-4070-b417-47b3d7c32fda None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:37.761513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfe13-d2f0-4070-b417-47b3d7c32fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:37.835615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-241bfe13-d2f0-4070-b417-47b3d7c32fda None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:37.836852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-241bfe13-d2f0-4070-b417-47b3d7c32fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:37.853619 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:37.952828 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 525/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:34:38.245358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8bf4e-799f-46c6-9af9-4d0a4fa6da11 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:38.246952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-27d8bf4e-799f-46c6-9af9-4d0a4fa6da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:38.321025 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:38.448838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8bf4e-799f-46c6-9af9-4d0a4fa6da11 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:38.591790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b716c-c897-455f-a0c7-cbab552bfef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:38.592118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b716c-c897-455f-a0c7-cbab552bfef1 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:38.592936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b716c-c897-455f-a0c7-cbab552bfef1 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:38.592936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b716c-c897-455f-a0c7-cbab552bfef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:38.594994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c96b716c-c897-455f-a0c7-cbab552bfef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:38.617515 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:38.714803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b716c-c897-455f-a0c7-cbab552bfef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:38.716434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b716c-c897-455f-a0c7-cbab552bfef1 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:38.738072 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 531/1056] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:41.114606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730b981-0f56-4106-9e14-b2438d15a7ff None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:41.115504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730b981-0f56-4106-9e14-b2438d15a7ff None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:41.115937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730b981-0f56-4106-9e14-b2438d15a7ff None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:41.123631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb0868-abd3-4d97-935c-d04a5134c794 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:41.125112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb0868-abd3-4d97-935c-d04a5134c794 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:41.125575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb0868-abd3-4d97-935c-d04a5134c794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:41.129078 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 526/1057] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:41 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:41.214368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c6fb0868-abd3-4d97-935c-d04a5134c794 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:41.215790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c6fb0868-abd3-4d97-935c-d04a5134c794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:41.321273 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:41.337311 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 532/1058] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:34:41.660264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730b981-0f56-4106-9e14-b2438d15a7ff None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:41.662013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f730b981-0f56-4106-9e14-b2438d15a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:41.829227 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:41.833740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730b981-0f56-4106-9e14-b2438d15a7ff None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:42.021077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c88ba-ffb9-4831-a0f7-e436e71646fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:42.021692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c88ba-ffb9-4831-a0f7-e436e71646fa service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:42.021975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c88ba-ffb9-4831-a0f7-e436e71646fa service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:42.022250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c88ba-ffb9-4831-a0f7-e436e71646fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:42.023858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-617c88ba-ffb9-4831-a0f7-e436e71646fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:42.150052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c88ba-ffb9-4831-a0f7-e436e71646fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:42.153046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c88ba-ffb9-4831-a0f7-e436e71646fa service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:42.180144 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 527/1059] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:44.509806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4021-fb3e-45af-aa1c-2a5ce5c2baa6 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:44.510273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4021-fb3e-45af-aa1c-2a5ce5c2baa6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:44.510463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4021-fb3e-45af-aa1c-2a5ce5c2baa6 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:44.511873 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 533/1060] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:44.517884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c59a36-2b17-4961-a951-bb0d2be6e4cc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:44.518307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c59a36-2b17-4961-a951-bb0d2be6e4cc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:44.518518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c59a36-2b17-4961-a951-bb0d2be6e4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:44.522914 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:44.596433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-33c59a36-2b17-4961-a951-bb0d2be6e4cc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:44.597674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-33c59a36-2b17-4961-a951-bb0d2be6e4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:44.716480 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 528/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:45.010547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e4021-fb3e-45af-aa1c-2a5ce5c2baa6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:45.012083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-170e4021-fb3e-45af-aa1c-2a5ce5c2baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:45.183016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e4021-fb3e-45af-aa1c-2a5ce5c2baa6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:45.251791 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:45.304704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e7218-62ac-4f82-b02f-99156375dfad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:45.305315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e7218-62ac-4f82-b02f-99156375dfad service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:45.305596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e7218-62ac-4f82-b02f-99156375dfad service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:45.305871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e7218-62ac-4f82-b02f-99156375dfad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:45.307479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a60e7218-62ac-4f82-b02f-99156375dfad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:45.412093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e7218-62ac-4f82-b02f-99156375dfad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:45.413754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e7218-62ac-4f82-b02f-99156375dfad service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:45.437907 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 534/1062] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:48.301524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb80166-20a2-4ae8-993f-df69b3db89e3 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:48.302050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb80166-20a2-4ae8-993f-df69b3db89e3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:48.302050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb80166-20a2-4ae8-993f-df69b3db89e3 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:48.303339 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 529/1063] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:48.310246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18340eb-746a-468e-9c8e-427879251cad None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:48.310715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18340eb-746a-468e-9c8e-427879251cad None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:48.310971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18340eb-746a-468e-9c8e-427879251cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:48.399494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c18340eb-746a-468e-9c8e-427879251cad None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:48.401555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c18340eb-746a-468e-9c8e-427879251cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:48.436255 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:48.516070 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 535/1064] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:48.809512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb80166-20a2-4ae8-993f-df69b3db89e3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:48.810981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fbb80166-20a2-4ae8-993f-df69b3db89e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:48.895916 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:48.984702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb80166-20a2-4ae8-993f-df69b3db89e3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:49.131701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be18bc-9048-4323-88f7-c9acd0bc7806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:49.132314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be18bc-9048-4323-88f7-c9acd0bc7806 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:49.132596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be18bc-9048-4323-88f7-c9acd0bc7806 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:49.132904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be18bc-9048-4323-88f7-c9acd0bc7806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:49.134652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85be18bc-9048-4323-88f7-c9acd0bc7806 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:49.184978 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:49.236519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be18bc-9048-4323-88f7-c9acd0bc7806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:49.238159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be18bc-9048-4323-88f7-c9acd0bc7806 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:49.257460 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 530/1065] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:51.525042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13a863-3490-4e06-9746-b7d2cda40f4e None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:51.525663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13a863-3490-4e06-9746-b7d2cda40f4e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:51.525663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13a863-3490-4e06-9746-b7d2cda40f4e None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:51.527149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 536/1066] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:51.537379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915fb08-5936-4747-957b-c0859551b374 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:51.538017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915fb08-5936-4747-957b-c0859551b374 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:51.538017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915fb08-5936-4747-957b-c0859551b374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:51.607593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e915fb08-5936-4747-957b-c0859551b374 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:51.609355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e915fb08-5936-4747-957b-c0859551b374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:51.714175 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 531/1067] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:52.015899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13a863-3490-4e06-9746-b7d2cda40f4e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:52.017540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5e13a863-3490-4e06-9746-b7d2cda40f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:52.195016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13a863-3490-4e06-9746-b7d2cda40f4e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:52.205444 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:52.325481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd8882-b203-4798-ba43-850e9bb09546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:52.325991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8882-b203-4798-ba43-850e9bb09546 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:52.326266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8882-b203-4798-ba43-850e9bb09546 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:52.326532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8882-b203-4798-ba43-850e9bb09546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:52.328933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-69fd8882-b203-4798-ba43-850e9bb09546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:52.426461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd8882-b203-4798-ba43-850e9bb09546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:52.428069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd8882-b203-4798-ba43-850e9bb09546 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:52.447337 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 537/1068] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:52.606627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff31d76-1a33-4c6c-8e49-4e67fe74ae20 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:52.607237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff31d76-1a33-4c6c-8e49-4e67fe74ae20 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:52.607237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff31d76-1a33-4c6c-8e49-4e67fe74ae20 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:52.609846 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 532/1069] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:52.615931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fbc0c-94bf-441b-9a69-a13b694ccb6e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:52.616518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fbc0c-94bf-441b-9a69-a13b694ccb6e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:52.616518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fbc0c-94bf-441b-9a69-a13b694ccb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:52.634190 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:52.695672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-439fbc0c-94bf-441b-9a69-a13b694ccb6e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:52.696922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-439fbc0c-94bf-441b-9a69-a13b694ccb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:52.807092 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 538/1070] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:53.125702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267b718-e358-4036-badf-3a730a1430b4 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:53.125985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267b718-e358-4036-badf-3a730a1430b4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:53.126266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267b718-e358-4036-badf-3a730a1430b4 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:53.127655 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 533/1071] 10.222.0.27 () {54 vars in 962 bytes} [Wed Oct 19 00:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:34:53.133860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403391f-e24f-4b55-871e-2b0399d49837 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:53.134220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403391f-e24f-4b55-871e-2b0399d49837 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:53.134445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403391f-e24f-4b55-871e-2b0399d49837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:53.250162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c403391f-e24f-4b55-871e-2b0399d49837 None None] MFA Rules not processed for user `6eb751f44d3b4fb3b49a0084e76176d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:53.251978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c403391f-e24f-4b55-871e-2b0399d49837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:53.310481 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:53.357848 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 539/1072] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Oct 19 00:34:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:53.367753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267b718-e358-4036-badf-3a730a1430b4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:53.369506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b267b718-e358-4036-badf-3a730a1430b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:53.396269 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:53.485455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267b718-e358-4036-badf-3a730a1430b4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:53.569053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921d9fa-6734-4f52-b047-d97e1562d94b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:53.569631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921d9fa-6734-4f52-b047-d97e1562d94b service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:53.569853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921d9fa-6734-4f52-b047-d97e1562d94b service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:53.570130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921d9fa-6734-4f52-b047-d97e1562d94b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:53.571746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7921d9fa-6734-4f52-b047-d97e1562d94b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:53.656863 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:53.695888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921d9fa-6734-4f52-b047-d97e1562d94b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:53.697385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921d9fa-6734-4f52-b047-d97e1562d94b service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:53.717213 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 534/1073] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:54.492824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69059715-05ab-452d-b042-01b2182c1cd4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:54.493321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69059715-05ab-452d-b042-01b2182c1cd4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:54.493533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69059715-05ab-452d-b042-01b2182c1cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:54.568663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-69059715-05ab-452d-b042-01b2182c1cd4 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:54.569944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-69059715-05ab-452d-b042-01b2182c1cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:54.665643 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 540/1074] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:34:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:54.684076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec8b9-6362-46d1-97fa-41928acbe056 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:54.684076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec8b9-6362-46d1-97fa-41928acbe056 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:54.684076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec8b9-6362-46d1-97fa-41928acbe056 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:54.685489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 535/1075] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:54.691805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406672-25b0-415d-b649-136faaf5fdfe None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:54.692092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406672-25b0-415d-b649-136faaf5fdfe None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:54.692368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406672-25b0-415d-b649-136faaf5fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:54.710783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9d14d-01b1-4cf8-9f9c-40aef02bad4e None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:54.711064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9d14d-01b1-4cf8-9f9c-40aef02bad4e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:54.711339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9d14d-01b1-4cf8-9f9c-40aef02bad4e None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:54.712708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 536/1076] 10.222.0.27 () {54 vars in 943 bytes} [Wed Oct 19 00:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:34:54.719998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd977b8-e1c6-4767-8d66-dc74cb49a8d2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:54.720284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd977b8-e1c6-4767-8d66-dc74cb49a8d2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:54.720560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd977b8-e1c6-4767-8d66-dc74cb49a8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:54.762584 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:54.765838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-61406672-25b0-415d-b649-136faaf5fdfe None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:54.767708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-61406672-25b0-415d-b649-136faaf5fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:54.804692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6fd977b8-e1c6-4767-8d66-dc74cb49a8d2 None None] MFA Rules not processed for user `54b7394a5d944639b1253d5d54b688e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:54.805941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6fd977b8-e1c6-4767-8d66-dc74cb49a8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:54.872890 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 541/1077] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:54.923441 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 537/1078] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Oct 19 00:34:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:54.932672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406672-25b0-415d-b649-136faaf5fdfe None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:54.933968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-61406672-25b0-415d-b649-136faaf5fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:55.049536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406672-25b0-415d-b649-136faaf5fdfe None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:55.080108 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:55.160955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd977b8-e1c6-4767-8d66-dc74cb49a8d2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:55.162168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6fd977b8-e1c6-4767-8d66-dc74cb49a8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:55.162287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55291890-7760-4518-9340-48538275889a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:55.162953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291890-7760-4518-9340-48538275889a service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:55.163439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291890-7760-4518-9340-48538275889a service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:55.163723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291890-7760-4518-9340-48538275889a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:55.165593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-55291890-7760-4518-9340-48538275889a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:55.176947 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:55.280497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55291890-7760-4518-9340-48538275889a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:55.282138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd977b8-e1c6-4767-8d66-dc74cb49a8d2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:55.282278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55291890-7760-4518-9340-48538275889a service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:55.292074 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 542/1079] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:34:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:34:55.471757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6f78e-eb31-415e-b3c3-56bfc8b038d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:55.478685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f78e-eb31-415e-b3c3-56bfc8b038d2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:55.478685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f78e-eb31-415e-b3c3-56bfc8b038d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:55.478685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6f78e-eb31-415e-b3c3-56bfc8b038d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:55.478685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-35f6f78e-eb31-415e-b3c3-56bfc8b038d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:55.513892 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:55.609499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6f78e-eb31-415e-b3c3-56bfc8b038d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:55.611229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6f78e-eb31-415e-b3c3-56bfc8b038d2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:55.634210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 538/1080] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:34:57.906987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee5ee-d47a-4624-9b0d-9274f81a5deb None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:57.907530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee5ee-d47a-4624-9b0d-9274f81a5deb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:57.907530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee5ee-d47a-4624-9b0d-9274f81a5deb None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:57.909241 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 543/1081] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:57.914923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb743-ea89-4345-a2e1-232bc420d8ea None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:57.915382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb743-ea89-4345-a2e1-232bc420d8ea None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:57.915494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb743-ea89-4345-a2e1-232bc420d8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:57.994276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b8bdb743-ea89-4345-a2e1-232bc420d8ea None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:57.995526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b8bdb743-ea89-4345-a2e1-232bc420d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:58.104747 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:58.109587 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 539/1082] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:58.409422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcee5ee-d47a-4624-9b0d-9274f81a5deb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:58.411045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0bcee5ee-d47a-4624-9b0d-9274f81a5deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:58.490214 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:58.594920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcee5ee-d47a-4624-9b0d-9274f81a5deb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:58.730512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfb6b7-5929-4d34-952b-69352f21a64e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:58.731130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb6b7-5929-4d34-952b-69352f21a64e service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:58.731409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb6b7-5929-4d34-952b-69352f21a64e service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:58.731683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb6b7-5929-4d34-952b-69352f21a64e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:58.735861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c8bfb6b7-5929-4d34-952b-69352f21a64e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:58.760091 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:58.838606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfb6b7-5929-4d34-952b-69352f21a64e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:58.840510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfb6b7-5929-4d34-952b-69352f21a64e service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:58.862052 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 544/1083] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:01.139319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234eb9-a1ee-4032-9edc-98a95f622653 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:01.140249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234eb9-a1ee-4032-9edc-98a95f622653 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:01.140537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234eb9-a1ee-4032-9edc-98a95f622653 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:01.142110 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 540/1084] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:01.147591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22085-7eeb-41dc-ba30-99a2756f1fd8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:01.148261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22085-7eeb-41dc-ba30-99a2756f1fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:01.148261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22085-7eeb-41dc-ba30-99a2756f1fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:01.225670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-edf22085-7eeb-41dc-ba30-99a2756f1fd8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:01.227074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-edf22085-7eeb-41dc-ba30-99a2756f1fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:01.341717 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:01.346473 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 545/1085] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:01.646865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85234eb9-a1ee-4032-9edc-98a95f622653 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:01.648679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85234eb9-a1ee-4032-9edc-98a95f622653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:01.816568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85234eb9-a1ee-4032-9edc-98a95f622653 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:01.905732 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:01.958395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977e04-b24f-4f31-b74d-c2a9e6aaec26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:01.959343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977e04-b24f-4f31-b74d-c2a9e6aaec26 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:01.959618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977e04-b24f-4f31-b74d-c2a9e6aaec26 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:01.959890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977e04-b24f-4f31-b74d-c2a9e6aaec26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:01.961676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-92977e04-b24f-4f31-b74d-c2a9e6aaec26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:02.079668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977e04-b24f-4f31-b74d-c2a9e6aaec26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:02.081600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977e04-b24f-4f31-b74d-c2a9e6aaec26 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:02.107068 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 541/1086] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:12.104489 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=63 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:18.783008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7e032-a4e1-46b0-81bf-19abc1d397b1 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:18.783573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7e032-a4e1-46b0-81bf-19abc1d397b1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:18.783573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7e032-a4e1-46b0-81bf-19abc1d397b1 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:18.784846 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 546/1087] 10.222.0.27 () {54 vars in 918 bytes} [Wed Oct 19 00:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:18.790274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eec6bd-e8c4-44ae-af35-00e261298adb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:18.790738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eec6bd-e8c4-44ae-af35-00e261298adb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:18.790846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eec6bd-e8c4-44ae-af35-00e261298adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:18.869699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-07eec6bd-e8c4-44ae-af35-00e261298adb None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:18.870927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-07eec6bd-e8c4-44ae-af35-00e261298adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:18.980647 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 542/1088] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Oct 19 00:35:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:18.995627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffcf9e-fe0f-4ece-8d52-ebcb49a65438 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:18.995907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffcf9e-fe0f-4ece-8d52-ebcb49a65438 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:18.996211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffcf9e-fe0f-4ece-8d52-ebcb49a65438 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:18.997654 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 547/1089] 10.222.0.27 () {54 vars in 918 bytes} [Wed Oct 19 00:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:19.002628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d187e93-fbf7-4b8f-85e0-39a2ab3e62bf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:19.002917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d187e93-fbf7-4b8f-85e0-39a2ab3e62bf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:19.003194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d187e93-fbf7-4b8f-85e0-39a2ab3e62bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:19.083625 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:19.086571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3d187e93-fbf7-4b8f-85e0-39a2ab3e62bf None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:19.088377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3d187e93-fbf7-4b8f-85e0-39a2ab3e62bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:19.207323 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 543/1090] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Oct 19 00:35:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:21.861801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26141948-3c32-4e4e-a564-87a3826502ac None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:21.862397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26141948-3c32-4e4e-a564-87a3826502ac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:21.862397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26141948-3c32-4e4e-a564-87a3826502ac None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:21.863698 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 548/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:21.869115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8268a-b080-4b55-95d3-04e8dad59e88 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:21.869562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8268a-b080-4b55-95d3-04e8dad59e88 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:21.869669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8268a-b080-4b55-95d3-04e8dad59e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:21.937387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5fc8268a-b080-4b55-95d3-04e8dad59e88 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:21.938632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5fc8268a-b080-4b55-95d3-04e8dad59e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:21.996812 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:22.040281 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 544/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:22.329358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26141948-3c32-4e4e-a564-87a3826502ac None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:22.331072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-26141948-3c32-4e4e-a564-87a3826502ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:22.481360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26141948-3c32-4e4e-a564-87a3826502ac None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:22.555921 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:22.598509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bab0a-ed80-44c6-a48f-9459b3d670f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:22.599116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bab0a-ed80-44c6-a48f-9459b3d670f3 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:22.599399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bab0a-ed80-44c6-a48f-9459b3d670f3 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:22.599670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bab0a-ed80-44c6-a48f-9459b3d670f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:22.601333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1a7bab0a-ed80-44c6-a48f-9459b3d670f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:22.717383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bab0a-ed80-44c6-a48f-9459b3d670f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:22.718993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bab0a-ed80-44c6-a48f-9459b3d670f3 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:22.737474 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 549/1093] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:23.910035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01d228-d282-406b-8ef3-83020ec0c842 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:23.910586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01d228-d282-406b-8ef3-83020ec0c842 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:23.910586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01d228-d282-406b-8ef3-83020ec0c842 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:23.911852 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 545/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:23.918603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe8db-997f-401a-a75d-f771c1de7073 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:23.919118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe8db-997f-401a-a75d-f771c1de7073 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:23.919239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe8db-997f-401a-a75d-f771c1de7073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:23.999896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-846fe8db-997f-401a-a75d-f771c1de7073 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:24.001220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-846fe8db-997f-401a-a75d-f771c1de7073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:24.029943 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:24.113963 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 550/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:24.274350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01d228-d282-406b-8ef3-83020ec0c842 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:24.276035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e01d228-d282-406b-8ef3-83020ec0c842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:24.439578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01d228-d282-406b-8ef3-83020ec0c842 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:24.486721 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:24.570626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f4fc5-7935-4d6a-9ea8-27aadab2ce54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:24.571224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f4fc5-7935-4d6a-9ea8-27aadab2ce54 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:24.571496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f4fc5-7935-4d6a-9ea8-27aadab2ce54 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:24.571762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f4fc5-7935-4d6a-9ea8-27aadab2ce54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:24.573396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-511f4fc5-7935-4d6a-9ea8-27aadab2ce54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:24.663866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f4fc5-7935-4d6a-9ea8-27aadab2ce54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:24.665485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f4fc5-7935-4d6a-9ea8-27aadab2ce54 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:24.684132 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 546/1096] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:25.842014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec63de-d23d-4c3c-af3a-8eec55018789 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:25.842614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec63de-d23d-4c3c-af3a-8eec55018789 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:25.842614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec63de-d23d-4c3c-af3a-8eec55018789 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:25.843927 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 551/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:25.850383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203794c9-2b5f-45c5-922b-394b6cec43a5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:25.850833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203794c9-2b5f-45c5-922b-394b6cec43a5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:25.850929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203794c9-2b5f-45c5-922b-394b6cec43a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:25.907998 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:25.930561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-203794c9-2b5f-45c5-922b-394b6cec43a5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:25.931764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-203794c9-2b5f-45c5-922b-394b6cec43a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:26.035506 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 547/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:26.196614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec63de-d23d-4c3c-af3a-8eec55018789 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:26.198028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8dec63de-d23d-4c3c-af3a-8eec55018789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:26.347195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec63de-d23d-4c3c-af3a-8eec55018789 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:26.359320 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:26.464577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad81cec-b677-4bf0-9a3c-d1b2808970c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:26.465144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad81cec-b677-4bf0-9a3c-d1b2808970c8 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:26.465420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad81cec-b677-4bf0-9a3c-d1b2808970c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:26.465687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad81cec-b677-4bf0-9a3c-d1b2808970c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:26.467463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fad81cec-b677-4bf0-9a3c-d1b2808970c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:26.565198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad81cec-b677-4bf0-9a3c-d1b2808970c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:26.566805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad81cec-b677-4bf0-9a3c-d1b2808970c8 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:26.585911 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 552/1099] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:27.754898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4bf14-0624-46f2-b6c9-ebca094fdf50 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:27.755443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4bf14-0624-46f2-b6c9-ebca094fdf50 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:27.755537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4bf14-0624-46f2-b6c9-ebca094fdf50 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:27.756873 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 548/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:27.763886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb98c-0c0e-4bc5-85d1-a3cddd2feac0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:27.764446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb98c-0c0e-4bc5-85d1-a3cddd2feac0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:27.764736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb98c-0c0e-4bc5-85d1-a3cddd2feac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:27.784339 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:27.846323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-09deb98c-0c0e-4bc5-85d1-a3cddd2feac0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:27.847544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09deb98c-0c0e-4bc5-85d1-a3cddd2feac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:27.946956 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 553/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:28.105901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4bf14-0624-46f2-b6c9-ebca094fdf50 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:28.107426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-afa4bf14-0624-46f2-b6c9-ebca094fdf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:28.224575 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:28.262692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4bf14-0624-46f2-b6c9-ebca094fdf50 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:28.387133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5967ea-89fd-46ec-aa05-319e8f15e98c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:28.387748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5967ea-89fd-46ec-aa05-319e8f15e98c service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:28.388026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5967ea-89fd-46ec-aa05-319e8f15e98c service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:28.388296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5967ea-89fd-46ec-aa05-319e8f15e98c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:28.390546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6e5967ea-89fd-46ec-aa05-319e8f15e98c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:28.468658 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:28.482258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5967ea-89fd-46ec-aa05-319e8f15e98c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:28.483990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5967ea-89fd-46ec-aa05-319e8f15e98c service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:28.501521 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 549/1102] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:29.653091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17736d5-5d15-4c45-b527-e5e11fbfb268 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:29.653669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17736d5-5d15-4c45-b527-e5e11fbfb268 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:29.653669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17736d5-5d15-4c45-b527-e5e11fbfb268 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:29.655698 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 554/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:29.662611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061708-c23e-4747-bb0a-b6be4f4877ae None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:29.663140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061708-c23e-4747-bb0a-b6be4f4877ae None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:29.663140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061708-c23e-4747-bb0a-b6be4f4877ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:29.741763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-28061708-c23e-4747-bb0a-b6be4f4877ae None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:29.742989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-28061708-c23e-4747-bb0a-b6be4f4877ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:29.845351 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 550/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:29.996220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17736d5-5d15-4c45-b527-e5e11fbfb268 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:29.998021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d17736d5-5d15-4c45-b527-e5e11fbfb268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:30.084350 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:30.151292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17736d5-5d15-4c45-b527-e5e11fbfb268 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:30.271732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5f0e2-acdc-4bd6-8e98-d0544f87091e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:30.272245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5f0e2-acdc-4bd6-8e98-d0544f87091e service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:30.272520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5f0e2-acdc-4bd6-8e98-d0544f87091e service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:30.272814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5f0e2-acdc-4bd6-8e98-d0544f87091e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:30.274417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8d5f0e2-acdc-4bd6-8e98-d0544f87091e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:30.332102 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:30.378804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5f0e2-acdc-4bd6-8e98-d0544f87091e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:30.380498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5f0e2-acdc-4bd6-8e98-d0544f87091e service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:30.399099 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 555/1105] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:31.473115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e156fe-7a57-4db4-9a25-3d2eadfd7999 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:31.473653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e156fe-7a57-4db4-9a25-3d2eadfd7999 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:31.473653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e156fe-7a57-4db4-9a25-3d2eadfd7999 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:31.475001 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 551/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:31.481431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fce73c-77c0-4093-add8-4254219c6ede None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:31.481929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fce73c-77c0-4093-add8-4254219c6ede None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:31.482028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fce73c-77c0-4093-add8-4254219c6ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:31.562173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-63fce73c-77c0-4093-add8-4254219c6ede None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:31.563398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-63fce73c-77c0-4093-add8-4254219c6ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:31.660224 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 556/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:31.811178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e156fe-7a57-4db4-9a25-3d2eadfd7999 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:31.812671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-51e156fe-7a57-4db4-9a25-3d2eadfd7999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:31.863087 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:31.959465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e156fe-7a57-4db4-9a25-3d2eadfd7999 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:32.075551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea42ed-f221-4b27-9e8f-b511c684a104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:32.076077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea42ed-f221-4b27-9e8f-b511c684a104 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:32.076873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea42ed-f221-4b27-9e8f-b511c684a104 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:32.077142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea42ed-f221-4b27-9e8f-b511c684a104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:32.078729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-07ea42ed-f221-4b27-9e8f-b511c684a104 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:32.086039 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:32.177097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea42ed-f221-4b27-9e8f-b511c684a104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:32.178791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea42ed-f221-4b27-9e8f-b511c684a104 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:32.197859 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 552/1108] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:33.272779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ec321-c5a5-46f5-bca1-2c602fc7c7fc None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:33.273346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ec321-c5a5-46f5-bca1-2c602fc7c7fc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:33.273346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ec321-c5a5-46f5-bca1-2c602fc7c7fc None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:33.274694 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 557/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:35:33.282536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539816-2bc2-4df2-aef5-8be58fb7e7de None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:33.283078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539816-2bc2-4df2-aef5-8be58fb7e7de None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:33.283078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539816-2bc2-4df2-aef5-8be58fb7e7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:33.371401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-38539816-2bc2-4df2-aef5-8be58fb7e7de None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:33.372676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-38539816-2bc2-4df2-aef5-8be58fb7e7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:33.445525 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:33.476319 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 553/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:33.634663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ec321-c5a5-46f5-bca1-2c602fc7c7fc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:33.636224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-706ec321-c5a5-46f5-bca1-2c602fc7c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:33.655257 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:33.802489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ec321-c5a5-46f5-bca1-2c602fc7c7fc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:33.904127 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:33.933906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce3f41-ecbe-45a0-970d-49693bbfe3cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:33.934508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3f41-ecbe-45a0-970d-49693bbfe3cf service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:33.934780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3f41-ecbe-45a0-970d-49693bbfe3cf service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:33.935046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3f41-ecbe-45a0-970d-49693bbfe3cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:33.936729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-84ce3f41-ecbe-45a0-970d-49693bbfe3cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:34.029289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce3f41-ecbe-45a0-970d-49693bbfe3cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:34.031879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce3f41-ecbe-45a0-970d-49693bbfe3cf service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:34.051374 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 558/1111] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:35.125907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244981e-6fae-4d02-8f94-7055b7e96289 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:35.126459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244981e-6fae-4d02-8f94-7055b7e96289 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:35.126459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244981e-6fae-4d02-8f94-7055b7e96289 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:35.127836 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 554/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:35.134625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f169d0-9e30-4283-801a-cbb9c2bf8e4e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:35.135065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f169d0-9e30-4283-801a-cbb9c2bf8e4e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:35.135204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f169d0-9e30-4283-801a-cbb9c2bf8e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:35.212352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-26f169d0-9e30-4283-801a-cbb9c2bf8e4e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:35.213620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-26f169d0-9e30-4283-801a-cbb9c2bf8e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:35.265279 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:35.325353 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 559/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:35.475535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244981e-6fae-4d02-8f94-7055b7e96289 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:35.477096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a244981e-6fae-4d02-8f94-7055b7e96289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:35.626380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244981e-6fae-4d02-8f94-7055b7e96289 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:35.682979 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:35.742478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91018d-6846-49c0-80d3-287ee1b9f658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:35.743082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91018d-6846-49c0-80d3-287ee1b9f658 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:35.743363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91018d-6846-49c0-80d3-287ee1b9f658 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:35.743634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91018d-6846-49c0-80d3-287ee1b9f658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:35.745281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9a91018d-6846-49c0-80d3-287ee1b9f658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:35.837058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91018d-6846-49c0-80d3-287ee1b9f658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:35.838710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91018d-6846-49c0-80d3-287ee1b9f658 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:35.860174 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 555/1114] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:36.949109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca56dc-87a6-44e2-b188-1c9dc37819c2 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:36.949661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca56dc-87a6-44e2-b188-1c9dc37819c2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:36.949661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca56dc-87a6-44e2-b188-1c9dc37819c2 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:36.951022 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 560/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:36.958050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5e29-d853-4b72-b459-591a7fbf9b33 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:36.958574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5e29-d853-4b72-b459-591a7fbf9b33 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:36.958574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5e29-d853-4b72-b459-591a7fbf9b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:37.043657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-87ea5e29-d853-4b72-b459-591a7fbf9b33 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:37.044963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-87ea5e29-d853-4b72-b459-591a7fbf9b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:37.048000 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:37.152856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 556/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:37.312610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca56dc-87a6-44e2-b188-1c9dc37819c2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:37.314097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-beca56dc-87a6-44e2-b188-1c9dc37819c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:37.486465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca56dc-87a6-44e2-b188-1c9dc37819c2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:37.520465 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:37.616555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faeb9d6-7817-48ec-90dd-9a091e4c4ab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:37.617197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb9d6-7817-48ec-90dd-9a091e4c4ab0 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:37.617471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb9d6-7817-48ec-90dd-9a091e4c4ab0 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:37.617753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb9d6-7817-48ec-90dd-9a091e4c4ab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:37.619357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4faeb9d6-7817-48ec-90dd-9a091e4c4ab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:37.722868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeb9d6-7817-48ec-90dd-9a091e4c4ab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:37.724491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeb9d6-7817-48ec-90dd-9a091e4c4ab0 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:37.744886 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 561/1117] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:35:39.899280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f135-eb5b-4189-9bcc-d39d53554b6a None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:39.900164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f135-eb5b-4189-9bcc-d39d53554b6a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:39.900164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f135-eb5b-4189-9bcc-d39d53554b6a None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:39.901211 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 557/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:35:39.908776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6ddd-9ac7-4415-8589-c718fa427440 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:39.909466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6ddd-9ac7-4415-8589-c718fa427440 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:39.909466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6ddd-9ac7-4415-8589-c718fa427440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:39.956492 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:39.999437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8f4b6ddd-9ac7-4415-8589-c718fa427440 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:40.001688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8f4b6ddd-9ac7-4415-8589-c718fa427440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:40.142286 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 562/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:40.431326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3f135-eb5b-4189-9bcc-d39d53554b6a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:40.433220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2fd3f135-eb5b-4189-9bcc-d39d53554b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:40.556246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3f135-eb5b-4189-9bcc-d39d53554b6a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:40.593421 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:40.642285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a87474-1b69-4ded-8621-e4b67ea9c955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:40.642897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a87474-1b69-4ded-8621-e4b67ea9c955 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:40.643179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a87474-1b69-4ded-8621-e4b67ea9c955 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:40.643453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a87474-1b69-4ded-8621-e4b67ea9c955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:40.645116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b0a87474-1b69-4ded-8621-e4b67ea9c955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:40.763636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a87474-1b69-4ded-8621-e4b67ea9c955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:40.765763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a87474-1b69-4ded-8621-e4b67ea9c955 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:40.786034 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 558/1120] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:43.144311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29b9db-6624-499c-9b87-e5de969ab211 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:43.145185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29b9db-6624-499c-9b87-e5de969ab211 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:43.145185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29b9db-6624-499c-9b87-e5de969ab211 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:43.146304 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 563/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:43.152134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa48b-57a2-46a3-846e-15da05c5b97e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:43.152596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa48b-57a2-46a3-846e-15da05c5b97e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:43.152730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa48b-57a2-46a3-846e-15da05c5b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:43.220875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-68cfa48b-57a2-46a3-846e-15da05c5b97e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:43.222111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-68cfa48b-57a2-46a3-846e-15da05c5b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:43.235374 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:43.326032 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 559/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:43.615522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29b9db-6624-499c-9b87-e5de969ab211 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:43.617141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3c29b9db-6624-499c-9b87-e5de969ab211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:43.725428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29b9db-6624-499c-9b87-e5de969ab211 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:43.738768 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:43.807215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6470a4d-3557-4be5-809e-3667871ee0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:43.807818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470a4d-3557-4be5-809e-3667871ee0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:43.808092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470a4d-3557-4be5-809e-3667871ee0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:43.808357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470a4d-3557-4be5-809e-3667871ee0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:43.809978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b6470a4d-3557-4be5-809e-3667871ee0a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:43.926748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6470a4d-3557-4be5-809e-3667871ee0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:43.928147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6470a4d-3557-4be5-809e-3667871ee0a2 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:43.948194 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 564/1123] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:46.503804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb255816-9c45-48ca-b8d1-51ce29ac42ba None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.504375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb255816-9c45-48ca-b8d1-51ce29ac42ba None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.504375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb255816-9c45-48ca-b8d1-51ce29ac42ba None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.505739 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 560/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:46.511093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b38a8c-c284-4b6c-bb67-106aeea89da8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.511507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b38a8c-c284-4b6c-bb67-106aeea89da8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.511647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b38a8c-c284-4b6c-bb67-106aeea89da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.562488 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:46.581388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a5b38a8c-c284-4b6c-bb67-106aeea89da8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:46.582864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a5b38a8c-c284-4b6c-bb67-106aeea89da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:46.681998 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 565/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:46.968605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb255816-9c45-48ca-b8d1-51ce29ac42ba None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.970233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eb255816-9c45-48ca-b8d1-51ce29ac42ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:47.081953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb255816-9c45-48ca-b8d1-51ce29ac42ba None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:47.123868 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:47.160464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc487af0-710d-4e96-ad1a-e34c3f57839c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:47.161102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc487af0-710d-4e96-ad1a-e34c3f57839c service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:47.161379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc487af0-710d-4e96-ad1a-e34c3f57839c service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:47.161652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc487af0-710d-4e96-ad1a-e34c3f57839c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:47.163258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc487af0-710d-4e96-ad1a-e34c3f57839c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:47.277916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc487af0-710d-4e96-ad1a-e34c3f57839c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:47.279936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc487af0-710d-4e96-ad1a-e34c3f57839c service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:47.298580 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 561/1126] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:49.700560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c78d-26cd-47e0-8eaa-c1400b5aa6cb None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:49.701733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c78d-26cd-47e0-8eaa-c1400b5aa6cb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:49.701733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c78d-26cd-47e0-8eaa-c1400b5aa6cb None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:49.703311 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 566/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:49.709017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56a9b-66a2-489a-9263-84c9a93b1b08 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:49.709519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56a9b-66a2-489a-9263-84c9a93b1b08 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:49.709656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56a9b-66a2-489a-9263-84c9a93b1b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:49.777507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-87a56a9b-66a2-489a-9263-84c9a93b1b08 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:49.778679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-87a56a9b-66a2-489a-9263-84c9a93b1b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:49.799549 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:49.881820 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 562/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:50.165662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36c78d-26cd-47e0-8eaa-c1400b5aa6cb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:50.167382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4a36c78d-26cd-47e0-8eaa-c1400b5aa6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:50.278686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36c78d-26cd-47e0-8eaa-c1400b5aa6cb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:50.301131 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:50.362579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52e07-5cbb-41a4-b074-4c067f026aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:50.363456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52e07-5cbb-41a4-b074-4c067f026aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:50.363881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52e07-5cbb-41a4-b074-4c067f026aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:50.364215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52e07-5cbb-41a4-b074-4c067f026aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:50.365884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d0e52e07-5cbb-41a4-b074-4c067f026aa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:50.477719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e52e07-5cbb-41a4-b074-4c067f026aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:50.479149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e52e07-5cbb-41a4-b074-4c067f026aa9 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:50.496746 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 567/1129] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:52.787808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbdb2a-35da-43fa-9017-f571971f421d None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.788383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbdb2a-35da-43fa-9017-f571971f421d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.788493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbdb2a-35da-43fa-9017-f571971f421d None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.789862 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 563/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:52.796088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab290-25d4-4ffe-9371-6c0450e72f06 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.796527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab290-25d4-4ffe-9371-6c0450e72f06 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.796654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab290-25d4-4ffe-9371-6c0450e72f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.861059 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:52.864973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5c2ab290-25d4-4ffe-9371-6c0450e72f06 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:52.866471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5c2ab290-25d4-4ffe-9371-6c0450e72f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:52.966585 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 568/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:53.251738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbdb2a-35da-43fa-9017-f571971f421d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:53.253388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-22bbdb2a-35da-43fa-9017-f571971f421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:53.362669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbdb2a-35da-43fa-9017-f571971f421d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:53.413936 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:53.440003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001f426-39dd-40d9-82f8-b5ab75d63da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:53.440608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001f426-39dd-40d9-82f8-b5ab75d63da9 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:53.440908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001f426-39dd-40d9-82f8-b5ab75d63da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:53.441175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001f426-39dd-40d9-82f8-b5ab75d63da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:53.442769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b001f426-39dd-40d9-82f8-b5ab75d63da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:53.557631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001f426-39dd-40d9-82f8-b5ab75d63da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:53.559066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001f426-39dd-40d9-82f8-b5ab75d63da9 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:53.577893 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 564/1132] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:55.802519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf4e54-4d5e-4995-a7b6-87eccd23485d None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:55.803095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf4e54-4d5e-4995-a7b6-87eccd23485d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:55.803095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf4e54-4d5e-4995-a7b6-87eccd23485d None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:55.804396 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 569/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:55.809847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e0d6-e23e-4f57-80dd-3112bf13770f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:55.810918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e0d6-e23e-4f57-80dd-3112bf13770f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:55.810918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e0d6-e23e-4f57-80dd-3112bf13770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:55.881743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-89d1e0d6-e23e-4f57-80dd-3112bf13770f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:55.882990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-89d1e0d6-e23e-4f57-80dd-3112bf13770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:55.914236 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:55.987669 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 565/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:56.287970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf4e54-4d5e-4995-a7b6-87eccd23485d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:56.289657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8fdf4e54-4d5e-4995-a7b6-87eccd23485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:56.406874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf4e54-4d5e-4995-a7b6-87eccd23485d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:56.437074 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:56.487126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfb192-fc1a-410a-bcc1-c55e3346762f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:56.487662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfb192-fc1a-410a-bcc1-c55e3346762f service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:56.487939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfb192-fc1a-410a-bcc1-c55e3346762f service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:56.488197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfb192-fc1a-410a-bcc1-c55e3346762f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:56.489909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-90cfb192-fc1a-410a-bcc1-c55e3346762f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:56.611954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfb192-fc1a-410a-bcc1-c55e3346762f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:56.613433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfb192-fc1a-410a-bcc1-c55e3346762f service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:56.632429 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 570/1135] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:58.991646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9e98d-ed39-4969-8084-e4becf9e7651 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:58.992233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9e98d-ed39-4969-8084-e4becf9e7651 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:58.992233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9e98d-ed39-4969-8084-e4becf9e7651 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:58.993592 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 566/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:35:58.999882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e60ef-31d0-4698-8f03-1bca7023a1ee None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:59.000396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e60ef-31d0-4698-8f03-1bca7023a1ee None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:59.000396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e60ef-31d0-4698-8f03-1bca7023a1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:59.069851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-328e60ef-31d0-4698-8f03-1bca7023a1ee None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:59.071117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-328e60ef-31d0-4698-8f03-1bca7023a1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:59.079645 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:59.171214 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 571/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:59.467320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9e98d-ed39-4969-8084-e4becf9e7651 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:59.469251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-12b9e98d-ed39-4969-8084-e4becf9e7651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:59.579291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9e98d-ed39-4969-8084-e4becf9e7651 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:59.638190 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:59.657337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22fd17-a051-4045-a5b3-16b6ed1913e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:59.657946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fd17-a051-4045-a5b3-16b6ed1913e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:59.658225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fd17-a051-4045-a5b3-16b6ed1913e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:59.658499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fd17-a051-4045-a5b3-16b6ed1913e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:59.660148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cd22fd17-a051-4045-a5b3-16b6ed1913e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:59.776381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22fd17-a051-4045-a5b3-16b6ed1913e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:59.777878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22fd17-a051-4045-a5b3-16b6ed1913e3 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:59.797445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 567/1138] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:02.053753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd72b4-981a-4db6-8558-8b3beb8bcb5a None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:02.054242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd72b4-981a-4db6-8558-8b3beb8bcb5a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:02.054348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd72b4-981a-4db6-8558-8b3beb8bcb5a None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:02.055687 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 572/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:36:02.061370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c09c2-5f9e-43de-ad52-37a690044d39 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:02.061853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c09c2-5f9e-43de-ad52-37a690044d39 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:02.061972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c09c2-5f9e-43de-ad52-37a690044d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:02.130558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-df9c09c2-5f9e-43de-ad52-37a690044d39 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:02.131776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-df9c09c2-5f9e-43de-ad52-37a690044d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:02.173391 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:02.236742 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 568/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:02.532083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd72b4-981a-4db6-8558-8b3beb8bcb5a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:02.533676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7bfd72b4-981a-4db6-8558-8b3beb8bcb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:02.637669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd72b4-981a-4db6-8558-8b3beb8bcb5a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:02.676464 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:02.712467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd48a8-da3e-4f79-ac0d-d4ad1fe2623d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:02.713097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd48a8-da3e-4f79-ac0d-d4ad1fe2623d service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:02.713377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd48a8-da3e-4f79-ac0d-d4ad1fe2623d service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:02.713649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd48a8-da3e-4f79-ac0d-d4ad1fe2623d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:02.715232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bccd48a8-da3e-4f79-ac0d-d4ad1fe2623d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:02.828386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd48a8-da3e-4f79-ac0d-d4ad1fe2623d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:02.829780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd48a8-da3e-4f79-ac0d-d4ad1fe2623d service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:02.850057 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 573/1141] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:05.056710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0969c7-3e80-4aa4-a576-0cf0354e9598 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:05.057177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0969c7-3e80-4aa4-a576-0cf0354e9598 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:05.057298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0969c7-3e80-4aa4-a576-0cf0354e9598 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:05.058682 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 569/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:05.064753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e4b5-59b5-4cd5-b406-2da487e8c0e2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:05.065197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e4b5-59b5-4cd5-b406-2da487e8c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:05.065295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e4b5-59b5-4cd5-b406-2da487e8c0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:05.140781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8af0e4b5-59b5-4cd5-b406-2da487e8c0e2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:05.141559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8af0e4b5-59b5-4cd5-b406-2da487e8c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:05.160827 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:05.241664 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 574/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:05.530904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0969c7-3e80-4aa4-a576-0cf0354e9598 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:05.532526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1a0969c7-3e80-4aa4-a576-0cf0354e9598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:05.637140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0969c7-3e80-4aa4-a576-0cf0354e9598 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:05.705695 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:05.713364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b608d6-ac80-4d49-92c2-7acb9accea59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:05.713919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b608d6-ac80-4d49-92c2-7acb9accea59 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:05.714201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b608d6-ac80-4d49-92c2-7acb9accea59 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:05.714475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b608d6-ac80-4d49-92c2-7acb9accea59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:05.716076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-83b608d6-ac80-4d49-92c2-7acb9accea59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:05.829152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b608d6-ac80-4d49-92c2-7acb9accea59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:05.831657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b608d6-ac80-4d49-92c2-7acb9accea59 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:05.849800 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 570/1144] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:08.073900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b1f0-0e15-454b-90c7-4c355f8d8943 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:08.074451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b1f0-0e15-454b-90c7-4c355f8d8943 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:08.074451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b1f0-0e15-454b-90c7-4c355f8d8943 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:08.076274 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:08.081649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c63bc-09c3-47d0-b9f7-8c7e1a2f3603 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:08.082368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c63bc-09c3-47d0-b9f7-8c7e1a2f3603 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:08.082478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c63bc-09c3-47d0-b9f7-8c7e1a2f3603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:08.151096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6d5c63bc-09c3-47d0-b9f7-8c7e1a2f3603 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:08.152318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6d5c63bc-09c3-47d0-b9f7-8c7e1a2f3603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:08.205237 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:08.255622 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:08.547118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b1f0-0e15-454b-90c7-4c355f8d8943 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:08.548711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f2c3b1f0-0e15-454b-90c7-4c355f8d8943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:08.652738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b1f0-0e15-454b-90c7-4c355f8d8943 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:08.701429 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:08.728675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3017f5-fb2a-46f5-b81b-de063e41f2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:08.729313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3017f5-fb2a-46f5-b81b-de063e41f2bc service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:08.729570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3017f5-fb2a-46f5-b81b-de063e41f2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:08.730117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3017f5-fb2a-46f5-b81b-de063e41f2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:08.731461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f3017f5-fb2a-46f5-b81b-de063e41f2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:08.844435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3017f5-fb2a-46f5-b81b-de063e41f2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:08.845911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3017f5-fb2a-46f5-b81b-de063e41f2bc service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:08.864528 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 576/1147] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:18.254027 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=22 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:18.862270 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=66 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:29.679817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c84970-10ce-4ec4-b5e0-9fa8d1d54a49 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:29.680426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c84970-10ce-4ec4-b5e0-9fa8d1d54a49 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:29.680426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c84970-10ce-4ec4-b5e0-9fa8d1d54a49 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:29.681745 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 572/1148] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:29.688173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851f365-9d08-40f2-af05-270235fd0090 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:29.688642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851f365-9d08-40f2-af05-270235fd0090 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:29.688755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851f365-9d08-40f2-af05-270235fd0090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:29.755739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d851f365-9d08-40f2-af05-270235fd0090 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:29.756989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d851f365-9d08-40f2-af05-270235fd0090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:29.857523 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 577/1149] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:30.165747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b827-78c6-40bb-babe-8396c79dc6df None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:30.166033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b827-78c6-40bb-babe-8396c79dc6df None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:30.166311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b827-78c6-40bb-babe-8396c79dc6df None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:30.167662 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 573/1150] 10.222.0.27 () {54 vars in 962 bytes} [Wed Oct 19 00:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:30.172966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a776a1-33a0-4e13-a0bf-8d48a619d08c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:30.173251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a776a1-33a0-4e13-a0bf-8d48a619d08c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:30.173569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a776a1-33a0-4e13-a0bf-8d48a619d08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:30.250226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f7a776a1-33a0-4e13-a0bf-8d48a619d08c None None] MFA Rules not processed for user `6eb751f44d3b4fb3b49a0084e76176d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:30.251459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f7a776a1-33a0-4e13-a0bf-8d48a619d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:30.272335 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:30.329881 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 578/1151] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Oct 19 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:30.337878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b827-78c6-40bb-babe-8396c79dc6df None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:30.339443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fac6b827-78c6-40bb-babe-8396c79dc6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:30.454019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b827-78c6-40bb-babe-8396c79dc6df None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:30.529922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c664c1c-0a59-42f2-886e-55a0dc601ac2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:30.530558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c664c1c-0a59-42f2-886e-55a0dc601ac2 service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:30.530826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c664c1c-0a59-42f2-886e-55a0dc601ac2 service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:30.531230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c664c1c-0a59-42f2-886e-55a0dc601ac2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:30.532881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c664c1c-0a59-42f2-886e-55a0dc601ac2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:30.591869 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:30.650294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c664c1c-0a59-42f2-886e-55a0dc601ac2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:30.651720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c664c1c-0a59-42f2-886e-55a0dc601ac2 service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:30.672228 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 574/1152] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:32.993398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca8205-ce8e-4460-aefb-87295cdf53c4 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:32.993957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca8205-ce8e-4460-aefb-87295cdf53c4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:32.993957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca8205-ce8e-4460-aefb-87295cdf53c4 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:32.995289 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 579/1153] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:33.001096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17316fa-e295-45b8-831a-7440851274e1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:33.001577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17316fa-e295-45b8-831a-7440851274e1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:33.001714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17316fa-e295-45b8-831a-7440851274e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:33.072232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b17316fa-e295-45b8-831a-7440851274e1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:33.073649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b17316fa-e295-45b8-831a-7440851274e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:33.178489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 575/1154] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:33.468316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca8205-ce8e-4460-aefb-87295cdf53c4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:33.469903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b0ca8205-ce8e-4460-aefb-87295cdf53c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:33.605663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca8205-ce8e-4460-aefb-87295cdf53c4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:33.662637 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:33.706842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f53b8-5304-497e-9055-9d785ebb718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:33.707711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f53b8-5304-497e-9055-9d785ebb718a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:33.707985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f53b8-5304-497e-9055-9d785ebb718a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:33.708248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f53b8-5304-497e-9055-9d785ebb718a admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:33.708912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f53b8-5304-497e-9055-9d785ebb718a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:33.710020 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-f16f53b8-5304-497e-9055-9d785ebb718a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:36:33.710020 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:36:33.710020 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:36:33.711146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f53b8-5304-497e-9055-9d785ebb718a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:33.730834 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 580/1155] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 19 00:36:33 2022] GET /identity/v3/projects => generated 2553 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:36:35.936299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cd66e-fe4c-45ed-a0fe-858f0c4fa9a8 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:35.936920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cd66e-fe4c-45ed-a0fe-858f0c4fa9a8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:35.936920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cd66e-fe4c-45ed-a0fe-858f0c4fa9a8 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:35.938213 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 576/1156] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:35.943888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fe62b-ee2f-4717-9640-8dbd4fa8f850 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:35.944382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fe62b-ee2f-4717-9640-8dbd4fa8f850 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:35.944496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fe62b-ee2f-4717-9640-8dbd4fa8f850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:36.021703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cd1fe62b-ee2f-4717-9640-8dbd4fa8f850 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:36.023026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd1fe62b-ee2f-4717-9640-8dbd4fa8f850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:36.127066 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 581/1157] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:36.424724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cd66e-fe4c-45ed-a0fe-858f0c4fa9a8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:36.426397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-902cd66e-fe4c-45ed-a0fe-858f0c4fa9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:36.436927 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:36.599512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cd66e-fe4c-45ed-a0fe-858f0c4fa9a8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:36.682159 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:36.716706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1b10b-5475-4b74-9eae-6cea43a3b2e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:36.717326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1b10b-5475-4b74-9eae-6cea43a3b2e1 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:36.717609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1b10b-5475-4b74-9eae-6cea43a3b2e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:36.717890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1b10b-5475-4b74-9eae-6cea43a3b2e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:36.719568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d3d1b10b-5475-4b74-9eae-6cea43a3b2e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:36.821057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1b10b-5475-4b74-9eae-6cea43a3b2e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:36.822656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1b10b-5475-4b74-9eae-6cea43a3b2e1 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:36.842123 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 577/1158] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:39.255031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2ed0-e1be-4273-a530-ca0ffd9de53b None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:39.255623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2ed0-e1be-4273-a530-ca0ffd9de53b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:39.255623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2ed0-e1be-4273-a530-ca0ffd9de53b None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:39.257020 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 582/1159] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:39.262641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ffd55-4d9b-46aa-8748-e8a4671ac614 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:39.263584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ffd55-4d9b-46aa-8748-e8a4671ac614 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:39.263732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ffd55-4d9b-46aa-8748-e8a4671ac614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:39.334047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-984ffd55-4d9b-46aa-8748-e8a4671ac614 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:39.335308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-984ffd55-4d9b-46aa-8748-e8a4671ac614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:39.383871 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:39.434837 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 578/1160] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:39.723540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2ed0-e1be-4273-a530-ca0ffd9de53b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:39.725147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1f3c2ed0-e1be-4273-a530-ca0ffd9de53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:39.750170 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:39.833497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2ed0-e1be-4273-a530-ca0ffd9de53b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:39.915563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98d2ba-d7b6-4dea-ae78-4ac41bf7d06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:39.916171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98d2ba-d7b6-4dea-ae78-4ac41bf7d06c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:39.916452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98d2ba-d7b6-4dea-ae78-4ac41bf7d06c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:39.916753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98d2ba-d7b6-4dea-ae78-4ac41bf7d06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:39.918361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd98d2ba-d7b6-4dea-ae78-4ac41bf7d06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:40.002059 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:40.037974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98d2ba-d7b6-4dea-ae78-4ac41bf7d06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:40.039421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98d2ba-d7b6-4dea-ae78-4ac41bf7d06c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:40.058278 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 583/1161] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:42.305252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61797446-036d-487a-980e-4ce12475cc4e None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:42.305801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61797446-036d-487a-980e-4ce12475cc4e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:42.305801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61797446-036d-487a-980e-4ce12475cc4e None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:42.307104 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 579/1162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:42.313354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f774cf-7ce3-4ac5-9fc8-51a848e66ffd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:42.313821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f774cf-7ce3-4ac5-9fc8-51a848e66ffd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:42.313942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f774cf-7ce3-4ac5-9fc8-51a848e66ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:42.381740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-98f774cf-7ce3-4ac5-9fc8-51a848e66ffd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:42.382959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-98f774cf-7ce3-4ac5-9fc8-51a848e66ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:42.484030 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 584/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:42.784185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61797446-036d-487a-980e-4ce12475cc4e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:42.785769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-61797446-036d-487a-980e-4ce12475cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:42.913710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61797446-036d-487a-980e-4ce12475cc4e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:42.998725 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:43.000136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6ece7-dfa1-4685-a3c9-399cc2ec23bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:43.000937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ece7-dfa1-4685-a3c9-399cc2ec23bf service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:43.001399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ece7-dfa1-4685-a3c9-399cc2ec23bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:43.001830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ece7-dfa1-4685-a3c9-399cc2ec23bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:43.003770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-06f6ece7-dfa1-4685-a3c9-399cc2ec23bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:43.126232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6ece7-dfa1-4685-a3c9-399cc2ec23bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:43.127670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6ece7-dfa1-4685-a3c9-399cc2ec23bf service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:43.147157 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 580/1164] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:45.501412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655ffa9-5b16-43e0-8364-a735466c6da9 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:45.501989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655ffa9-5b16-43e0-8364-a735466c6da9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:45.501989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655ffa9-5b16-43e0-8364-a735466c6da9 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:45.503321 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 585/1165] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:45.508949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68f6aa-0eba-41d7-857c-ecc22dc64872 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:45.509392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68f6aa-0eba-41d7-857c-ecc22dc64872 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:45.509506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68f6aa-0eba-41d7-857c-ecc22dc64872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:45.579626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3a68f6aa-0eba-41d7-857c-ecc22dc64872 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:45.580911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3a68f6aa-0eba-41d7-857c-ecc22dc64872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:45.639502 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:45.685925 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 581/1166] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:45.973591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655ffa9-5b16-43e0-8364-a735466c6da9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:45.975143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4655ffa9-5b16-43e0-8364-a735466c6da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:46.012258 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:46.092876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655ffa9-5b16-43e0-8364-a735466c6da9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:46.170037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff427a2d-64e8-47b0-b07b-39d1a15f3140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:46.170776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff427a2d-64e8-47b0-b07b-39d1a15f3140 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:46.171060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff427a2d-64e8-47b0-b07b-39d1a15f3140 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:46.171332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff427a2d-64e8-47b0-b07b-39d1a15f3140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:46.172987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ff427a2d-64e8-47b0-b07b-39d1a15f3140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:46.259005 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:46.292871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff427a2d-64e8-47b0-b07b-39d1a15f3140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:46.295240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff427a2d-64e8-47b0-b07b-39d1a15f3140 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:46.314509 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 586/1167] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:48.807428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931e4b9-2938-4136-b1d6-3b82ab295f79 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:48.808242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931e4b9-2938-4136-b1d6-3b82ab295f79 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:48.808242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931e4b9-2938-4136-b1d6-3b82ab295f79 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:48.810630 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 582/1168] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 19 00:36:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:48.816951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08fe3-370c-40fa-bae9-0ef5b98ad836 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:48.817445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08fe3-370c-40fa-bae9-0ef5b98ad836 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:48.817771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08fe3-370c-40fa-bae9-0ef5b98ad836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:48.895948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-65d08fe3-370c-40fa-bae9-0ef5b98ad836 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:48.897193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65d08fe3-370c-40fa-bae9-0ef5b98ad836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:49.008906 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 587/1169] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 19 00:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:36:49.317628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931e4b9-2938-4136-b1d6-3b82ab295f79 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:49.319190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5931e4b9-2938-4136-b1d6-3b82ab295f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:49.433240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931e4b9-2938-4136-b1d6-3b82ab295f79 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:49.514990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9be1a-ef4b-488f-9ac7-fe46b2309579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:49.515749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9be1a-ef4b-488f-9ac7-fe46b2309579 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:49.516164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9be1a-ef4b-488f-9ac7-fe46b2309579 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:49.516447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9be1a-ef4b-488f-9ac7-fe46b2309579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:49.518475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-99a9be1a-ef4b-488f-9ac7-fe46b2309579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:49.527511 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:49.633939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9be1a-ef4b-488f-9ac7-fe46b2309579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:49.635412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9be1a-ef4b-488f-9ac7-fe46b2309579 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:49.654461 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 583/1170] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:59.007132 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=82 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:59.651372 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=50 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:12.372443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad6619-430a-4123-baae-11cb97a538ac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:12.373060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad6619-430a-4123-baae-11cb97a538ac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:12.373060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad6619-430a-4123-baae-11cb97a538ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:12.452176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0dad6619-430a-4123-baae-11cb97a538ac None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:38:12.453436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0dad6619-430a-4123-baae-11cb97a538ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:12.551693 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 588/1171] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:38:12.560131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb789a-53a8-4947-9bd6-1474dbef331f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:12.560827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb789a-53a8-4947-9bd6-1474dbef331f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:12.560827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb789a-53a8-4947-9bd6-1474dbef331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:12.639224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9fdb789a-53a8-4947-9bd6-1474dbef331f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:38:12.640432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9fdb789a-53a8-4947-9bd6-1474dbef331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:12.736945 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 584/1172] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:38:12.741695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad6619-430a-4123-baae-11cb97a538ac None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:12.742951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0dad6619-430a-4123-baae-11cb97a538ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:12.755074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad6619-430a-4123-baae-11cb97a538ac None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:12.817272 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:12.853396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:12.854688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:12.854967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:12.855236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:12.855872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:38:12.856170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:12.857209 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:38:12.857209 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:38:12.857209 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:38:12.858092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:12.869146 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 589/1173] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:38:12.879168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb789a-53a8-4947-9bd6-1474dbef331f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:12.888544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb789a-53a8-4947-9bd6-1474dbef331f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:12.950852 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:12.985750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:12.986404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:12.986680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:12.986949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:12.987587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:12.988720 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:38:12.988720 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:38:12.988720 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:38:12.989909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:13.046388 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 585/1174] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:38:12 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:38:13.050682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:13.052209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:13.088514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c3d33-4491-49b1-8e6b-4eeeb7f0d5ae admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:13.184491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:13.185183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:13.185467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:13.185742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:13.186378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:13.187384 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:38:13.187384 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:38:13.187384 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:38:13.188607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:13.233166 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 590/1175] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:38:13 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:38:13.237376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:13.238876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:13.304228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ffbb-d7ee-4ac1-9325-e7cca7bd62c9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:13.394197 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:13.407444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3915-a7ba-4095-828c-3edbf53be9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:13.408077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3915-a7ba-4095-828c-3edbf53be9ab admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:13.408470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3915-a7ba-4095-828c-3edbf53be9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:13.408782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3915-a7ba-4095-828c-3edbf53be9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:13.409425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd3915-a7ba-4095-828c-3edbf53be9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:13.411055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd3915-a7ba-4095-828c-3edbf53be9ab admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:13.426331 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 586/1176] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:38:13.430391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:13.432099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:13.443425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b9158-4937-4d71-a794-d3c73149b2e1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:13.468951 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:13.540779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2657c-8095-4d71-8fba-5744c4a9c0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:13.542103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2657c-8095-4d71-8fba-5744c4a9c0aa admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:13.543019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2657c-8095-4d71-8fba-5744c4a9c0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:13.543019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2657c-8095-4d71-8fba-5744c4a9c0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:13.543282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2657c-8095-4d71-8fba-5744c4a9c0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:13.545333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2657c-8095-4d71-8fba-5744c4a9c0aa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:13.557973 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 591/1177] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:38:13.562149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3915-a7ba-4095-828c-3edbf53be9ab admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:13.563736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ffcd3915-a7ba-4095-828c-3edbf53be9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:13.597224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3915-a7ba-4095-828c-3edbf53be9ab admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:13.693676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc7c79-6396-40e2-be12-f6b110ebcc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:13.694342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc7c79-6396-40e2-be12-f6b110ebcc70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:13.694625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc7c79-6396-40e2-be12-f6b110ebcc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:13.694899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc7c79-6396-40e2-be12-f6b110ebcc70 admin admin] PATH_INFO: `/v3/projects/10c32708894045b5a28bf6472a0403df/users/c720d44d993a45ab89727e013b8123b9/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:13.719498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc7c79-6396-40e2-be12-f6b110ebcc70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c32708894045b5a28bf6472a0403df, user_id=c720d44d993a45ab89727e013b8123b9, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:13.722201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc7c79-6396-40e2-be12-f6b110ebcc70 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:13.748726 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 587/1178] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:38:13 2022] PUT /identity/v3/projects/10c32708894045b5a28bf6472a0403df/users/c720d44d993a45ab89727e013b8123b9/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:38:13.759705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4ad8-37d5-4e47-b8e3-3f6ed446887a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:13.760080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4ad8-37d5-4e47-b8e3-3f6ed446887a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:13.760886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a4ad8-37d5-4e47-b8e3-3f6ed446887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:13.820151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-af1a4ad8-37d5-4e47-b8e3-3f6ed446887a None None] MFA Rules not processed for user `c720d44d993a45ab89727e013b8123b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:38:13.821411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-af1a4ad8-37d5-4e47-b8e3-3f6ed446887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:13.900770 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 592/1179] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:38:13.914195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d317d03-f1f4-4900-b26c-7ce80e4e1ab4 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:13.914422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d317d03-f1f4-4900-b26c-7ce80e4e1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:13.914702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d317d03-f1f4-4900-b26c-7ce80e4e1ab4 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:13.916046 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 588/1180] 10.222.0.27 () {54 vars in 963 bytes} [Wed Oct 19 00:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:38:13.921487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4e57b-b589-4a5b-8764-57620a0a2a3e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:13.921780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4e57b-b589-4a5b-8764-57620a0a2a3e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:13.922063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4e57b-b589-4a5b-8764-57620a0a2a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:13.955505 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:14.003502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d3c4e57b-b589-4a5b-8764-57620a0a2a3e None None] MFA Rules not processed for user `5f3c0c082e3044b283bfeb58543d088c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:38:14.004744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d3c4e57b-b589-4a5b-8764-57620a0a2a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:14.087662 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 593/1181] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Oct 19 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:38:14.095670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d317d03-f1f4-4900-b26c-7ce80e4e1ab4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:14.097606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d317d03-f1f4-4900-b26c-7ce80e4e1ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:14.148663 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:14.203610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d317d03-f1f4-4900-b26c-7ce80e4e1ab4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:14.278869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:14.279614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:14.279899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:14.280172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:14.281856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:14.386784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:14.388223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:14.391777 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:14.407329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 589/1182] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:38:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:38:14.454208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d5451-8b91-4b10-9bdf-cf10ce7ad049 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:14.454648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d5451-8b91-4b10-9bdf-cf10ce7ad049 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:14.454763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d5451-8b91-4b10-9bdf-cf10ce7ad049 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:14.456117 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 594/1183] 10.222.0.27 () {52 vars in 830 bytes} [Wed Oct 19 00:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:38:14.460195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:14.461455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:14.565861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e21ba-6369-41f6-8ae4-0d946518492c service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:14.662262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:14.662893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:14.663179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:14.663449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] PATH_INFO: `/v3/users/c720d44d993a45ab89727e013b8123b9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:14.677545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c720d44d993a45ab89727e013b8123b9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:14.678559 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:38:14.678559 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:38:14.678559 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:38:14.679791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:14.690102 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:14.747807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c720d44d993a45ab89727e013b8123b9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:14.771006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c720d44d993a45ab89727e013b8123b9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:14.781132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c720d44d993a45ab89727e013b8123b9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:14.796224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c720d44d993a45ab89727e013b8123b9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:14.796722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c720d44d993a45ab89727e013b8123b9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:14.802705 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 590/1184] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:38:14 2022] DELETE /identity/v3/users/c720d44d993a45ab89727e013b8123b9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:38:14.807404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fad14e-ea68-4669-9c3c-bbbb7bb9b66b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:14.807696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fad14e-ea68-4669-9c3c-bbbb7bb9b66b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:14.807966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fad14e-ea68-4669-9c3c-bbbb7bb9b66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:14.867677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-80fad14e-ea68-4669-9c3c-bbbb7bb9b66b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:38:14.868978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-80fad14e-ea68-4669-9c3c-bbbb7bb9b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:14.944968 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:14.958315 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 595/1185] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:38:14.968798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:14.970109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:15.072105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4b907-2b1f-4c39-97e3-f031f3e979e9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:15.131914 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:15.154301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeeba1-a9f1-4a64-87d2-9d346c75a49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:15.154916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeeba1-a9f1-4a64-87d2-9d346c75a49d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:15.155195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeeba1-a9f1-4a64-87d2-9d346c75a49d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:15.155465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeeba1-a9f1-4a64-87d2-9d346c75a49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:15.157101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-25aeeba1-a9f1-4a64-87d2-9d346c75a49d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:15.268410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeeba1-a9f1-4a64-87d2-9d346c75a49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:15.269888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeeba1-a9f1-4a64-87d2-9d346c75a49d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:15.289175 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 591/1186] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:38:15.640163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fad14e-ea68-4669-9c3c-bbbb7bb9b66b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:15.641823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-80fad14e-ea68-4669-9c3c-bbbb7bb9b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:15.654370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fad14e-ea68-4669-9c3c-bbbb7bb9b66b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:15.757861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:15.758494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:15.758802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:15.759074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] PATH_INFO: `/v3/projects/10c32708894045b5a28bf6472a0403df` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:15.769923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c32708894045b5a28bf6472a0403df)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:15.770957 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:38:15.770957 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:38:15.770957 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:38:15.772175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:15.832683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c32708894045b5a28bf6472a0403df', 'request_id': 'req-f5660f64-5992-472e-9e59-17a23503a749'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:15.844676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c32708894045b5a28bf6472a0403df', 'request_id': 'req-f5660f64-5992-472e-9e59-17a23503a749'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:15.851096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c32708894045b5a28bf6472a0403df', 'request_id': 'req-f5660f64-5992-472e-9e59-17a23503a749'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:15.883500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] The token cache is being invalidate because project 10c32708894045b5a28bf6472a0403df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:38:15.883708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:15.884139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f5660f64-5992-472e-9e59-17a23503a749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:38:15.885996 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 596/1187] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:38:15 2022] DELETE /identity/v3/projects/10c32708894045b5a28bf6472a0403df => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:38:25.286751 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=62 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:25.881371 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:34.067977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07472ef4-6682-41e9-894c-058dee8d334e None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:34.068605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07472ef4-6682-41e9-894c-058dee8d334e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:34.068605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07472ef4-6682-41e9-894c-058dee8d334e None None] PATH_INFO: `/v3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:34.069985 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 592/1188] 10.222.0.36 () {54 vars in 925 bytes} [Wed Oct 19 00:41:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:41:34.077650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5cde-5667-4c5b-b3f7-f4eab7dc7e46 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:34.078290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5cde-5667-4c5b-b3f7-f4eab7dc7e46 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:34.078290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5cde-5667-4c5b-b3f7-f4eab7dc7e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:34.202617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ac7c5cde-5667-4c5b-b3f7-f4eab7dc7e46 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:34.203946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ac7c5cde-5667-4c5b-b3f7-f4eab7dc7e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:34.224571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd1bdc-fc41-4672-ba66-f6bad3364bf5 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:34.225087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd1bdc-fc41-4672-ba66-f6bad3364bf5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:34.225518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd1bdc-fc41-4672-ba66-f6bad3364bf5 None None] PATH_INFO: `/v3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:34.227067 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 593/1189] 10.222.0.45 () {54 vars in 925 bytes} [Wed Oct 19 00:41:34 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:41:34.241957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8297ef-3154-4bc9-b66c-840ff95c0258 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:34.242494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8297ef-3154-4bc9-b66c-840ff95c0258 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:34.243003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8297ef-3154-4bc9-b66c-840ff95c0258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:34.269693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1d8297ef-3154-4bc9-b66c-840ff95c0258 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:34.270878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1d8297ef-3154-4bc9-b66c-840ff95c0258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:34.364766 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 594/1190] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Oct 19 00:41:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:34.365431 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 597/1191] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Oct 19 00:41:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:44.204654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47d1a-e520-4748-8ac1-e298aab62eb5 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:44.205286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47d1a-e520-4748-8ac1-e298aab62eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:44.205286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47d1a-e520-4748-8ac1-e298aab62eb5 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:44.207744 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 595/1192] 10.222.0.27 () {54 vars in 961 bytes} [Wed Oct 19 00:41:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:41:44.213871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fd4fe-0fe8-4747-8cad-6c379fb37276 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:44.214440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fd4fe-0fe8-4747-8cad-6c379fb37276 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:44.214440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fd4fe-0fe8-4747-8cad-6c379fb37276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:44.240336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ef4fd4fe-0fe8-4747-8cad-6c379fb37276 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:44.241634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ef4fd4fe-0fe8-4747-8cad-6c379fb37276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:44.250850 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 598/1193] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 00:41:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:44.263064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47d1a-e520-4748-8ac1-e298aab62eb5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:44.278088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47d1a-e520-4748-8ac1-e298aab62eb5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:44.283541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd4a00-8ff6-48cc-933d-e2a5709d8796 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:44.284488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd4a00-8ff6-48cc-933d-e2a5709d8796 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:44.284805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd4a00-8ff6-48cc-933d-e2a5709d8796 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:44.285081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd4a00-8ff6-48cc-933d-e2a5709d8796 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:44.294828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd4a00-8ff6-48cc-933d-e2a5709d8796 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:44.296459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd4a00-8ff6-48cc-933d-e2a5709d8796 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:44.308324 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 596/1194] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:41:44.360115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353c1e-9e60-4b4d-b574-ccd5565cbb8e None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:44.360546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353c1e-9e60-4b4d-b574-ccd5565cbb8e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:44.360995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353c1e-9e60-4b4d-b574-ccd5565cbb8e None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:44.363517 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 599/1195] 10.222.0.27 () {54 vars in 961 bytes} [Wed Oct 19 00:41:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:41:44.370179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c909b82-fec5-4089-ae65-5de4da66b9cf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:44.370659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c909b82-fec5-4089-ae65-5de4da66b9cf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:44.371095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c909b82-fec5-4089-ae65-5de4da66b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:44.398760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8c909b82-fec5-4089-ae65-5de4da66b9cf None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:44.400014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8c909b82-fec5-4089-ae65-5de4da66b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:44.413483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 597/1196] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 00:41:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:44.423645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353c1e-9e60-4b4d-b574-ccd5565cbb8e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:44.443991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353c1e-9e60-4b4d-b574-ccd5565cbb8e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:44.450604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eb37c-1609-423b-b267-1386233272fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:44.451238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eb37c-1609-423b-b267-1386233272fb service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:44.451514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eb37c-1609-423b-b267-1386233272fb service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:44.451785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eb37c-1609-423b-b267-1386233272fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:44.461840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eb37c-1609-423b-b267-1386233272fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:44.463462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eb37c-1609-423b-b267-1386233272fb service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:44.475107 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 600/1197] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:54.390199 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=44 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:54.469868 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=83 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:59.367322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e26fc-f67e-4941-92a5-c1e35bf02274 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:59.367966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e26fc-f67e-4941-92a5-c1e35bf02274 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:59.367966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e26fc-f67e-4941-92a5-c1e35bf02274 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:59.369296 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 598/1198] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:41:59.374616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c762-cd8c-4ece-a763-5874b5b161e9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:59.375224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c762-cd8c-4ece-a763-5874b5b161e9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:59.375224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c762-cd8c-4ece-a763-5874b5b161e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:59.438373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-92c4c762-cd8c-4ece-a763-5874b5b161e9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:59.439829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-92c4c762-cd8c-4ece-a763-5874b5b161e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:59.519064 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 601/1199] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:59.676012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e26fc-f67e-4941-92a5-c1e35bf02274 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:59.677753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-611e26fc-f67e-4941-92a5-c1e35bf02274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:59.788941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e26fc-f67e-4941-92a5-c1e35bf02274 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:59.795997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb471ff-c41f-4c15-8c1e-e6b72c17a9bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:59.796657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb471ff-c41f-4c15-8c1e-e6b72c17a9bc service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:59.796941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb471ff-c41f-4c15-8c1e-e6b72c17a9bc service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:59.797214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb471ff-c41f-4c15-8c1e-e6b72c17a9bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:59.807232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb471ff-c41f-4c15-8c1e-e6b72c17a9bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:59.808887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb471ff-c41f-4c15-8c1e-e6b72c17a9bc service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:59.820431 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 599/1200] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:42:00.971853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaca2a0-5959-4af6-a7f1-c3157e60ff5c None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:00.972431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaca2a0-5959-4af6-a7f1-c3157e60ff5c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:00.972431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaca2a0-5959-4af6-a7f1-c3157e60ff5c None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:00.973982 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 602/1201] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:42:00.980594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92842b-143e-46a6-9b1f-cb15f957c946 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:00.981125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92842b-143e-46a6-9b1f-cb15f957c946 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:00.981125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92842b-143e-46a6-9b1f-cb15f957c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:01.001805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1e92842b-143e-46a6-9b1f-cb15f957c946 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:01.003220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1e92842b-143e-46a6-9b1f-cb15f957c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:01.011869 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 600/1202] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:01.171107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaca2a0-5959-4af6-a7f1-c3157e60ff5c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:01.187627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaca2a0-5959-4af6-a7f1-c3157e60ff5c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:01.193936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbb21b-fd12-49eb-b0cc-51ce63be4cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:01.194564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb21b-fd12-49eb-b0cc-51ce63be4cf5 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:01.194851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb21b-fd12-49eb-b0cc-51ce63be4cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:01.195135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb21b-fd12-49eb-b0cc-51ce63be4cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:01.204199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbb21b-fd12-49eb-b0cc-51ce63be4cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:01.206218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbb21b-fd12-49eb-b0cc-51ce63be4cf5 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:01.217586 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 603/1203] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:05.215525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5bcd1-45be-4a94-8566-8beabf859b5b None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:05.216049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5bcd1-45be-4a94-8566-8beabf859b5b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:05.216049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5bcd1-45be-4a94-8566-8beabf859b5b None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:05.217391 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 601/1204] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:42:05.223131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defdb5-57ae-4384-8b0f-6f13a7ed7bb1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:05.223587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defdb5-57ae-4384-8b0f-6f13a7ed7bb1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:05.223692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defdb5-57ae-4384-8b0f-6f13a7ed7bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:05.244568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-55defdb5-57ae-4384-8b0f-6f13a7ed7bb1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:05.245804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-55defdb5-57ae-4384-8b0f-6f13a7ed7bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:05.254588 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 604/1205] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:05.541354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5bcd1-45be-4a94-8566-8beabf859b5b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:05.543058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0fe5bcd1-45be-4a94-8566-8beabf859b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:05.624601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5bcd1-45be-4a94-8566-8beabf859b5b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:05.629330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81371ae-5aaf-4174-bbba-58f846b5b031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:05.630151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81371ae-5aaf-4174-bbba-58f846b5b031 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:05.630474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81371ae-5aaf-4174-bbba-58f846b5b031 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:05.630818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81371ae-5aaf-4174-bbba-58f846b5b031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:05.640862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81371ae-5aaf-4174-bbba-58f846b5b031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:05.642295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81371ae-5aaf-4174-bbba-58f846b5b031 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:05.651685 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 602/1206] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:07.921991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2626eb-a1f7-43ed-801f-18b988c214f0 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:07.922732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2626eb-a1f7-43ed-801f-18b988c214f0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:07.922732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2626eb-a1f7-43ed-801f-18b988c214f0 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:07.927737 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 605/1207] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:42:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:42:07.933842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ad3a6-561c-4e64-9943-74e08e5a412f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:07.934423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ad3a6-561c-4e64-9943-74e08e5a412f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:07.934423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ad3a6-561c-4e64-9943-74e08e5a412f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:07.961250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c56ad3a6-561c-4e64-9943-74e08e5a412f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:07.962509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c56ad3a6-561c-4e64-9943-74e08e5a412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:07.971893 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 603/1208] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:08.283985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2626eb-a1f7-43ed-801f-18b988c214f0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:08.286130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4a2626eb-a1f7-43ed-801f-18b988c214f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:08.302658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2626eb-a1f7-43ed-801f-18b988c214f0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:08.307281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41af663-3d58-4e9a-b531-c32cc630bdca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:08.307927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af663-3d58-4e9a-b531-c32cc630bdca service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:08.308208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af663-3d58-4e9a-b531-c32cc630bdca service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:08.308485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af663-3d58-4e9a-b531-c32cc630bdca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:08.320311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af663-3d58-4e9a-b531-c32cc630bdca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:08.321829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af663-3d58-4e9a-b531-c32cc630bdca service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:08.333765 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 606/1209] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:17.953235 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:18.327776 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=65 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:01.222279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2e2d6-0d97-40ba-91a2-796302b82056 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:01.223180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2e2d6-0d97-40ba-91a2-796302b82056 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:01.223180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2e2d6-0d97-40ba-91a2-796302b82056 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:01.224270 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 604/1210] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:01.230705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711955-fe84-4b35-bcd8-18a2d019a66d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:01.231256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711955-fe84-4b35-bcd8-18a2d019a66d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:01.231461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711955-fe84-4b35-bcd8-18a2d019a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:01.257193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-01711955-fe84-4b35-bcd8-18a2d019a66d None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:01.259007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-01711955-fe84-4b35-bcd8-18a2d019a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:01.272382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 607/1211] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:43:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:11.249339 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:37.739558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d0c88-b483-4371-8d1a-176953549741 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:37.740484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d0c88-b483-4371-8d1a-176953549741 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:37.740675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d0c88-b483-4371-8d1a-176953549741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:37.800325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e37d0c88-b483-4371-8d1a-176953549741 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:37.802520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e37d0c88-b483-4371-8d1a-176953549741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:37.821033 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 605/1212] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:43:37.850263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a65ca-b761-4b9b-9000-0ab4689fde0f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:37.851884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a65ca-b761-4b9b-9000-0ab4689fde0f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:37.852703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a65ca-b761-4b9b-9000-0ab4689fde0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:37.910875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-939a65ca-b761-4b9b-9000-0ab4689fde0f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:37.913038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-939a65ca-b761-4b9b-9000-0ab4689fde0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:37.931798 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 608/1213] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:37.939812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d0c88-b483-4371-8d1a-176953549741 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:37.961852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d0c88-b483-4371-8d1a-176953549741 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:37.973248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a2d58-0d41-4c2a-b9c9-589f27c4048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:37.974323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2d58-0d41-4c2a-b9c9-589f27c4048a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:37.974845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2d58-0d41-4c2a-b9c9-589f27c4048a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:37.975333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2d58-0d41-4c2a-b9c9-589f27c4048a admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:37.976513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a2d58-0d41-4c2a-b9c9-589f27c4048a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:37.982233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a2d58-0d41-4c2a-b9c9-589f27c4048a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:37.984223 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-cb3a2d58-0d41-4c2a-b9c9-589f27c4048a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:43:37.984223 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:43:37.984223 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:43:37.985962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a2d58-0d41-4c2a-b9c9-589f27c4048a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:38.016149 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 606/1214] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:38.030518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a65ca-b761-4b9b-9000-0ab4689fde0f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:38.049565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a65ca-b761-4b9b-9000-0ab4689fde0f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:38.067646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73cd2c-fe9a-4f3d-b6ab-ffdeb74e321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:38.069513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73cd2c-fe9a-4f3d-b6ab-ffdeb74e321a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.070314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73cd2c-fe9a-4f3d-b6ab-ffdeb74e321a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.071086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73cd2c-fe9a-4f3d-b6ab-ffdeb74e321a admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:38.072530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73cd2c-fe9a-4f3d-b6ab-ffdeb74e321a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:38.074675 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-8a73cd2c-fe9a-4f3d-b6ab-ffdeb74e321a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:43:38.074675 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:43:38.074675 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:43:38.082262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73cd2c-fe9a-4f3d-b6ab-ffdeb74e321a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:38.147718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30997657-9147-40f0-8c58-cbe55936e318 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.148796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30997657-9147-40f0-8c58-cbe55936e318 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.149546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30997657-9147-40f0-8c58-cbe55936e318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:38.195522 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 609/1215] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:38 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:43:38.199227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-30997657-9147-40f0-8c58-cbe55936e318 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:38.200769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73cd2c-fe9a-4f3d-b6ab-ffdeb74e321a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:38.202181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-30997657-9147-40f0-8c58-cbe55936e318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:38.400838 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 607/1216] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:43:38.403201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73cd2c-fe9a-4f3d-b6ab-ffdeb74e321a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:38.436135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73a365-e2fe-45c2-bbec-311f61cb3987 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.441466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73a365-e2fe-45c2-bbec-311f61cb3987 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.442254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73a365-e2fe-45c2-bbec-311f61cb3987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:38.452191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfad9d6-b0a5-4734-9305-48b61bb3fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:38.455964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfad9d6-b0a5-4734-9305-48b61bb3fcca admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.457935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfad9d6-b0a5-4734-9305-48b61bb3fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.458741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfad9d6-b0a5-4734-9305-48b61bb3fcca admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:38.460135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfad9d6-b0a5-4734-9305-48b61bb3fcca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:38.464329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfad9d6-b0a5-4734-9305-48b61bb3fcca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:38.516986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ae73a365-e2fe-45c2-bbec-311f61cb3987 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:38.519009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae73a365-e2fe-45c2-bbec-311f61cb3987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:38.520158 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 610/1217] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:38 2022] POST /identity/v3/users => generated 290 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:38.525838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfad9d6-b0a5-4734-9305-48b61bb3fcca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:38.545364 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 608/1218] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:38.552797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfad9d6-b0a5-4734-9305-48b61bb3fcca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:38.553540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73a365-e2fe-45c2-bbec-311f61cb3987 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:38.585109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73a365-e2fe-45c2-bbec-311f61cb3987 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:38.585793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18a45e-229c-4bd6-91f3-a2b1304d588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:38.586830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18a45e-229c-4bd6-91f3-a2b1304d588f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.587333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18a45e-229c-4bd6-91f3-a2b1304d588f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.588478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18a45e-229c-4bd6-91f3-a2b1304d588f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:38.589696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18a45e-229c-4bd6-91f3-a2b1304d588f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:38.592968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18a45e-229c-4bd6-91f3-a2b1304d588f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:38.598817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa6ff2-a66e-4c3f-a68c-da4739b7f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:38.599812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa6ff2-a66e-4c3f-a68c-da4739b7f8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.600291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa6ff2-a66e-4c3f-a68c-da4739b7f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.600803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa6ff2-a66e-4c3f-a68c-da4739b7f8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:38.602021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa6ff2-a66e-4c3f-a68c-da4739b7f8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:38.602568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa6ff2-a66e-4c3f-a68c-da4739b7f8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:38.605580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa6ff2-a66e-4c3f-a68c-da4739b7f8c0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:38.626012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 611/1219] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:43:38.638389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18a45e-229c-4bd6-91f3-a2b1304d588f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:38.649608 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 609/1220] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:43:38.665893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18a45e-229c-4bd6-91f3-a2b1304d588f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:38.670469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa6ff2-a66e-4c3f-a68c-da4739b7f8c0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:38.690942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f39b2e-0104-43d3-9466-2108a7af29a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:38.692712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f39b2e-0104-43d3-9466-2108a7af29a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.693152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f39b2e-0104-43d3-9466-2108a7af29a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.693572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f39b2e-0104-43d3-9466-2108a7af29a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:38.694582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f39b2e-0104-43d3-9466-2108a7af29a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:38.697621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f39b2e-0104-43d3-9466-2108a7af29a6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:38.701661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa6ff2-a66e-4c3f-a68c-da4739b7f8c0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:38.719308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a7cbe-ba68-48aa-b43f-9bb5ed6d45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:38.720541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a7cbe-ba68-48aa-b43f-9bb5ed6d45a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.721047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a7cbe-ba68-48aa-b43f-9bb5ed6d45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.721520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a7cbe-ba68-48aa-b43f-9bb5ed6d45a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:38.728646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a7cbe-ba68-48aa-b43f-9bb5ed6d45a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:38.728646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a7cbe-ba68-48aa-b43f-9bb5ed6d45a3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:38.732014 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 612/1221] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:43:38.742178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f39b2e-0104-43d3-9466-2108a7af29a6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:38.771764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f39b2e-0104-43d3-9466-2108a7af29a6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:38.793697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430efa-cb8a-4da9-be27-4a6239c57a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:38.795548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430efa-cb8a-4da9-be27-4a6239c57a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.796042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430efa-cb8a-4da9-be27-4a6239c57a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.796549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430efa-cb8a-4da9-be27-4a6239c57a94 admin admin] PATH_INFO: `/v3/projects/c64d39f0a00b4dab9da6f0ffd2832210/users/be64be1ba172441eb0ee9a03fabb0bda/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:38.806878 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 610/1222] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:38 2022] POST /identity/v3/projects => generated 397 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:43:38.815244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a7cbe-ba68-48aa-b43f-9bb5ed6d45a3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:38.848523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430efa-cb8a-4da9-be27-4a6239c57a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64d39f0a00b4dab9da6f0ffd2832210, user_id=be64be1ba172441eb0ee9a03fabb0bda, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:38.854097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430efa-cb8a-4da9-be27-4a6239c57a94 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:38.890568 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 613/1223] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:38 2022] PUT /identity/v3/projects/c64d39f0a00b4dab9da6f0ffd2832210/users/be64be1ba172441eb0ee9a03fabb0bda/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:38.922086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adef07-ed8e-4c04-8c1f-95cc00eebfae None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:38.922491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adef07-ed8e-4c04-8c1f-95cc00eebfae None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:38.922922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adef07-ed8e-4c04-8c1f-95cc00eebfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.020772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-24adef07-ed8e-4c04-8c1f-95cc00eebfae None None] MFA Rules not processed for user `be64be1ba172441eb0ee9a03fabb0bda`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.022880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-24adef07-ed8e-4c04-8c1f-95cc00eebfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.023604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a7cbe-ba68-48aa-b43f-9bb5ed6d45a3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.196080 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:39.248022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250d493-bec6-4ad6-8e81-a0a424cced8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.249643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250d493-bec6-4ad6-8e81-a0a424cced8e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.250480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250d493-bec6-4ad6-8e81-a0a424cced8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.251272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250d493-bec6-4ad6-8e81-a0a424cced8e admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.254826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250d493-bec6-4ad6-8e81-a0a424cced8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.257396 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-f250d493-bec6-4ad6-8e81-a0a424cced8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:43:39.257396 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:43:39.257396 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:43:39.260419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250d493-bec6-4ad6-8e81-a0a424cced8e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.279039 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:39.323098 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 614/1224] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:43:39.331912 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 611/1225] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:38 2022] POST /identity/v3/users => generated 299 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:43:39.334642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf81c-5105-4da4-9443-e22963ac50d2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.334884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bd0d-ac78-41e2-b44c-a56c1b9a16b1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.335697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf81c-5105-4da4-9443-e22963ac50d2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.335880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bd0d-ac78-41e2-b44c-a56c1b9a16b1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.336257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bd0d-ac78-41e2-b44c-a56c1b9a16b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.337469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf81c-5105-4da4-9443-e22963ac50d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.384299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-16baf81c-5105-4da4-9443-e22963ac50d2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.384804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a667bd0d-ac78-41e2-b44c-a56c1b9a16b1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.386192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a667bd0d-ac78-41e2-b44c-a56c1b9a16b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.387981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-16baf81c-5105-4da4-9443-e22963ac50d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.405208 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 615/1226] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.406565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be084-4c0e-4068-b22b-8cb29b463690 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.408456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be084-4c0e-4068-b22b-8cb29b463690 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.409309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be084-4c0e-4068-b22b-8cb29b463690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.414702 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 612/1227] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.415537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baf81c-5105-4da4-9443-e22963ac50d2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.432770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baf81c-5105-4da4-9443-e22963ac50d2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.440288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab28f32-19ab-4d75-b95e-339e91a97a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.440953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab28f32-19ab-4d75-b95e-339e91a97a12 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.441242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab28f32-19ab-4d75-b95e-339e91a97a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.441639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab28f32-19ab-4d75-b95e-339e91a97a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.442166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab28f32-19ab-4d75-b95e-339e91a97a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.444112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab28f32-19ab-4d75-b95e-339e91a97a12 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.447970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a69be084-4c0e-4068-b22b-8cb29b463690 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.449864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a69be084-4c0e-4068-b22b-8cb29b463690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.462751 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 616/1228] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.462751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69be084-4c0e-4068-b22b-8cb29b463690 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.481675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69be084-4c0e-4068-b22b-8cb29b463690 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.487751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca124-8772-4d0f-b0d3-69aa4aa071ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.488464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca124-8772-4d0f-b0d3-69aa4aa071ba admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.488845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca124-8772-4d0f-b0d3-69aa4aa071ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.489263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca124-8772-4d0f-b0d3-69aa4aa071ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.489927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca124-8772-4d0f-b0d3-69aa4aa071ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.492782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca124-8772-4d0f-b0d3-69aa4aa071ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.507589 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 613/1229] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:39.509036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fdcbe-78d5-42f2-8719-e7f7703f8509 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.509333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fdcbe-78d5-42f2-8719-e7f7703f8509 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.509615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fdcbe-78d5-42f2-8719-e7f7703f8509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.512368 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 617/1230] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:39.515172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63022354-41a3-4bba-a54b-4c0a48bb244e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.515803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63022354-41a3-4bba-a54b-4c0a48bb244e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.516900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63022354-41a3-4bba-a54b-4c0a48bb244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.536374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d55fdcbe-78d5-42f2-8719-e7f7703f8509 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.537971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d55fdcbe-78d5-42f2-8719-e7f7703f8509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.543398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-63022354-41a3-4bba-a54b-4c0a48bb244e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.545217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-63022354-41a3-4bba-a54b-4c0a48bb244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.633310 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 614/1231] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.643717 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 618/1232] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.644021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7def92-5778-40d9-ba57-fa055dc67f7c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.644199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144469a-e883-424e-89bc-ef70621b0dac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.644199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144469a-e883-424e-89bc-ef70621b0dac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.644472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7def92-5778-40d9-ba57-fa055dc67f7c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.644609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144469a-e883-424e-89bc-ef70621b0dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.644741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7def92-5778-40d9-ba57-fa055dc67f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.663048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8144469a-e883-424e-89bc-ef70621b0dac None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.664312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8144469a-e883-424e-89bc-ef70621b0dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.667796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dc7def92-5778-40d9-ba57-fa055dc67f7c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.669847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc7def92-5778-40d9-ba57-fa055dc67f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.673439 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 619/1233] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.674723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204b8aa-800b-4f48-a3d9-a2ab16e29092 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.675007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204b8aa-800b-4f48-a3d9-a2ab16e29092 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.675345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204b8aa-800b-4f48-a3d9-a2ab16e29092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.689836 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 615/1234] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.691310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7def92-5778-40d9-ba57-fa055dc67f7c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.711991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7def92-5778-40d9-ba57-fa055dc67f7c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.712462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8204b8aa-800b-4f48-a3d9-a2ab16e29092 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.713806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8204b8aa-800b-4f48-a3d9-a2ab16e29092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.723959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cea1c5-3db7-43c8-88ac-4d8eeb17f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.725215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cea1c5-3db7-43c8-88ac-4d8eeb17f2fa admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.725382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 620/1235] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.725480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cea1c5-3db7-43c8-88ac-4d8eeb17f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.725962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cea1c5-3db7-43c8-88ac-4d8eeb17f2fa admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.726102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204b8aa-800b-4f48-a3d9-a2ab16e29092 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.727131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cea1c5-3db7-43c8-88ac-4d8eeb17f2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.731230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cea1c5-3db7-43c8-88ac-4d8eeb17f2fa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.736764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204b8aa-800b-4f48-a3d9-a2ab16e29092 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.741524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6e61b-d212-4d04-bbff-e758f9a5304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.742139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e61b-d212-4d04-bbff-e758f9a5304f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.742434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e61b-d212-4d04-bbff-e758f9a5304f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.742681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e61b-d212-4d04-bbff-e758f9a5304f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.743333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6e61b-d212-4d04-bbff-e758f9a5304f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.745006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6e61b-d212-4d04-bbff-e758f9a5304f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.758014 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 621/1236] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:39.759675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd927844-7e86-47ef-8f01-7e2b87e19385 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.760077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd927844-7e86-47ef-8f01-7e2b87e19385 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.760484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd927844-7e86-47ef-8f01-7e2b87e19385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.766201 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 616/1237] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/users => generated 298 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:39.767524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d4453-ecd8-41a2-b11a-91493f4b91dd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.767810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d4453-ecd8-41a2-b11a-91493f4b91dd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.768108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d4453-ecd8-41a2-b11a-91493f4b91dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.788392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bd927844-7e86-47ef-8f01-7e2b87e19385 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.790003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bd927844-7e86-47ef-8f01-7e2b87e19385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.793412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ef6d4453-ecd8-41a2-b11a-91493f4b91dd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.794869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ef6d4453-ecd8-41a2-b11a-91493f4b91dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.801234 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 622/1238] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.802757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd927844-7e86-47ef-8f01-7e2b87e19385 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.803528 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 617/1239] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.804911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8c609-fdbb-4968-97bb-df20dddb018f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.805125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8c609-fdbb-4968-97bb-df20dddb018f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.805441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8c609-fdbb-4968-97bb-df20dddb018f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.822742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd927844-7e86-47ef-8f01-7e2b87e19385 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.828759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-02b8c609-fdbb-4968-97bb-df20dddb018f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:39.830006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-02b8c609-fdbb-4968-97bb-df20dddb018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:39.830867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f8708-acfc-4a35-ba73-f1429b01d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.832052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f8708-acfc-4a35-ba73-f1429b01d50e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.832554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f8708-acfc-4a35-ba73-f1429b01d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.833084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f8708-acfc-4a35-ba73-f1429b01d50e admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.834303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f8708-acfc-4a35-ba73-f1429b01d50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:39.834858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f8708-acfc-4a35-ba73-f1429b01d50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.838033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f8708-acfc-4a35-ba73-f1429b01d50e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.843360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 618/1240] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:39.844769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8c609-fdbb-4968-97bb-df20dddb018f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.857845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8c609-fdbb-4968-97bb-df20dddb018f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.859070 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 623/1241] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:39.860866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f8708-acfc-4a35-ba73-f1429b01d50e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.871364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eaeac-0258-460b-8b9f-54dfda2dec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.872207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eaeac-0258-460b-8b9f-54dfda2dec89 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.872924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eaeac-0258-460b-8b9f-54dfda2dec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.873489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eaeac-0258-460b-8b9f-54dfda2dec89 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.874285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eaeac-0258-460b-8b9f-54dfda2dec89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:39.874460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f8708-acfc-4a35-ba73-f1429b01d50e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.874750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eaeac-0258-460b-8b9f-54dfda2dec89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.876980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eaeac-0258-460b-8b9f-54dfda2dec89 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.880352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7993914-d559-4262-8a89-fade8fbc3328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.881034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7993914-d559-4262-8a89-fade8fbc3328 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.881722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7993914-d559-4262-8a89-fade8fbc3328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.881722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7993914-d559-4262-8a89-fade8fbc3328 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.882368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7993914-d559-4262-8a89-fade8fbc3328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:39.882842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7993914-d559-4262-8a89-fade8fbc3328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.884525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7993914-d559-4262-8a89-fade8fbc3328 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.898007 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 619/1242] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:39.898007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eaeac-0258-460b-8b9f-54dfda2dec89 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.901865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 624/1243] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:39.910005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7993914-d559-4262-8a89-fade8fbc3328 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.913400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eaeac-0258-460b-8b9f-54dfda2dec89 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.919361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15fe3f-0728-42af-b471-511f3d334e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.920265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15fe3f-0728-42af-b471-511f3d334e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.920832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15fe3f-0728-42af-b471-511f3d334e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.921012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7993914-d559-4262-8a89-fade8fbc3328 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:39.921319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15fe3f-0728-42af-b471-511f3d334e20 admin admin] PATH_INFO: `/v3/projects/3bed859f9c7a4895b8808ce7f2649d6b/users/4863c5d0793842d29c6b8f7c69ecd297/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.928832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342f0e-0b6e-4937-8215-c4682e9c347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:39.929789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342f0e-0b6e-4937-8215-c4682e9c347f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.930249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342f0e-0b6e-4937-8215-c4682e9c347f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.930708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342f0e-0b6e-4937-8215-c4682e9c347f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.931904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97342f0e-0b6e-4937-8215-c4682e9c347f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.935689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97342f0e-0b6e-4937-8215-c4682e9c347f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.943690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15fe3f-0728-42af-b471-511f3d334e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bed859f9c7a4895b8808ce7f2649d6b, user_id=4863c5d0793842d29c6b8f7c69ecd297, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:39.949937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15fe3f-0728-42af-b471-511f3d334e20 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:39.957602 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 625/1244] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:39.958992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342f0e-0b6e-4937-8215-c4682e9c347f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:39.972934 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 620/1245] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:39 2022] PUT /identity/v3/projects/3bed859f9c7a4895b8808ce7f2649d6b/users/4863c5d0793842d29c6b8f7c69ecd297/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:39.974582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6f904-4058-4ece-a6be-ca7ecc3c4092 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:39.975146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6f904-4058-4ece-a6be-ca7ecc3c4092 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:39.975433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6f904-4058-4ece-a6be-ca7ecc3c4092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:39.977929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342f0e-0b6e-4937-8215-c4682e9c347f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.005899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c2c6f904-4058-4ece-a6be-ca7ecc3c4092 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:40.007179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c2c6f904-4058-4ece-a6be-ca7ecc3c4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:40.042693 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:40.082753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1001a-a0b4-44c3-9831-f4a6a49cea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.083900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1001a-a0b4-44c3-9831-f4a6a49cea5e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.084386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1001a-a0b4-44c3-9831-f4a6a49cea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.085453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1001a-a0b4-44c3-9831-f4a6a49cea5e admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.086611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1001a-a0b4-44c3-9831-f4a6a49cea5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:40.087218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1001a-a0b4-44c3-9831-f4a6a49cea5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.090364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1001a-a0b4-44c3-9831-f4a6a49cea5e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.097816 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 621/1246] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:40.099260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6f904-4058-4ece-a6be-ca7ecc3c4092 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.103544 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:40.108742 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 626/1247] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:40.111203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1001a-a0b4-44c3-9831-f4a6a49cea5e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.113999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6f904-4058-4ece-a6be-ca7ecc3c4092 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.119273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16141cfe-646c-4920-ba51-b87378b082be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.120067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16141cfe-646c-4920-ba51-b87378b082be admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.120423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16141cfe-646c-4920-ba51-b87378b082be admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.120816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16141cfe-646c-4920-ba51-b87378b082be admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.121562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16141cfe-646c-4920-ba51-b87378b082be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:40.121884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16141cfe-646c-4920-ba51-b87378b082be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.123594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16141cfe-646c-4920-ba51-b87378b082be admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.132486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1001a-a0b4-44c3-9831-f4a6a49cea5e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.138069 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 622/1248] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:40.139518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16141cfe-646c-4920-ba51-b87378b082be admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.141573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929348a-914f-488c-a88d-704198e0c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.142628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929348a-914f-488c-a88d-704198e0c831 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.143125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929348a-914f-488c-a88d-704198e0c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.143619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929348a-914f-488c-a88d-704198e0c831 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.144853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929348a-914f-488c-a88d-704198e0c831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.148763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929348a-914f-488c-a88d-704198e0c831 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.157254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16141cfe-646c-4920-ba51-b87378b082be admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.162861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807af27-e8bd-44ed-b745-ffd70c85ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.163572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807af27-e8bd-44ed-b745-ffd70c85ce31 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.163854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807af27-e8bd-44ed-b745-ffd70c85ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.164320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807af27-e8bd-44ed-b745-ffd70c85ce31 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.165013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807af27-e8bd-44ed-b745-ffd70c85ce31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.166997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807af27-e8bd-44ed-b745-ffd70c85ce31 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.200505 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 627/1249] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.201959 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 623/1250] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.202434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929348a-914f-488c-a88d-704198e0c831 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.203194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807af27-e8bd-44ed-b745-ffd70c85ce31 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.296285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807af27-e8bd-44ed-b745-ffd70c85ce31 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.305888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6187e-6613-4785-88e3-a9f1893dabcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.306940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6187e-6613-4785-88e3-a9f1893dabcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.307424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6187e-6613-4785-88e3-a9f1893dabcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.308014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6187e-6613-4785-88e3-a9f1893dabcd admin admin] PATH_INFO: `/v3/projects/ba978ee0a80d4f4db74b9340f647efd6/users/6ea7abfc3333406a9db9853bfa0f12b0/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.330098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6187e-6613-4785-88e3-a9f1893dabcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba978ee0a80d4f4db74b9340f647efd6, user_id=6ea7abfc3333406a9db9853bfa0f12b0, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.330971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929348a-914f-488c-a88d-704198e0c831 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.333188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6187e-6613-4785-88e3-a9f1893dabcd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.337463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce93aa-8420-4b98-92ee-8b1298b58826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.338338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce93aa-8420-4b98-92ee-8b1298b58826 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.338770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce93aa-8420-4b98-92ee-8b1298b58826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.339227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce93aa-8420-4b98-92ee-8b1298b58826 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.340364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce93aa-8420-4b98-92ee-8b1298b58826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.343504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce93aa-8420-4b98-92ee-8b1298b58826 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.350966 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 624/1251] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:40 2022] PUT /identity/v3/projects/ba978ee0a80d4f4db74b9340f647efd6/users/6ea7abfc3333406a9db9853bfa0f12b0/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:40.352038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05125996-8d09-4cb8-add6-3e43559207b1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.352349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05125996-8d09-4cb8-add6-3e43559207b1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.352688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05125996-8d09-4cb8-add6-3e43559207b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.387546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-05125996-8d09-4cb8-add6-3e43559207b1 None None] MFA Rules not processed for user `4863c5d0793842d29c6b8f7c69ecd297`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:40.389705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-05125996-8d09-4cb8-add6-3e43559207b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:40.390280 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 628/1252] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/projects => generated 403 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.395724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce93aa-8420-4b98-92ee-8b1298b58826 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.487992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce93aa-8420-4b98-92ee-8b1298b58826 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.496992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779bbc3-2ad2-436a-bb74-96c222d48673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.498127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779bbc3-2ad2-436a-bb74-96c222d48673 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.498612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779bbc3-2ad2-436a-bb74-96c222d48673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.499095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779bbc3-2ad2-436a-bb74-96c222d48673 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.500109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779bbc3-2ad2-436a-bb74-96c222d48673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:40.500554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779bbc3-2ad2-436a-bb74-96c222d48673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.501206 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 625/1253] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:40.502427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05125996-8d09-4cb8-add6-3e43559207b1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.507227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779bbc3-2ad2-436a-bb74-96c222d48673 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.518112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05125996-8d09-4cb8-add6-3e43559207b1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.524035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb41f9d-e73a-47fc-8445-75520605a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.524914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41f9d-e73a-47fc-8445-75520605a3dc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.525121 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 629/1254] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:40.525370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41f9d-e73a-47fc-8445-75520605a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.525739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41f9d-e73a-47fc-8445-75520605a3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.526356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779bbc3-2ad2-436a-bb74-96c222d48673 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.526569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb41f9d-e73a-47fc-8445-75520605a3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.529805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb41f9d-e73a-47fc-8445-75520605a3dc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.545292 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:40.545859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779bbc3-2ad2-436a-bb74-96c222d48673 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.553956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb29df-ee0d-43aa-ac7e-59ac9299df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.554793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb29df-ee0d-43aa-ac7e-59ac9299df6a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.555270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb29df-ee0d-43aa-ac7e-59ac9299df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.555654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb29df-ee0d-43aa-ac7e-59ac9299df6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.556581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb29df-ee0d-43aa-ac7e-59ac9299df6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.559129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb29df-ee0d-43aa-ac7e-59ac9299df6a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.581690 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 626/1255] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.581690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb41f9d-e73a-47fc-8445-75520605a3dc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.609027 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 630/1256] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.609027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb29df-ee0d-43aa-ac7e-59ac9299df6a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.652377 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:40.680264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb41f9d-e73a-47fc-8445-75520605a3dc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.686894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd779d-7b16-43d1-890d-5ddd62ed5631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.687769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd779d-7b16-43d1-890d-5ddd62ed5631 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.688156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd779d-7b16-43d1-890d-5ddd62ed5631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.688533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd779d-7b16-43d1-890d-5ddd62ed5631 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.689112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb29df-ee0d-43aa-ac7e-59ac9299df6a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.689576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd779d-7b16-43d1-890d-5ddd62ed5631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.692001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd779d-7b16-43d1-890d-5ddd62ed5631 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.694408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b92bbe-5245-4231-a25d-09e2ca6a1327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.695044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b92bbe-5245-4231-a25d-09e2ca6a1327 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.695514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b92bbe-5245-4231-a25d-09e2ca6a1327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.695795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b92bbe-5245-4231-a25d-09e2ca6a1327 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.696467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b92bbe-5245-4231-a25d-09e2ca6a1327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.698537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b92bbe-5245-4231-a25d-09e2ca6a1327 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.722232 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 627/1257] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.723111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd779d-7b16-43d1-890d-5ddd62ed5631 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.732389 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 631/1258] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.737758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b92bbe-5245-4231-a25d-09e2ca6a1327 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.737975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd779d-7b16-43d1-890d-5ddd62ed5631 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.741300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640d65-9465-413e-97bb-c6da506e61be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.742433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640d65-9465-413e-97bb-c6da506e61be admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.742947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640d65-9465-413e-97bb-c6da506e61be admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.743723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640d65-9465-413e-97bb-c6da506e61be admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.745114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37640d65-9465-413e-97bb-c6da506e61be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.749209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37640d65-9465-413e-97bb-c6da506e61be admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.750028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b92bbe-5245-4231-a25d-09e2ca6a1327 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.758522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207cfc7-5941-40dc-a5d3-e04d4205f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.759525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207cfc7-5941-40dc-a5d3-e04d4205f66e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.760081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207cfc7-5941-40dc-a5d3-e04d4205f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.760535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207cfc7-5941-40dc-a5d3-e04d4205f66e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.761735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207cfc7-5941-40dc-a5d3-e04d4205f66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.765456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207cfc7-5941-40dc-a5d3-e04d4205f66e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.767588 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 628/1259] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:40.769182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640d65-9465-413e-97bb-c6da506e61be admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.783991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640d65-9465-413e-97bb-c6da506e61be admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.790205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1bb50-74ee-40aa-ad08-ecafa74b7668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.791005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1bb50-74ee-40aa-ad08-ecafa74b7668 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.791466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1bb50-74ee-40aa-ad08-ecafa74b7668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.791935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1bb50-74ee-40aa-ad08-ecafa74b7668 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.793147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1bb50-74ee-40aa-ad08-ecafa74b7668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.796540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1bb50-74ee-40aa-ad08-ecafa74b7668 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.798344 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 632/1260] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/users => generated 302 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.799025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207cfc7-5941-40dc-a5d3-e04d4205f66e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.814972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207cfc7-5941-40dc-a5d3-e04d4205f66e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.821828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06387047-3490-4022-bfaa-3db7c94839a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.822770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06387047-3490-4022-bfaa-3db7c94839a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.823204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06387047-3490-4022-bfaa-3db7c94839a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.823674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06387047-3490-4022-bfaa-3db7c94839a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.824518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06387047-3490-4022-bfaa-3db7c94839a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.829156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06387047-3490-4022-bfaa-3db7c94839a9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:40.840205 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 629/1261] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/projects => generated 397 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.842075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1bb50-74ee-40aa-ad08-ecafa74b7668 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.875525 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 633/1262] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:40.876348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06387047-3490-4022-bfaa-3db7c94839a9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:40.940366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1bb50-74ee-40aa-ad08-ecafa74b7668 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.969246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06387047-3490-4022-bfaa-3db7c94839a9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:40.974657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51971697-8e4a-4892-9830-e86ae9650a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:40.975448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51971697-8e4a-4892-9830-e86ae9650a33 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:40.975831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51971697-8e4a-4892-9830-e86ae9650a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:40.976208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51971697-8e4a-4892-9830-e86ae9650a33 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:40.976976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51971697-8e4a-4892-9830-e86ae9650a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:40.978958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51971697-8e4a-4892-9830-e86ae9650a33 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.011693 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 634/1263] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:41.013461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51971697-8e4a-4892-9830-e86ae9650a33 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.016920 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:41.028048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51971697-8e4a-4892-9830-e86ae9650a33 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.031834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f0995-1328-4d93-a64b-84540f21a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.032752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f0995-1328-4d93-a64b-84540f21a32c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.033195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f0995-1328-4d93-a64b-84540f21a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.033676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f0995-1328-4d93-a64b-84540f21a32c admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.034140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a87b34-5d72-4cd2-a8be-0bd4ba83b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.034622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f0995-1328-4d93-a64b-84540f21a32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.034815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a87b34-5d72-4cd2-a8be-0bd4ba83b94c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.035038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a87b34-5d72-4cd2-a8be-0bd4ba83b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.035314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a87b34-5d72-4cd2-a8be-0bd4ba83b94c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.035973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a87b34-5d72-4cd2-a8be-0bd4ba83b94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.037418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f0995-1328-4d93-a64b-84540f21a32c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.037631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a87b34-5d72-4cd2-a8be-0bd4ba83b94c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.061805 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 635/1264] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.061805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a87b34-5d72-4cd2-a8be-0bd4ba83b94c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.066147 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 630/1265] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:40 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:41.069955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f0995-1328-4d93-a64b-84540f21a32c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.070393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a87b34-5d72-4cd2-a8be-0bd4ba83b94c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.076544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c931d-2716-4426-b686-1a21a5851e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.077274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c931d-2716-4426-b686-1a21a5851e28 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.077542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c931d-2716-4426-b686-1a21a5851e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.077813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c931d-2716-4426-b686-1a21a5851e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.078469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c931d-2716-4426-b686-1a21a5851e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.080131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c931d-2716-4426-b686-1a21a5851e28 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.083521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f0995-1328-4d93-a64b-84540f21a32c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.092174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d161ed-4a48-485b-8e23-a991d8301d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.093496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d161ed-4a48-485b-8e23-a991d8301d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.094122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d161ed-4a48-485b-8e23-a991d8301d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.094608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d161ed-4a48-485b-8e23-a991d8301d07 admin admin] PATH_INFO: `/v3/projects/ba978ee0a80d4f4db74b9340f647efd6/users/6ea7abfc3333406a9db9853bfa0f12b0/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.098223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d161ed-4a48-485b-8e23-a991d8301d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba978ee0a80d4f4db74b9340f647efd6, user_id=6ea7abfc3333406a9db9853bfa0f12b0, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.100515 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 636/1266] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.101552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c931d-2716-4426-b686-1a21a5851e28 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.103661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d161ed-4a48-485b-8e23-a991d8301d07 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.121895 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 631/1267] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:41 2022] PUT /identity/v3/projects/ba978ee0a80d4f4db74b9340f647efd6/users/6ea7abfc3333406a9db9853bfa0f12b0/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:41.122867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c931d-2716-4426-b686-1a21a5851e28 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.123070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d161ed-4a48-485b-8e23-a991d8301d07 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.191036 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:41.205924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed8477-c4f3-47c5-90b4-97056122ed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.206571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed8477-c4f3-47c5-90b4-97056122ed83 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.206855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed8477-c4f3-47c5-90b4-97056122ed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.207200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed8477-c4f3-47c5-90b4-97056122ed83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.207861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed8477-c4f3-47c5-90b4-97056122ed83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.209646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed8477-c4f3-47c5-90b4-97056122ed83 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.221979 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 637/1268] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.222689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed8477-c4f3-47c5-90b4-97056122ed83 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.235423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed8477-c4f3-47c5-90b4-97056122ed83 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.240390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d161ed-4a48-485b-8e23-a991d8301d07 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.242424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d0cb4-ea4c-478f-a9db-b0cac2d47dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.243373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d0cb4-ea4c-478f-a9db-b0cac2d47dbc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.243840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d0cb4-ea4c-478f-a9db-b0cac2d47dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.244306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d0cb4-ea4c-478f-a9db-b0cac2d47dbc admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.245251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d0cb4-ea4c-478f-a9db-b0cac2d47dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.248241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d0cb4-ea4c-478f-a9db-b0cac2d47dbc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.248510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d3df1-b180-401a-82ae-cf9dc67254cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.249436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d3df1-b180-401a-82ae-cf9dc67254cc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.249895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d3df1-b180-401a-82ae-cf9dc67254cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.250346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d3df1-b180-401a-82ae-cf9dc67254cc admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.251460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d3df1-b180-401a-82ae-cf9dc67254cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.255032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d3df1-b180-401a-82ae-cf9dc67254cc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.275913 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 638/1269] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:41 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:41.277123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d0cb4-ea4c-478f-a9db-b0cac2d47dbc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.290615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 632/1270] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:41 2022] POST /identity/v3/users => generated 305 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:41.290615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d3df1-b180-401a-82ae-cf9dc67254cc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.291002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d0cb4-ea4c-478f-a9db-b0cac2d47dbc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.299810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda5ce-4a59-433e-80a8-83ad1437b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.300522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d3df1-b180-401a-82ae-cf9dc67254cc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.300886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda5ce-4a59-433e-80a8-83ad1437b72e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.301365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda5ce-4a59-433e-80a8-83ad1437b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.301823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda5ce-4a59-433e-80a8-83ad1437b72e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.302980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda5ce-4a59-433e-80a8-83ad1437b72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.306126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda5ce-4a59-433e-80a8-83ad1437b72e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.306642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167847e-466d-4b90-9eca-6eda244e4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.307375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167847e-466d-4b90-9eca-6eda244e4ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.307756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167847e-466d-4b90-9eca-6eda244e4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.308117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167847e-466d-4b90-9eca-6eda244e4ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.309064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167847e-466d-4b90-9eca-6eda244e4ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.312005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167847e-466d-4b90-9eca-6eda244e4ab2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.327853 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 639/1271] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.327853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda5ce-4a59-433e-80a8-83ad1437b72e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.328347 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 633/1272] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.329855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167847e-466d-4b90-9eca-6eda244e4ab2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.342599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167847e-466d-4b90-9eca-6eda244e4ab2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.343867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda5ce-4a59-433e-80a8-83ad1437b72e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.348288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61eae0-4f45-4ad0-8cd2-2141f6d7913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.348986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61eae0-4f45-4ad0-8cd2-2141f6d7913f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.349286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61eae0-4f45-4ad0-8cd2-2141f6d7913f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.349569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61eae0-4f45-4ad0-8cd2-2141f6d7913f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.350063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d13cb-113b-4df6-9a62-a13c2bc07298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.350257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61eae0-4f45-4ad0-8cd2-2141f6d7913f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.350911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d13cb-113b-4df6-9a62-a13c2bc07298 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.351348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d13cb-113b-4df6-9a62-a13c2bc07298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.351760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d13cb-113b-4df6-9a62-a13c2bc07298 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.351936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61eae0-4f45-4ad0-8cd2-2141f6d7913f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.352727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d13cb-113b-4df6-9a62-a13c2bc07298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.355508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d13cb-113b-4df6-9a62-a13c2bc07298 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.367000 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 634/1273] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.368439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2228e15-c319-4ca6-b22c-583eb5980d61 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.368845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2228e15-c319-4ca6-b22c-583eb5980d61 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.369124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2228e15-c319-4ca6-b22c-583eb5980d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.372706 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 640/1274] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.376800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d13cb-113b-4df6-9a62-a13c2bc07298 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.389963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d13cb-113b-4df6-9a62-a13c2bc07298 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.397133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e508-d1eb-4dfb-bbeb-75d12ee9e7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.397822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e508-d1eb-4dfb-bbeb-75d12ee9e7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.398098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e508-d1eb-4dfb-bbeb-75d12ee9e7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.398376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e508-d1eb-4dfb-bbeb-75d12ee9e7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.399037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711e508-d1eb-4dfb-bbeb-75d12ee9e7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.400743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711e508-d1eb-4dfb-bbeb-75d12ee9e7f2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.405573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c2228e15-c319-4ca6-b22c-583eb5980d61 None None] MFA Rules not processed for user `6ea7abfc3333406a9db9853bfa0f12b0`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:41.406888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c2228e15-c319-4ca6-b22c-583eb5980d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:41.414690 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 641/1275] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.415602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e508-d1eb-4dfb-bbeb-75d12ee9e7f2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.426631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e508-d1eb-4dfb-bbeb-75d12ee9e7f2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.431949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b97a8-f148-4baa-b65a-4c2c9513c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.432589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b97a8-f148-4baa-b65a-4c2c9513c3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.433669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b97a8-f148-4baa-b65a-4c2c9513c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.433669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b97a8-f148-4baa-b65a-4c2c9513c3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.434029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b97a8-f148-4baa-b65a-4c2c9513c3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.436836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b97a8-f148-4baa-b65a-4c2c9513c3e5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.449244 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 642/1276] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.450150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b97a8-f148-4baa-b65a-4c2c9513c3e5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.462439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b97a8-f148-4baa-b65a-4c2c9513c3e5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.468929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbadf75-a7ef-4a13-99f0-366477d06a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.469588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbadf75-a7ef-4a13-99f0-366477d06a1f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.469869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbadf75-a7ef-4a13-99f0-366477d06a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.470142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbadf75-a7ef-4a13-99f0-366477d06a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.470795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbadf75-a7ef-4a13-99f0-366477d06a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.472445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbadf75-a7ef-4a13-99f0-366477d06a1f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.485015 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 643/1277] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.486083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbadf75-a7ef-4a13-99f0-366477d06a1f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.498868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbadf75-a7ef-4a13-99f0-366477d06a1f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.506937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad183cf-6299-450c-b0be-32c7d80152a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.508242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad183cf-6299-450c-b0be-32c7d80152a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.508774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad183cf-6299-450c-b0be-32c7d80152a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.509234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad183cf-6299-450c-b0be-32c7d80152a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.510402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad183cf-6299-450c-b0be-32c7d80152a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.513631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad183cf-6299-450c-b0be-32c7d80152a6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.520781 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 635/1278] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:41.521650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2228e15-c319-4ca6-b22c-583eb5980d61 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.534211 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 644/1279] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.535556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad183cf-6299-450c-b0be-32c7d80152a6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.536262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2228e15-c319-4ca6-b22c-583eb5980d61 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.541787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a5e0c-bd8b-49ca-a0e9-e5bf35e79ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.542477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5e0c-bd8b-49ca-a0e9-e5bf35e79ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.542755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5e0c-bd8b-49ca-a0e9-e5bf35e79ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.543028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5e0c-bd8b-49ca-a0e9-e5bf35e79ca9 admin admin] PATH_INFO: `/v3/projects/4461d9ea56f143b2aacb15c8ddedf787/users/e8c1300b14424311ac7e83954ad14858/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.549919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad183cf-6299-450c-b0be-32c7d80152a6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.558079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a577e7-57f4-4c97-8d97-2355db7b5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.558079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a577e7-57f4-4c97-8d97-2355db7b5e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.558302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a577e7-57f4-4c97-8d97-2355db7b5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.558846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a577e7-57f4-4c97-8d97-2355db7b5e91 admin admin] PATH_INFO: `/v3/projects/55009aa838d444e1a971a90513161a2c/users/0c46540ac3d74e7db424c2cd597e4000/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.567018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a5e0c-bd8b-49ca-a0e9-e5bf35e79ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4461d9ea56f143b2aacb15c8ddedf787, user_id=e8c1300b14424311ac7e83954ad14858, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.569964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a5e0c-bd8b-49ca-a0e9-e5bf35e79ca9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.579844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a577e7-57f4-4c97-8d97-2355db7b5e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55009aa838d444e1a971a90513161a2c, user_id=0c46540ac3d74e7db424c2cd597e4000, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.583098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a577e7-57f4-4c97-8d97-2355db7b5e91 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.584163 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:41.593590 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 636/1280] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:41 2022] PUT /identity/v3/projects/4461d9ea56f143b2aacb15c8ddedf787/users/e8c1300b14424311ac7e83954ad14858/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:41.596048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a5e0c-bd8b-49ca-a0e9-e5bf35e79ca9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.611702 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 645/1281] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:41 2022] PUT /identity/v3/projects/55009aa838d444e1a971a90513161a2c/users/0c46540ac3d74e7db424c2cd597e4000/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:41.618277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a577e7-57f4-4c97-8d97-2355db7b5e91 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.683805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a5e0c-bd8b-49ca-a0e9-e5bf35e79ca9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.714393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a577e7-57f4-4c97-8d97-2355db7b5e91 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.722784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b11a9-6498-4d05-ba27-737632424421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.723899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b11a9-6498-4d05-ba27-737632424421 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.724410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b11a9-6498-4d05-ba27-737632424421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.724923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b11a9-6498-4d05-ba27-737632424421 admin admin] PATH_INFO: `/v3/projects/6be4ac47d8094dd2854afeadbfae9c96/users/729379ca02904136b0d5c96d6b28c490/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.752793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b11a9-6498-4d05-ba27-737632424421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be4ac47d8094dd2854afeadbfae9c96, user_id=729379ca02904136b0d5c96d6b28c490, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.755935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b11a9-6498-4d05-ba27-737632424421 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.757312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257719b8-e9b4-474c-848f-f38908f271de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.758165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257719b8-e9b4-474c-848f-f38908f271de admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.758456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257719b8-e9b4-474c-848f-f38908f271de admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.758760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257719b8-e9b4-474c-848f-f38908f271de admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.759437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257719b8-e9b4-474c-848f-f38908f271de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.761218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257719b8-e9b4-474c-848f-f38908f271de admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.774071 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 646/1282] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:41 2022] PUT /identity/v3/projects/6be4ac47d8094dd2854afeadbfae9c96/users/729379ca02904136b0d5c96d6b28c490/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:41.779718 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 637/1283] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.779718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257719b8-e9b4-474c-848f-f38908f271de admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.780150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b11a9-6498-4d05-ba27-737632424421 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.790505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257719b8-e9b4-474c-848f-f38908f271de admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.817628 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:41.877558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b11a9-6498-4d05-ba27-737632424421 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.884597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632d551-3e3d-46c6-85a3-0694de17aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.885439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632d551-3e3d-46c6-85a3-0694de17aab3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.885846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632d551-3e3d-46c6-85a3-0694de17aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.886357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632d551-3e3d-46c6-85a3-0694de17aab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.886937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632d551-3e3d-46c6-85a3-0694de17aab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.889503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632d551-3e3d-46c6-85a3-0694de17aab3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.889681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c310631-62d0-4548-98a3-66c9231fbf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.890991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c310631-62d0-4548-98a3-66c9231fbf46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.891456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c310631-62d0-4548-98a3-66c9231fbf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.891940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c310631-62d0-4548-98a3-66c9231fbf46 admin admin] PATH_INFO: `/v3/projects/ed8ecf3ae5ca4ed7a3ca096de9d927d7/users/d1ce97805d904c8f8f29b996ef4ce0a4/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.903273 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 647/1284] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:41.905273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632d551-3e3d-46c6-85a3-0694de17aab3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:41.913398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c310631-62d0-4548-98a3-66c9231fbf46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8ecf3ae5ca4ed7a3ca096de9d927d7, user_id=d1ce97805d904c8f8f29b996ef4ce0a4, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.918101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c310631-62d0-4548-98a3-66c9231fbf46 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.923710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632d551-3e3d-46c6-85a3-0694de17aab3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:41.930717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414f478-8581-44ed-956d-9554796191fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:41.932091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414f478-8581-44ed-956d-9554796191fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.932536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414f478-8581-44ed-956d-9554796191fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.933039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414f478-8581-44ed-956d-9554796191fe admin admin] PATH_INFO: `/v3/projects/395b44d7ce3c46ebb445d5c1950ab251/users/2205b0097ec442e49f83d7893aea1628/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.941237 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 638/1285] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:41 2022] PUT /identity/v3/projects/ed8ecf3ae5ca4ed7a3ca096de9d927d7/users/d1ce97805d904c8f8f29b996ef4ce0a4/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:41.943673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98477578-0e6b-49c5-b6dd-06f123abc1e1 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.944169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98477578-0e6b-49c5-b6dd-06f123abc1e1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.944689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98477578-0e6b-49c5-b6dd-06f123abc1e1 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.947462 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 639/1286] 10.222.0.27 () {54 vars in 961 bytes} [Wed Oct 19 00:43:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:41.949744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee252e9-a2a4-414c-ad59-93736e778c45 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.950772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee252e9-a2a4-414c-ad59-93736e778c45 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.951431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee252e9-a2a4-414c-ad59-93736e778c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.960188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414f478-8581-44ed-956d-9554796191fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=395b44d7ce3c46ebb445d5c1950ab251, user_id=2205b0097ec442e49f83d7893aea1628, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:41.964528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414f478-8581-44ed-956d-9554796191fe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:41.985794 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 648/1287] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:41 2022] PUT /identity/v3/projects/395b44d7ce3c46ebb445d5c1950ab251/users/2205b0097ec442e49f83d7893aea1628/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:41.987366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01b877-1074-4f0e-91a9-9cab1c120318 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:41.987765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01b877-1074-4f0e-91a9-9cab1c120318 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:41.988144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01b877-1074-4f0e-91a9-9cab1c120318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:41.995646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4ee252e9-a2a4-414c-ad59-93736e778c45 None None] MFA Rules not processed for user `e8c1300b14424311ac7e83954ad14858`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:41.998088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4ee252e9-a2a4-414c-ad59-93736e778c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:42.021286 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:42.029946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ce01b877-1074-4f0e-91a9-9cab1c120318 None None] MFA Rules not processed for user `0c46540ac3d74e7db424c2cd597e4000`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:42.031223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ce01b877-1074-4f0e-91a9-9cab1c120318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:42.112358 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 640/1288] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:42.113278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee252e9-a2a4-414c-ad59-93736e778c45 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:42.125778 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 649/1289] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:42.129593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a9985-0710-412e-84ce-313daf87b06f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.129593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a9985-0710-412e-84ce-313daf87b06f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.129593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a9985-0710-412e-84ce-313daf87b06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.152518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ef2a9985-0710-412e-84ce-313daf87b06f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:42.154111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ef2a9985-0710-412e-84ce-313daf87b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:42.191875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee252e9-a2a4-414c-ad59-93736e778c45 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:42.196873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff64c-bebf-4bc6-af39-4c82c1171ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:42.197559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff64c-bebf-4bc6-af39-4c82c1171ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.197842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff64c-bebf-4bc6-af39-4c82c1171ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.198117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff64c-bebf-4bc6-af39-4c82c1171ff0 admin admin] PATH_INFO: `/v3/projects/1a82b77e707e4b04ab3baf915f5944a3/users/72837586ca9441e1838dda376463ccd7/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.218103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eff64c-bebf-4bc6-af39-4c82c1171ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a82b77e707e4b04ab3baf915f5944a3, user_id=72837586ca9441e1838dda376463ccd7, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:42.221332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eff64c-bebf-4bc6-af39-4c82c1171ff0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:42.224515 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 650/1290] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:42.225413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a9985-0710-412e-84ce-313daf87b06f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:42.237138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a9985-0710-412e-84ce-313daf87b06f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:42.240228 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 641/1291] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:42 2022] PUT /identity/v3/projects/1a82b77e707e4b04ab3baf915f5944a3/users/72837586ca9441e1838dda376463ccd7/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:42.241143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff64c-bebf-4bc6-af39-4c82c1171ff0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:42.263351 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:42.308155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0f7ff-50fb-40ce-bdd6-5052488a6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:42.308873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0f7ff-50fb-40ce-bdd6-5052488a6842 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.309156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0f7ff-50fb-40ce-bdd6-5052488a6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.310015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0f7ff-50fb-40ce-bdd6-5052488a6842 admin admin] PATH_INFO: `/v3/projects/0f53450c0ede48c3bb7ff6c52697c593/users/0e8e8ac53a4e405fa6723cac11b3b5fd/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.325231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff64c-bebf-4bc6-af39-4c82c1171ff0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:42.329088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0f7ff-50fb-40ce-bdd6-5052488a6842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f53450c0ede48c3bb7ff6c52697c593, user_id=0e8e8ac53a4e405fa6723cac11b3b5fd, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:42.330821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f2814-625e-4b15-85c2-c1734b767dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:42.331499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f2814-625e-4b15-85c2-c1734b767dae admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.331761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f2814-625e-4b15-85c2-c1734b767dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.332066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f2814-625e-4b15-85c2-c1734b767dae admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.332725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f2814-625e-4b15-85c2-c1734b767dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:42.332900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0f7ff-50fb-40ce-bdd6-5052488a6842 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:42.334360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f2814-625e-4b15-85c2-c1734b767dae admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:42.347142 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 642/1292] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:42.348472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52072639-a71f-4618-b3ca-2f9fa83b7a2d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.348815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52072639-a71f-4618-b3ca-2f9fa83b7a2d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.349066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52072639-a71f-4618-b3ca-2f9fa83b7a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.353327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 651/1293] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:42 2022] PUT /identity/v3/projects/0f53450c0ede48c3bb7ff6c52697c593/users/0e8e8ac53a4e405fa6723cac11b3b5fd/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:42.354743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a322d-9f5e-4a00-a230-812c6a4480dc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.355088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a322d-9f5e-4a00-a230-812c6a4480dc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.355458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a322d-9f5e-4a00-a230-812c6a4480dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.390157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-872a322d-9f5e-4a00-a230-812c6a4480dc None None] MFA Rules not processed for user `2205b0097ec442e49f83d7893aea1628`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:42.391884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-872a322d-9f5e-4a00-a230-812c6a4480dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:42.399612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-52072639-a71f-4618-b3ca-2f9fa83b7a2d None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:42.400949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-52072639-a71f-4618-b3ca-2f9fa83b7a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:42.419423 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:42.488726 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 652/1294] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:42.489403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a322d-9f5e-4a00-a230-812c6a4480dc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:42.503393 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 643/1295] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:42.505618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52072639-a71f-4618-b3ca-2f9fa83b7a2d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:42.588772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52072639-a71f-4618-b3ca-2f9fa83b7a2d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:42.594526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c0fd7-8802-4c73-b873-637bbd77c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:42.595286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0fd7-8802-4c73-b873-637bbd77c0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.595436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0fd7-8802-4c73-b873-637bbd77c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.595607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0fd7-8802-4c73-b873-637bbd77c0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.596260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c0fd7-8802-4c73-b873-637bbd77c0b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:42.598362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c0fd7-8802-4c73-b873-637bbd77c0b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:42.600224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a322d-9f5e-4a00-a230-812c6a4480dc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:42.609172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c0018-a9c6-49e5-a58e-adcc6d7cc6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:42.610237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c0018-a9c6-49e5-a58e-adcc6d7cc6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.610734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c0018-a9c6-49e5-a58e-adcc6d7cc6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.611224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c0018-a9c6-49e5-a58e-adcc6d7cc6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.612378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c0018-a9c6-49e5-a58e-adcc6d7cc6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:42.616217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c0018-a9c6-49e5-a58e-adcc6d7cc6c1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:42.628392 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 644/1296] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:42 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:42.629424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c0fd7-8802-4c73-b873-637bbd77c0b5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:42.659357 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 653/1297] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:42 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:42.661616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd45ae-ed40-435a-bd69-03c0ad8027eb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.662093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd45ae-ed40-435a-bd69-03c0ad8027eb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.662570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd45ae-ed40-435a-bd69-03c0ad8027eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.697520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-31fd45ae-ed40-435a-bd69-03c0ad8027eb None None] MFA Rules not processed for user `72837586ca9441e1838dda376463ccd7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:42.699125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-31fd45ae-ed40-435a-bd69-03c0ad8027eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:42.711631 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:42.736384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c0fd7-8802-4c73-b873-637bbd77c0b5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:42.804061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf810f-0a7b-4d97-9cc4-00a47014dea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:42.804894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf810f-0a7b-4d97-9cc4-00a47014dea8 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.805280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf810f-0a7b-4d97-9cc4-00a47014dea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.805655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf810f-0a7b-4d97-9cc4-00a47014dea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.814276 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:42.821733 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 654/1298] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:42.822936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd45ae-ed40-435a-bd69-03c0ad8027eb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:42.898234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf810f-0a7b-4d97-9cc4-00a47014dea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:42.899730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf810f-0a7b-4d97-9cc4-00a47014dea8 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:42.911659 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 645/1299] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:42.912928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e29c0-30bd-468c-b7e3-3dddb9ce2f85 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.913262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e29c0-30bd-468c-b7e3-3dddb9ce2f85 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.913543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e29c0-30bd-468c-b7e3-3dddb9ce2f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.934941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd45ae-ed40-435a-bd69-03c0ad8027eb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:42.944944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d0cea-7a87-4c93-942e-040a30751dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:42.945943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d0cea-7a87-4c93-942e-040a30751dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:42.946413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d0cea-7a87-4c93-942e-040a30751dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:42.946853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d0cea-7a87-4c93-942e-040a30751dc2 admin admin] PATH_INFO: `/v3/projects/ed8ecf3ae5ca4ed7a3ca096de9d927d7/users/d1ce97805d904c8f8f29b996ef4ce0a4/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:42.949263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-db6e29c0-30bd-468c-b7e3-3dddb9ce2f85 None None] MFA Rules not processed for user `0e8e8ac53a4e405fa6723cac11b3b5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:42.949974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d0cea-7a87-4c93-942e-040a30751dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8ecf3ae5ca4ed7a3ca096de9d927d7, user_id=d1ce97805d904c8f8f29b996ef4ce0a4, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:42.950855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db6e29c0-30bd-468c-b7e3-3dddb9ce2f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:42.956548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d0cea-7a87-4c93-942e-040a30751dc2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:42.976512 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 655/1300] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:42 2022] PUT /identity/v3/projects/ed8ecf3ae5ca4ed7a3ca096de9d927d7/users/d1ce97805d904c8f8f29b996ef4ce0a4/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:42.977504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d0cea-7a87-4c93-942e-040a30751dc2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:43.079899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d0cea-7a87-4c93-942e-040a30751dc2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:43.090086 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 646/1301] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:43.091088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96d3cc-6b77-4786-a96c-14f62cebe5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:43.091775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e29c0-30bd-468c-b7e3-3dddb9ce2f85 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:43.092657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96d3cc-6b77-4786-a96c-14f62cebe5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:43.093367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96d3cc-6b77-4786-a96c-14f62cebe5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:43.094167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96d3cc-6b77-4786-a96c-14f62cebe5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:43.095468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96d3cc-6b77-4786-a96c-14f62cebe5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:43.099915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96d3cc-6b77-4786-a96c-14f62cebe5a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:43.144140 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 656/1302] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:42 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:43.145791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96d3cc-6b77-4786-a96c-14f62cebe5a8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:43.204281 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.259114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96d3cc-6b77-4786-a96c-14f62cebe5a8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:43.261876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e29c0-30bd-468c-b7e3-3dddb9ce2f85 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:43.269607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7da7d3-1b06-4a25-b823-fd45d6a13d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:43.271422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7da7d3-1b06-4a25-b823-fd45d6a13d85 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:43.272753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7da7d3-1b06-4a25-b823-fd45d6a13d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:43.273553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7da7d3-1b06-4a25-b823-fd45d6a13d85 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:43.274777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7da7d3-1b06-4a25-b823-fd45d6a13d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:43.279736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7da7d3-1b06-4a25-b823-fd45d6a13d85 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:43.323055 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.326556 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 657/1303] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:43 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:43.328021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7da7d3-1b06-4a25-b823-fd45d6a13d85 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:43.349130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7da7d3-1b06-4a25-b823-fd45d6a13d85 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:43.359194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fda99-401f-4103-b8ac-f0551867ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:43.360278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fda99-401f-4103-b8ac-f0551867ba8d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:43.360858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fda99-401f-4103-b8ac-f0551867ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:43.361385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fda99-401f-4103-b8ac-f0551867ba8d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:43.362689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fda99-401f-4103-b8ac-f0551867ba8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:43.366885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fda99-401f-4103-b8ac-f0551867ba8d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:43.408969 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 658/1304] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:43 2022] POST /identity/v3/users => generated 297 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:43.411042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fda99-401f-4103-b8ac-f0551867ba8d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:43.414995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28f297-559d-41f2-bfea-b264fb878c24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:43.416093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28f297-559d-41f2-bfea-b264fb878c24 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:43.416727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28f297-559d-41f2-bfea-b264fb878c24 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:43.417265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28f297-559d-41f2-bfea-b264fb878c24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:43.436120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fda99-401f-4103-b8ac-f0551867ba8d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:43.444800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196446e-63fd-41b7-bdb0-1b73af436d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:43.446052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196446e-63fd-41b7-bdb0-1b73af436d53 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:43.446672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196446e-63fd-41b7-bdb0-1b73af436d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:43.447205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196446e-63fd-41b7-bdb0-1b73af436d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:43.448361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196446e-63fd-41b7-bdb0-1b73af436d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:43.453386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196446e-63fd-41b7-bdb0-1b73af436d53 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:43.523895 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 659/1305] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:43 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:43.523895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ae85-1e91-4e8d-855a-33d8921fa5dc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:43.523895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ae85-1e91-4e8d-855a-33d8921fa5dc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:43.523895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ae85-1e91-4e8d-855a-33d8921fa5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:43.556541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-01e6ae85-1e91-4e8d-855a-33d8921fa5dc None None] MFA Rules not processed for user `d1ce97805d904c8f8f29b996ef4ce0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:43.557928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-01e6ae85-1e91-4e8d-855a-33d8921fa5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:43.579638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28f297-559d-41f2-bfea-b264fb878c24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:43.581657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28f297-559d-41f2-bfea-b264fb878c24 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:43.596892 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 647/1306] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:43.597852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28f297-559d-41f2-bfea-b264fb878c24 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:43.614589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28f297-559d-41f2-bfea-b264fb878c24 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:43.723071 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 660/1307] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:43 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:43.723071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ae85-1e91-4e8d-855a-33d8921fa5dc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:43.764251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f548ed-a0df-41c8-b3e7-7777c05ad14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:43.765624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f548ed-a0df-41c8-b3e7-7777c05ad14f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:43.766170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f548ed-a0df-41c8-b3e7-7777c05ad14f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:43.766915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f548ed-a0df-41c8-b3e7-7777c05ad14f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:43.768118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f548ed-a0df-41c8-b3e7-7777c05ad14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:43.786023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f548ed-a0df-41c8-b3e7-7777c05ad14f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:43.850537 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 648/1308] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:43 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:43.854567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f548ed-a0df-41c8-b3e7-7777c05ad14f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:43.872787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ae85-1e91-4e8d-855a-33d8921fa5dc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:43.884762 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.951809 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.977613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f548ed-a0df-41c8-b3e7-7777c05ad14f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:43.981469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183f2f-ce3c-48dd-903e-e8c16d3b7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:43.983002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183f2f-ce3c-48dd-903e-e8c16d3b7581 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:43.983748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183f2f-ce3c-48dd-903e-e8c16d3b7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:43.983958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37979e-616e-4f16-a3fe-d830f36344e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:43.984596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183f2f-ce3c-48dd-903e-e8c16d3b7581 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:43.984803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37979e-616e-4f16-a3fe-d830f36344e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:43.985157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37979e-616e-4f16-a3fe-d830f36344e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:43.985394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37979e-616e-4f16-a3fe-d830f36344e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:43.986105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37979e-616e-4f16-a3fe-d830f36344e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:43.986841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3183f2f-ce3c-48dd-903e-e8c16d3b7581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:43.988415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37979e-616e-4f16-a3fe-d830f36344e3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:43.990632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3183f2f-ce3c-48dd-903e-e8c16d3b7581 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.003156 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 649/1309] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:44.003767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37979e-616e-4f16-a3fe-d830f36344e3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.020414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37979e-616e-4f16-a3fe-d830f36344e3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.027077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1bfb-b6fc-4fe5-ba3b-634cdfc1017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.029493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1bfb-b6fc-4fe5-ba3b-634cdfc1017e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.029493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1bfb-b6fc-4fe5-ba3b-634cdfc1017e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.029878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1bfb-b6fc-4fe5-ba3b-634cdfc1017e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.030748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f1bfb-b6fc-4fe5-ba3b-634cdfc1017e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.032679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f1bfb-b6fc-4fe5-ba3b-634cdfc1017e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.048652 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 661/1310] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:43 2022] POST /identity/v3/users => generated 296 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:44.050656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183f2f-ce3c-48dd-903e-e8c16d3b7581 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.053143 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 650/1311] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:44.054657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8965-5294-4494-aaa6-e5435ccc628f None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.054949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8965-5294-4494-aaa6-e5435ccc628f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.055225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8965-5294-4494-aaa6-e5435ccc628f None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.056637 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 651/1312] 10.222.0.27 () {54 vars in 961 bytes} [Wed Oct 19 00:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:44.057545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8965-5294-4494-aaa6-e5435ccc628f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.074738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8965-5294-4494-aaa6-e5435ccc628f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.084513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c42119-75d4-457c-b198-228d052fc63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.085670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c42119-75d4-457c-b198-228d052fc63a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.086152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c42119-75d4-457c-b198-228d052fc63a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.086629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c42119-75d4-457c-b198-228d052fc63a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.087311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c42119-75d4-457c-b198-228d052fc63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.090262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c42119-75d4-457c-b198-228d052fc63a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.111070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183f2f-ce3c-48dd-903e-e8c16d3b7581 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.125741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48eac-7f1c-4130-a59d-101002ec8dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.127074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48eac-7f1c-4130-a59d-101002ec8dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.127627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48eac-7f1c-4130-a59d-101002ec8dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.128223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48eac-7f1c-4130-a59d-101002ec8dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.130063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd48eac-7f1c-4130-a59d-101002ec8dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.133811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd48eac-7f1c-4130-a59d-101002ec8dc6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.143990 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 652/1313] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:44 2022] POST /identity/v3/users => generated 295 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:44.143990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c42119-75d4-457c-b198-228d052fc63a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.172696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c42119-75d4-457c-b198-228d052fc63a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.178483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb328c-74a1-4ef3-b9a4-4c779e908d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.179181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb328c-74a1-4ef3-b9a4-4c779e908d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.180157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb328c-74a1-4ef3-b9a4-4c779e908d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.180455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb328c-74a1-4ef3-b9a4-4c779e908d34 admin admin] PATH_INFO: `/v3/projects/025775c2606c44459ce94c205b43c088/users/713439c274d84eb4b3ae022a34c78031/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.182172 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 662/1314] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:44 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:44.183667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48eac-7f1c-4130-a59d-101002ec8dc6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.203597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48eac-7f1c-4130-a59d-101002ec8dc6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.208194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb328c-74a1-4ef3-b9a4-4c779e908d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025775c2606c44459ce94c205b43c088, user_id=713439c274d84eb4b3ae022a34c78031, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.211143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb328c-74a1-4ef3-b9a4-4c779e908d34 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.212328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be801048-de35-4350-a564-8067c8a28ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.213350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801048-de35-4350-a564-8067c8a28ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.214067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801048-de35-4350-a564-8067c8a28ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.214546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801048-de35-4350-a564-8067c8a28ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.215733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be801048-de35-4350-a564-8067c8a28ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.219696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be801048-de35-4350-a564-8067c8a28ad8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.232034 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 653/1315] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:44 2022] PUT /identity/v3/projects/025775c2606c44459ce94c205b43c088/users/713439c274d84eb4b3ae022a34c78031/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:44.233661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb328c-74a1-4ef3-b9a4-4c779e908d34 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.252655 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 663/1316] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:44.254948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c89d77-8dc7-4a5d-a0c0-8ec5190a2577 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.255279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c89d77-8dc7-4a5d-a0c0-8ec5190a2577 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.255577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c89d77-8dc7-4a5d-a0c0-8ec5190a2577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.309926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b9c89d77-8dc7-4a5d-a0c0-8ec5190a2577 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:44.313875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b9c89d77-8dc7-4a5d-a0c0-8ec5190a2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:44.356079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb328c-74a1-4ef3-b9a4-4c779e908d34 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.365389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38086b-284d-4def-beff-0f19d24a1b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.368592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38086b-284d-4def-beff-0f19d24a1b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.368592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38086b-284d-4def-beff-0f19d24a1b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.368968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38086b-284d-4def-beff-0f19d24a1b29 admin admin] PATH_INFO: `/v3/projects/8a6f93bf3f2642689f852abc7a092972/users/0959e609632a487084307195a0b910c6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.427790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38086b-284d-4def-beff-0f19d24a1b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6f93bf3f2642689f852abc7a092972, user_id=0959e609632a487084307195a0b910c6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.434961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38086b-284d-4def-beff-0f19d24a1b29 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.473941 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 654/1317] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:44 2022] PUT /identity/v3/projects/8a6f93bf3f2642689f852abc7a092972/users/0959e609632a487084307195a0b910c6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:44.475637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38086b-284d-4def-beff-0f19d24a1b29 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.489962 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 664/1318] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 00:43:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:44.491265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c89d77-8dc7-4a5d-a0c0-8ec5190a2577 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.507997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c89d77-8dc7-4a5d-a0c0-8ec5190a2577 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.623921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddd5ca-f918-4e23-b81b-a801db2a0188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.624574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddd5ca-f918-4e23-b81b-a801db2a0188 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.624894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddd5ca-f918-4e23-b81b-a801db2a0188 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.625173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddd5ca-f918-4e23-b81b-a801db2a0188 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.626098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddd5ca-f918-4e23-b81b-a801db2a0188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.629142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddd5ca-f918-4e23-b81b-a801db2a0188 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.643766 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 665/1319] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:44.644747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddd5ca-f918-4e23-b81b-a801db2a0188 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.652384 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:44.659743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddd5ca-f918-4e23-b81b-a801db2a0188 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.667293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7917c-6fa1-4721-9ede-603fc053c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.669393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7917c-6fa1-4721-9ede-603fc053c05d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.670009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7917c-6fa1-4721-9ede-603fc053c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.670760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7917c-6fa1-4721-9ede-603fc053c05d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.671529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7917c-6fa1-4721-9ede-603fc053c05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.674638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7917c-6fa1-4721-9ede-603fc053c05d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.675609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38086b-284d-4def-beff-0f19d24a1b29 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.686605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bf6e5-b9b9-497e-b16e-d716a9bac676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.687305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bf6e5-b9b9-497e-b16e-d716a9bac676 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.687783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bf6e5-b9b9-497e-b16e-d716a9bac676 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.688070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bf6e5-b9b9-497e-b16e-d716a9bac676 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.690270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bf6e5-b9b9-497e-b16e-d716a9bac676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.693084 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 666/1320] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:44.693264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bf6e5-b9b9-497e-b16e-d716a9bac676 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.694173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7917c-6fa1-4721-9ede-603fc053c05d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.708898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7917c-6fa1-4721-9ede-603fc053c05d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.714978 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 655/1321] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:44.717486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458581d9-4d8f-425f-9f3b-31883f915ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.718385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458581d9-4d8f-425f-9f3b-31883f915ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.719232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458581d9-4d8f-425f-9f3b-31883f915ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.719662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458581d9-4d8f-425f-9f3b-31883f915ffe admin admin] PATH_INFO: `/v3/projects/2b6e859acb154890891a94f2ec836a33/users/275efecb0c9749f9b58b565a117b3756/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.720187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bf6e5-b9b9-497e-b16e-d716a9bac676 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.740865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458581d9-4d8f-425f-9f3b-31883f915ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6e859acb154890891a94f2ec836a33, user_id=275efecb0c9749f9b58b565a117b3756, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.743747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bf6e5-b9b9-497e-b16e-d716a9bac676 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.744821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458581d9-4d8f-425f-9f3b-31883f915ffe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.753000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76274fba-6245-48d1-9e94-d292a720d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.754284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274fba-6245-48d1-9e94-d292a720d76e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.754562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274fba-6245-48d1-9e94-d292a720d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.755268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274fba-6245-48d1-9e94-d292a720d76e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.755776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76274fba-6245-48d1-9e94-d292a720d76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.757787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76274fba-6245-48d1-9e94-d292a720d76e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.765270 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:44.775332 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 656/1322] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:44.776639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76274fba-6245-48d1-9e94-d292a720d76e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.779017 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 667/1323] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:44 2022] PUT /identity/v3/projects/2b6e859acb154890891a94f2ec836a33/users/275efecb0c9749f9b58b565a117b3756/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:44.780606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458581d9-4d8f-425f-9f3b-31883f915ffe admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:44.886005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458581d9-4d8f-425f-9f3b-31883f915ffe admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.891658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a981d5-fda4-4383-8fab-6a8381e82648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:44.892366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a981d5-fda4-4383-8fab-6a8381e82648 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.892995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a981d5-fda4-4383-8fab-6a8381e82648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.892995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a981d5-fda4-4383-8fab-6a8381e82648 admin admin] PATH_INFO: `/v3/projects/f48362632fd543e9864d69bf8a4da9fd/users/7ad33cd7dc1b43518ed3be02b6a5cf2d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.910168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76274fba-6245-48d1-9e94-d292a720d76e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:44.916675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a981d5-fda4-4383-8fab-6a8381e82648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48362632fd543e9864d69bf8a4da9fd, user_id=7ad33cd7dc1b43518ed3be02b6a5cf2d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:44.919577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a981d5-fda4-4383-8fab-6a8381e82648 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:44.944075 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 668/1324] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:44 2022] PUT /identity/v3/projects/f48362632fd543e9864d69bf8a4da9fd/users/7ad33cd7dc1b43518ed3be02b6a5cf2d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:44.944075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bf01-3fba-417f-8aef-0fac59590b37 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:44.944075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bf01-3fba-417f-8aef-0fac59590b37 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:44.944075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35bf01-3fba-417f-8aef-0fac59590b37 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:44.946038 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 669/1325] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:44.947215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35bf01-3fba-417f-8aef-0fac59590b37 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:45.027028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c2a95-fa3e-49bb-a779-83e0b70c71a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:45.028172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c2a95-fa3e-49bb-a779-83e0b70c71a7 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.028649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c2a95-fa3e-49bb-a779-83e0b70c71a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.029384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c2a95-fa3e-49bb-a779-83e0b70c71a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.048724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35bf01-3fba-417f-8aef-0fac59590b37 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:45.063829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec1d14-cbf8-4baf-a641-bbbd58413618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:45.065176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec1d14-cbf8-4baf-a641-bbbd58413618 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.065478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec1d14-cbf8-4baf-a641-bbbd58413618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.065881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec1d14-cbf8-4baf-a641-bbbd58413618 admin admin] PATH_INFO: `/v3/projects/025775c2606c44459ce94c205b43c088/users/713439c274d84eb4b3ae022a34c78031/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.070894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec1d14-cbf8-4baf-a641-bbbd58413618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025775c2606c44459ce94c205b43c088, user_id=713439c274d84eb4b3ae022a34c78031, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:45.073769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec1d14-cbf8-4baf-a641-bbbd58413618 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:45.105384 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 670/1326] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:44 2022] PUT /identity/v3/projects/025775c2606c44459ce94c205b43c088/users/713439c274d84eb4b3ae022a34c78031/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:45.112493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec1d14-cbf8-4baf-a641-bbbd58413618 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:45.211093 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:45.238481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c2a95-fa3e-49bb-a779-83e0b70c71a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:45.241822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c2a95-fa3e-49bb-a779-83e0b70c71a7 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:45.255642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec1d14-cbf8-4baf-a641-bbbd58413618 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:45.265099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953e870-02d4-4350-989c-d85f1e0d6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:45.266455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953e870-02d4-4350-989c-d85f1e0d6db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.266818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953e870-02d4-4350-989c-d85f1e0d6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.267074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953e870-02d4-4350-989c-d85f1e0d6db8 admin admin] PATH_INFO: `/v3/projects/968d3df8f1c34832a9e73decb53e6a57/users/1ee8bcf0218e42d189a5fac064f3bb45/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.275267 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 657/1327] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:44 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:45.289841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c2a95-fa3e-49bb-a779-83e0b70c71a7 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:45.306196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953e870-02d4-4350-989c-d85f1e0d6db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968d3df8f1c34832a9e73decb53e6a57, user_id=1ee8bcf0218e42d189a5fac064f3bb45, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:45.313066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953e870-02d4-4350-989c-d85f1e0d6db8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:45.320575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c2a95-fa3e-49bb-a779-83e0b70c71a7 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:45.337097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5368-4140-4bf1-88d6-b262fa571030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:45.342208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5368-4140-4bf1-88d6-b262fa571030 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.342431 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 671/1328] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:45 2022] PUT /identity/v3/projects/968d3df8f1c34832a9e73decb53e6a57/users/1ee8bcf0218e42d189a5fac064f3bb45/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:45.342524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5368-4140-4bf1-88d6-b262fa571030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.342524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5368-4140-4bf1-88d6-b262fa571030 admin admin] PATH_INFO: `/v3/projects/8a6f93bf3f2642689f852abc7a092972/users/0959e609632a487084307195a0b910c6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.343969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953e870-02d4-4350-989c-d85f1e0d6db8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:45.347417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f5368-4140-4bf1-88d6-b262fa571030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6f93bf3f2642689f852abc7a092972, user_id=0959e609632a487084307195a0b910c6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:45.350456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f5368-4140-4bf1-88d6-b262fa571030 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:45.372886 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 658/1329] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:45 2022] PUT /identity/v3/projects/8a6f93bf3f2642689f852abc7a092972/users/0959e609632a487084307195a0b910c6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:45.372886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5368-4140-4bf1-88d6-b262fa571030 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:45.404636 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:45.498491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5368-4140-4bf1-88d6-b262fa571030 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:45.515403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb9576-7dbe-4035-9251-b67606f24e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:45.516410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb9576-7dbe-4035-9251-b67606f24e55 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.517003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb9576-7dbe-4035-9251-b67606f24e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.517547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb9576-7dbe-4035-9251-b67606f24e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.518732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb9576-7dbe-4035-9251-b67606f24e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:45.522043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb9576-7dbe-4035-9251-b67606f24e55 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:45.547465 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 659/1330] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:45.550135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586303d-8c4d-46df-b61f-aed88b6fd3bc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.550833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586303d-8c4d-46df-b61f-aed88b6fd3bc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.551217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586303d-8c4d-46df-b61f-aed88b6fd3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.557044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953e870-02d4-4350-989c-d85f1e0d6db8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:45.571251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25dcbc-480d-4a84-8671-590b0781ab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:45.572198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25dcbc-480d-4a84-8671-590b0781ab90 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.572573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25dcbc-480d-4a84-8671-590b0781ab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.573030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25dcbc-480d-4a84-8671-590b0781ab90 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.574172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25dcbc-480d-4a84-8671-590b0781ab90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:45.579338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25dcbc-480d-4a84-8671-590b0781ab90 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:45.594187 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 672/1331] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:45.595889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090b104-a7c5-4b9f-813f-bf55cda35309 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.596281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090b104-a7c5-4b9f-813f-bf55cda35309 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.596968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090b104-a7c5-4b9f-813f-bf55cda35309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.606045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0586303d-8c4d-46df-b61f-aed88b6fd3bc None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:45.609024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0586303d-8c4d-46df-b61f-aed88b6fd3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:45.650146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9090b104-a7c5-4b9f-813f-bf55cda35309 None None] MFA Rules not processed for user `713439c274d84eb4b3ae022a34c78031`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:45.651684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9090b104-a7c5-4b9f-813f-bf55cda35309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:45.829650 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 660/1332] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:43:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:45.835906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586303d-8c4d-46df-b61f-aed88b6fd3bc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:45.855798 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 673/1333] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:45.858136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d90fd9-f6e9-43a6-a6a9-0d5a40000204 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.858663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d90fd9-f6e9-43a6-a6a9-0d5a40000204 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.859187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d90fd9-f6e9-43a6-a6a9-0d5a40000204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.877995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586303d-8c4d-46df-b61f-aed88b6fd3bc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:45.895078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfb965-bf4a-4ecf-b264-a4609f6e1a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:45.896094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfb965-bf4a-4ecf-b264-a4609f6e1a89 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.896551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfb965-bf4a-4ecf-b264-a4609f6e1a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.897070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfb965-bf4a-4ecf-b264-a4609f6e1a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.898163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfb965-bf4a-4ecf-b264-a4609f6e1a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:45.901567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfb965-bf4a-4ecf-b264-a4609f6e1a89 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:45.907626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d5d90fd9-f6e9-43a6-a6a9-0d5a40000204 None None] MFA Rules not processed for user `0959e609632a487084307195a0b910c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:45.939299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d5d90fd9-f6e9-43a6-a6a9-0d5a40000204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:45.939675 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 661/1334] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:45.939675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfb965-bf4a-4ecf-b264-a4609f6e1a89 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:45.954875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfb965-bf4a-4ecf-b264-a4609f6e1a89 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:45.961476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a326d-185c-4475-823d-12c4d536e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:45.962194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a326d-185c-4475-823d-12c4d536e939 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:45.962474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a326d-185c-4475-823d-12c4d536e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:45.962750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a326d-185c-4475-823d-12c4d536e939 admin admin] PATH_INFO: `/v3/projects/f48362632fd543e9864d69bf8a4da9fd/users/7ad33cd7dc1b43518ed3be02b6a5cf2d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:45.965064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a326d-185c-4475-823d-12c4d536e939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48362632fd543e9864d69bf8a4da9fd, user_id=7ad33cd7dc1b43518ed3be02b6a5cf2d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:45.970160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a326d-185c-4475-823d-12c4d536e939 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:45.997689 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 662/1335] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:45 2022] PUT /identity/v3/projects/f48362632fd543e9864d69bf8a4da9fd/users/7ad33cd7dc1b43518ed3be02b6a5cf2d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:45.998728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a326d-185c-4475-823d-12c4d536e939 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:46.034842 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:46.096654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a326d-185c-4475-823d-12c4d536e939 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:46.103447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b8c3-195b-4027-a70c-40a4ffcdec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:46.104154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b8c3-195b-4027-a70c-40a4ffcdec8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.104441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b8c3-195b-4027-a70c-40a4ffcdec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.104860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b8c3-195b-4027-a70c-40a4ffcdec8c admin admin] PATH_INFO: `/v3/projects/2b6e859acb154890891a94f2ec836a33/users/275efecb0c9749f9b58b565a117b3756/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.107319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621b8c3-195b-4027-a70c-40a4ffcdec8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6e859acb154890891a94f2ec836a33, user_id=275efecb0c9749f9b58b565a117b3756, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:46.108850 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 674/1336] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:46.110615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621b8c3-195b-4027-a70c-40a4ffcdec8c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:46.111508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d90fd9-f6e9-43a6-a6a9-0d5a40000204 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:46.125731 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 663/1337] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:45 2022] PUT /identity/v3/projects/2b6e859acb154890891a94f2ec836a33/users/275efecb0c9749f9b58b565a117b3756/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:46.126837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b8c3-195b-4027-a70c-40a4ffcdec8c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:46.136922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d90fd9-f6e9-43a6-a6a9-0d5a40000204 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:46.173862 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:46.241599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b8c3-195b-4027-a70c-40a4ffcdec8c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:46.251818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8472-96f0-478f-9bb9-b91aaff76aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:46.254185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8472-96f0-478f-9bb9-b91aaff76aa6 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.254185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8472-96f0-478f-9bb9-b91aaff76aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.254185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8472-96f0-478f-9bb9-b91aaff76aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.259033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096577c-b076-46b7-a4d1-7af15b15c415 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:46.259778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096577c-b076-46b7-a4d1-7af15b15c415 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.260135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096577c-b076-46b7-a4d1-7af15b15c415 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.260484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096577c-b076-46b7-a4d1-7af15b15c415 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.271856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096577c-b076-46b7-a4d1-7af15b15c415 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:46.274113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096577c-b076-46b7-a4d1-7af15b15c415 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:46.286197 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 675/1338] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:46.287171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096577c-b076-46b7-a4d1-7af15b15c415 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:46.353927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8472-96f0-478f-9bb9-b91aaff76aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:46.356976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8472-96f0-478f-9bb9-b91aaff76aa6 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:46.370274 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 664/1339] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:46.386550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096577c-b076-46b7-a4d1-7af15b15c415 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:46.387340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088d25b-a3a8-4432-95f7-d2bda79ca0d1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.388128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088d25b-a3a8-4432-95f7-d2bda79ca0d1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.388586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088d25b-a3a8-4432-95f7-d2bda79ca0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.393914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ed7f0-c114-42cc-b032-463daa90c420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:46.394983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ed7f0-c114-42cc-b032-463daa90c420 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.395270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ed7f0-c114-42cc-b032-463daa90c420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.396180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ed7f0-c114-42cc-b032-463daa90c420 admin admin] PATH_INFO: `/v3/projects/968d3df8f1c34832a9e73decb53e6a57/users/1ee8bcf0218e42d189a5fac064f3bb45/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.399396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ed7f0-c114-42cc-b032-463daa90c420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968d3df8f1c34832a9e73decb53e6a57, user_id=1ee8bcf0218e42d189a5fac064f3bb45, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:46.403369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ed7f0-c114-42cc-b032-463daa90c420 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:46.423600 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 676/1340] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:46 2022] PUT /identity/v3/projects/968d3df8f1c34832a9e73decb53e6a57/users/1ee8bcf0218e42d189a5fac064f3bb45/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:46.425358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd58fe-39ce-4d11-b1ef-e9535332cc6c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.425920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd58fe-39ce-4d11-b1ef-e9535332cc6c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.426440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd58fe-39ce-4d11-b1ef-e9535332cc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.467171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f088d25b-a3a8-4432-95f7-d2bda79ca0d1 None None] MFA Rules not processed for user `7ad33cd7dc1b43518ed3be02b6a5cf2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:46.468582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f088d25b-a3a8-4432-95f7-d2bda79ca0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:46.509438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-94fd58fe-39ce-4d11-b1ef-e9535332cc6c None None] MFA Rules not processed for user `275efecb0c9749f9b58b565a117b3756`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:46.511074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-94fd58fe-39ce-4d11-b1ef-e9535332cc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:46.621106 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 665/1341] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:46.621106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d35c1f-a25e-42d1-b721-0360e0ec2e40 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.621106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d35c1f-a25e-42d1-b721-0360e0ec2e40 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.621106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d35c1f-a25e-42d1-b721-0360e0ec2e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.636960 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:46.661116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f7d35c1f-a25e-42d1-b721-0360e0ec2e40 None None] MFA Rules not processed for user `1ee8bcf0218e42d189a5fac064f3bb45`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:46.662504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f7d35c1f-a25e-42d1-b721-0360e0ec2e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:46.702575 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 677/1342] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:46.703497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd58fe-39ce-4d11-b1ef-e9535332cc6c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:46.706177 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:46.783078 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 666/1343] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:46.784584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e9c45-eec3-4451-b2f6-04d4d354747d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.784973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e9c45-eec3-4451-b2f6-04d4d354747d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.785255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e9c45-eec3-4451-b2f6-04d4d354747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.819329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f47e9c45-eec3-4451-b2f6-04d4d354747d None None] MFA Rules not processed for user `be64be1ba172441eb0ee9a03fabb0bda`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:46.820884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f47e9c45-eec3-4451-b2f6-04d4d354747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:46.831837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd58fe-39ce-4d11-b1ef-e9535332cc6c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:46.839056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f6766-c980-41d4-9c54-66cb85542d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:46.839708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f6766-c980-41d4-9c54-66cb85542d39 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.839991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f6766-c980-41d4-9c54-66cb85542d39 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.840263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f6766-c980-41d4-9c54-66cb85542d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.970555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f6766-c980-41d4-9c54-66cb85542d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:46.972701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f6766-c980-41d4-9c54-66cb85542d39 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:46.988140 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 678/1344] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:46.989872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f57f32-f792-4ac4-b2e7-f3f648b1b9c0 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:46.990240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f57f32-f792-4ac4-b2e7-f3f648b1b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:46.990589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f57f32-f792-4ac4-b2e7-f3f648b1b9c0 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:46.992463 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 679/1345] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:46.993029 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 667/1346] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:47.000934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f57f32-f792-4ac4-b2e7-f3f648b1b9c0 None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:43:47.027325 n-d-master-1 devstack@keystone.service[86424]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-f3f57f32-f792-4ac4-b2e7-f3f648b1b9c0 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 19 00:43:47.027325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f57f32-f792-4ac4-b2e7-f3f648b1b9c0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:47.154013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e9c45-eec3-4451-b2f6-04d4d354747d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:47.155790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f57f32-f792-4ac4-b2e7-f3f648b1b9c0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:47.162228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4138d-d80d-42c7-8fb8-e1bca8559de0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713439c274d84eb4b3ae022a34c78031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '025775c2606c44459ce94c205b43c088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:47.162905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4138d-d80d-42c7-8fb8-e1bca8559de0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:47.163194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4138d-d80d-42c7-8fb8-e1bca8559de0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:47.163473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4138d-d80d-42c7-8fb8-e1bca8559de0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] PATH_INFO: `/v3/projects/55009aa838d444e1a971a90513161a2c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:47.165673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4138d-d80d-42c7-8fb8-e1bca8559de0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] RBAC: Authorizing `identity:get_project(project_id=55009aa838d444e1a971a90513161a2c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:47.172527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4138d-d80d-42c7-8fb8-e1bca8559de0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:47.177830 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 680/1347] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:43:46 2022] GET /identity/v3/projects/55009aa838d444e1a971a90513161a2c => generated 379 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:47.188202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e9c45-eec3-4451-b2f6-04d4d354747d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:47.219076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7c1c-0cd5-4137-bc13-08b5ccfed300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:47.220140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7c1c-0cd5-4137-bc13-08b5ccfed300 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:47.220607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7c1c-0cd5-4137-bc13-08b5ccfed300 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:47.221208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7c1c-0cd5-4137-bc13-08b5ccfed300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:47.274468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7c1c-0cd5-4137-bc13-08b5ccfed300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:47.283773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7c1c-0cd5-4137-bc13-08b5ccfed300 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:47.335071 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 668/1348] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:43:47.360187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4138d-d80d-42c7-8fb8-e1bca8559de0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:47.386917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4138d-d80d-42c7-8fb8-e1bca8559de0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:47.394356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7c1c-0cd5-4137-bc13-08b5ccfed300 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:47.405914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11517506-86f1-4dd3-9e17-5bd813e2a1ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:47.407117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11517506-86f1-4dd3-9e17-5bd813e2a1ac service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:47.408083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11517506-86f1-4dd3-9e17-5bd813e2a1ac service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:47.408374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11517506-86f1-4dd3-9e17-5bd813e2a1ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:47.418103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7c1c-0cd5-4137-bc13-08b5ccfed300 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:47.426045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c0111-ab32-458d-8a78-f730b2969241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:47.427768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c0111-ab32-458d-8a78-f730b2969241 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:47.428544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c0111-ab32-458d-8a78-f730b2969241 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:47.429127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c0111-ab32-458d-8a78-f730b2969241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:47.430541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11517506-86f1-4dd3-9e17-5bd813e2a1ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:47.432262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11517506-86f1-4dd3-9e17-5bd813e2a1ac service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:47.442967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c0111-ab32-458d-8a78-f730b2969241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:47.445100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c0111-ab32-458d-8a78-f730b2969241 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:47.448787 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:47.467325 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 681/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:47.489252 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 669/1350] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:47.549941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11517506-86f1-4dd3-9e17-5bd813e2a1ac service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:47.577447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11517506-86f1-4dd3-9e17-5bd813e2a1ac service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:47.589140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632254b8-e596-44cb-a2b0-11ebfab51717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:47.590209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632254b8-e596-44cb-a2b0-11ebfab51717 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:47.591613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632254b8-e596-44cb-a2b0-11ebfab51717 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:47.592506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632254b8-e596-44cb-a2b0-11ebfab51717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:47.625464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632254b8-e596-44cb-a2b0-11ebfab51717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:47.629144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632254b8-e596-44cb-a2b0-11ebfab51717 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:47.671399 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 682/1351] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:47.819710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034612-45b4-470e-a83a-b6039bd1b443 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:47.820185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034612-45b4-470e-a83a-b6039bd1b443 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:47.820768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034612-45b4-470e-a83a-b6039bd1b443 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:47.823684 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 670/1352] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:43:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:47.856733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb0468-bbd2-4e09-9761-68ee5de5340b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:47.856733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb0468-bbd2-4e09-9761-68ee5de5340b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:47.856733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb0468-bbd2-4e09-9761-68ee5de5340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:47.879501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034612-45b4-470e-a83a-b6039bd1b443 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:47.879976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-66eb0468-bbd2-4e09-9761-68ee5de5340b None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:47.881561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-66eb0468-bbd2-4e09-9761-68ee5de5340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:47.909986 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 683/1353] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:43:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:43:47.910592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034612-45b4-470e-a83a-b6039bd1b443 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:47.910998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb0468-bbd2-4e09-9761-68ee5de5340b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:47.912688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-66eb0468-bbd2-4e09-9761-68ee5de5340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:47.924307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99316af8-fe55-4c72-a666-85e78addff49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:47.925839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316af8-fe55-4c72-a666-85e78addff49 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:47.928057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316af8-fe55-4c72-a666-85e78addff49 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:47.934154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316af8-fe55-4c72-a666-85e78addff49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:48.065183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb0468-bbd2-4e09-9761-68ee5de5340b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:48.070379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4bbe6-ced4-4793-b080-7b664e9fb98b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:48.071434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4bbe6-ced4-4793-b080-7b664e9fb98b service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:48.071907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4bbe6-ced4-4793-b080-7b664e9fb98b service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:48.072532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4bbe6-ced4-4793-b080-7b664e9fb98b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:48.091792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4bbe6-ced4-4793-b080-7b664e9fb98b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:48.096587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4bbe6-ced4-4793-b080-7b664e9fb98b service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:48.109373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99316af8-fe55-4c72-a666-85e78addff49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:48.114939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99316af8-fe55-4c72-a666-85e78addff49 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:48.134795 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 684/1354] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:48.149950 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 671/1355] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:43:48.496269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4bbe6-ced4-4793-b080-7b664e9fb98b service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:48.854768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4bbe6-ced4-4793-b080-7b664e9fb98b service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:48.889533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:48.891009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:48.891680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:48.893231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] PATH_INFO: `/v3/users/72837586ca9441e1838dda376463ccd7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:48.896009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72837586ca9441e1838dda376463ccd7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:48.899902 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:43:48.899902 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:43:48.899902 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:43:48.902881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:48.929432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132823-f604-41ec-9c8f-3c68a0f9d4e6 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:48.930723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132823-f604-41ec-9c8f-3c68a0f9d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:48.931382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132823-f604-41ec-9c8f-3c68a0f9d4e6 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:48.936597 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 672/1356] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:43:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:48.944909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132823-f604-41ec-9c8f-3c68a0f9d4e6 None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:43:49.049700 n-d-master-1 devstack@keystone.service[86425]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-25132823-f604-41ec-9c8f-3c68a0f9d4e6 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 19 00:43:49.049700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132823-f604-41ec-9c8f-3c68a0f9d4e6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:49.077161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132823-f604-41ec-9c8f-3c68a0f9d4e6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:49.100952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b6c38-0c2d-4ff6-95e9-9d73687017db tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713439c274d84eb4b3ae022a34c78031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '025775c2606c44459ce94c205b43c088', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:49.102199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b6c38-0c2d-4ff6-95e9-9d73687017db tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:49.103601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b6c38-0c2d-4ff6-95e9-9d73687017db tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:49.107087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b6c38-0c2d-4ff6-95e9-9d73687017db tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] PATH_INFO: `/v3/projects/55009aa838d444e1a971a90513161a2c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:49.110616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b6c38-0c2d-4ff6-95e9-9d73687017db tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] RBAC: Authorizing `identity:get_project(project_id=55009aa838d444e1a971a90513161a2c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:49.118991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b6c38-0c2d-4ff6-95e9-9d73687017db tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:49.133756 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 673/1357] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:43:48 2022] GET /identity/v3/projects/55009aa838d444e1a971a90513161a2c => generated 379 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:49.250310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72837586ca9441e1838dda376463ccd7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:49.350312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72837586ca9441e1838dda376463ccd7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:49.354391 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:49.376923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72837586ca9441e1838dda376463ccd7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:49.421059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72837586ca9441e1838dda376463ccd7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:49.423685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72837586ca9441e1838dda376463ccd7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:49.457120 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 685/1358] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:43:48 2022] DELETE /identity/v3/users/72837586ca9441e1838dda376463ccd7 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:43:49.466755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb3d5-988a-42a5-a52e-8a3923eb8ba0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:49.467705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb3d5-988a-42a5-a52e-8a3923eb8ba0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:49.468638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb3d5-988a-42a5-a52e-8a3923eb8ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:49.531918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-569cb3d5-988a-42a5-a52e-8a3923eb8ba0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:49.533313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-569cb3d5-988a-42a5-a52e-8a3923eb8ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:49.648959 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:49.751935 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 674/1359] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:49.761812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:49.763977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:49.989718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cb3d5-988a-42a5-a52e-8a3923eb8ba0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:49.997762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-569cb3d5-988a-42a5-a52e-8a3923eb8ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:50.016599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f2dc7-1ce3-4667-9826-5d9fe517705e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:50.030867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b3e7-3403-488c-ab3d-8956fc31d300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:50.032352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b3e7-3403-488c-ab3d-8956fc31d300 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:50.032352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b3e7-3403-488c-ab3d-8956fc31d300 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:50.032673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b3e7-3403-488c-ab3d-8956fc31d300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:50.073126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b3e7-3403-488c-ab3d-8956fc31d300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:50.075297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5b3e7-3403-488c-ab3d-8956fc31d300 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:50.123854 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 686/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:43:50.227299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cb3d5-988a-42a5-a52e-8a3923eb8ba0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:50.234002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:50.234643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:50.234913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:50.235457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:50.237539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:50.252231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:50.268665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:50.288065 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 675/1361] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:43:50.634618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b3e7-3403-488c-ab3d-8956fc31d300 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:50.636036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-54d5b3e7-3403-488c-ab3d-8956fc31d300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:50.646098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:50.647275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:50.678064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b3e7-3403-488c-ab3d-8956fc31d300 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:50.695494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da03b8d-77e1-477d-8ca0-8b8bdf621c89 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:50.709558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:50.712192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:50.718011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:50.719091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] PATH_INFO: `/v3/users/0c46540ac3d74e7db424c2cd597e4000` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:50.721622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:50.723286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c46540ac3d74e7db424c2cd597e4000)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:50.723805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:50.728896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:50.729434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:50.729886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] PATH_INFO: `/v3/users/e8c1300b14424311ac7e83954ad14858` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:50.731680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c1300b14424311ac7e83954ad14858)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:50.740389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:50.854830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c46540ac3d74e7db424c2cd597e4000'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:50.864034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c1300b14424311ac7e83954ad14858'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:50.912061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c46540ac3d74e7db424c2cd597e4000'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:50.921807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c1300b14424311ac7e83954ad14858'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:50.940250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c46540ac3d74e7db424c2cd597e4000'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:50.950536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c1300b14424311ac7e83954ad14858'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:50.980747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c46540ac3d74e7db424c2cd597e4000'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:50.984892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c46540ac3d74e7db424c2cd597e4000'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:50.989008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c1300b14424311ac7e83954ad14858'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:50.995302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40a184bb-b8ae-4496-b253-172b1357ac9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c1300b14424311ac7e83954ad14858'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:51.006498 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 687/1362] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:43:50 2022] DELETE /identity/v3/users/0c46540ac3d74e7db424c2cd597e4000 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:51.008466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:51.014662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:51.015901 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 676/1363] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:43:50 2022] DELETE /identity/v3/users/e8c1300b14424311ac7e83954ad14858 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:51.018960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7306d5a-3db7-4983-8de1-c84dc6b25af4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:51.021048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7306d5a-3db7-4983-8de1-c84dc6b25af4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:51.022499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7306d5a-3db7-4983-8de1-c84dc6b25af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:51.096376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e7306d5a-3db7-4983-8de1-c84dc6b25af4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:51.116473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e7306d5a-3db7-4983-8de1-c84dc6b25af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:51.205491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c160057-febc-4ec1-97b8-ad930f50612b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:51.210688 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:51.329247 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:51.472212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:51.472689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:51.472981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:51.473257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] PATH_INFO: `/v3/projects/1a82b77e707e4b04ab3baf915f5944a3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:51.474466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a82b77e707e4b04ab3baf915f5944a3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:51.477108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:51.493483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 677/1364] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:51.493483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4516-4a68-4186-b1f3-e67d2d7e2083 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:51.493483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4516-4a68-4186-b1f3-e67d2d7e2083 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:51.500716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4516-4a68-4186-b1f3-e67d2d7e2083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:51.569658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3dcc4516-4a68-4186-b1f3-e67d2d7e2083 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:51.572482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3dcc4516-4a68-4186-b1f3-e67d2d7e2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:51.603515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a82b77e707e4b04ab3baf915f5944a3', 'request_id': 'req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:51.624146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a82b77e707e4b04ab3baf915f5944a3', 'request_id': 'req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:51.635359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a82b77e707e4b04ab3baf915f5944a3', 'request_id': 'req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:51.690092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] The token cache is being invalidate because project 1a82b77e707e4b04ab3baf915f5944a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:43:51.690750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:51.691690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:51.700760 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 688/1365] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:43:51 2022] DELETE /identity/v3/projects/1a82b77e707e4b04ab3baf915f5944a3 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:51.702214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:51.704212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:51.859942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d43d06-4a9d-43db-9c8a-1e971b43a0a6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:51.876587 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 678/1366] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:51.880230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4516-4a68-4186-b1f3-e67d2d7e2083 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:51.881633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:51.882918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:51.883213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3dcc4516-4a68-4186-b1f3-e67d2d7e2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:51.883624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:51.884140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:51.886852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:51.964539 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:52.021224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:52.023093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:52.029888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4516-4a68-4186-b1f3-e67d2d7e2083 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:52.037974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:52.039943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:52.040821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:52.041299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:52.042710 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 689/1367] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:52.045122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:52.051082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:52.061555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:52.081415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e445-ddc3-418e-8414-84811d5bf803 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:52.089823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:52.093479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:52.113031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:52.113031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:52.113031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:52.113031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] PATH_INFO: `/v3/users/7ad33cd7dc1b43518ed3be02b6a5cf2d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:52.113751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad33cd7dc1b43518ed3be02b6a5cf2d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:52.113751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:52.129416 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 679/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:52.134078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:52.138413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:52.177807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92b6c9-94b4-42ad-8c9e-fe4dc53151fc service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:52.192199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49ca7d-d60b-44b0-9194-744bc0f939cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:52.195763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49ca7d-d60b-44b0-9194-744bc0f939cb service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:52.196474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad33cd7dc1b43518ed3be02b6a5cf2d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:52.197276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49ca7d-d60b-44b0-9194-744bc0f939cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:52.199467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49ca7d-d60b-44b0-9194-744bc0f939cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:52.215828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad33cd7dc1b43518ed3be02b6a5cf2d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:52.227072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad33cd7dc1b43518ed3be02b6a5cf2d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:52.241437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49ca7d-d60b-44b0-9194-744bc0f939cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:52.246204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad33cd7dc1b43518ed3be02b6a5cf2d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:52.248160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d1420cbd-89d9-47a3-8ea1-9be9ee6ada56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad33cd7dc1b43518ed3be02b6a5cf2d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:52.249637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49ca7d-d60b-44b0-9194-744bc0f939cb service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:52.260903 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 690/1369] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:43:52 2022] DELETE /identity/v3/users/7ad33cd7dc1b43518ed3be02b6a5cf2d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:52.260903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a805558-6b08-40e8-a34c-87022158b333 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:52.260903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a805558-6b08-40e8-a34c-87022158b333 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:52.260903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a805558-6b08-40e8-a34c-87022158b333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:52.311305 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 680/1370] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:52.346084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6a805558-6b08-40e8-a34c-87022158b333 None None] MFA Rules not processed for user `729379ca02904136b0d5c96d6b28c490`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:52.347333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6a805558-6b08-40e8-a34c-87022158b333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:52.535273 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 691/1371] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:52.538932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49ca7d-d60b-44b0-9194-744bc0f939cb service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:52.541596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de49ca7d-d60b-44b0-9194-744bc0f939cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:52.584092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49ca7d-d60b-44b0-9194-744bc0f939cb service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:52.717540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a805558-6b08-40e8-a34c-87022158b333 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:52.717540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6a805558-6b08-40e8-a34c-87022158b333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:52.804291 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:52.834918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96a63-236c-4dc2-82e9-2f21b7b60298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:52.838499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96a63-236c-4dc2-82e9-2f21b7b60298 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:52.838930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96a63-236c-4dc2-82e9-2f21b7b60298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:52.839225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96a63-236c-4dc2-82e9-2f21b7b60298 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:52.839955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc96a63-236c-4dc2-82e9-2f21b7b60298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:52.870607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc96a63-236c-4dc2-82e9-2f21b7b60298 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:52.922088 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:52.936100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a805558-6b08-40e8-a34c-87022158b333 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:52.966457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:52.967362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:52.967648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:52.968413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] PATH_INFO: `/v3/projects/55009aa838d444e1a971a90513161a2c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:52.976696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=55009aa838d444e1a971a90513161a2c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:52.978791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:53.023148 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 681/1372] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:52 2022] POST /identity/v3/projects => generated 403 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:53.026333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96a63-236c-4dc2-82e9-2f21b7b60298 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:53.039355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1dc96a63-236c-4dc2-82e9-2f21b7b60298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:53.136287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55009aa838d444e1a971a90513161a2c', 'request_id': 'req-84800100-1bbe-4992-a48f-64df7fea28cf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.160706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55009aa838d444e1a971a90513161a2c', 'request_id': 'req-84800100-1bbe-4992-a48f-64df7fea28cf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.173927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55009aa838d444e1a971a90513161a2c', 'request_id': 'req-84800100-1bbe-4992-a48f-64df7fea28cf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.214549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] The token cache is being invalidate because project 55009aa838d444e1a971a90513161a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:43:53.214777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.216808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.234218 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 692/1373] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:43:52 2022] DELETE /identity/v3/projects/55009aa838d444e1a971a90513161a2c => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:53.238469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:53.240598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:53.370887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84800100-1bbe-4992-a48f-64df7fea28cf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:53.379824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:53.384482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:53.385590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:53.386710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] PATH_INFO: `/v3/users/713439c274d84eb4b3ae022a34c78031` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:53.388865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713439c274d84eb4b3ae022a34c78031)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:53.391162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:53.466790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96a63-236c-4dc2-82e9-2f21b7b60298 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:53.475198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a362c3-c2d2-480f-a659-b0d34d91e3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:53.477335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a362c3-c2d2-480f-a659-b0d34d91e3dd admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:53.478878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a362c3-c2d2-480f-a659-b0d34d91e3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:53.479257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a362c3-c2d2-480f-a659-b0d34d91e3dd admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:53.481175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a362c3-c2d2-480f-a659-b0d34d91e3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:53.488802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a362c3-c2d2-480f-a659-b0d34d91e3dd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:53.529251 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 682/1374] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:53 2022] POST /identity/v3/users => generated 308 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:53.530652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a362c3-c2d2-480f-a659-b0d34d91e3dd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:53.533706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c3a362c3-c2d2-480f-a659-b0d34d91e3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:53.535438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713439c274d84eb4b3ae022a34c78031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.550377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a362c3-c2d2-480f-a659-b0d34d91e3dd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:53.555887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713439c274d84eb4b3ae022a34c78031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.556860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:53.557819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:53.558341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:53.558799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] PATH_INFO: `/v3/projects/f48362632fd543e9864d69bf8a4da9fd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:53.561928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48362632fd543e9864d69bf8a4da9fd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:53.563399 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:43:53.563399 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:43:53.563399 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:43:53.564081 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:53.565580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:53.579080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713439c274d84eb4b3ae022a34c78031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.602739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713439c274d84eb4b3ae022a34c78031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.604144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713439c274d84eb4b3ae022a34c78031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.623564 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 693/1375] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:43:53 2022] DELETE /identity/v3/users/713439c274d84eb4b3ae022a34c78031 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:53.625776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:53.630051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:53.664290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48362632fd543e9864d69bf8a4da9fd', 'request_id': 'req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.676901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48362632fd543e9864d69bf8a4da9fd', 'request_id': 'req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.687229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48362632fd543e9864d69bf8a4da9fd', 'request_id': 'req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.720965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] The token cache is being invalidate because project f48362632fd543e9864d69bf8a4da9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:43:53.722246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.722782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22b5ceb0-df37-4dd5-9ba8-81f89e8e0dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:53.732558 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 683/1376] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:43:53 2022] DELETE /identity/v3/projects/f48362632fd543e9864d69bf8a4da9fd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:53.734526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e3bc0-d83d-4c4e-8ed8-4a81c43beadd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:53.735367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e3bc0-d83d-4c4e-8ed8-4a81c43beadd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:53.735514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e3bc0-d83d-4c4e-8ed8-4a81c43beadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:53.839956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1a0e3bc0-d83d-4c4e-8ed8-4a81c43beadd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:53.851305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1a0e3bc0-d83d-4c4e-8ed8-4a81c43beadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:53.888107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c908c6d-2177-4b38-866e-d0be7c0571d6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:54.049660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82591b-eaf4-452f-93aa-409af4f4de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:54.053635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82591b-eaf4-452f-93aa-409af4f4de93 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:54.055541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82591b-eaf4-452f-93aa-409af4f4de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:54.059575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82591b-eaf4-452f-93aa-409af4f4de93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:54.060574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82591b-eaf4-452f-93aa-409af4f4de93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:54.062978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82591b-eaf4-452f-93aa-409af4f4de93 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:54.096715 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 694/1377] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:54.098017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82591b-eaf4-452f-93aa-409af4f4de93 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:54.100004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7a82591b-eaf4-452f-93aa-409af4f4de93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:54.118621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82591b-eaf4-452f-93aa-409af4f4de93 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:54.124262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:54.125154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:54.125450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:54.125727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] PATH_INFO: `/v3/projects/4461d9ea56f143b2aacb15c8ddedf787` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:54.127100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4461d9ea56f143b2aacb15c8ddedf787)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:54.129604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:54.258366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4461d9ea56f143b2aacb15c8ddedf787', 'request_id': 'req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.270915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4461d9ea56f143b2aacb15c8ddedf787', 'request_id': 'req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.297470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4461d9ea56f143b2aacb15c8ddedf787', 'request_id': 'req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.298242 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 684/1378] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:54.299716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e3bc0-d83d-4c4e-8ed8-4a81c43beadd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:54.301431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1a0e3bc0-d83d-4c4e-8ed8-4a81c43beadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:54.325032 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:54.333802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e3bc0-d83d-4c4e-8ed8-4a81c43beadd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:54.347370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] The token cache is being invalidate because project 4461d9ea56f143b2aacb15c8ddedf787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:43:54.347852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.349272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.353243 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 695/1379] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:43:54 2022] DELETE /identity/v3/projects/4461d9ea56f143b2aacb15c8ddedf787 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:54.357627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:54.362780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:54.377871 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:54.443287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba8f11-0136-49a6-9f76-8c3ad5fbdb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:54.444075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba8f11-0136-49a6-9f76-8c3ad5fbdb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:54.444528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba8f11-0136-49a6-9f76-8c3ad5fbdb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:54.445004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba8f11-0136-49a6-9f76-8c3ad5fbdb8e admin admin] PATH_INFO: `/v3/projects/509418800d6f4e79b70f4170e7583a62/users/2785a638c2a3448ca63e04e749ce01dc/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:54.457508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5da38-816a-4f53-96cf-9f6ae8f733f5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:54.464057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:54.464969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:54.465955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:54.466578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] PATH_INFO: `/v3/users/0e8e8ac53a4e405fa6723cac11b3b5fd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:54.468361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8e8ac53a4e405fa6723cac11b3b5fd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:54.470596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:54.472684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba8f11-0136-49a6-9f76-8c3ad5fbdb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=509418800d6f4e79b70f4170e7583a62, user_id=2785a638c2a3448ca63e04e749ce01dc, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:54.476488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba8f11-0136-49a6-9f76-8c3ad5fbdb8e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:54.517078 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 685/1380] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:54 2022] PUT /identity/v3/projects/509418800d6f4e79b70f4170e7583a62/users/2785a638c2a3448ca63e04e749ce01dc/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:54.517078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1037e-bc76-4175-a638-3e5bf090ad35 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:54.517078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1037e-bc76-4175-a638-3e5bf090ad35 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:54.519418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1037e-bc76-4175-a638-3e5bf090ad35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:54.566098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c1d1037e-bc76-4175-a638-3e5bf090ad35 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:54.580653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1d1037e-bc76-4175-a638-3e5bf090ad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:54.580857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8e8ac53a4e405fa6723cac11b3b5fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.621676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8e8ac53a4e405fa6723cac11b3b5fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.635652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8e8ac53a4e405fa6723cac11b3b5fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.647480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8e8ac53a4e405fa6723cac11b3b5fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.648841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8e8ac53a4e405fa6723cac11b3b5fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.659316 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 696/1381] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:43:54 2022] DELETE /identity/v3/users/0e8e8ac53a4e405fa6723cac11b3b5fd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:54.660344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:54.663440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:54.668830 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 686/1382] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:54.669857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1037e-bc76-4175-a638-3e5bf090ad35 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:54.674525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1d1037e-bc76-4175-a638-3e5bf090ad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:54.693861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1037e-bc76-4175-a638-3e5bf090ad35 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:54.780540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfce72-60c1-4ea0-823f-8a6e6d3b095d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:54.780837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:54.781647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:54.781964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:54.782219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] PATH_INFO: `/v3/users/0959e609632a487084307195a0b910c6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:54.783410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0959e609632a487084307195a0b910c6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:54.785646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:54.789213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:54.790287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:54.790821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:54.791199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] PATH_INFO: `/v3/projects/025775c2606c44459ce94c205b43c088` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:54.792490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=025775c2606c44459ce94c205b43c088)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:54.796665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:54.823890 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:54.849842 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:54.859948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0959e609632a487084307195a0b910c6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.870107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025775c2606c44459ce94c205b43c088', 'request_id': 'req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.879650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0959e609632a487084307195a0b910c6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.880301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025775c2606c44459ce94c205b43c088', 'request_id': 'req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.890274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025775c2606c44459ce94c205b43c088', 'request_id': 'req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.892429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0959e609632a487084307195a0b910c6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.907334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] The token cache is being invalidate because project 025775c2606c44459ce94c205b43c088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:43:54.907659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.908568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae2bbe8f-b074-421f-b0ba-26fdd5c24dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.910781 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 697/1383] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:43:54 2022] DELETE /identity/v3/projects/025775c2606c44459ce94c205b43c088 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:54.912354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247b4e-3831-4c08-9c44-425df273ca03 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:54.912900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247b4e-3831-4c08-9c44-425df273ca03 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:54.913180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247b4e-3831-4c08-9c44-425df273ca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:54.917220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0959e609632a487084307195a0b910c6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.921345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0959e609632a487084307195a0b910c6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:54.932103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 687/1384] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:43:54 2022] DELETE /identity/v3/users/0959e609632a487084307195a0b910c6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:54.933385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:54.935372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:55.038056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987337f4-fb7d-46c6-9dfa-c81964e6017d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:55.042418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dd247b4e-3831-4c08-9c44-425df273ca03 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:55.046085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dd247b4e-3831-4c08-9c44-425df273ca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:55.048663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce27ee-7ea0-4738-afdc-650f040fdaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:55.049527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce27ee-7ea0-4738-afdc-650f040fdaee admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.049818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce27ee-7ea0-4738-afdc-650f040fdaee admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.050159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce27ee-7ea0-4738-afdc-650f040fdaee admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.051512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce27ee-7ea0-4738-afdc-650f040fdaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:55.053334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce27ee-7ea0-4738-afdc-650f040fdaee admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:55.067861 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 688/1385] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:55.070351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86610cf-3511-49ea-9b5a-26ecc1350528 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.070846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86610cf-3511-49ea-9b5a-26ecc1350528 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.073021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86610cf-3511-49ea-9b5a-26ecc1350528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.115616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e86610cf-3511-49ea-9b5a-26ecc1350528 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:55.119661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e86610cf-3511-49ea-9b5a-26ecc1350528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:55.137719 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 689/1386] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:55.138965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86610cf-3511-49ea-9b5a-26ecc1350528 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:55.140440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e86610cf-3511-49ea-9b5a-26ecc1350528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:55.162706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86610cf-3511-49ea-9b5a-26ecc1350528 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:55.177331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa58e4-26ac-46aa-a2cf-d58b4d41c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:55.178427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa58e4-26ac-46aa-a2cf-d58b4d41c545 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.178712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa58e4-26ac-46aa-a2cf-d58b4d41c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.178997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa58e4-26ac-46aa-a2cf-d58b4d41c545 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.179649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa58e4-26ac-46aa-a2cf-d58b4d41c545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:55.182120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa58e4-26ac-46aa-a2cf-d58b4d41c545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:55.183681 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 698/1387] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:43:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:55.185729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7466f64-8c53-4b1a-826e-a9d9546c2196 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.186023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7466f64-8c53-4b1a-826e-a9d9546c2196 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.186301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7466f64-8c53-4b1a-826e-a9d9546c2196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.194162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa58e4-26ac-46aa-a2cf-d58b4d41c545 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:55.224999 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 690/1388] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:55.228057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa58e4-26ac-46aa-a2cf-d58b4d41c545 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:55.234749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a7466f64-8c53-4b1a-826e-a9d9546c2196 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:55.239411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a7466f64-8c53-4b1a-826e-a9d9546c2196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:55.249030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa58e4-26ac-46aa-a2cf-d58b4d41c545 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:55.259129 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 699/1389] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:55.261608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7466f64-8c53-4b1a-826e-a9d9546c2196 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:55.262936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410d0b5-2d6a-416d-82b9-e543daf68605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:55.263629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410d0b5-2d6a-416d-82b9-e543daf68605 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.263735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a7466f64-8c53-4b1a-826e-a9d9546c2196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:55.263971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410d0b5-2d6a-416d-82b9-e543daf68605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.264191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410d0b5-2d6a-416d-82b9-e543daf68605 admin admin] PATH_INFO: `/v3/projects/509418800d6f4e79b70f4170e7583a62/users/2785a638c2a3448ca63e04e749ce01dc/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.271740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410d0b5-2d6a-416d-82b9-e543daf68605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509418800d6f4e79b70f4170e7583a62, user_id=2785a638c2a3448ca63e04e749ce01dc, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:55.274740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410d0b5-2d6a-416d-82b9-e543daf68605 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:55.291130 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 691/1390] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:55 2022] PUT /identity/v3/projects/509418800d6f4e79b70f4170e7583a62/users/2785a638c2a3448ca63e04e749ce01dc/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:55.296347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410d0b5-2d6a-416d-82b9-e543daf68605 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:55.373292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7466f64-8c53-4b1a-826e-a9d9546c2196 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:55.419174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410d0b5-2d6a-416d-82b9-e543daf68605 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:55.425880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b378a-dde5-4772-b9e7-01822cd76176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:55.426854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b378a-dde5-4772-b9e7-01822cd76176 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.427142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b378a-dde5-4772-b9e7-01822cd76176 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.427555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b378a-dde5-4772-b9e7-01822cd76176 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.428335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b378a-dde5-4772-b9e7-01822cd76176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:55.430769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b378a-dde5-4772-b9e7-01822cd76176 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:55.448767 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:55.472238 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 692/1391] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:55 2022] POST /identity/v3/projects => generated 395 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:55.472238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce463b97-10aa-44f6-ac86-48b9fce51631 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.472238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce463b97-10aa-44f6-ac86-48b9fce51631 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.472238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce463b97-10aa-44f6-ac86-48b9fce51631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.496920 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:55.517858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ce463b97-10aa-44f6-ac86-48b9fce51631 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:55.519972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ce463b97-10aa-44f6-ac86-48b9fce51631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:55.531515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ed37e-9cc8-41af-a13b-2c241794cacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:55.532168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ed37e-9cc8-41af-a13b-2c241794cacd service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.532453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ed37e-9cc8-41af-a13b-2c241794cacd service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.532756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ed37e-9cc8-41af-a13b-2c241794cacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.558129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ed37e-9cc8-41af-a13b-2c241794cacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:55.562328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ed37e-9cc8-41af-a13b-2c241794cacd service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:55.589226 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 700/1392] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:55.591118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ed37e-9cc8-41af-a13b-2c241794cacd service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:55.593525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-101ed37e-9cc8-41af-a13b-2c241794cacd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:55.685856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 693/1393] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:55.687574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce463b97-10aa-44f6-ac86-48b9fce51631 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:55.719178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce463b97-10aa-44f6-ac86-48b9fce51631 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:55.726449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae06e4-0f63-4025-808f-5968b0a7939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:55.726959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae06e4-0f63-4025-808f-5968b0a7939a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.727130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae06e4-0f63-4025-808f-5968b0a7939a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.727415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae06e4-0f63-4025-808f-5968b0a7939a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.727991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae06e4-0f63-4025-808f-5968b0a7939a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:55.730069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae06e4-0f63-4025-808f-5968b0a7939a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:55.773488 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 694/1394] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:55 2022] POST /identity/v3/users => generated 298 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:55.774426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae06e4-0f63-4025-808f-5968b0a7939a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:55.785260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8fae06e4-0f63-4025-808f-5968b0a7939a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:55.798963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae06e4-0f63-4025-808f-5968b0a7939a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:55.804837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:55.805557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.805883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.806160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] PATH_INFO: `/v3/projects/8a6f93bf3f2642689f852abc7a092972` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.807470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6f93bf3f2642689f852abc7a092972)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:55.810224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:55.812185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ed37e-9cc8-41af-a13b-2c241794cacd service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:55.896115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6f93bf3f2642689f852abc7a092972', 'request_id': 'req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:55.902176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6543732-185c-4a63-89f4-2db92886f897 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:55.904340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6543732-185c-4a63-89f4-2db92886f897 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:55.904853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6543732-185c-4a63-89f4-2db92886f897 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:55.905271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6543732-185c-4a63-89f4-2db92886f897 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:55.914500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6f93bf3f2642689f852abc7a092972', 'request_id': 'req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:55.928174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6f93bf3f2642689f852abc7a092972', 'request_id': 'req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:55.959708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] The token cache is being invalidate because project 8a6f93bf3f2642689f852abc7a092972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:43:55.960368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:55.961994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:55.969441 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 695/1395] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:43:55 2022] DELETE /identity/v3/projects/8a6f93bf3f2642689f852abc7a092972 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:55.969441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:55.970796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:56.065531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac9a8e-c0ab-42e8-b77f-8cce44713d11 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:56.078463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:56.079717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.080534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.081607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.082633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:56.083244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:56.095532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:56.097773 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:56.107619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6543732-185c-4a63-89f4-2db92886f897 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:56.109498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6543732-185c-4a63-89f4-2db92886f897 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:56.116306 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 696/1396] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:56.117237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:56.120536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:56.128591 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 701/1397] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:43:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:43:56.130536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f030a-338d-44eb-a0bd-1b4f844d816a None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.131039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f030a-338d-44eb-a0bd-1b4f844d816a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.131639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f030a-338d-44eb-a0bd-1b4f844d816a None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.135076 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 702/1398] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:43:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:43:56.137119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afcd7c-c971-46df-bf38-e098519fe5f4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.137646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afcd7c-c971-46df-bf38-e098519fe5f4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.138192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afcd7c-c971-46df-bf38-e098519fe5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.144736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9f7b2-5df3-4ded-bfc9-a1a7c55cba40 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:56.149822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba2d83-c015-47e0-9fdc-09b6e8f36716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:56.150460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba2d83-c015-47e0-9fdc-09b6e8f36716 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.150789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba2d83-c015-47e0-9fdc-09b6e8f36716 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.151082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba2d83-c015-47e0-9fdc-09b6e8f36716 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.152102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba2d83-c015-47e0-9fdc-09b6e8f36716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:56.153970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba2d83-c015-47e0-9fdc-09b6e8f36716 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:56.164751 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:56.172468 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 697/1399] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:56.174432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba2d83-c015-47e0-9fdc-09b6e8f36716 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:56.181720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-34afcd7c-c971-46df-bf38-e098519fe5f4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:56.183324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-34afcd7c-c971-46df-bf38-e098519fe5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:56.187653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba2d83-c015-47e0-9fdc-09b6e8f36716 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:56.195335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689b8af-82e2-411a-98e6-faf650276797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:56.196428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689b8af-82e2-411a-98e6-faf650276797 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.197059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689b8af-82e2-411a-98e6-faf650276797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.197576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689b8af-82e2-411a-98e6-faf650276797 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.198487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689b8af-82e2-411a-98e6-faf650276797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:56.201030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689b8af-82e2-411a-98e6-faf650276797 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:56.205748 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 703/1400] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:56.207349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be1da-4c5c-4398-b2c2-1db9a423a7a8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.207775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be1da-4c5c-4398-b2c2-1db9a423a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.208150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be1da-4c5c-4398-b2c2-1db9a423a7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.233919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-639be1da-4c5c-4398-b2c2-1db9a423a7a8 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:56.235655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-639be1da-4c5c-4398-b2c2-1db9a423a7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:56.280760 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 698/1401] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:56 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:56.281979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689b8af-82e2-411a-98e6-faf650276797 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:56.488593 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 704/1402] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:43:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:56.490166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d3404-9679-487f-bd27-e9f6ffa4343d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.494602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d3404-9679-487f-bd27-e9f6ffa4343d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.494994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d3404-9679-487f-bd27-e9f6ffa4343d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.520372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689b8af-82e2-411a-98e6-faf650276797 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:56.550734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e55c4-2654-4c10-8b5d-3f717d729be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:56.551459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e55c4-2654-4c10-8b5d-3f717d729be6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.551767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e55c4-2654-4c10-8b5d-3f717d729be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.552066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e55c4-2654-4c10-8b5d-3f717d729be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.552705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e55c4-2654-4c10-8b5d-3f717d729be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:56.564039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e55c4-2654-4c10-8b5d-3f717d729be6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:56.590797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-aa3d3404-9679-487f-bd27-e9f6ffa4343d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:56.592563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aa3d3404-9679-487f-bd27-e9f6ffa4343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:56.612761 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 699/1403] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:56.612761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e55c4-2654-4c10-8b5d-3f717d729be6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:56.640865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 705/1404] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:56.641764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d3404-9679-487f-bd27-e9f6ffa4343d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:56.657090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aa3d3404-9679-487f-bd27-e9f6ffa4343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:56.663356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e55c4-2654-4c10-8b5d-3f717d729be6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:56.687383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f9f8-3a32-49b8-9121-ceb9730e8cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:56.687908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f9f8-3a32-49b8-9121-ceb9730e8cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.688192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f9f8-3a32-49b8-9121-ceb9730e8cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.688592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f9f8-3a32-49b8-9121-ceb9730e8cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.689265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f9f8-3a32-49b8-9121-ceb9730e8cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:56.691952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f9f8-3a32-49b8-9121-ceb9730e8cd7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:56.750651 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 700/1405] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:56 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:56.750651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f9f8-3a32-49b8-9121-ceb9730e8cd7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:56.772009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f9f8-3a32-49b8-9121-ceb9730e8cd7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:56.783065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab373c3-62ef-4c5b-b9b4-1badfcee4d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:56.783883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab373c3-62ef-4c5b-b9b4-1badfcee4d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:56.784420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab373c3-62ef-4c5b-b9b4-1badfcee4d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:56.784844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab373c3-62ef-4c5b-b9b4-1badfcee4d91 admin admin] PATH_INFO: `/v3/projects/2753fc50fce34c949198d78ead289f24/users/29847de2c3704348a07b66256a607223/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:56.815871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab373c3-62ef-4c5b-b9b4-1badfcee4d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2753fc50fce34c949198d78ead289f24, user_id=29847de2c3704348a07b66256a607223, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:56.821925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab373c3-62ef-4c5b-b9b4-1badfcee4d91 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:56.857672 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 701/1406] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:56 2022] PUT /identity/v3/projects/2753fc50fce34c949198d78ead289f24/users/29847de2c3704348a07b66256a607223/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:56.863688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab373c3-62ef-4c5b-b9b4-1badfcee4d91 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:56.928107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d3404-9679-487f-bd27-e9f6ffa4343d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:57.212834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a96c3-9546-484d-b14a-6eb6aea2af8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:57.213498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a96c3-9546-484d-b14a-6eb6aea2af8b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:57.213760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a96c3-9546-484d-b14a-6eb6aea2af8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:57.214035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a96c3-9546-484d-b14a-6eb6aea2af8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:57.224163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab373c3-62ef-4c5b-b9b4-1badfcee4d91 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:57.245902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768e6c-874a-4ca9-abb2-07fa3d8a0692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:57.248230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768e6c-874a-4ca9-abb2-07fa3d8a0692 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:57.250606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768e6c-874a-4ca9-abb2-07fa3d8a0692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:57.251368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768e6c-874a-4ca9-abb2-07fa3d8a0692 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:57.257082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79768e6c-874a-4ca9-abb2-07fa3d8a0692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:43:57.257801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79768e6c-874a-4ca9-abb2-07fa3d8a0692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:57.259877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79768e6c-874a-4ca9-abb2-07fa3d8a0692 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:57.317662 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 702/1407] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:43:57.319813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768e6c-874a-4ca9-abb2-07fa3d8a0692 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:57.344677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768e6c-874a-4ca9-abb2-07fa3d8a0692 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:57.353312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36044b-e0fa-4831-8b8f-3b6407fb5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:57.355067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36044b-e0fa-4831-8b8f-3b6407fb5398 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:57.357568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36044b-e0fa-4831-8b8f-3b6407fb5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:57.358380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36044b-e0fa-4831-8b8f-3b6407fb5398 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:57.359791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36044b-e0fa-4831-8b8f-3b6407fb5398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:57.362893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36044b-e0fa-4831-8b8f-3b6407fb5398 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:57.366553 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:57.423513 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:57.426622 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 703/1408] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:57.435490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe079a-f151-4ad0-a112-2592f0d5b421 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:57.435490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe079a-f151-4ad0-a112-2592f0d5b421 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:57.435490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe079a-f151-4ad0-a112-2592f0d5b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:57.494109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a96c3-9546-484d-b14a-6eb6aea2af8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:57.497440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a96c3-9546-484d-b14a-6eb6aea2af8b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:57.508513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0dfe079a-f151-4ad0-a112-2592f0d5b421 None None] MFA Rules not processed for user `29847de2c3704348a07b66256a607223`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:57.518896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0dfe079a-f151-4ad0-a112-2592f0d5b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:57.544610 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 706/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 903 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:57.555746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cc91a-3fe1-430c-91f6-0893e519f42a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:57.559784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cc91a-3fe1-430c-91f6-0893e519f42a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:57.560388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cc91a-3fe1-430c-91f6-0893e519f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:57.708398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5a1cc91a-3fe1-430c-91f6-0893e519f42a None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:57.710491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5a1cc91a-3fe1-430c-91f6-0893e519f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:57.727645 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 707/1410] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Oct 19 00:43:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:57.731786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cc91a-3fe1-430c-91f6-0893e519f42a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:57.737499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5a1cc91a-3fe1-430c-91f6-0893e519f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:57.794352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cc91a-3fe1-430c-91f6-0893e519f42a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:57.807069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:57.808462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:57.809227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:57.812302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] PATH_INFO: `/v3/projects/0f53450c0ede48c3bb7ff6c52697c593` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:57.813898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f53450c0ede48c3bb7ff6c52697c593)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:57.817854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:57.851906 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 704/1411] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:57.854733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe079a-f151-4ad0-a112-2592f0d5b421 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:57.894664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe079a-f151-4ad0-a112-2592f0d5b421 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:57.910255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abb51f-50cb-4c79-a403-e239b350b2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:57.910963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abb51f-50cb-4c79-a403-e239b350b2db admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:57.914965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abb51f-50cb-4c79-a403-e239b350b2db admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:57.914965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abb51f-50cb-4c79-a403-e239b350b2db admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:57.914965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abb51f-50cb-4c79-a403-e239b350b2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:57.919697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abb51f-50cb-4c79-a403-e239b350b2db admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:57.941134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f53450c0ede48c3bb7ff6c52697c593', 'request_id': 'req-763533ab-08ab-4957-a508-f25e321a3f9e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:57.958994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f53450c0ede48c3bb7ff6c52697c593', 'request_id': 'req-763533ab-08ab-4957-a508-f25e321a3f9e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:57.974794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f53450c0ede48c3bb7ff6c52697c593', 'request_id': 'req-763533ab-08ab-4957-a508-f25e321a3f9e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:57.995970 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 705/1412] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:57 2022] POST /identity/v3/projects => generated 391 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:57.997609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abb51f-50cb-4c79-a403-e239b350b2db admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:58.009652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] The token cache is being invalidate because project 0f53450c0ede48c3bb7ff6c52697c593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:43:58.009948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:58.013921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:58.018992 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 708/1413] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:43:57 2022] DELETE /identity/v3/projects/0f53450c0ede48c3bb7ff6c52697c593 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:58.019872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:58.025577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:58.263001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763533ab-08ab-4957-a508-f25e321a3f9e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:58.323278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abb51f-50cb-4c79-a403-e239b350b2db admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:58.335510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fd1da-9921-401d-8c79-064e4f91a5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:58.336506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fd1da-9921-401d-8c79-064e4f91a5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:58.341404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fd1da-9921-401d-8c79-064e4f91a5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:58.342027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fd1da-9921-401d-8c79-064e4f91a5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:58.343057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fd1da-9921-401d-8c79-064e4f91a5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:58.344952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fd1da-9921-401d-8c79-064e4f91a5f7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:58.394845 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 706/1414] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:58.399355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fd1da-9921-401d-8c79-064e4f91a5f7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:58.405809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-563fd1da-9921-401d-8c79-064e4f91a5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:58.435291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:58.436797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:58.437094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:58.437374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:58.445809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:58.455688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fd1da-9921-401d-8c79-064e4f91a5f7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:58.469701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63587f64-4243-49d1-af47-c34898865898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:58.470676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63587f64-4243-49d1-af47-c34898865898 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:58.471115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63587f64-4243-49d1-af47-c34898865898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:58.472801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63587f64-4243-49d1-af47-c34898865898 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:58.474597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63587f64-4243-49d1-af47-c34898865898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:58.475794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:58.477080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63587f64-4243-49d1-af47-c34898865898 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:58.477315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:58.498470 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 709/1415] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:43:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:58.502815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:58.507437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:58.525422 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 707/1416] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:43:58 2022] POST /identity/v3/projects => generated 395 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:58.527329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63587f64-4243-49d1-af47-c34898865898 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:58.530072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-63587f64-4243-49d1-af47-c34898865898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:58.537539 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:58.549785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6526d78-9b68-4603-90f0-a9cf316cd3a7 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:58.711767 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:58.719527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7c397-0482-4ab4-8d95-ea7c9e37db88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:58.721441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c397-0482-4ab4-8d95-ea7c9e37db88 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:58.721730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c397-0482-4ab4-8d95-ea7c9e37db88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:58.722012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c397-0482-4ab4-8d95-ea7c9e37db88 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:58.722684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7c397-0482-4ab4-8d95-ea7c9e37db88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:58.726053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7c397-0482-4ab4-8d95-ea7c9e37db88 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:58.789356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63587f64-4243-49d1-af47-c34898865898 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:58.804654 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 710/1417] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:58 2022] POST /identity/v3/users => generated 296 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:58.806518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7c397-0482-4ab4-8d95-ea7c9e37db88 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:58.814793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e4e7c397-0482-4ab4-8d95-ea7c9e37db88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:58.821275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:58.823082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:58.823417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:58.823770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] PATH_INFO: `/v3/users/1ee8bcf0218e42d189a5fac064f3bb45` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:58.830183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee8bcf0218e42d189a5fac064f3bb45)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:58.842890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:58.861477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7c397-0482-4ab4-8d95-ea7c9e37db88 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:58.881368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776ebe5-c34a-4732-8b33-412704a997eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:58.882380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776ebe5-c34a-4732-8b33-412704a997eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:58.882885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776ebe5-c34a-4732-8b33-412704a997eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:58.891482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776ebe5-c34a-4732-8b33-412704a997eb admin admin] PATH_INFO: `/v3/projects/f092e266f25545dea290f34ea233a412/users/b983be8651fb47c8b400ce00cff7596a/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:58.934224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776ebe5-c34a-4732-8b33-412704a997eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f092e266f25545dea290f34ea233a412, user_id=b983be8651fb47c8b400ce00cff7596a, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:58.938881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776ebe5-c34a-4732-8b33-412704a997eb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:58.974151 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 711/1418] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:58 2022] PUT /identity/v3/projects/f092e266f25545dea290f34ea233a412/users/b983be8651fb47c8b400ce00cff7596a/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:58.978418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776ebe5-c34a-4732-8b33-412704a997eb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:58.995981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee8bcf0218e42d189a5fac064f3bb45'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:59.044129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee8bcf0218e42d189a5fac064f3bb45'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:59.095729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee8bcf0218e42d189a5fac064f3bb45'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:59.120468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee8bcf0218e42d189a5fac064f3bb45'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:59.124070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee8bcf0218e42d189a5fac064f3bb45'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:43:59.156985 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 708/1419] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:43:58 2022] DELETE /identity/v3/users/1ee8bcf0218e42d189a5fac064f3bb45 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:43:59.164843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:59.171186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:59.229890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776ebe5-c34a-4732-8b33-412704a997eb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:59.377373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222ec96-44df-4c80-b9ee-d114a0f3b4a5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:59.402202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce454850-7cb4-4458-be25-1037cb8ff8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:59.404995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce454850-7cb4-4458-be25-1037cb8ff8ce admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:59.410512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce454850-7cb4-4458-be25-1037cb8ff8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:59.411225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce454850-7cb4-4458-be25-1037cb8ff8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:59.414300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce454850-7cb4-4458-be25-1037cb8ff8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:59.417703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce454850-7cb4-4458-be25-1037cb8ff8ce admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:59.446254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4610af-eb49-4c01-98df-2ab358051dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:59.449600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4610af-eb49-4c01-98df-2ab358051dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:59.450319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4610af-eb49-4c01-98df-2ab358051dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:59.450825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4610af-eb49-4c01-98df-2ab358051dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:59.452028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4610af-eb49-4c01-98df-2ab358051dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:59.453454 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 709/1420] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:59.457526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1a1c-d823-4463-8a09-23b066bd4a92 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:59.459359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1a1c-d823-4463-8a09-23b066bd4a92 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:59.459816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1a1c-d823-4463-8a09-23b066bd4a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:59.461985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4610af-eb49-4c01-98df-2ab358051dd5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:59.530586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-310e1a1c-d823-4463-8a09-23b066bd4a92 None None] MFA Rules not processed for user `b983be8651fb47c8b400ce00cff7596a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:43:59.532965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-310e1a1c-d823-4463-8a09-23b066bd4a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:59.540608 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 712/1421] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:43:58 2022] POST /identity/v3/users => generated 304 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:43:59.550601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4610af-eb49-4c01-98df-2ab358051dd5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:59.580911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4610af-eb49-4c01-98df-2ab358051dd5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:59.610129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19c5e6-c963-4e86-a189-38c36e1a8d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:59.610909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19c5e6-c963-4e86-a189-38c36e1a8d97 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:59.611214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19c5e6-c963-4e86-a189-38c36e1a8d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:59.612291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19c5e6-c963-4e86-a189-38c36e1a8d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:59.613134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19c5e6-c963-4e86-a189-38c36e1a8d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:59.632469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19c5e6-c963-4e86-a189-38c36e1a8d97 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:59.634323 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:59.670668 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 713/1422] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:59.671973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19c5e6-c963-4e86-a189-38c36e1a8d97 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:59.686703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fa19c5e6-c963-4e86-a189-38c36e1a8d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:43:59.711500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19c5e6-c963-4e86-a189-38c36e1a8d97 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:59.729537 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:59.741733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd510-fc70-4833-bedd-d41fa7da23c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:59.742610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd510-fc70-4833-bedd-d41fa7da23c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:59.742730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd510-fc70-4833-bedd-d41fa7da23c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:59.743087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd510-fc70-4833-bedd-d41fa7da23c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:59.743821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd510-fc70-4833-bedd-d41fa7da23c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:59.745679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd510-fc70-4833-bedd-d41fa7da23c8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:59.786990 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 714/1423] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:43:59.795755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd510-fc70-4833-bedd-d41fa7da23c8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:59.822766 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 710/1424] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:43:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:43:59.825363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e1a1c-d823-4463-8a09-23b066bd4a92 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:43:59.847780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd510-fc70-4833-bedd-d41fa7da23c8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:59.863509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2fa69-33d1-492f-a157-929d807b276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:59.864370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2fa69-33d1-492f-a157-929d807b276d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:59.864706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2fa69-33d1-492f-a157-929d807b276d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:59.865519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2fa69-33d1-492f-a157-929d807b276d admin admin] PATH_INFO: `/v3/projects/d6737859002b432aa18d1ce98ca7ad37/users/293e85d461014f758ff0d0c609651bc7/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:59.866385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e1a1c-d823-4463-8a09-23b066bd4a92 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:43:59.922104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691b20b-acca-448e-a0b1-61600fc84d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:43:59.923469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691b20b-acca-448e-a0b1-61600fc84d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:43:59.923964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691b20b-acca-448e-a0b1-61600fc84d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:43:59.924471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691b20b-acca-448e-a0b1-61600fc84d19 admin admin] PATH_INFO: `/v3/projects/40bfaccf90554a5a8083798d95072c10/users/819cc35a92c94712b15c305cf0790b62/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:43:59.980108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2fa69-33d1-492f-a157-929d807b276d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6737859002b432aa18d1ce98ca7ad37, user_id=293e85d461014f758ff0d0c609651bc7, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:43:59.988832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2fa69-33d1-492f-a157-929d807b276d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:43:59.999639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691b20b-acca-448e-a0b1-61600fc84d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bfaccf90554a5a8083798d95072c10, user_id=819cc35a92c94712b15c305cf0790b62, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:00.021886 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 715/1425] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:59 2022] PUT /identity/v3/projects/d6737859002b432aa18d1ce98ca7ad37/users/293e85d461014f758ff0d0c609651bc7/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:00.023451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691b20b-acca-448e-a0b1-61600fc84d19 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:00.034040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2fa69-33d1-492f-a157-929d807b276d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:00.040143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b1b2fa69-33d1-492f-a157-929d807b276d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:00.091851 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 711/1426] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:43:59 2022] PUT /identity/v3/projects/40bfaccf90554a5a8083798d95072c10/users/819cc35a92c94712b15c305cf0790b62/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:00.099599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5786813-e15f-4662-b5b8-ee779179f39c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:00.101495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5786813-e15f-4662-b5b8-ee779179f39c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:00.102075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5786813-e15f-4662-b5b8-ee779179f39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:00.206124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e5786813-e15f-4662-b5b8-ee779179f39c None None] MFA Rules not processed for user `293e85d461014f758ff0d0c609651bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:00.208426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e5786813-e15f-4662-b5b8-ee779179f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:00.318428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2fa69-33d1-492f-a157-929d807b276d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:00.494537 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 712/1427] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:00.508438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5786813-e15f-4662-b5b8-ee779179f39c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:00.524911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81544da0-05a9-4339-a84a-375c98909ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:00.525927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544da0-05a9-4339-a84a-375c98909ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:00.525927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544da0-05a9-4339-a84a-375c98909ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:00.527175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544da0-05a9-4339-a84a-375c98909ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:00.528159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81544da0-05a9-4339-a84a-375c98909ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:00.531042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81544da0-05a9-4339-a84a-375c98909ba2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:00.710617 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 716/1428] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:00 2022] POST /identity/v3/projects => generated 397 bytes in 687 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:00.712142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81544da0-05a9-4339-a84a-375c98909ba2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:00.876610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5786813-e15f-4662-b5b8-ee779179f39c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:00.922222 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:00.966440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81544da0-05a9-4339-a84a-375c98909ba2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:00.988308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66503617-1df1-4b49-9ed0-ba44b434b249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:00.989948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503617-1df1-4b49-9ed0-ba44b434b249 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:00.990265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503617-1df1-4b49-9ed0-ba44b434b249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:00.990640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503617-1df1-4b49-9ed0-ba44b434b249 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:00.992015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66503617-1df1-4b49-9ed0-ba44b434b249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:00.996990 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:00.999762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66503617-1df1-4b49-9ed0-ba44b434b249 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:01.009311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a959fd6-c1b5-498f-827a-fa3e07cf3c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:01.011270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a959fd6-c1b5-498f-827a-fa3e07cf3c8a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:01.013813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a959fd6-c1b5-498f-827a-fa3e07cf3c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:01.014434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a959fd6-c1b5-498f-827a-fa3e07cf3c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:01.016720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a959fd6-c1b5-498f-827a-fa3e07cf3c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:01.020058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a959fd6-c1b5-498f-827a-fa3e07cf3c8a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:01.041306 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 713/1429] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 551 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:01.050348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a959fd6-c1b5-498f-827a-fa3e07cf3c8a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:01.059209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2a959fd6-c1b5-498f-827a-fa3e07cf3c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:01.075512 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 717/1430] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:00 2022] POST /identity/v3/projects => generated 393 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:01.075967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66503617-1df1-4b49-9ed0-ba44b434b249 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:01.108055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a959fd6-c1b5-498f-827a-fa3e07cf3c8a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:01.304316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66503617-1df1-4b49-9ed0-ba44b434b249 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:01.312537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb14d8-eb9e-4c4b-8374-652067a5a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:01.313713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb14d8-eb9e-4c4b-8374-652067a5a850 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:01.314199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb14d8-eb9e-4c4b-8374-652067a5a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:01.314484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb14d8-eb9e-4c4b-8374-652067a5a850 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:01.315178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb14d8-eb9e-4c4b-8374-652067a5a850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:01.317562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb14d8-eb9e-4c4b-8374-652067a5a850 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:01.343671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:01.345269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:01.345674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:01.346593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] PATH_INFO: `/v3/projects/968d3df8f1c34832a9e73decb53e6a57` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:01.356023 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 718/1431] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:01 2022] POST /identity/v3/users => generated 305 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:01.357963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb14d8-eb9e-4c4b-8374-652067a5a850 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:01.362253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=968d3df8f1c34832a9e73decb53e6a57)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:01.367978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:01.371293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb14d8-eb9e-4c4b-8374-652067a5a850 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:01.379175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a6c2-ec2e-42c3-a10a-f89a16c8c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:01.379935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a6c2-ec2e-42c3-a10a-f89a16c8c746 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:01.380224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a6c2-ec2e-42c3-a10a-f89a16c8c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:01.380505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a6c2-ec2e-42c3-a10a-f89a16c8c746 admin admin] PATH_INFO: `/v3/projects/40bfaccf90554a5a8083798d95072c10/users/819cc35a92c94712b15c305cf0790b62/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:01.386030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492a6c2-ec2e-42c3-a10a-f89a16c8c746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bfaccf90554a5a8083798d95072c10, user_id=819cc35a92c94712b15c305cf0790b62, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:01.394118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492a6c2-ec2e-42c3-a10a-f89a16c8c746 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:01.430150 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 719/1432] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:01 2022] PUT /identity/v3/projects/40bfaccf90554a5a8083798d95072c10/users/819cc35a92c94712b15c305cf0790b62/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:01.431382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a6c2-ec2e-42c3-a10a-f89a16c8c746 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:01.589667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968d3df8f1c34832a9e73decb53e6a57', 'request_id': 'req-1a608b59-3537-4991-aa09-35c961a83248'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:01.604921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968d3df8f1c34832a9e73decb53e6a57', 'request_id': 'req-1a608b59-3537-4991-aa09-35c961a83248'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:01.614401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a6c2-ec2e-42c3-a10a-f89a16c8c746 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:01.647210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968d3df8f1c34832a9e73decb53e6a57', 'request_id': 'req-1a608b59-3537-4991-aa09-35c961a83248'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:01.695384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] The token cache is being invalidate because project 968d3df8f1c34832a9e73decb53e6a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:01.697555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:01.700601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:01.708939 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 714/1433] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:01 2022] DELETE /identity/v3/projects/968d3df8f1c34832a9e73decb53e6a57 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:01.708939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:01.711992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:01.814512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720205a1-0d3a-4039-a3f7-9033ed21dccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:01.818221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720205a1-0d3a-4039-a3f7-9033ed21dccc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:01.819142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720205a1-0d3a-4039-a3f7-9033ed21dccc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:01.819818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720205a1-0d3a-4039-a3f7-9033ed21dccc admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:01.821831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720205a1-0d3a-4039-a3f7-9033ed21dccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:01.832929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720205a1-0d3a-4039-a3f7-9033ed21dccc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:01.883054 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:01.945947 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 720/1434] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:01 2022] POST /identity/v3/users => generated 303 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:01.954764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541bb11-a244-4bb0-928c-1e4900f3bda3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:01.956159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a608b59-3537-4991-aa09-35c961a83248 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:01.956803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541bb11-a244-4bb0-928c-1e4900f3bda3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:01.957358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541bb11-a244-4bb0-928c-1e4900f3bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:01.967537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbff99-f6c9-42ed-b358-3dba6949e354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:01.968810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbff99-f6c9-42ed-b358-3dba6949e354 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:01.969510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbff99-f6c9-42ed-b358-3dba6949e354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:01.970115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbff99-f6c9-42ed-b358-3dba6949e354 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:01.971861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbff99-f6c9-42ed-b358-3dba6949e354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:01.983107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbff99-f6c9-42ed-b358-3dba6949e354 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:02.018729 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 715/1435] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:02.021291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3913-c47d-49f2-8a1c-757f7c1e21da None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:02.021917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3913-c47d-49f2-8a1c-757f7c1e21da None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:02.022300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3913-c47d-49f2-8a1c-757f7c1e21da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:02.100751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f541bb11-a244-4bb0-928c-1e4900f3bda3 None None] MFA Rules not processed for user `819cc35a92c94712b15c305cf0790b62`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:02.106816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f541bb11-a244-4bb0-928c-1e4900f3bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:02.119161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-657f3913-c47d-49f2-8a1c-757f7c1e21da None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:02.120493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-657f3913-c47d-49f2-8a1c-757f7c1e21da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:02.149817 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 716/1436] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:02.152771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f3913-c47d-49f2-8a1c-757f7c1e21da None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:02.172191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-657f3913-c47d-49f2-8a1c-757f7c1e21da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:02.211609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f3913-c47d-49f2-8a1c-757f7c1e21da None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:02.226948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627352-cf6c-4efa-b9bb-b0f3397a9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:02.227598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627352-cf6c-4efa-b9bb-b0f3397a9463 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:02.228075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627352-cf6c-4efa-b9bb-b0f3397a9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:02.228533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627352-cf6c-4efa-b9bb-b0f3397a9463 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:02.235517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627352-cf6c-4efa-b9bb-b0f3397a9463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:02.237450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627352-cf6c-4efa-b9bb-b0f3397a9463 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:02.283340 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 717/1437] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:02.285828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627352-cf6c-4efa-b9bb-b0f3397a9463 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:02.292653 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:02.312572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627352-cf6c-4efa-b9bb-b0f3397a9463 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:02.332424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30142d1-0a5d-4e83-bad2-39244a48dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:02.333501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30142d1-0a5d-4e83-bad2-39244a48dccb admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:02.333660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30142d1-0a5d-4e83-bad2-39244a48dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:02.334448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30142d1-0a5d-4e83-bad2-39244a48dccb admin admin] PATH_INFO: `/v3/projects/7d08aea89a6f46a2a89d93c91c5f874d/users/8533645267d345a2a5d8e961e92858e8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:02.428006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30142d1-0a5d-4e83-bad2-39244a48dccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d08aea89a6f46a2a89d93c91c5f874d, user_id=8533645267d345a2a5d8e961e92858e8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:02.441320 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 721/1438] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:02.441670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30142d1-0a5d-4e83-bad2-39244a48dccb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:02.443272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5d660-a149-49d6-a062-0de0591266fa None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:02.443989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5d660-a149-49d6-a062-0de0591266fa None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:02.444583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5d660-a149-49d6-a062-0de0591266fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:02.466688 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 718/1439] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:02 2022] PUT /identity/v3/projects/7d08aea89a6f46a2a89d93c91c5f874d/users/8533645267d345a2a5d8e961e92858e8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:02.468242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09c2c-cb00-41af-9346-02031c9d8d45 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:02.468525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09c2c-cb00-41af-9346-02031c9d8d45 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:02.468826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09c2c-cb00-41af-9346-02031c9d8d45 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:02.475133 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 719/1440] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:44:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:02.476106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09c2c-cb00-41af-9346-02031c9d8d45 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:02.512538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-63c5d660-a149-49d6-a062-0de0591266fa None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:02.516541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-63c5d660-a149-49d6-a062-0de0591266fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:02.685612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09c2c-cb00-41af-9346-02031c9d8d45 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:02.694967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80048-8700-4968-bb34-57e679268b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:02.708986 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 722/1441] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:02.717844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80048-8700-4968-bb34-57e679268b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:02.718617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80048-8700-4968-bb34-57e679268b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:02.719102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80048-8700-4968-bb34-57e679268b42 admin admin] PATH_INFO: `/v3/projects/8ebf327abdc74e5a8daf3d3be6cf2fb6/users/60b65333a2044b69ae55138e224c1532/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:02.720679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5d660-a149-49d6-a062-0de0591266fa None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:02.722997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-63c5d660-a149-49d6-a062-0de0591266fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:02.748820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80048-8700-4968-bb34-57e679268b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ebf327abdc74e5a8daf3d3be6cf2fb6, user_id=60b65333a2044b69ae55138e224c1532, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:02.752916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80048-8700-4968-bb34-57e679268b42 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:02.770415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5d660-a149-49d6-a062-0de0591266fa None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:02.782128 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 720/1442] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:02 2022] PUT /identity/v3/projects/8ebf327abdc74e5a8daf3d3be6cf2fb6/users/60b65333a2044b69ae55138e224c1532/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:02.783867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80048-8700-4968-bb34-57e679268b42 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:02.964065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b406f37-c1c9-49c6-a56c-8ccf1de30d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:02.965053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406f37-c1c9-49c6-a56c-8ccf1de30d76 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:02.966151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406f37-c1c9-49c6-a56c-8ccf1de30d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:02.966438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406f37-c1c9-49c6-a56c-8ccf1de30d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:02.967252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b406f37-c1c9-49c6-a56c-8ccf1de30d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:02.976079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b406f37-c1c9-49c6-a56c-8ccf1de30d76 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:03.026885 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 723/1443] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:02 2022] POST /identity/v3/projects => generated 395 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:03.034982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b406f37-c1c9-49c6-a56c-8ccf1de30d76 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:03.056762 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:03.115014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80048-8700-4968-bb34-57e679268b42 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:03.269565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b406f37-c1c9-49c6-a56c-8ccf1de30d76 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:03.285374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c198f4-fc3c-4f62-933a-7bcd5a2a587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:03.286658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c198f4-fc3c-4f62-933a-7bcd5a2a587b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:03.290134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c198f4-fc3c-4f62-933a-7bcd5a2a587b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:03.293880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c198f4-fc3c-4f62-933a-7bcd5a2a587b admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:03.296211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c198f4-fc3c-4f62-933a-7bcd5a2a587b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:03.297191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c198f4-fc3c-4f62-933a-7bcd5a2a587b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:03.306545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c198f4-fc3c-4f62-933a-7bcd5a2a587b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:03.341518 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 724/1444] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:03.343102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c198f4-fc3c-4f62-933a-7bcd5a2a587b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:03.356951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6cdce-3f2c-4460-9e94-f96de43a11ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:03.357886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6cdce-3f2c-4460-9e94-f96de43a11ad admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:03.358960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6cdce-3f2c-4460-9e94-f96de43a11ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:03.361403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6cdce-3f2c-4460-9e94-f96de43a11ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:03.362341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6cdce-3f2c-4460-9e94-f96de43a11ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:03.367012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6cdce-3f2c-4460-9e94-f96de43a11ad admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:03.370080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c198f4-fc3c-4f62-933a-7bcd5a2a587b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:03.378636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45bd23-98f2-44b4-9151-2d732df00be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:03.379551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45bd23-98f2-44b4-9151-2d732df00be9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:03.380662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45bd23-98f2-44b4-9151-2d732df00be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:03.381700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45bd23-98f2-44b4-9151-2d732df00be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:03.390079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45bd23-98f2-44b4-9151-2d732df00be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:03.391902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45bd23-98f2-44b4-9151-2d732df00be9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:03.412921 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 721/1445] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 626 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:03.412921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed5fff-252a-4433-bace-6ba58ea56953 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:03.412921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed5fff-252a-4433-bace-6ba58ea56953 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:03.412921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed5fff-252a-4433-bace-6ba58ea56953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:03.413378 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 725/1446] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:03.415039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45bd23-98f2-44b4-9151-2d732df00be9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:03.438497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45bd23-98f2-44b4-9151-2d732df00be9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:03.440228 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:03.450541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7325834-7680-4e90-bcbb-7109f6e91bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:03.450541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7325834-7680-4e90-bcbb-7109f6e91bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:03.450541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7325834-7680-4e90-bcbb-7109f6e91bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:03.450541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7325834-7680-4e90-bcbb-7109f6e91bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:03.451016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7325834-7680-4e90-bcbb-7109f6e91bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:03.451016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7325834-7680-4e90-bcbb-7109f6e91bd8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:03.466481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-85ed5fff-252a-4433-bace-6ba58ea56953 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:03.476749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85ed5fff-252a-4433-bace-6ba58ea56953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:03.507391 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 726/1447] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:03 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:03.516410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7325834-7680-4e90-bcbb-7109f6e91bd8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:03.560051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7325834-7680-4e90-bcbb-7109f6e91bd8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:03.572217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f0946-4b30-4b77-8297-a7ea501ab97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:03.573185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0946-4b30-4b77-8297-a7ea501ab97b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:03.573472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0946-4b30-4b77-8297-a7ea501ab97b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:03.573751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0946-4b30-4b77-8297-a7ea501ab97b admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:03.575320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f0946-4b30-4b77-8297-a7ea501ab97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:03.589540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f0946-4b30-4b77-8297-a7ea501ab97b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:03.628355 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 722/1448] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:44:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:03.629758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed5fff-252a-4433-bace-6ba58ea56953 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:03.650727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed5fff-252a-4433-bace-6ba58ea56953 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:03.657456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f739b6a-f40e-4d8b-a5b9-947bb660cfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:03.658434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f739b6a-f40e-4d8b-a5b9-947bb660cfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:03.658936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f739b6a-f40e-4d8b-a5b9-947bb660cfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:03.659398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f739b6a-f40e-4d8b-a5b9-947bb660cfd8 admin admin] PATH_INFO: `/v3/projects/7d08aea89a6f46a2a89d93c91c5f874d/users/8533645267d345a2a5d8e961e92858e8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:03.662847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f739b6a-f40e-4d8b-a5b9-947bb660cfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d08aea89a6f46a2a89d93c91c5f874d, user_id=8533645267d345a2a5d8e961e92858e8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:03.665102 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 727/1449] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:03 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:03.666697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f739b6a-f40e-4d8b-a5b9-947bb660cfd8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:03.672074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f0946-4b30-4b77-8297-a7ea501ab97b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:03.693965 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 723/1450] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:03 2022] PUT /identity/v3/projects/7d08aea89a6f46a2a89d93c91c5f874d/users/8533645267d345a2a5d8e961e92858e8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:03.696923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f739b6a-f40e-4d8b-a5b9-947bb660cfd8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:03.843553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f0946-4b30-4b77-8297-a7ea501ab97b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:03.869159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edac037-4811-4cad-97c0-8faed857cef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:03.870738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edac037-4811-4cad-97c0-8faed857cef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:03.871766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edac037-4811-4cad-97c0-8faed857cef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:03.872866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edac037-4811-4cad-97c0-8faed857cef8 admin admin] PATH_INFO: `/v3/projects/8ebf327abdc74e5a8daf3d3be6cf2fb6/users/60b65333a2044b69ae55138e224c1532/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:03.880223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edac037-4811-4cad-97c0-8faed857cef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ebf327abdc74e5a8daf3d3be6cf2fb6, user_id=60b65333a2044b69ae55138e224c1532, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:03.891460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edac037-4811-4cad-97c0-8faed857cef8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:03.926092 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 728/1451] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:03 2022] PUT /identity/v3/projects/8ebf327abdc74e5a8daf3d3be6cf2fb6/users/60b65333a2044b69ae55138e224c1532/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:03.928053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edac037-4811-4cad-97c0-8faed857cef8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:03.954189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f739b6a-f40e-4d8b-a5b9-947bb660cfd8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:04.041379 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:04.149372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edac037-4811-4cad-97c0-8faed857cef8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:04.178883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6dac3-1e45-4058-bac0-71d37698a103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:04.187622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6dac3-1e45-4058-bac0-71d37698a103 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:04.188675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6dac3-1e45-4058-bac0-71d37698a103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:04.189298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6dac3-1e45-4058-bac0-71d37698a103 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:04.194983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6dac3-1e45-4058-bac0-71d37698a103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:04.206178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6dac3-1e45-4058-bac0-71d37698a103 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:04.223908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5d6e4-3dec-46d2-8148-896e53e7ec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:04.224857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5d6e4-3dec-46d2-8148-896e53e7ec9c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:04.227039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5d6e4-3dec-46d2-8148-896e53e7ec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:04.227348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5d6e4-3dec-46d2-8148-896e53e7ec9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:04.228054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5d6e4-3dec-46d2-8148-896e53e7ec9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:04.229771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5d6e4-3dec-46d2-8148-896e53e7ec9c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:04.270537 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 729/1452] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:03 2022] POST /identity/v3/users => generated 291 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:04.270789 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 724/1453] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 575 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:04.271235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c388-6f92-4abc-aa97-397b9c383121 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:04.272079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c388-6f92-4abc-aa97-397b9c383121 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:04.272270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5d6e4-3dec-46d2-8148-896e53e7ec9c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:04.273184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c388-6f92-4abc-aa97-397b9c383121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:04.276459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d5f5d6e4-3dec-46d2-8148-896e53e7ec9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:04.354327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-df52c388-6f92-4abc-aa97-397b9c383121 None None] MFA Rules not processed for user `8533645267d345a2a5d8e961e92858e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:04.360859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-df52c388-6f92-4abc-aa97-397b9c383121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:04.372074 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:04.532547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5d6e4-3dec-46d2-8148-896e53e7ec9c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:04.551213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541ea06-71c5-4826-8017-dc7cc45ebad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:04.553130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541ea06-71c5-4826-8017-dc7cc45ebad8 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:04.553786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541ea06-71c5-4826-8017-dc7cc45ebad8 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:04.554408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541ea06-71c5-4826-8017-dc7cc45ebad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:04.596529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541ea06-71c5-4826-8017-dc7cc45ebad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:04.600481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541ea06-71c5-4826-8017-dc7cc45ebad8 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:04.635350 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 725/1454] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:04.639080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b3914-5fc7-4e91-8946-121313bd7260 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:04.639872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b3914-5fc7-4e91-8946-121313bd7260 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:04.640607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b3914-5fc7-4e91-8946-121313bd7260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:04.642274 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 730/1455] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:04 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:04.643965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52c388-6f92-4abc-aa97-397b9c383121 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:04.693144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52c388-6f92-4abc-aa97-397b9c383121 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:04.718168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692dba7-cdd0-40ff-8445-2ee9033df4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:04.719460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692dba7-cdd0-40ff-8445-2ee9033df4ca admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:04.719779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692dba7-cdd0-40ff-8445-2ee9033df4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:04.720283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692dba7-cdd0-40ff-8445-2ee9033df4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:04.721554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692dba7-cdd0-40ff-8445-2ee9033df4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:04.727911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692dba7-cdd0-40ff-8445-2ee9033df4ca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:04.768142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-613b3914-5fc7-4e91-8946-121313bd7260 None None] MFA Rules not processed for user `60b65333a2044b69ae55138e224c1532`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:04.776827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-613b3914-5fc7-4e91-8946-121313bd7260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:04.803304 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 731/1456] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:04.805942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692dba7-cdd0-40ff-8445-2ee9033df4ca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:04.858179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692dba7-cdd0-40ff-8445-2ee9033df4ca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:04.879750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b105fd-b395-4280-9803-4bf9ce3fb2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:04.880988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b105fd-b395-4280-9803-4bf9ce3fb2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:04.881493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b105fd-b395-4280-9803-4bf9ce3fb2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:04.882002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b105fd-b395-4280-9803-4bf9ce3fb2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:04.885816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b105fd-b395-4280-9803-4bf9ce3fb2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:04.895060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b105fd-b395-4280-9803-4bf9ce3fb2d1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:04.954635 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 732/1457] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:04.956651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b105fd-b395-4280-9803-4bf9ce3fb2d1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:04.994188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b105fd-b395-4280-9803-4bf9ce3fb2d1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:05.017789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37003ad4-c327-4d81-9f67-ab09d45c9523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:05.018917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003ad4-c327-4d81-9f67-ab09d45c9523 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:05.021441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003ad4-c327-4d81-9f67-ab09d45c9523 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:05.022016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003ad4-c327-4d81-9f67-ab09d45c9523 admin admin] PATH_INFO: `/v3/projects/0573aaefe05443c5840f4e1fa532606b/users/ee41edbee5b4444ab257f8d24570afe2/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:05.122593 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 726/1458] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:05.144567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b3914-5fc7-4e91-8946-121313bd7260 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:05.146186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37003ad4-c327-4d81-9f67-ab09d45c9523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0573aaefe05443c5840f4e1fa532606b, user_id=ee41edbee5b4444ab257f8d24570afe2, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:05.150545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-613b3914-5fc7-4e91-8946-121313bd7260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:05.165912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37003ad4-c327-4d81-9f67-ab09d45c9523 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:05.220739 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 733/1459] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:04 2022] PUT /identity/v3/projects/0573aaefe05443c5840f4e1fa532606b/users/ee41edbee5b4444ab257f8d24570afe2/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:05.223865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37003ad4-c327-4d81-9f67-ab09d45c9523 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:05.227328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b3914-5fc7-4e91-8946-121313bd7260 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:05.439652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f4f0c-67c6-404b-a658-40f8015a4621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:05.442428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f4f0c-67c6-404b-a658-40f8015a4621 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:05.443271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f4f0c-67c6-404b-a658-40f8015a4621 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:05.444080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f4f0c-67c6-404b-a658-40f8015a4621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:05.452221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2c0f4f0c-67c6-404b-a658-40f8015a4621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:05.471836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37003ad4-c327-4d81-9f67-ab09d45c9523 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:05.488200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab86a4-e295-4bc8-a513-d9d830a0d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:05.489506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab86a4-e295-4bc8-a513-d9d830a0d313 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:05.489997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab86a4-e295-4bc8-a513-d9d830a0d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:05.490483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab86a4-e295-4bc8-a513-d9d830a0d313 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:05.492417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab86a4-e295-4bc8-a513-d9d830a0d313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:05.501925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab86a4-e295-4bc8-a513-d9d830a0d313 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:05.590920 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 734/1460] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:05.590920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab86a4-e295-4bc8-a513-d9d830a0d313 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:05.632299 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:05.642366 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:05.660044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab86a4-e295-4bc8-a513-d9d830a0d313 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:05.682074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8dcc3-f09c-4abd-9b84-742b1ce803e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:05.686589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8dcc3-f09c-4abd-9b84-742b1ce803e7 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:05.687068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8dcc3-f09c-4abd-9b84-742b1ce803e7 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:05.687451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8dcc3-f09c-4abd-9b84-742b1ce803e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:05.737199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f4f0c-67c6-404b-a658-40f8015a4621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:05.743228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f4f0c-67c6-404b-a658-40f8015a4621 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:05.786370 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 727/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:05.790473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d8891-778a-447e-affa-d552a4f0dde8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:05.794521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d8891-778a-447e-affa-d552a4f0dde8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:05.795111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d8891-778a-447e-affa-d552a4f0dde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:05.891236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a87d8891-778a-447e-affa-d552a4f0dde8 None None] MFA Rules not processed for user `ee41edbee5b4444ab257f8d24570afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:05.893949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a87d8891-778a-447e-affa-d552a4f0dde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:05.923851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8dcc3-f09c-4abd-9b84-742b1ce803e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:05.926171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8dcc3-f09c-4abd-9b84-742b1ce803e7 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:05.999818 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 735/1462] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:06.001846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8dcc3-f09c-4abd-9b84-742b1ce803e7 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:06.060379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8dcc3-f09c-4abd-9b84-742b1ce803e7 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:06.075473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9170-f989-4aeb-b282-7b95fdcf7c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:06.076303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9170-f989-4aeb-b282-7b95fdcf7c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:06.077351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9170-f989-4aeb-b282-7b95fdcf7c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:06.077956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9170-f989-4aeb-b282-7b95fdcf7c9d admin admin] PATH_INFO: `/v3/projects/d5e08dea015240f8b29d6dca698f555e/users/c47bb66f14dc4181a423e106e2d871f3/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:06.166534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9170-f989-4aeb-b282-7b95fdcf7c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e08dea015240f8b29d6dca698f555e, user_id=c47bb66f14dc4181a423e106e2d871f3, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:06.171559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9170-f989-4aeb-b282-7b95fdcf7c9d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:06.207403 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 728/1463] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:06.224994 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 736/1464] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:05 2022] PUT /identity/v3/projects/d5e08dea015240f8b29d6dca698f555e/users/c47bb66f14dc4181a423e106e2d871f3/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:06.229060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac8be7-b32e-4c51-804d-3bc4371aa453 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:06.229662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac8be7-b32e-4c51-804d-3bc4371aa453 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:06.230008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac8be7-b32e-4c51-804d-3bc4371aa453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:06.324850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9170-f989-4aeb-b282-7b95fdcf7c9d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:06.358743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a7ac8be7-b32e-4c51-804d-3bc4371aa453 None None] MFA Rules not processed for user `c47bb66f14dc4181a423e106e2d871f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:06.360031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7ac8be7-b32e-4c51-804d-3bc4371aa453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:06.511301 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 729/1465] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:06.514643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac8be7-b32e-4c51-804d-3bc4371aa453 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:06.583557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9170-f989-4aeb-b282-7b95fdcf7c9d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:06.598697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770091be-f40f-43a8-b3e5-f89c00408c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:06.600426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770091be-f40f-43a8-b3e5-f89c00408c26 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:06.601068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770091be-f40f-43a8-b3e5-f89c00408c26 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:06.601832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770091be-f40f-43a8-b3e5-f89c00408c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:06.669788 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:06.715589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac8be7-b32e-4c51-804d-3bc4371aa453 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:06.723899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a966f-2aab-4da8-99f4-744d59fe438d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:06.725907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a966f-2aab-4da8-99f4-744d59fe438d service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:06.726458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a966f-2aab-4da8-99f4-744d59fe438d service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:06.726917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a966f-2aab-4da8-99f4-744d59fe438d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:06.791290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770091be-f40f-43a8-b3e5-f89c00408c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:06.801908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770091be-f40f-43a8-b3e5-f89c00408c26 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:06.887324 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 737/1466] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:06 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:44:06.891682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770091be-f40f-43a8-b3e5-f89c00408c26 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:06.963251 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:07.047422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a966f-2aab-4da8-99f4-744d59fe438d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:07.050549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a966f-2aab-4da8-99f4-744d59fe438d service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:07.109194 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 730/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:06 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:07.170179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770091be-f40f-43a8-b3e5-f89c00408c26 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:07.197968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b43b4f-ec69-44df-8455-b5923370da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:07.198764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b43b4f-ec69-44df-8455-b5923370da86 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:07.203363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b43b4f-ec69-44df-8455-b5923370da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:07.203363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b43b4f-ec69-44df-8455-b5923370da86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:07.203363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b43b4f-ec69-44df-8455-b5923370da86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:07.212488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b43b4f-ec69-44df-8455-b5923370da86 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:07.272531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6e41-ecb0-44b2-9ec4-b1ecd2fe3012 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:07.273222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6e41-ecb0-44b2-9ec4-b1ecd2fe3012 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:07.273837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6e41-ecb0-44b2-9ec4-b1ecd2fe3012 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:07.278131 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 731/1468] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:07.284498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6e41-ecb0-44b2-9ec4-b1ecd2fe3012 None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:07.327221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6e41-ecb0-44b2-9ec4-b1ecd2fe3012 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:07.342231 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 738/1469] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:06 2022] POST /identity/v3/projects => generated 385 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:07.344576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b43b4f-ec69-44df-8455-b5923370da86 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:07.357025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6e41-ecb0-44b2-9ec4-b1ecd2fe3012 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:07.664041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fc7a5-090e-4d6d-a810-17b62d8132ba tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819cc35a92c94712b15c305cf0790b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40bfaccf90554a5a8083798d95072c10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:07.665582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fc7a5-090e-4d6d-a810-17b62d8132ba tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:07.669417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fc7a5-090e-4d6d-a810-17b62d8132ba tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:07.671304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fc7a5-090e-4d6d-a810-17b62d8132ba tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] PATH_INFO: `/v3/projects/2753fc50fce34c949198d78ead289f24` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:07.678042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fc7a5-090e-4d6d-a810-17b62d8132ba tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorizing `identity:get_project(project_id=2753fc50fce34c949198d78ead289f24)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:07.688398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fc7a5-090e-4d6d-a810-17b62d8132ba tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:07.698411 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 732/1470] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:07 2022] GET /identity/v3/projects/2753fc50fce34c949198d78ead289f24 => generated 395 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:07.703072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fc7a5-090e-4d6d-a810-17b62d8132ba tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:07.705292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b43b4f-ec69-44df-8455-b5923370da86 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:07.728577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:07.732666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:07.733254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:07.733994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] PATH_INFO: `/v3/users/293e85d461014f758ff0d0c609651bc7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:07.739803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=293e85d461014f758ff0d0c609651bc7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:07.751406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:07.753883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fc7a5-090e-4d6d-a810-17b62d8132ba tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:07.797702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641043e0-120c-4636-aa26-8a4ebb22da17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:07.798492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641043e0-120c-4636-aa26-8a4ebb22da17 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:07.802679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641043e0-120c-4636-aa26-8a4ebb22da17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:07.804821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641043e0-120c-4636-aa26-8a4ebb22da17 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:07.808355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641043e0-120c-4636-aa26-8a4ebb22da17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:07.818133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641043e0-120c-4636-aa26-8a4ebb22da17 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:07.883848 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 733/1471] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:07 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:07.890395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641043e0-120c-4636-aa26-8a4ebb22da17 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:07.920173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641043e0-120c-4636-aa26-8a4ebb22da17 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:07.920755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '293e85d461014f758ff0d0c609651bc7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:07.927434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c7b8e-bb42-4757-9de1-899aeb1edd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:07.930431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c7b8e-bb42-4757-9de1-899aeb1edd12 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:07.930732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c7b8e-bb42-4757-9de1-899aeb1edd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:07.931100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c7b8e-bb42-4757-9de1-899aeb1edd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:07.933764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c7b8e-bb42-4757-9de1-899aeb1edd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:07.938999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c7b8e-bb42-4757-9de1-899aeb1edd12 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:07.971747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '293e85d461014f758ff0d0c609651bc7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:07.980782 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 734/1472] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:07.982461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b349-3fa2-4d26-9b90-a9d836592034 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:07.982828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b349-3fa2-4d26-9b90-a9d836592034 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:07.983511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b349-3fa2-4d26-9b90-a9d836592034 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:07.989233 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 735/1473] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:07.990443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b349-3fa2-4d26-9b90-a9d836592034 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:07.998475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '293e85d461014f758ff0d0c609651bc7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:08.020750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '293e85d461014f758ff0d0c609651bc7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:08.025364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '293e85d461014f758ff0d0c609651bc7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:08.029158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b349-3fa2-4d26-9b90-a9d836592034 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:08.041418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d068c-a36d-4ffa-b6dc-d4ee77e58efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:08.044289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d068c-a36d-4ffa-b6dc-d4ee77e58efe admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:08.044650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d068c-a36d-4ffa-b6dc-d4ee77e58efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:08.045951 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 739/1474] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:07 2022] DELETE /identity/v3/users/293e85d461014f758ff0d0c609651bc7 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:08.047132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:08.051760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d068c-a36d-4ffa-b6dc-d4ee77e58efe admin admin] PATH_INFO: `/v3/projects/b6bd55618d8c4c26a1bdb12305849739/users/cec343ec67624cbb832343f770229bf6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:08.064169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:08.120128 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:08.136107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d068c-a36d-4ffa-b6dc-d4ee77e58efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bd55618d8c4c26a1bdb12305849739, user_id=cec343ec67624cbb832343f770229bf6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:08.171268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d068c-a36d-4ffa-b6dc-d4ee77e58efe admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:08.223047 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 736/1475] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:07 2022] PUT /identity/v3/projects/b6bd55618d8c4c26a1bdb12305849739/users/cec343ec67624cbb832343f770229bf6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:08.223933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e618-ab16-4bbd-8992-bc6247b8cc17 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:08.224516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e618-ab16-4bbd-8992-bc6247b8cc17 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:08.224653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e618-ab16-4bbd-8992-bc6247b8cc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:08.300457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:08.307946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:08.319527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3212e618-ab16-4bbd-8992-bc6247b8cc17 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:08.321581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3212e618-ab16-4bbd-8992-bc6247b8cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:08.396988 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:08.564531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4911c-0681-4e18-9399-1add8e37cb2f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:08.567457 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 737/1476] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:08.583091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e618-ab16-4bbd-8992-bc6247b8cc17 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:08.585318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3212e618-ab16-4bbd-8992-bc6247b8cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:08.608505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e618-ab16-4bbd-8992-bc6247b8cc17 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:08.621815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:08.626648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:08.627063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:08.627220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] PATH_INFO: `/v3/users/b983be8651fb47c8b400ce00cff7596a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:08.632666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b983be8651fb47c8b400ce00cff7596a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:08.641484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:08.728081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b983be8651fb47c8b400ce00cff7596a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:08.732951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd10ae7-2fab-4d4d-a71d-3dbd7c948ed3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819cc35a92c94712b15c305cf0790b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40bfaccf90554a5a8083798d95072c10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:08.734256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10ae7-2fab-4d4d-a71d-3dbd7c948ed3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:08.734920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10ae7-2fab-4d4d-a71d-3dbd7c948ed3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:08.735425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10ae7-2fab-4d4d-a71d-3dbd7c948ed3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] PATH_INFO: `/v3/projects/2753fc50fce34c949198d78ead289f24` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:08.738612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd10ae7-2fab-4d4d-a71d-3dbd7c948ed3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorizing `identity:get_project(project_id=2753fc50fce34c949198d78ead289f24)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:08.743534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd10ae7-2fab-4d4d-a71d-3dbd7c948ed3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:08.744891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b983be8651fb47c8b400ce00cff7596a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:08.750543 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 740/1477] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:08 2022] GET /identity/v3/projects/2753fc50fce34c949198d78ead289f24 => generated 395 bytes in 704 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:08.752194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd10ae7-2fab-4d4d-a71d-3dbd7c948ed3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:08.755406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cd10ae7-2fab-4d4d-a71d-3dbd7c948ed3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:08.756298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b983be8651fb47c8b400ce00cff7596a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:08.775815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b983be8651fb47c8b400ce00cff7596a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:08.777343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b983be8651fb47c8b400ce00cff7596a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:08.788921 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 738/1478] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:08 2022] DELETE /identity/v3/users/b983be8651fb47c8b400ce00cff7596a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:08.790043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:08.791527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd10ae7-2fab-4d4d-a71d-3dbd7c948ed3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:08.791728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:08.908136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48479a-4e27-431f-8110-a41f5363da38 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:08.915825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cbd4d-ab73-4be4-a266-210c7bd14092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:08.917414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cbd4d-ab73-4be4-a266-210c7bd14092 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:08.918531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cbd4d-ab73-4be4-a266-210c7bd14092 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:08.919081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cbd4d-ab73-4be4-a266-210c7bd14092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:08.923250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab7cbd4d-ab73-4be4-a266-210c7bd14092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:08.925463 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:08.933400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11a199-99ec-4581-a16d-f0bc1bd1cc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:08.934052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11a199-99ec-4581-a16d-f0bc1bd1cc7f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:08.934343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11a199-99ec-4581-a16d-f0bc1bd1cc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:08.934627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11a199-99ec-4581-a16d-f0bc1bd1cc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:08.935456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11a199-99ec-4581-a16d-f0bc1bd1cc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:08.937332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11a199-99ec-4581-a16d-f0bc1bd1cc7f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:08.952307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cbd4d-ab73-4be4-a266-210c7bd14092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:08.955862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cbd4d-ab73-4be4-a266-210c7bd14092 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:08.969645 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 741/1479] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:08.972266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:08.973371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:08.973849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:08.980529 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 739/1480] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:08.983412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a827d-4c45-471b-9825-fdece0e31f64 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:08.984069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a827d-4c45-471b-9825-fdece0e31f64 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:08.984790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a827d-4c45-471b-9825-fdece0e31f64 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:08.988522 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 740/1481] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:08.990076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a827d-4c45-471b-9825-fdece0e31f64 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:08.993502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc7a827d-4c45-471b-9825-fdece0e31f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:09.014140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:09.016500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:09.047606 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 742/1482] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:09.047606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:09.048297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:09.056544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a827d-4c45-471b-9825-fdece0e31f64 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:09.064772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42297f25-fa4b-4e2f-b2b8-73dfa1f00f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:09.067310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42297f25-fa4b-4e2f-b2b8-73dfa1f00f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:09.068389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42297f25-fa4b-4e2f-b2b8-73dfa1f00f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:09.069550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42297f25-fa4b-4e2f-b2b8-73dfa1f00f8a admin admin] PATH_INFO: `/v3/projects/b6bd55618d8c4c26a1bdb12305849739/users/cec343ec67624cbb832343f770229bf6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:09.075754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42297f25-fa4b-4e2f-b2b8-73dfa1f00f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bd55618d8c4c26a1bdb12305849739, user_id=cec343ec67624cbb832343f770229bf6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:09.082491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42297f25-fa4b-4e2f-b2b8-73dfa1f00f8a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:09.113181 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 741/1483] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:08 2022] PUT /identity/v3/projects/b6bd55618d8c4c26a1bdb12305849739/users/cec343ec67624cbb832343f770229bf6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:09.114123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42297f25-fa4b-4e2f-b2b8-73dfa1f00f8a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:09.182820 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:09.251978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42297f25-fa4b-4e2f-b2b8-73dfa1f00f8a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:09.258216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612a8e2-6bd0-4c9c-a416-489ac7a45838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:09.259321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612a8e2-6bd0-4c9c-a416-489ac7a45838 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:09.259662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612a8e2-6bd0-4c9c-a416-489ac7a45838 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:09.260126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612a8e2-6bd0-4c9c-a416-489ac7a45838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:09.298419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:09.304783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:09.430081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612a8e2-6bd0-4c9c-a416-489ac7a45838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:09.434080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612a8e2-6bd0-4c9c-a416-489ac7a45838 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:09.458497 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 742/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:09.462220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eac7b4-1e3c-41d8-aaab-22b72c508e7b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:09.462668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eac7b4-1e3c-41d8-aaab-22b72c508e7b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:09.463126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eac7b4-1e3c-41d8-aaab-22b72c508e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:09.489509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee753-4c01-48dd-a831-c535317af9ed None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:09.516718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-15eac7b4-1e3c-41d8-aaab-22b72c508e7b None None] MFA Rules not processed for user `cec343ec67624cbb832343f770229bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:09.518015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-15eac7b4-1e3c-41d8-aaab-22b72c508e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:09.636117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7540ef-16eb-43a5-ada0-2219495c2a77 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819cc35a92c94712b15c305cf0790b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40bfaccf90554a5a8083798d95072c10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:09.638456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7540ef-16eb-43a5-ada0-2219495c2a77 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:09.639889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7540ef-16eb-43a5-ada0-2219495c2a77 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:09.640442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7540ef-16eb-43a5-ada0-2219495c2a77 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] PATH_INFO: `/v3/projects/2753fc50fce34c949198d78ead289f24` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:09.642118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7540ef-16eb-43a5-ada0-2219495c2a77 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorizing `identity:get_project(project_id=2753fc50fce34c949198d78ead289f24)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:09.644614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7540ef-16eb-43a5-ada0-2219495c2a77 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:09.648209 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 743/1485] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:09 2022] GET /identity/v3/projects/2753fc50fce34c949198d78ead289f24 => generated 395 bytes in 603 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:09.724405 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 743/1486] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:09.745320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7540ef-16eb-43a5-ada0-2219495c2a77 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:09.748316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4b7540ef-16eb-43a5-ada0-2219495c2a77 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:09.835119 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:09.916997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eac7b4-1e3c-41d8-aaab-22b72c508e7b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:09.922558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-15eac7b4-1e3c-41d8-aaab-22b72c508e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:09.971916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eac7b4-1e3c-41d8-aaab-22b72c508e7b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:09.992399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:09.995405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:09.999439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:10.000780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] PATH_INFO: `/v3/projects/d6737859002b432aa18d1ce98ca7ad37` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:10.003244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6737859002b432aa18d1ce98ca7ad37)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:10.007955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:10.035995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7540ef-16eb-43a5-ada0-2219495c2a77 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:10.091410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff8dc0-3354-41d8-a201-63a0db058681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:10.095552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff8dc0-3354-41d8-a201-63a0db058681 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:10.101129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff8dc0-3354-41d8-a201-63a0db058681 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:10.101129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff8dc0-3354-41d8-a201-63a0db058681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:10.146609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff8dc0-3354-41d8-a201-63a0db058681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:10.157044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff8dc0-3354-41d8-a201-63a0db058681 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:10.226205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6737859002b432aa18d1ce98ca7ad37', 'request_id': 'req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.230533 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 744/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:10.246156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6737859002b432aa18d1ce98ca7ad37', 'request_id': 'req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.253530 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:10.257291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6737859002b432aa18d1ce98ca7ad37', 'request_id': 'req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.284192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] The token cache is being invalidate because project d6737859002b432aa18d1ce98ca7ad37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:10.286731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.289506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.294912 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 744/1488] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:09 2022] DELETE /identity/v3/projects/d6737859002b432aa18d1ce98ca7ad37 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:10.298964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff8dc0-3354-41d8-a201-63a0db058681 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:10.341980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff8dc0-3354-41d8-a201-63a0db058681 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:10.381472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:10.383387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:10.505164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:10.505896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:10.506174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:10.506449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] PATH_INFO: `/v3/users/60b65333a2044b69ae55138e224c1532` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:10.507780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b65333a2044b69ae55138e224c1532)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:10.509868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:10.606580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b65333a2044b69ae55138e224c1532'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.630383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b65333a2044b69ae55138e224c1532'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.644909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b65333a2044b69ae55138e224c1532'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.671782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b65333a2044b69ae55138e224c1532'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.673954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23344a-ff58-42fe-b9d9-ab9f9ab7c69d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:10.675436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b65333a2044b69ae55138e224c1532'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.686849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:10.695371 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 745/1489] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:10 2022] DELETE /identity/v3/users/60b65333a2044b69ae55138e224c1532 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:10.695371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:10.695707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:10.695707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:10.695707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] PATH_INFO: `/v3/projects/f092e266f25545dea290f34ea233a412` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:10.695962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:10.713188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f092e266f25545dea290f34ea233a412)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:10.723619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:10.799360 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:10.896080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f092e266f25545dea290f34ea233a412', 'request_id': 'req-0cb457f7-14e8-4f51-a840-c570009f10ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.913428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f092e266f25545dea290f34ea233a412', 'request_id': 'req-0cb457f7-14e8-4f51-a840-c570009f10ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.921333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce3bb2-77b4-4a5c-810b-90c99f8ac376 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:10.938579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f092e266f25545dea290f34ea233a412', 'request_id': 'req-0cb457f7-14e8-4f51-a840-c570009f10ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.968860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] The token cache is being invalidate because project f092e266f25545dea290f34ea233a412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:10.971670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.973667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:10.977088 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 745/1490] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:10 2022] DELETE /identity/v3/projects/f092e266f25545dea290f34ea233a412 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:44:10.984396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:10.988964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:11.119354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:11.120191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:11.120341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:11.121243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:11.123418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:11.160803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb457f7-14e8-4f51-a840-c570009f10ef admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:11.180715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:11.183557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:11.184738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:11.188098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] PATH_INFO: `/v3/users/8533645267d345a2a5d8e961e92858e8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:11.194089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8533645267d345a2a5d8e961e92858e8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:11.200497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:11.242166 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:11.250181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:11.254856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:11.290329 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 746/1491] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:10 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:11.324069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8533645267d345a2a5d8e961e92858e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.346911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:11.349643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:11.359450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8533645267d345a2a5d8e961e92858e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.380816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8533645267d345a2a5d8e961e92858e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.384082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63fe1a-0300-4f6b-9890-cab6a32f9cfc service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:11.395321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:11.395713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8533645267d345a2a5d8e961e92858e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.396687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:11.397202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:11.397679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] PATH_INFO: `/v3/projects/8ebf327abdc74e5a8daf3d3be6cf2fb6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:11.402608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ebf327abdc74e5a8daf3d3be6cf2fb6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:11.408385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:11.408750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8533645267d345a2a5d8e961e92858e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.428045 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 746/1492] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:10 2022] DELETE /identity/v3/users/8533645267d345a2a5d8e961e92858e8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:11.432014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:11.433684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:11.523666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ebf327abdc74e5a8daf3d3be6cf2fb6', 'request_id': 'req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.541435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ebf327abdc74e5a8daf3d3be6cf2fb6', 'request_id': 'req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.580243 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:11.583522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ebf327abdc74e5a8daf3d3be6cf2fb6', 'request_id': 'req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.627112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] The token cache is being invalidate because project 8ebf327abdc74e5a8daf3d3be6cf2fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:11.627623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.632488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38bab641-fb93-4ae9-9d29-fce6f4c1b7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.636910 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 747/1493] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:11 2022] DELETE /identity/v3/projects/8ebf327abdc74e5a8daf3d3be6cf2fb6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:11.642659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe28b3-cba0-4176-9500-741fa5237fc5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:11.643035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe28b3-cba0-4176-9500-741fa5237fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:11.643312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe28b3-cba0-4176-9500-741fa5237fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:11.661978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607560-918f-48cb-bba1-ede98b0c34d7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:11.679020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cdfe28b3-cba0-4176-9500-741fa5237fc5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:11.683880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cdfe28b3-cba0-4176-9500-741fa5237fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:11.826092 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 748/1494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:44:11.826092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb58e07-09b4-43b0-8713-d80f4695eca3 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:11.826092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb58e07-09b4-43b0-8713-d80f4695eca3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:11.826092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb58e07-09b4-43b0-8713-d80f4695eca3 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:11.829170 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 749/1495] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:11.831808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:11.832796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:11.833124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:11.843242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:11.843920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:11.844479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:11.844898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] PATH_INFO: `/v3/users/c47bb66f14dc4181a423e106e2d871f3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:11.846388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47bb66f14dc4181a423e106e2d871f3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:11.848344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:11.895792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:11.899398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:11.919790 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 750/1496] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:11.921531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:11.923567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:11.930514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47bb66f14dc4181a423e106e2d871f3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.935022 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:11.967165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47bb66f14dc4181a423e106e2d871f3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:11.993753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47bb66f14dc4181a423e106e2d871f3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:12.011980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47bb66f14dc4181a423e106e2d871f3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:12.014038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47bb66f14dc4181a423e106e2d871f3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:12.033113 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 747/1497] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:11 2022] DELETE /identity/v3/users/c47bb66f14dc4181a423e106e2d871f3 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:12.033948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:12.035507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.112225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:12.113803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.143650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423fa1e-3e90-4ec6-bc2d-3e6175e60531 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:12.148846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:12.149489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.149775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.150054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.150766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:12.151038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:12.153384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:12.170566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 748/1498] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:12.171583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:12.174380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.191118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51506d-bcad-4635-8ddc-794a368fe3ca admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:12.197443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:12.198619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.199589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.199958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] PATH_INFO: `/v3/projects/7d08aea89a6f46a2a89d93c91c5f874d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.201446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d08aea89a6f46a2a89d93c91c5f874d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:12.201620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6922b-91f7-4c70-922d-ae5fc2342405 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:12.204103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:12.239143 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:12.287264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d08aea89a6f46a2a89d93c91c5f874d', 'request_id': 'req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:12.287962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff26f69-7205-4142-8ce3-f041d39d8b94 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819cc35a92c94712b15c305cf0790b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40bfaccf90554a5a8083798d95072c10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:12.288914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff26f69-7205-4142-8ce3-f041d39d8b94 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.289385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff26f69-7205-4142-8ce3-f041d39d8b94 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.289857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff26f69-7205-4142-8ce3-f041d39d8b94 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] PATH_INFO: `/v3/projects/2753fc50fce34c949198d78ead289f24` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.291624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff26f69-7205-4142-8ce3-f041d39d8b94 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorizing `identity:get_project(project_id=2753fc50fce34c949198d78ead289f24)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:12.295005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff26f69-7205-4142-8ce3-f041d39d8b94 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:12.297081 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 751/1499] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:11 2022] GET /identity/v3/projects/2753fc50fce34c949198d78ead289f24 => generated 395 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:12.301914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d08aea89a6f46a2a89d93c91c5f874d', 'request_id': 'req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:12.302543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41259-3a30-4a7e-b1ec-0dae94dd26b7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.304157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41259-3a30-4a7e-b1ec-0dae94dd26b7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.304157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41259-3a30-4a7e-b1ec-0dae94dd26b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.314603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d08aea89a6f46a2a89d93c91c5f874d', 'request_id': 'req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:12.341345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] The token cache is being invalidate because project 7d08aea89a6f46a2a89d93c91c5f874d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:12.341345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:12.341345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec3510cb-7bc0-4b7d-8274-4ec57f8657e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:12.349861 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 749/1500] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:12 2022] DELETE /identity/v3/projects/7d08aea89a6f46a2a89d93c91c5f874d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:12.349861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c82b8-9ffb-4de8-9805-88a5a4b9e4f6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.349861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c82b8-9ffb-4de8-9805-88a5a4b9e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.349861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c82b8-9ffb-4de8-9805-88a5a4b9e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.352352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0aa41259-3a30-4a7e-b1ec-0dae94dd26b7 None None] MFA Rules not processed for user `2785a638c2a3448ca63e04e749ce01dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:12.356192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0aa41259-3a30-4a7e-b1ec-0dae94dd26b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.385706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fc2c82b8-9ffb-4de8-9805-88a5a4b9e4f6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:12.388164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fc2c82b8-9ffb-4de8-9805-88a5a4b9e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.437183 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:12.467022 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 752/1501] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:12.468336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41259-3a30-4a7e-b1ec-0dae94dd26b7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:12.474258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0aa41259-3a30-4a7e-b1ec-0dae94dd26b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.481626 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 750/1502] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:12.481626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8e5e-5d79-402e-840e-aad81f6cdbc0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.481626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8e5e-5d79-402e-840e-aad81f6cdbc0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.481626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8e5e-5d79-402e-840e-aad81f6cdbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.512048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41259-3a30-4a7e-b1ec-0dae94dd26b7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:12.519434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-575e8e5e-5d79-402e-840e-aad81f6cdbc0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:12.521489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-575e8e5e-5d79-402e-840e-aad81f6cdbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.522144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc06672-9393-4792-ac26-3b3dd2e38657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:12.523223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc06672-9393-4792-ac26-3b3dd2e38657 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.523730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc06672-9393-4792-ac26-3b3dd2e38657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.524231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc06672-9393-4792-ac26-3b3dd2e38657 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.525527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc06672-9393-4792-ac26-3b3dd2e38657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:12.532501 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 751/1503] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:12.533146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc06672-9393-4792-ac26-3b3dd2e38657 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:12.535380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8e42-f2e7-4247-8c82-8e2d9f2340df None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.536046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8e42-f2e7-4247-8c82-8e2d9f2340df None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.536502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8e42-f2e7-4247-8c82-8e2d9f2340df None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.539047 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 752/1504] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:12.540018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8e42-f2e7-4247-8c82-8e2d9f2340df None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:12.541963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7f5c8e42-f2e7-4247-8c82-8e2d9f2340df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.600387 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 753/1505] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:12 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:12.602119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc06672-9393-4792-ac26-3b3dd2e38657 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:12.604220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fdc06672-9393-4792-ac26-3b3dd2e38657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.677333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8e42-f2e7-4247-8c82-8e2d9f2340df None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:12.689539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc06672-9393-4792-ac26-3b3dd2e38657 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:12.694405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65ca81-0c80-4cc2-a3f9-9564d83acc22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:12.695398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ca81-0c80-4cc2-a3f9-9564d83acc22 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.695802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ca81-0c80-4cc2-a3f9-9564d83acc22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.696153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65ca81-0c80-4cc2-a3f9-9564d83acc22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.761736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:12.762524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.762807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.763212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.765855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.776925 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:12.810356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65ca81-0c80-4cc2-a3f9-9564d83acc22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:12.813249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65ca81-0c80-4cc2-a3f9-9564d83acc22 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:12.832980 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 754/1506] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:12.835546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727f9a8-1679-4d31-9956-b3fbd4106446 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.836039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727f9a8-1679-4d31-9956-b3fbd4106446 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.836522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727f9a8-1679-4d31-9956-b3fbd4106446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.846279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:12.850006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:12.873381 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 753/1507] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:12 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:12.877103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:12.879386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a727f9a8-1679-4d31-9956-b3fbd4106446 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:12.881061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.883100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a727f9a8-1679-4d31-9956-b3fbd4106446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.903566 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 755/1508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:12.904422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727f9a8-1679-4d31-9956-b3fbd4106446 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:12.918148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727f9a8-1679-4d31-9956-b3fbd4106446 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:12.923370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:12.923659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704b12d-c5ef-4374-9c7a-6ce99fe16591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:12.924142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704b12d-c5ef-4374-9c7a-6ce99fe16591 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:12.924462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704b12d-c5ef-4374-9c7a-6ce99fe16591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:12.924732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704b12d-c5ef-4374-9c7a-6ce99fe16591 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:12.925378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704b12d-c5ef-4374-9c7a-6ce99fe16591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:12.925682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:12.927737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704b12d-c5ef-4374-9c7a-6ce99fe16591 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:12.949720 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:12.968437 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 756/1509] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:12 2022] POST /identity/v3/users => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:12.969370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704b12d-c5ef-4374-9c7a-6ce99fe16591 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.004846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704b12d-c5ef-4374-9c7a-6ce99fe16591 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.020377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88414e06-5768-414a-9a13-1a056b558be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.021058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88414e06-5768-414a-9a13-1a056b558be9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.021543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88414e06-5768-414a-9a13-1a056b558be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.021957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88414e06-5768-414a-9a13-1a056b558be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.022843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88414e06-5768-414a-9a13-1a056b558be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:13.023154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88414e06-5768-414a-9a13-1a056b558be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.024847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88414e06-5768-414a-9a13-1a056b558be9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.057479 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 757/1510] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:13.059024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88414e06-5768-414a-9a13-1a056b558be9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.071962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88414e06-5768-414a-9a13-1a056b558be9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.080228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676224-6a68-4a73-9bc8-667914ef0161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.080950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676224-6a68-4a73-9bc8-667914ef0161 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.081235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676224-6a68-4a73-9bc8-667914ef0161 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.081537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676224-6a68-4a73-9bc8-667914ef0161 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.082262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676224-6a68-4a73-9bc8-667914ef0161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.083958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676224-6a68-4a73-9bc8-667914ef0161 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.098782 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 758/1511] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:13.099831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676224-6a68-4a73-9bc8-667914ef0161 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.119476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676224-6a68-4a73-9bc8-667914ef0161 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.135267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1ac13-1415-4c94-a6bd-a94abc425c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.135916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1ac13-1415-4c94-a6bd-a94abc425c77 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.136263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1ac13-1415-4c94-a6bd-a94abc425c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.136547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1ac13-1415-4c94-a6bd-a94abc425c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.137405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1ac13-1415-4c94-a6bd-a94abc425c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.139528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1ac13-1415-4c94-a6bd-a94abc425c77 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.155878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730da10a-eb7b-4eb2-9b8e-bd48b4640246 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.170602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa7e7-d52a-4cce-96b0-100d0c028a63 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819cc35a92c94712b15c305cf0790b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40bfaccf90554a5a8083798d95072c10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.171274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa7e7-d52a-4cce-96b0-100d0c028a63 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.171560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa7e7-d52a-4cce-96b0-100d0c028a63 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.171840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa7e7-d52a-4cce-96b0-100d0c028a63 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] PATH_INFO: `/v3/projects/2753fc50fce34c949198d78ead289f24` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.174789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa7e7-d52a-4cce-96b0-100d0c028a63 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorizing `identity:get_project(project_id=2753fc50fce34c949198d78ead289f24)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.178687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa7e7-d52a-4cce-96b0-100d0c028a63 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.182589 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 754/1512] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:12 2022] GET /identity/v3/projects/2753fc50fce34c949198d78ead289f24 => generated 395 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:13.183846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa7e7-d52a-4cce-96b0-100d0c028a63 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.202106 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 759/1513] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:13 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:13.206866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1ac13-1415-4c94-a6bd-a94abc425c77 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.214332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa7e7-d52a-4cce-96b0-100d0c028a63 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.296917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1ac13-1415-4c94-a6bd-a94abc425c77 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.306053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bea3fd-f1f3-4fb9-93ae-55dc11c498dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.307582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bea3fd-f1f3-4fb9-93ae-55dc11c498dc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.309095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bea3fd-f1f3-4fb9-93ae-55dc11c498dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.309738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bea3fd-f1f3-4fb9-93ae-55dc11c498dc admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.311231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bea3fd-f1f3-4fb9-93ae-55dc11c498dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.315235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bea3fd-f1f3-4fb9-93ae-55dc11c498dc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.373659 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 760/1514] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:13 2022] POST /identity/v3/users => generated 304 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:13.374703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bea3fd-f1f3-4fb9-93ae-55dc11c498dc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.393111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae2b2a-880b-4101-9d98-15a0865b9ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.395245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae2b2a-880b-4101-9d98-15a0865b9ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.403148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae2b2a-880b-4101-9d98-15a0865b9ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.403974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae2b2a-880b-4101-9d98-15a0865b9ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.405610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae2b2a-880b-4101-9d98-15a0865b9ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.420378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae2b2a-880b-4101-9d98-15a0865b9ca7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.451422 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 755/1515] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:13.453437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae2b2a-880b-4101-9d98-15a0865b9ca7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.473115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae2b2a-880b-4101-9d98-15a0865b9ca7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.481757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26115a6-856b-420d-80ff-880fc413b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.482999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26115a6-856b-420d-80ff-880fc413b5ac admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.483577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26115a6-856b-420d-80ff-880fc413b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.484189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26115a6-856b-420d-80ff-880fc413b5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.485625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26115a6-856b-420d-80ff-880fc413b5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.489069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26115a6-856b-420d-80ff-880fc413b5ac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.507350 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:13.519844 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 756/1516] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:13.528237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26115a6-856b-420d-80ff-880fc413b5ac admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.531628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a26115a6-856b-420d-80ff-880fc413b5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:13.558448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26115a6-856b-420d-80ff-880fc413b5ac admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.569973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.571710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.571873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.572664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] PATH_INFO: `/v3/projects/d5e08dea015240f8b29d6dca698f555e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.575614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e08dea015240f8b29d6dca698f555e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.579979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.580512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bea3fd-f1f3-4fb9-93ae-55dc11c498dc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.590740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826f5d3-30b3-48b0-909e-3a0e1cc86c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.592489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826f5d3-30b3-48b0-909e-3a0e1cc86c63 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.593098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826f5d3-30b3-48b0-909e-3a0e1cc86c63 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.593546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826f5d3-30b3-48b0-909e-3a0e1cc86c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.754311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826f5d3-30b3-48b0-909e-3a0e1cc86c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.756494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826f5d3-30b3-48b0-909e-3a0e1cc86c63 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.765147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e08dea015240f8b29d6dca698f555e', 'request_id': 'req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:13.781456 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 761/1517] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:13.782453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e08dea015240f8b29d6dca698f555e', 'request_id': 'req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:13.783519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826f5d3-30b3-48b0-909e-3a0e1cc86c63 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.799284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e08dea015240f8b29d6dca698f555e', 'request_id': 'req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:13.804688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826f5d3-30b3-48b0-909e-3a0e1cc86c63 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:13.821725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] The token cache is being invalidate because project d5e08dea015240f8b29d6dca698f555e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:13.822222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:13.826262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:13.828812 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 757/1518] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:13 2022] DELETE /identity/v3/projects/d5e08dea015240f8b29d6dca698f555e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:13.830637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.833363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:13.883294 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:13.898068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461840b5-f6cc-4550-9a11-a180409b17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:13.899208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461840b5-f6cc-4550-9a11-a180409b17a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.899502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461840b5-f6cc-4550-9a11-a180409b17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.899783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461840b5-f6cc-4550-9a11-a180409b17a0 admin admin] PATH_INFO: `/v3/projects/fd215e75fbda44c9a04e669cde1dfaa1/users/c5bef756c5c74e688ded867d98a6d29a/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.926357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461840b5-f6cc-4550-9a11-a180409b17a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd215e75fbda44c9a04e669cde1dfaa1, user_id=c5bef756c5c74e688ded867d98a6d29a, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:13.930599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461840b5-f6cc-4550-9a11-a180409b17a0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:13.956692 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 762/1519] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:13 2022] PUT /identity/v3/projects/fd215e75fbda44c9a04e669cde1dfaa1/users/c5bef756c5c74e688ded867d98a6d29a/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:13.956692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45a67-e263-4571-b9ae-d066acc741ab None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:13.957089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45a67-e263-4571-b9ae-d066acc741ab None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:13.957089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45a67-e263-4571-b9ae-d066acc741ab None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:13.959103 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 763/1520] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:13.959731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45a67-e263-4571-b9ae-d066acc741ab None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:13.964854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-48f45a67-e263-4571-b9ae-d066acc741ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:13.987907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c82554-47d7-4e24-a5b5-7acfc7bfc3e4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:14.080180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ea2a-2f2e-4db2-91ee-afdbc78fa968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:14.081272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ea2a-2f2e-4db2-91ee-afdbc78fa968 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:14.081722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ea2a-2f2e-4db2-91ee-afdbc78fa968 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:14.082155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ea2a-2f2e-4db2-91ee-afdbc78fa968 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:14.083092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ea2a-2f2e-4db2-91ee-afdbc78fa968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:14.085026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ea2a-2f2e-4db2-91ee-afdbc78fa968 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:14.104285 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 758/1521] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:14.106636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45a67-e263-4571-b9ae-d066acc741ab None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:14.106836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8e977-b89d-4c84-b1ea-d1ed668a29ec None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:14.107266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8e977-b89d-4c84-b1ea-d1ed668a29ec None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:14.107702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8e977-b89d-4c84-b1ea-d1ed668a29ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:14.118048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:14.119102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:14.119574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:14.120022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] PATH_INFO: `/v3/users/cec343ec67624cbb832343f770229bf6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:14.122917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec343ec67624cbb832343f770229bf6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:14.126605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:14.148361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5cc8e977-b89d-4c84-b1ea-d1ed668a29ec None None] MFA Rules not processed for user `c5bef756c5c74e688ded867d98a6d29a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:14.149954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5cc8e977-b89d-4c84-b1ea-d1ed668a29ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:14.183724 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:14.257429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec343ec67624cbb832343f770229bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:14.279525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec343ec67624cbb832343f770229bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:14.292324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec343ec67624cbb832343f770229bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:14.303910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec343ec67624cbb832343f770229bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:14.305139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec343ec67624cbb832343f770229bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:14.316525 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 764/1522] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:13 2022] DELETE /identity/v3/users/cec343ec67624cbb832343f770229bf6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:14.318314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:14.321514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:14.324470 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 759/1523] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:14.326451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8e977-b89d-4c84-b1ea-d1ed668a29ec None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:14.366585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8e977-b89d-4c84-b1ea-d1ed668a29ec None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:14.503646 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:14.537641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:14.539529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:14.544155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e542ce4-2119-4dbe-9203-a54a2e1633a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:14.547971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e542ce4-2119-4dbe-9203-a54a2e1633a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:14.548835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e542ce4-2119-4dbe-9203-a54a2e1633a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:14.549614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e542ce4-2119-4dbe-9203-a54a2e1633a0 admin admin] PATH_INFO: `/v3/projects/fe2dcb0cfc58456aae5afdc226600eec/users/27b94e8a05964ad1b2c9a27341b48d90/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:14.618274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e542ce4-2119-4dbe-9203-a54a2e1633a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2dcb0cfc58456aae5afdc226600eec, user_id=27b94e8a05964ad1b2c9a27341b48d90, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:14.624102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e542ce4-2119-4dbe-9203-a54a2e1633a0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:14.658625 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 760/1524] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:14 2022] PUT /identity/v3/projects/fe2dcb0cfc58456aae5afdc226600eec/users/27b94e8a05964ad1b2c9a27341b48d90/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:14.660649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e542ce4-2119-4dbe-9203-a54a2e1633a0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:14.665520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6e542ce4-2119-4dbe-9203-a54a2e1633a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:14.712290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d9ebe-4b7d-4b92-8e0d-0b671a83c485 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:14.784156 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:14.864035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e542ce4-2119-4dbe-9203-a54a2e1633a0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:14.877218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ed5aa-635b-48f7-bf93-1ee0eece8b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:14.877881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed5aa-635b-48f7-bf93-1ee0eece8b85 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:14.878173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed5aa-635b-48f7-bf93-1ee0eece8b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:14.878449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed5aa-635b-48f7-bf93-1ee0eece8b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:14.880777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f8cef-483b-4af7-9847-ba63cfbc2eb0 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819cc35a92c94712b15c305cf0790b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40bfaccf90554a5a8083798d95072c10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:14.881032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ed5aa-635b-48f7-bf93-1ee0eece8b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:14.881758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f8cef-483b-4af7-9847-ba63cfbc2eb0 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:14.882234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f8cef-483b-4af7-9847-ba63cfbc2eb0 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:14.882414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ed5aa-635b-48f7-bf93-1ee0eece8b85 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:14.882848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f8cef-483b-4af7-9847-ba63cfbc2eb0 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] PATH_INFO: `/v3/projects/0573aaefe05443c5840f4e1fa532606b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:14.885715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f8cef-483b-4af7-9847-ba63cfbc2eb0 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorizing `identity:get_project(project_id=0573aaefe05443c5840f4e1fa532606b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:14.893046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f8cef-483b-4af7-9847-ba63cfbc2eb0 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:14.902814 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 765/1525] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:14 2022] GET /identity/v3/projects/0573aaefe05443c5840f4e1fa532606b => generated 395 bytes in 585 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:14.907938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e994e00-600d-499f-ab47-a9c83ed860c7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:14.908661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e994e00-600d-499f-ab47-a9c83ed860c7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:14.909723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e994e00-600d-499f-ab47-a9c83ed860c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:14.929362 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 761/1526] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:14 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:14.939389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ed5aa-635b-48f7-bf93-1ee0eece8b85 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:15.015160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2e994e00-600d-499f-ab47-a9c83ed860c7 None None] MFA Rules not processed for user `27b94e8a05964ad1b2c9a27341b48d90`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:15.017365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2e994e00-600d-499f-ab47-a9c83ed860c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.121147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ed5aa-635b-48f7-bf93-1ee0eece8b85 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:15.133996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e407df7-11e1-47d9-9952-eee8ab0b07e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:15.137012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407df7-11e1-47d9-9952-eee8ab0b07e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.139731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407df7-11e1-47d9-9952-eee8ab0b07e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.139731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407df7-11e1-47d9-9952-eee8ab0b07e3 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:15.140116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e407df7-11e1-47d9-9952-eee8ab0b07e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:15.143289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e407df7-11e1-47d9-9952-eee8ab0b07e3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:15.176103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 762/1527] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:14 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:44:15.180034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e407df7-11e1-47d9-9952-eee8ab0b07e3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:15.181860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3e407df7-11e1-47d9-9952-eee8ab0b07e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.203343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e407df7-11e1-47d9-9952-eee8ab0b07e3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:15.208973 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 766/1528] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:14 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:15.210218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e994e00-600d-499f-ab47-a9c83ed860c7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:15.216185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:15.217300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2e994e00-600d-499f-ab47-a9c83ed860c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.219529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.219827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.220124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] PATH_INFO: `/v3/users/29847de2c3704348a07b66256a607223` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:15.223229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=29847de2c3704348a07b66256a607223)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:15.225373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:15.244537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e994e00-600d-499f-ab47-a9c83ed860c7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:15.268799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:15.270390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.270889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.271365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] PATH_INFO: `/v3/projects/b6bd55618d8c4c26a1bdb12305849739` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:15.273102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bd55618d8c4c26a1bdb12305849739)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:15.275415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:15.327670 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:15.333308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29847de2c3704348a07b66256a607223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.364059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29847de2c3704348a07b66256a607223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.385633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29847de2c3704348a07b66256a607223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.388775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bd55618d8c4c26a1bdb12305849739', 'request_id': 'req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.404776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bd55618d8c4c26a1bdb12305849739', 'request_id': 'req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.404925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29847de2c3704348a07b66256a607223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.405886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29847de2c3704348a07b66256a607223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.417930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bd55618d8c4c26a1bdb12305849739', 'request_id': 'req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.425531 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 763/1529] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:15 2022] DELETE /identity/v3/users/29847de2c3704348a07b66256a607223 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:15.425531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:15.427866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.436594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] The token cache is being invalidate because project b6bd55618d8c4c26a1bdb12305849739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:15.437077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.438259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:15.440679 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 767/1530] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:15 2022] DELETE /identity/v3/projects/b6bd55618d8c4c26a1bdb12305849739 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:15.443009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:15.445083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.612333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b3f7-cd29-41ed-a243-8a1755f16e4c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:15.618268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef4bf-5038-4b6a-83aa-b9b9aa520c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:15.619263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef4bf-5038-4b6a-83aa-b9b9aa520c31 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.619775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef4bf-5038-4b6a-83aa-b9b9aa520c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.620245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef4bf-5038-4b6a-83aa-b9b9aa520c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:15.622108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ef4bf-5038-4b6a-83aa-b9b9aa520c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:15.624261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ef4bf-5038-4b6a-83aa-b9b9aa520c31 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:15.647935 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 764/1531] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:15.649794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f7fa-1176-4056-94ef-fe8ce27c76b3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.650320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f7fa-1176-4056-94ef-fe8ce27c76b3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.650843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f7fa-1176-4056-94ef-fe8ce27c76b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:15.686560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6587f7fa-1176-4056-94ef-fe8ce27c76b3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:15.688789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6587f7fa-1176-4056-94ef-fe8ce27c76b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.711533 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 765/1532] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:15.714203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc4c2d-00e2-499f-bd3c-0d20500fec1c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.714693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc4c2d-00e2-499f-bd3c-0d20500fec1c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.715387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc4c2d-00e2-499f-bd3c-0d20500fec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:15.752533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f9bc4c2d-00e2-499f-bd3c-0d20500fec1c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:15.754075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f9bc4c2d-00e2-499f-bd3c-0d20500fec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.768683 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 766/1533] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:15.769415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc4c2d-00e2-499f-bd3c-0d20500fec1c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:15.771435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f9bc4c2d-00e2-499f-bd3c-0d20500fec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.786179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc4c2d-00e2-499f-bd3c-0d20500fec1c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:15.793654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8953b-0a53-4cc5-bb0e-fa3c1028bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:15.794467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8953b-0a53-4cc5-bb0e-fa3c1028bfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.794801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8953b-0a53-4cc5-bb0e-fa3c1028bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.796263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8953b-0a53-4cc5-bb0e-fa3c1028bfbb admin admin] PATH_INFO: `/v3/projects/5f2fec863e8446128e270320b0ef204d/users/886050a9ea1a46428ee4927b2e5fdbe7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:15.797900 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:15.824236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8953b-0a53-4cc5-bb0e-fa3c1028bfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2fec863e8446128e270320b0ef204d, user_id=886050a9ea1a46428ee4927b2e5fdbe7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:15.827504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8953b-0a53-4cc5-bb0e-fa3c1028bfbb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:15.828342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be8696-f8b8-40ab-b4bc-ac9eaf16e8f2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:15.839211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4bf7e-ad1e-4c33-a073-3b6065e2d057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:15.841293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4bf7e-ad1e-4c33-a073-3b6065e2d057 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.841787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4bf7e-ad1e-4c33-a073-3b6065e2d057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.842843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4bf7e-ad1e-4c33-a073-3b6065e2d057 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:15.846196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4bf7e-ad1e-4c33-a073-3b6065e2d057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:15.846523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4bf7e-ad1e-4c33-a073-3b6065e2d057 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:15.857010 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 767/1534] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:15 2022] PUT /identity/v3/projects/5f2fec863e8446128e270320b0ef204d/users/886050a9ea1a46428ee4927b2e5fdbe7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:15.859371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8953b-0a53-4cc5-bb0e-fa3c1028bfbb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:15.862162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f4f8953b-0a53-4cc5-bb0e-fa3c1028bfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.941725 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 768/1535] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:15 2022] POST /identity/v3/projects => generated 409 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:15.946723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425a619-2303-4ef0-bee3-ecb7d091fc49 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.947241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425a619-2303-4ef0-bee3-ecb7d091fc49 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.947735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425a619-2303-4ef0-bee3-ecb7d091fc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.009986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3425a619-2303-4ef0-bee3-ecb7d091fc49 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:16.011837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3425a619-2303-4ef0-bee3-ecb7d091fc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:16.027720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8953b-0a53-4cc5-bb0e-fa3c1028bfbb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.107822 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:16.140477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cce59-9c38-4e2d-a8c4-66bfa1e55964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.142150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cce59-9c38-4e2d-a8c4-66bfa1e55964 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.143747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cce59-9c38-4e2d-a8c4-66bfa1e55964 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.144392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cce59-9c38-4e2d-a8c4-66bfa1e55964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.145867 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 769/1536] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:16.146717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425a619-2303-4ef0-bee3-ecb7d091fc49 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.163971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cce59-9c38-4e2d-a8c4-66bfa1e55964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.164184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425a619-2303-4ef0-bee3-ecb7d091fc49 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.166221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cce59-9c38-4e2d-a8c4-66bfa1e55964 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.171610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137e737-b534-4d3b-8dd7-b087e3d575fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.172563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e737-b534-4d3b-8dd7-b087e3d575fa admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.173558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e737-b534-4d3b-8dd7-b087e3d575fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.173856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e737-b534-4d3b-8dd7-b087e3d575fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.174556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137e737-b534-4d3b-8dd7-b087e3d575fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.176830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137e737-b534-4d3b-8dd7-b087e3d575fa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.179640 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 768/1537] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:16.180729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cce59-9c38-4e2d-a8c4-66bfa1e55964 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.205180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cce59-9c38-4e2d-a8c4-66bfa1e55964 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.212673 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 770/1538] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:16.212673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137e737-b534-4d3b-8dd7-b087e3d575fa admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.219251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54572838-3907-4b17-a12f-ca91732b4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.221904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572838-3907-4b17-a12f-ca91732b4fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.222460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572838-3907-4b17-a12f-ca91732b4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.224820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572838-3907-4b17-a12f-ca91732b4fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.226044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54572838-3907-4b17-a12f-ca91732b4fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.231892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54572838-3907-4b17-a12f-ca91732b4fc3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.243418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137e737-b534-4d3b-8dd7-b087e3d575fa admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.257537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8f80f-0baa-4f62-80fc-85d6d843a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.258162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f80f-0baa-4f62-80fc-85d6d843a744 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.258439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f80f-0baa-4f62-80fc-85d6d843a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.258717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f80f-0baa-4f62-80fc-85d6d843a744 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.260886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8f80f-0baa-4f62-80fc-85d6d843a744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:16.264222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8f80f-0baa-4f62-80fc-85d6d843a744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.268263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8f80f-0baa-4f62-80fc-85d6d843a744 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.292434 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 769/1539] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:16 2022] POST /identity/v3/users => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:16.293772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54572838-3907-4b17-a12f-ca91732b4fc3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.307944 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 771/1540] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:16.309999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8f80f-0baa-4f62-80fc-85d6d843a744 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.326540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54572838-3907-4b17-a12f-ca91732b4fc3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.337082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408779b0-c849-401f-9ea6-d6594cee3beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.338153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408779b0-c849-401f-9ea6-d6594cee3beb admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.339760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408779b0-c849-401f-9ea6-d6594cee3beb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.340566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408779b0-c849-401f-9ea6-d6594cee3beb admin admin] PATH_INFO: `/v3/projects/5f2fec863e8446128e270320b0ef204d/users/886050a9ea1a46428ee4927b2e5fdbe7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.342614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8f80f-0baa-4f62-80fc-85d6d843a744 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.347821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408779b0-c849-401f-9ea6-d6594cee3beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2fec863e8446128e270320b0ef204d, user_id=886050a9ea1a46428ee4927b2e5fdbe7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.350824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb269ca-a63d-481f-9dbc-6ba278df901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.352970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb269ca-a63d-481f-9dbc-6ba278df901a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.353153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408779b0-c849-401f-9ea6-d6594cee3beb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.353415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb269ca-a63d-481f-9dbc-6ba278df901a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.353757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb269ca-a63d-481f-9dbc-6ba278df901a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.354550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb269ca-a63d-481f-9dbc-6ba278df901a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.357079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb269ca-a63d-481f-9dbc-6ba278df901a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.373418 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 772/1541] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:16.373418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb269ca-a63d-481f-9dbc-6ba278df901a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.396641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 770/1542] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:16 2022] PUT /identity/v3/projects/5f2fec863e8446128e270320b0ef204d/users/886050a9ea1a46428ee4927b2e5fdbe7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:16.396641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408779b0-c849-401f-9ea6-d6594cee3beb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.411843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb269ca-a63d-481f-9dbc-6ba278df901a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.541357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408779b0-c849-401f-9ea6-d6594cee3beb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.553080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395c62c-ef9a-4033-824a-eabcead11ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.554589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395c62c-ef9a-4033-824a-eabcead11ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.555407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395c62c-ef9a-4033-824a-eabcead11ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.556143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395c62c-ef9a-4033-824a-eabcead11ec9 admin admin] PATH_INFO: `/v3/projects/300ff6e84ff84169a18ade1faeae90ed/users/ee590c5e09ad4af0a98a5610254bce30/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.559321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0631d-860a-49fd-8530-2ee99609d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.570887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0631d-860a-49fd-8530-2ee99609d9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.571403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0631d-860a-49fd-8530-2ee99609d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.571888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0631d-860a-49fd-8530-2ee99609d9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.572984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0631d-860a-49fd-8530-2ee99609d9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.576563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0631d-860a-49fd-8530-2ee99609d9d7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.600453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395c62c-ef9a-4033-824a-eabcead11ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=300ff6e84ff84169a18ade1faeae90ed, user_id=ee590c5e09ad4af0a98a5610254bce30, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.605304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395c62c-ef9a-4033-824a-eabcead11ec9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.632593 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 771/1543] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:16 2022] PUT /identity/v3/projects/300ff6e84ff84169a18ade1faeae90ed/users/ee590c5e09ad4af0a98a5610254bce30/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:16.632593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd60c51-145c-4032-9e6d-842bd04006ae None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.632593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd60c51-145c-4032-9e6d-842bd04006ae None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.632593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd60c51-145c-4032-9e6d-842bd04006ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.649876 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 773/1544] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:16 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:16.650911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0631d-860a-49fd-8530-2ee99609d9d7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.672094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8cd60c51-145c-4032-9e6d-842bd04006ae None None] MFA Rules not processed for user `886050a9ea1a46428ee4927b2e5fdbe7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:16.673505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8cd60c51-145c-4032-9e6d-842bd04006ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:16.706828 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:16.779253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0631d-860a-49fd-8530-2ee99609d9d7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.791239 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 772/1545] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:16.800903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd60c51-145c-4032-9e6d-842bd04006ae None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.802026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2395b0b-7c89-491c-b2ca-c6639fef4f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.802771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2395b0b-7c89-491c-b2ca-c6639fef4f76 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.805007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2395b0b-7c89-491c-b2ca-c6639fef4f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.805555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2395b0b-7c89-491c-b2ca-c6639fef4f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.806454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2395b0b-7c89-491c-b2ca-c6639fef4f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.808468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2395b0b-7c89-491c-b2ca-c6639fef4f76 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.816378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd60c51-145c-4032-9e6d-842bd04006ae None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.822140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8970-3084-4fbe-9e62-4fe5dd10cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.822919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8970-3084-4fbe-9e62-4fe5dd10cb2c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.827238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8970-3084-4fbe-9e62-4fe5dd10cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.827238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8970-3084-4fbe-9e62-4fe5dd10cb2c admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.827238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8970-3084-4fbe-9e62-4fe5dd10cb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.827995 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 774/1546] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:16.830114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8970-3084-4fbe-9e62-4fe5dd10cb2c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.830348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9060c0-3c95-4332-884f-bfffc7b0afd6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.830987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9060c0-3c95-4332-884f-bfffc7b0afd6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.831657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9060c0-3c95-4332-884f-bfffc7b0afd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.861316 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:16.871989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7f9060c0-3c95-4332-884f-bfffc7b0afd6 None None] MFA Rules not processed for user `c5bef756c5c74e688ded867d98a6d29a`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:16.873719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f9060c0-3c95-4332-884f-bfffc7b0afd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:16.879887 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 773/1547] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:16 2022] POST /identity/v3/users => generated 293 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:16.881545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8970-3084-4fbe-9e62-4fe5dd10cb2c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.895362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8970-3084-4fbe-9e62-4fe5dd10cb2c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:16.904721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa840d87-a0ce-4a8d-a36d-e1a481c28bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:16.905587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa840d87-a0ce-4a8d-a36d-e1a481c28bea admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.905868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa840d87-a0ce-4a8d-a36d-e1a481c28bea admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.906144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa840d87-a0ce-4a8d-a36d-e1a481c28bea admin admin] PATH_INFO: `/v3/projects/300ff6e84ff84169a18ade1faeae90ed/users/ee590c5e09ad4af0a98a5610254bce30/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:16.912392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa840d87-a0ce-4a8d-a36d-e1a481c28bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=300ff6e84ff84169a18ade1faeae90ed, user_id=ee590c5e09ad4af0a98a5610254bce30, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:16.925178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa840d87-a0ce-4a8d-a36d-e1a481c28bea admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:16.968254 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 774/1548] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:16 2022] PUT /identity/v3/projects/300ff6e84ff84169a18ade1faeae90ed/users/ee590c5e09ad4af0a98a5610254bce30/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:16.969383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa840d87-a0ce-4a8d-a36d-e1a481c28bea admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:16.986710 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 775/1549] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:16.995742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0413-d56a-43a1-8001-756970a59545 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:16.997037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0413-d56a-43a1-8001-756970a59545 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:16.997433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0413-d56a-43a1-8001-756970a59545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.066607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1d8d0413-d56a-43a1-8001-756970a59545 None None] MFA Rules not processed for user `ee590c5e09ad4af0a98a5610254bce30`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:17.068467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1d8d0413-d56a-43a1-8001-756970a59545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.100764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa840d87-a0ce-4a8d-a36d-e1a481c28bea admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:17.107721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21401015-62ba-4fee-919d-fad9f35b076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:17.109104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21401015-62ba-4fee-919d-fad9f35b076f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:17.109447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21401015-62ba-4fee-919d-fad9f35b076f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:17.109798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21401015-62ba-4fee-919d-fad9f35b076f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.110527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21401015-62ba-4fee-919d-fad9f35b076f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:17.112478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21401015-62ba-4fee-919d-fad9f35b076f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:17.129018 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 775/1550] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:17.129018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21401015-62ba-4fee-919d-fad9f35b076f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:17.131776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-21401015-62ba-4fee-919d-fad9f35b076f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.147439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21401015-62ba-4fee-919d-fad9f35b076f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:17.167977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:17.169495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:17.169791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:17.170206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] PATH_INFO: `/v3/projects/2753fc50fce34c949198d78ead289f24` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.171976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2753fc50fce34c949198d78ead289f24)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:17.174674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:17.186329 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 776/1551] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:16 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:17.187226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0413-d56a-43a1-8001-756970a59545 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:17.189183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1d8d0413-d56a-43a1-8001-756970a59545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.256492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2753fc50fce34c949198d78ead289f24', 'request_id': 'req-5efb10df-ce66-4830-b946-f6c81423ccc5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.267669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2753fc50fce34c949198d78ead289f24', 'request_id': 'req-5efb10df-ce66-4830-b946-f6c81423ccc5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.279650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2753fc50fce34c949198d78ead289f24', 'request_id': 'req-5efb10df-ce66-4830-b946-f6c81423ccc5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.281427 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:17.297359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] The token cache is being invalidate because project 2753fc50fce34c949198d78ead289f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:17.297852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.299011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.304681 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 776/1552] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:17 2022] DELETE /identity/v3/projects/2753fc50fce34c949198d78ead289f24 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:17.304681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:17.306608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.313570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0413-d56a-43a1-8001-756970a59545 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:17.392366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb10df-ce66-4830-b946-f6c81423ccc5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:17.396827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3ab73-5cfc-4b25-96a2-c51ee8f27f03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:17.397326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23d7c-612f-4b7c-bbe7-5dae485958c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:17.397502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3ab73-5cfc-4b25-96a2-c51ee8f27f03 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:17.397720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3ab73-5cfc-4b25-96a2-c51ee8f27f03 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:17.397951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23d7c-612f-4b7c-bbe7-5dae485958c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:17.398085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3ab73-5cfc-4b25-96a2-c51ee8f27f03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.398230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23d7c-612f-4b7c-bbe7-5dae485958c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:17.398560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23d7c-612f-4b7c-bbe7-5dae485958c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.399159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a23d7c-612f-4b7c-bbe7-5dae485958c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:17.399804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4ae3ab73-5cfc-4b25-96a2-c51ee8f27f03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.401026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a23d7c-612f-4b7c-bbe7-5dae485958c5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:17.412732 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 777/1553] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:17.413583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23d7c-612f-4b7c-bbe7-5dae485958c5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:17.419906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b5a23d7c-612f-4b7c-bbe7-5dae485958c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.431975 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:17.440976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23d7c-612f-4b7c-bbe7-5dae485958c5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:17.448796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:17.449696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:17.449981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:17.450389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.452362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.477165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3ab73-5cfc-4b25-96a2-c51ee8f27f03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:17.480833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3ab73-5cfc-4b25-96a2-c51ee8f27f03 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:17.498843 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 777/1554] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:17.501392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f781c85-a404-42c0-8021-9b77a80ec341 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:17.501791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f781c85-a404-42c0-8021-9b77a80ec341 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:17.502071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f781c85-a404-42c0-8021-9b77a80ec341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.522389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8f781c85-a404-42c0-8021-9b77a80ec341 None None] MFA Rules not processed for user `729379ca02904136b0d5c96d6b28c490`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:17.524115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8f781c85-a404-42c0-8021-9b77a80ec341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.575718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:17.579541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:17.598671 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 778/1555] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:17 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:17.600167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:17.602257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.634149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 778/1556] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:17.634149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f781c85-a404-42c0-8021-9b77a80ec341 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:17.634441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d4c48-2d24-4e93-b764-11f70fe6f130 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:17.638206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:17.639178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:17.639533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:17.639967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] PATH_INFO: `/v3/users/819cc35a92c94712b15c305cf0790b62` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.641588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=819cc35a92c94712b15c305cf0790b62)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:17.644733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:17.650966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f781c85-a404-42c0-8021-9b77a80ec341 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:17.659702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0afc7-58b9-4fc2-83a6-5a87ad8bf919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:17.660863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0afc7-58b9-4fc2-83a6-5a87ad8bf919 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:17.661347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0afc7-58b9-4fc2-83a6-5a87ad8bf919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:17.661828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0afc7-58b9-4fc2-83a6-5a87ad8bf919 admin admin] PATH_INFO: `/v3/projects/567fbf64687542a4b59b8c0abf4b3dcc/users/f88c3bf8066a450d95fbac2df7ba3dbd/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.695950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0afc7-58b9-4fc2-83a6-5a87ad8bf919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567fbf64687542a4b59b8c0abf4b3dcc, user_id=f88c3bf8066a450d95fbac2df7ba3dbd, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:17.701598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0afc7-58b9-4fc2-83a6-5a87ad8bf919 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:17.728694 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 779/1557] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:17 2022] PUT /identity/v3/projects/567fbf64687542a4b59b8c0abf4b3dcc/users/f88c3bf8066a450d95fbac2df7ba3dbd/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:17.728887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819cc35a92c94712b15c305cf0790b62'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.732163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc4a17-5560-4ebe-a123-ee697486dfa3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:17.732579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc4a17-5560-4ebe-a123-ee697486dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:17.733005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc4a17-5560-4ebe-a123-ee697486dfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:17.742544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819cc35a92c94712b15c305cf0790b62'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.757084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819cc35a92c94712b15c305cf0790b62'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.764173 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:17.773116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819cc35a92c94712b15c305cf0790b62'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.774440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819cc35a92c94712b15c305cf0790b62'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:17.778628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-44bc4a17-5560-4ebe-a123-ee697486dfa3 None None] MFA Rules not processed for user `f88c3bf8066a450d95fbac2df7ba3dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:17.780758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-44bc4a17-5560-4ebe-a123-ee697486dfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.787591 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 779/1558] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:17 2022] DELETE /identity/v3/users/819cc35a92c94712b15c305cf0790b62 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:17.894751 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 780/1559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:17.900188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:17.903206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:17.988945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babf53b-5ecb-46d4-b8da-466bb21f2516 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:18.012786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b857d-b788-456e-976e-34c0e9bd45b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:18.013442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b857d-b788-456e-976e-34c0e9bd45b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.013747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b857d-b788-456e-976e-34c0e9bd45b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.014008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b857d-b788-456e-976e-34c0e9bd45b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.015583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b857d-b788-456e-976e-34c0e9bd45b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:18.020101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b857d-b788-456e-976e-34c0e9bd45b8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:18.051806 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:18.077714 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 780/1560] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:17 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:18.080304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc4a17-5560-4ebe-a123-ee697486dfa3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:18.156913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b857d-b788-456e-976e-34c0e9bd45b8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:18.159225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b6b857d-b788-456e-976e-34c0e9bd45b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:18.267778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc4a17-5560-4ebe-a123-ee697486dfa3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:18.295377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b857d-b788-456e-976e-34c0e9bd45b8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:18.313204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adef5a-ad1f-42cd-b898-763358be6c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:18.313450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adef5a-ad1f-42cd-b898-763358be6c3f service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.313796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adef5a-ad1f-42cd-b898-763358be6c3f service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.314091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adef5a-ad1f-42cd-b898-763358be6c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.321778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-34adef5a-ad1f-42cd-b898-763358be6c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:18.376979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321a4f8-8cfb-4327-ad2e-56068d7ccad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:18.377824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321a4f8-8cfb-4327-ad2e-56068d7ccad4 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.378136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321a4f8-8cfb-4327-ad2e-56068d7ccad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.378470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321a4f8-8cfb-4327-ad2e-56068d7ccad4 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.379158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321a4f8-8cfb-4327-ad2e-56068d7ccad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:18.381409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321a4f8-8cfb-4327-ad2e-56068d7ccad4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:18.414924 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 781/1561] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:18 2022] POST /identity/v3/users => generated 299 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:44:18.423402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321a4f8-8cfb-4327-ad2e-56068d7ccad4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:18.435219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adef5a-ad1f-42cd-b898-763358be6c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:18.437600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adef5a-ad1f-42cd-b898-763358be6c3f service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:18.442857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321a4f8-8cfb-4327-ad2e-56068d7ccad4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:18.458878 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 781/1562] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:18 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:44:18.470651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ed811-4e0e-4c1a-a0e3-93cad9314e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:18.470651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ed811-4e0e-4c1a-a0e3-93cad9314e4d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.470651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ed811-4e0e-4c1a-a0e3-93cad9314e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.470651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ed811-4e0e-4c1a-a0e3-93cad9314e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.472109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ed811-4e0e-4c1a-a0e3-93cad9314e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:18.475265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ed811-4e0e-4c1a-a0e3-93cad9314e4d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:18.503785 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 782/1563] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:18.507458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adef5a-ad1f-42cd-b898-763358be6c3f service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:18.530057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adef5a-ad1f-42cd-b898-763358be6c3f service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:18.541735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236e9b4-3e4f-41e5-bdd6-99f1e9083870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:18.542873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236e9b4-3e4f-41e5-bdd6-99f1e9083870 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.543166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236e9b4-3e4f-41e5-bdd6-99f1e9083870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.543547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236e9b4-3e4f-41e5-bdd6-99f1e9083870 admin admin] PATH_INFO: `/v3/projects/88f4b981924a42ba89d838596835652e/users/f0256a6b6e1a4baa856308fd831358e6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.583613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236e9b4-3e4f-41e5-bdd6-99f1e9083870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f4b981924a42ba89d838596835652e, user_id=f0256a6b6e1a4baa856308fd831358e6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:18.584542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236e9b4-3e4f-41e5-bdd6-99f1e9083870 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:18.608239 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 782/1564] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:18 2022] PUT /identity/v3/projects/88f4b981924a42ba89d838596835652e/users/f0256a6b6e1a4baa856308fd831358e6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:18.609476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ed811-4e0e-4c1a-a0e3-93cad9314e4d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:18.625227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ed811-4e0e-4c1a-a0e3-93cad9314e4d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:18.693484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1bd3-98a1-40b2-9f95-83789181ded1 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.693900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1bd3-98a1-40b2-9f95-83789181ded1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.694076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1bd3-98a1-40b2-9f95-83789181ded1 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.695714 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 783/1565] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:18.696405 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:18.725615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba62a-51b8-442a-96ca-d1337b49c589 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.726107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba62a-51b8-442a-96ca-d1337b49c589 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.726681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba62a-51b8-442a-96ca-d1337b49c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.767409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-590ba62a-51b8-442a-96ca-d1337b49c589 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:18.768794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-590ba62a-51b8-442a-96ca-d1337b49c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:18.791778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617fedf-94b5-48eb-a5dd-b4de5f8da525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:18.792947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617fedf-94b5-48eb-a5dd-b4de5f8da525 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.793543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617fedf-94b5-48eb-a5dd-b4de5f8da525 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.794193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617fedf-94b5-48eb-a5dd-b4de5f8da525 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.796482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617fedf-94b5-48eb-a5dd-b4de5f8da525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:18.798556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617fedf-94b5-48eb-a5dd-b4de5f8da525 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:18.828450 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 783/1566] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:18.830314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79e1fb-f02e-46a0-83db-72d0f1a5bb50 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.830627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79e1fb-f02e-46a0-83db-72d0f1a5bb50 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.830932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79e1fb-f02e-46a0-83db-72d0f1a5bb50 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.832943 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 784/1567] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:18.834623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79e1fb-f02e-46a0-83db-72d0f1a5bb50 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:18.838635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0d79e1fb-f02e-46a0-83db-72d0f1a5bb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:18.860707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79e1fb-f02e-46a0-83db-72d0f1a5bb50 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:18.866800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:18.870049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:18.870049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:18.870049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] PATH_INFO: `/v3/projects/40bfaccf90554a5a8083798d95072c10` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:18.871574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40bfaccf90554a5a8083798d95072c10)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:18.872965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:18.916602 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:18.941533 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 784/1568] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:44:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:44:18.942678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ba62a-51b8-442a-96ca-d1337b49c589 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:18.953187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40bfaccf90554a5a8083798d95072c10', 'request_id': 'req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:18.958872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ba62a-51b8-442a-96ca-d1337b49c589 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:18.964407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40bfaccf90554a5a8083798d95072c10', 'request_id': 'req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:18.977896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40bfaccf90554a5a8083798d95072c10', 'request_id': 'req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:18.998248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] The token cache is being invalidate because project 40bfaccf90554a5a8083798d95072c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:18.998518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:18.999268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905dcfed-a1d2-4eb6-85f8-a5bc97cca065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.002615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 785/1569] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:18 2022] DELETE /identity/v3/projects/40bfaccf90554a5a8083798d95072c10 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:19.004183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05392a6b-825e-4f55-a37e-4d3e75a98180 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:19.004466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05392a6b-825e-4f55-a37e-4d3e75a98180 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:19.004812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05392a6b-825e-4f55-a37e-4d3e75a98180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:19.045879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-05392a6b-825e-4f55-a37e-4d3e75a98180 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:19.047311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-05392a6b-825e-4f55-a37e-4d3e75a98180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.069554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9475bb-1c06-4dca-ad47-6e0f4406ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:19.070267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9475bb-1c06-4dca-ad47-6e0f4406ca12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:19.070554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9475bb-1c06-4dca-ad47-6e0f4406ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:19.070835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9475bb-1c06-4dca-ad47-6e0f4406ca12 admin admin] PATH_INFO: `/v3/projects/88f4b981924a42ba89d838596835652e/users/f0256a6b6e1a4baa856308fd831358e6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:19.073637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9475bb-1c06-4dca-ad47-6e0f4406ca12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f4b981924a42ba89d838596835652e, user_id=f0256a6b6e1a4baa856308fd831358e6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:19.076849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9475bb-1c06-4dca-ad47-6e0f4406ca12 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:19.093504 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 785/1570] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:18 2022] PUT /identity/v3/projects/88f4b981924a42ba89d838596835652e/users/f0256a6b6e1a4baa856308fd831358e6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:19.094755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9475bb-1c06-4dca-ad47-6e0f4406ca12 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:19.096754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3a9475bb-1c06-4dca-ad47-6e0f4406ca12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.134509 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 786/1571] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:44:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:19.135478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05392a6b-825e-4f55-a37e-4d3e75a98180 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:19.137145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-05392a6b-825e-4f55-a37e-4d3e75a98180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.191823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9475bb-1c06-4dca-ad47-6e0f4406ca12 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:19.198055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:19.198880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:19.199177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:19.199453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] PATH_INFO: `/v3/users/27b94e8a05964ad1b2c9a27341b48d90` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:19.200886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b94e8a05964ad1b2c9a27341b48d90)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:19.202894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:19.221315 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:19.246746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05392a6b-825e-4f55-a37e-4d3e75a98180 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:19.289564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b94e8a05964ad1b2c9a27341b48d90'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.307447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b94e8a05964ad1b2c9a27341b48d90'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.317769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b94e8a05964ad1b2c9a27341b48d90'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.329191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b94e8a05964ad1b2c9a27341b48d90'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.330299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b94e8a05964ad1b2c9a27341b48d90'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.337354 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 786/1572] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:19 2022] DELETE /identity/v3/users/27b94e8a05964ad1b2c9a27341b48d90 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:19.341098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:19.342764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.348087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1930e1-cc9e-42c9-bd2c-ab5fc6202fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:19.349223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1930e1-cc9e-42c9-bd2c-ab5fc6202fec service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:19.349747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1930e1-cc9e-42c9-bd2c-ab5fc6202fec service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:19.350643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1930e1-cc9e-42c9-bd2c-ab5fc6202fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:19.354651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9f1930e1-cc9e-42c9-bd2c-ab5fc6202fec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.371112 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:19.380422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1930e1-cc9e-42c9-bd2c-ab5fc6202fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:19.384150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1930e1-cc9e-42c9-bd2c-ab5fc6202fec service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:19.417132 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 787/1573] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:19.419199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3095f-be4a-4e9c-8a21-ec65ffa82f60 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:19.419490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3095f-be4a-4e9c-8a21-ec65ffa82f60 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:19.420083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3095f-be4a-4e9c-8a21-ec65ffa82f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:19.451765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6a3d0-bea6-43c5-935b-45e616e83c46 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:19.458725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:19.459706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:19.460163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:19.460511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] PATH_INFO: `/v3/users/ee41edbee5b4444ab257f8d24570afe2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:19.462560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee41edbee5b4444ab257f8d24570afe2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:19.466248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:19.489189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f5d3095f-be4a-4e9c-8a21-ec65ffa82f60 None None] MFA Rules not processed for user `f0256a6b6e1a4baa856308fd831358e6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:19.491175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f5d3095f-be4a-4e9c-8a21-ec65ffa82f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.537703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee41edbee5b4444ab257f8d24570afe2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.561749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee41edbee5b4444ab257f8d24570afe2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.571484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee41edbee5b4444ab257f8d24570afe2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.585452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee41edbee5b4444ab257f8d24570afe2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.586401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee41edbee5b4444ab257f8d24570afe2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:19.602169 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 787/1574] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:19 2022] DELETE /identity/v3/users/ee41edbee5b4444ab257f8d24570afe2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:19.603228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:19.604903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.653262 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 788/1575] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:19.654663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4e394-1ea8-4be6-85d6-ac99501fd1a3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:19.654994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4e394-1ea8-4be6-85d6-ac99501fd1a3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:19.655349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4e394-1ea8-4be6-85d6-ac99501fd1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:19.679894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1de4e394-1ea8-4be6-85d6-ac99501fd1a3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:19.681177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1de4e394-1ea8-4be6-85d6-ac99501fd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.692484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15c1af-5c32-4858-95b6-9ac6b1c29689 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:19.707873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:19.708547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:19.708924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:19.709315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:19.712275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.728336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:19.730548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:19.744484 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 788/1576] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:19.812607 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 789/1577] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:19.836795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:19.838786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.854607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed0a46-2fb2-4131-bd15-54b3d47f9dca service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:19.861622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf1587-f7ac-41e8-b47a-e49fba3db6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:19.862545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf1587-f7ac-41e8-b47a-e49fba3db6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:19.863090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf1587-f7ac-41e8-b47a-e49fba3db6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:19.863090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf1587-f7ac-41e8-b47a-e49fba3db6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:19.871642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4e394-1ea8-4be6-85d6-ac99501fd1a3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:19.882737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1de4e394-1ea8-4be6-85d6-ac99501fd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:19.895366 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:19.916912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf1587-f7ac-41e8-b47a-e49fba3db6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:19.918523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf1587-f7ac-41e8-b47a-e49fba3db6d9 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:19.942334 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 789/1578] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:20.012814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4e394-1ea8-4be6-85d6-ac99501fd1a3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:20.023891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c023f-aafa-4bcf-b469-c8ff6950edf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:20.025134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c023f-aafa-4bcf-b469-c8ff6950edf8 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:20.025579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c023f-aafa-4bcf-b469-c8ff6950edf8 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:20.025923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c023f-aafa-4bcf-b469-c8ff6950edf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:20.142376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c023f-aafa-4bcf-b469-c8ff6950edf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:20.144403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c023f-aafa-4bcf-b469-c8ff6950edf8 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:20.158097 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 790/1579] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:20.401092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf1587-f7ac-41e8-b47a-e49fba3db6d9 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:20.403041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-15bf1587-f7ac-41e8-b47a-e49fba3db6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:20.431121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf1587-f7ac-41e8-b47a-e49fba3db6d9 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:20.473404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:20.475089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:20.475551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:20.476008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:20.478059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:20.501732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c023f-aafa-4bcf-b469-c8ff6950edf8 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:20.503480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a00c023f-aafa-4bcf-b469-c8ff6950edf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:20.529590 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:20.549013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c023f-aafa-4bcf-b469-c8ff6950edf8 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:20.568230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:20.570885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:20.572071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:20.574752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] PATH_INFO: `/v3/projects/0573aaefe05443c5840f4e1fa532606b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:20.581888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0573aaefe05443c5840f4e1fa532606b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:20.588974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:20.695446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:20.699698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:20.719839 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 790/1580] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:20.727436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:20.734128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:20.752371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0573aaefe05443c5840f4e1fa532606b', 'request_id': 'req-b48fdaa3-d874-4c2a-b69c-45bedbec598e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:20.767316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0573aaefe05443c5840f4e1fa532606b', 'request_id': 'req-b48fdaa3-d874-4c2a-b69c-45bedbec598e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:20.771494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e7d06-44b4-4103-bdeb-bce3207daf52 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:20.778576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0573aaefe05443c5840f4e1fa532606b', 'request_id': 'req-b48fdaa3-d874-4c2a-b69c-45bedbec598e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:20.863792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] The token cache is being invalidate because project 0573aaefe05443c5840f4e1fa532606b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:20.865749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:20.869364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b48fdaa3-d874-4c2a-b69c-45bedbec598e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:20.875609 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 791/1581] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:20 2022] DELETE /identity/v3/projects/0573aaefe05443c5840f4e1fa532606b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:20.886009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308ddf3-7826-4999-b497-8c8723590e8f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:20.886659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308ddf3-7826-4999-b497-8c8723590e8f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:20.887228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308ddf3-7826-4999-b497-8c8723590e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:20.967652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b308ddf3-7826-4999-b497-8c8723590e8f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:20.972714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b308ddf3-7826-4999-b497-8c8723590e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:20.993616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:20.994639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:20.995932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:20.996542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] PATH_INFO: `/v3/projects/fe2dcb0cfc58456aae5afdc226600eec` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.006063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2dcb0cfc58456aae5afdc226600eec)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:21.010616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:21.011807 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:21.114525 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 792/1582] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:44:21.125043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41e494-44b5-4c78-9102-1b90551c43f0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:21.125305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41e494-44b5-4c78-9102-1b90551c43f0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:21.125916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41e494-44b5-4c78-9102-1b90551c43f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.135044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2dcb0cfc58456aae5afdc226600eec', 'request_id': 'req-e505b335-1716-4414-840e-4e1182872b1d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.147558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2dcb0cfc58456aae5afdc226600eec', 'request_id': 'req-e505b335-1716-4414-840e-4e1182872b1d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.158595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2dcb0cfc58456aae5afdc226600eec', 'request_id': 'req-e505b335-1716-4414-840e-4e1182872b1d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.166654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8c41e494-44b5-4c78-9102-1b90551c43f0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:21.166654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8c41e494-44b5-4c78-9102-1b90551c43f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:21.175212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] The token cache is being invalidate because project fe2dcb0cfc58456aae5afdc226600eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:21.176923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.178436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.180366 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 791/1583] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:20 2022] DELETE /identity/v3/projects/fe2dcb0cfc58456aae5afdc226600eec => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:21.184949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:21.188838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:21.265625 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:21.314126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505b335-1716-4414-840e-4e1182872b1d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:21.331418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:21.332508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:21.332854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:21.334111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] PATH_INFO: `/v3/users/ee590c5e09ad4af0a98a5610254bce30` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.335037 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 793/1584] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:21.338301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee590c5e09ad4af0a98a5610254bce30)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:21.340922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:21.341340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41e494-44b5-4c78-9102-1b90551c43f0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:21.359186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41e494-44b5-4c78-9102-1b90551c43f0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:21.374018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79b3be-1375-45ba-bbf8-9da28e047cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:21.376514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79b3be-1375-45ba-bbf8-9da28e047cab admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:21.377139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79b3be-1375-45ba-bbf8-9da28e047cab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:21.377731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79b3be-1375-45ba-bbf8-9da28e047cab admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.384019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79b3be-1375-45ba-bbf8-9da28e047cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:21.384457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79b3be-1375-45ba-bbf8-9da28e047cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:21.390685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79b3be-1375-45ba-bbf8-9da28e047cab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:21.455979 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 794/1585] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:21.458781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79b3be-1375-45ba-bbf8-9da28e047cab admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:21.473770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79b3be-1375-45ba-bbf8-9da28e047cab admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:21.479643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159b28-9ea1-4d96-a649-0d5c6f2a0eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:21.480454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159b28-9ea1-4d96-a649-0d5c6f2a0eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:21.480812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159b28-9ea1-4d96-a649-0d5c6f2a0eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:21.481179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159b28-9ea1-4d96-a649-0d5c6f2a0eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.481952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31159b28-9ea1-4d96-a649-0d5c6f2a0eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:21.484163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31159b28-9ea1-4d96-a649-0d5c6f2a0eb3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:21.517374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee590c5e09ad4af0a98a5610254bce30'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.552737 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 795/1586] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:21 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:21.554504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159b28-9ea1-4d96-a649-0d5c6f2a0eb3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:21.585923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee590c5e09ad4af0a98a5610254bce30'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.596876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee590c5e09ad4af0a98a5610254bce30'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.612375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee590c5e09ad4af0a98a5610254bce30'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.613277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee590c5e09ad4af0a98a5610254bce30'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.631269 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 792/1587] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:21 2022] DELETE /identity/v3/users/ee590c5e09ad4af0a98a5610254bce30 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:44:21.724592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:21.727955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:21.732557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159b28-9ea1-4d96-a649-0d5c6f2a0eb3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:21.786495 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:21.838363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908bf2-6a62-40e3-b00a-fdcfe9fbf671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:21.839526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908bf2-6a62-40e3-b00a-fdcfe9fbf671 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:21.839938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908bf2-6a62-40e3-b00a-fdcfe9fbf671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:21.840582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908bf2-6a62-40e3-b00a-fdcfe9fbf671 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.841328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83908bf2-6a62-40e3-b00a-fdcfe9fbf671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:21.843409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83908bf2-6a62-40e3-b00a-fdcfe9fbf671 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:21.872425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6753e-f1c5-488f-9534-56907f791890 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:21.883420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:21.883858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:21.884596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:21.884596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] PATH_INFO: `/v3/users/f88c3bf8066a450d95fbac2df7ba3dbd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.885943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88c3bf8066a450d95fbac2df7ba3dbd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:21.888021 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 796/1588] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:21 2022] POST /identity/v3/users => generated 302 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:44:21.902988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:21.905187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908bf2-6a62-40e3-b00a-fdcfe9fbf671 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:21.914021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-83908bf2-6a62-40e3-b00a-fdcfe9fbf671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:21.935350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908bf2-6a62-40e3-b00a-fdcfe9fbf671 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:21.945424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559cc44-450f-4209-ac74-75afef821d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:21.946193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559cc44-450f-4209-ac74-75afef821d93 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:21.947382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559cc44-450f-4209-ac74-75afef821d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:21.947382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559cc44-450f-4209-ac74-75afef821d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:21.949213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559cc44-450f-4209-ac74-75afef821d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:21.953902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559cc44-450f-4209-ac74-75afef821d93 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:21.979554 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 797/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:21.981330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559cc44-450f-4209-ac74-75afef821d93 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:21.983143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88c3bf8066a450d95fbac2df7ba3dbd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:21.996041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559cc44-450f-4209-ac74-75afef821d93 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:22.004756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9b5a4-63b0-4cde-a6d6-e5c766323591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:22.005452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9b5a4-63b0-4cde-a6d6-e5c766323591 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:22.006426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9b5a4-63b0-4cde-a6d6-e5c766323591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:22.006804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9b5a4-63b0-4cde-a6d6-e5c766323591 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:22.008177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9b5a4-63b0-4cde-a6d6-e5c766323591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:22.016845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9b5a4-63b0-4cde-a6d6-e5c766323591 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:22.022121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88c3bf8066a450d95fbac2df7ba3dbd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:22.030961 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:22.038910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88c3bf8066a450d95fbac2df7ba3dbd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:22.049832 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 798/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:44:22.053804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9b5a4-63b0-4cde-a6d6-e5c766323591 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:22.060354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88c3bf8066a450d95fbac2df7ba3dbd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:22.065383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e124e693-e28b-4913-bcb7-466941078d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88c3bf8066a450d95fbac2df7ba3dbd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:22.073605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9b5a4-63b0-4cde-a6d6-e5c766323591 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:22.074791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 793/1591] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:21 2022] DELETE /identity/v3/users/f88c3bf8066a450d95fbac2df7ba3dbd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:22.080480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4ef8-16e7-49e5-8817-224f106d9838 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:22.081063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4ef8-16e7-49e5-8817-224f106d9838 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:22.081558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4ef8-16e7-49e5-8817-224f106d9838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:22.128505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8b9b4ef8-16e7-49e5-8817-224f106d9838 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:22.131061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8b9b4ef8-16e7-49e5-8817-224f106d9838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:22.226435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba90117-32f5-43ee-af23-4053c0c7e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:22.229489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba90117-32f5-43ee-af23-4053c0c7e93c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:22.229788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba90117-32f5-43ee-af23-4053c0c7e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:22.230796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba90117-32f5-43ee-af23-4053c0c7e93c admin admin] PATH_INFO: `/v3/projects/009288be91794393b779e14d30e5c421/users/9fe239d58cbf4c4d9d1b8023b5c4ebdb/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:22.272368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba90117-32f5-43ee-af23-4053c0c7e93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=009288be91794393b779e14d30e5c421, user_id=9fe239d58cbf4c4d9d1b8023b5c4ebdb, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:22.277488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba90117-32f5-43ee-af23-4053c0c7e93c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:22.295042 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 794/1592] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:22.306883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b4ef8-16e7-49e5-8817-224f106d9838 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:22.309449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8b9b4ef8-16e7-49e5-8817-224f106d9838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:22.314417 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 799/1593] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:22 2022] PUT /identity/v3/projects/009288be91794393b779e14d30e5c421/users/9fe239d58cbf4c4d9d1b8023b5c4ebdb/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:22.329065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba90117-32f5-43ee-af23-4053c0c7e93c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:22.331830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eba90117-32f5-43ee-af23-4053c0c7e93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:22.409295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b4ef8-16e7-49e5-8817-224f106d9838 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:22.453215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba90117-32f5-43ee-af23-4053c0c7e93c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:22.458997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:22.459666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:22.460225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:22.460523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] PATH_INFO: `/v3/projects/300ff6e84ff84169a18ade1faeae90ed` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:22.461761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300ff6e84ff84169a18ade1faeae90ed)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:22.464200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:22.530833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f36293-7502-4140-967e-d6a947db911f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:22.531420 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:22.531772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f36293-7502-4140-967e-d6a947db911f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:22.532098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f36293-7502-4140-967e-d6a947db911f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:22.532383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f36293-7502-4140-967e-d6a947db911f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:22.552688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f36293-7502-4140-967e-d6a947db911f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:22.559151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f36293-7502-4140-967e-d6a947db911f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:22.569753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300ff6e84ff84169a18ade1faeae90ed', 'request_id': 'req-76396670-6227-4514-8603-fe815e5801c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:22.576648 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 795/1594] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:22.578189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3077e-cdec-41d9-800a-67f99004731c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:22.578769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3077e-cdec-41d9-800a-67f99004731c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:22.578900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3077e-cdec-41d9-800a-67f99004731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:22.588141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300ff6e84ff84169a18ade1faeae90ed', 'request_id': 'req-76396670-6227-4514-8603-fe815e5801c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:22.609873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300ff6e84ff84169a18ade1faeae90ed', 'request_id': 'req-76396670-6227-4514-8603-fe815e5801c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:22.638625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] The token cache is being invalidate because project 300ff6e84ff84169a18ade1faeae90ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:22.639098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:22.640765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-76396670-6227-4514-8603-fe815e5801c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:22.643596 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 800/1595] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:22 2022] DELETE /identity/v3/projects/300ff6e84ff84169a18ade1faeae90ed => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:22.649748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e8fed-7aed-415d-ad0a-18f846065776 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:22.650114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e8fed-7aed-415d-ad0a-18f846065776 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:22.650397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e8fed-7aed-415d-ad0a-18f846065776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:22.664845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fee3077e-cdec-41d9-800a-67f99004731c None None] MFA Rules not processed for user `9fe239d58cbf4c4d9d1b8023b5c4ebdb`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:22.674521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fee3077e-cdec-41d9-800a-67f99004731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:22.704890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a85e8fed-7aed-415d-ad0a-18f846065776 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:22.706231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a85e8fed-7aed-415d-ad0a-18f846065776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:22.751376 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:22.823874 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 796/1596] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:22.824983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3077e-cdec-41d9-800a-67f99004731c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:22.826580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fee3077e-cdec-41d9-800a-67f99004731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:22.919469 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 801/1597] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:22.921739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd05b-91ba-46b6-8df3-288259ba6636 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:22.922035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd05b-91ba-46b6-8df3-288259ba6636 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:22.922318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd05b-91ba-46b6-8df3-288259ba6636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:22.950059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-abadd05b-91ba-46b6-8df3-288259ba6636 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:22.951927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-abadd05b-91ba-46b6-8df3-288259ba6636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:23.021521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3077e-cdec-41d9-800a-67f99004731c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.028899 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 802/1598] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:23.030229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd05b-91ba-46b6-8df3-288259ba6636 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.030552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4d462-c26c-48eb-bbbd-5d786c45ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.031365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d462-c26c-48eb-bbbd-5d786c45ab3b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.031647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d462-c26c-48eb-bbbd-5d786c45ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.031930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d462-c26c-48eb-bbbd-5d786c45ab3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.032578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4d462-c26c-48eb-bbbd-5d786c45ab3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.034594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4d462-c26c-48eb-bbbd-5d786c45ab3b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.052840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd05b-91ba-46b6-8df3-288259ba6636 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.064974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e4f1-44d1-409c-849f-32587a1dca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.065763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e4f1-44d1-409c-849f-32587a1dca10 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.066041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e4f1-44d1-409c-849f-32587a1dca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.066311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e4f1-44d1-409c-849f-32587a1dca10 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.067334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e4f1-44d1-409c-849f-32587a1dca10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:23.067827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e4f1-44d1-409c-849f-32587a1dca10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.069790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e4f1-44d1-409c-849f-32587a1dca10 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.080901 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 797/1599] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:22 2022] POST /identity/v3/projects => generated 401 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:23.085641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4d462-c26c-48eb-bbbd-5d786c45ab3b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.093890 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 803/1600] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:44:23.098666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e4f1-44d1-409c-849f-32587a1dca10 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.125916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e4f1-44d1-409c-849f-32587a1dca10 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.227295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4d462-c26c-48eb-bbbd-5d786c45ab3b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.233224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727ea67-b181-4f09-8878-8daa41d6e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.233962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727ea67-b181-4f09-8878-8daa41d6e831 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.234349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727ea67-b181-4f09-8878-8daa41d6e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.234727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727ea67-b181-4f09-8878-8daa41d6e831 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.235600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727ea67-b181-4f09-8878-8daa41d6e831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.240186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727ea67-b181-4f09-8878-8daa41d6e831 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.266934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cbc18-432b-4968-8474-c1522a072667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.268256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cbc18-432b-4968-8474-c1522a072667 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.268793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cbc18-432b-4968-8474-c1522a072667 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.272953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cbc18-432b-4968-8474-c1522a072667 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.274180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cbc18-432b-4968-8474-c1522a072667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.281515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cbc18-432b-4968-8474-c1522a072667 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.295240 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 798/1601] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:23 2022] POST /identity/v3/users => generated 307 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:23.296320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727ea67-b181-4f09-8878-8daa41d6e831 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.311406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727ea67-b181-4f09-8878-8daa41d6e831 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.321923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec72ff-f74b-4083-9d55-f72783b2f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.322614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec72ff-f74b-4083-9d55-f72783b2f168 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.322913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec72ff-f74b-4083-9d55-f72783b2f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.323384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec72ff-f74b-4083-9d55-f72783b2f168 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.330528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec72ff-f74b-4083-9d55-f72783b2f168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.330528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec72ff-f74b-4083-9d55-f72783b2f168 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.341940 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 804/1602] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:23 2022] POST /identity/v3/projects => generated 369 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:44:23.344651 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 799/1603] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:23.347436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cbc18-432b-4968-8474-c1522a072667 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.347774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec72ff-f74b-4083-9d55-f72783b2f168 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.363018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec72ff-f74b-4083-9d55-f72783b2f168 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.398758 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:23.466157 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:23.502039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f6cf6-f8e8-4682-84c8-028310666969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.502577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f6cf6-f8e8-4682-84c8-028310666969 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.503002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f6cf6-f8e8-4682-84c8-028310666969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.503389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f6cf6-f8e8-4682-84c8-028310666969 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.504142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f6cf6-f8e8-4682-84c8-028310666969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.506324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f6cf6-f8e8-4682-84c8-028310666969 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.519727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cbc18-432b-4968-8474-c1522a072667 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.525485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225a6f-cb2c-4ab3-a283-d9802c09d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.526181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225a6f-cb2c-4ab3-a283-d9802c09d98e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.527580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225a6f-cb2c-4ab3-a283-d9802c09d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.527580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225a6f-cb2c-4ab3-a283-d9802c09d98e admin admin] PATH_INFO: `/v3/projects/f002025aca2c472ab186d16c6745a0b3/users/a864687612404b139227d92ff7564d8b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.537586 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 800/1604] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:23 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:23.537586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f6cf6-f8e8-4682-84c8-028310666969 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.537586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-558f6cf6-f8e8-4682-84c8-028310666969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:23.551735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f6cf6-f8e8-4682-84c8-028310666969 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.556825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.557578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.557929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.558280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] PATH_INFO: `/v3/projects/567fbf64687542a4b59b8c0abf4b3dcc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.558407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225a6f-cb2c-4ab3-a283-d9802c09d98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f002025aca2c472ab186d16c6745a0b3, user_id=a864687612404b139227d92ff7564d8b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.559863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567fbf64687542a4b59b8c0abf4b3dcc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.561099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225a6f-cb2c-4ab3-a283-d9802c09d98e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.562066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.579798 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 805/1605] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:23 2022] PUT /identity/v3/projects/f002025aca2c472ab186d16c6745a0b3/users/a864687612404b139227d92ff7564d8b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:23.581506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225a6f-cb2c-4ab3-a283-d9802c09d98e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.633573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567fbf64687542a4b59b8c0abf4b3dcc', 'request_id': 'req-a587a2d9-1190-4241-81f0-1816e5f7c341'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.644164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567fbf64687542a4b59b8c0abf4b3dcc', 'request_id': 'req-a587a2d9-1190-4241-81f0-1816e5f7c341'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.656584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567fbf64687542a4b59b8c0abf4b3dcc', 'request_id': 'req-a587a2d9-1190-4241-81f0-1816e5f7c341'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.673001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] The token cache is being invalidate because project 567fbf64687542a4b59b8c0abf4b3dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:23.673317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.674082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.674732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225a6f-cb2c-4ab3-a283-d9802c09d98e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.675949 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 801/1606] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:23 2022] DELETE /identity/v3/projects/567fbf64687542a4b59b8c0abf4b3dcc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:23.676611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.678010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:23.777940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f340db-b513-47bc-a05b-5c0bbe7d82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.778514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f340db-b513-47bc-a05b-5c0bbe7d82f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.778805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f340db-b513-47bc-a05b-5c0bbe7d82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.779070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f340db-b513-47bc-a05b-5c0bbe7d82f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.779726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f340db-b513-47bc-a05b-5c0bbe7d82f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.781364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f340db-b513-47bc-a05b-5c0bbe7d82f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.782411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587a2d9-1190-4241-81f0-1816e5f7c341 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.787390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0772280-74b5-4e2b-b87c-804bf86f9218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.788057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0772280-74b5-4e2b-b87c-804bf86f9218 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.788446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0772280-74b5-4e2b-b87c-804bf86f9218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.788764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0772280-74b5-4e2b-b87c-804bf86f9218 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.789431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0772280-74b5-4e2b-b87c-804bf86f9218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.791283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0772280-74b5-4e2b-b87c-804bf86f9218 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.799066 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 806/1607] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:23.799066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f340db-b513-47bc-a05b-5c0bbe7d82f5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.801018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b4f340db-b513-47bc-a05b-5c0bbe7d82f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:23.808574 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 802/1608] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:23.808574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0772280-74b5-4e2b-b87c-804bf86f9218 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.810614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f0772280-74b5-4e2b-b87c-804bf86f9218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:23.822739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f340db-b513-47bc-a05b-5c0bbe7d82f5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.829911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.830484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0772280-74b5-4e2b-b87c-804bf86f9218 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.830693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.831053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.831559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] PATH_INFO: `/v3/users/f0256a6b6e1a4baa856308fd831358e6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.832910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0256a6b6e1a4baa856308fd831358e6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.834969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.836266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f9bf-f4ee-43ea-99d4-b16845da3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.837133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f9bf-f4ee-43ea-99d4-b16845da3d87 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.837522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f9bf-f4ee-43ea-99d4-b16845da3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.837903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f9bf-f4ee-43ea-99d4-b16845da3d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.838754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f9bf-f4ee-43ea-99d4-b16845da3d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.841825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f9bf-f4ee-43ea-99d4-b16845da3d87 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.852938 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 803/1609] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:23.853773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f9bf-f4ee-43ea-99d4-b16845da3d87 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.863807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f9bf-f4ee-43ea-99d4-b16845da3d87 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:23.869716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d4228-8603-4005-87f6-c728eb623042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:23.871022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d4228-8603-4005-87f6-c728eb623042 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.871022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d4228-8603-4005-87f6-c728eb623042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.871526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d4228-8603-4005-87f6-c728eb623042 admin admin] PATH_INFO: `/v3/projects/f002025aca2c472ab186d16c6745a0b3/users/a864687612404b139227d92ff7564d8b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:23.879299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d4228-8603-4005-87f6-c728eb623042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f002025aca2c472ab186d16c6745a0b3, user_id=a864687612404b139227d92ff7564d8b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:23.882192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d4228-8603-4005-87f6-c728eb623042 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:23.903734 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:23.909773 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 804/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:23 2022] PUT /identity/v3/projects/f002025aca2c472ab186d16c6745a0b3/users/a864687612404b139227d92ff7564d8b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:23.910908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d4228-8603-4005-87f6-c728eb623042 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:23.915876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0256a6b6e1a4baa856308fd831358e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.954917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0256a6b6e1a4baa856308fd831358e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.962413 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:23.970419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0256a6b6e1a4baa856308fd831358e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.979070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0256a6b6e1a4baa856308fd831358e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.981869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d50daf08-98b4-4b1b-9aa7-4f22cfe2e6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0256a6b6e1a4baa856308fd831358e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:23.990701 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 807/1611] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:23 2022] DELETE /identity/v3/users/f0256a6b6e1a4baa856308fd831358e6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:23.992581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be107-7867-4c04-b8dd-a1d737051605 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:23.993046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be107-7867-4c04-b8dd-a1d737051605 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:23.993508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be107-7867-4c04-b8dd-a1d737051605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.023600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d4228-8603-4005-87f6-c728eb623042 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:24.040234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9d7be107-7867-4c04-b8dd-a1d737051605 None None] MFA Rules not processed for user `a864687612404b139227d92ff7564d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:24.041709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9d7be107-7867-4c04-b8dd-a1d737051605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:24.111793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a76aa-f52b-4cf8-83f6-fc35ffa52cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:24.112731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a76aa-f52b-4cf8-83f6-fc35ffa52cef admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.113014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a76aa-f52b-4cf8-83f6-fc35ffa52cef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.113291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a76aa-f52b-4cf8-83f6-fc35ffa52cef admin admin] PATH_INFO: `/v3/projects/a0676f376817483389300f03ed99cced/users/a24b98f6af634c61af828bb20ce1e945/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.136239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a76aa-f52b-4cf8-83f6-fc35ffa52cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0676f376817483389300f03ed99cced, user_id=a24b98f6af634c61af828bb20ce1e945, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:24.139701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a76aa-f52b-4cf8-83f6-fc35ffa52cef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:24.157605 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 805/1612] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:23 2022] PUT /identity/v3/projects/a0676f376817483389300f03ed99cced/users/a24b98f6af634c61af828bb20ce1e945/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:24.165471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d414c-26df-47ae-8262-338240725df4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.165866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d414c-26df-47ae-8262-338240725df4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.166011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d414c-26df-47ae-8262-338240725df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.185122 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 808/1613] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:24.194510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8a7d414c-26df-47ae-8262-338240725df4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:24.196125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8a7d414c-26df-47ae-8262-338240725df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:24.197472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7be107-7867-4c04-b8dd-a1d737051605 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:24.200286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9d7be107-7867-4c04-b8dd-a1d737051605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:24.317032 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 806/1614] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:44:24.327563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d414c-26df-47ae-8262-338240725df4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:24.330497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8a7d414c-26df-47ae-8262-338240725df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:24.357474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7be107-7867-4c04-b8dd-a1d737051605 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:24.445968 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:24.454240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d414c-26df-47ae-8262-338240725df4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:24.461689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97172f-c73f-4110-8513-dbbc09e56b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:24.462772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97172f-c73f-4110-8513-dbbc09e56b8f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.463289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97172f-c73f-4110-8513-dbbc09e56b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.463838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97172f-c73f-4110-8513-dbbc09e56b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.479092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97172f-c73f-4110-8513-dbbc09e56b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:24.481523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97172f-c73f-4110-8513-dbbc09e56b8f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:24.487359 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:24.495415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f352c5c-8b4b-4c17-8276-dc88f6a1bd39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:24.496417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f352c5c-8b4b-4c17-8276-dc88f6a1bd39 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.496874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f352c5c-8b4b-4c17-8276-dc88f6a1bd39 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.497152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f352c5c-8b4b-4c17-8276-dc88f6a1bd39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.500040 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 807/1615] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:44:24.506390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97172f-c73f-4110-8513-dbbc09e56b8f service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:24.509426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3b97172f-c73f-4110-8513-dbbc09e56b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:24.543554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97172f-c73f-4110-8513-dbbc09e56b8f service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:24.551495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:24.552563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.554107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.554415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] PATH_INFO: `/v3/projects/88f4b981924a42ba89d838596835652e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.556067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f4b981924a42ba89d838596835652e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:24.567271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:24.588538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f352c5c-8b4b-4c17-8276-dc88f6a1bd39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:24.590316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f352c5c-8b4b-4c17-8276-dc88f6a1bd39 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:24.602788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 809/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:24 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:24.640982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f4b981924a42ba89d838596835652e', 'request_id': 'req-8859d542-9618-4866-a039-fcc4d442d022'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:24.652886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f4b981924a42ba89d838596835652e', 'request_id': 'req-8859d542-9618-4866-a039-fcc4d442d022'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:24.658425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f4b981924a42ba89d838596835652e', 'request_id': 'req-8859d542-9618-4866-a039-fcc4d442d022'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:24.661739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f352c5c-8b4b-4c17-8276-dc88f6a1bd39 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:24.664365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2f352c5c-8b4b-4c17-8276-dc88f6a1bd39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:24.680410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] The token cache is being invalidate because project 88f4b981924a42ba89d838596835652e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:24.680821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:24.681593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8859d542-9618-4866-a039-fcc4d442d022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:24.682271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f352c5c-8b4b-4c17-8276-dc88f6a1bd39 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:24.684472 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 808/1617] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:24 2022] DELETE /identity/v3/projects/88f4b981924a42ba89d838596835652e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:24.689705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a718ec-2295-496b-b2c3-b581062a3f3f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.690117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a718ec-2295-496b-b2c3-b581062a3f3f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.690491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a718ec-2295-496b-b2c3-b581062a3f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.728510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f0a718ec-2295-496b-b2c3-b581062a3f3f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:24.731540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f0a718ec-2295-496b-b2c3-b581062a3f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:24.797895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08649c1-7261-4cc7-99d6-06b9444ee3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:24.798343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08649c1-7261-4cc7-99d6-06b9444ee3d5 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.798618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08649c1-7261-4cc7-99d6-06b9444ee3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.798895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08649c1-7261-4cc7-99d6-06b9444ee3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.801826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a08649c1-7261-4cc7-99d6-06b9444ee3d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:24.834312 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 809/1618] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:24.843241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b9179-fc8a-4ac4-be32-e8f343589b09 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.843704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b9179-fc8a-4ac4-be32-e8f343589b09 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.844109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b9179-fc8a-4ac4-be32-e8f343589b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.872504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ed6b9179-fc8a-4ac4-be32-e8f343589b09 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:24.874877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ed6b9179-fc8a-4ac4-be32-e8f343589b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:24.889633 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 810/1619] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:24.894108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b9179-fc8a-4ac4-be32-e8f343589b09 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:24.898257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08649c1-7261-4cc7-99d6-06b9444ee3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:24.899540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08649c1-7261-4cc7-99d6-06b9444ee3d5 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:24.906246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b9179-fc8a-4ac4-be32-e8f343589b09 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:24.911121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac65f6-1b41-47a7-b375-3e2d14db1f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:24.911749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac65f6-1b41-47a7-b375-3e2d14db1f30 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.912019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac65f6-1b41-47a7-b375-3e2d14db1f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.912289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac65f6-1b41-47a7-b375-3e2d14db1f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.912980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac65f6-1b41-47a7-b375-3e2d14db1f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:24.913290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac65f6-1b41-47a7-b375-3e2d14db1f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:24.913477 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 810/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:24 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:44:24.914891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac65f6-1b41-47a7-b375-3e2d14db1f30 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:24.934963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08649c1-7261-4cc7-99d6-06b9444ee3d5 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:24.938735 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 811/1621] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:44:24.960962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08649c1-7261-4cc7-99d6-06b9444ee3d5 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:24.979423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d639e-8715-4c6f-be55-ab1f8b0bb00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:24.981853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d639e-8715-4c6f-be55-ab1f8b0bb00c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:24.982143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d639e-8715-4c6f-be55-ab1f8b0bb00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:24.982534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d639e-8715-4c6f-be55-ab1f8b0bb00c admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:24.983733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d639e-8715-4c6f-be55-ab1f8b0bb00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:24.987009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d639e-8715-4c6f-be55-ab1f8b0bb00c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:25.023983 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:25.067511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac65f6-1b41-47a7-b375-3e2d14db1f30 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:25.068090 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 811/1622] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:24 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:44:25.082906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac65f6-1b41-47a7-b375-3e2d14db1f30 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:25.231921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d22031-9fb1-47d3-bbf2-0c5af6c523d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:25.231921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d22031-9fb1-47d3-bbf2-0c5af6c523d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:25.231921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d22031-9fb1-47d3-bbf2-0c5af6c523d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:25.231921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d22031-9fb1-47d3-bbf2-0c5af6c523d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:25.233187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d22031-9fb1-47d3-bbf2-0c5af6c523d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:25.233187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d22031-9fb1-47d3-bbf2-0c5af6c523d4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:25.254970 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:25.283977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d639e-8715-4c6f-be55-ab1f8b0bb00c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:25.288914 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 812/1623] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:25 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:44:25.309525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d639e-8715-4c6f-be55-ab1f8b0bb00c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:25.336829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6023481-94f0-4628-8c43-a407c6b51498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:25.337939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6023481-94f0-4628-8c43-a407c6b51498 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:25.338408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6023481-94f0-4628-8c43-a407c6b51498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:25.341719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6023481-94f0-4628-8c43-a407c6b51498 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:25.343152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6023481-94f0-4628-8c43-a407c6b51498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:25.346344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6023481-94f0-4628-8c43-a407c6b51498 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:25.373334 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 812/1624] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:25.374811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d22031-9fb1-47d3-bbf2-0c5af6c523d4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:25.392976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d22031-9fb1-47d3-bbf2-0c5af6c523d4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:25.400086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b84f1a-c277-4cce-b08f-e421df76eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:25.401992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b84f1a-c277-4cce-b08f-e421df76eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:25.402684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b84f1a-c277-4cce-b08f-e421df76eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:25.403219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b84f1a-c277-4cce-b08f-e421df76eaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:25.404292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b84f1a-c277-4cce-b08f-e421df76eaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:25.406293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b84f1a-c277-4cce-b08f-e421df76eaf3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:25.434385 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 813/1625] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:25.435065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6023481-94f0-4628-8c43-a407c6b51498 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:25.460915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6023481-94f0-4628-8c43-a407c6b51498 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:25.473062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706cb7-71fd-4add-8119-2366156b8cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:25.479593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706cb7-71fd-4add-8119-2366156b8cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:25.479593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706cb7-71fd-4add-8119-2366156b8cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:25.479593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706cb7-71fd-4add-8119-2366156b8cf2 admin admin] PATH_INFO: `/v3/projects/b553e8276e214de6b1fa6db1fb52e6a9/users/97fb5d3a021149d4a90bef39a518ada2/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:25.542917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a706cb7-71fd-4add-8119-2366156b8cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b553e8276e214de6b1fa6db1fb52e6a9, user_id=97fb5d3a021149d4a90bef39a518ada2, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:25.551484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a706cb7-71fd-4add-8119-2366156b8cf2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:25.580930 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 813/1626] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:25 2022] PUT /identity/v3/projects/b553e8276e214de6b1fa6db1fb52e6a9/users/97fb5d3a021149d4a90bef39a518ada2/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:25.600896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1acef-970a-4dfd-a109-15cba2282366 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:25.601610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1acef-970a-4dfd-a109-15cba2282366 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:25.602081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1acef-970a-4dfd-a109-15cba2282366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:25.659569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7cc1acef-970a-4dfd-a109-15cba2282366 None None] MFA Rules not processed for user `97fb5d3a021149d4a90bef39a518ada2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:25.664300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7cc1acef-970a-4dfd-a109-15cba2282366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:25.826765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706cb7-71fd-4add-8119-2366156b8cf2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:25.828651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9a706cb7-71fd-4add-8119-2366156b8cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:25.849065 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 814/1627] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:25.856133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1acef-970a-4dfd-a109-15cba2282366 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:25.988533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706cb7-71fd-4add-8119-2366156b8cf2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:26.005095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:26.006385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:26.006887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:26.007378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] PATH_INFO: `/v3/users/9fe239d58cbf4c4d9d1b8023b5c4ebdb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:26.016325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe239d58cbf4c4d9d1b8023b5c4ebdb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:26.020342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:26.045513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1acef-970a-4dfd-a109-15cba2282366 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:26.071362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7b2b4-09e4-43c1-be79-ff7c855bf38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:26.072424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7b2b4-09e4-43c1-be79-ff7c855bf38f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:26.072995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7b2b4-09e4-43c1-be79-ff7c855bf38f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:26.073496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7b2b4-09e4-43c1-be79-ff7c855bf38f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:26.074725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7b2b4-09e4-43c1-be79-ff7c855bf38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:26.078536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7b2b4-09e4-43c1-be79-ff7c855bf38f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:26.208240 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 815/1628] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:25 2022] POST /identity/v3/projects => generated 385 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:26.210895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe239d58cbf4c4d9d1b8023b5c4ebdb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:26.211510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7b2b4-09e4-43c1-be79-ff7c855bf38f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:26.253524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe239d58cbf4c4d9d1b8023b5c4ebdb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:26.274695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe239d58cbf4c4d9d1b8023b5c4ebdb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:26.286484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe239d58cbf4c4d9d1b8023b5c4ebdb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:26.287935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b6c04b9f-595b-4d14-9da1-edacf5def13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe239d58cbf4c4d9d1b8023b5c4ebdb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:26.317755 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 814/1629] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:25 2022] DELETE /identity/v3/users/9fe239d58cbf4c4d9d1b8023b5c4ebdb => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:26.321105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6080dd-de17-4675-bece-3907ac3d9dad None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:26.321393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6080dd-de17-4675-bece-3907ac3d9dad None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:26.321674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6080dd-de17-4675-bece-3907ac3d9dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:26.423723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9f6080dd-de17-4675-bece-3907ac3d9dad None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:26.429750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9f6080dd-de17-4675-bece-3907ac3d9dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:26.465086 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:26.478822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7b2b4-09e4-43c1-be79-ff7c855bf38f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:26.548190 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:26.657473 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 815/1630] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:26.662849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66096b-48ac-4fde-82a7-df664ae8beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:26.663582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66096b-48ac-4fde-82a7-df664ae8beaf admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:26.663947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66096b-48ac-4fde-82a7-df664ae8beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:26.664238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66096b-48ac-4fde-82a7-df664ae8beaf admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:26.664934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66096b-48ac-4fde-82a7-df664ae8beaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:26.669127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66096b-48ac-4fde-82a7-df664ae8beaf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:26.680192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6080dd-de17-4675-bece-3907ac3d9dad None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:26.682353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9f6080dd-de17-4675-bece-3907ac3d9dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:26.720289 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 816/1631] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:26 2022] POST /identity/v3/users => generated 299 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:26.725075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66096b-48ac-4fde-82a7-df664ae8beaf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:26.740851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5d66096b-48ac-4fde-82a7-df664ae8beaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:26.781678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6080dd-de17-4675-bece-3907ac3d9dad None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:26.786225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fbb65-98dc-405a-9e65-0483f6f6424e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:26.787003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fbb65-98dc-405a-9e65-0483f6f6424e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:26.787372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fbb65-98dc-405a-9e65-0483f6f6424e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:26.787670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fbb65-98dc-405a-9e65-0483f6f6424e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:26.795057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66096b-48ac-4fde-82a7-df664ae8beaf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:26.800971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fbb65-98dc-405a-9e65-0483f6f6424e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:26.802679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fbb65-98dc-405a-9e65-0483f6f6424e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:26.815584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0642-e294-46bb-9d95-63ae9fc4a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:26.816755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0642-e294-46bb-9d95-63ae9fc4a9cd admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:26.817440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0642-e294-46bb-9d95-63ae9fc4a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:26.819051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0642-e294-46bb-9d95-63ae9fc4a9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:26.820711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c0642-e294-46bb-9d95-63ae9fc4a9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:26.825253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c0642-e294-46bb-9d95-63ae9fc4a9cd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:26.828743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 816/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:26.850448 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 817/1633] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:26.854928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fbb65-98dc-405a-9e65-0483f6f6424e service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:26.871884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fbb65-98dc-405a-9e65-0483f6f6424e service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:26.883572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acf7b7-eae1-426c-b383-cce6b1c8f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:26.884286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acf7b7-eae1-426c-b383-cce6b1c8f53e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:26.884565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acf7b7-eae1-426c-b383-cce6b1c8f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:26.884861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acf7b7-eae1-426c-b383-cce6b1c8f53e admin admin] PATH_INFO: `/v3/projects/4cd0a5bce77f4182967d71e36658224f/users/a37341e416ed42dfbe9b34a4e5ff2ba9/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:26.924549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acf7b7-eae1-426c-b383-cce6b1c8f53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd0a5bce77f4182967d71e36658224f, user_id=a37341e416ed42dfbe9b34a4e5ff2ba9, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:26.929870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acf7b7-eae1-426c-b383-cce6b1c8f53e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:26.958333 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 817/1634] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:26 2022] PUT /identity/v3/projects/4cd0a5bce77f4182967d71e36658224f/users/a37341e416ed42dfbe9b34a4e5ff2ba9/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:44:26.961769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0642-e294-46bb-9d95-63ae9fc4a9cd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:26.983510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0642-e294-46bb-9d95-63ae9fc4a9cd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:27.067636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e100f5-e4fe-446e-8164-82302d672404 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:27.068495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e100f5-e4fe-446e-8164-82302d672404 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:27.068495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e100f5-e4fe-446e-8164-82302d672404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:27.135966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-22e100f5-e4fe-446e-8164-82302d672404 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:27.137378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-22e100f5-e4fe-446e-8164-82302d672404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:27.140008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a34d4-817a-4a6d-bcf8-dc859ebba240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:27.140914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a34d4-817a-4a6d-bcf8-dc859ebba240 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:27.142847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a34d4-817a-4a6d-bcf8-dc859ebba240 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:27.143793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a34d4-817a-4a6d-bcf8-dc859ebba240 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:27.146552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a34d4-817a-4a6d-bcf8-dc859ebba240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:27.149028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a34d4-817a-4a6d-bcf8-dc859ebba240 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:27.197039 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 818/1635] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:27.202780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a34d4-817a-4a6d-bcf8-dc859ebba240 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:27.230566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a34d4-817a-4a6d-bcf8-dc859ebba240 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:27.243507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae184c3e-0ad4-418e-9333-8d67c1ff8868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:27.245176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184c3e-0ad4-418e-9333-8d67c1ff8868 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:27.245493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184c3e-0ad4-418e-9333-8d67c1ff8868 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:27.245836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184c3e-0ad4-418e-9333-8d67c1ff8868 admin admin] PATH_INFO: `/v3/projects/4cd0a5bce77f4182967d71e36658224f/users/a37341e416ed42dfbe9b34a4e5ff2ba9/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:27.251125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae184c3e-0ad4-418e-9333-8d67c1ff8868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd0a5bce77f4182967d71e36658224f, user_id=a37341e416ed42dfbe9b34a4e5ff2ba9, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:27.257843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae184c3e-0ad4-418e-9333-8d67c1ff8868 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:27.274485 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 818/1636] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Oct 19 00:44:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:44:27.285036 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 819/1637] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:27 2022] PUT /identity/v3/projects/4cd0a5bce77f4182967d71e36658224f/users/a37341e416ed42dfbe9b34a4e5ff2ba9/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:44:27.309638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ff6af-e57f-4b99-bc30-2eca9c602672 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:27.310112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ff6af-e57f-4b99-bc30-2eca9c602672 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:27.310573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ff6af-e57f-4b99-bc30-2eca9c602672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:27.327206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae184c3e-0ad4-418e-9333-8d67c1ff8868 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:27.384369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9d3ff6af-e57f-4b99-bc30-2eca9c602672 None None] MFA Rules not processed for user `a37341e416ed42dfbe9b34a4e5ff2ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:27.386745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9d3ff6af-e57f-4b99-bc30-2eca9c602672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:27.456518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae184c3e-0ad4-418e-9333-8d67c1ff8868 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:27.464817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566a378-42b7-461c-b84b-d63f3059aa9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:27.465615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a378-42b7-461c-b84b-d63f3059aa9f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:27.465899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a378-42b7-461c-b84b-d63f3059aa9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:27.466174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a378-42b7-461c-b84b-d63f3059aa9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:27.483337 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:27.485876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566a378-42b7-461c-b84b-d63f3059aa9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:27.489620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566a378-42b7-461c-b84b-d63f3059aa9f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:27.522548 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 820/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:44:27.527296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566a378-42b7-461c-b84b-d63f3059aa9f service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:27.529357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4566a378-42b7-461c-b84b-d63f3059aa9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:27.544170 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 819/1639] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:27.552539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda2acf-d4e4-43f7-980e-76312d0f1d1d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:27.552905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda2acf-d4e4-43f7-980e-76312d0f1d1d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:27.553087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda2acf-d4e4-43f7-980e-76312d0f1d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:27.569014 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:27.589789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8eda2acf-d4e4-43f7-980e-76312d0f1d1d None None] MFA Rules not processed for user `97fb5d3a021149d4a90bef39a518ada2`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:27.590956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8eda2acf-d4e4-43f7-980e-76312d0f1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:27.695214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566a378-42b7-461c-b84b-d63f3059aa9f service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:27.706675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:27.707657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:27.708086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:27.708396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] PATH_INFO: `/v3/projects/009288be91794393b779e14d30e5c421` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:27.726560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] RBAC: Authorizing `identity:delete_project(project_id=009288be91794393b779e14d30e5c421)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:27.735036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:27.751305 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 820/1640] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:27.770056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda2acf-d4e4-43f7-980e-76312d0f1d1d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:27.775406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8eda2acf-d4e4-43f7-980e-76312d0f1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:27.923543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009288be91794393b779e14d30e5c421', 'request_id': 'req-ec83d326-2b25-4a16-b64f-0a958fd1706c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:27.947845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009288be91794393b779e14d30e5c421', 'request_id': 'req-ec83d326-2b25-4a16-b64f-0a958fd1706c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:27.953233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda2acf-d4e4-43f7-980e-76312d0f1d1d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:27.973065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009288be91794393b779e14d30e5c421', 'request_id': 'req-ec83d326-2b25-4a16-b64f-0a958fd1706c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:28.013266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] The token cache is being invalidate because project 009288be91794393b779e14d30e5c421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:28.013886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:28.021163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:28.023204 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 821/1641] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:27 2022] DELETE /identity/v3/projects/009288be91794393b779e14d30e5c421 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:28.027428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:28.029389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:28.088247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb25fb-3383-4302-b83c-691366be76e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:28.090371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb25fb-3383-4302-b83c-691366be76e1 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:28.093677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb25fb-3383-4302-b83c-691366be76e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:28.094225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb25fb-3383-4302-b83c-691366be76e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:28.097691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5ecb25fb-3383-4302-b83c-691366be76e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:28.134919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83d326-2b25-4a16-b64f-0a958fd1706c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:28.142311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:28.143070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:28.143384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:28.143702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] PATH_INFO: `/v3/users/a864687612404b139227d92ff7564d8b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:28.145100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a864687612404b139227d92ff7564d8b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:28.147596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:28.168974 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:28.233353 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:28.249894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb25fb-3383-4302-b83c-691366be76e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:28.251735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb25fb-3383-4302-b83c-691366be76e1 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:28.253025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a864687612404b139227d92ff7564d8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:28.283368 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 821/1642] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:28.284121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a864687612404b139227d92ff7564d8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:28.303360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a864687612404b139227d92ff7564d8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:28.349221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a864687612404b139227d92ff7564d8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:28.350587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-67e2b775-5160-4769-9649-5beed556c101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a864687612404b139227d92ff7564d8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:28.368849 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 822/1643] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:28 2022] DELETE /identity/v3/users/a864687612404b139227d92ff7564d8b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:29.273339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb25fb-3383-4302-b83c-691366be76e1 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:29.291449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb25fb-3383-4302-b83c-691366be76e1 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:29.517315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:29.523554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:29.523554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:29.530295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] PATH_INFO: `/v3/projects/f002025aca2c472ab186d16c6745a0b3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:29.534606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f002025aca2c472ab186d16c6745a0b3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:29.549767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:29.688496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f002025aca2c472ab186d16c6745a0b3', 'request_id': 'req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:29.699311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f002025aca2c472ab186d16c6745a0b3', 'request_id': 'req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:29.715524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f002025aca2c472ab186d16c6745a0b3', 'request_id': 'req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:29.765875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] The token cache is being invalidate because project f002025aca2c472ab186d16c6745a0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:29.765875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:29.765875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c0e40ae-b1b1-49ba-b392-1aab8b40e46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:29.765875 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 822/1644] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:29 2022] DELETE /identity/v3/projects/f002025aca2c472ab186d16c6745a0b3 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:29.767420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4082d-7d22-4a8a-a7cc-d6401059f2e6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:29.767420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4082d-7d22-4a8a-a7cc-d6401059f2e6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:29.767420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4082d-7d22-4a8a-a7cc-d6401059f2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:29.841808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bfd4082d-7d22-4a8a-a7cc-d6401059f2e6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:29.843244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bfd4082d-7d22-4a8a-a7cc-d6401059f2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:29.981852 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 823/1645] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:29.983789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20338ee5-18ac-4e17-b95c-4bac994b384a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:29.984080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20338ee5-18ac-4e17-b95c-4bac994b384a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:29.985177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20338ee5-18ac-4e17-b95c-4bac994b384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.027195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-20338ee5-18ac-4e17-b95c-4bac994b384a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:30.028832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-20338ee5-18ac-4e17-b95c-4bac994b384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:30.038379 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 823/1646] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:30.043790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4082d-7d22-4a8a-a7cc-d6401059f2e6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:30.059271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4082d-7d22-4a8a-a7cc-d6401059f2e6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:30.066758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97d243-a391-462f-8b28-35675e918a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:30.067767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97d243-a391-462f-8b28-35675e918a84 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.068088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97d243-a391-462f-8b28-35675e918a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.068362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97d243-a391-462f-8b28-35675e918a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.069080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97d243-a391-462f-8b28-35675e918a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:30.069382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97d243-a391-462f-8b28-35675e918a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:30.071108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97d243-a391-462f-8b28-35675e918a84 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:30.102874 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 824/1647] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:30.109625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20338ee5-18ac-4e17-b95c-4bac994b384a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:30.127469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20338ee5-18ac-4e17-b95c-4bac994b384a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:30.134784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf1d9b-924d-473f-80e7-4b3532f6ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:30.136315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf1d9b-924d-473f-80e7-4b3532f6ce03 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.136739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf1d9b-924d-473f-80e7-4b3532f6ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.137111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf1d9b-924d-473f-80e7-4b3532f6ce03 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.137932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf1d9b-924d-473f-80e7-4b3532f6ce03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:30.139927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf1d9b-924d-473f-80e7-4b3532f6ce03 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:30.184848 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 824/1648] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:30 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:30.185297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97d243-a391-462f-8b28-35675e918a84 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:30.199185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97d243-a391-462f-8b28-35675e918a84 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:30.244047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac4176-ee36-425b-8d56-0a1adb654b34 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.246558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac4176-ee36-425b-8d56-0a1adb654b34 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.247679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac4176-ee36-425b-8d56-0a1adb654b34 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.253851 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 825/1649] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:30 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:30.264333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d050fa-b65f-4fa4-8c4a-0e65ed50912f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.264709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d050fa-b65f-4fa4-8c4a-0e65ed50912f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.265259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d050fa-b65f-4fa4-8c4a-0e65ed50912f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.315821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-09d050fa-b65f-4fa4-8c4a-0e65ed50912f None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:30.317524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09d050fa-b65f-4fa4-8c4a-0e65ed50912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:30.327787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd8bc-45d3-4c2b-b386-8a75f1b0531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:30.329869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd8bc-45d3-4c2b-b386-8a75f1b0531f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.335381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd8bc-45d3-4c2b-b386-8a75f1b0531f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.336161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd8bc-45d3-4c2b-b386-8a75f1b0531f admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.337321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bd8bc-45d3-4c2b-b386-8a75f1b0531f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:30.340231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bd8bc-45d3-4c2b-b386-8a75f1b0531f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:30.365533 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:30.406193 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 825/1650] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:30 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:44:30.416014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd8bc-45d3-4c2b-b386-8a75f1b0531f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:30.436327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd8bc-45d3-4c2b-b386-8a75f1b0531f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:30.442590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae6765-0a3c-459e-8d25-f1ee8d9049d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:30.443734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae6765-0a3c-459e-8d25-f1ee8d9049d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.444254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae6765-0a3c-459e-8d25-f1ee8d9049d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.444771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae6765-0a3c-459e-8d25-f1ee8d9049d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.445675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae6765-0a3c-459e-8d25-f1ee8d9049d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:30.448875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae6765-0a3c-459e-8d25-f1ee8d9049d5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:30.451583 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 826/1651] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:30.464478 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 826/1652] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:30.471071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d050fa-b65f-4fa4-8c4a-0e65ed50912f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:30.488490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae6765-0a3c-459e-8d25-f1ee8d9049d5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:30.491853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7eae6765-0a3c-459e-8d25-f1ee8d9049d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:30.495833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d050fa-b65f-4fa4-8c4a-0e65ed50912f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:30.502865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0645-2971-4509-8883-01ac9c0c085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:30.503727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0645-2971-4509-8883-01ac9c0c085f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.503948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0645-2971-4509-8883-01ac9c0c085f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.504224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0645-2971-4509-8883-01ac9c0c085f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.504929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0645-2971-4509-8883-01ac9c0c085f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:30.507295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0645-2971-4509-8883-01ac9c0c085f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:30.523897 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 827/1653] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:30.528026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0645-2971-4509-8883-01ac9c0c085f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:30.541376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0645-2971-4509-8883-01ac9c0c085f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:30.549255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e9412-6825-4d8f-b6ad-632b720dcd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:30.554679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae6765-0a3c-459e-8d25-f1ee8d9049d5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:30.566872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e9412-6825-4d8f-b6ad-632b720dcd4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.567236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e9412-6825-4d8f-b6ad-632b720dcd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.568123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e9412-6825-4d8f-b6ad-632b720dcd4a admin admin] PATH_INFO: `/v3/projects/047beaabd75e483b9d668d120fb434a4/users/fa1bdd6156f4450db16c3a1cbeabd4c8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.589090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3acf4-40d5-44e6-ad63-f9ff9080d2fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:30.590220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3acf4-40d5-44e6-ad63-f9ff9080d2fa service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.590705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3acf4-40d5-44e6-ad63-f9ff9080d2fa service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.591285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3acf4-40d5-44e6-ad63-f9ff9080d2fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.628863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3acf4-40d5-44e6-ad63-f9ff9080d2fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:30.633484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3acf4-40d5-44e6-ad63-f9ff9080d2fa service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:30.651533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e9412-6825-4d8f-b6ad-632b720dcd4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=047beaabd75e483b9d668d120fb434a4, user_id=fa1bdd6156f4450db16c3a1cbeabd4c8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:30.665833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e9412-6825-4d8f-b6ad-632b720dcd4a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:30.677249 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 827/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:30.702077 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 828/1655] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:30 2022] PUT /identity/v3/projects/047beaabd75e483b9d668d120fb434a4/users/fa1bdd6156f4450db16c3a1cbeabd4c8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:30.713614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16203778-3126-4dc6-a712-ee5d2495e7e1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:30.714089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16203778-3126-4dc6-a712-ee5d2495e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:30.714539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16203778-3126-4dc6-a712-ee5d2495e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:30.738485 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:30.755255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-16203778-3126-4dc6-a712-ee5d2495e7e1 None None] MFA Rules not processed for user `fa1bdd6156f4450db16c3a1cbeabd4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:30.758026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-16203778-3126-4dc6-a712-ee5d2495e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:30.875763 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 828/1656] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:30.880139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e9412-6825-4d8f-b6ad-632b720dcd4a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:31.004877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e9412-6825-4d8f-b6ad-632b720dcd4a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:31.011831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ba579-2436-4456-803f-94c66f94ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:31.012881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ba579-2436-4456-803f-94c66f94ba5c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:31.013377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ba579-2436-4456-803f-94c66f94ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:31.013830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ba579-2436-4456-803f-94c66f94ba5c admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:31.014698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ba579-2436-4456-803f-94c66f94ba5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:31.017230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ba579-2436-4456-803f-94c66f94ba5c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:31.070641 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 829/1657] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:30 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:31.075157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16203778-3126-4dc6-a712-ee5d2495e7e1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:31.092965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16203778-3126-4dc6-a712-ee5d2495e7e1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:31.192651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a521d4-2652-4969-8bcc-4a6b3211d8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:31.206513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a521d4-2652-4969-8bcc-4a6b3211d8ba admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:31.207150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a521d4-2652-4969-8bcc-4a6b3211d8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:31.207363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a521d4-2652-4969-8bcc-4a6b3211d8ba admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:31.213251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a521d4-2652-4969-8bcc-4a6b3211d8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:31.223482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a521d4-2652-4969-8bcc-4a6b3211d8ba admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:31.283381 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 829/1658] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:31 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:31.296208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ba579-2436-4456-803f-94c66f94ba5c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:31.318101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ba579-2436-4456-803f-94c66f94ba5c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:31.328966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522221-78f3-4478-89d7-5a72e4a5558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:31.329926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522221-78f3-4478-89d7-5a72e4a5558a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:31.330209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522221-78f3-4478-89d7-5a72e4a5558a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:31.330503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522221-78f3-4478-89d7-5a72e4a5558a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:31.331159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17522221-78f3-4478-89d7-5a72e4a5558a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:31.344065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17522221-78f3-4478-89d7-5a72e4a5558a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:31.375168 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 830/1659] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:31.377082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a521d4-2652-4969-8bcc-4a6b3211d8ba admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:31.395040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a521d4-2652-4969-8bcc-4a6b3211d8ba admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:31.420791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e258e-56b0-4403-b762-10965cd224aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:31.422600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e258e-56b0-4403-b762-10965cd224aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:31.422977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e258e-56b0-4403-b762-10965cd224aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:31.423376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e258e-56b0-4403-b762-10965cd224aa admin admin] PATH_INFO: `/v3/projects/3b9f87c69d264030af37a186609edf48/users/c9b206a5e2b849b2a6b5c61c4b9ec3c8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:31.471382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e258e-56b0-4403-b762-10965cd224aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9f87c69d264030af37a186609edf48, user_id=c9b206a5e2b849b2a6b5c61c4b9ec3c8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:31.482155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e258e-56b0-4403-b762-10965cd224aa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:31.501864 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 830/1660] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:31 2022] PUT /identity/v3/projects/3b9f87c69d264030af37a186609edf48/users/c9b206a5e2b849b2a6b5c61c4b9ec3c8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:31.506416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522221-78f3-4478-89d7-5a72e4a5558a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:31.535684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522221-78f3-4478-89d7-5a72e4a5558a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:31.683796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c25b7a-147e-403a-8b16-f387c2f3dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:31.684554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c25b7a-147e-403a-8b16-f387c2f3dc06 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:31.684990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c25b7a-147e-403a-8b16-f387c2f3dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:31.685324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c25b7a-147e-403a-8b16-f387c2f3dc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:31.686668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c25b7a-147e-403a-8b16-f387c2f3dc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:31.689206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c25b7a-147e-403a-8b16-f387c2f3dc06 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:31.715149 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:31.736990 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 831/1661] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:31.739718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e258e-56b0-4403-b762-10965cd224aa admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:31.757821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e258e-56b0-4403-b762-10965cd224aa admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:31.778772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a0f6-923e-4687-be6b-cba4b8217a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:31.780099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a0f6-923e-4687-be6b-cba4b8217a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:31.780434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a0f6-923e-4687-be6b-cba4b8217a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:31.780744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a0f6-923e-4687-be6b-cba4b8217a07 admin admin] PATH_INFO: `/v3/projects/3b9f87c69d264030af37a186609edf48/users/c9b206a5e2b849b2a6b5c61c4b9ec3c8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:31.787318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186a0f6-923e-4687-be6b-cba4b8217a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9f87c69d264030af37a186609edf48, user_id=c9b206a5e2b849b2a6b5c61c4b9ec3c8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:31.794313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186a0f6-923e-4687-be6b-cba4b8217a07 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:31.820610 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 831/1662] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:31 2022] PUT /identity/v3/projects/3b9f87c69d264030af37a186609edf48/users/c9b206a5e2b849b2a6b5c61c4b9ec3c8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:31.832339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1f5d9-9468-49cf-9e88-85ae005b9f17 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:31.832730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1f5d9-9468-49cf-9e88-85ae005b9f17 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:31.833093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1f5d9-9468-49cf-9e88-85ae005b9f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:31.908327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7fb1f5d9-9468-49cf-9e88-85ae005b9f17 None None] MFA Rules not processed for user `c9b206a5e2b849b2a6b5c61c4b9ec3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:31.912391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7fb1f5d9-9468-49cf-9e88-85ae005b9f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:32.106530 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 832/1663] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:32.134125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a0f6-923e-4687-be6b-cba4b8217a07 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:32.137042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d186a0f6-923e-4687-be6b-cba4b8217a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:32.291133 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:32.357417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a0f6-923e-4687-be6b-cba4b8217a07 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:32.364124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fb8eb-120c-4f61-8dcf-dd8aaa42f54d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:32.364792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fb8eb-120c-4f61-8dcf-dd8aaa42f54d service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:32.365079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fb8eb-120c-4f61-8dcf-dd8aaa42f54d service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:32.365356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fb8eb-120c-4f61-8dcf-dd8aaa42f54d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:32.377654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fb8eb-120c-4f61-8dcf-dd8aaa42f54d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:32.381116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fb8eb-120c-4f61-8dcf-dd8aaa42f54d service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:32.407199 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 832/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:33.894150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9aea-0982-434a-a54e-b00fb2b5943a None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:33.895054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9aea-0982-434a-a54e-b00fb2b5943a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:33.895525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9aea-0982-434a-a54e-b00fb2b5943a None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:33.897488 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 833/1665] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:33.909940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23581c9-8224-4ace-b063-3ce97cdceefb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:33.910500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23581c9-8224-4ace-b063-3ce97cdceefb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:33.910500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23581c9-8224-4ace-b063-3ce97cdceefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:33.958455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c23581c9-8224-4ace-b063-3ce97cdceefb None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:33.960169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c23581c9-8224-4ace-b063-3ce97cdceefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:34.002648 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 833/1666] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:44:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:34.097787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd9aea-0982-434a-a54e-b00fb2b5943a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:34.136876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd9aea-0982-434a-a54e-b00fb2b5943a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:34.143515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba9ea5-9876-4ce8-bc7d-bc932214381d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:34.144398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba9ea5-9876-4ce8-bc7d-bc932214381d service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:34.144780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba9ea5-9876-4ce8-bc7d-bc932214381d service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:34.145132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba9ea5-9876-4ce8-bc7d-bc932214381d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:34.161400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba9ea5-9876-4ce8-bc7d-bc932214381d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:34.163145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba9ea5-9876-4ce8-bc7d-bc932214381d service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:34.178857 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 834/1667] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:34.264580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23581c9-8224-4ace-b063-3ce97cdceefb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:34.373321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23581c9-8224-4ace-b063-3ce97cdceefb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:34.395446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:34.397558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:34.397925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:34.398204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] PATH_INFO: `/v3/users/fa1bdd6156f4450db16c3a1cbeabd4c8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:34.402146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1bdd6156f4450db16c3a1cbeabd4c8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:34.405834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:34.593932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1bdd6156f4450db16c3a1cbeabd4c8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:34.669922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1bdd6156f4450db16c3a1cbeabd4c8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:34.705938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1bdd6156f4450db16c3a1cbeabd4c8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:34.753497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1bdd6156f4450db16c3a1cbeabd4c8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:34.754934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1bdd6156f4450db16c3a1cbeabd4c8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:34.763823 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 834/1668] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:34 2022] DELETE /identity/v3/users/fa1bdd6156f4450db16c3a1cbeabd4c8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:34.768941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939af15a-f623-40d6-9e1b-32d5afdbcef9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:34.769676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939af15a-f623-40d6-9e1b-32d5afdbcef9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:34.770166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939af15a-f623-40d6-9e1b-32d5afdbcef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:34.825963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-939af15a-f623-40d6-9e1b-32d5afdbcef9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:34.832007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-939af15a-f623-40d6-9e1b-32d5afdbcef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:35.040577 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 835/1669] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:35.056878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:35.060861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:35.236176 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:35.268601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ad7b-1298-4960-a7e9-2840d0b3b2e2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:35.279989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706cb76-f2b3-4f2a-b0e4-42a33a2baf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:35.280917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706cb76-f2b3-4f2a-b0e4-42a33a2baf03 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:35.281273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706cb76-f2b3-4f2a-b0e4-42a33a2baf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:35.281616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706cb76-f2b3-4f2a-b0e4-42a33a2baf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:35.309809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706cb76-f2b3-4f2a-b0e4-42a33a2baf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:35.338451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706cb76-f2b3-4f2a-b0e4-42a33a2baf03 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:35.376999 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 835/1670] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:35.763241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939af15a-f623-40d6-9e1b-32d5afdbcef9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:35.773762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-939af15a-f623-40d6-9e1b-32d5afdbcef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:35.958610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939af15a-f623-40d6-9e1b-32d5afdbcef9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:35.970432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27b370-3335-4c76-a810-4f663bad511b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:35.971735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27b370-3335-4c76-a810-4f663bad511b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:35.971974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27b370-3335-4c76-a810-4f663bad511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:36.003060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:36.006874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:36.010655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:36.014778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:36.021511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:36.053406 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:36.065182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-da27b370-3335-4c76-a810-4f663bad511b None None] MFA Rules not processed for user `a24b98f6af634c61af828bb20ce1e945`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:36.066433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-da27b370-3335-4c76-a810-4f663bad511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:36.221613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:36.223810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:36.254930 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 836/1671] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:36.287920 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 836/1672] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:44:36.294711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:36.296593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:36.319926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b846-c500-44fe-875c-8632f8b1b5dc service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:36.328534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9eaa6-62bc-434c-a078-31ba4ec1b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:36.330410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9eaa6-62bc-434c-a078-31ba4ec1b7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:36.330798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9eaa6-62bc-434c-a078-31ba4ec1b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:36.331081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9eaa6-62bc-434c-a078-31ba4ec1b7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:36.333723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9eaa6-62bc-434c-a078-31ba4ec1b7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:36.340570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9eaa6-62bc-434c-a078-31ba4ec1b7f3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:36.383814 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 837/1673] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:36 2022] POST /identity/v3/projects => generated 369 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:36.388684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27b370-3335-4c76-a810-4f663bad511b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:36.413593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27b370-3335-4c76-a810-4f663bad511b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:36.470056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9eaa6-62bc-434c-a078-31ba4ec1b7f3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:36.473216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b7c9eaa6-62bc-434c-a078-31ba4ec1b7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:36.674948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9eaa6-62bc-434c-a078-31ba4ec1b7f3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:36.700428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6e17b-f45f-42a7-a929-cbb1a9280742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:36.701635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6e17b-f45f-42a7-a929-cbb1a9280742 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:36.702145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6e17b-f45f-42a7-a929-cbb1a9280742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:36.702430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6e17b-f45f-42a7-a929-cbb1a9280742 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:36.708190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6e17b-f45f-42a7-a929-cbb1a9280742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:36.724451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6e17b-f45f-42a7-a929-cbb1a9280742 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:36.725657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:36.726581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:36.726878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:36.727178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] PATH_INFO: `/v3/projects/047beaabd75e483b9d668d120fb434a4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:36.767247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=047beaabd75e483b9d668d120fb434a4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:36.785572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:36.811783 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 837/1674] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:36 2022] POST /identity/v3/users => generated 291 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:36.816174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6e17b-f45f-42a7-a929-cbb1a9280742 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:36.852052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6e17b-f45f-42a7-a929-cbb1a9280742 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:36.868840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e84d1-7f2f-4e57-9523-ecb8e6337b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:36.869421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e84d1-7f2f-4e57-9523-ecb8e6337b6a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:36.872724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e84d1-7f2f-4e57-9523-ecb8e6337b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:36.873056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e84d1-7f2f-4e57-9523-ecb8e6337b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:36.875309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e84d1-7f2f-4e57-9523-ecb8e6337b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:36.879924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e84d1-7f2f-4e57-9523-ecb8e6337b6a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:36.918952 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 838/1675] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:36.920504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e84d1-7f2f-4e57-9523-ecb8e6337b6a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:36.928579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '047beaabd75e483b9d668d120fb434a4', 'request_id': 'req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:36.946563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '047beaabd75e483b9d668d120fb434a4', 'request_id': 'req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:36.948816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e84d1-7f2f-4e57-9523-ecb8e6337b6a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:36.958668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '047beaabd75e483b9d668d120fb434a4', 'request_id': 'req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:36.987150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] The token cache is being invalidate because project 047beaabd75e483b9d668d120fb434a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:36.987485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:36.988859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:36.999837 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 838/1676] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:36 2022] DELETE /identity/v3/projects/047beaabd75e483b9d668d120fb434a4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:37.000892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:37.014969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:37.078781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda34b2-2462-4ee9-8f8a-d4d41fe133df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:37.079730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda34b2-2462-4ee9-8f8a-d4d41fe133df admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:37.080014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda34b2-2462-4ee9-8f8a-d4d41fe133df admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:37.080288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda34b2-2462-4ee9-8f8a-d4d41fe133df admin admin] PATH_INFO: `/v3/projects/c234e27d4de44dc8be5033b9b5bb9161/users/171c3ef9ce28423eb069bb8e67b3a367/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:37.083494 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:37.086077 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:37.106181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda34b2-2462-4ee9-8f8a-d4d41fe133df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c234e27d4de44dc8be5033b9b5bb9161, user_id=171c3ef9ce28423eb069bb8e67b3a367, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:37.110230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda34b2-2462-4ee9-8f8a-d4d41fe133df admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:37.140756 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 839/1677] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:36 2022] PUT /identity/v3/projects/c234e27d4de44dc8be5033b9b5bb9161/users/171c3ef9ce28423eb069bb8e67b3a367/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:37.142710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda34b2-2462-4ee9-8f8a-d4d41fe133df admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:37.147019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0bda34b2-2462-4ee9-8f8a-d4d41fe133df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:37.223681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97331b8-05df-4a6a-9bbc-82ee2f2aca60 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:37.331764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda34b2-2462-4ee9-8f8a-d4d41fe133df admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:37.349361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5c92-df87-4aea-bad7-03f74ffbc8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:37.350414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5c92-df87-4aea-bad7-03f74ffbc8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:37.351960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5c92-df87-4aea-bad7-03f74ffbc8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:37.352303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5c92-df87-4aea-bad7-03f74ffbc8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:37.353382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c5c92-df87-4aea-bad7-03f74ffbc8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:37.356151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c5c92-df87-4aea-bad7-03f74ffbc8c8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:37.358196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:37.359207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:37.360680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:37.361029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] PATH_INFO: `/v3/users/c9b206a5e2b849b2a6b5c61c4b9ec3c8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:37.363290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b206a5e2b849b2a6b5c61c4b9ec3c8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:37.367588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:37.387346 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 840/1678] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:37.389575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5c92-df87-4aea-bad7-03f74ffbc8c8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:37.415126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5c92-df87-4aea-bad7-03f74ffbc8c8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:37.433078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae566-5782-4d6d-b771-c5b8a8505a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:37.433319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae566-5782-4d6d-b771-c5b8a8505a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:37.433598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae566-5782-4d6d-b771-c5b8a8505a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:37.433871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae566-5782-4d6d-b771-c5b8a8505a3f admin admin] PATH_INFO: `/v3/projects/c234e27d4de44dc8be5033b9b5bb9161/users/171c3ef9ce28423eb069bb8e67b3a367/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:37.443272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abae566-5782-4d6d-b771-c5b8a8505a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c234e27d4de44dc8be5033b9b5bb9161, user_id=171c3ef9ce28423eb069bb8e67b3a367, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:37.449415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abae566-5782-4d6d-b771-c5b8a8505a3f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:37.488062 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 841/1679] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:37 2022] PUT /identity/v3/projects/c234e27d4de44dc8be5033b9b5bb9161/users/171c3ef9ce28423eb069bb8e67b3a367/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:37.497265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b206a5e2b849b2a6b5c61c4b9ec3c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:37.523890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b206a5e2b849b2a6b5c61c4b9ec3c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:37.536270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b206a5e2b849b2a6b5c61c4b9ec3c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:37.549577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b206a5e2b849b2a6b5c61c4b9ec3c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:37.550816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de4d9ab-e300-498c-a5ab-47a13fad4292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b206a5e2b849b2a6b5c61c4b9ec3c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:37.565114 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 839/1680] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:36 2022] DELETE /identity/v3/users/c9b206a5e2b849b2a6b5c61c4b9ec3c8 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:38.080653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae566-5782-4d6d-b771-c5b8a8505a3f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:38.083752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7abae566-5782-4d6d-b771-c5b8a8505a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:38.191025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae566-5782-4d6d-b771-c5b8a8505a3f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:38.333591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:38.334250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:38.334539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:38.334817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] PATH_INFO: `/v3/users/2205b0097ec442e49f83d7893aea1628` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:38.336003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2205b0097ec442e49f83d7893aea1628)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:38.338181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:38.386636 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:38.490061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2205b0097ec442e49f83d7893aea1628'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:38.527797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2205b0097ec442e49f83d7893aea1628'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:38.539718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2205b0097ec442e49f83d7893aea1628'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:38.554066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2205b0097ec442e49f83d7893aea1628'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:38.555052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2205b0097ec442e49f83d7893aea1628'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:38.580082 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 842/1681] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:38 2022] DELETE /identity/v3/users/2205b0097ec442e49f83d7893aea1628 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:38.591565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315114-fdc7-4626-86b8-82907755c8f8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:38.592469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315114-fdc7-4626-86b8-82907755c8f8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:38.592959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315114-fdc7-4626-86b8-82907755c8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:38.638072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-89315114-fdc7-4626-86b8-82907755c8f8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:38.639692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-89315114-fdc7-4626-86b8-82907755c8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:38.733339 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:38.777023 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 840/1682] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:38.834977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:38.836494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:39.006332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12570567-8208-4f9e-9342-040ec07e77ae admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:39.022449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc062-3d44-4256-9044-d3f338d533a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:39.024085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc062-3d44-4256-9044-d3f338d533a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:39.027373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc062-3d44-4256-9044-d3f338d533a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:39.027523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc062-3d44-4256-9044-d3f338d533a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:39.080898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cc062-3d44-4256-9044-d3f338d533a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:39.090078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cc062-3d44-4256-9044-d3f338d533a5 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:39.121453 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 843/1683] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:39.388463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315114-fdc7-4626-86b8-82907755c8f8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:39.390058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-89315114-fdc7-4626-86b8-82907755c8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:39.408099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315114-fdc7-4626-86b8-82907755c8f8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:39.424418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:39.425103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:39.435037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:39.435569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] PATH_INFO: `/v3/projects/3b9f87c69d264030af37a186609edf48` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:39.438354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9f87c69d264030af37a186609edf48)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:39.440501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:39.546605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc062-3d44-4256-9044-d3f338d533a5 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:39.548018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-180cc062-3d44-4256-9044-d3f338d533a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:39.570829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc062-3d44-4256-9044-d3f338d533a5 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:39.577434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9f87c69d264030af37a186609edf48', 'request_id': 'req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.592891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9f87c69d264030af37a186609edf48', 'request_id': 'req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.609169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9f87c69d264030af37a186609edf48', 'request_id': 'req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.673575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] The token cache is being invalidate because project 3b9f87c69d264030af37a186609edf48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:39.673886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.675850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-582df2ec-e7aa-49aa-a8dd-00f266e8ce4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.687674 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 841/1684] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:39 2022] DELETE /identity/v3/projects/3b9f87c69d264030af37a186609edf48 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:39.690833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d5c6-3b35-4aae-b5f3-ab667805aaa1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:39.691451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d5c6-3b35-4aae-b5f3-ab667805aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:39.692026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d5c6-3b35-4aae-b5f3-ab667805aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:39.741214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:39.741973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:39.742438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:39.742888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] PATH_INFO: `/v3/users/be64be1ba172441eb0ee9a03fabb0bda` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:39.745823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be64be1ba172441eb0ee9a03fabb0bda)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:39.750895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-52f9d5c6-3b35-4aae-b5f3-ab667805aaa1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:39.755816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-52f9d5c6-3b35-4aae-b5f3-ab667805aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:39.758861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:39.789506 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 842/1685] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:39.793952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aa92c-a984-4160-a7b2-02c72a0a7249 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:39.794307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aa92c-a984-4160-a7b2-02c72a0a7249 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:39.795247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aa92c-a984-4160-a7b2-02c72a0a7249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:39.840921 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:39.857491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9d5aa92c-a984-4160-a7b2-02c72a0a7249 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:39.863942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9d5aa92c-a984-4160-a7b2-02c72a0a7249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:39.885661 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 843/1686] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:39.890419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aa92c-a984-4160-a7b2-02c72a0a7249 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:39.902114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be64be1ba172441eb0ee9a03fabb0bda'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.910383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aa92c-a984-4160-a7b2-02c72a0a7249 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:39.926233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:39.926995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:39.927274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:39.927811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:39.928316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be64be1ba172441eb0ee9a03fabb0bda'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.928694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:39.929003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:39.930695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:39.945713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be64be1ba172441eb0ee9a03fabb0bda'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.976560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be64be1ba172441eb0ee9a03fabb0bda'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.980679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4ea20b3d-3e32-4a6c-ab7b-cae9389f8b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be64be1ba172441eb0ee9a03fabb0bda'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:39.992970 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 844/1687] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:39.995153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:40.004958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:40.005222 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 844/1688] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:39 2022] DELETE /identity/v3/users/be64be1ba172441eb0ee9a03fabb0bda => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:44:40.022791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bd203-d81e-4878-8722-942bb92f2be8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:40.023086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bd203-d81e-4878-8722-942bb92f2be8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:40.023439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bd203-d81e-4878-8722-942bb92f2be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:40.034133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5486f2-7da1-4451-bc2d-2b12620e6bb5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:40.056705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cd7bd203-d81e-4878-8722-942bb92f2be8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:40.058148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cd7bd203-d81e-4878-8722-942bb92f2be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:40.280497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cfef1-aff3-40c4-8032-c40f28d30903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:40.282642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cfef1-aff3-40c4-8032-c40f28d30903 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:40.283371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cfef1-aff3-40c4-8032-c40f28d30903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:40.284107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cfef1-aff3-40c4-8032-c40f28d30903 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:40.288991 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 845/1689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:40.299015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cfef1-aff3-40c4-8032-c40f28d30903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:40.306091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cfef1-aff3-40c4-8032-c40f28d30903 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:40.320576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bd203-d81e-4878-8722-942bb92f2be8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:40.325565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cd7bd203-d81e-4878-8722-942bb92f2be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:40.511474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bd203-d81e-4878-8722-942bb92f2be8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:40.514312 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 845/1690] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:39 2022] POST /identity/v3/projects => generated 375 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:40.522640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cfef1-aff3-40c4-8032-c40f28d30903 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:40.656238 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:40.740499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cfef1-aff3-40c4-8032-c40f28d30903 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:40.751270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c401eb-a2d4-46a0-bbf1-9ea51c506b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:40.752783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c401eb-a2d4-46a0-bbf1-9ea51c506b0b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:40.753791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c401eb-a2d4-46a0-bbf1-9ea51c506b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:40.754736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c401eb-a2d4-46a0-bbf1-9ea51c506b0b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:40.758372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c401eb-a2d4-46a0-bbf1-9ea51c506b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:40.770266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c401eb-a2d4-46a0-bbf1-9ea51c506b0b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:40.806567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f38cc-1187-4246-bb47-068245ac6faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:40.807853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f38cc-1187-4246-bb47-068245ac6faf service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:40.808475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f38cc-1187-4246-bb47-068245ac6faf service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:40.808699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f38cc-1187-4246-bb47-068245ac6faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:40.824327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 846/1691] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:40 2022] POST /identity/v3/users => generated 288 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:40.832524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c401eb-a2d4-46a0-bbf1-9ea51c506b0b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:40.846422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f38cc-1187-4246-bb47-068245ac6faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:40.848062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f38cc-1187-4246-bb47-068245ac6faf service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:40.865575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c401eb-a2d4-46a0-bbf1-9ea51c506b0b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:40.885908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4f196-dac0-4597-a894-e61750cc5f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:40.888890 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 846/1692] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:40.889585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4f196-dac0-4597-a894-e61750cc5f78 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:40.890108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4f196-dac0-4597-a894-e61750cc5f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:40.890619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4f196-dac0-4597-a894-e61750cc5f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:40.891471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4f196-dac0-4597-a894-e61750cc5f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:40.902533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4f196-dac0-4597-a894-e61750cc5f78 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:40.918922 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 847/1693] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:40.923003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f38cc-1187-4246-bb47-068245ac6faf service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:40.940305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f38cc-1187-4246-bb47-068245ac6faf service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:40.955030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d07b4d-cc4e-47bb-b78b-5592ef17377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:40.956105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d07b4d-cc4e-47bb-b78b-5592ef17377a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:40.956686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d07b4d-cc4e-47bb-b78b-5592ef17377a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:40.957251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d07b4d-cc4e-47bb-b78b-5592ef17377a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:40.958189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d07b4d-cc4e-47bb-b78b-5592ef17377a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:40.960211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d07b4d-cc4e-47bb-b78b-5592ef17377a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:40.985342 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 847/1694] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:40.989980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4f196-dac0-4597-a894-e61750cc5f78 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:41.007703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4f196-dac0-4597-a894-e61750cc5f78 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:41.017971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcaa0-b552-48af-ab25-7c967091f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:41.018767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcaa0-b552-48af-ab25-7c967091f713 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:41.019123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcaa0-b552-48af-ab25-7c967091f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:41.019518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcaa0-b552-48af-ab25-7c967091f713 admin admin] PATH_INFO: `/v3/projects/9d3ce840c31c48b6a1bf147824faa84c/users/20e0faf8a74d44129fbb9dc9408eb3fb/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:41.060328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbcaa0-b552-48af-ab25-7c967091f713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3ce840c31c48b6a1bf147824faa84c, user_id=20e0faf8a74d44129fbb9dc9408eb3fb, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:41.063350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbcaa0-b552-48af-ab25-7c967091f713 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:41.098545 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 848/1695] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:40 2022] PUT /identity/v3/projects/9d3ce840c31c48b6a1bf147824faa84c/users/20e0faf8a74d44129fbb9dc9408eb3fb/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:41.123798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581074e8-3c07-42ad-b196-018b5e6fb258 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:41.124409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581074e8-3c07-42ad-b196-018b5e6fb258 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:41.124933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581074e8-3c07-42ad-b196-018b5e6fb258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:41.160096 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:41.329685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-581074e8-3c07-42ad-b196-018b5e6fb258 None None] MFA Rules not processed for user `20e0faf8a74d44129fbb9dc9408eb3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:41.333035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-581074e8-3c07-42ad-b196-018b5e6fb258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:41.503585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcaa0-b552-48af-ab25-7c967091f713 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:41.505921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2ccbcaa0-b552-48af-ab25-7c967091f713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:41.654463 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 848/1696] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:41.662500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581074e8-3c07-42ad-b196-018b5e6fb258 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:41.789185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581074e8-3c07-42ad-b196-018b5e6fb258 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:41.794940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8049ae-0d10-42d6-9ac8-84b0b58ddcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:41.796719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8049ae-0d10-42d6-9ac8-84b0b58ddcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:41.797153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcaa0-b552-48af-ab25-7c967091f713 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:41.797770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8049ae-0d10-42d6-9ac8-84b0b58ddcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:41.798276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8049ae-0d10-42d6-9ac8-84b0b58ddcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:41.799144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8049ae-0d10-42d6-9ac8-84b0b58ddcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:41.801650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8049ae-0d10-42d6-9ac8-84b0b58ddcf2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:41.812918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:41.813759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:41.814239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:41.814732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] PATH_INFO: `/v3/projects/395b44d7ce3c46ebb445d5c1950ab251` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:41.820410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395b44d7ce3c46ebb445d5c1950ab251)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:41.848030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:41.862930 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 849/1697] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:41 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:41.863899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8049ae-0d10-42d6-9ac8-84b0b58ddcf2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:41.865672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ec8049ae-0d10-42d6-9ac8-84b0b58ddcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:42.012585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395b44d7ce3c46ebb445d5c1950ab251', 'request_id': 'req-89592fa6-5708-4715-8513-409d46c9fd05'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.029195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395b44d7ce3c46ebb445d5c1950ab251', 'request_id': 'req-89592fa6-5708-4715-8513-409d46c9fd05'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.043117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395b44d7ce3c46ebb445d5c1950ab251', 'request_id': 'req-89592fa6-5708-4715-8513-409d46c9fd05'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.076891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8049ae-0d10-42d6-9ac8-84b0b58ddcf2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:42.090733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] The token cache is being invalidate because project 395b44d7ce3c46ebb445d5c1950ab251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:42.095061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.099831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.106649 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 849/1698] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:41 2022] DELETE /identity/v3/projects/395b44d7ce3c46ebb445d5c1950ab251 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:42.106857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:42.110919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:42.146146 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:42.154861 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:42.289190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:42.289869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:42.292109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:42.292588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] PATH_INFO: `/v3/users/4863c5d0793842d29c6b8f7c69ecd297` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:42.296457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4863c5d0793842d29c6b8f7c69ecd297)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:42.298554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:42.310326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592fa6-5708-4715-8513-409d46c9fd05 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:42.321701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e08ef6-f792-48c9-ae05-01511ec2a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:42.331668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e08ef6-f792-48c9-ae05-01511ec2a789 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:42.331668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e08ef6-f792-48c9-ae05-01511ec2a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:42.331668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e08ef6-f792-48c9-ae05-01511ec2a789 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:42.331668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e08ef6-f792-48c9-ae05-01511ec2a789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:42.333009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e08ef6-f792-48c9-ae05-01511ec2a789 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:42.367212 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 850/1699] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:42 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:42.368170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e08ef6-f792-48c9-ae05-01511ec2a789 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:42.373470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a9e08ef6-f792-48c9-ae05-01511ec2a789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:42.395843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e08ef6-f792-48c9-ae05-01511ec2a789 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:42.413022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:42.413693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:42.413975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:42.414253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] PATH_INFO: `/v3/users/275efecb0c9749f9b58b565a117b3756` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:42.415690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275efecb0c9749f9b58b565a117b3756)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:42.416326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4863c5d0793842d29c6b8f7c69ecd297'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.417946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:42.440016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4863c5d0793842d29c6b8f7c69ecd297'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.458861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4863c5d0793842d29c6b8f7c69ecd297'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.476413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4863c5d0793842d29c6b8f7c69ecd297'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.477399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4863c5d0793842d29c6b8f7c69ecd297'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.491633 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 850/1700] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:41 2022] DELETE /identity/v3/users/4863c5d0793842d29c6b8f7c69ecd297 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:42.497666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:42.501146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:42.549319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275efecb0c9749f9b58b565a117b3756'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.594598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275efecb0c9749f9b58b565a117b3756'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.620191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275efecb0c9749f9b58b565a117b3756'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.658152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275efecb0c9749f9b58b565a117b3756'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.661672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d6630b9-ea7e-4c92-9e55-5a0108a6dd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275efecb0c9749f9b58b565a117b3756'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:42.682671 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 851/1701] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:42 2022] DELETE /identity/v3/users/275efecb0c9749f9b58b565a117b3756 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:42.686156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1797f4-5a84-4f11-84d2-c6bdd11df809 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:42.686455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1797f4-5a84-4f11-84d2-c6bdd11df809 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:42.687143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1797f4-5a84-4f11-84d2-c6bdd11df809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:42.728240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5c76f-1736-41be-8830-459c7f05c17f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:42.738780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-de1797f4-5a84-4f11-84d2-c6bdd11df809 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:42.741707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-de1797f4-5a84-4f11-84d2-c6bdd11df809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:42.862911 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:42.889025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30070d35-9c4e-44f0-9965-6f79c44aaac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:42.890380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30070d35-9c4e-44f0-9965-6f79c44aaac8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:42.890670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30070d35-9c4e-44f0-9965-6f79c44aaac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:42.890941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30070d35-9c4e-44f0-9965-6f79c44aaac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:42.891611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30070d35-9c4e-44f0-9965-6f79c44aaac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:42.897266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30070d35-9c4e-44f0-9965-6f79c44aaac8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:42.915710 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 852/1702] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:42.917205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1797f4-5a84-4f11-84d2-c6bdd11df809 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:42.918835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-de1797f4-5a84-4f11-84d2-c6bdd11df809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:42.932108 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 851/1703] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:42.934909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30070d35-9c4e-44f0-9965-6f79c44aaac8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:42.941937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-30070d35-9c4e-44f0-9965-6f79c44aaac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:42.942515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1797f4-5a84-4f11-84d2-c6bdd11df809 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:42.957699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:42.958369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:42.958650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:42.958922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] PATH_INFO: `/v3/projects/c64d39f0a00b4dab9da6f0ffd2832210` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:42.963179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64d39f0a00b4dab9da6f0ffd2832210)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:42.967117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:42.982272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30070d35-9c4e-44f0-9965-6f79c44aaac8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:42.991683 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:42.998802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333a01c-26bc-465b-9fe3-6d6ea97143d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:42.999632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333a01c-26bc-465b-9fe3-6d6ea97143d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:42.999988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333a01c-26bc-465b-9fe3-6d6ea97143d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:43.001615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333a01c-26bc-465b-9fe3-6d6ea97143d0 admin admin] PATH_INFO: `/v3/projects/9203aaea5b84415b9b233cbda21c8a30/users/3d8acfd69728476495c678164ae8e616/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:43.054301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333a01c-26bc-465b-9fe3-6d6ea97143d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9203aaea5b84415b9b233cbda21c8a30, user_id=3d8acfd69728476495c678164ae8e616, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:43.059555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333a01c-26bc-465b-9fe3-6d6ea97143d0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:43.085410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64d39f0a00b4dab9da6f0ffd2832210', 'request_id': 'req-114c315c-adca-4c80-9423-258cb5218c8a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.098281 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 852/1704] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:42 2022] PUT /identity/v3/projects/9203aaea5b84415b9b233cbda21c8a30/users/3d8acfd69728476495c678164ae8e616/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:43.103454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333a01c-26bc-465b-9fe3-6d6ea97143d0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:43.106245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7333a01c-26bc-465b-9fe3-6d6ea97143d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:43.114670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64d39f0a00b4dab9da6f0ffd2832210', 'request_id': 'req-114c315c-adca-4c80-9423-258cb5218c8a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.129096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64d39f0a00b4dab9da6f0ffd2832210', 'request_id': 'req-114c315c-adca-4c80-9423-258cb5218c8a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.160557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] The token cache is being invalidate because project c64d39f0a00b4dab9da6f0ffd2832210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:43.161365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.162549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.166788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 853/1705] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:42 2022] DELETE /identity/v3/projects/c64d39f0a00b4dab9da6f0ffd2832210 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:43.169032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:43.171469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:43.226709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333a01c-26bc-465b-9fe3-6d6ea97143d0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:43.237161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:43.238385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:43.238385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:43.238794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:43.243109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:43.277869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c315c-adca-4c80-9423-258cb5218c8a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:43.376574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4e917-ae9f-4bae-8643-b86499ffd245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:43.377676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4e917-ae9f-4bae-8643-b86499ffd245 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:43.378116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4e917-ae9f-4bae-8643-b86499ffd245 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:43.378619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4e917-ae9f-4bae-8643-b86499ffd245 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:43.379809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4e917-ae9f-4bae-8643-b86499ffd245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:43.381079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:43.382633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4e917-ae9f-4bae-8643-b86499ffd245 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:43.382863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:43.420520 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 854/1706] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:43.421770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4e917-ae9f-4bae-8643-b86499ffd245 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:43.428295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-15d4e917-ae9f-4bae-8643-b86499ffd245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:43.428667 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 853/1707] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:43.429716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:43.437166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:43.467899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c43237-63b4-45ad-9272-5331a43023bd service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:43.483360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:43.484048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:43.484577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:43.484896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] PATH_INFO: `/v3/users/6ea7abfc3333406a9db9853bfa0f12b0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:43.486106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea7abfc3333406a9db9853bfa0f12b0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:43.488453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:43.529948 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:43.583264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea7abfc3333406a9db9853bfa0f12b0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.612194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea7abfc3333406a9db9853bfa0f12b0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.617820 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:43.628523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea7abfc3333406a9db9853bfa0f12b0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.639187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4e917-ae9f-4bae-8643-b86499ffd245 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:43.645346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea7abfc3333406a9db9853bfa0f12b0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.647173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea7abfc3333406a9db9853bfa0f12b0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:43.647767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:43.648809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:43.649349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:43.649840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:43.654037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:43.669557 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 854/1708] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:43 2022] DELETE /identity/v3/users/6ea7abfc3333406a9db9853bfa0f12b0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:43.670068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:43.671373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:43.749382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:43.751305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:43.776774 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 855/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:43.797737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:43.801084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:43.852588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377e21-05ee-472f-b8bf-1549eb04bad5 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:43.862338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9112755-49b5-45b9-954c-2e451eedfb7c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:43.872493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee3bec-0c28-4626-9b11-d2ac01ce446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:43.875850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee3bec-0c28-4626-9b11-d2ac01ce446d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:43.876179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee3bec-0c28-4626-9b11-d2ac01ce446d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:43.876483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee3bec-0c28-4626-9b11-d2ac01ce446d admin admin] PATH_INFO: `/v3/projects/9203aaea5b84415b9b233cbda21c8a30/users/3d8acfd69728476495c678164ae8e616/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:43.884105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:43.884795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:43.885135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:43.885426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] PATH_INFO: `/v3/projects/2b6e859acb154890891a94f2ec836a33` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:43.887463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee3bec-0c28-4626-9b11-d2ac01ce446d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9203aaea5b84415b9b233cbda21c8a30, user_id=3d8acfd69728476495c678164ae8e616, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:43.890228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee3bec-0c28-4626-9b11-d2ac01ce446d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:43.897061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6e859acb154890891a94f2ec836a33)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:43.899344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:43.927208 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 856/1710] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:43 2022] PUT /identity/v3/projects/9203aaea5b84415b9b233cbda21c8a30/users/3d8acfd69728476495c678164ae8e616/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:43.939097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bddec0-0710-40ac-96d7-a37d6b8c3c9e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:43.939384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bddec0-0710-40ac-96d7-a37d6b8c3c9e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:43.939832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bddec0-0710-40ac-96d7-a37d6b8c3c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:44.001430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-15bddec0-0710-40ac-96d7-a37d6b8c3c9e None None] MFA Rules not processed for user `3d8acfd69728476495c678164ae8e616`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:44.002582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-15bddec0-0710-40ac-96d7-a37d6b8c3c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:44.013517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6e859acb154890891a94f2ec836a33', 'request_id': 'req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.024000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6e859acb154890891a94f2ec836a33', 'request_id': 'req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.039040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6e859acb154890891a94f2ec836a33', 'request_id': 'req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.057544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] The token cache is being invalidate because project 2b6e859acb154890891a94f2ec836a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:44.057895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.059185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-82e7e6b3-80ed-4e65-bbdc-c74af949f6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.066878 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 855/1711] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:43 2022] DELETE /identity/v3/projects/2b6e859acb154890891a94f2ec836a33 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:44.068397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1805f-ba7f-4318-9e58-c7923ce32473 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:44.068750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1805f-ba7f-4318-9e58-c7923ce32473 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:44.069055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1805f-ba7f-4318-9e58-c7923ce32473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:44.154911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a7d1805f-ba7f-4318-9e58-c7923ce32473 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:44.172933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7d1805f-ba7f-4318-9e58-c7923ce32473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:44.180775 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 857/1712] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:44.181970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bddec0-0710-40ac-96d7-a37d6b8c3c9e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:44.199992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bddec0-0710-40ac-96d7-a37d6b8c3c9e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:44.217452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882055ac-8661-4832-aa61-ad005ff53d66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:44.218391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882055ac-8661-4832-aa61-ad005ff53d66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:44.218391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882055ac-8661-4832-aa61-ad005ff53d66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:44.218686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882055ac-8661-4832-aa61-ad005ff53d66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:44.219569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882055ac-8661-4832-aa61-ad005ff53d66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:44.219569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882055ac-8661-4832-aa61-ad005ff53d66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:44.221263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882055ac-8661-4832-aa61-ad005ff53d66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:44.243036 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 858/1713] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:44.244686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882055ac-8661-4832-aa61-ad005ff53d66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:44.271184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882055ac-8661-4832-aa61-ad005ff53d66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:44.290380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c02c5-ed59-4ba6-98bb-b8e421cbc099 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:44.294849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c02c5-ed59-4ba6-98bb-b8e421cbc099 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:44.296013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c02c5-ed59-4ba6-98bb-b8e421cbc099 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:44.296864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c02c5-ed59-4ba6-98bb-b8e421cbc099 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:44.298432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c02c5-ed59-4ba6-98bb-b8e421cbc099 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:44.307411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c02c5-ed59-4ba6-98bb-b8e421cbc099 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:44.383039 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 856/1714] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:44.385383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1805f-ba7f-4318-9e58-c7923ce32473 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:44.387911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7d1805f-ba7f-4318-9e58-c7923ce32473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:44.407089 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 859/1715] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:44 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:44.407089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c02c5-ed59-4ba6-98bb-b8e421cbc099 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:44.408069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a80c02c5-ed59-4ba6-98bb-b8e421cbc099 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:44.413968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1805f-ba7f-4318-9e58-c7923ce32473 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:44.421315 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:44.430890 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:44.498891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c02c5-ed59-4ba6-98bb-b8e421cbc099 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:44.504715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:44.505546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:44.506676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:44.506979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] PATH_INFO: `/v3/projects/3bed859f9c7a4895b8808ce7f2649d6b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:44.508179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bed859f9c7a4895b8808ce7f2649d6b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:44.510372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:44.535694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:44.536684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:44.537157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:44.537594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] PATH_INFO: `/v3/projects/ba978ee0a80d4f4db74b9340f647efd6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:44.539135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba978ee0a80d4f4db74b9340f647efd6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:44.543240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:44.585246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bed859f9c7a4895b8808ce7f2649d6b', 'request_id': 'req-3310b951-f04f-4466-bdf1-07a2dd62d06d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.601801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bed859f9c7a4895b8808ce7f2649d6b', 'request_id': 'req-3310b951-f04f-4466-bdf1-07a2dd62d06d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.610443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bed859f9c7a4895b8808ce7f2649d6b', 'request_id': 'req-3310b951-f04f-4466-bdf1-07a2dd62d06d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.626055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] The token cache is being invalidate because project 3bed859f9c7a4895b8808ce7f2649d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:44.626170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.627021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3310b951-f04f-4466-bdf1-07a2dd62d06d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.635831 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 860/1716] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:44 2022] DELETE /identity/v3/projects/3bed859f9c7a4895b8808ce7f2649d6b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:44.637984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06ce3-2eff-4ab0-b00d-a3473ea7ef24 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:44.638270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06ce3-2eff-4ab0-b00d-a3473ea7ef24 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:44.638547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06ce3-2eff-4ab0-b00d-a3473ea7ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:44.676560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e6d06ce3-2eff-4ab0-b00d-a3473ea7ef24 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:44.679512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e6d06ce3-2eff-4ab0-b00d-a3473ea7ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:44.696944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba978ee0a80d4f4db74b9340f647efd6', 'request_id': 'req-5f67814a-a53a-4763-bf0b-34e020dcef7f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.719149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba978ee0a80d4f4db74b9340f647efd6', 'request_id': 'req-5f67814a-a53a-4763-bf0b-34e020dcef7f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.734768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba978ee0a80d4f4db74b9340f647efd6', 'request_id': 'req-5f67814a-a53a-4763-bf0b-34e020dcef7f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.791025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] The token cache is being invalidate because project ba978ee0a80d4f4db74b9340f647efd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:44.791782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.792950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:44.795745 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 857/1717] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:44 2022] DELETE /identity/v3/projects/ba978ee0a80d4f4db74b9340f647efd6 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:44.803471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:44.819103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:44.831566 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 861/1718] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:44.833134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d06ce3-2eff-4ab0-b00d-a3473ea7ef24 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:44.837368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e6d06ce3-2eff-4ab0-b00d-a3473ea7ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:44.873122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d06ce3-2eff-4ab0-b00d-a3473ea7ef24 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:44.890319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:44.893319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:44.894149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:44.894987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] PATH_INFO: `/v3/users/d1ce97805d904c8f8f29b996ef4ce0a4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:44.898713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ce97805d904c8f8f29b996ef4ce0a4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:44.905570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:44.979273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67814a-a53a-4763-bf0b-34e020dcef7f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:44.990353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8c8da-3b25-4f34-a465-c097c67af538 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:44.991203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8c8da-3b25-4f34-a465-c097c67af538 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:44.991602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8c8da-3b25-4f34-a465-c097c67af538 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:44.991977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8c8da-3b25-4f34-a465-c097c67af538 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:44.992994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8c8da-3b25-4f34-a465-c097c67af538 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:44.993604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8c8da-3b25-4f34-a465-c097c67af538 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:44.997372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8c8da-3b25-4f34-a465-c097c67af538 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:45.035226 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 858/1719] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:45.038274 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:45.052376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45603e-34bb-4367-b47e-ffb536c872c1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:45.054563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45603e-34bb-4367-b47e-ffb536c872c1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:45.055091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45603e-34bb-4367-b47e-ffb536c872c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:45.073791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ce97805d904c8f8f29b996ef4ce0a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:45.104463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ce97805d904c8f8f29b996ef4ce0a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:45.114086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0c45603e-34bb-4367-b47e-ffb536c872c1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:45.115492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0c45603e-34bb-4367-b47e-ffb536c872c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:45.119679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ce97805d904c8f8f29b996ef4ce0a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:45.131989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ce97805d904c8f8f29b996ef4ce0a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:45.132834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ce97805d904c8f8f29b996ef4ce0a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:45.143535 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 859/1720] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:45.143535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45603e-34bb-4367-b47e-ffb536c872c1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:45.152496 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 862/1721] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:44 2022] DELETE /identity/v3/users/d1ce97805d904c8f8f29b996ef4ce0a4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:45.152496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:45.154434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:45.160116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45603e-34bb-4367-b47e-ffb536c872c1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:45.290740 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:45.401583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a8e6c-857c-40b7-aece-f3500e68f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:45.402232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a8e6c-857c-40b7-aece-f3500e68f9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:45.402515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a8e6c-857c-40b7-aece-f3500e68f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:45.402815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a8e6c-857c-40b7-aece-f3500e68f9b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:45.403484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a8e6c-857c-40b7-aece-f3500e68f9b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:45.403791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a8e6c-857c-40b7-aece-f3500e68f9b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:45.405478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a8e6c-857c-40b7-aece-f3500e68f9b3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:45.434631 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 860/1722] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:45.441617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8bec7-3e42-4f99-8a49-304dd5077900 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:45.441617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8bec7-3e42-4f99-8a49-304dd5077900 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:45.441617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8bec7-3e42-4f99-8a49-304dd5077900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:45.454895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d2ef-6667-44b8-93f8-7db5baf502e0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:45.470417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3fb8bec7-3e42-4f99-8a49-304dd5077900 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:45.472021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3fb8bec7-3e42-4f99-8a49-304dd5077900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:45.477180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca5c4c-06ce-45ce-bf78-e2a50ed25a39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:45.478163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca5c4c-06ce-45ce-bf78-e2a50ed25a39 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:45.480237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca5c4c-06ce-45ce-bf78-e2a50ed25a39 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:45.480799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca5c4c-06ce-45ce-bf78-e2a50ed25a39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:45.483563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-31ca5c4c-06ce-45ce-bf78-e2a50ed25a39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:45.488672 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 861/1723] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:45.489805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8bec7-3e42-4f99-8a49-304dd5077900 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:45.491482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3fb8bec7-3e42-4f99-8a49-304dd5077900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:45.505514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8bec7-3e42-4f99-8a49-304dd5077900 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:45.513108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f89d7e-2a92-4eb3-b6b2-d5a4fa8e1b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:45.514088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f89d7e-2a92-4eb3-b6b2-d5a4fa8e1b91 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:45.514464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f89d7e-2a92-4eb3-b6b2-d5a4fa8e1b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:45.514838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f89d7e-2a92-4eb3-b6b2-d5a4fa8e1b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:45.515583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f89d7e-2a92-4eb3-b6b2-d5a4fa8e1b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:45.518115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f89d7e-2a92-4eb3-b6b2-d5a4fa8e1b91 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:45.598240 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 862/1724] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:45 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:45.598240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f89d7e-2a92-4eb3-b6b2-d5a4fa8e1b91 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:45.708599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca5c4c-06ce-45ce-bf78-e2a50ed25a39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:45.711057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca5c4c-06ce-45ce-bf78-e2a50ed25a39 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:45.739305 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 863/1725] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:45.740486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca5c4c-06ce-45ce-bf78-e2a50ed25a39 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:45.768063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca5c4c-06ce-45ce-bf78-e2a50ed25a39 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:45.833989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f89d7e-2a92-4eb3-b6b2-d5a4fa8e1b91 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:45.839244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:45.840651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:45.840963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:45.841245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:45.842126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:45.842471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:45.845744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:45.873503 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 863/1726] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:45.874860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:45.888013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:45.905825 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:45.926155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137f637-297f-435c-9aa0-4acd100997c6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:45.939248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:45.940504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:45.940817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:45.941095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] PATH_INFO: `/v3/projects/ed8ecf3ae5ca4ed7a3ca096de9d927d7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:45.943941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8ecf3ae5ca4ed7a3ca096de9d927d7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:45.945152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:45.951729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6a9e4-9bab-4dc3-852a-525d49239436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:45.952412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6a9e4-9bab-4dc3-852a-525d49239436 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:45.952750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6a9e4-9bab-4dc3-852a-525d49239436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:45.953029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6a9e4-9bab-4dc3-852a-525d49239436 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:45.953737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6a9e4-9bab-4dc3-852a-525d49239436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:45.957081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6a9e4-9bab-4dc3-852a-525d49239436 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:46.012656 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 864/1727] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:45 2022] POST /identity/v3/users => generated 295 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:46.014432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08cf5-7b03-4286-8714-c42aef8a105d None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.014733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08cf5-7b03-4286-8714-c42aef8a105d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.015127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08cf5-7b03-4286-8714-c42aef8a105d None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.019078 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 865/1728] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:46.023114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b08cf5-7b03-4286-8714-c42aef8a105d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:46.108255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b08cf5-7b03-4286-8714-c42aef8a105d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:46.111170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8ecf3ae5ca4ed7a3ca096de9d927d7', 'request_id': 'req-0108ab69-b7ff-4f77-a564-38946b951b95'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:46.130104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8ecf3ae5ca4ed7a3ca096de9d927d7', 'request_id': 'req-0108ab69-b7ff-4f77-a564-38946b951b95'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:46.146423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8ecf3ae5ca4ed7a3ca096de9d927d7', 'request_id': 'req-0108ab69-b7ff-4f77-a564-38946b951b95'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:46.192433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] The token cache is being invalidate because project ed8ecf3ae5ca4ed7a3ca096de9d927d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:46.192826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:46.193490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:46.195063 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 864/1729] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:45 2022] DELETE /identity/v3/projects/ed8ecf3ae5ca4ed7a3ca096de9d927d7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:46.199961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:46.205121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:46.249516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:46.250513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.250841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.251146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.251850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:46.253988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:46.256353 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:46.309812 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 866/1730] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:46 2022] POST /identity/v3/projects => generated 381 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:46.310679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:46.317134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:46.387815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108ab69-b7ff-4f77-a564-38946b951b95 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:46.497112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:46.501694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:46.515346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69278af-59e9-49dc-9014-28c4202d7b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:46.516521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69278af-59e9-49dc-9014-28c4202d7b8e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.517139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69278af-59e9-49dc-9014-28c4202d7b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.517627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69278af-59e9-49dc-9014-28c4202d7b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.518726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69278af-59e9-49dc-9014-28c4202d7b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:46.522135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69278af-59e9-49dc-9014-28c4202d7b8e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:46.545252 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 865/1731] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:46.547046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be8d1b-8b0b-432e-a588-4a8a733a003f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.547559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be8d1b-8b0b-432e-a588-4a8a733a003f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.548037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be8d1b-8b0b-432e-a588-4a8a733a003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.576027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-98be8d1b-8b0b-432e-a588-4a8a733a003f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:46.577825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-98be8d1b-8b0b-432e-a588-4a8a733a003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:46.595035 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 866/1732] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:46.595978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be8d1b-8b0b-432e-a588-4a8a733a003f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:46.611244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-98be8d1b-8b0b-432e-a588-4a8a733a003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:46.628727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be8d1b-8b0b-432e-a588-4a8a733a003f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:46.631347 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:46.637699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e09361-49e1-4e0b-b8c0-b3f1984e0e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:46.638387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e09361-49e1-4e0b-b8c0-b3f1984e0e2a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.638737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e09361-49e1-4e0b-b8c0-b3f1984e0e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.639133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e09361-49e1-4e0b-b8c0-b3f1984e0e2a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.640000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e09361-49e1-4e0b-b8c0-b3f1984e0e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:46.646453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e09361-49e1-4e0b-b8c0-b3f1984e0e2a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:46.655343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b137c-3748-4367-bf64-ecaae2b4df17 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:46.669162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b47f3e-a236-4fcd-adb8-7a45966c557d tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:46.669931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b47f3e-a236-4fcd-adb8-7a45966c557d tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.670316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b47f3e-a236-4fcd-adb8-7a45966c557d tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.670668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b47f3e-a236-4fcd-adb8-7a45966c557d tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/projects/43cab5470a484788965df76c6ea93679` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.674642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b47f3e-a236-4fcd-adb8-7a45966c557d tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:get_project(project_id=43cab5470a484788965df76c6ea93679)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:46.678594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b47f3e-a236-4fcd-adb8-7a45966c557d tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:46.685537 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 867/1733] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:46 2022] GET /identity/v3/projects/43cab5470a484788965df76c6ea93679 => generated 371 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:46.686961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1863a-bdca-43b4-bd64-46cbdd7ce43e None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.687275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1863a-bdca-43b4-bd64-46cbdd7ce43e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.688397 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 867/1734] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:46 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:46.692464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1863a-bdca-43b4-bd64-46cbdd7ce43e None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.693861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e09361-49e1-4e0b-b8c0-b3f1984e0e2a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:46.697149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 868/1735] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:44:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:46.698636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d852-7608-42ad-8b1b-ef9b8a31a157 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.698922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d852-7608-42ad-8b1b-ef9b8a31a157 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.699204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d852-7608-42ad-8b1b-ef9b8a31a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.725708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e09361-49e1-4e0b-b8c0-b3f1984e0e2a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:46.738968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773908e-bc24-4fd1-ac1e-3009a651a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:46.739950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773908e-bc24-4fd1-ac1e-3009a651a881 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.739950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773908e-bc24-4fd1-ac1e-3009a651a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.740126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773908e-bc24-4fd1-ac1e-3009a651a881 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.740860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773908e-bc24-4fd1-ac1e-3009a651a881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:46.745962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773908e-bc24-4fd1-ac1e-3009a651a881 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:46.753681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7824d852-7608-42ad-8b1b-ef9b8a31a157 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:46.758889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7824d852-7608-42ad-8b1b-ef9b8a31a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:46.770240 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 868/1736] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:46.770240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773908e-bc24-4fd1-ac1e-3009a651a881 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:46.782913 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 869/1737] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:46.784374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449973e-6901-47d4-abdc-08c4d0ecb53c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.785359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449973e-6901-47d4-abdc-08c4d0ecb53c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.785653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449973e-6901-47d4-abdc-08c4d0ecb53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.797925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773908e-bc24-4fd1-ac1e-3009a651a881 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:46.816116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa24c40-789e-4a8c-a2c3-018d601fa975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:46.820540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa24c40-789e-4a8c-a2c3-018d601fa975 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.820871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa24c40-789e-4a8c-a2c3-018d601fa975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.821145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa24c40-789e-4a8c-a2c3-018d601fa975 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.821822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa24c40-789e-4a8c-a2c3-018d601fa975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:46.826353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa24c40-789e-4a8c-a2c3-018d601fa975 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:46.837558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f449973e-6901-47d4-abdc-08c4d0ecb53c None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:46.840806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f449973e-6901-47d4-abdc-08c4d0ecb53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:46.858233 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 869/1738] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:46.862741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa24c40-789e-4a8c-a2c3-018d601fa975 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:46.883227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa24c40-789e-4a8c-a2c3-018d601fa975 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:46.895885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdee2c7-046c-45d9-8243-03fc40a70ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:46.896816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdee2c7-046c-45d9-8243-03fc40a70ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:46.907112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdee2c7-046c-45d9-8243-03fc40a70ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:46.907516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdee2c7-046c-45d9-8243-03fc40a70ad7 admin admin] PATH_INFO: `/v3/projects/ec62e1fb72ba44da8443be083f172b90/users/0ba955efddd645e8ada9987c22bc52ee/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:46.939662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdee2c7-046c-45d9-8243-03fc40a70ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec62e1fb72ba44da8443be083f172b90, user_id=0ba955efddd645e8ada9987c22bc52ee, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:46.944601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdee2c7-046c-45d9-8243-03fc40a70ad7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:46.978923 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 870/1739] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:46 2022] PUT /identity/v3/projects/ec62e1fb72ba44da8443be083f172b90/users/0ba955efddd645e8ada9987c22bc52ee/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:46.980718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdee2c7-046c-45d9-8243-03fc40a70ad7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:46.991673 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 870/1740] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:44:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:46.993012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449973e-6901-47d4-abdc-08c4d0ecb53c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:47.016093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449973e-6901-47d4-abdc-08c4d0ecb53c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:47.058384 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:47.082054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdee2c7-046c-45d9-8243-03fc40a70ad7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:47.090119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66716167-f627-4539-8737-032328dc4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:47.090789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cb7d5-1db5-425b-bc80-257813f0f91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:47.091030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66716167-f627-4539-8737-032328dc4292 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.091639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66716167-f627-4539-8737-032328dc4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.092024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66716167-f627-4539-8737-032328dc4292 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.092339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cb7d5-1db5-425b-bc80-257813f0f91a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.092862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cb7d5-1db5-425b-bc80-257813f0f91a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.093130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66716167-f627-4539-8737-032328dc4292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:47.093449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66716167-f627-4539-8737-032328dc4292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:47.093789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cb7d5-1db5-425b-bc80-257813f0f91a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.094770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cb7d5-1db5-425b-bc80-257813f0f91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:47.095358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66716167-f627-4539-8737-032328dc4292 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:47.096988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cb7d5-1db5-425b-bc80-257813f0f91a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:47.113922 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 871/1741] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:47.113922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44732466-34b2-489e-b42c-c8f358f10ef7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.114229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44732466-34b2-489e-b42c-c8f358f10ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.114654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44732466-34b2-489e-b42c-c8f358f10ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.120941 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 871/1742] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:47.123050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cb7d5-1db5-425b-bc80-257813f0f91a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:47.137073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-252cb7d5-1db5-425b-bc80-257813f0f91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:47.173679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-44732466-34b2-489e-b42c-c8f358f10ef7 None None] MFA Rules not processed for user `0ba955efddd645e8ada9987c22bc52ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:47.175623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-44732466-34b2-489e-b42c-c8f358f10ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:47.244733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cb7d5-1db5-425b-bc80-257813f0f91a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:47.249449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af67ba-da33-40ec-85a8-2d1e797da77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:47.251899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af67ba-da33-40ec-85a8-2d1e797da77c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.252948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af67ba-da33-40ec-85a8-2d1e797da77c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.253561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af67ba-da33-40ec-85a8-2d1e797da77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.264079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af67ba-da33-40ec-85a8-2d1e797da77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:47.266136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af67ba-da33-40ec-85a8-2d1e797da77c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:47.298424 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 872/1743] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:47.298424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af67ba-da33-40ec-85a8-2d1e797da77c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:47.341498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af67ba-da33-40ec-85a8-2d1e797da77c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:47.352535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bf705-41b5-41af-a718-5af932059f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:47.353394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bf705-41b5-41af-a718-5af932059f25 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.353743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bf705-41b5-41af-a718-5af932059f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.354493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bf705-41b5-41af-a718-5af932059f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.355249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bf705-41b5-41af-a718-5af932059f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:47.361522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bf705-41b5-41af-a718-5af932059f25 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:47.405216 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 872/1744] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:47.406398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44732466-34b2-489e-b42c-c8f358f10ef7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:47.420499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44732466-34b2-489e-b42c-c8f358f10ef7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:47.426903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9938e-e842-4f67-a139-909734d79dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:47.428027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9938e-e842-4f67-a139-909734d79dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.428320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9938e-e842-4f67-a139-909734d79dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.428666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9938e-e842-4f67-a139-909734d79dfd admin admin] PATH_INFO: `/v3/projects/a3806e04d88e4a96be04b3c437abcdfe/users/964a40ff09e24604b79aec09824fbd3e/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.445777 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 873/1745] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:47 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:47.449343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bac1e-473b-4ba1-9003-b325bdf52ca2 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.449526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bac1e-473b-4ba1-9003-b325bdf52ca2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.449735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bac1e-473b-4ba1-9003-b325bdf52ca2 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.452419 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 874/1746] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:47.453905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bac1e-473b-4ba1-9003-b325bdf52ca2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:47.469063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9938e-e842-4f67-a139-909734d79dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3806e04d88e4a96be04b3c437abcdfe, user_id=964a40ff09e24604b79aec09824fbd3e, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:47.474482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9938e-e842-4f67-a139-909734d79dfd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:47.481011 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:47.504460 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 873/1747] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:47 2022] PUT /identity/v3/projects/a3806e04d88e4a96be04b3c437abcdfe/users/964a40ff09e24604b79aec09824fbd3e/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:47.505475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9938e-e842-4f67-a139-909734d79dfd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:47.578196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bac1e-473b-4ba1-9003-b325bdf52ca2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:47.645553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9938e-e842-4f67-a139-909734d79dfd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:47.657560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e617b6e-63c8-4d5e-907c-455af7feb319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:47.658699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e617b6e-63c8-4d5e-907c-455af7feb319 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.659143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e617b6e-63c8-4d5e-907c-455af7feb319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.659494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e617b6e-63c8-4d5e-907c-455af7feb319 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.660223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e617b6e-63c8-4d5e-907c-455af7feb319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:47.662304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e617b6e-63c8-4d5e-907c-455af7feb319 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:47.680937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27205-8249-472b-91a9-69e01c04b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:47.682275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27205-8249-472b-91a9-69e01c04b469 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.682644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27205-8249-472b-91a9-69e01c04b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.683161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27205-8249-472b-91a9-69e01c04b469 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.683832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27205-8249-472b-91a9-69e01c04b469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:47.685875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27205-8249-472b-91a9-69e01c04b469 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:47.707105 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 874/1748] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:47 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:47.708580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e617b6e-63c8-4d5e-907c-455af7feb319 admin admin] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:47.734294 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 875/1749] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:47 2022] POST /identity/v3/projects => generated 389 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:47.735777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27205-8249-472b-91a9-69e01c04b469 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:47.737968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-efb27205-8249-472b-91a9-69e01c04b469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:47.763371 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:47.818602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e617b6e-63c8-4d5e-907c-455af7feb319 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:47.848109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27205-8249-472b-91a9-69e01c04b469 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:47.871301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f918d-4653-420a-9775-1dddcaf832a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:47.873197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f918d-4653-420a-9775-1dddcaf832a8 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.873668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f918d-4653-420a-9775-1dddcaf832a8 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.874131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f918d-4653-420a-9775-1dddcaf832a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:47.876318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-709f918d-4653-420a-9775-1dddcaf832a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:47.910396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e617b6e-63c8-4d5e-907c-455af7feb319 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:47.914027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f918d-4653-420a-9775-1dddcaf832a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:47.915660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f918d-4653-420a-9775-1dddcaf832a8 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:47.950922 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 876/1750] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:47.953831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c8fd6-0764-47cd-9515-d64cfc9b6929 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:47.954121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c8fd6-0764-47cd-9515-d64cfc9b6929 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:47.957475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c8fd6-0764-47cd-9515-d64cfc9b6929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.060196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6c1c8fd6-0764-47cd-9515-d64cfc9b6929 None None] MFA Rules not processed for user `964a40ff09e24604b79aec09824fbd3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:48.062105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6c1c8fd6-0764-47cd-9515-d64cfc9b6929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:48.082237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829246ee-7b30-478d-8e4f-2a6be86fcbc8 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.085859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829246ee-7b30-478d-8e4f-2a6be86fcbc8 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.086530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829246ee-7b30-478d-8e4f-2a6be86fcbc8 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.087000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829246ee-7b30-478d-8e4f-2a6be86fcbc8 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/projects/43cab5470a484788965df76c6ea93679` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.090148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829246ee-7b30-478d-8e4f-2a6be86fcbc8 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:get_project(project_id=43cab5470a484788965df76c6ea93679)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:48.095566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829246ee-7b30-478d-8e4f-2a6be86fcbc8 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:48.100144 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 875/1751] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:47 2022] GET /identity/v3/projects/43cab5470a484788965df76c6ea93679 => generated 371 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:48.102115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829246ee-7b30-478d-8e4f-2a6be86fcbc8 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:48.149251 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:48.253714 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 877/1752] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:48.259102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c8fd6-0764-47cd-9515-d64cfc9b6929 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:48.278708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829246ee-7b30-478d-8e4f-2a6be86fcbc8 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:48.294094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b521-821b-4771-9c11-c4ba0833cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.294561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c8fd6-0764-47cd-9515-d64cfc9b6929 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:48.294738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b521-821b-4771-9c11-c4ba0833cb9d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.295021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b521-821b-4771-9c11-c4ba0833cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.295295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b521-821b-4771-9c11-c4ba0833cb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.295958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65b521-821b-4771-9c11-c4ba0833cb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:48.297680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65b521-821b-4771-9c11-c4ba0833cb9d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:48.314430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5722e3-7383-4565-a625-c2a145c4f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.315651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5722e3-7383-4565-a625-c2a145c4f5ab admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.315651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5722e3-7383-4565-a625-c2a145c4f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.315957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5722e3-7383-4565-a625-c2a145c4f5ab admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.316415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5722e3-7383-4565-a625-c2a145c4f5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:48.319990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5722e3-7383-4565-a625-c2a145c4f5ab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:48.347869 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 876/1753] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:48.349092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b521-821b-4771-9c11-c4ba0833cb9d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:48.409101 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 878/1754] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:48 2022] POST /identity/v3/users => generated 301 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:48.409324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b521-821b-4771-9c11-c4ba0833cb9d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:48.410718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5722e3-7383-4565-a625-c2a145c4f5ab admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:48.443176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81af1a9-e98f-4ddf-aafb-b25b63437cfe tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.445691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af1a9-e98f-4ddf-aafb-b25b63437cfe tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.446087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af1a9-e98f-4ddf-aafb-b25b63437cfe tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.447348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af1a9-e98f-4ddf-aafb-b25b63437cfe tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.448605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81af1a9-e98f-4ddf-aafb-b25b63437cfe tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:48.448968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81af1a9-e98f-4ddf-aafb-b25b63437cfe tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:48.453537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81af1a9-e98f-4ddf-aafb-b25b63437cfe tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:48.453840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5722e3-7383-4565-a625-c2a145c4f5ab admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:48.466091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b14fe-c626-4dfa-8ece-d09c59efed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.467225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b14fe-c626-4dfa-8ece-d09c59efed14 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.467790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b14fe-c626-4dfa-8ece-d09c59efed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.468285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b14fe-c626-4dfa-8ece-d09c59efed14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.469418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b14fe-c626-4dfa-8ece-d09c59efed14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:48.473692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b14fe-c626-4dfa-8ece-d09c59efed14 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:48.509012 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 877/1755] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:48.509012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81af1a9-e98f-4ddf-aafb-b25b63437cfe tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:48.525740 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:48.538729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81af1a9-e98f-4ddf-aafb-b25b63437cfe tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:48.552444 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 879/1756] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:48 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:48.552444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895dfa6-63ad-403d-8e0e-48adb77555b1 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.553405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895dfa6-63ad-403d-8e0e-48adb77555b1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.553912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895dfa6-63ad-403d-8e0e-48adb77555b1 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.561341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f31ca9-ffff-4dcb-886b-37952c025fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.562231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f31ca9-ffff-4dcb-886b-37952c025fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.562740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f31ca9-ffff-4dcb-886b-37952c025fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.563351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f31ca9-ffff-4dcb-886b-37952c025fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.564240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f31ca9-ffff-4dcb-886b-37952c025fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:48.565829 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 880/1757] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:44:48 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:48.567902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895dfa6-63ad-403d-8e0e-48adb77555b1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:48.568485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f31ca9-ffff-4dcb-886b-37952c025fa6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:48.592036 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 878/1758] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:48.593022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f31ca9-ffff-4dcb-886b-37952c025fa6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:48.617952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f31ca9-ffff-4dcb-886b-37952c025fa6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:48.772530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895dfa6-63ad-403d-8e0e-48adb77555b1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:48.785976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850ea97-800b-44ee-a7c2-a0a60cf1f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.787403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850ea97-800b-44ee-a7c2-a0a60cf1f2df admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.787959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850ea97-800b-44ee-a7c2-a0a60cf1f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.788543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850ea97-800b-44ee-a7c2-a0a60cf1f2df admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.788848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05697a5-5f3b-499d-af5a-4d4c1dd2d52b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.789917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850ea97-800b-44ee-a7c2-a0a60cf1f2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:48.790270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05697a5-5f3b-499d-af5a-4d4c1dd2d52b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.790861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05697a5-5f3b-499d-af5a-4d4c1dd2d52b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.791459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05697a5-5f3b-499d-af5a-4d4c1dd2d52b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.793464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05697a5-5f3b-499d-af5a-4d4c1dd2d52b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:48.794551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850ea97-800b-44ee-a7c2-a0a60cf1f2df admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:48.797638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05697a5-5f3b-499d-af5a-4d4c1dd2d52b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:48.849210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 879/1759] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:48 2022] POST /identity/v3/users => generated 379 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:48.850493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05697a5-5f3b-499d-af5a-4d4c1dd2d52b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:48.873560 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 881/1760] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:48.881442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb7f2-2c8f-4e21-b973-d8d4c63b758d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.882903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb7f2-2c8f-4e21-b973-d8d4c63b758d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.886187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb7f2-2c8f-4e21-b973-d8d4c63b758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.888135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05697a5-5f3b-499d-af5a-4d4c1dd2d52b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:48.900998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78649a1a-0163-41d3-ba2d-a0dbdd480040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.903113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78649a1a-0163-41d3-ba2d-a0dbdd480040 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.903366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78649a1a-0163-41d3-ba2d-a0dbdd480040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.903641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78649a1a-0163-41d3-ba2d-a0dbdd480040 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:48.904314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78649a1a-0163-41d3-ba2d-a0dbdd480040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:48.906383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78649a1a-0163-41d3-ba2d-a0dbdd480040 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:48.938298 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 880/1761] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:48 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:48.943112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78649a1a-0163-41d3-ba2d-a0dbdd480040 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:48.950002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6a8eb7f2-2c8f-4e21-b973-d8d4c63b758d None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:48.951438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6a8eb7f2-2c8f-4e21-b973-d8d4c63b758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:48.967159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78649a1a-0163-41d3-ba2d-a0dbdd480040 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:48.977429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e800eb-ae9b-41c1-a124-5b26f100ed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:48.979375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e800eb-ae9b-41c1-a124-5b26f100ed10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:48.980175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e800eb-ae9b-41c1-a124-5b26f100ed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:48.981004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e800eb-ae9b-41c1-a124-5b26f100ed10 admin admin] PATH_INFO: `/v3/projects/e90f08d039644dc09dc67fb89e7ce84c/users/5fdfd4e5176348a394736873ab3a4110/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.015177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e800eb-ae9b-41c1-a124-5b26f100ed10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90f08d039644dc09dc67fb89e7ce84c, user_id=5fdfd4e5176348a394736873ab3a4110, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:49.023017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e800eb-ae9b-41c1-a124-5b26f100ed10 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:49.052789 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 881/1762] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:48 2022] PUT /identity/v3/projects/e90f08d039644dc09dc67fb89e7ce84c/users/5fdfd4e5176348a394736873ab3a4110/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:49.070151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e800eb-ae9b-41c1-a124-5b26f100ed10 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:49.143236 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 882/1763] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:44:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:49.144567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb7f2-2c8f-4e21-b973-d8d4c63b758d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:49.174510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb7f2-2c8f-4e21-b973-d8d4c63b758d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:49.200847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e800eb-ae9b-41c1-a124-5b26f100ed10 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:49.204722 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:49.210845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c96f4-c168-4812-934d-a08278f79e66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:49.211803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c96f4-c168-4812-934d-a08278f79e66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.212027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c96f4-c168-4812-934d-a08278f79e66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.212312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c96f4-c168-4812-934d-a08278f79e66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.213117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c96f4-c168-4812-934d-a08278f79e66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:49.213444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c96f4-c168-4812-934d-a08278f79e66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:49.215360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c96f4-c168-4812-934d-a08278f79e66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:49.237960 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 882/1764] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:49.243092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c96f4-c168-4812-934d-a08278f79e66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:49.316908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74456376-46c3-492b-8875-3346f940f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:49.316908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74456376-46c3-492b-8875-3346f940f4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.316908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74456376-46c3-492b-8875-3346f940f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.316908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74456376-46c3-492b-8875-3346f940f4a6 admin admin] PATH_INFO: `/v3/projects/79f9ad4f3606435bae9b93133042cc30/users/6c8fb2a47d584c138a431e057f788185/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.345577 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:49.365334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74456376-46c3-492b-8875-3346f940f4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f9ad4f3606435bae9b93133042cc30, user_id=6c8fb2a47d584c138a431e057f788185, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:49.368514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74456376-46c3-492b-8875-3346f940f4a6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:49.405158 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 883/1765] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:49 2022] PUT /identity/v3/projects/79f9ad4f3606435bae9b93133042cc30/users/6c8fb2a47d584c138a431e057f788185/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:49.409986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cf8fa-6d65-4559-985a-3d7e979336a5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.410314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cf8fa-6d65-4559-985a-3d7e979336a5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.410611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cf8fa-6d65-4559-985a-3d7e979336a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.436102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c96f4-c168-4812-934d-a08278f79e66 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:49.474819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-333cf8fa-6d65-4559-985a-3d7e979336a5 None None] MFA Rules not processed for user `5fdfd4e5176348a394736873ab3a4110`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:49.476150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-333cf8fa-6d65-4559-985a-3d7e979336a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:49.577658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a4b6e-6f67-461e-a1b6-cb6d596d6dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:49.578149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 884/1766] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:49.579068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cf8fa-6d65-4559-985a-3d7e979336a5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:49.583472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a4b6e-6f67-461e-a1b6-cb6d596d6dde admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.583766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a4b6e-6f67-461e-a1b6-cb6d596d6dde admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.584041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a4b6e-6f67-461e-a1b6-cb6d596d6dde admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.584879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a4b6e-6f67-461e-a1b6-cb6d596d6dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:49.586547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a4b6e-6f67-461e-a1b6-cb6d596d6dde admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:49.600160 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 883/1767] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:49.601741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efb6f3-0a0e-4753-abee-77e797ecd870 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.602025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efb6f3-0a0e-4753-abee-77e797ecd870 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.602305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efb6f3-0a0e-4753-abee-77e797ecd870 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.605158 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 884/1768] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:49.606241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efb6f3-0a0e-4753-abee-77e797ecd870 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:49.622087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efb6f3-0a0e-4753-abee-77e797ecd870 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:49.628108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09147af-ac69-4fca-994e-9a3d94cc9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:49.628781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09147af-ac69-4fca-994e-9a3d94cc9335 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.629065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09147af-ac69-4fca-994e-9a3d94cc9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.629341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09147af-ac69-4fca-994e-9a3d94cc9335 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.630015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09147af-ac69-4fca-994e-9a3d94cc9335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:49.632000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09147af-ac69-4fca-994e-9a3d94cc9335 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:49.649139 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 885/1769] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:49.649139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09147af-ac69-4fca-994e-9a3d94cc9335 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:49.741301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cf8fa-6d65-4559-985a-3d7e979336a5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:49.746339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:49.747009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.748898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.749836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.785074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09147af-ac69-4fca-994e-9a3d94cc9335 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:49.800885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab4364-ea05-4dce-987d-d2d03a9caac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:49.802273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab4364-ea05-4dce-987d-d2d03a9caac5 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.802790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab4364-ea05-4dce-987d-d2d03a9caac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.803267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab4364-ea05-4dce-987d-d2d03a9caac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.846883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab4364-ea05-4dce-987d-d2d03a9caac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:49.873036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab4364-ea05-4dce-987d-d2d03a9caac5 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:49.877600 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:49.912354 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 886/1770] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:49.913684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab4364-ea05-4dce-987d-d2d03a9caac5 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:49.942967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab4364-ea05-4dce-987d-d2d03a9caac5 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:49.956318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:49.958121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:49.974608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355849d-d440-4627-9ec1-eb77f07b1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:49.976599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355849d-d440-4627-9ec1-eb77f07b1654 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.980102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355849d-d440-4627-9ec1-eb77f07b1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.991145 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 885/1771] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:49.992253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:49.995150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355849d-d440-4627-9ec1-eb77f07b1654 admin admin] PATH_INFO: `/v3/projects/854f65479c434cda8ea94436ed595abf/users/d35339304edd4b6fa7780ad230b79125/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.999662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:50.038203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:50.046263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355849d-d440-4627-9ec1-eb77f07b1654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854f65479c434cda8ea94436ed595abf, user_id=d35339304edd4b6fa7780ad230b79125, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:50.049701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355849d-d440-4627-9ec1-eb77f07b1654 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:50.075707 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 887/1772] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:49 2022] PUT /identity/v3/projects/854f65479c434cda8ea94436ed595abf/users/d35339304edd4b6fa7780ad230b79125/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:50.077048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355849d-d440-4627-9ec1-eb77f07b1654 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:50.149994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e696-9b27-496a-a01d-9dbc393429ad service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:50.172949 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:50.200111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355849d-d440-4627-9ec1-eb77f07b1654 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:50.213334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531583fc-6e7d-4f59-860b-310c9078f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:50.214269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531583fc-6e7d-4f59-860b-310c9078f76f admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:50.214740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531583fc-6e7d-4f59-860b-310c9078f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:50.215219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531583fc-6e7d-4f59-860b-310c9078f76f admin admin] PATH_INFO: `/v3/projects/79f9ad4f3606435bae9b93133042cc30/users/6c8fb2a47d584c138a431e057f788185/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:50.217713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531583fc-6e7d-4f59-860b-310c9078f76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f9ad4f3606435bae9b93133042cc30, user_id=6c8fb2a47d584c138a431e057f788185, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:50.221106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531583fc-6e7d-4f59-860b-310c9078f76f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:50.237317 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 888/1773] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:50 2022] PUT /identity/v3/projects/79f9ad4f3606435bae9b93133042cc30/users/6c8fb2a47d584c138a431e057f788185/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:50.238561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531583fc-6e7d-4f59-860b-310c9078f76f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:50.261995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7069f3-a83e-4873-912e-472635c93a78 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:50.263721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7069f3-a83e-4873-912e-472635c93a78 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:50.264432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7069f3-a83e-4873-912e-472635c93a78 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:50.265007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7069f3-a83e-4873-912e-472635c93a78 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/projects/43cab5470a484788965df76c6ea93679` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:50.266548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7069f3-a83e-4873-912e-472635c93a78 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:get_project(project_id=43cab5470a484788965df76c6ea93679)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:50.280781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7069f3-a83e-4873-912e-472635c93a78 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:50.283878 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 886/1774] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:49 2022] GET /identity/v3/projects/43cab5470a484788965df76c6ea93679 => generated 371 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:50.285812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5650b4e-bb29-4c98-8b90-414606dac9a1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:50.286320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5650b4e-bb29-4c98-8b90-414606dac9a1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:50.286790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5650b4e-bb29-4c98-8b90-414606dac9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:50.368813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a5650b4e-bb29-4c98-8b90-414606dac9a1 None None] MFA Rules not processed for user `6c8fb2a47d584c138a431e057f788185`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:50.374255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a5650b4e-bb29-4c98-8b90-414606dac9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:50.447716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531583fc-6e7d-4f59-860b-310c9078f76f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:50.467955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128de2dd-945e-40b0-aced-f84004bc59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:50.469422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128de2dd-945e-40b0-aced-f84004bc59f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:50.470315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128de2dd-945e-40b0-aced-f84004bc59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:50.471456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128de2dd-945e-40b0-aced-f84004bc59f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:50.472957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128de2dd-945e-40b0-aced-f84004bc59f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:50.477843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128de2dd-945e-40b0-aced-f84004bc59f5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:50.504944 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 889/1775] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:50.513097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128de2dd-945e-40b0-aced-f84004bc59f5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:50.535040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128de2dd-945e-40b0-aced-f84004bc59f5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:50.552737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927f408-bc7b-4419-a8c0-fe080402afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:50.553867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927f408-bc7b-4419-a8c0-fe080402afb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:50.554872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927f408-bc7b-4419-a8c0-fe080402afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:50.555431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927f408-bc7b-4419-a8c0-fe080402afb4 admin admin] PATH_INFO: `/v3/projects/854f65479c434cda8ea94436ed595abf/users/d35339304edd4b6fa7780ad230b79125/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:50.559549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927f408-bc7b-4419-a8c0-fe080402afb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854f65479c434cda8ea94436ed595abf, user_id=d35339304edd4b6fa7780ad230b79125, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:50.564157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927f408-bc7b-4419-a8c0-fe080402afb4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:50.584739 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:50.591385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 887/1776] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:50.593384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba14e21-10be-4f0a-9683-cc0de431a281 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:50.593669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba14e21-10be-4f0a-9683-cc0de431a281 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:50.593940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba14e21-10be-4f0a-9683-cc0de431a281 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:50.601293 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 888/1777] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:44:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:50.602710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba14e21-10be-4f0a-9683-cc0de431a281 None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:44:50.613843 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 890/1778] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:50 2022] PUT /identity/v3/projects/854f65479c434cda8ea94436ed595abf/users/d35339304edd4b6fa7780ad230b79125/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:50.616117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec1cd-9e56-40d3-bbd3-fc174d5237ac None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:50.616711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec1cd-9e56-40d3-bbd3-fc174d5237ac None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:50.617196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec1cd-9e56-40d3-bbd3-fc174d5237ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:50.718905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0e5ec1cd-9e56-40d3-bbd3-fc174d5237ac None None] MFA Rules not processed for user `0ba955efddd645e8ada9987c22bc52ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:50.725736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0e5ec1cd-9e56-40d3-bbd3-fc174d5237ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:50.804331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba14e21-10be-4f0a-9683-cc0de431a281 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:50.918360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 891/1779] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:50.921787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc813a-63be-4426-859e-3739c8dd27b9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:50.922096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc813a-63be-4426-859e-3739c8dd27b9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:50.922441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc813a-63be-4426-859e-3739c8dd27b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:51.018892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9adc813a-63be-4426-859e-3739c8dd27b9 None None] MFA Rules not processed for user `d35339304edd4b6fa7780ad230b79125`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:51.020190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9adc813a-63be-4426-859e-3739c8dd27b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:51.027406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba14e21-10be-4f0a-9683-cc0de431a281 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:51.036672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc0cc-7e65-4619-94d5-256517d0317b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:51.037493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc0cc-7e65-4619-94d5-256517d0317b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:51.037845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc0cc-7e65-4619-94d5-256517d0317b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:51.038180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc0cc-7e65-4619-94d5-256517d0317b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/projects/43cab5470a484788965df76c6ea93679` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:51.049940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffc0cc-7e65-4619-94d5-256517d0317b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:get_project(project_id=43cab5470a484788965df76c6ea93679)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:51.052331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffc0cc-7e65-4619-94d5-256517d0317b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:51.069933 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 889/1780] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:44:50 2022] GET /identity/v3/projects/43cab5470a484788965df76c6ea93679 => generated 371 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:51.070992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc0cc-7e65-4619-94d5-256517d0317b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:51.131277 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:51.157867 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 892/1781] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:51.159065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc813a-63be-4426-859e-3739c8dd27b9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:51.198281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc813a-63be-4426-859e-3739c8dd27b9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:51.238739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:51.244349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:51.249250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:51.264699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/users/a624ed9281f94cedb0c6d392dfdbc447` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:51.292645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc0cc-7e65-4619-94d5-256517d0317b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:51.308723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:51.312475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:51.312862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:51.313316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] PATH_INFO: `/v3/users/5fdfd4e5176348a394736873ab3a4110` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:51.317913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fdfd4e5176348a394736873ab3a4110)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:51.326088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:51.342213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a624ed9281f94cedb0c6d392dfdbc447)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:51.347567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:51.429911 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:51.440338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fdfd4e5176348a394736873ab3a4110'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.492762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fdfd4e5176348a394736873ab3a4110'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.506203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a624ed9281f94cedb0c6d392dfdbc447'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.512462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fdfd4e5176348a394736873ab3a4110'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.531844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fdfd4e5176348a394736873ab3a4110'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.533155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fdfd4e5176348a394736873ab3a4110'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.557684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a624ed9281f94cedb0c6d392dfdbc447'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.572430 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 890/1782] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:51 2022] DELETE /identity/v3/users/5fdfd4e5176348a394736873ab3a4110 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:51.575090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:51.579912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:51.583139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a624ed9281f94cedb0c6d392dfdbc447'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.598103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a624ed9281f94cedb0c6d392dfdbc447'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.599695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e0a695ea-2ed2-499d-983d-6f7b1e0f8ae5 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a624ed9281f94cedb0c6d392dfdbc447'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:51.611994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 893/1783] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:51 2022] DELETE /identity/v3/users/a624ed9281f94cedb0c6d392dfdbc447 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:51.615605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ef428-10f5-4054-a5f8-aeab4785afb7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:51.616351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ef428-10f5-4054-a5f8-aeab4785afb7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:51.616929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ef428-10f5-4054-a5f8-aeab4785afb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:51.686607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-540ef428-10f5-4054-a5f8-aeab4785afb7 None None] MFA Rules not processed for user `171c3ef9ce28423eb069bb8e67b3a367`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:51.688851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-540ef428-10f5-4054-a5f8-aeab4785afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:51.760100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa07089-b92d-438f-b646-4e44f235f277 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:51.876936 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 894/1784] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:51.877767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ef428-10f5-4054-a5f8-aeab4785afb7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:51.879244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-540ef428-10f5-4054-a5f8-aeab4785afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:51.925950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d62dc1-6172-4952-b427-9a9e715ee391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:51.928724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62dc1-6172-4952-b427-9a9e715ee391 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:51.929355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62dc1-6172-4952-b427-9a9e715ee391 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:51.929874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62dc1-6172-4952-b427-9a9e715ee391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:51.934439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-75d62dc1-6172-4952-b427-9a9e715ee391 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:51.944858 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:51.995499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ef428-10f5-4054-a5f8-aeab4785afb7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:52.002283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:52.003042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:52.004051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:52.004051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:52.005816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:52.034950 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:52.039294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d62dc1-6172-4952-b427-9a9e715ee391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:52.042840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d62dc1-6172-4952-b427-9a9e715ee391 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:52.062840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 891/1785] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:52.070213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd02068-f4e4-42ad-baf9-189143592521 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:52.070426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd02068-f4e4-42ad-baf9-189143592521 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:52.070785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd02068-f4e4-42ad-baf9-189143592521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:52.104462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bdd02068-f4e4-42ad-baf9-189143592521 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:52.105738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bdd02068-f4e4-42ad-baf9-189143592521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:52.132123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:52.135092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:52.165159 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 895/1786] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:52.165159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:52.173128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:52.265821 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 892/1787] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:52.267539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ab4cb-2a17-4e2f-867f-daa54f7ba72f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:52.267963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ab4cb-2a17-4e2f-867f-daa54f7ba72f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:52.268370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ab4cb-2a17-4e2f-867f-daa54f7ba72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:52.322581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ee6ab4cb-2a17-4e2f-867f-daa54f7ba72f None None] MFA Rules not processed for user `a24b98f6af634c61af828bb20ce1e945`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:52.332471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ee6ab4cb-2a17-4e2f-867f-daa54f7ba72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:52.348274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd663d99-2c86-4972-a2c9-a465c749b4c1 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:52.357664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d8acfd69728476495c678164ae8e616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9203aaea5b84415b9b233cbda21c8a30', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:52.358331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:52.358772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:52.360454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] PATH_INFO: `/v3/projects/43cab5470a484788965df76c6ea93679` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:52.362278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorizing `identity:delete_project(project_id=43cab5470a484788965df76c6ea93679)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:52.365088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:52.470753 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 893/1788] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:52.471827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ab4cb-2a17-4e2f-867f-daa54f7ba72f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:52.474507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ee6ab4cb-2a17-4e2f-867f-daa54f7ba72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:52.481277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43cab5470a484788965df76c6ea93679', 'request_id': 'req-083bbac9-175b-44b6-ba01-e395a96fdc7e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.505193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43cab5470a484788965df76c6ea93679', 'request_id': 'req-083bbac9-175b-44b6-ba01-e395a96fdc7e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.507634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ab4cb-2a17-4e2f-867f-daa54f7ba72f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:52.519613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43cab5470a484788965df76c6ea93679', 'request_id': 'req-083bbac9-175b-44b6-ba01-e395a96fdc7e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.540016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] The token cache is being invalidate because project 43cab5470a484788965df76c6ea93679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:52.540514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.542662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.552743 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 896/1789] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:52 2022] DELETE /identity/v3/projects/43cab5470a484788965df76c6ea93679 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:52.554235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:52.555825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:52.570222 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:52.674951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bbac9-175b-44b6-ba01-e395a96fdc7e tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:52.687039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:52.688445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:52.688813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:52.689792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:52.699570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:52.700261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:52.700588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:52.700838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] PATH_INFO: `/v3/users/964a40ff09e24604b79aec09824fbd3e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:52.703488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964a40ff09e24604b79aec09824fbd3e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:52.705572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:52.707325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:52.784003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:52.786780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:52.810151 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:52.826434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964a40ff09e24604b79aec09824fbd3e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.834607 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 897/1790] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:52.835368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:52.840365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:52.862948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964a40ff09e24604b79aec09824fbd3e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.865732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aa400-3005-45c3-b767-1cdce0129e9a service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:52.878346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:52.878899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:52.879186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:52.879468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] PATH_INFO: `/v3/users/20e0faf8a74d44129fbb9dc9408eb3fb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:52.885626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e0faf8a74d44129fbb9dc9408eb3fb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:52.887746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:52.889089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964a40ff09e24604b79aec09824fbd3e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.916949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964a40ff09e24604b79aec09824fbd3e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.919768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-962e4647-349d-4216-aa1d-5e4cc8c31ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964a40ff09e24604b79aec09824fbd3e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:52.931375 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 894/1791] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:52 2022] DELETE /identity/v3/users/964a40ff09e24604b79aec09824fbd3e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:52.937496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf71e4-8bbf-4fa7-9d16-666305c2b225 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:52.937834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf71e4-8bbf-4fa7-9d16-666305c2b225 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:52.938057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf71e4-8bbf-4fa7-9d16-666305c2b225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:52.981372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-65bf71e4-8bbf-4fa7-9d16-666305c2b225 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:52.983890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65bf71e4-8bbf-4fa7-9d16-666305c2b225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:52.993331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e0faf8a74d44129fbb9dc9408eb3fb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:53.042502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e0faf8a74d44129fbb9dc9408eb3fb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:53.073642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e0faf8a74d44129fbb9dc9408eb3fb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:53.099159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e0faf8a74d44129fbb9dc9408eb3fb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:53.104200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e0faf8a74d44129fbb9dc9408eb3fb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:53.116741 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 898/1792] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:52 2022] DELETE /identity/v3/users/20e0faf8a74d44129fbb9dc9408eb3fb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:53.118052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:53.120014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:53.130297 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 895/1793] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:53.131703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafe62b-e232-4c1c-9df1-edbed9e8212c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:53.131997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafe62b-e232-4c1c-9df1-edbed9e8212c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:53.132274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafe62b-e232-4c1c-9df1-edbed9e8212c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:53.173573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7dafe62b-e232-4c1c-9df1-edbed9e8212c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:53.174822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7dafe62b-e232-4c1c-9df1-edbed9e8212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:53.373277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09b93-a6c6-45bc-9b56-008b49f87c37 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:53.401189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:53.401838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:53.402122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:53.402395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:53.408216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:53.437610 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 896/1794] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:53.443132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafe62b-e232-4c1c-9df1-edbed9e8212c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:53.451055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7dafe62b-e232-4c1c-9df1-edbed9e8212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:53.452380 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:53.557671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:53.559341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:53.578094 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 899/1795] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:53.579068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:53.581570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:53.715096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafe62b-e232-4c1c-9df1-edbed9e8212c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:53.721946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4170fa-234d-4459-960c-e6829a5975b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:53.722854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4170fa-234d-4459-960c-e6829a5975b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:53.723278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4170fa-234d-4459-960c-e6829a5975b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:53.723737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4170fa-234d-4459-960c-e6829a5975b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:53.738947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ab15e-03d1-4996-bbd0-7e3eb2c37734 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:53.747345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4170fa-234d-4459-960c-e6829a5975b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:53.751721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4730-ae68-480e-81c1-e232792a844a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:53.753100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4730-ae68-480e-81c1-e232792a844a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:53.754385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4730-ae68-480e-81c1-e232792a844a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:53.754869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4730-ae68-480e-81c1-e232792a844a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:53.755889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4170fa-234d-4459-960c-e6829a5975b9 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:53.768751 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:53.781655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4730-ae68-480e-81c1-e232792a844a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:53.784086 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 897/1796] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:53.785098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4730-ae68-480e-81c1-e232792a844a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:53.802281 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 900/1797] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:54.233387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4170fa-234d-4459-960c-e6829a5975b9 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:54.234860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ff4170fa-234d-4459-960c-e6829a5975b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:54.287824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4170fa-234d-4459-960c-e6829a5975b9 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:54.324655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:54.325597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.327696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.330255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] PATH_INFO: `/v3/projects/e90f08d039644dc09dc67fb89e7ce84c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.337010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90f08d039644dc09dc67fb89e7ce84c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:54.340894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:54.438198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4730-ae68-480e-81c1-e232792a844a service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:54.440607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a22d4730-ae68-480e-81c1-e232792a844a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:54.479464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4730-ae68-480e-81c1-e232792a844a service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:54.524975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90f08d039644dc09dc67fb89e7ce84c', 'request_id': 'req-7a45d53f-8b44-4484-a7d0-37b6764e2b20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:54.541651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90f08d039644dc09dc67fb89e7ce84c', 'request_id': 'req-7a45d53f-8b44-4484-a7d0-37b6764e2b20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:54.555268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90f08d039644dc09dc67fb89e7ce84c', 'request_id': 'req-7a45d53f-8b44-4484-a7d0-37b6764e2b20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:54.582422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] The token cache is being invalidate because project e90f08d039644dc09dc67fb89e7ce84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:54.582755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:54.583679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a45d53f-8b44-4484-a7d0-37b6764e2b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:54.598133 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 898/1798] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:54 2022] DELETE /identity/v3/projects/e90f08d039644dc09dc67fb89e7ce84c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:44:54.599695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b535d1-78f4-40e5-bdc3-eb5053508729 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.599989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b535d1-78f4-40e5-bdc3-eb5053508729 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.600270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b535d1-78f4-40e5-bdc3-eb5053508729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.625088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c3b535d1-78f4-40e5-bdc3-eb5053508729 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:54.626375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c3b535d1-78f4-40e5-bdc3-eb5053508729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:54.747166 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 899/1799] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:54.748677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b995-8eb8-469a-9a22-a6a70f578d17 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.748969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b995-8eb8-469a-9a22-a6a70f578d17 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.749244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b995-8eb8-469a-9a22-a6a70f578d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.774825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7570b995-8eb8-469a-9a22-a6a70f578d17 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:54.777398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7570b995-8eb8-469a-9a22-a6a70f578d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:54.781764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d48b2b-3357-41f3-a5fb-ea8601ddf2d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:54.783206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d48b2b-3357-41f3-a5fb-ea8601ddf2d3 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.784068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d48b2b-3357-41f3-a5fb-ea8601ddf2d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.785836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d48b2b-3357-41f3-a5fb-ea8601ddf2d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.790172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-72d48b2b-3357-41f3-a5fb-ea8601ddf2d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:54.793524 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 900/1800] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:54.794550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b995-8eb8-469a-9a22-a6a70f578d17 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:54.806008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b995-8eb8-469a-9a22-a6a70f578d17 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:54.813434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaab9f-53ec-4ea6-941d-ddbea8614223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:54.814313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaab9f-53ec-4ea6-941d-ddbea8614223 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.814742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaab9f-53ec-4ea6-941d-ddbea8614223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.815158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaab9f-53ec-4ea6-941d-ddbea8614223 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.816000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaab9f-53ec-4ea6-941d-ddbea8614223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:54.816471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaab9f-53ec-4ea6-941d-ddbea8614223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:54.818796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaab9f-53ec-4ea6-941d-ddbea8614223 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:54.847205 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 901/1801] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:54.848195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaab9f-53ec-4ea6-941d-ddbea8614223 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:54.871704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaab9f-53ec-4ea6-941d-ddbea8614223 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:54.897008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868b927-4205-4224-9e67-421054f0099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:54.898180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868b927-4205-4224-9e67-421054f0099d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.898627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868b927-4205-4224-9e67-421054f0099d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.899116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868b927-4205-4224-9e67-421054f0099d admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.903295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868b927-4205-4224-9e67-421054f0099d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:54.917716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868b927-4205-4224-9e67-421054f0099d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:55.047866 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 902/1802] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:54 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:55.056983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868b927-4205-4224-9e67-421054f0099d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:55.065859 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:55.088014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d48b2b-3357-41f3-a5fb-ea8601ddf2d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:55.096332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d48b2b-3357-41f3-a5fb-ea8601ddf2d3 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:55.125599 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 901/1803] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:44:55.231922 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:55.326739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868b927-4205-4224-9e67-421054f0099d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:55.345528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa17f5e-ba0b-4422-b30a-257636dd0593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:55.347076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa17f5e-ba0b-4422-b30a-257636dd0593 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:55.347667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa17f5e-ba0b-4422-b30a-257636dd0593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:55.348379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa17f5e-ba0b-4422-b30a-257636dd0593 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:55.349692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa17f5e-ba0b-4422-b30a-257636dd0593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:55.353493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa17f5e-ba0b-4422-b30a-257636dd0593 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:55.418762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d48b2b-3357-41f3-a5fb-ea8601ddf2d3 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:55.419552 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 903/1804] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:55 2022] POST /identity/v3/users => generated 292 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:55.436230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d48b2b-3357-41f3-a5fb-ea8601ddf2d3 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:55.456746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19f2b5-3cc1-4fa3-9a44-c0183134ff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:55.457850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f2b5-3cc1-4fa3-9a44-c0183134ff91 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:55.458287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f2b5-3cc1-4fa3-9a44-c0183134ff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:55.458790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f2b5-3cc1-4fa3-9a44-c0183134ff91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:55.460257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19f2b5-3cc1-4fa3-9a44-c0183134ff91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:55.464231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19f2b5-3cc1-4fa3-9a44-c0183134ff91 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:55.512693 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 902/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:44:55.517917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa17f5e-ba0b-4422-b30a-257636dd0593 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:55.537504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa17f5e-ba0b-4422-b30a-257636dd0593 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:55.552895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3d01-4508-42cf-8c2c-d82c42a99dcf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:55.553386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3d01-4508-42cf-8c2c-d82c42a99dcf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:55.553877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3d01-4508-42cf-8c2c-d82c42a99dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:55.554134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e393b-7e66-43cf-9f02-bef76ed35385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:55.555594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e393b-7e66-43cf-9f02-bef76ed35385 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:55.557578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e393b-7e66-43cf-9f02-bef76ed35385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:55.558048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e393b-7e66-43cf-9f02-bef76ed35385 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:55.559698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e393b-7e66-43cf-9f02-bef76ed35385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:55.566381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e393b-7e66-43cf-9f02-bef76ed35385 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:55.596916 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 904/1806] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:55.606897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e393b-7e66-43cf-9f02-bef76ed35385 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:55.639908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-176e3d01-4508-42cf-8c2c-d82c42a99dcf None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:55.642199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-176e3d01-4508-42cf-8c2c-d82c42a99dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:55.662956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e393b-7e66-43cf-9f02-bef76ed35385 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:55.678652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292add65-3b32-46da-8568-01ecffb216ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:55.680236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292add65-3b32-46da-8568-01ecffb216ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:55.682180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292add65-3b32-46da-8568-01ecffb216ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:55.694478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292add65-3b32-46da-8568-01ecffb216ce admin admin] PATH_INFO: `/v3/projects/95e962592ce1403bbe43ac8dcb767a53/users/8b9d2b20d75a4b4f8ebbc4e6ee0e9810/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:55.784321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292add65-3b32-46da-8568-01ecffb216ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e962592ce1403bbe43ac8dcb767a53, user_id=8b9d2b20d75a4b4f8ebbc4e6ee0e9810, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:55.802216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292add65-3b32-46da-8568-01ecffb216ce admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:55.846024 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 905/1807] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:55 2022] PUT /identity/v3/projects/95e962592ce1403bbe43ac8dcb767a53/users/8b9d2b20d75a4b4f8ebbc4e6ee0e9810/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:55.865472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f811-11b1-4fef-9095-8cac42a06c7a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:55.866634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f811-11b1-4fef-9095-8cac42a06c7a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:55.867145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f811-11b1-4fef-9095-8cac42a06c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:55.881582 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 903/1808] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:44:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:44:55.961867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3d01-4508-42cf-8c2c-d82c42a99dcf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:55.965439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-176e3d01-4508-42cf-8c2c-d82c42a99dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:55.981713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6157f811-11b1-4fef-9095-8cac42a06c7a None None] MFA Rules not processed for user `8b9d2b20d75a4b4f8ebbc4e6ee0e9810`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:55.983046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6157f811-11b1-4fef-9095-8cac42a06c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:56.034454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3d01-4508-42cf-8c2c-d82c42a99dcf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:56.207887 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 906/1809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:56.210182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f811-11b1-4fef-9095-8cac42a06c7a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:56.338186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5290df-2ab4-4ae5-b730-7871ed697ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:56.340422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5290df-2ab4-4ae5-b730-7871ed697ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:56.340750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5290df-2ab4-4ae5-b730-7871ed697ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:56.341035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5290df-2ab4-4ae5-b730-7871ed697ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:56.362784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5290df-2ab4-4ae5-b730-7871ed697ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:56.364268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5290df-2ab4-4ae5-b730-7871ed697ff9 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:56.382485 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 904/1810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:44:56.421971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5290df-2ab4-4ae5-b730-7871ed697ff9 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:56.424417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4e5290df-2ab4-4ae5-b730-7871ed697ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:56.439746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f811-11b1-4fef-9095-8cac42a06c7a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:56.460797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1286d8-0097-42d0-8dbd-766624131ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:56.461975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1286d8-0097-42d0-8dbd-766624131ced admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:56.462892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1286d8-0097-42d0-8dbd-766624131ced admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:56.464348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1286d8-0097-42d0-8dbd-766624131ced admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:56.465117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5290df-2ab4-4ae5-b730-7871ed697ff9 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:56.466412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1286d8-0097-42d0-8dbd-766624131ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:56.471796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1286d8-0097-42d0-8dbd-766624131ced admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:56.500114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:56.504553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:56.520338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:56.521991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] PATH_INFO: `/v3/projects/a3806e04d88e4a96be04b3c437abcdfe` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:56.534141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3806e04d88e4a96be04b3c437abcdfe)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:56.571409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:56.669292 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 907/1811] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:56 2022] POST /identity/v3/projects => generated 385 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:56.672361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1286d8-0097-42d0-8dbd-766624131ced admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:56.684444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ad1286d8-0097-42d0-8dbd-766624131ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:56.749000 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:56.881717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3806e04d88e4a96be04b3c437abcdfe', 'request_id': 'req-8c357bd7-f38c-4de8-8ccc-4f3011342db4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:56.904268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1286d8-0097-42d0-8dbd-766624131ced admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:56.922969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3806e04d88e4a96be04b3c437abcdfe', 'request_id': 'req-8c357bd7-f38c-4de8-8ccc-4f3011342db4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:56.933830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3806e04d88e4a96be04b3c437abcdfe', 'request_id': 'req-8c357bd7-f38c-4de8-8ccc-4f3011342db4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:56.976803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] The token cache is being invalidate because project a3806e04d88e4a96be04b3c437abcdfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:56.977406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:56.980893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:56.990947 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 905/1812] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:56 2022] DELETE /identity/v3/projects/a3806e04d88e4a96be04b3c437abcdfe => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:57.004530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:57.010697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:57.060687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:57.061390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:57.061759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:57.062222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] PATH_INFO: `/v3/projects/9d3ce840c31c48b6a1bf147824faa84c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:57.064254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3ce840c31c48b6a1bf147824faa84c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:57.066714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:57.072220 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:57.214877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c357bd7-f38c-4de8-8ccc-4f3011342db4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:57.215697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3ce840c31c48b6a1bf147824faa84c', 'request_id': 'req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.245240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3ce840c31c48b6a1bf147824faa84c', 'request_id': 'req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.267973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3ce840c31c48b6a1bf147824faa84c', 'request_id': 'req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.306534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] The token cache is being invalidate because project 9d3ce840c31c48b6a1bf147824faa84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:57.309234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.311546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.319502 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 908/1813] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:56 2022] DELETE /identity/v3/projects/9d3ce840c31c48b6a1bf147824faa84c => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:57.319502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:57.325678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:57.432098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a6f8-6124-4765-93c4-5258d9f969ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:57.434151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a6f8-6124-4765-93c4-5258d9f969ac admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:57.434455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a6f8-6124-4765-93c4-5258d9f969ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:57.435902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a6f8-6124-4765-93c4-5258d9f969ac admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:57.436646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a6f8-6124-4765-93c4-5258d9f969ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:57.441712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a6f8-6124-4765-93c4-5258d9f969ac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:57.451418 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:57.498724 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 906/1814] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:44:56 2022] POST /identity/v3/users => generated 299 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:57.499597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a6f8-6124-4765-93c4-5258d9f969ac admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:57.501938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2382a6f8-6124-4765-93c4-5258d9f969ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:57.507985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7507f3d-be9f-4acb-b1d3-7a17ff15e383 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:57.523093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:57.523759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:57.524073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:57.524351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] PATH_INFO: `/v3/users/d35339304edd4b6fa7780ad230b79125` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:57.527397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35339304edd4b6fa7780ad230b79125)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:57.530154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a6f8-6124-4765-93c4-5258d9f969ac admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:57.534799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:57.539603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:57.541591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:57.542200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:57.542678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] PATH_INFO: `/v3/users/3d8acfd69728476495c678164ae8e616` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:57.545560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8acfd69728476495c678164ae8e616)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:57.548187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:57.637015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35339304edd4b6fa7780ad230b79125'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.643761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8acfd69728476495c678164ae8e616'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.661668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8acfd69728476495c678164ae8e616'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.665354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35339304edd4b6fa7780ad230b79125'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.672884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8acfd69728476495c678164ae8e616'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.677059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35339304edd4b6fa7780ad230b79125'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.684558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8acfd69728476495c678164ae8e616'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.685433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a4b94e-5bbd-4947-86c7-21507d376c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8acfd69728476495c678164ae8e616'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.693074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35339304edd4b6fa7780ad230b79125'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.693854 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 907/1815] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:57 2022] DELETE /identity/v3/users/3d8acfd69728476495c678164ae8e616 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:57.695156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2bd15-4cbb-46c8-98b9-eaa89e7b4808 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:57.695443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2bd15-4cbb-46c8-98b9-eaa89e7b4808 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:57.695719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2bd15-4cbb-46c8-98b9-eaa89e7b4808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:57.706935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35339304edd4b6fa7780ad230b79125'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:57.718513 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 909/1816] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:57 2022] DELETE /identity/v3/users/d35339304edd4b6fa7780ad230b79125 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:57.719635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:57.721677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:57.723067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-91d2bd15-4cbb-46c8-98b9-eaa89e7b4808 None None] MFA Rules not processed for user `97fb5d3a021149d4a90bef39a518ada2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:57.724681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-91d2bd15-4cbb-46c8-98b9-eaa89e7b4808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:57.854978 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:57.903513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bc8e-c7b7-4ac4-a3b3-fdcdb6085431 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:57.913644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc5885-29b5-4e4c-8e1a-f6428a70c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:57.914572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc5885-29b5-4e4c-8e1a-f6428a70c3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:57.914886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc5885-29b5-4e4c-8e1a-f6428a70c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:57.915150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc5885-29b5-4e4c-8e1a-f6428a70c3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:57.921453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc5885-29b5-4e4c-8e1a-f6428a70c3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:57.921453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc5885-29b5-4e4c-8e1a-f6428a70c3c8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:57.940962 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 910/1817] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:57.942619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc5885-29b5-4e4c-8e1a-f6428a70c3c8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:57.961806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc5885-29b5-4e4c-8e1a-f6428a70c3c8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:57.970600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db94cc-4d6c-434e-bdb6-99bbfce60ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:57.971813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db94cc-4d6c-434e-bdb6-99bbfce60ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:57.973159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db94cc-4d6c-434e-bdb6-99bbfce60ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:57.973671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db94cc-4d6c-434e-bdb6-99bbfce60ec5 admin admin] PATH_INFO: `/v3/projects/48bdddb8059441eb9cf4fdabd2bcdc5c/users/fb3fea054ac6422aabc1121da5c23bd2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.004593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db94cc-4d6c-434e-bdb6-99bbfce60ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bdddb8059441eb9cf4fdabd2bcdc5c, user_id=fb3fea054ac6422aabc1121da5c23bd2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:58.008007 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 908/1818] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:58.015762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db94cc-4d6c-434e-bdb6-99bbfce60ec5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:58.042761 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 911/1819] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:57 2022] PUT /identity/v3/projects/48bdddb8059441eb9cf4fdabd2bcdc5c/users/fb3fea054ac6422aabc1121da5c23bd2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:58.043189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2bd15-4cbb-46c8-98b9-eaa89e7b4808 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:58.066887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2bd15-4cbb-46c8-98b9-eaa89e7b4808 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:58.291927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690b73b-756e-4aa1-afa6-2dbde746ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:58.293468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b73b-756e-4aa1-afa6-2dbde746ab63 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.294060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b73b-756e-4aa1-afa6-2dbde746ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.294728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b73b-756e-4aa1-afa6-2dbde746ab63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.296030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690b73b-756e-4aa1-afa6-2dbde746ab63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:58.299124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690b73b-756e-4aa1-afa6-2dbde746ab63 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:58.324053 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 909/1820] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:44:58.327865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db94cc-4d6c-434e-bdb6-99bbfce60ec5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:58.353581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db94cc-4d6c-434e-bdb6-99bbfce60ec5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:58.372986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5016c7-5363-4d37-a3ba-d1807f6eb475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:58.374587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5016c7-5363-4d37-a3ba-d1807f6eb475 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.375648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5016c7-5363-4d37-a3ba-d1807f6eb475 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.376050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5016c7-5363-4d37-a3ba-d1807f6eb475 admin admin] PATH_INFO: `/v3/projects/48bdddb8059441eb9cf4fdabd2bcdc5c/users/fb3fea054ac6422aabc1121da5c23bd2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.378536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5016c7-5363-4d37-a3ba-d1807f6eb475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bdddb8059441eb9cf4fdabd2bcdc5c, user_id=fb3fea054ac6422aabc1121da5c23bd2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:58.382719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5016c7-5363-4d37-a3ba-d1807f6eb475 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:58.397965 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 912/1821] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:44:58 2022] PUT /identity/v3/projects/48bdddb8059441eb9cf4fdabd2bcdc5c/users/fb3fea054ac6422aabc1121da5c23bd2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:44:58.410005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24303b9-3ecd-4b57-b3dd-72a4ae7d7097 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.410005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24303b9-3ecd-4b57-b3dd-72a4ae7d7097 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.410428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24303b9-3ecd-4b57-b3dd-72a4ae7d7097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.492534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a24303b9-3ecd-4b57-b3dd-72a4ae7d7097 None None] MFA Rules not processed for user `fb3fea054ac6422aabc1121da5c23bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:58.494109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a24303b9-3ecd-4b57-b3dd-72a4ae7d7097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:58.652981 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 910/1822] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:58.759181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5016c7-5363-4d37-a3ba-d1807f6eb475 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:58.761629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7b5016c7-5363-4d37-a3ba-d1807f6eb475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:58.817466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24303b9-3ecd-4b57-b3dd-72a4ae7d7097 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:58.820311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a24303b9-3ecd-4b57-b3dd-72a4ae7d7097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:58.835055 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:58.938530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5016c7-5363-4d37-a3ba-d1807f6eb475 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:58.951070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:58.952012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.952497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.953076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] PATH_INFO: `/v3/projects/9203aaea5b84415b9b233cbda21c8a30` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.956993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9203aaea5b84415b9b233cbda21c8a30)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:58.957810 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:58.961334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:59.001292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24303b9-3ecd-4b57-b3dd-72a4ae7d7097 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:59.019659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931128f4-00c5-4a8b-aebd-24040916f280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:59.020409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931128f4-00c5-4a8b-aebd-24040916f280 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:59.022735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931128f4-00c5-4a8b-aebd-24040916f280 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:59.023128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931128f4-00c5-4a8b-aebd-24040916f280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:59.058298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931128f4-00c5-4a8b-aebd-24040916f280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:59.063388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931128f4-00c5-4a8b-aebd-24040916f280 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:59.092063 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 911/1823] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:59.094049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9203aaea5b84415b9b233cbda21c8a30', 'request_id': 'req-25dc77a9-1d27-4596-9c10-e21867fd9a47'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.097514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931128f4-00c5-4a8b-aebd-24040916f280 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:59.107359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9203aaea5b84415b9b233cbda21c8a30', 'request_id': 'req-25dc77a9-1d27-4596-9c10-e21867fd9a47'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.108921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-931128f4-00c5-4a8b-aebd-24040916f280 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:59.124407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9203aaea5b84415b9b233cbda21c8a30', 'request_id': 'req-25dc77a9-1d27-4596-9c10-e21867fd9a47'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.153712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] The token cache is being invalidate because project 9203aaea5b84415b9b233cbda21c8a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:59.154265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.155426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-25dc77a9-1d27-4596-9c10-e21867fd9a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.163129 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 913/1824] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:58 2022] DELETE /identity/v3/projects/9203aaea5b84415b9b233cbda21c8a30 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:59.167554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfb5e-0d27-4b31-bce2-4d1e463edc7d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:59.169167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931128f4-00c5-4a8b-aebd-24040916f280 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:59.172242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfb5e-0d27-4b31-bce2-4d1e463edc7d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:59.172536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfb5e-0d27-4b31-bce2-4d1e463edc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:59.226619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-72ebfb5e-0d27-4b31-bce2-4d1e463edc7d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:59.228430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-72ebfb5e-0d27-4b31-bce2-4d1e463edc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:59.330274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:59.333789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:59.334096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:59.334377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] PATH_INFO: `/v3/projects/854f65479c434cda8ea94436ed595abf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:59.343889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=854f65479c434cda8ea94436ed595abf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:59.346449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:59.414065 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 914/1825] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:59.421907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92584c9-7848-4b94-9b81-541e15db07c5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:59.422229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92584c9-7848-4b94-9b81-541e15db07c5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:59.422675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92584c9-7848-4b94-9b81-541e15db07c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:59.468317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d92584c9-7848-4b94-9b81-541e15db07c5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:59.471412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d92584c9-7848-4b94-9b81-541e15db07c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:59.532543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854f65479c434cda8ea94436ed595abf', 'request_id': 'req-7ef4def9-bcad-4e5f-874b-2058b496f9af'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.573229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854f65479c434cda8ea94436ed595abf', 'request_id': 'req-7ef4def9-bcad-4e5f-874b-2058b496f9af'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.595409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854f65479c434cda8ea94436ed595abf', 'request_id': 'req-7ef4def9-bcad-4e5f-874b-2058b496f9af'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.622981 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:59.638492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] The token cache is being invalidate because project 854f65479c434cda8ea94436ed595abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:59.638752 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 915/1826] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:59.641266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.642954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92584c9-7848-4b94-9b81-541e15db07c5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:59.644197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7ef4def9-bcad-4e5f-874b-2058b496f9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.649138 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 912/1827] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:59 2022] DELETE /identity/v3/projects/854f65479c434cda8ea94436ed595abf => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:59.656949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f205eb-78e2-48c4-ac22-be3b9f6ce3d3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:59.658962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f205eb-78e2-48c4-ac22-be3b9f6ce3d3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:59.660448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f205eb-78e2-48c4-ac22-be3b9f6ce3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:59.672193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92584c9-7848-4b94-9b81-541e15db07c5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:59.692024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:59.692756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:59.693685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:59.693685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:59.695900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:44:59.697326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:59.702831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:59.743006 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 916/1828] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:44:59.746246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-74f205eb-78e2-48c4-ac22-be3b9f6ce3d3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:59.748675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-74f205eb-78e2-48c4-ac22-be3b9f6ce3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:59.748849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:59.765641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:59.772974 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 913/1829] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:59.813939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7585-7369-40dc-82ce-414ec5c7eba5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:59.815988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7585-7369-40dc-82ce-414ec5c7eba5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:59.816725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7585-7369-40dc-82ce-414ec5c7eba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:59.835138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59c64a-3a33-4cd2-bcd4-8b5541e62751 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:59.845708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829633d8-0104-4239-a0ca-e0fac4e06420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:59.846556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829633d8-0104-4239-a0ca-e0fac4e06420 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:59.846841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829633d8-0104-4239-a0ca-e0fac4e06420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:59.847306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829633d8-0104-4239-a0ca-e0fac4e06420 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:59.848492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829633d8-0104-4239-a0ca-e0fac4e06420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:59.854667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829633d8-0104-4239-a0ca-e0fac4e06420 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:59.895487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-06cc7585-7369-40dc-82ce-414ec5c7eba5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:59.897484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-06cc7585-7369-40dc-82ce-414ec5c7eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:59.925427 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 914/1830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:59.926384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc7585-7369-40dc-82ce-414ec5c7eba5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:59.927864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-06cc7585-7369-40dc-82ce-414ec5c7eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:59.945973 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 917/1831] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:44:59 2022] POST /identity/v3/projects => generated 391 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:44:59.948758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc7585-7369-40dc-82ce-414ec5c7eba5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:59.955164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829633d8-0104-4239-a0ca-e0fac4e06420 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.044255 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:00.061062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.062470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.062941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.064757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] PATH_INFO: `/v3/users/8b9d2b20d75a4b4f8ebbc4e6ee0e9810` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.068065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9d2b20d75a4b4f8ebbc4e6ee0e9810)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.072083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.098197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829633d8-0104-4239-a0ca-e0fac4e06420 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:00.113883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79300c89-f07b-4515-911b-1ef07207d3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.114532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300c89-f07b-4515-911b-1ef07207d3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.114813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300c89-f07b-4515-911b-1ef07207d3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.115089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300c89-f07b-4515-911b-1ef07207d3b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.115762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79300c89-f07b-4515-911b-1ef07207d3b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:00.116258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79300c89-f07b-4515-911b-1ef07207d3b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.118094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79300c89-f07b-4515-911b-1ef07207d3b3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.152493 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 918/1832] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:00.153492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79300c89-f07b-4515-911b-1ef07207d3b3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.167927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79300c89-f07b-4515-911b-1ef07207d3b3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:00.173378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9d2b20d75a4b4f8ebbc4e6ee0e9810'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:00.174555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01640f1b-5077-4a93-ba31-cc1add29a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.175015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01640f1b-5077-4a93-ba31-cc1add29a3ba admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.175296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01640f1b-5077-4a93-ba31-cc1add29a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.175571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01640f1b-5077-4a93-ba31-cc1add29a3ba admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.176217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01640f1b-5077-4a93-ba31-cc1add29a3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.186095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01640f1b-5077-4a93-ba31-cc1add29a3ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.205170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9d2b20d75a4b4f8ebbc4e6ee0e9810'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:00.220928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9d2b20d75a4b4f8ebbc4e6ee0e9810'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:00.234618 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 919/1833] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:00 2022] POST /identity/v3/users => generated 296 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:00.235746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01640f1b-5077-4a93-ba31-cc1add29a3ba admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.239320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9d2b20d75a4b4f8ebbc4e6ee0e9810'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:00.240870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9d2b20d75a4b4f8ebbc4e6ee0e9810'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:00.251930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01640f1b-5077-4a93-ba31-cc1add29a3ba admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:00.258591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefddc1a-c1ad-4223-ab69-0b2543b77e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.259827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefddc1a-c1ad-4223-ab69-0b2543b77e45 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.260113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefddc1a-c1ad-4223-ab69-0b2543b77e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.260531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefddc1a-c1ad-4223-ab69-0b2543b77e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.261214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefddc1a-c1ad-4223-ab69-0b2543b77e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.261963 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 915/1834] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:59 2022] DELETE /identity/v3/users/8b9d2b20d75a4b4f8ebbc4e6ee0e9810 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:00.263196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefddc1a-c1ad-4223-ab69-0b2543b77e45 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.264393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.266750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:00.311275 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 920/1835] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:00 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:00.315666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4f74-b379-4984-993f-8d1571e471b3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.316073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4f74-b379-4984-993f-8d1571e471b3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.316409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4f74-b379-4984-993f-8d1571e471b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.343051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a66d4f74-b379-4984-993f-8d1571e471b3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:00.344325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a66d4f74-b379-4984-993f-8d1571e471b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:00.415074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73677b7e-1766-4a31-a1e5-fe3c7e72c67b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:00.572084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d68f-6d21-457b-944e-f5799cb2e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.572886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d68f-6d21-457b-944e-f5799cb2e926 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.573201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d68f-6d21-457b-944e-f5799cb2e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.573480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d68f-6d21-457b-944e-f5799cb2e926 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.574139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d68f-6d21-457b-944e-f5799cb2e926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.576347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d68f-6d21-457b-944e-f5799cb2e926 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.599327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 921/1836] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:00.602286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4f74-b379-4984-993f-8d1571e471b3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.606982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a66d4f74-b379-4984-993f-8d1571e471b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:00.614867 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 916/1837] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:00.616034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d68f-6d21-457b-944e-f5799cb2e926 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.620245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3267d68f-6d21-457b-944e-f5799cb2e926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:00.635986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4f74-b379-4984-993f-8d1571e471b3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:00.648801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdc2b9-2fc2-49cd-a59e-2b27cbcff7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.649963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdc2b9-2fc2-49cd-a59e-2b27cbcff7dc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.651116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdc2b9-2fc2-49cd-a59e-2b27cbcff7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.652009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdc2b9-2fc2-49cd-a59e-2b27cbcff7dc admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.653288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdc2b9-2fc2-49cd-a59e-2b27cbcff7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.658492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdc2b9-2fc2-49cd-a59e-2b27cbcff7dc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.680595 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:00.697538 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:00.730859 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 922/1838] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:00 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:00.731439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdc2b9-2fc2-49cd-a59e-2b27cbcff7dc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.773490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdc2b9-2fc2-49cd-a59e-2b27cbcff7dc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:00.795237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fd975-f946-4b3e-a63f-9fad5c96c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.797455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fd975-f946-4b3e-a63f-9fad5c96c887 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.799025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fd975-f946-4b3e-a63f-9fad5c96c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.799644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fd975-f946-4b3e-a63f-9fad5c96c887 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.802319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fd975-f946-4b3e-a63f-9fad5c96c887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.807473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fd975-f946-4b3e-a63f-9fad5c96c887 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.818996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d68f-6d21-457b-944e-f5799cb2e926 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:00.826642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96aff9-0593-4805-87f6-23162c608b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.827737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96aff9-0593-4805-87f6-23162c608b16 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.828260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96aff9-0593-4805-87f6-23162c608b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.828852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96aff9-0593-4805-87f6-23162c608b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.861116 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 923/1839] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:00.863272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fd975-f946-4b3e-a63f-9fad5c96c887 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.872874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96aff9-0593-4805-87f6-23162c608b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.877496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96aff9-0593-4805-87f6-23162c608b16 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.882725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fd975-f946-4b3e-a63f-9fad5c96c887 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:00.891668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63ad43-45d4-4a60-8704-065ce7a471a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.892928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63ad43-45d4-4a60-8704-065ce7a471a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.893356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63ad43-45d4-4a60-8704-065ce7a471a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.897194 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 917/1840] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:00.898380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96aff9-0593-4805-87f6-23162c608b16 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.905716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63ad43-45d4-4a60-8704-065ce7a471a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.906982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63ad43-45d4-4a60-8704-065ce7a471a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.910358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96aff9-0593-4805-87f6-23162c608b16 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:00.914992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63ad43-45d4-4a60-8704-065ce7a471a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.915489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc1695-c2c8-4195-a3ef-9b54a25ac949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:00.916178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc1695-c2c8-4195-a3ef-9b54a25ac949 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.916709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc1695-c2c8-4195-a3ef-9b54a25ac949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.917176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc1695-c2c8-4195-a3ef-9b54a25ac949 admin admin] PATH_INFO: `/v3/projects/c5b69c18338643abba49d008af53c18e/users/2f399df50fd34de3b8d9c69d8461fc13/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:00.945398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc1695-c2c8-4195-a3ef-9b54a25ac949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b69c18338643abba49d008af53c18e, user_id=2f399df50fd34de3b8d9c69d8461fc13, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:00.949020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc1695-c2c8-4195-a3ef-9b54a25ac949 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:00.958201 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 924/1841] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:00.965581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63ad43-45d4-4a60-8704-065ce7a471a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:00.968920 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 918/1842] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:00 2022] PUT /identity/v3/projects/c5b69c18338643abba49d008af53c18e/users/2f399df50fd34de3b8d9c69d8461fc13/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:00.982584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f9c01-22d8-433e-ac9f-2d65fa075de6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:00.982944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f9c01-22d8-433e-ac9f-2d65fa075de6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:00.983275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f9c01-22d8-433e-ac9f-2d65fa075de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.030293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63ad43-45d4-4a60-8704-065ce7a471a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:01.052661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3a9f9c01-22d8-433e-ac9f-2d65fa075de6 None None] MFA Rules not processed for user `2f399df50fd34de3b8d9c69d8461fc13`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:01.052661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3a9f9c01-22d8-433e-ac9f-2d65fa075de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:01.163374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d6661-a58f-4f64-8ca9-1a2119ba7bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:01.164053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d6661-a58f-4f64-8ca9-1a2119ba7bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.164326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d6661-a58f-4f64-8ca9-1a2119ba7bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.164742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d6661-a58f-4f64-8ca9-1a2119ba7bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.165750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d6661-a58f-4f64-8ca9-1a2119ba7bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:01.169109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d6661-a58f-4f64-8ca9-1a2119ba7bd2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:01.191850 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 925/1843] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:01.192251 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 919/1844] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:01.193387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d6661-a58f-4f64-8ca9-1a2119ba7bd2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:01.193590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f9c01-22d8-433e-ac9f-2d65fa075de6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:01.210629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d6661-a58f-4f64-8ca9-1a2119ba7bd2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:01.216691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f9c01-22d8-433e-ac9f-2d65fa075de6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:01.227820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebff560-526f-4ff6-9533-bd2da83534d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:01.229255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebff560-526f-4ff6-9533-bd2da83534d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.229727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebff560-526f-4ff6-9533-bd2da83534d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.230656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebff560-526f-4ff6-9533-bd2da83534d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.231959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebff560-526f-4ff6-9533-bd2da83534d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:01.234767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989eb30-9031-4367-85ec-19d2816e3c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:01.235467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989eb30-9031-4367-85ec-19d2816e3c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.235839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989eb30-9031-4367-85ec-19d2816e3c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.236123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989eb30-9031-4367-85ec-19d2816e3c45 admin admin] PATH_INFO: `/v3/projects/d58f1270fa1b4852879254371b4aee1c/users/6a75ef8924b743d893971f4b20b7738b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.238195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebff560-526f-4ff6-9533-bd2da83534d5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:01.273469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989eb30-9031-4367-85ec-19d2816e3c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58f1270fa1b4852879254371b4aee1c, user_id=6a75ef8924b743d893971f4b20b7738b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:01.277324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989eb30-9031-4367-85ec-19d2816e3c45 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:01.296785 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 926/1845] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:01 2022] PUT /identity/v3/projects/d58f1270fa1b4852879254371b4aee1c/users/6a75ef8924b743d893971f4b20b7738b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:01.314389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb6530-da40-4a45-8c5e-7cf8be79bf66 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.314765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb6530-da40-4a45-8c5e-7cf8be79bf66 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.315128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb6530-da40-4a45-8c5e-7cf8be79bf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.329274 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 920/1846] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:01 2022] POST /identity/v3/projects => generated 391 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:01.330374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebff560-526f-4ff6-9533-bd2da83534d5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:01.356344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-68fb6530-da40-4a45-8c5e-7cf8be79bf66 None None] MFA Rules not processed for user `6a75ef8924b743d893971f4b20b7738b`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:01.358062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-68fb6530-da40-4a45-8c5e-7cf8be79bf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:01.416313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebff560-526f-4ff6-9533-bd2da83534d5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:01.422540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805acc31-0038-4ae2-ad60-e77e828135b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:01.423374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acc31-0038-4ae2-ad60-e77e828135b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.423728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acc31-0038-4ae2-ad60-e77e828135b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.424072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acc31-0038-4ae2-ad60-e77e828135b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.425744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805acc31-0038-4ae2-ad60-e77e828135b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:01.427877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805acc31-0038-4ae2-ad60-e77e828135b4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:01.442546 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:01.485305 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 921/1847] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:01 2022] POST /identity/v3/users => generated 302 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:01.486643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805acc31-0038-4ae2-ad60-e77e828135b4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:01.501732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805acc31-0038-4ae2-ad60-e77e828135b4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:01.507710 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 927/1848] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:01.508604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d50009-d2a8-4ee9-b003-87562e6cec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:01.510114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d50009-d2a8-4ee9-b003-87562e6cec7d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.510637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d50009-d2a8-4ee9-b003-87562e6cec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.511074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d50009-d2a8-4ee9-b003-87562e6cec7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.511935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d50009-d2a8-4ee9-b003-87562e6cec7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:01.513989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d50009-d2a8-4ee9-b003-87562e6cec7d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:01.514611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb6530-da40-4a45-8c5e-7cf8be79bf66 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:01.546877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb6530-da40-4a45-8c5e-7cf8be79bf66 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:01.552648 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 922/1849] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:01.554160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d50009-d2a8-4ee9-b003-87562e6cec7d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:01.563725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52b8e3-d6c2-43c1-837b-53ee7e4e26ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:01.564537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52b8e3-d6c2-43c1-837b-53ee7e4e26ba admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.565762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52b8e3-d6c2-43c1-837b-53ee7e4e26ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.566236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52b8e3-d6c2-43c1-837b-53ee7e4e26ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.567007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52b8e3-d6c2-43c1-837b-53ee7e4e26ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:01.569189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d50009-d2a8-4ee9-b003-87562e6cec7d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:01.573848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52b8e3-d6c2-43c1-837b-53ee7e4e26ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:01.576008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a302-c5fc-42b1-b4bd-abbfeb60d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:01.576818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a302-c5fc-42b1-b4bd-abbfeb60d238 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.577102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a302-c5fc-42b1-b4bd-abbfeb60d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.577380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a302-c5fc-42b1-b4bd-abbfeb60d238 admin admin] PATH_INFO: `/v3/projects/40a4d63f1fad438bb90a4c6e94aacd3e/users/979e77a796e24cdc88af45b7c9a37428/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.636426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20a302-c5fc-42b1-b4bd-abbfeb60d238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a4d63f1fad438bb90a4c6e94aacd3e, user_id=979e77a796e24cdc88af45b7c9a37428, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:01.642533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20a302-c5fc-42b1-b4bd-abbfeb60d238 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:01.666253 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 928/1850] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:01 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:01.673345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52b8e3-d6c2-43c1-837b-53ee7e4e26ba admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:01.682659 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 923/1851] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:01 2022] PUT /identity/v3/projects/40a4d63f1fad438bb90a4c6e94aacd3e/users/979e77a796e24cdc88af45b7c9a37428/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:01.687843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a302-c5fc-42b1-b4bd-abbfeb60d238 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:01.749782 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:01.874801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52b8e3-d6c2-43c1-837b-53ee7e4e26ba admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:01.894635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3e9cf-3ffb-4796-9456-c56d99ef7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:01.895596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3e9cf-3ffb-4796-9456-c56d99ef7190 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.895873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3e9cf-3ffb-4796-9456-c56d99ef7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.896175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3e9cf-3ffb-4796-9456-c56d99ef7190 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.896839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3e9cf-3ffb-4796-9456-c56d99ef7190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:01.900264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3e9cf-3ffb-4796-9456-c56d99ef7190 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:01.942331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a302-c5fc-42b1-b4bd-abbfeb60d238 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:01.964137 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 929/1852] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:01 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:01.965053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb3bec-ea8b-4345-a1c1-809471283ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:01.965774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3e9cf-3ffb-4796-9456-c56d99ef7190 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:01.966338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb3bec-ea8b-4345-a1c1-809471283ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:01.966935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb3bec-ea8b-4345-a1c1-809471283ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:01.967500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb3bec-ea8b-4345-a1c1-809471283ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:01.968798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb3bec-ea8b-4345-a1c1-809471283ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:01.972135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb3bec-ea8b-4345-a1c1-809471283ec4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:01.990935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3e9cf-3ffb-4796-9456-c56d99ef7190 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:02.003799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8412900-519b-43c5-ac21-477d9282d12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:02.004443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412900-519b-43c5-ac21-477d9282d12d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.004766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412900-519b-43c5-ac21-477d9282d12d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.005034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412900-519b-43c5-ac21-477d9282d12d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.006103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8412900-519b-43c5-ac21-477d9282d12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:02.006291 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 924/1853] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:02.007661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8412900-519b-43c5-ac21-477d9282d12d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:02.008465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb3bec-ea8b-4345-a1c1-809471283ec4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:02.025456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb3bec-ea8b-4345-a1c1-809471283ec4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:02.030567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fa899-3cb8-4c9d-acd9-8c4c5ba83cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:02.031421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa899-3cb8-4c9d-acd9-8c4c5ba83cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.031808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa899-3cb8-4c9d-acd9-8c4c5ba83cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.032191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa899-3cb8-4c9d-acd9-8c4c5ba83cf0 admin admin] PATH_INFO: `/v3/projects/40a4d63f1fad438bb90a4c6e94aacd3e/users/979e77a796e24cdc88af45b7c9a37428/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.034515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fa899-3cb8-4c9d-acd9-8c4c5ba83cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a4d63f1fad438bb90a4c6e94aacd3e, user_id=979e77a796e24cdc88af45b7c9a37428, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:02.037547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fa899-3cb8-4c9d-acd9-8c4c5ba83cf0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:02.042526 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 930/1854] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:02.053029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8412900-519b-43c5-ac21-477d9282d12d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:02.062762 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 925/1855] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:02 2022] PUT /identity/v3/projects/40a4d63f1fad438bb90a4c6e94aacd3e/users/979e77a796e24cdc88af45b7c9a37428/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:02.082508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca2e5d-2428-47bd-b1ca-b2baf7f50bd3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.082937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca2e5d-2428-47bd-b1ca-b2baf7f50bd3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.083311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca2e5d-2428-47bd-b1ca-b2baf7f50bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.107889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8412900-519b-43c5-ac21-477d9282d12d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:02.137799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b6ca2e5d-2428-47bd-b1ca-b2baf7f50bd3 None None] MFA Rules not processed for user `979e77a796e24cdc88af45b7c9a37428`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:02.139282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b6ca2e5d-2428-47bd-b1ca-b2baf7f50bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:02.293083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fe57e-e3db-4883-aea3-26f744c99989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:02.294911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe57e-e3db-4883-aea3-26f744c99989 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.295155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe57e-e3db-4883-aea3-26f744c99989 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.295654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe57e-e3db-4883-aea3-26f744c99989 admin admin] PATH_INFO: `/v3/projects/0d730dde723748618f222965f83c455e/users/368d640b1b8a4b45b68316d0e8c29a5f/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.319137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fe57e-e3db-4883-aea3-26f744c99989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d730dde723748618f222965f83c455e, user_id=368d640b1b8a4b45b68316d0e8c29a5f, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:02.322455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fe57e-e3db-4883-aea3-26f744c99989 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:02.339098 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 926/1856] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:02.339098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca2e5d-2428-47bd-b1ca-b2baf7f50bd3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:02.344409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b6ca2e5d-2428-47bd-b1ca-b2baf7f50bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:02.352474 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 931/1857] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:02 2022] PUT /identity/v3/projects/0d730dde723748618f222965f83c455e/users/368d640b1b8a4b45b68316d0e8c29a5f/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:02.365171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a1ac-2d0c-4a7c-9e33-0b11b9d2a6ca None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.365171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a1ac-2d0c-4a7c-9e33-0b11b9d2a6ca None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.365171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a1ac-2d0c-4a7c-9e33-0b11b9d2a6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.380445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca2e5d-2428-47bd-b1ca-b2baf7f50bd3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:02.389911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-db60a1ac-2d0c-4a7c-9e33-0b11b9d2a6ca None None] MFA Rules not processed for user `2f399df50fd34de3b8d9c69d8461fc13`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:02.391828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-db60a1ac-2d0c-4a7c-9e33-0b11b9d2a6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:02.439039 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:02.502435 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 932/1858] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:02.503957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60a1ac-2d0c-4a7c-9e33-0b11b9d2a6ca None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:02.512738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:02.515120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.515887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.516575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] PATH_INFO: `/v3/projects/95e962592ce1403bbe43ac8dcb767a53` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.520397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e962592ce1403bbe43ac8dcb767a53)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:02.522993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:02.523196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60a1ac-2d0c-4a7c-9e33-0b11b9d2a6ca None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:02.531773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82451-6936-4c93-b33a-5613c9b5a9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:02.532659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82451-6936-4c93-b33a-5613c9b5a9ee admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.532997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82451-6936-4c93-b33a-5613c9b5a9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.533845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82451-6936-4c93-b33a-5613c9b5a9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.535375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e82451-6936-4c93-b33a-5613c9b5a9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:02.537533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e82451-6936-4c93-b33a-5613c9b5a9ee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:02.554358 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 933/1859] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:02.555336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82451-6936-4c93-b33a-5613c9b5a9ee admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:02.559114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b9e82451-6936-4c93-b33a-5613c9b5a9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:02.576647 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:02.625382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e962592ce1403bbe43ac8dcb767a53', 'request_id': 'req-03ccf87d-3102-4a44-8771-f8f125e5e948'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:02.643768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e962592ce1403bbe43ac8dcb767a53', 'request_id': 'req-03ccf87d-3102-4a44-8771-f8f125e5e948'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:02.655276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82451-6936-4c93-b33a-5613c9b5a9ee admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:02.656736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e962592ce1403bbe43ac8dcb767a53', 'request_id': 'req-03ccf87d-3102-4a44-8771-f8f125e5e948'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:02.679095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] The token cache is being invalidate because project 95e962592ce1403bbe43ac8dcb767a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:02.682645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:02.683566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:02.689802 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 927/1860] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:02 2022] DELETE /identity/v3/projects/95e962592ce1403bbe43ac8dcb767a53 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:02.689802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:02.690355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:02.814734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524a6fd-13a6-4d1a-af27-db668b59d53d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:02.815365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a6fd-13a6-4d1a-af27-db668b59d53d service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.815642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a6fd-13a6-4d1a-af27-db668b59d53d service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.815906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a6fd-13a6-4d1a-af27-db668b59d53d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.819805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf87d-3102-4a44-8771-f8f125e5e948 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:02.820198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a524a6fd-13a6-4d1a-af27-db668b59d53d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:02.827165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5d98-bd89-4e97-aaba-325b64e8f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:02.827999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5d98-bd89-4e97-aaba-325b64e8f290 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.828372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5d98-bd89-4e97-aaba-325b64e8f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.828561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5d98-bd89-4e97-aaba-325b64e8f290 admin admin] PATH_INFO: `/v3/projects/0d730dde723748618f222965f83c455e/users/368d640b1b8a4b45b68316d0e8c29a5f/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.831691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce5d98-bd89-4e97-aaba-325b64e8f290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d730dde723748618f222965f83c455e, user_id=368d640b1b8a4b45b68316d0e8c29a5f, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:02.835228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce5d98-bd89-4e97-aaba-325b64e8f290 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:02.849951 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 928/1861] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:02 2022] PUT /identity/v3/projects/0d730dde723748618f222965f83c455e/users/368d640b1b8a4b45b68316d0e8c29a5f/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:02.861314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5d98-bd89-4e97-aaba-325b64e8f290 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:02.864747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c2ce5d98-bd89-4e97-aaba-325b64e8f290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:02.938094 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:02.949577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524a6fd-13a6-4d1a-af27-db668b59d53d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:02.952058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524a6fd-13a6-4d1a-af27-db668b59d53d service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:02.956517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5d98-bd89-4e97-aaba-325b64e8f290 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:02.967386 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 934/1862] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:02.969496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06998e29-69d5-4f49-9334-68ba4eb5b68d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.969786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06998e29-69d5-4f49-9334-68ba4eb5b68d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.970067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06998e29-69d5-4f49-9334-68ba4eb5b68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.985970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:02.987849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:02.992228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:02.993767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] PATH_INFO: `/v3/users/fb3fea054ac6422aabc1121da5c23bd2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:02.995953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3fea054ac6422aabc1121da5c23bd2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:02.998131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:03.003955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-06998e29-69d5-4f49-9334-68ba4eb5b68d None None] MFA Rules not processed for user `368d640b1b8a4b45b68316d0e8c29a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:03.005253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-06998e29-69d5-4f49-9334-68ba4eb5b68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.090923 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:03.150876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3fea054ac6422aabc1121da5c23bd2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:03.155158 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 935/1863] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:03.169818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3fea054ac6422aabc1121da5c23bd2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:03.182828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3fea054ac6422aabc1121da5c23bd2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:03.195352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3fea054ac6422aabc1121da5c23bd2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:03.196354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3fea054ac6422aabc1121da5c23bd2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:03.219050 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 929/1864] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:02 2022] DELETE /identity/v3/users/fb3fea054ac6422aabc1121da5c23bd2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:03.269419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06998e29-69d5-4f49-9334-68ba4eb5b68d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:03.271435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-06998e29-69d5-4f49-9334-68ba4eb5b68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.422397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06998e29-69d5-4f49-9334-68ba4eb5b68d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:03.580314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:03.581290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:03.581838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:03.582458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:03.586084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.732739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:03.736434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:03.747456 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 936/1865] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:45:03.843942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:03.847002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.894266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:03.895821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.915554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa5df-1a88-4f33-ab10-32439b5e3e81 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:03.921944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d9b89-5af2-476f-b08a-004e113fc31c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:03.922572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d9b89-5af2-476f-b08a-004e113fc31c service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:03.922850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d9b89-5af2-476f-b08a-004e113fc31c service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:03.923121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d9b89-5af2-476f-b08a-004e113fc31c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:03.924960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1a7d9b89-5af2-476f-b08a-004e113fc31c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:03.950823 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:04.073502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d9b89-5af2-476f-b08a-004e113fc31c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:04.076178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d9b89-5af2-476f-b08a-004e113fc31c service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:04.101549 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 930/1866] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:04.129212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ede1a-704c-4452-99db-166d13dfca40 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:04.137027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:04.137696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:04.137980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:04.138264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] PATH_INFO: `/v3/projects/48bdddb8059441eb9cf4fdabd2bcdc5c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:04.145553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48bdddb8059441eb9cf4fdabd2bcdc5c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:04.147704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:04.251809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bdddb8059441eb9cf4fdabd2bcdc5c', 'request_id': 'req-c9fb9969-c741-44a3-84f5-491f060270a8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:04.293188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bdddb8059441eb9cf4fdabd2bcdc5c', 'request_id': 'req-c9fb9969-c741-44a3-84f5-491f060270a8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:04.306542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bdddb8059441eb9cf4fdabd2bcdc5c', 'request_id': 'req-c9fb9969-c741-44a3-84f5-491f060270a8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:04.330297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] The token cache is being invalidate because project 48bdddb8059441eb9cf4fdabd2bcdc5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:04.331346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:04.334173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c9fb9969-c741-44a3-84f5-491f060270a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:04.336458 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 937/1867] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:03 2022] DELETE /identity/v3/projects/48bdddb8059441eb9cf4fdabd2bcdc5c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:04.346335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269242e-3f27-4029-91ad-a8dd84cd98a4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:04.346766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269242e-3f27-4029-91ad-a8dd84cd98a4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:04.347269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269242e-3f27-4029-91ad-a8dd84cd98a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:04.382948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3269242e-3f27-4029-91ad-a8dd84cd98a4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:04.387009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3269242e-3f27-4029-91ad-a8dd84cd98a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:04.584175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc75eeb-8c6e-4d2a-98f0-7b1b0a2d0eb3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:04.584530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc75eeb-8c6e-4d2a-98f0-7b1b0a2d0eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:04.584872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc75eeb-8c6e-4d2a-98f0-7b1b0a2d0eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:04.585039 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 931/1868] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:04.629402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3dc75eeb-8c6e-4d2a-98f0-7b1b0a2d0eb3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:04.636697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3dc75eeb-8c6e-4d2a-98f0-7b1b0a2d0eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:04.661378 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 938/1869] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:04.667766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269242e-3f27-4029-91ad-a8dd84cd98a4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:04.694206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269242e-3f27-4029-91ad-a8dd84cd98a4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:04.708828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418e05-c1dc-40d5-9caf-8c58f4089b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:04.710579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418e05-c1dc-40d5-9caf-8c58f4089b32 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:04.710579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418e05-c1dc-40d5-9caf-8c58f4089b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:04.711756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418e05-c1dc-40d5-9caf-8c58f4089b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:04.712924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418e05-c1dc-40d5-9caf-8c58f4089b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:04.715275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418e05-c1dc-40d5-9caf-8c58f4089b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:04.717305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418e05-c1dc-40d5-9caf-8c58f4089b32 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:04.731425 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:04.753487 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 932/1870] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:04.758247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc75eeb-8c6e-4d2a-98f0-7b1b0a2d0eb3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:04.776390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc75eeb-8c6e-4d2a-98f0-7b1b0a2d0eb3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:04.788721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7349-eaff-4dff-9fac-95be326d2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:04.790513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7349-eaff-4dff-9fac-95be326d2c57 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:04.797665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7349-eaff-4dff-9fac-95be326d2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:04.799227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7349-eaff-4dff-9fac-95be326d2c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:04.802754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e7349-eaff-4dff-9fac-95be326d2c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:04.813351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e7349-eaff-4dff-9fac-95be326d2c57 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:04.893280 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 939/1871] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:04 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:04.893509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418e05-c1dc-40d5-9caf-8c58f4089b32 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:04.908932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418e05-c1dc-40d5-9caf-8c58f4089b32 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:04.949987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7349-eaff-4dff-9fac-95be326d2c57 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:04.952984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-297e7349-eaff-4dff-9fac-95be326d2c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:05.101501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7349-eaff-4dff-9fac-95be326d2c57 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:05.121990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:05.122697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.123101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.123373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] PATH_INFO: `/v3/users/6a75ef8924b743d893971f4b20b7738b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.128724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a75ef8924b743d893971f4b20b7738b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:05.133240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:05.156236 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:05.173152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41a82-4506-420e-89c9-4de1d26d80a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:05.174418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41a82-4506-420e-89c9-4de1d26d80a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.175387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41a82-4506-420e-89c9-4de1d26d80a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.175816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41a82-4506-420e-89c9-4de1d26d80a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.177038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41a82-4506-420e-89c9-4de1d26d80a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:05.181346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41a82-4506-420e-89c9-4de1d26d80a2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:05.233269 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 933/1872] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:04 2022] POST /identity/v3/users => generated 288 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:45:05.236793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41a82-4506-420e-89c9-4de1d26d80a2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:05.262829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41a82-4506-420e-89c9-4de1d26d80a2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:05.273854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902eaef-5473-4344-a097-d0a0cffb0e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:05.276381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902eaef-5473-4344-a097-d0a0cffb0e22 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.277032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902eaef-5473-4344-a097-d0a0cffb0e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.277488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902eaef-5473-4344-a097-d0a0cffb0e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.278458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902eaef-5473-4344-a097-d0a0cffb0e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:05.281388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902eaef-5473-4344-a097-d0a0cffb0e22 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:05.311438 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 934/1873] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:05.314439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902eaef-5473-4344-a097-d0a0cffb0e22 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:05.327149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a75ef8924b743d893971f4b20b7738b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:05.331579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902eaef-5473-4344-a097-d0a0cffb0e22 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:05.340434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cba703-d051-4b91-b3a6-0670503c0abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:05.340434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cba703-d051-4b91-b3a6-0670503c0abd admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.340434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cba703-d051-4b91-b3a6-0670503c0abd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.340864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cba703-d051-4b91-b3a6-0670503c0abd admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.342444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cba703-d051-4b91-b3a6-0670503c0abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:05.353505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cba703-d051-4b91-b3a6-0670503c0abd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:05.371676 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 935/1874] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:05.373322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cba703-d051-4b91-b3a6-0670503c0abd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:05.382898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a75ef8924b743d893971f4b20b7738b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:05.386271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cba703-d051-4b91-b3a6-0670503c0abd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:05.392536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8b6fc-a82c-4911-8f2f-92184e9895d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:05.393327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8b6fc-a82c-4911-8f2f-92184e9895d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.393605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8b6fc-a82c-4911-8f2f-92184e9895d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.393886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8b6fc-a82c-4911-8f2f-92184e9895d9 admin admin] PATH_INFO: `/v3/projects/21012f35c9a6466a8e2f939519a2c6f2/users/854a03060a8b4f3a8aaa75b09fb57baa/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.404900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a75ef8924b743d893971f4b20b7738b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:05.426011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a75ef8924b743d893971f4b20b7738b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:05.426218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8b6fc-a82c-4911-8f2f-92184e9895d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21012f35c9a6466a8e2f939519a2c6f2, user_id=854a03060a8b4f3a8aaa75b09fb57baa, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:05.427243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ec8e2e6-6baf-42f0-afa2-dffe735315e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a75ef8924b743d893971f4b20b7738b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:05.433681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8b6fc-a82c-4911-8f2f-92184e9895d9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:05.444773 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 940/1875] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:04 2022] DELETE /identity/v3/users/6a75ef8924b743d893971f4b20b7738b => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:05.452289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a942415-2cf2-414e-b0d3-b5b3fb22bd32 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.453496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a942415-2cf2-414e-b0d3-b5b3fb22bd32 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.454238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a942415-2cf2-414e-b0d3-b5b3fb22bd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.465006 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 936/1876] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:05 2022] PUT /identity/v3/projects/21012f35c9a6466a8e2f939519a2c6f2/users/854a03060a8b4f3a8aaa75b09fb57baa/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:05.480488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af3bb-391e-423c-b928-61d4724cfc02 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.480848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af3bb-391e-423c-b928-61d4724cfc02 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.481070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af3bb-391e-423c-b928-61d4724cfc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.513505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6a942415-2cf2-414e-b0d3-b5b3fb22bd32 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:05.517726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6a942415-2cf2-414e-b0d3-b5b3fb22bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:05.544145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0f0af3bb-391e-423c-b928-61d4724cfc02 None None] MFA Rules not processed for user `854a03060a8b4f3a8aaa75b09fb57baa`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:05.545669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0f0af3bb-391e-423c-b928-61d4724cfc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:05.638958 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 941/1877] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:05.662369 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 937/1878] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:05.667782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a942415-2cf2-414e-b0d3-b5b3fb22bd32 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:05.670305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6a942415-2cf2-414e-b0d3-b5b3fb22bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:05.685712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a942415-2cf2-414e-b0d3-b5b3fb22bd32 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:05.692903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3d57-598c-40da-a03b-c9b30c8dfd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:05.693540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3d57-598c-40da-a03b-c9b30c8dfd24 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.693822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3d57-598c-40da-a03b-c9b30c8dfd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.694102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3d57-598c-40da-a03b-c9b30c8dfd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.695296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a3d57-598c-40da-a03b-c9b30c8dfd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:05.696866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a3d57-598c-40da-a03b-c9b30c8dfd24 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:05.707705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af3bb-391e-423c-b928-61d4724cfc02 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:05.711107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0f0af3bb-391e-423c-b928-61d4724cfc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:05.745736 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 942/1879] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:05 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:05.747313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3d57-598c-40da-a03b-c9b30c8dfd24 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:05.769753 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:05.814530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af3bb-391e-423c-b928-61d4724cfc02 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:05.901079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3d57-598c-40da-a03b-c9b30c8dfd24 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:05.911788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a276ac-b27a-46e6-ae96-a6662ce38d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:05.912532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a276ac-b27a-46e6-ae96-a6662ce38d47 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.913527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a276ac-b27a-46e6-ae96-a6662ce38d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.913813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a276ac-b27a-46e6-ae96-a6662ce38d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.924013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbc290-ea6e-4a3a-8e3c-c536bff39d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:05.925991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc290-ea6e-4a3a-8e3c-c536bff39d0f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:05.926279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc290-ea6e-4a3a-8e3c-c536bff39d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:05.926559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc290-ea6e-4a3a-8e3c-c536bff39d0f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:05.927726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a276ac-b27a-46e6-ae96-a6662ce38d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:05.929623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a276ac-b27a-46e6-ae96-a6662ce38d47 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:05.929992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbc290-ea6e-4a3a-8e3c-c536bff39d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:05.938224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbc290-ea6e-4a3a-8e3c-c536bff39d0f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:05.943538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 938/1880] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:45:05.963449 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:05.995231 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 943/1881] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:05 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:05.997034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a276ac-b27a-46e6-ae96-a6662ce38d47 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.016143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a276ac-b27a-46e6-ae96-a6662ce38d47 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:06.024344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb18dc-a696-46a6-afad-05cda135ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:06.025070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb18dc-a696-46a6-afad-05cda135ad10 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.025414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb18dc-a696-46a6-afad-05cda135ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.025700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb18dc-a696-46a6-afad-05cda135ad10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.026463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb18dc-a696-46a6-afad-05cda135ad10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:06.037419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb18dc-a696-46a6-afad-05cda135ad10 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:06.060810 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 939/1882] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:06.064599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbc290-ea6e-4a3a-8e3c-c536bff39d0f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.084707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbc290-ea6e-4a3a-8e3c-c536bff39d0f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:06.096062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fe2aa-307e-4b51-9455-4b98022cf95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:06.096956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fe2aa-307e-4b51-9455-4b98022cf95e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.097950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fe2aa-307e-4b51-9455-4b98022cf95e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.098245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fe2aa-307e-4b51-9455-4b98022cf95e admin admin] PATH_INFO: `/v3/projects/505208a1f04845f8bfe491c65b66cea2/users/0ff6c00ebcca45fbb0223c81820e7009/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.123878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fe2aa-307e-4b51-9455-4b98022cf95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=505208a1f04845f8bfe491c65b66cea2, user_id=0ff6c00ebcca45fbb0223c81820e7009, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:06.127855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fe2aa-307e-4b51-9455-4b98022cf95e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:06.175749 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 944/1883] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:06 2022] PUT /identity/v3/projects/505208a1f04845f8bfe491c65b66cea2/users/0ff6c00ebcca45fbb0223c81820e7009/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:06.179619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb18dc-a696-46a6-afad-05cda135ad10 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.192655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb18dc-a696-46a6-afad-05cda135ad10 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:06.290583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa13e5-5578-4386-b5f8-456655adb91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:06.291371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa13e5-5578-4386-b5f8-456655adb91c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.291657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa13e5-5578-4386-b5f8-456655adb91c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.291934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa13e5-5578-4386-b5f8-456655adb91c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.292586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa13e5-5578-4386-b5f8-456655adb91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:06.294564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa13e5-5578-4386-b5f8-456655adb91c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:06.318511 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 940/1884] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:06.328097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fe2aa-307e-4b51-9455-4b98022cf95e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.359954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fe2aa-307e-4b51-9455-4b98022cf95e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:06.365509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62e2e9-6795-4667-a017-371fb3cdb619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:06.366365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62e2e9-6795-4667-a017-371fb3cdb619 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.366499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62e2e9-6795-4667-a017-371fb3cdb619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.366759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62e2e9-6795-4667-a017-371fb3cdb619 admin admin] PATH_INFO: `/v3/projects/505208a1f04845f8bfe491c65b66cea2/users/0ff6c00ebcca45fbb0223c81820e7009/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.369883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62e2e9-6795-4667-a017-371fb3cdb619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=505208a1f04845f8bfe491c65b66cea2, user_id=0ff6c00ebcca45fbb0223c81820e7009, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:06.375159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62e2e9-6795-4667-a017-371fb3cdb619 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:06.403209 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 945/1885] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:06 2022] PUT /identity/v3/projects/505208a1f04845f8bfe491c65b66cea2/users/0ff6c00ebcca45fbb0223c81820e7009/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:06.420767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8747-ddd8-4842-b253-9ff808685fa1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.421463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8747-ddd8-4842-b253-9ff808685fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.423168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8747-ddd8-4842-b253-9ff808685fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.498604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-278c8747-ddd8-4842-b253-9ff808685fa1 None None] MFA Rules not processed for user `0ff6c00ebcca45fbb0223c81820e7009`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:06.500647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-278c8747-ddd8-4842-b253-9ff808685fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:06.636249 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:06.652135 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 941/1886] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:06.654765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62e2e9-6795-4667-a017-371fb3cdb619 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.655610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8747-ddd8-4842-b253-9ff808685fa1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.658145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2d62e2e9-6795-4667-a017-371fb3cdb619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:06.665934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8747-ddd8-4842-b253-9ff808685fa1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:06.707493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dd537-8e74-4a16-9c39-851bd5621919 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:06.708549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dd537-8e74-4a16-9c39-851bd5621919 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.709655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dd537-8e74-4a16-9c39-851bd5621919 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.710203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dd537-8e74-4a16-9c39-851bd5621919 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.711265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dd537-8e74-4a16-9c39-851bd5621919 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:06.711650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dd537-8e74-4a16-9c39-851bd5621919 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:06.716092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dd537-8e74-4a16-9c39-851bd5621919 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:06.737472 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 942/1887] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:06.743305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dd537-8e74-4a16-9c39-851bd5621919 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.755965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dd537-8e74-4a16-9c39-851bd5621919 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:06.762800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19104b70-b104-48eb-b3ef-11f938980c1c tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:06.764507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104b70-b104-48eb-b3ef-11f938980c1c tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.765045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104b70-b104-48eb-b3ef-11f938980c1c tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.765696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104b70-b104-48eb-b3ef-11f938980c1c tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.767847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19104b70-b104-48eb-b3ef-11f938980c1c tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:06.772550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19104b70-b104-48eb-b3ef-11f938980c1c tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:06.862888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62e2e9-6795-4667-a017-371fb3cdb619 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:06.870711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:06.871638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:06.872747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:06.873063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] PATH_INFO: `/v3/projects/d58f1270fa1b4852879254371b4aee1c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:06.874604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58f1270fa1b4852879254371b4aee1c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:06.877687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:06.878969 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 943/1888] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:06 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:06.885549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19104b70-b104-48eb-b3ef-11f938980c1c tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:06.980724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58f1270fa1b4852879254371b4aee1c', 'request_id': 'req-6f8811c8-0842-47e4-8b45-d9df788c47c6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.005177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58f1270fa1b4852879254371b4aee1c', 'request_id': 'req-6f8811c8-0842-47e4-8b45-d9df788c47c6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.017353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58f1270fa1b4852879254371b4aee1c', 'request_id': 'req-6f8811c8-0842-47e4-8b45-d9df788c47c6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.033838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19104b70-b104-48eb-b3ef-11f938980c1c tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.034317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] The token cache is being invalidate because project d58f1270fa1b4852879254371b4aee1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:07.034594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.035280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.036887 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 946/1889] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:06 2022] DELETE /identity/v3/projects/d58f1270fa1b4852879254371b4aee1c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:07.041391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.043091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:07.131091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.131846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.132199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.132547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.133415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:07.134389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.136242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.137923 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:07.157689 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 944/1890] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:07.189053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8811c8-0842-47e4-8b45-d9df788c47c6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.201140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.201820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.202107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.202390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] PATH_INFO: `/v3/users/368d640b1b8a4b45b68316d0e8c29a5f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.205302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=368d640b1b8a4b45b68316d0e8c29a5f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.208016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.234875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.238244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:07.316494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368d640b1b8a4b45b68316d0e8c29a5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.342864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368d640b1b8a4b45b68316d0e8c29a5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.354331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368d640b1b8a4b45b68316d0e8c29a5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.366456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368d640b1b8a4b45b68316d0e8c29a5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.367206 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:07.369095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f21b2c-0825-48b7-890a-bad6fdfade0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368d640b1b8a4b45b68316d0e8c29a5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:07.382097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eea8fc-46b7-4040-aa79-24e04949a28f tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.383163 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 947/1891] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:07 2022] DELETE /identity/v3/users/368d640b1b8a4b45b68316d0e8c29a5f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:07.496157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.497286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.497869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.498435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.501924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:07.613135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.615232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.628947 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 945/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:45:07.647546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89cb74-f562-4024-a965-ce42db42e030 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.647854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89cb74-f562-4024-a965-ce42db42e030 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.648106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89cb74-f562-4024-a965-ce42db42e030 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.650551 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 948/1893] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:45:07.659074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:45:07.661935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:07.679922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.691470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcb5d5-60cb-4617-8ec1-d551a1e44c69 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.700206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b31d0-6ea0-4f10-b656-0d7572eca955 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.700908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b31d0-6ea0-4f10-b656-0d7572eca955 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.701242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b31d0-6ea0-4f10-b656-0d7572eca955 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.701523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b31d0-6ea0-4f10-b656-0d7572eca955 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/projects/91f2d5cc332744da99f3f1ea042b88d0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.704356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b31d0-6ea0-4f10-b656-0d7572eca955 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:get_project(project_id=91f2d5cc332744da99f3f1ea042b88d0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.707193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b31d0-6ea0-4f10-b656-0d7572eca955 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.709445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 946/1894] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:45:07 2022] GET /identity/v3/projects/91f2d5cc332744da99f3f1ea042b88d0 => generated 369 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:07.836387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cf7e9-09d8-47cb-9879-c3683e5f1b94 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.837630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cf7e9-09d8-47cb-9879-c3683e5f1b94 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.838144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cf7e9-09d8-47cb-9879-c3683e5f1b94 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.840565 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 949/1895] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:45:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:45:07.846235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b31d0-6ea0-4f10-b656-0d7572eca955 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:45:07.863625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b31d0-6ea0-4f10-b656-0d7572eca955 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.876433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b31d0-6ea0-4f10-b656-0d7572eca955 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.881453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549069-bb05-48c7-992c-006f28254377 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.882107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549069-bb05-48c7-992c-006f28254377 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.882388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549069-bb05-48c7-992c-006f28254377 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.882666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549069-bb05-48c7-992c-006f28254377 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/projects/91f2d5cc332744da99f3f1ea042b88d0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.884404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f549069-bb05-48c7-992c-006f28254377 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:get_project(project_id=91f2d5cc332744da99f3f1ea042b88d0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.887234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f549069-bb05-48c7-992c-006f28254377 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:07.889398 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 947/1896] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:45:07 2022] GET /identity/v3/projects/91f2d5cc332744da99f3f1ea042b88d0 => generated 369 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:07.930121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cf7e9-09d8-47cb-9879-c3683e5f1b94 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.932971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9e9cf7e9-09d8-47cb-9879-c3683e5f1b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:07.947426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549069-bb05-48c7-992c-006f28254377 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:07.974040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549069-bb05-48c7-992c-006f28254377 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:07.981687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73ef14-29b0-4104-8e20-aa64e15c8dd9 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:07.982495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73ef14-29b0-4104-8e20-aa64e15c8dd9 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:07.983431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73ef14-29b0-4104-8e20-aa64e15c8dd9 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:07.983726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73ef14-29b0-4104-8e20-aa64e15c8dd9 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:07.984411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73ef14-29b0-4104-8e20-aa64e15c8dd9 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:07.984801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73ef14-29b0-4104-8e20-aa64e15c8dd9 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:07.987648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73ef14-29b0-4104-8e20-aa64e15c8dd9 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.012856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 948/1897] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:08.014197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73ef14-29b0-4104-8e20-aa64e15c8dd9 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.026371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73ef14-29b0-4104-8e20-aa64e15c8dd9 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.031307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6dab-32b9-495f-a0f1-dfa5bd5b4559 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.032057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6dab-32b9-495f-a0f1-dfa5bd5b4559 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.032351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6dab-32b9-495f-a0f1-dfa5bd5b4559 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.032649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6dab-32b9-495f-a0f1-dfa5bd5b4559 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.033931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6dab-32b9-495f-a0f1-dfa5bd5b4559 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.035338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6dab-32b9-495f-a0f1-dfa5bd5b4559 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.060241 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 949/1898] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:08 2022] POST /identity/v3/users => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:08.064185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6dab-32b9-495f-a0f1-dfa5bd5b4559 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.066837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cf7e9-09d8-47cb-9879-c3683e5f1b94 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.072675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.072918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.073176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.073452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] PATH_INFO: `/v3/projects/0d730dde723748618f222965f83c455e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.074633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d730dde723748618f222965f83c455e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.076875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.077021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6dab-32b9-495f-a0f1-dfa5bd5b4559 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.082479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37c32b-eef4-45da-ba5d-434d352e7738 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.083231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37c32b-eef4-45da-ba5d-434d352e7738 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.083579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37c32b-eef4-45da-ba5d-434d352e7738 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.083934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37c32b-eef4-45da-ba5d-434d352e7738 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.084812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37c32b-eef4-45da-ba5d-434d352e7738 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:08.085254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37c32b-eef4-45da-ba5d-434d352e7738 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.088125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37c32b-eef4-45da-ba5d-434d352e7738 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.100875 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 950/1899] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:08.123351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ebd0-07c1-4729-b655-248abb6316a4 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.123735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ebd0-07c1-4729-b655-248abb6316a4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.124120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ebd0-07c1-4729-b655-248abb6316a4 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.125610 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 951/1900] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:45:08.130549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ebd0-07c1-4729-b655-248abb6316a4 None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:45:08.132252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-22c2ebd0-07c1-4729-b655-248abb6316a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:08.141522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d730dde723748618f222965f83c455e', 'request_id': 'req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:08.153695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d730dde723748618f222965f83c455e', 'request_id': 'req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:08.161701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d730dde723748618f222965f83c455e', 'request_id': 'req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:08.163732 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:08.175370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] The token cache is being invalidate because project 0d730dde723748618f222965f83c455e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:08.175760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:08.176267 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:08.177641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2550b00f-f219-4ab7-bb9e-e4b0f702e9ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:08.179422 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 950/1901] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:07 2022] DELETE /identity/v3/projects/0d730dde723748618f222965f83c455e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:08.184363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bffed-12c1-4876-aa83-75957a51077e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.184801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bffed-12c1-4876-aa83-75957a51077e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.185138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bffed-12c1-4876-aa83-75957a51077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.211541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d84bffed-12c1-4876-aa83-75957a51077e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:08.213746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d84bffed-12c1-4876-aa83-75957a51077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:08.240848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ebd0-07c1-4729-b655-248abb6316a4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.304135 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 951/1902] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:08.314992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df774-64c6-4f39-9619-91270f62c7c5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.315379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df774-64c6-4f39-9619-91270f62c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.315738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df774-64c6-4f39-9619-91270f62c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.335322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ebd0-07c1-4729-b655-248abb6316a4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.342464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5019913-5f0d-4af8-9c52-053619febc7d tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.343247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5019913-5f0d-4af8-9c52-053619febc7d tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.343607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5019913-5f0d-4af8-9c52-053619febc7d tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.343806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dd8df774-64c6-4f39-9619-91270f62c7c5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:08.344008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5019913-5f0d-4af8-9c52-053619febc7d tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/projects/91f2d5cc332744da99f3f1ea042b88d0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.345090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dd8df774-64c6-4f39-9619-91270f62c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:08.345358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5019913-5f0d-4af8-9c52-053619febc7d tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:get_project(project_id=91f2d5cc332744da99f3f1ea042b88d0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.347553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5019913-5f0d-4af8-9c52-053619febc7d tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.349742 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 952/1903] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:45:08 2022] GET /identity/v3/projects/91f2d5cc332744da99f3f1ea042b88d0 => generated 369 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:08.353741 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 952/1904] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:08.359031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5019913-5f0d-4af8-9c52-053619febc7d tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.381392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5019913-5f0d-4af8-9c52-053619febc7d tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.392665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de20134-dc86-4c33-a997-f85f24ec673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.394088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de20134-dc86-4c33-a997-f85f24ec673a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.394465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de20134-dc86-4c33-a997-f85f24ec673a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.395186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de20134-dc86-4c33-a997-f85f24ec673a admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.396220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de20134-dc86-4c33-a997-f85f24ec673a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:08.396818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de20134-dc86-4c33-a997-f85f24ec673a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.401841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de20134-dc86-4c33-a997-f85f24ec673a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.428205 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 953/1905] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:08.430206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8df774-64c6-4f39-9619-91270f62c7c5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.455467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8df774-64c6-4f39-9619-91270f62c7c5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.465119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f20d99-cd3d-470f-9cb3-30aa58c45adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.466175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f20d99-cd3d-470f-9cb3-30aa58c45adb admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.467351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f20d99-cd3d-470f-9cb3-30aa58c45adb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.467862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f20d99-cd3d-470f-9cb3-30aa58c45adb admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.468751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f20d99-cd3d-470f-9cb3-30aa58c45adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.471556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f20d99-cd3d-470f-9cb3-30aa58c45adb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.523291 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 953/1906] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:08 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:08.529398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de20134-dc86-4c33-a997-f85f24ec673a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.542034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de20134-dc86-4c33-a997-f85f24ec673a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.602719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9fadf-c8a5-4813-9420-2fd0e4ade77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.603347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9fadf-c8a5-4813-9420-2fd0e4ade77a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.603613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9fadf-c8a5-4813-9420-2fd0e4ade77a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.603887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9fadf-c8a5-4813-9420-2fd0e4ade77a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.604534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9fadf-c8a5-4813-9420-2fd0e4ade77a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.606548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9fadf-c8a5-4813-9420-2fd0e4ade77a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.635089 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 954/1907] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:08 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:45:08.639083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f20d99-cd3d-470f-9cb3-30aa58c45adb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.650615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f20d99-cd3d-470f-9cb3-30aa58c45adb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.655472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65345f6d-8380-4984-9159-a75211b1e317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.656097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65345f6d-8380-4984-9159-a75211b1e317 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.656386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65345f6d-8380-4984-9159-a75211b1e317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.656695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65345f6d-8380-4984-9159-a75211b1e317 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.657336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65345f6d-8380-4984-9159-a75211b1e317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.658954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65345f6d-8380-4984-9159-a75211b1e317 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.672905 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 954/1908] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:08.673906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9fadf-c8a5-4813-9420-2fd0e4ade77a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.688986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9fadf-c8a5-4813-9420-2fd0e4ade77a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.692585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148aa7b-99e2-4370-98ad-4eddc6e72825 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.693775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148aa7b-99e2-4370-98ad-4eddc6e72825 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.693775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148aa7b-99e2-4370-98ad-4eddc6e72825 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.694521 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 955/1909] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:45:08.700563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9885d6-9864-493e-a73a-39b9c99fcd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.700836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148aa7b-99e2-4370-98ad-4eddc6e72825 None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:45:08.701301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9885d6-9864-493e-a73a-39b9c99fcd17 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.701793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9885d6-9864-493e-a73a-39b9c99fcd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.702204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a148aa7b-99e2-4370-98ad-4eddc6e72825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:08.702327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9885d6-9864-493e-a73a-39b9c99fcd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.703495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9885d6-9864-493e-a73a-39b9c99fcd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.706346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9885d6-9864-493e-a73a-39b9c99fcd17 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.720667 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 955/1910] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:08.726273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9885d6-9864-493e-a73a-39b9c99fcd17 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.742257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9885d6-9864-493e-a73a-39b9c99fcd17 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:08.748752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5fe50-e525-4c33-bf93-41406cd5b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:08.749430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5fe50-e525-4c33-bf93-41406cd5b563 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.749709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5fe50-e525-4c33-bf93-41406cd5b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.750099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5fe50-e525-4c33-bf93-41406cd5b563 admin admin] PATH_INFO: `/v3/projects/e3c1dac6cb0f4012aa1fea23c570da09/users/077f0afb3bd24669a5a2831221b1a81b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.777682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5fe50-e525-4c33-bf93-41406cd5b563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c1dac6cb0f4012aa1fea23c570da09, user_id=077f0afb3bd24669a5a2831221b1a81b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:08.781356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5fe50-e525-4c33-bf93-41406cd5b563 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:08.801626 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 956/1911] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:08 2022] PUT /identity/v3/projects/e3c1dac6cb0f4012aa1fea23c570da09/users/077f0afb3bd24669a5a2831221b1a81b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:08.815808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfebfbb-ca8b-4ce4-8e43-94b2dba49c10 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:08.816018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfebfbb-ca8b-4ce4-8e43-94b2dba49c10 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:08.816299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfebfbb-ca8b-4ce4-8e43-94b2dba49c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:08.826603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148aa7b-99e2-4370-98ad-4eddc6e72825 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:08.828366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a148aa7b-99e2-4370-98ad-4eddc6e72825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:08.865382 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:08.891375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6bfebfbb-ca8b-4ce4-8e43-94b2dba49c10 None None] MFA Rules not processed for user `077f0afb3bd24669a5a2831221b1a81b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:08.893618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6bfebfbb-ca8b-4ce4-8e43-94b2dba49c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:08.904785 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:08.925654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148aa7b-99e2-4370-98ad-4eddc6e72825 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.002172 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 957/1912] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:09.006986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfebfbb-ca8b-4ce4-8e43-94b2dba49c10 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:09.020416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca489c52-0158-4fc3-bdf4-e76023dc756e tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.021181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca489c52-0158-4fc3-bdf4-e76023dc756e tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.021513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca489c52-0158-4fc3-bdf4-e76023dc756e tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.021790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca489c52-0158-4fc3-bdf4-e76023dc756e tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/projects/91f2d5cc332744da99f3f1ea042b88d0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.022978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca489c52-0158-4fc3-bdf4-e76023dc756e tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:get_project(project_id=91f2d5cc332744da99f3f1ea042b88d0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.025818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca489c52-0158-4fc3-bdf4-e76023dc756e tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.027627 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 956/1913] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:45:08 2022] GET /identity/v3/projects/91f2d5cc332744da99f3f1ea042b88d0 => generated 369 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:09.084350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca489c52-0158-4fc3-bdf4-e76023dc756e tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:09.096247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca489c52-0158-4fc3-bdf4-e76023dc756e tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.101964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.102976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.103799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.103942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/users/8fef55cd8fdc41668c71a4918e113c7b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.113152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfebfbb-ca8b-4ce4-8e43-94b2dba49c10 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.119541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0d829-71bb-430c-a6be-3163b5827add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.120846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0d829-71bb-430c-a6be-3163b5827add admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.120846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0d829-71bb-430c-a6be-3163b5827add admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.121037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0d829-71bb-430c-a6be-3163b5827add admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.121571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0d829-71bb-430c-a6be-3163b5827add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.123851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0d829-71bb-430c-a6be-3163b5827add admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.124192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8fef55cd8fdc41668c71a4918e113c7b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.126271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.166472 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 958/1914] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:09 2022] POST /identity/v3/projects => generated 391 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:09.168192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0d829-71bb-430c-a6be-3163b5827add admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:09.184194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fef55cd8fdc41668c71a4918e113c7b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.199709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fef55cd8fdc41668c71a4918e113c7b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.209352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fef55cd8fdc41668c71a4918e113c7b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.217771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fef55cd8fdc41668c71a4918e113c7b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.218663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fef55cd8fdc41668c71a4918e113c7b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.225056 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 957/1915] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:09 2022] DELETE /identity/v3/users/8fef55cd8fdc41668c71a4918e113c7b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:09.231720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:09.231720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:09.237307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0d829-71bb-430c-a6be-3163b5827add admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.277076 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:09.312998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1c462-5060-446a-8a05-4c5b11eb2207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.313588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1c462-5060-446a-8a05-4c5b11eb2207 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.313874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1c462-5060-446a-8a05-4c5b11eb2207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.314150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1c462-5060-446a-8a05-4c5b11eb2207 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.315004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1c462-5060-446a-8a05-4c5b11eb2207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.317597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1c462-5060-446a-8a05-4c5b11eb2207 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.337734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d307c-25cb-41cb-ac0c-ec8ab14538f2 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.342639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ff6c00ebcca45fbb0223c81820e7009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '505208a1f04845f8bfe491c65b66cea2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.346495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.346633 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 959/1916] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:09 2022] POST /identity/v3/users => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:45:09.346753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.346753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] PATH_INFO: `/v3/projects/91f2d5cc332744da99f3f1ea042b88d0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.347041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91f2d5cc332744da99f3f1ea042b88d0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.348000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1c462-5060-446a-8a05-4c5b11eb2207 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:09.348999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.349734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-13a1c462-5060-446a-8a05-4c5b11eb2207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:09.353331 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:09.363964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1c462-5060-446a-8a05-4c5b11eb2207 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.370030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f01fe0-bbb4-4876-8e5b-3bab469bd66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.370658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f01fe0-bbb4-4876-8e5b-3bab469bd66d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.370948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f01fe0-bbb4-4876-8e5b-3bab469bd66d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.371213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f01fe0-bbb4-4876-8e5b-3bab469bd66d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.371876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f01fe0-bbb4-4876-8e5b-3bab469bd66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.373586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f01fe0-bbb4-4876-8e5b-3bab469bd66d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.386773 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 960/1917] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:09.391456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f01fe0-bbb4-4876-8e5b-3bab469bd66d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:09.402751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f01fe0-bbb4-4876-8e5b-3bab469bd66d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.416317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f2d5cc332744da99f3f1ea042b88d0', 'request_id': 'req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.427338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f2d5cc332744da99f3f1ea042b88d0', 'request_id': 'req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.439651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f2d5cc332744da99f3f1ea042b88d0', 'request_id': 'req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.462924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] The token cache is being invalidate because project 91f2d5cc332744da99f3f1ea042b88d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:09.463515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.464350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.469110 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 958/1918] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:09 2022] DELETE /identity/v3/projects/91f2d5cc332744da99f3f1ea042b88d0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:09.476258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:09.478137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:09.531301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7c904-d857-4187-98d2-ea6245c2a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.532056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7c904-d857-4187-98d2-ea6245c2a5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.532344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7c904-d857-4187-98d2-ea6245c2a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.532668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7c904-d857-4187-98d2-ea6245c2a5e3 admin admin] PATH_INFO: `/v3/projects/fc498afebeb046069a26946e7d406be4/users/1c01e748bd4b4a2ca16609a604519a01/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.557023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7c904-d857-4187-98d2-ea6245c2a5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc498afebeb046069a26946e7d406be4, user_id=1c01e748bd4b4a2ca16609a604519a01, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.560004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7c904-d857-4187-98d2-ea6245c2a5e3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.596083 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 961/1919] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:09 2022] PUT /identity/v3/projects/fc498afebeb046069a26946e7d406be4/users/1c01e748bd4b4a2ca16609a604519a01/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:09.598751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7c904-d857-4187-98d2-ea6245c2a5e3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:09.605415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-caf7c904-d857-4187-98d2-ea6245c2a5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:09.639019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4675e-95ea-4a6c-99d3-8f92c8be21ba tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.745073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.746020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.746372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.746650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] PATH_INFO: `/v3/users/854a03060a8b4f3a8aaa75b09fb57baa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.747926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] RBAC: Authorizing `identity:delete_user(user_id=854a03060a8b4f3a8aaa75b09fb57baa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.750031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.751896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7c904-d857-4187-98d2-ea6245c2a5e3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.774602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f5ef8-95a4-4bed-9cea-fe0f418cb18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.776294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f5ef8-95a4-4bed-9cea-fe0f418cb18b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.776865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f5ef8-95a4-4bed-9cea-fe0f418cb18b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.777354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f5ef8-95a4-4bed-9cea-fe0f418cb18b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.778233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f5ef8-95a4-4bed-9cea-fe0f418cb18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.780468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f5ef8-95a4-4bed-9cea-fe0f418cb18b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.799847 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 962/1920] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:09.801236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f5ef8-95a4-4bed-9cea-fe0f418cb18b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:09.819037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f5ef8-95a4-4bed-9cea-fe0f418cb18b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:09.839228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b590311-c112-47f8-827b-210c226c2894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:09.840560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590311-c112-47f8-827b-210c226c2894 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.841210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590311-c112-47f8-827b-210c226c2894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.842877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590311-c112-47f8-827b-210c226c2894 admin admin] PATH_INFO: `/v3/projects/fc498afebeb046069a26946e7d406be4/users/1c01e748bd4b4a2ca16609a604519a01/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.847180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b590311-c112-47f8-827b-210c226c2894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc498afebeb046069a26946e7d406be4, user_id=1c01e748bd4b4a2ca16609a604519a01, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:09.850131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b590311-c112-47f8-827b-210c226c2894 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:09.852013 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:09.863761 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 963/1921] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:09 2022] PUT /identity/v3/projects/fc498afebeb046069a26946e7d406be4/users/1c01e748bd4b4a2ca16609a604519a01/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:09.867109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854a03060a8b4f3a8aaa75b09fb57baa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.875795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e78095-5681-4e0b-ab1d-4a14eee083eb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.876078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e78095-5681-4e0b-ab1d-4a14eee083eb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.876359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e78095-5681-4e0b-ab1d-4a14eee083eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.889809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854a03060a8b4f3a8aaa75b09fb57baa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.901668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854a03060a8b4f3a8aaa75b09fb57baa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.914611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854a03060a8b4f3a8aaa75b09fb57baa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.916072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-503bfa31-a6da-4612-95f3-1cdb3703083e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854a03060a8b4f3a8aaa75b09fb57baa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:09.920104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-44e78095-5681-4e0b-ab1d-4a14eee083eb None None] MFA Rules not processed for user `1c01e748bd4b4a2ca16609a604519a01`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:09.921497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-44e78095-5681-4e0b-ab1d-4a14eee083eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:09.925292 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 959/1922] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:09 2022] DELETE /identity/v3/users/854a03060a8b4f3a8aaa75b09fb57baa => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:09.929523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f5583-7208-4c94-8bde-2b5e24163f9c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:09.930109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f5583-7208-4c94-8bde-2b5e24163f9c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:09.932380 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:09.932524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f5583-7208-4c94-8bde-2b5e24163f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:09.967910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-045f5583-7208-4c94-8bde-2b5e24163f9c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:09.969280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-045f5583-7208-4c94-8bde-2b5e24163f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.081442 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 964/1923] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:10.082731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e78095-5681-4e0b-ab1d-4a14eee083eb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:10.084367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-44e78095-5681-4e0b-ab1d-4a14eee083eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.106192 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 960/1924] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:10.113078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f5583-7208-4c94-8bde-2b5e24163f9c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:10.114525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-045f5583-7208-4c94-8bde-2b5e24163f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.196973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f5583-7208-4c94-8bde-2b5e24163f9c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:10.199791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e78095-5681-4e0b-ab1d-4a14eee083eb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:10.201210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b331074-efed-46a0-8081-ba93e6b0456a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:10.201721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b331074-efed-46a0-8081-ba93e6b0456a service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:10.202094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b331074-efed-46a0-8081-ba93e6b0456a service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:10.202442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b331074-efed-46a0-8081-ba93e6b0456a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:10.207269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:10.208123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:10.208475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:10.208979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:10.211232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.218487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b331074-efed-46a0-8081-ba93e6b0456a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:10.220022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b331074-efed-46a0-8081-ba93e6b0456a service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:10.238688 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 961/1925] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:45:10.294520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b331074-efed-46a0-8081-ba93e6b0456a service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:10.296497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4b331074-efed-46a0-8081-ba93e6b0456a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.314107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b331074-efed-46a0-8081-ba93e6b0456a service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:10.322712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:10.323378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:10.323662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:10.323937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] PATH_INFO: `/v3/users/077f0afb3bd24669a5a2831221b1a81b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:10.325555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=077f0afb3bd24669a5a2831221b1a81b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:10.327883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:10.362201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:10.363832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:10.393538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 965/1926] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:10.417800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077f0afb3bd24669a5a2831221b1a81b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.427866 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:10.455070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077f0afb3bd24669a5a2831221b1a81b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.475201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077f0afb3bd24669a5a2831221b1a81b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.497791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:10.500364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.503262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077f0afb3bd24669a5a2831221b1a81b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.504520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bba2f10-1b56-4282-9065-e6db37c60e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077f0afb3bd24669a5a2831221b1a81b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.516523 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 962/1927] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:10 2022] DELETE /identity/v3/users/077f0afb3bd24669a5a2831221b1a81b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:10.520240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fae4-b3cc-461c-8041-9c4cbfc40d81 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:10.521224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fae4-b3cc-461c-8041-9c4cbfc40d81 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:10.521775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fae4-b3cc-461c-8041-9c4cbfc40d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:10.528445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba111-ddc8-48c7-9431-865ee7ef71e2 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:10.567857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-40a7fae4-b3cc-461c-8041-9c4cbfc40d81 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:10.570307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-40a7fae4-b3cc-461c-8041-9c4cbfc40d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.579388 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:10.654737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:10.656499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:10.657307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:10.657660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:10.661075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.678535 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 963/1928] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:10.692052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fae4-b3cc-461c-8041-9c4cbfc40d81 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:10.694042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-40a7fae4-b3cc-461c-8041-9c4cbfc40d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.770968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:10.773297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:10.794751 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 966/1929] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:45:10.796713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:10.798990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:10.799327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fae4-b3cc-461c-8041-9c4cbfc40d81 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:10.803515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98f9c6-709d-493b-a83c-2f93a694d457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:10.804247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98f9c6-709d-493b-a83c-2f93a694d457 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:10.804872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98f9c6-709d-493b-a83c-2f93a694d457 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:10.804872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98f9c6-709d-493b-a83c-2f93a694d457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:10.817560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98f9c6-709d-493b-a83c-2f93a694d457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:10.819078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5fb0b-66c5-4819-a7e6-d0fb0a6305a1 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:10.819261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98f9c6-709d-493b-a83c-2f93a694d457 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:10.827558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:10.828700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:10.829591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:10.830091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] PATH_INFO: `/v3/projects/21012f35c9a6466a8e2f939519a2c6f2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:10.832440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21012f35c9a6466a8e2f939519a2c6f2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:10.833917 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 964/1930] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:10.836825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:10.909066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21012f35c9a6466a8e2f939519a2c6f2', 'request_id': 'req-769741b7-772b-4fdc-8a30-94aa61019cb4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.920498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21012f35c9a6466a8e2f939519a2c6f2', 'request_id': 'req-769741b7-772b-4fdc-8a30-94aa61019cb4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.928332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21012f35c9a6466a8e2f939519a2c6f2', 'request_id': 'req-769741b7-772b-4fdc-8a30-94aa61019cb4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.944108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] The token cache is being invalidate because project 21012f35c9a6466a8e2f939519a2c6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:10.944564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.945743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:10.949288 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 967/1931] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:10 2022] DELETE /identity/v3/projects/21012f35c9a6466a8e2f939519a2c6f2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:10.954821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98f9c6-709d-493b-a83c-2f93a694d457 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:10.965245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98f9c6-709d-493b-a83c-2f93a694d457 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:11.136052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:11.136865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:11.137011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:11.137291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] PATH_INFO: `/v3/users/0ff6c00ebcca45fbb0223c81820e7009` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:11.138535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff6c00ebcca45fbb0223c81820e7009)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:11.140493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:11.169716 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:11.211342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff6c00ebcca45fbb0223c81820e7009'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.229125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff6c00ebcca45fbb0223c81820e7009'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.239765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff6c00ebcca45fbb0223c81820e7009'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.248486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff6c00ebcca45fbb0223c81820e7009'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.249998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff6c00ebcca45fbb0223c81820e7009'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.260665 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 965/1932] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:10 2022] DELETE /identity/v3/users/0ff6c00ebcca45fbb0223c81820e7009 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:11.530971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:11.536094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:11.562604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769741b7-772b-4fdc-8a30-94aa61019cb4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:11.659038 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:11.672090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:11.672788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:11.673084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:11.673440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] PATH_INFO: `/v3/projects/e3c1dac6cb0f4012aa1fea23c570da09` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:11.674636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c1dac6cb0f4012aa1fea23c570da09)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:11.677323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:11.767155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c1dac6cb0f4012aa1fea23c570da09', 'request_id': 'req-142146b1-94fe-4267-ae4c-2faee85d3bf9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.776557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c1dac6cb0f4012aa1fea23c570da09', 'request_id': 'req-142146b1-94fe-4267-ae4c-2faee85d3bf9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.783764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c1dac6cb0f4012aa1fea23c570da09', 'request_id': 'req-142146b1-94fe-4267-ae4c-2faee85d3bf9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.802991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] The token cache is being invalidate because project e3c1dac6cb0f4012aa1fea23c570da09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:11.803579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.805884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:11.809933 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 968/1933] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:11 2022] DELETE /identity/v3/projects/e3c1dac6cb0f4012aa1fea23c570da09 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:11.815450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:11.817181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:11.832963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0c334-0d22-4ff2-85bd-f3cd1601ddf7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:11.834235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:11.835953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:11.934333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142146b1-94fe-4267-ae4c-2faee85d3bf9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:11.939388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:11.941000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:11.941888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:11.942401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] PATH_INFO: `/v3/projects/505208a1f04845f8bfe491c65b66cea2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:11.944039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=505208a1f04845f8bfe491c65b66cea2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:11.946828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:11.962305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:11.963153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:11.963441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:11.963752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] PATH_INFO: `/v3/users/1c01e748bd4b4a2ca16609a604519a01` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:11.965246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c01e748bd4b4a2ca16609a604519a01)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:11.968189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:12.013296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '505208a1f04845f8bfe491c65b66cea2', 'request_id': 'req-3fce4860-e7ef-41de-8541-ef9faffd34ec'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.035255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '505208a1f04845f8bfe491c65b66cea2', 'request_id': 'req-3fce4860-e7ef-41de-8541-ef9faffd34ec'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.041158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c01e748bd4b4a2ca16609a604519a01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.047792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '505208a1f04845f8bfe491c65b66cea2', 'request_id': 'req-3fce4860-e7ef-41de-8541-ef9faffd34ec'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.061467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c01e748bd4b4a2ca16609a604519a01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.063341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] The token cache is being invalidate because project 505208a1f04845f8bfe491c65b66cea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:12.063706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.064810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3fce4860-e7ef-41de-8541-ef9faffd34ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.068309 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 969/1934] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:11 2022] DELETE /identity/v3/projects/505208a1f04845f8bfe491c65b66cea2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:12.075510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f881b3-192b-4901-865d-faaadba68178 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.075972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f881b3-192b-4901-865d-faaadba68178 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.076256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f881b3-192b-4901-865d-faaadba68178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.078561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c01e748bd4b4a2ca16609a604519a01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.089857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c01e748bd4b4a2ca16609a604519a01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.091478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0c902712-5049-492d-9e75-60fb1f7bd814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c01e748bd4b4a2ca16609a604519a01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:12.102553 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 966/1935] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:11 2022] DELETE /identity/v3/users/1c01e748bd4b4a2ca16609a604519a01 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:12.124336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-54f881b3-192b-4901-865d-faaadba68178 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:12.124336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-54f881b3-192b-4901-865d-faaadba68178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:12.129512 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:12.219043 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 970/1936] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:12.220902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a50f17-7d64-44b2-b694-3c7508601b4f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.221392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a50f17-7d64-44b2-b694-3c7508601b4f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.221639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a50f17-7d64-44b2-b694-3c7508601b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.250919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a0a50f17-7d64-44b2-b694-3c7508601b4f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:12.252768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a0a50f17-7d64-44b2-b694-3c7508601b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:12.280338 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 967/1937] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:12.284986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f881b3-192b-4901-865d-faaadba68178 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:12.298738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f881b3-192b-4901-865d-faaadba68178 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:12.305380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ae37-cd70-4ab3-950f-d22dd3ecc6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:12.306302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ae37-cd70-4ab3-950f-d22dd3ecc6da admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.306541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ae37-cd70-4ab3-950f-d22dd3ecc6da admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.306919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ae37-cd70-4ab3-950f-d22dd3ecc6da admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.307775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ae37-cd70-4ab3-950f-d22dd3ecc6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:12.308202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ae37-cd70-4ab3-950f-d22dd3ecc6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:12.309948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ae37-cd70-4ab3-950f-d22dd3ecc6da admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:12.329475 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 971/1938] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:12.330312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a50f17-7d64-44b2-b694-3c7508601b4f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:12.352913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a50f17-7d64-44b2-b694-3c7508601b4f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:12.360199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa42a5-e0d0-4c3e-98f7-b62190cdf6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:12.360869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa42a5-e0d0-4c3e-98f7-b62190cdf6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.361155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa42a5-e0d0-4c3e-98f7-b62190cdf6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.361433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa42a5-e0d0-4c3e-98f7-b62190cdf6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.362087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa42a5-e0d0-4c3e-98f7-b62190cdf6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:12.364044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa42a5-e0d0-4c3e-98f7-b62190cdf6a5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:12.370438 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:12.402545 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 968/1939] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:12 2022] POST /identity/v3/projects => generated 395 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:12.407838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ae37-cd70-4ab3-950f-d22dd3ecc6da admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:12.424874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ae37-cd70-4ab3-950f-d22dd3ecc6da admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:12.514392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52c1c2-fe21-48f2-9f9b-900468c60cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:12.515432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52c1c2-fe21-48f2-9f9b-900468c60cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.515904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52c1c2-fe21-48f2-9f9b-900468c60cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.516393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52c1c2-fe21-48f2-9f9b-900468c60cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.517581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52c1c2-fe21-48f2-9f9b-900468c60cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:12.520758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52c1c2-fe21-48f2-9f9b-900468c60cb0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:12.547319 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 972/1940] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:12 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:12.552253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa42a5-e0d0-4c3e-98f7-b62190cdf6a5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:12.583675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa42a5-e0d0-4c3e-98f7-b62190cdf6a5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:12.593520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9303d9e-dfff-42d5-9bed-1712acb49c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:12.594508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9303d9e-dfff-42d5-9bed-1712acb49c00 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.594799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9303d9e-dfff-42d5-9bed-1712acb49c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.595076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9303d9e-dfff-42d5-9bed-1712acb49c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.595750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9303d9e-dfff-42d5-9bed-1712acb49c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:12.598114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9303d9e-dfff-42d5-9bed-1712acb49c00 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:12.621320 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 969/1941] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:12.622236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52c1c2-fe21-48f2-9f9b-900468c60cb0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:12.667681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52c1c2-fe21-48f2-9f9b-900468c60cb0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:12.675007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4a89-c7c3-40c0-b159-a72b8c403ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:12.675817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4a89-c7c3-40c0-b159-a72b8c403ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.676321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4a89-c7c3-40c0-b159-a72b8c403ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.676606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4a89-c7c3-40c0-b159-a72b8c403ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.677312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4a89-c7c3-40c0-b159-a72b8c403ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:12.679287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4a89-c7c3-40c0-b159-a72b8c403ca2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:12.698376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9303d9e-dfff-42d5-9bed-1712acb49c00 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:12.700064 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 973/1942] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:12.719573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9303d9e-dfff-42d5-9bed-1712acb49c00 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:12.728461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923df91-4e3d-459c-9ba6-c3bbe0a56086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:12.729364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923df91-4e3d-459c-9ba6-c3bbe0a56086 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.729747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923df91-4e3d-459c-9ba6-c3bbe0a56086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.730130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923df91-4e3d-459c-9ba6-c3bbe0a56086 admin admin] PATH_INFO: `/v3/projects/517bd155a3d544e08fef047741fb70ce/users/b2a833999fff49a8a3601a6ab56349e9/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.755770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923df91-4e3d-459c-9ba6-c3bbe0a56086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517bd155a3d544e08fef047741fb70ce, user_id=b2a833999fff49a8a3601a6ab56349e9, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:12.760390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923df91-4e3d-459c-9ba6-c3bbe0a56086 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:12.787121 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 970/1943] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:12 2022] PUT /identity/v3/projects/517bd155a3d544e08fef047741fb70ce/users/b2a833999fff49a8a3601a6ab56349e9/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:12.802243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecfef2-bd0c-4076-9ba6-145695ea2f5e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:12.802522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecfef2-bd0c-4076-9ba6-145695ea2f5e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:12.804208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecfef2-bd0c-4076-9ba6-145695ea2f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:12.883016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923df91-4e3d-459c-9ba6-c3bbe0a56086 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:12.885277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9923df91-4e3d-459c-9ba6-c3bbe0a56086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:12.897741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-21ecfef2-bd0c-4076-9ba6-145695ea2f5e None None] MFA Rules not processed for user `b2a833999fff49a8a3601a6ab56349e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:12.905010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-21ecfef2-bd0c-4076-9ba6-145695ea2f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:13.049499 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 974/1944] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:13.054786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecfef2-bd0c-4076-9ba6-145695ea2f5e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.065128 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:13.074060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923df91-4e3d-459c-9ba6-c3bbe0a56086 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.084183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.086532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.087310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.087844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] PATH_INFO: `/v3/projects/fc498afebeb046069a26946e7d406be4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.089662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc498afebeb046069a26946e7d406be4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.091900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.212413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecfef2-bd0c-4076-9ba6-145695ea2f5e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.214591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc498afebeb046069a26946e7d406be4', 'request_id': 'req-5a8c6b34-f439-40ba-97af-ce5841105fb5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:13.232807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc498afebeb046069a26946e7d406be4', 'request_id': 'req-5a8c6b34-f439-40ba-97af-ce5841105fb5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:13.240660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc498afebeb046069a26946e7d406be4', 'request_id': 'req-5a8c6b34-f439-40ba-97af-ce5841105fb5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:13.256085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] The token cache is being invalidate because project fc498afebeb046069a26946e7d406be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:13.260675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:13.260675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a8c6b34-f439-40ba-97af-ce5841105fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:13.260675 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 971/1945] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:12 2022] DELETE /identity/v3/projects/fc498afebeb046069a26946e7d406be4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:13.265165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09741248-55ef-44c5-bc4a-99400aabdaf1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.265804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09741248-55ef-44c5-bc4a-99400aabdaf1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.266687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09741248-55ef-44c5-bc4a-99400aabdaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.301910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-09741248-55ef-44c5-bc4a-99400aabdaf1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:13.303346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09741248-55ef-44c5-bc4a-99400aabdaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:13.324414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ab3b-1523-4275-80e2-13afea922253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.325099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ab3b-1523-4275-80e2-13afea922253 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.325491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ab3b-1523-4275-80e2-13afea922253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.325777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ab3b-1523-4275-80e2-13afea922253 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.326571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74ab3b-1523-4275-80e2-13afea922253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.329549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74ab3b-1523-4275-80e2-13afea922253 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.375492 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 975/1946] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/projects => generated 395 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:13.376431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ab3b-1523-4275-80e2-13afea922253 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.378371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4d74ab3b-1523-4275-80e2-13afea922253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:13.381125 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:13.429456 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 972/1947] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:13.436249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ac932-b55a-4c20-9cfd-43f643e32d85 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.436640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ac932-b55a-4c20-9cfd-43f643e32d85 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.437019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ac932-b55a-4c20-9cfd-43f643e32d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.464269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-051ac932-b55a-4c20-9cfd-43f643e32d85 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:13.465611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-051ac932-b55a-4c20-9cfd-43f643e32d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:13.496037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ab3b-1523-4275-80e2-13afea922253 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.501047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c97ae-71d5-4111-af15-3055e0baf428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.501685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c97ae-71d5-4111-af15-3055e0baf428 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.501965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c97ae-71d5-4111-af15-3055e0baf428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.502240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c97ae-71d5-4111-af15-3055e0baf428 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.502879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c97ae-71d5-4111-af15-3055e0baf428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.504854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c97ae-71d5-4111-af15-3055e0baf428 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.541304 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 976/1948] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/users => generated 304 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:13.546114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c97ae-71d5-4111-af15-3055e0baf428 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.549439 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 973/1949] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:13.553539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ac932-b55a-4c20-9cfd-43f643e32d85 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.556440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c97ae-71d5-4111-af15-3055e0baf428 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.561510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4141-b58d-4fef-8479-a7f77639694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.562124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4141-b58d-4fef-8479-a7f77639694b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.562405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4141-b58d-4fef-8479-a7f77639694b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.562680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4141-b58d-4fef-8479-a7f77639694b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.563157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ac932-b55a-4c20-9cfd-43f643e32d85 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.563326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f4141-b58d-4fef-8479-a7f77639694b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.564966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f4141-b58d-4fef-8479-a7f77639694b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.568052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ab804-dd08-4e36-819a-5e80fec18f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.568758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ab804-dd08-4e36-819a-5e80fec18f4d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.569044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ab804-dd08-4e36-819a-5e80fec18f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.569324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ab804-dd08-4e36-819a-5e80fec18f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.570139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ab804-dd08-4e36-819a-5e80fec18f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:13.570441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ab804-dd08-4e36-819a-5e80fec18f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.572605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ab804-dd08-4e36-819a-5e80fec18f4d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.579539 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 977/1950] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:13.583656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4141-b58d-4fef-8479-a7f77639694b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.587760 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 974/1951] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:13.594866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ab804-dd08-4e36-819a-5e80fec18f4d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.599963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4141-b58d-4fef-8479-a7f77639694b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.606726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ab804-dd08-4e36-819a-5e80fec18f4d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.607396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8f291-1893-47fc-b578-4a8b2676682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.608186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8f291-1893-47fc-b578-4a8b2676682b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.608398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8f291-1893-47fc-b578-4a8b2676682b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.608709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8f291-1893-47fc-b578-4a8b2676682b admin admin] PATH_INFO: `/v3/projects/109a815c736e427fb5915aa0fc563761/users/7fa2bb97c4644e259efff27e0ed0c742/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.611547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d64c72-5dae-4988-808a-988471029cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.612165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d64c72-5dae-4988-808a-988471029cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.612454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d64c72-5dae-4988-808a-988471029cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.612772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d64c72-5dae-4988-808a-988471029cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.613416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d64c72-5dae-4988-808a-988471029cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.615380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d64c72-5dae-4988-808a-988471029cb7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.627622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8f291-1893-47fc-b578-4a8b2676682b admin admin] RBAC: Authorizing `identity:create_grant(project_id=109a815c736e427fb5915aa0fc563761, user_id=7fa2bb97c4644e259efff27e0ed0c742, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.630502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8f291-1893-47fc-b578-4a8b2676682b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.632961 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:13.647584 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 978/1952] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:13 2022] PUT /identity/v3/projects/109a815c736e427fb5915aa0fc563761/users/7fa2bb97c4644e259efff27e0ed0c742/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:13.652050 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 975/1953] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/projects => generated 395 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:45:13.653274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8f291-1893-47fc-b578-4a8b2676682b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.656946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d64c72-5dae-4988-808a-988471029cb7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.740211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d64c72-5dae-4988-808a-988471029cb7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.744232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8f291-1893-47fc-b578-4a8b2676682b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.746893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c36ad-a3d1-4f67-8abd-2b712ddacca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.747451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c36ad-a3d1-4f67-8abd-2b712ddacca6 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.747865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c36ad-a3d1-4f67-8abd-2b712ddacca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.748147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c36ad-a3d1-4f67-8abd-2b712ddacca6 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.748805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c36ad-a3d1-4f67-8abd-2b712ddacca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.749629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f7764-a323-4a76-8835-40ef832d0c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.750278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f7764-a323-4a76-8835-40ef832d0c5f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.750561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f7764-a323-4a76-8835-40ef832d0c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.750790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c36ad-a3d1-4f67-8abd-2b712ddacca6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.750964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f7764-a323-4a76-8835-40ef832d0c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.751599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f7764-a323-4a76-8835-40ef832d0c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.754314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f7764-a323-4a76-8835-40ef832d0c5f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.768204 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 979/1954] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:13.773094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f7764-a323-4a76-8835-40ef832d0c5f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.787457 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 976/1955] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:45:13.788914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c36ad-a3d1-4f67-8abd-2b712ddacca6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.792689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f7764-a323-4a76-8835-40ef832d0c5f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.798672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a37a08-4eb8-4ca4-9652-6f8b379a3ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.799369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37a08-4eb8-4ca4-9652-6f8b379a3ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.799639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37a08-4eb8-4ca4-9652-6f8b379a3ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.799917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37a08-4eb8-4ca4-9652-6f8b379a3ca1 admin admin] PATH_INFO: `/v3/projects/109a815c736e427fb5915aa0fc563761/users/7fa2bb97c4644e259efff27e0ed0c742/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.802784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a37a08-4eb8-4ca4-9652-6f8b379a3ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=109a815c736e427fb5915aa0fc563761, user_id=7fa2bb97c4644e259efff27e0ed0c742, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.807797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a37a08-4eb8-4ca4-9652-6f8b379a3ca1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.815303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c36ad-a3d1-4f67-8abd-2b712ddacca6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.822233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e7eb5-755d-40a7-9b3a-85c11236fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.822867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e7eb5-755d-40a7-9b3a-85c11236fcff admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.823153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e7eb5-755d-40a7-9b3a-85c11236fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.823427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e7eb5-755d-40a7-9b3a-85c11236fcff admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.824102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e7eb5-755d-40a7-9b3a-85c11236fcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.827531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e7eb5-755d-40a7-9b3a-85c11236fcff admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:13.829356 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 980/1956] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:13 2022] PUT /identity/v3/projects/109a815c736e427fb5915aa0fc563761/users/7fa2bb97c4644e259efff27e0ed0c742/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:13.840796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b510946-6b88-4381-8eef-c8f7a47c7e8f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.841407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b510946-6b88-4381-8eef-c8f7a47c7e8f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.845537 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 977/1957] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:13.845834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b510946-6b88-4381-8eef-c8f7a47c7e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.847578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e7eb5-755d-40a7-9b3a-85c11236fcff admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:13.866154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e7eb5-755d-40a7-9b3a-85c11236fcff admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:13.890665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3b510946-6b88-4381-8eef-c8f7a47c7e8f None None] MFA Rules not processed for user `7fa2bb97c4644e259efff27e0ed0c742`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:13.892325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3b510946-6b88-4381-8eef-c8f7a47c7e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:13.926754 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:13.988034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211e496-d927-4de2-bfbc-75970a18d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:13.988853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211e496-d927-4de2-bfbc-75970a18d765 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:13.989839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211e496-d927-4de2-bfbc-75970a18d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:13.990154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211e496-d927-4de2-bfbc-75970a18d765 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:13.990918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211e496-d927-4de2-bfbc-75970a18d765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:13.995155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211e496-d927-4de2-bfbc-75970a18d765 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.012920 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 978/1958] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:14.013869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211e496-d927-4de2-bfbc-75970a18d765 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.015936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8211e496-d927-4de2-bfbc-75970a18d765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:14.023047 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 981/1959] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:14.024683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b510946-6b88-4381-8eef-c8f7a47c7e8f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.038337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b510946-6b88-4381-8eef-c8f7a47c7e8f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.054933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47746d5f-9f72-4e46-a0b4-4b7c2d226923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.057582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47746d5f-9f72-4e46-a0b4-4b7c2d226923 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.058403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47746d5f-9f72-4e46-a0b4-4b7c2d226923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.059827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47746d5f-9f72-4e46-a0b4-4b7c2d226923 admin admin] PATH_INFO: `/v3/projects/bb37aacf1c5a449997eaad713e369387/users/b3d2f8e058a745adadee164b9df0406d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.106003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47746d5f-9f72-4e46-a0b4-4b7c2d226923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb37aacf1c5a449997eaad713e369387, user_id=b3d2f8e058a745adadee164b9df0406d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.110274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47746d5f-9f72-4e46-a0b4-4b7c2d226923 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.139780 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 982/1960] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:14 2022] PUT /identity/v3/projects/bb37aacf1c5a449997eaad713e369387/users/b3d2f8e058a745adadee164b9df0406d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:14.139780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec117c27-206d-4c2a-9386-b513694fc7ba None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.139780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec117c27-206d-4c2a-9386-b513694fc7ba None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.139780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec117c27-206d-4c2a-9386-b513694fc7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.152571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211e496-d927-4de2-bfbc-75970a18d765 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.170188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ec117c27-206d-4c2a-9386-b513694fc7ba None None] MFA Rules not processed for user `b2a833999fff49a8a3601a6ab56349e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:14.172819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ec117c27-206d-4c2a-9386-b513694fc7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:14.217164 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:14.237245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.237916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.237999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.238419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.240115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:14.257441 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 983/1961] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:14.259299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb487a-1245-4b07-871c-274a22cfa4f8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.259617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb487a-1245-4b07-871c-274a22cfa4f8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.259898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb487a-1245-4b07-871c-274a22cfa4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.303927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-70bb487a-1245-4b07-871c-274a22cfa4f8 None None] MFA Rules not processed for user `b3d2f8e058a745adadee164b9df0406d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:14.306708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-70bb487a-1245-4b07-871c-274a22cfa4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:14.325528 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:14.330219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.331912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.344774 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 979/1962] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:14.345756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.347296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:14.363574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e8ca-9bcb-4877-a2ad-0e45fdd52920 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.372856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b1f11-7f17-4c26-91f9-607438600c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.376106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b1f11-7f17-4c26-91f9-607438600c4d service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.376646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b1f11-7f17-4c26-91f9-607438600c4d service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.377200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b1f11-7f17-4c26-91f9-607438600c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.380589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a62b1f11-7f17-4c26-91f9-607438600c4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:14.395110 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 984/1963] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:14.399887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b1f11-7f17-4c26-91f9-607438600c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.401469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb487a-1245-4b07-871c-274a22cfa4f8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.402927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b1f11-7f17-4c26-91f9-607438600c4d service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.413970 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 980/1964] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:14 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:14.479430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb487a-1245-4b07-871c-274a22cfa4f8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.486264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3abe9-c56b-4a53-ab01-0aad97094139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.486886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3abe9-c56b-4a53-ab01-0aad97094139 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.487172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3abe9-c56b-4a53-ab01-0aad97094139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.487445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3abe9-c56b-4a53-ab01-0aad97094139 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.488118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3abe9-c56b-4a53-ab01-0aad97094139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.490268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3abe9-c56b-4a53-ab01-0aad97094139 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.526688 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 985/1965] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:14 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:14.531041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b1f11-7f17-4c26-91f9-607438600c4d service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.542846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b1f11-7f17-4c26-91f9-607438600c4d service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.611323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaf6bb-ca37-4569-8909-8e388adda22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.612082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaf6bb-ca37-4569-8909-8e388adda22d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.612386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaf6bb-ca37-4569-8909-8e388adda22d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.612694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaf6bb-ca37-4569-8909-8e388adda22d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.613323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaf6bb-ca37-4569-8909-8e388adda22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.616119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaf6bb-ca37-4569-8909-8e388adda22d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.660519 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 981/1966] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:14 2022] POST /identity/v3/users => generated 303 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:45:14.662891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3abe9-c56b-4a53-ab01-0aad97094139 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.682429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3abe9-c56b-4a53-ab01-0aad97094139 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.688366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c45d4e-e941-4f52-9903-224d2f3d4c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.689043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c45d4e-e941-4f52-9903-224d2f3d4c33 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.689325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c45d4e-e941-4f52-9903-224d2f3d4c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.689637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c45d4e-e941-4f52-9903-224d2f3d4c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.690399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c45d4e-e941-4f52-9903-224d2f3d4c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.692139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c45d4e-e941-4f52-9903-224d2f3d4c33 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.706030 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 986/1967] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:14.712969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaf6bb-ca37-4569-8909-8e388adda22d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.725133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaf6bb-ca37-4569-8909-8e388adda22d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.731470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e96709-45af-4d77-b919-22d137565fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.732203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96709-45af-4d77-b919-22d137565fac admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.732487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96709-45af-4d77-b919-22d137565fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.732833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96709-45af-4d77-b919-22d137565fac admin admin] PATH_INFO: `/v3/projects/d279e4460db6474ba22c9ae268869387/users/932320e983c947018f1a5fc2e208976e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.753274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e96709-45af-4d77-b919-22d137565fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d279e4460db6474ba22c9ae268869387, user_id=932320e983c947018f1a5fc2e208976e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.756038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e96709-45af-4d77-b919-22d137565fac admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.773500 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 982/1968] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:14 2022] PUT /identity/v3/projects/d279e4460db6474ba22c9ae268869387/users/932320e983c947018f1a5fc2e208976e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:14.778053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c45d4e-e941-4f52-9903-224d2f3d4c33 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.789052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c45d4e-e941-4f52-9903-224d2f3d4c33 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.864787 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:14.881950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851167d-d2a3-49f6-a5e1-0703484ee18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.882813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851167d-d2a3-49f6-a5e1-0703484ee18a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.883034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851167d-d2a3-49f6-a5e1-0703484ee18a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.884483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851167d-d2a3-49f6-a5e1-0703484ee18a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.885309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851167d-d2a3-49f6-a5e1-0703484ee18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.887078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851167d-d2a3-49f6-a5e1-0703484ee18a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.899221 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 987/1969] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:14.904434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e96709-45af-4d77-b919-22d137565fac admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:14.917760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e96709-45af-4d77-b919-22d137565fac admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:14.923010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556323a-44c9-4e6d-8871-39c600c16f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:14.923825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556323a-44c9-4e6d-8871-39c600c16f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.924107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556323a-44c9-4e6d-8871-39c600c16f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.924382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556323a-44c9-4e6d-8871-39c600c16f0a admin admin] PATH_INFO: `/v3/projects/d279e4460db6474ba22c9ae268869387/users/932320e983c947018f1a5fc2e208976e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:14.932345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556323a-44c9-4e6d-8871-39c600c16f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d279e4460db6474ba22c9ae268869387, user_id=932320e983c947018f1a5fc2e208976e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:14.935189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556323a-44c9-4e6d-8871-39c600c16f0a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:14.948454 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 983/1970] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:14 2022] PUT /identity/v3/projects/d279e4460db6474ba22c9ae268869387/users/932320e983c947018f1a5fc2e208976e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:14.959945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e8146-6db4-4b30-a97b-25dc91e065ec None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:14.960377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e8146-6db4-4b30-a97b-25dc91e065ec None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:14.960481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e8146-6db4-4b30-a97b-25dc91e065ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:15.001588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f1184-0286-4386-b779-b78735582241 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:15.001588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f1184-0286-4386-b779-b78735582241 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:15.001588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f1184-0286-4386-b779-b78735582241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:15.013227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-002e8146-6db4-4b30-a97b-25dc91e065ec None None] MFA Rules not processed for user `932320e983c947018f1a5fc2e208976e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:15.014560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-002e8146-6db4-4b30-a97b-25dc91e065ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:15.025060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-712f1184-0286-4386-b779-b78735582241 None None] MFA Rules not processed for user `0ba955efddd645e8ada9987c22bc52ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:15.026630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-712f1184-0286-4386-b779-b78735582241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:15.158976 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 988/1971] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:15.170770 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 984/1972] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:15.373615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e8146-6db4-4b30-a97b-25dc91e065ec None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:15.469895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e8146-6db4-4b30-a97b-25dc91e065ec None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:15.476185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5706-3ff3-48fc-8bb9-e597421893b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:15.478168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5706-3ff3-48fc-8bb9-e597421893b2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:15.478442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5706-3ff3-48fc-8bb9-e597421893b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:15.478767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5706-3ff3-48fc-8bb9-e597421893b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:15.489164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa5706-3ff3-48fc-8bb9-e597421893b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:15.491581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa5706-3ff3-48fc-8bb9-e597421893b2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:15.502330 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 989/1973] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:15 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:15.849264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f1184-0286-4386-b779-b78735582241 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:15.898381 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:15.928800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f1184-0286-4386-b779-b78735582241 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:15.935743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:15.936418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:15.936763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:15.937006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] PATH_INFO: `/v3/users/b3d2f8e058a745adadee164b9df0406d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:15.938187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d2f8e058a745adadee164b9df0406d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:15.940155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:16.011879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d2f8e058a745adadee164b9df0406d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:16.029944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d2f8e058a745adadee164b9df0406d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:16.049898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d2f8e058a745adadee164b9df0406d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:16.076698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d2f8e058a745adadee164b9df0406d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:16.077671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d2f8e058a745adadee164b9df0406d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:16.091917 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 985/1974] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:15 2022] DELETE /identity/v3/users/b3d2f8e058a745adadee164b9df0406d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:16.095560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac796e-b992-4eca-ad55-4707f741f1a2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:16.096094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac796e-b992-4eca-ad55-4707f741f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:16.096230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac796e-b992-4eca-ad55-4707f741f1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:16.120514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1bac796e-b992-4eca-ad55-4707f741f1a2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:16.122796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1bac796e-b992-4eca-ad55-4707f741f1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:16.219409 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:16.257074 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 990/1975] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:16.267752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:16.283419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:16.440389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5e4a-1a0d-48ce-9993-b6d8bd38fe86 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:16.444291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4223e6c-5fc9-4ab8-85f7-b75f49ce63fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:16.445049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4223e6c-5fc9-4ab8-85f7-b75f49ce63fa service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:16.446437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4223e6c-5fc9-4ab8-85f7-b75f49ce63fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:16.450996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4223e6c-5fc9-4ab8-85f7-b75f49ce63fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:16.478228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4223e6c-5fc9-4ab8-85f7-b75f49ce63fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:16.484386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4223e6c-5fc9-4ab8-85f7-b75f49ce63fa service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:16.505499 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 986/1976] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:17.224053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac796e-b992-4eca-ad55-4707f741f1a2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:17.225525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1bac796e-b992-4eca-ad55-4707f741f1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:17.238397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac796e-b992-4eca-ad55-4707f741f1a2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:17.245895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:17.246546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:17.246824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:17.247096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] PATH_INFO: `/v3/projects/bb37aacf1c5a449997eaad713e369387` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:17.248222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb37aacf1c5a449997eaad713e369387)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:17.251141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:17.327409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb37aacf1c5a449997eaad713e369387', 'request_id': 'req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.342590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb37aacf1c5a449997eaad713e369387', 'request_id': 'req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.354920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb37aacf1c5a449997eaad713e369387', 'request_id': 'req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.370196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] The token cache is being invalidate because project bb37aacf1c5a449997eaad713e369387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:17.370485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.372117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5446101-f9c8-4c7d-a25a-f0780dc73a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.374679 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 991/1977] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:17 2022] DELETE /identity/v3/projects/bb37aacf1c5a449997eaad713e369387 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:17.380015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4223e6c-5fc9-4ab8-85f7-b75f49ce63fa service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:17.397207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4223e6c-5fc9-4ab8-85f7-b75f49ce63fa service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:17.544086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:17.545119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:17.545399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:17.545673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] PATH_INFO: `/v3/users/932320e983c947018f1a5fc2e208976e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:17.546822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932320e983c947018f1a5fc2e208976e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:17.548802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:17.550796 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:17.609490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932320e983c947018f1a5fc2e208976e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.623741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932320e983c947018f1a5fc2e208976e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.631023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932320e983c947018f1a5fc2e208976e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.638244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932320e983c947018f1a5fc2e208976e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.638929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fca06b78-1b41-4b16-98a7-424fbe4bd488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932320e983c947018f1a5fc2e208976e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:17.645457 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 987/1978] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:17 2022] DELETE /identity/v3/users/932320e983c947018f1a5fc2e208976e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:17.739456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9513-f07a-4110-89f8-289edb117689 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:17.739833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9513-f07a-4110-89f8-289edb117689 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:17.740310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9513-f07a-4110-89f8-289edb117689 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:17.741764 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 992/1979] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:45:17.747921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d8956-adf4-4e50-aea3-d3d6a1e93f06 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:17.748336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d8956-adf4-4e50-aea3-d3d6a1e93f06 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:17.748781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d8956-adf4-4e50-aea3-d3d6a1e93f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:17.780125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d34d8956-adf4-4e50-aea3-d3d6a1e93f06 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:17.782146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d34d8956-adf4-4e50-aea3-d3d6a1e93f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:17.902240 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 988/1980] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:45:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:17.923377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9513-f07a-4110-89f8-289edb117689 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:17.925653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-27ff9513-f07a-4110-89f8-289edb117689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:17.998567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9513-f07a-4110-89f8-289edb117689 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:18.010668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df383e6-7d77-42c4-b370-67a478a673a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:18.012117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df383e6-7d77-42c4-b370-67a478a673a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:18.012117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df383e6-7d77-42c4-b370-67a478a673a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:18.012588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df383e6-7d77-42c4-b370-67a478a673a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:18.029144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df383e6-7d77-42c4-b370-67a478a673a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:18.030847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df383e6-7d77-42c4-b370-67a478a673a0 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:18.047768 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 993/1981] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:18.075383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009c4a-c213-46bd-bd0d-f88b798bcfde None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:18.075699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009c4a-c213-46bd-bd0d-f88b798bcfde None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:18.076183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009c4a-c213-46bd-bd0d-f88b798bcfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:18.104852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-03009c4a-c213-46bd-bd0d-f88b798bcfde None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:18.106085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-03009c4a-c213-46bd-bd0d-f88b798bcfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:18.114028 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 989/1982] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:45:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:18.133712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df383e6-7d77-42c4-b370-67a478a673a0 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:18.143396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df383e6-7d77-42c4-b370-67a478a673a0 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:18.147867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2b3e-79d2-4451-85fc-0d071f7764e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:18.148576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2b3e-79d2-4451-85fc-0d071f7764e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:18.149564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2b3e-79d2-4451-85fc-0d071f7764e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:18.150114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2b3e-79d2-4451-85fc-0d071f7764e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:18.158844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2b3e-79d2-4451-85fc-0d071f7764e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:18.160608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2b3e-79d2-4451-85fc-0d071f7764e7 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:18.170372 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 994/1983] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:18.261595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009c4a-c213-46bd-bd0d-f88b798bcfde None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:18.263165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-03009c4a-c213-46bd-bd0d-f88b798bcfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:18.428338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009c4a-c213-46bd-bd0d-f88b798bcfde None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:18.436540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:18.437684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:18.438125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:18.438549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] PATH_INFO: `/v3/projects/d279e4460db6474ba22c9ae268869387` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:18.440207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d279e4460db6474ba22c9ae268869387)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:18.443635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:18.461973 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:18.548410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd279e4460db6474ba22c9ae268869387', 'request_id': 'req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:18.562001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd279e4460db6474ba22c9ae268869387', 'request_id': 'req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:18.571921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd279e4460db6474ba22c9ae268869387', 'request_id': 'req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:18.609586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] The token cache is being invalidate because project d279e4460db6474ba22c9ae268869387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:18.610034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:18.610996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e5f696f-0856-4e12-bc91-f1fcd930a5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:18.616816 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 990/1984] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:18 2022] DELETE /identity/v3/projects/d279e4460db6474ba22c9ae268869387 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:18.620274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e8065-99ed-4ece-b153-d891a5defb7b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:18.620884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e8065-99ed-4ece-b153-d891a5defb7b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:18.620884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e8065-99ed-4ece-b153-d891a5defb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:18.667884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-479e8065-99ed-4ece-b153-d891a5defb7b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:18.669338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-479e8065-99ed-4ece-b153-d891a5defb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:18.806562 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 995/1985] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:18.808234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919eec0-f6c5-4efd-baa4-c8e08eb078f5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:18.808517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919eec0-f6c5-4efd-baa4-c8e08eb078f5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:18.808799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919eec0-f6c5-4efd-baa4-c8e08eb078f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:18.850934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2919eec0-f6c5-4efd-baa4-c8e08eb078f5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:18.854962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2919eec0-f6c5-4efd-baa4-c8e08eb078f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:18.881268 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 991/1986] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:18.886400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e8065-99ed-4ece-b153-d891a5defb7b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:18.907278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e8065-99ed-4ece-b153-d891a5defb7b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:18.933172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6653f-2eb9-40f0-a01d-e9930146c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:18.934103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6653f-2eb9-40f0-a01d-e9930146c1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:18.934582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6653f-2eb9-40f0-a01d-e9930146c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:18.934920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6653f-2eb9-40f0-a01d-e9930146c1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:18.935665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6653f-2eb9-40f0-a01d-e9930146c1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:18.936749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6653f-2eb9-40f0-a01d-e9930146c1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:18.939604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6653f-2eb9-40f0-a01d-e9930146c1c1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:18.941730 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:18.960264 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 996/1987] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:18.965901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919eec0-f6c5-4efd-baa4-c8e08eb078f5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:18.982368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919eec0-f6c5-4efd-baa4-c8e08eb078f5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:18.988865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266c264-1653-4891-a207-0ff4ca60ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:18.989778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266c264-1653-4891-a207-0ff4ca60ab82 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:18.989778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266c264-1653-4891-a207-0ff4ca60ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:18.990043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266c264-1653-4891-a207-0ff4ca60ab82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:18.990685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266c264-1653-4891-a207-0ff4ca60ab82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:18.993750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266c264-1653-4891-a207-0ff4ca60ab82 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:19.042303 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 992/1988] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:18 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:19.052279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6653f-2eb9-40f0-a01d-e9930146c1c1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.071545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6653f-2eb9-40f0-a01d-e9930146c1c1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:19.174410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03b25e-9e92-48e3-bc79-d52e1c0f8c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:19.174959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03b25e-9e92-48e3-bc79-d52e1c0f8c56 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:19.175341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03b25e-9e92-48e3-bc79-d52e1c0f8c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:19.175626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03b25e-9e92-48e3-bc79-d52e1c0f8c56 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:19.176714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03b25e-9e92-48e3-bc79-d52e1c0f8c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:19.178828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03b25e-9e92-48e3-bc79-d52e1c0f8c56 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:19.204056 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 997/1989] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:19 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:19.208062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266c264-1653-4891-a207-0ff4ca60ab82 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.221778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266c264-1653-4891-a207-0ff4ca60ab82 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:19.228186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16090a7-619e-431d-a9e2-3db0dcde5943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:19.228864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16090a7-619e-431d-a9e2-3db0dcde5943 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:19.229148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16090a7-619e-431d-a9e2-3db0dcde5943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:19.229422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16090a7-619e-431d-a9e2-3db0dcde5943 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:19.230086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16090a7-619e-431d-a9e2-3db0dcde5943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:19.231714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16090a7-619e-431d-a9e2-3db0dcde5943 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:19.244412 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 993/1990] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:19.248251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03b25e-9e92-48e3-bc79-d52e1c0f8c56 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.261901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03b25e-9e92-48e3-bc79-d52e1c0f8c56 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:19.266989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89ba7f-7f68-4152-bc38-f4c145192043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:19.267674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ba7f-7f68-4152-bc38-f4c145192043 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:19.267960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ba7f-7f68-4152-bc38-f4c145192043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:19.268434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ba7f-7f68-4152-bc38-f4c145192043 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:19.269151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89ba7f-7f68-4152-bc38-f4c145192043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:19.270932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89ba7f-7f68-4152-bc38-f4c145192043 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:19.285171 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 998/1991] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:19.288306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16090a7-619e-431d-a9e2-3db0dcde5943 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.300841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16090a7-619e-431d-a9e2-3db0dcde5943 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:19.309387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446bdd5-c3a3-49dc-8efb-af7b646b6138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:19.310260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446bdd5-c3a3-49dc-8efb-af7b646b6138 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:19.310545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446bdd5-c3a3-49dc-8efb-af7b646b6138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:19.310821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446bdd5-c3a3-49dc-8efb-af7b646b6138 admin admin] PATH_INFO: `/v3/projects/e0ee493430f849718083118f0a4e61c0/users/e94cc0780af240188e5024335e581dea/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:19.330276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446bdd5-c3a3-49dc-8efb-af7b646b6138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ee493430f849718083118f0a4e61c0, user_id=e94cc0780af240188e5024335e581dea, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:19.333835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446bdd5-c3a3-49dc-8efb-af7b646b6138 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:19.350758 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 994/1992] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:19 2022] PUT /identity/v3/projects/e0ee493430f849718083118f0a4e61c0/users/e94cc0780af240188e5024335e581dea/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:19.365816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e520a5-9aa7-4629-9634-b49af7f5a3b2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:19.366248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e520a5-9aa7-4629-9634-b49af7f5a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:19.367407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e520a5-9aa7-4629-9634-b49af7f5a3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:19.400868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-90e520a5-9aa7-4629-9634-b49af7f5a3b2 None None] MFA Rules not processed for user `e94cc0780af240188e5024335e581dea`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:19.402164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-90e520a5-9aa7-4629-9634-b49af7f5a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:19.504662 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 999/1993] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:19.509566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446bdd5-c3a3-49dc-8efb-af7b646b6138 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.604472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446bdd5-c3a3-49dc-8efb-af7b646b6138 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:19.611280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1206d-0718-4e37-8ca5-d071a8d362dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:19.612947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1206d-0718-4e37-8ca5-d071a8d362dd admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:19.613255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1206d-0718-4e37-8ca5-d071a8d362dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:19.613584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1206d-0718-4e37-8ca5-d071a8d362dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:19.614402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1206d-0718-4e37-8ca5-d071a8d362dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:19.616409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1206d-0718-4e37-8ca5-d071a8d362dd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:19.685625 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 995/1994] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:19 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:19.687128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e520a5-9aa7-4629-9634-b49af7f5a3b2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.706085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e520a5-9aa7-4629-9634-b49af7f5a3b2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:19.805938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e80e9-3f19-4c73-8938-57f2ea0fab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:19.806799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e80e9-3f19-4c73-8938-57f2ea0fab58 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:19.807261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e80e9-3f19-4c73-8938-57f2ea0fab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:19.807558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e80e9-3f19-4c73-8938-57f2ea0fab58 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:19.808329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e80e9-3f19-4c73-8938-57f2ea0fab58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:19.810428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e80e9-3f19-4c73-8938-57f2ea0fab58 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:19.826332 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:19.848688 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1000/1995] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:19 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:19.852866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1206d-0718-4e37-8ca5-d071a8d362dd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.864192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1206d-0718-4e37-8ca5-d071a8d362dd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:19.870248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ee069-077a-48ba-bbc6-ea5e0f631c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:19.870888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ee069-077a-48ba-bbc6-ea5e0f631c5b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:19.871165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ee069-077a-48ba-bbc6-ea5e0f631c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:19.871493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ee069-077a-48ba-bbc6-ea5e0f631c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:19.872158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ee069-077a-48ba-bbc6-ea5e0f631c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:19.873853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ee069-077a-48ba-bbc6-ea5e0f631c5b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:19.888225 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 996/1996] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:19.893106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e80e9-3f19-4c73-8938-57f2ea0fab58 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.904542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e80e9-3f19-4c73-8938-57f2ea0fab58 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:19.909600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369ca56-9681-49c2-91e0-0597affec9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:19.910274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369ca56-9681-49c2-91e0-0597affec9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:19.910556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369ca56-9681-49c2-91e0-0597affec9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:19.910834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369ca56-9681-49c2-91e0-0597affec9d8 admin admin] PATH_INFO: `/v3/projects/3f086c8824d84edd98b3c5ca4f6b7f72/users/59d367cbc5374d16b0f8b140e2f5c271/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:19.929381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369ca56-9681-49c2-91e0-0597affec9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f086c8824d84edd98b3c5ca4f6b7f72, user_id=59d367cbc5374d16b0f8b140e2f5c271, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:19.932272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369ca56-9681-49c2-91e0-0597affec9d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:19.948640 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1001/1997] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:19 2022] PUT /identity/v3/projects/3f086c8824d84edd98b3c5ca4f6b7f72/users/59d367cbc5374d16b0f8b140e2f5c271/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:19.952779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ee069-077a-48ba-bbc6-ea5e0f631c5b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:19.960196 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:19.965624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ee069-077a-48ba-bbc6-ea5e0f631c5b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:20.038791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c02e92-dd4f-4b5b-aa18-037ecde04887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:20.039744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c02e92-dd4f-4b5b-aa18-037ecde04887 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:20.040122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c02e92-dd4f-4b5b-aa18-037ecde04887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:20.040873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c02e92-dd4f-4b5b-aa18-037ecde04887 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:20.041283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c02e92-dd4f-4b5b-aa18-037ecde04887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:20.049313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c02e92-dd4f-4b5b-aa18-037ecde04887 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:20.068454 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 997/1998] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:20.071958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369ca56-9681-49c2-91e0-0597affec9d8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:20.084102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369ca56-9681-49c2-91e0-0597affec9d8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:20.096024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bde14d-1346-411a-a3e8-de104e9f1dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:20.096769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bde14d-1346-411a-a3e8-de104e9f1dba admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:20.097061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bde14d-1346-411a-a3e8-de104e9f1dba admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:20.099544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bde14d-1346-411a-a3e8-de104e9f1dba admin admin] PATH_INFO: `/v3/projects/3f086c8824d84edd98b3c5ca4f6b7f72/users/59d367cbc5374d16b0f8b140e2f5c271/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:20.100867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bde14d-1346-411a-a3e8-de104e9f1dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f086c8824d84edd98b3c5ca4f6b7f72, user_id=59d367cbc5374d16b0f8b140e2f5c271, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:20.104123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bde14d-1346-411a-a3e8-de104e9f1dba admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:20.116370 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1002/1999] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:20 2022] PUT /identity/v3/projects/3f086c8824d84edd98b3c5ca4f6b7f72/users/59d367cbc5374d16b0f8b140e2f5c271/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:20.129335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ef45d-922d-4959-9d27-eec840f1d292 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:20.129885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ef45d-922d-4959-9d27-eec840f1d292 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:20.130339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ef45d-922d-4959-9d27-eec840f1d292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:20.168584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d44ef45d-922d-4959-9d27-eec840f1d292 None None] MFA Rules not processed for user `59d367cbc5374d16b0f8b140e2f5c271`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:20.170065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d44ef45d-922d-4959-9d27-eec840f1d292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:20.254699 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 998/2000] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:20.266091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca480f-a92e-4aaf-beda-737a3f489d8d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:20.267266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca480f-a92e-4aaf-beda-737a3f489d8d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:20.267655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca480f-a92e-4aaf-beda-737a3f489d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:20.319153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5aca480f-a92e-4aaf-beda-737a3f489d8d None None] MFA Rules not processed for user `e94cc0780af240188e5024335e581dea`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:20.328284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5aca480f-a92e-4aaf-beda-737a3f489d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:20.441230 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1003/2001] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:20.880287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ef45d-922d-4959-9d27-eec840f1d292 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:20.882232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d44ef45d-922d-4959-9d27-eec840f1d292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:20.984563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ef45d-922d-4959-9d27-eec840f1d292 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:20.991496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e5e42-e9a3-4d26-b3ec-0d1b3c6cf782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:20.992952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e5e42-e9a3-4d26-b3ec-0d1b3c6cf782 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:20.993315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e5e42-e9a3-4d26-b3ec-0d1b3c6cf782 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:20.993755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e5e42-e9a3-4d26-b3ec-0d1b3c6cf782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:21.005354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e5e42-e9a3-4d26-b3ec-0d1b3c6cf782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:21.008227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e5e42-e9a3-4d26-b3ec-0d1b3c6cf782 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:21.021966 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 999/2002] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:21.551318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409267d-9fc4-4d5f-9495-61f013991ef0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:21.552372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409267d-9fc4-4d5f-9495-61f013991ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:21.552891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409267d-9fc4-4d5f-9495-61f013991ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:21.602315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8409267d-9fc4-4d5f-9495-61f013991ef0 None None] MFA Rules not processed for user `e94cc0780af240188e5024335e581dea`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:21.607059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8409267d-9fc4-4d5f-9495-61f013991ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:21.643589 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1004/2003] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:28.293701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaa91a-a999-4acc-be65-ad99368bf134 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:28.295110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaa91a-a999-4acc-be65-ad99368bf134 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:28.295389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaa91a-a999-4acc-be65-ad99368bf134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:28.329902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9acaa91a-a999-4acc-be65-ad99368bf134 None None] MFA Rules not processed for user `729379ca02904136b0d5c96d6b28c490`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:28.332219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9acaa91a-a999-4acc-be65-ad99368bf134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:28.341998 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:28.450119 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1000/2004] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:31.588874 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=4,keystone:SELECT=45 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:38.078949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409267d-9fc4-4d5f-9495-61f013991ef0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:38.080493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8409267d-9fc4-4d5f-9495-61f013991ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:38.165929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409267d-9fc4-4d5f-9495-61f013991ef0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:38.171680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:38.172332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:38.172641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:38.172984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] PATH_INFO: `/v3/users/97fb5d3a021149d4a90bef39a518ada2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:38.174600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fb5d3a021149d4a90bef39a518ada2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:38.188389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:38.219522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160ce1-bec1-4ca0-a64c-777e25257f4f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:38.220372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160ce1-bec1-4ca0-a64c-777e25257f4f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:38.220747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160ce1-bec1-4ca0-a64c-777e25257f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:38.241736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ad160ce1-bec1-4ca0-a64c-777e25257f4f None None] MFA Rules not processed for user `c5bef756c5c74e688ded867d98a6d29a`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:38.243518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ad160ce1-bec1-4ca0-a64c-777e25257f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:38.297396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fb5d3a021149d4a90bef39a518ada2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:38.338994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fb5d3a021149d4a90bef39a518ada2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:38.357512 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1001/2005] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:38.362956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fb5d3a021149d4a90bef39a518ada2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:38.375426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fb5d3a021149d4a90bef39a518ada2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:38.377281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fb5d3a021149d4a90bef39a518ada2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:38.393877 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1005/2006] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:38 2022] DELETE /identity/v3/users/97fb5d3a021149d4a90bef39a518ada2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:38.400089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dd573-bcf0-47ad-8452-531041719cfe None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:38.401101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dd573-bcf0-47ad-8452-531041719cfe None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:38.401441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dd573-bcf0-47ad-8452-531041719cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:38.444280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-963dd573-bcf0-47ad-8452-531041719cfe None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:38.448475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-963dd573-bcf0-47ad-8452-531041719cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:38.561371 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1002/2007] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:38.577686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:38.580072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:38.651206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0468-b893-4229-a3ad-a255f68995fb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:38.654824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba1114-7341-4958-ae60-1343f6ce88a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:38.655443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba1114-7341-4958-ae60-1343f6ce88a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:38.655721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba1114-7341-4958-ae60-1343f6ce88a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:38.655993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba1114-7341-4958-ae60-1343f6ce88a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:38.666882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba1114-7341-4958-ae60-1343f6ce88a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:38.669092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba1114-7341-4958-ae60-1343f6ce88a6 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:38.681708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1006/2008] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:38.873628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dd573-bcf0-47ad-8452-531041719cfe None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:38.874871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-963dd573-bcf0-47ad-8452-531041719cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:38.891890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dd573-bcf0-47ad-8452-531041719cfe None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:38.897640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:38.898949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:38.899228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:38.899467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] PATH_INFO: `/v3/projects/b553e8276e214de6b1fa6db1fb52e6a9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:38.905876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b553e8276e214de6b1fa6db1fb52e6a9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:38.907836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:38.982814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b553e8276e214de6b1fa6db1fb52e6a9', 'request_id': 'req-0070337c-6616-4c75-85b5-23b6d9478fe5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:38.999912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b553e8276e214de6b1fa6db1fb52e6a9', 'request_id': 'req-0070337c-6616-4c75-85b5-23b6d9478fe5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.001717 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:39.016578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b553e8276e214de6b1fa6db1fb52e6a9', 'request_id': 'req-0070337c-6616-4c75-85b5-23b6d9478fe5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.030738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] The token cache is being invalidate because project b553e8276e214de6b1fa6db1fb52e6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:39.031029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.031732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.033564 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1003/2009] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:38 2022] DELETE /identity/v3/projects/b553e8276e214de6b1fa6db1fb52e6a9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:39.037638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba1114-7341-4958-ae60-1343f6ce88a6 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:39.055425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba1114-7341-4958-ae60-1343f6ce88a6 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:39.078380 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:39.145259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:39.145812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:39.146199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:39.146499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] PATH_INFO: `/v3/users/a37341e416ed42dfbe9b34a4e5ff2ba9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:39.148588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37341e416ed42dfbe9b34a4e5ff2ba9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:39.151070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:39.213694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37341e416ed42dfbe9b34a4e5ff2ba9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.229109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37341e416ed42dfbe9b34a4e5ff2ba9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.238648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37341e416ed42dfbe9b34a4e5ff2ba9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.253179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37341e416ed42dfbe9b34a4e5ff2ba9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.260514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41445b6f-fcdc-4976-9b32-776d1c28812e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37341e416ed42dfbe9b34a4e5ff2ba9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.292952 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1007/2010] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:39 2022] DELETE /identity/v3/users/a37341e416ed42dfbe9b34a4e5ff2ba9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:39.569120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:39.570591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:39.593400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070337c-6616-4c75-85b5-23b6d9478fe5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:39.690849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:39.691956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:39.692310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:39.692595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] PATH_INFO: `/v3/projects/4cd0a5bce77f4182967d71e36658224f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:39.693985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd0a5bce77f4182967d71e36658224f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:39.696393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:39.792468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd0a5bce77f4182967d71e36658224f', 'request_id': 'req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.805695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd0a5bce77f4182967d71e36658224f', 'request_id': 'req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.814452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd0a5bce77f4182967d71e36658224f', 'request_id': 'req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.840030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] The token cache is being invalidate because project 4cd0a5bce77f4182967d71e36658224f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:39.840358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.844356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-51ae0e2a-ceb7-432c-8a8b-c24ae6a0437d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:39.853163 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1004/2011] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:39 2022] DELETE /identity/v3/projects/4cd0a5bce77f4182967d71e36658224f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:39.854964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26328ad-d2f7-4900-a66e-9eb8767252fd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:39.855256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26328ad-d2f7-4900-a66e-9eb8767252fd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:39.855536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26328ad-d2f7-4900-a66e-9eb8767252fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:39.889028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a26328ad-d2f7-4900-a66e-9eb8767252fd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:39.890561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a26328ad-d2f7-4900-a66e-9eb8767252fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:39.967971 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1008/2012] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:39.976203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f9861-0be7-4457-8f11-2bf90aeda128 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:39.976493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f9861-0be7-4457-8f11-2bf90aeda128 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:39.976796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f9861-0be7-4457-8f11-2bf90aeda128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.007101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dc8f9861-0be7-4457-8f11-2bf90aeda128 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:40.009512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dc8f9861-0be7-4457-8f11-2bf90aeda128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:40.023695 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1005/2013] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:40.029756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26328ad-d2f7-4900-a66e-9eb8767252fd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.041990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26328ad-d2f7-4900-a66e-9eb8767252fd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.047422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b1d7f-adc0-4976-8dba-3ad5a50e77c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.048006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b1d7f-adc0-4976-8dba-3ad5a50e77c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.048287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b1d7f-adc0-4976-8dba-3ad5a50e77c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.048566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b1d7f-adc0-4976-8dba-3ad5a50e77c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.049250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b1d7f-adc0-4976-8dba-3ad5a50e77c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:40.049553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b1d7f-adc0-4976-8dba-3ad5a50e77c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.051173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b1d7f-adc0-4976-8dba-3ad5a50e77c0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:40.077112 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1009/2014] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:40.078170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f9861-0be7-4457-8f11-2bf90aeda128 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.088596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f9861-0be7-4457-8f11-2bf90aeda128 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.094358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d9855-4eed-4351-b7b3-3612b68383ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.094992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d9855-4eed-4351-b7b3-3612b68383ee admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.095280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d9855-4eed-4351-b7b3-3612b68383ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.095567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d9855-4eed-4351-b7b3-3612b68383ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.096196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d9855-4eed-4351-b7b3-3612b68383ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.098150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d9855-4eed-4351-b7b3-3612b68383ee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:40.133936 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1006/2015] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:40 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:40.135782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b1d7f-adc0-4976-8dba-3ad5a50e77c0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.147471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b1d7f-adc0-4976-8dba-3ad5a50e77c0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.188966 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:40.273517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade4f1c-542c-495d-a5d8-3830b6b42432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.274291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade4f1c-542c-495d-a5d8-3830b6b42432 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.274659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade4f1c-542c-495d-a5d8-3830b6b42432 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.275079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade4f1c-542c-495d-a5d8-3830b6b42432 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.276477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade4f1c-542c-495d-a5d8-3830b6b42432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.279179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade4f1c-542c-495d-a5d8-3830b6b42432 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:40.320840 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1010/2016] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:40 2022] POST /identity/v3/users => generated 280 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:45:40.324228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d9855-4eed-4351-b7b3-3612b68383ee admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.342158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d9855-4eed-4351-b7b3-3612b68383ee admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.351694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f359f6-a1ae-4caa-95bf-f25e5c0d6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.352515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f359f6-a1ae-4caa-95bf-f25e5c0d6402 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.353045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f359f6-a1ae-4caa-95bf-f25e5c0d6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.353205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f359f6-a1ae-4caa-95bf-f25e5c0d6402 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.353902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f359f6-a1ae-4caa-95bf-f25e5c0d6402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.356346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f359f6-a1ae-4caa-95bf-f25e5c0d6402 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:40.376195 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1007/2017] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:45:40.380725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade4f1c-542c-495d-a5d8-3830b6b42432 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.400236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade4f1c-542c-495d-a5d8-3830b6b42432 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.409575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e485a-72a0-43b3-b87d-16aa2d82cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.410721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e485a-72a0-43b3-b87d-16aa2d82cdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.411280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e485a-72a0-43b3-b87d-16aa2d82cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.411784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e485a-72a0-43b3-b87d-16aa2d82cdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.414080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e485a-72a0-43b3-b87d-16aa2d82cdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.418443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e485a-72a0-43b3-b87d-16aa2d82cdb9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:40.439566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1011/2018] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:40.445425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f359f6-a1ae-4caa-95bf-f25e5c0d6402 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.477396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f359f6-a1ae-4caa-95bf-f25e5c0d6402 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.477396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5913b0-0861-4600-9d54-0671dcef8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.477396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5913b0-0861-4600-9d54-0671dcef8072 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.477396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5913b0-0861-4600-9d54-0671dcef8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.478017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5913b0-0861-4600-9d54-0671dcef8072 admin admin] PATH_INFO: `/v3/projects/2089381b5f9d4f9082d374bdee46a0f9/users/a03dd64efab849a582b712a0ba58623a/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.504696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5913b0-0861-4600-9d54-0671dcef8072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2089381b5f9d4f9082d374bdee46a0f9, user_id=a03dd64efab849a582b712a0ba58623a, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.508012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5913b0-0861-4600-9d54-0671dcef8072 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:40.524058 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1008/2019] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:40 2022] PUT /identity/v3/projects/2089381b5f9d4f9082d374bdee46a0f9/users/a03dd64efab849a582b712a0ba58623a/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:40.536151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e9fd0-cb74-40d7-846e-900ebff92112 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.536443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e9fd0-cb74-40d7-846e-900ebff92112 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.536761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e9fd0-cb74-40d7-846e-900ebff92112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.571467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6f2e9fd0-cb74-40d7-846e-900ebff92112 None None] MFA Rules not processed for user `a03dd64efab849a582b712a0ba58623a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:40.572760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6f2e9fd0-cb74-40d7-846e-900ebff92112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:40.658496 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1012/2020] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:40.659701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5913b0-0861-4600-9d54-0671dcef8072 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.675092 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:40.735733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5913b0-0861-4600-9d54-0671dcef8072 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.740805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9c1e-e314-4bd0-afd8-732d2495a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.741959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9c1e-e314-4bd0-afd8-732d2495a892 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.742473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9c1e-e314-4bd0-afd8-732d2495a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.742728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9c1e-e314-4bd0-afd8-732d2495a892 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.743522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9c1e-e314-4bd0-afd8-732d2495a892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.745484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9c1e-e314-4bd0-afd8-732d2495a892 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:40.775603 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1009/2021] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:40 2022] POST /identity/v3/projects => generated 361 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:40.781702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e9fd0-cb74-40d7-846e-900ebff92112 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.796438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e9fd0-cb74-40d7-846e-900ebff92112 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.883672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cee5e-6543-41d8-974a-9f4ce71ade81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.884298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cee5e-6543-41d8-974a-9f4ce71ade81 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.884573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cee5e-6543-41d8-974a-9f4ce71ade81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.884873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cee5e-6543-41d8-974a-9f4ce71ade81 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.885538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cee5e-6543-41d8-974a-9f4ce71ade81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.887521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cee5e-6543-41d8-974a-9f4ce71ade81 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:40.911083 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1013/2022] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:40 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:40.923384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9c1e-e314-4bd0-afd8-732d2495a892 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.935166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9c1e-e314-4bd0-afd8-732d2495a892 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.939851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d34399-b6c6-4fe8-90c0-473645df1b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.940459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d34399-b6c6-4fe8-90c0-473645df1b46 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.940764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d34399-b6c6-4fe8-90c0-473645df1b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.941036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d34399-b6c6-4fe8-90c0-473645df1b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.941672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d34399-b6c6-4fe8-90c0-473645df1b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.943312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d34399-b6c6-4fe8-90c0-473645df1b46 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:40.955715 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1010/2023] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:40.959889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cee5e-6543-41d8-974a-9f4ce71ade81 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:40.970099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cee5e-6543-41d8-974a-9f4ce71ade81 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:40.974701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21213827-b1fc-44ca-93ab-c294bfe0e427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:40.975348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21213827-b1fc-44ca-93ab-c294bfe0e427 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:40.975623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21213827-b1fc-44ca-93ab-c294bfe0e427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:40.975923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21213827-b1fc-44ca-93ab-c294bfe0e427 admin admin] PATH_INFO: `/v3/projects/08f03ca964be4654a53ebf78b1f09bb6/users/32b8cefe390847d689376c669b86292e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:40.991186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21213827-b1fc-44ca-93ab-c294bfe0e427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f03ca964be4654a53ebf78b1f09bb6, user_id=32b8cefe390847d689376c669b86292e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:40.994532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21213827-b1fc-44ca-93ab-c294bfe0e427 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:41.010743 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1014/2024] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:40 2022] PUT /identity/v3/projects/08f03ca964be4654a53ebf78b1f09bb6/users/32b8cefe390847d689376c669b86292e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:41.014842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d34399-b6c6-4fe8-90c0-473645df1b46 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:41.026230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d34399-b6c6-4fe8-90c0-473645df1b46 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:41.086419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab38f3-b1f2-498f-8d6a-05a631d3a990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:41.087046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab38f3-b1f2-498f-8d6a-05a631d3a990 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:41.087321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab38f3-b1f2-498f-8d6a-05a631d3a990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:41.087594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab38f3-b1f2-498f-8d6a-05a631d3a990 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:41.088239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab38f3-b1f2-498f-8d6a-05a631d3a990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:41.089877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab38f3-b1f2-498f-8d6a-05a631d3a990 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:41.101233 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1011/2025] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:41.105730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21213827-b1fc-44ca-93ab-c294bfe0e427 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:41.111435 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:41.119021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21213827-b1fc-44ca-93ab-c294bfe0e427 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:41.126196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b83ae-76b3-46ee-b564-a346c5e06d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:41.126651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b83ae-76b3-46ee-b564-a346c5e06d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:41.126935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b83ae-76b3-46ee-b564-a346c5e06d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:41.127213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b83ae-76b3-46ee-b564-a346c5e06d7d admin admin] PATH_INFO: `/v3/projects/08f03ca964be4654a53ebf78b1f09bb6/users/32b8cefe390847d689376c669b86292e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:41.129271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b83ae-76b3-46ee-b564-a346c5e06d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f03ca964be4654a53ebf78b1f09bb6, user_id=32b8cefe390847d689376c669b86292e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:41.132104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b83ae-76b3-46ee-b564-a346c5e06d7d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:41.144159 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1015/2026] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:41 2022] PUT /identity/v3/projects/08f03ca964be4654a53ebf78b1f09bb6/users/32b8cefe390847d689376c669b86292e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:41.154932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79317163-8ef2-44ec-80b0-f03b35089eb6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:41.155216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79317163-8ef2-44ec-80b0-f03b35089eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:41.155491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79317163-8ef2-44ec-80b0-f03b35089eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:41.185246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-79317163-8ef2-44ec-80b0-f03b35089eb6 None None] MFA Rules not processed for user `32b8cefe390847d689376c669b86292e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:41.186489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-79317163-8ef2-44ec-80b0-f03b35089eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:41.271660 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1012/2027] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:41.426001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b83ae-76b3-46ee-b564-a346c5e06d7d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:41.428902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f90b83ae-76b3-46ee-b564-a346c5e06d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:41.545581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b83ae-76b3-46ee-b564-a346c5e06d7d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:41.557453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba566b3a-a787-49c7-8a92-1f089f4b1bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:41.558215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba566b3a-a787-49c7-8a92-1f089f4b1bf6 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:41.558619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba566b3a-a787-49c7-8a92-1f089f4b1bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:41.559009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba566b3a-a787-49c7-8a92-1f089f4b1bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:41.572533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba566b3a-a787-49c7-8a92-1f089f4b1bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:41.574530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba566b3a-a787-49c7-8a92-1f089f4b1bf6 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:41.587214 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1016/2028] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:42.187305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1b2b-b9d8-417e-a05a-418ab5d946f9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:42.187868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1b2b-b9d8-417e-a05a-418ab5d946f9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:42.187868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1b2b-b9d8-417e-a05a-418ab5d946f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:42.202519 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:42.215156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f5bb1b2b-b9d8-417e-a05a-418ab5d946f9 None None] MFA Rules not processed for user `e94cc0780af240188e5024335e581dea`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:42.217869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f5bb1b2b-b9d8-417e-a05a-418ab5d946f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:42.291128 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1013/2029] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:43.475362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba566b3a-a787-49c7-8a92-1f089f4b1bf6 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:43.588479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba566b3a-a787-49c7-8a92-1f089f4b1bf6 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:43.597398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:43.598074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:43.598359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:43.599216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] PATH_INFO: `/v3/users/a03dd64efab849a582b712a0ba58623a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:43.604101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03dd64efab849a582b712a0ba58623a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:43.606104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:43.693954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03dd64efab849a582b712a0ba58623a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:43.720671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03dd64efab849a582b712a0ba58623a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:43.759451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03dd64efab849a582b712a0ba58623a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:43.767367 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:43.778062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03dd64efab849a582b712a0ba58623a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:43.779109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03dd64efab849a582b712a0ba58623a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:43.821381 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1017/2030] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:43 2022] DELETE /identity/v3/users/a03dd64efab849a582b712a0ba58623a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:43.825445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0ec30-c679-420a-aef2-72f161dd8d4c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:43.826004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0ec30-c679-420a-aef2-72f161dd8d4c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:43.826094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0ec30-c679-420a-aef2-72f161dd8d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:43.879219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-08c0ec30-c679-420a-aef2-72f161dd8d4c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:43.880895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-08c0ec30-c679-420a-aef2-72f161dd8d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:44.066158 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1014/2031] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:44.123840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:44.125314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:44.251050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a7b0e-473f-44c6-8604-8b133ea05de5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:44.257572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b7604-30a5-496a-a451-104af7f72bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:44.257572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b7604-30a5-496a-a451-104af7f72bcc service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:44.257801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b7604-30a5-496a-a451-104af7f72bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:44.258916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b7604-30a5-496a-a451-104af7f72bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:44.269650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b7604-30a5-496a-a451-104af7f72bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:44.273742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b7604-30a5-496a-a451-104af7f72bcc service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:44.285824 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1018/2032] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:44.978222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0ec30-c679-420a-aef2-72f161dd8d4c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:44.980183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-08c0ec30-c679-420a-aef2-72f161dd8d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:45.002352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0ec30-c679-420a-aef2-72f161dd8d4c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:45.024409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:45.025385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:45.025859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:45.026298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] PATH_INFO: `/v3/projects/2089381b5f9d4f9082d374bdee46a0f9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:45.027812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2089381b5f9d4f9082d374bdee46a0f9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:45.030364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:45.180143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2089381b5f9d4f9082d374bdee46a0f9', 'request_id': 'req-ae78b82a-9254-4d2b-8a8b-251140186e39'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.190497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2089381b5f9d4f9082d374bdee46a0f9', 'request_id': 'req-ae78b82a-9254-4d2b-8a8b-251140186e39'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.214473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2089381b5f9d4f9082d374bdee46a0f9', 'request_id': 'req-ae78b82a-9254-4d2b-8a8b-251140186e39'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.239799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] The token cache is being invalidate because project 2089381b5f9d4f9082d374bdee46a0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:45.240085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.244078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae78b82a-9254-4d2b-8a8b-251140186e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.249482 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1015/2033] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:44 2022] DELETE /identity/v3/projects/2089381b5f9d4f9082d374bdee46a0f9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:45.251661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b7604-30a5-496a-a451-104af7f72bcc service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:45.276086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b7604-30a5-496a-a451-104af7f72bcc service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:45.381132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:45.382034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:45.382236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:45.382985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] PATH_INFO: `/v3/users/32b8cefe390847d689376c669b86292e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:45.384468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b8cefe390847d689376c669b86292e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:45.386882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:45.490423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651505a0-aaa6-402d-ae04-e11b79592866 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:45.490776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651505a0-aaa6-402d-ae04-e11b79592866 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:45.491045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651505a0-aaa6-402d-ae04-e11b79592866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:45.520393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b8cefe390847d689376c669b86292e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.538544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-651505a0-aaa6-402d-ae04-e11b79592866 None None] MFA Rules not processed for user `a24b98f6af634c61af828bb20ce1e945`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:45.540944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-651505a0-aaa6-402d-ae04-e11b79592866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:45.563424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b8cefe390847d689376c669b86292e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.574948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b8cefe390847d689376c669b86292e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.582495 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:45.603410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b8cefe390847d689376c669b86292e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.604323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3bc8fe29-1351-4899-aef9-7d3dae5d4306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b8cefe390847d689376c669b86292e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:45.632799 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1019/2034] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:45 2022] DELETE /identity/v3/users/32b8cefe390847d689376c669b86292e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:45.635534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa29fb-0383-4cbd-910b-0b9ad5b374d7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:45.639566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa29fb-0383-4cbd-910b-0b9ad5b374d7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:45.640060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa29fb-0383-4cbd-910b-0b9ad5b374d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:45.692393 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1016/2035] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:45.736389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-deaa29fb-0383-4cbd-910b-0b9ad5b374d7 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:45.742759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-deaa29fb-0383-4cbd-910b-0b9ad5b374d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:45.783966 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:45.898064 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1020/2036] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:45:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:45.975419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651505a0-aaa6-402d-ae04-e11b79592866 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:45.977822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-651505a0-aaa6-402d-ae04-e11b79592866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:46.205003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651505a0-aaa6-402d-ae04-e11b79592866 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:46.351937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0e504-d31a-4054-a007-5c8cb01dd030 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:46.352277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa29fb-0383-4cbd-910b-0b9ad5b374d7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:46.353461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0e504-d31a-4054-a007-5c8cb01dd030 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:46.353928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0e504-d31a-4054-a007-5c8cb01dd030 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:46.354056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-deaa29fb-0383-4cbd-910b-0b9ad5b374d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:46.354521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0e504-d31a-4054-a007-5c8cb01dd030 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:46.364919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0e504-d31a-4054-a007-5c8cb01dd030 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:46.367629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0e504-d31a-4054-a007-5c8cb01dd030 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:46.378045 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1017/2037] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:45:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:45:46.566426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa29fb-0383-4cbd-910b-0b9ad5b374d7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:46.583347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:46.584406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:46.584981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:46.585644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] PATH_INFO: `/v3/users/b2a833999fff49a8a3601a6ab56349e9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:46.589212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a833999fff49a8a3601a6ab56349e9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:46.592096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:46.709014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a833999fff49a8a3601a6ab56349e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:46.747954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a833999fff49a8a3601a6ab56349e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:46.758867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a833999fff49a8a3601a6ab56349e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:46.778264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0e504-d31a-4054-a007-5c8cb01dd030 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:46.779807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a1c0e504-d31a-4054-a007-5c8cb01dd030 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:46.792876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a833999fff49a8a3601a6ab56349e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:46.797042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-debf2df2-feb2-4483-aee6-060cbc055e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a833999fff49a8a3601a6ab56349e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:46.809316 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1021/2038] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:46 2022] DELETE /identity/v3/users/b2a833999fff49a8a3601a6ab56349e9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:46.813582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea5959-ddab-4832-a003-03f66d68b20f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:46.814103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea5959-ddab-4832-a003-03f66d68b20f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:46.814551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea5959-ddab-4832-a003-03f66d68b20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:46.818947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0e504-d31a-4054-a007-5c8cb01dd030 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:46.849584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cbea5959-ddab-4832-a003-03f66d68b20f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:46.852446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cbea5959-ddab-4832-a003-03f66d68b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:46.932175 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:47.011458 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1022/2039] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:47.024574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea5959-ddab-4832-a003-03f66d68b20f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:47.026273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cbea5959-ddab-4832-a003-03f66d68b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:47.114786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:47.115460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:47.119147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:47.119444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] PATH_INFO: `/v3/projects/08f03ca964be4654a53ebf78b1f09bb6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:47.126237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f03ca964be4654a53ebf78b1f09bb6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:47.134322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:47.206996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea5959-ddab-4832-a003-03f66d68b20f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:47.218197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb5d5c-548d-4c6b-8e25-0d2673e144ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:47.219005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb5d5c-548d-4c6b-8e25-0d2673e144ce service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:47.219342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb5d5c-548d-4c6b-8e25-0d2673e144ce service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:47.219619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb5d5c-548d-4c6b-8e25-0d2673e144ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:47.223361 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:47.245821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb5d5c-548d-4c6b-8e25-0d2673e144ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:47.251829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb5d5c-548d-4c6b-8e25-0d2673e144ce service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:47.285404 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1023/2040] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:45:47.334604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f03ca964be4654a53ebf78b1f09bb6', 'request_id': 'req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:47.346792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f03ca964be4654a53ebf78b1f09bb6', 'request_id': 'req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:47.362101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f03ca964be4654a53ebf78b1f09bb6', 'request_id': 'req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:47.386329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] The token cache is being invalidate because project 08f03ca964be4654a53ebf78b1f09bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:47.387082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:47.388111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f42aec3a-65b2-4e71-abb6-1fa0f62e8d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:47.393310 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1018/2041] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:46 2022] DELETE /identity/v3/projects/08f03ca964be4654a53ebf78b1f09bb6 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:47.399952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355883a9-db75-4e3a-82c8-a0097ee3d7bf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:47.400991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355883a9-db75-4e3a-82c8-a0097ee3d7bf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:47.401443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355883a9-db75-4e3a-82c8-a0097ee3d7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:47.448222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-355883a9-db75-4e3a-82c8-a0097ee3d7bf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:47.449766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-355883a9-db75-4e3a-82c8-a0097ee3d7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:47.636708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1024/2042] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:47.647427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e832-b098-4f8b-9c20-c6abbac20950 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:47.648182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e832-b098-4f8b-9c20-c6abbac20950 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:47.648655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e832-b098-4f8b-9c20-c6abbac20950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:47.727184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-14d3e832-b098-4f8b-9c20-c6abbac20950 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:47.732290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-14d3e832-b098-4f8b-9c20-c6abbac20950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:47.760548 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1019/2043] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:47.764736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355883a9-db75-4e3a-82c8-a0097ee3d7bf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:47.789436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355883a9-db75-4e3a-82c8-a0097ee3d7bf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:47.817040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf95f7a-2ed8-462e-bfb0-69bdf91748cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:47.817826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf95f7a-2ed8-462e-bfb0-69bdf91748cc admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:47.819030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf95f7a-2ed8-462e-bfb0-69bdf91748cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:47.820642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf95f7a-2ed8-462e-bfb0-69bdf91748cc admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:47.822500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf95f7a-2ed8-462e-bfb0-69bdf91748cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:47.823207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf95f7a-2ed8-462e-bfb0-69bdf91748cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:47.826295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf95f7a-2ed8-462e-bfb0-69bdf91748cc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:47.897471 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1025/2044] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:47.902517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e832-b098-4f8b-9c20-c6abbac20950 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:47.918686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e832-b098-4f8b-9c20-c6abbac20950 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:47.948154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22cbd4-2086-4cb1-b923-0fb60deafd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:47.948825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22cbd4-2086-4cb1-b923-0fb60deafd36 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:47.949108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22cbd4-2086-4cb1-b923-0fb60deafd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:47.949383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22cbd4-2086-4cb1-b923-0fb60deafd36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:47.950174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22cbd4-2086-4cb1-b923-0fb60deafd36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:47.960906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22cbd4-2086-4cb1-b923-0fb60deafd36 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:48.025544 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1020/2045] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:47 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:48.031642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf95f7a-2ed8-462e-bfb0-69bdf91748cc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:48.073466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf95f7a-2ed8-462e-bfb0-69bdf91748cc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:48.304760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13dd53-4e6c-47fb-9647-3898ae904ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:48.305717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13dd53-4e6c-47fb-9647-3898ae904ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:48.305717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13dd53-4e6c-47fb-9647-3898ae904ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:48.306051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13dd53-4e6c-47fb-9647-3898ae904ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:48.306580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13dd53-4e6c-47fb-9647-3898ae904ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:48.325049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13dd53-4e6c-47fb-9647-3898ae904ad4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:48.362938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22cbd4-2086-4cb1-b923-0fb60deafd36 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:48.365513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bf22cbd4-2086-4cb1-b923-0fb60deafd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:48.409755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22cbd4-2086-4cb1-b923-0fb60deafd36 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:48.426994 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:48.452126 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1026/2046] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:48 2022] POST /identity/v3/users => generated 293 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:48.456564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:48.457280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:48.457567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:48.466495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] PATH_INFO: `/v3/projects/517bd155a3d544e08fef047741fb70ce` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:48.467759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13dd53-4e6c-47fb-9647-3898ae904ad4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:48.477424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=517bd155a3d544e08fef047741fb70ce)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:48.493134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:48.532748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13dd53-4e6c-47fb-9647-3898ae904ad4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:48.560681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e339-227b-4faf-a58a-b53bcab92068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:48.569012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e339-227b-4faf-a58a-b53bcab92068 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:48.594050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e339-227b-4faf-a58a-b53bcab92068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:48.594399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e339-227b-4faf-a58a-b53bcab92068 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:48.598822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76e339-227b-4faf-a58a-b53bcab92068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:48.607788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76e339-227b-4faf-a58a-b53bcab92068 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:48.640756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517bd155a3d544e08fef047741fb70ce', 'request_id': 'req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:48.659897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517bd155a3d544e08fef047741fb70ce', 'request_id': 'req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:48.671253 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1027/2047] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:48.675345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e339-227b-4faf-a58a-b53bcab92068 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:48.675767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517bd155a3d544e08fef047741fb70ce', 'request_id': 'req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:48.709260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e339-227b-4faf-a58a-b53bcab92068 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:48.714480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] The token cache is being invalidate because project 517bd155a3d544e08fef047741fb70ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:48.714780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:48.725342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:48.734977 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1021/2048] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:48 2022] DELETE /identity/v3/projects/517bd155a3d544e08fef047741fb70ce => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:48.741159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:48.745064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:48.946375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c981ed7-c22a-49ec-93b4-689f0a81c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:48.947008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c981ed7-c22a-49ec-93b4-689f0a81c91a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:48.947287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c981ed7-c22a-49ec-93b4-689f0a81c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:48.947563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c981ed7-c22a-49ec-93b4-689f0a81c91a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:48.948217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c981ed7-c22a-49ec-93b4-689f0a81c91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:48.951547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c981ed7-c22a-49ec-93b4-689f0a81c91a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:48.986158 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:48.993155 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1028/2049] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:48.994354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c981ed7-c22a-49ec-93b4-689f0a81c91a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:48.997861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaae249-eaca-4f7f-ac9f-d2cbc6e6de2f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:49.001873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8c981ed7-c22a-49ec-93b4-689f0a81c91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:49.022679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:49.023350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:49.023634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:49.023916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] PATH_INFO: `/v3/users/7fa2bb97c4644e259efff27e0ed0c742` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:49.026588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa2bb97c4644e259efff27e0ed0c742)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:49.036712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:49.042049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c981ed7-c22a-49ec-93b4-689f0a81c91a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:49.066164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb347a-65ab-4a29-9e30-fba0b4f1d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:49.066877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb347a-65ab-4a29-9e30-fba0b4f1d78d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:49.067164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb347a-65ab-4a29-9e30-fba0b4f1d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:49.067447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb347a-65ab-4a29-9e30-fba0b4f1d78d admin admin] PATH_INFO: `/v3/projects/6f71e12cab704f7b8b66cfdbd3c22c05/users/6b22975b582b4e7398f6b2eeb9298f31/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:49.123303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb347a-65ab-4a29-9e30-fba0b4f1d78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f71e12cab704f7b8b66cfdbd3c22c05, user_id=6b22975b582b4e7398f6b2eeb9298f31, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:49.126881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb347a-65ab-4a29-9e30-fba0b4f1d78d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:49.159006 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1029/2050] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:48 2022] PUT /identity/v3/projects/6f71e12cab704f7b8b66cfdbd3c22c05/users/6b22975b582b4e7398f6b2eeb9298f31/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:49.171113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1752-cc66-4c93-9167-cf207218b8ec None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:49.171405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1752-cc66-4c93-9167-cf207218b8ec None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:49.171717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1752-cc66-4c93-9167-cf207218b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:49.206282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa2bb97c4644e259efff27e0ed0c742'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.235511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa2bb97c4644e259efff27e0ed0c742'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.260390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa2bb97c4644e259efff27e0ed0c742'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.267277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-52cb1752-cc66-4c93-9167-cf207218b8ec None None] MFA Rules not processed for user `6b22975b582b4e7398f6b2eeb9298f31`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:49.273219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-52cb1752-cc66-4c93-9167-cf207218b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:49.286708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa2bb97c4644e259efff27e0ed0c742'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.290837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa2bb97c4644e259efff27e0ed0c742'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.314402 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1022/2051] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:48 2022] DELETE /identity/v3/users/7fa2bb97c4644e259efff27e0ed0c742 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:49.333393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:49.335205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:49.541756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c34f8-1cc8-4187-8bd0-a3807fc65453 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:49.544449 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1030/2052] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:49.548652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb1752-cc66-4c93-9167-cf207218b8ec None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:49.550009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-52cb1752-cc66-4c93-9167-cf207218b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:49.554679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:49.556436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:49.557180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:49.560605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] PATH_INFO: `/v3/users/0ba955efddd645e8ada9987c22bc52ee` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:49.562645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba955efddd645e8ada9987c22bc52ee)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:49.566945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:49.688146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba955efddd645e8ada9987c22bc52ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.699663 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:49.724989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba955efddd645e8ada9987c22bc52ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.735528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb1752-cc66-4c93-9167-cf207218b8ec None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:49.741044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba955efddd645e8ada9987c22bc52ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.752295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293639cb-2631-4243-a4c9-8fdfcd8aead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:49.755494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293639cb-2631-4243-a4c9-8fdfcd8aead8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:49.755712 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:49.758569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293639cb-2631-4243-a4c9-8fdfcd8aead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:49.759218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293639cb-2631-4243-a4c9-8fdfcd8aead8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:49.760895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293639cb-2631-4243-a4c9-8fdfcd8aead8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:49.761772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba955efddd645e8ada9987c22bc52ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.764020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293639cb-2631-4243-a4c9-8fdfcd8aead8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:49.766498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fd0c4bf-4088-4ffa-be6f-9fd381680b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba955efddd645e8ada9987c22bc52ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:49.786015 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1023/2053] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:49 2022] DELETE /identity/v3/users/0ba955efddd645e8ada9987c22bc52ee => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:49.791259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73d530-c656-4c98-82a4-c8e49afdf133 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:49.791777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73d530-c656-4c98-82a4-c8e49afdf133 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:49.792208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73d530-c656-4c98-82a4-c8e49afdf133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:49.838835 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1031/2054] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:49 2022] POST /identity/v3/projects => generated 385 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:45:49.845729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cd73d530-c656-4c98-82a4-c8e49afdf133 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:49.846935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293639cb-2631-4243-a4c9-8fdfcd8aead8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:49.848746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd73d530-c656-4c98-82a4-c8e49afdf133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:49.849446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-293639cb-2631-4243-a4c9-8fdfcd8aead8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:50.014599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293639cb-2631-4243-a4c9-8fdfcd8aead8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:50.027866 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1024/2055] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:50.041623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdc9b2-642d-4b0a-aac1-9c295d43838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:50.042532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdc9b2-642d-4b0a-aac1-9c295d43838d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:50.043054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdc9b2-642d-4b0a-aac1-9c295d43838d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:50.050254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73d530-c656-4c98-82a4-c8e49afdf133 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:50.052102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd73d530-c656-4c98-82a4-c8e49afdf133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:50.056075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdc9b2-642d-4b0a-aac1-9c295d43838d admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:50.058032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdc9b2-642d-4b0a-aac1-9c295d43838d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:50.062695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdc9b2-642d-4b0a-aac1-9c295d43838d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:50.132652 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1032/2056] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:49 2022] POST /identity/v3/users => generated 299 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:50.134154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdc9b2-642d-4b0a-aac1-9c295d43838d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:50.165629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdc9b2-642d-4b0a-aac1-9c295d43838d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:50.184546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea904671-a88c-49f2-9805-2142cd158ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:50.185384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea904671-a88c-49f2-9805-2142cd158ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:50.185768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea904671-a88c-49f2-9805-2142cd158ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:50.186170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea904671-a88c-49f2-9805-2142cd158ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:50.187309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea904671-a88c-49f2-9805-2142cd158ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:50.189178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea904671-a88c-49f2-9805-2142cd158ad6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:50.215872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73d530-c656-4c98-82a4-c8e49afdf133 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:50.220129 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1033/2057] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:50.221988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea904671-a88c-49f2-9805-2142cd158ad6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:50.229844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dbc4a-029b-4412-b390-21393886db5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:50.230525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dbc4a-029b-4412-b390-21393886db5e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:50.230823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dbc4a-029b-4412-b390-21393886db5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:50.231320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dbc4a-029b-4412-b390-21393886db5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:50.251529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea904671-a88c-49f2-9805-2142cd158ad6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:50.259519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dbc4a-029b-4412-b390-21393886db5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:50.261414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dbc4a-029b-4412-b390-21393886db5e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:50.271631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167dfbc-7148-4d16-92f1-7025f9082d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:50.273334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167dfbc-7148-4d16-92f1-7025f9082d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:50.273962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167dfbc-7148-4d16-92f1-7025f9082d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:50.274573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167dfbc-7148-4d16-92f1-7025f9082d49 admin admin] PATH_INFO: `/v3/projects/41f1ad01b2af4728893c4186754123ea/users/4465806e4893418ebf7a8a2b856f24c1/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:50.306660 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1025/2058] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:45:50.323584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167dfbc-7148-4d16-92f1-7025f9082d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f1ad01b2af4728893c4186754123ea, user_id=4465806e4893418ebf7a8a2b856f24c1, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:50.338935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167dfbc-7148-4d16-92f1-7025f9082d49 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:50.382520 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1034/2059] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:50 2022] PUT /identity/v3/projects/41f1ad01b2af4728893c4186754123ea/users/4465806e4893418ebf7a8a2b856f24c1/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:50.384104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dbc4a-029b-4412-b390-21393886db5e service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:50.420753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dbc4a-029b-4412-b390-21393886db5e service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:50.608859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313362c2-fdec-4826-b867-75ed09b5b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:50.610890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313362c2-fdec-4826-b867-75ed09b5b1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:50.611355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313362c2-fdec-4826-b867-75ed09b5b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:50.611786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313362c2-fdec-4826-b867-75ed09b5b1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:50.612645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313362c2-fdec-4826-b867-75ed09b5b1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:50.615146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313362c2-fdec-4826-b867-75ed09b5b1d4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:50.632748 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1026/2060] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:50.638658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167dfbc-7148-4d16-92f1-7025f9082d49 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:50.691269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167dfbc-7148-4d16-92f1-7025f9082d49 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:50.718387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd492-b743-4def-868c-4ef421c061e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:50.719612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd492-b743-4def-868c-4ef421c061e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:50.720089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd492-b743-4def-868c-4ef421c061e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:50.720535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd492-b743-4def-868c-4ef421c061e7 admin admin] PATH_INFO: `/v3/projects/41f1ad01b2af4728893c4186754123ea/users/4465806e4893418ebf7a8a2b856f24c1/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:50.723049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd492-b743-4def-868c-4ef421c061e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f1ad01b2af4728893c4186754123ea, user_id=4465806e4893418ebf7a8a2b856f24c1, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:50.728759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd492-b743-4def-868c-4ef421c061e7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:50.750114 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1035/2061] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:50 2022] PUT /identity/v3/projects/41f1ad01b2af4728893c4186754123ea/users/4465806e4893418ebf7a8a2b856f24c1/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:50.779414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41e24c-6cec-47a7-a86b-9d4f205151a7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:50.779843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41e24c-6cec-47a7-a86b-9d4f205151a7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:50.780206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41e24c-6cec-47a7-a86b-9d4f205151a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:50.840877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8d41e24c-6cec-47a7-a86b-9d4f205151a7 None None] MFA Rules not processed for user `4465806e4893418ebf7a8a2b856f24c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:50.840877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8d41e24c-6cec-47a7-a86b-9d4f205151a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:50.954594 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:50.956090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd492-b743-4def-868c-4ef421c061e7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:50.958231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-105dd492-b743-4def-868c-4ef421c061e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:51.143931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd492-b743-4def-868c-4ef421c061e7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:51.150895 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1027/2062] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:51.165423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:51.167297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:51.168281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:51.169185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] PATH_INFO: `/v3/projects/109a815c736e427fb5915aa0fc563761` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:51.171241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=109a815c736e427fb5915aa0fc563761)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:51.173425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:51.236650 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:51.239537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41e24c-6cec-47a7-a86b-9d4f205151a7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:51.241749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8d41e24c-6cec-47a7-a86b-9d4f205151a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:51.284068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41e24c-6cec-47a7-a86b-9d4f205151a7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:51.298029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:51.300287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:51.301192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:51.301824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] PATH_INFO: `/v3/projects/ec62e1fb72ba44da8443be083f172b90` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:51.306415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec62e1fb72ba44da8443be083f172b90)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:51.310898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:51.324867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109a815c736e427fb5915aa0fc563761', 'request_id': 'req-1fc24953-7932-43da-9e18-f74735cc8a42'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.346336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109a815c736e427fb5915aa0fc563761', 'request_id': 'req-1fc24953-7932-43da-9e18-f74735cc8a42'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.363430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109a815c736e427fb5915aa0fc563761', 'request_id': 'req-1fc24953-7932-43da-9e18-f74735cc8a42'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.400433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] The token cache is being invalidate because project 109a815c736e427fb5915aa0fc563761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:51.401535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.403793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.416071 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1036/2063] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:50 2022] DELETE /identity/v3/projects/109a815c736e427fb5915aa0fc563761 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:51.418351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:51.421909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:51.462120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec62e1fb72ba44da8443be083f172b90', 'request_id': 'req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.483039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec62e1fb72ba44da8443be083f172b90', 'request_id': 'req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.498489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec62e1fb72ba44da8443be083f172b90', 'request_id': 'req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.537059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] The token cache is being invalidate because project ec62e1fb72ba44da8443be083f172b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:51.538549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.540725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e70aeb0-b0de-4565-9689-e0bf4e8f2203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.546059 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1028/2064] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:51 2022] DELETE /identity/v3/projects/ec62e1fb72ba44da8443be083f172b90 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:51.546871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bee81-2702-45ab-b319-e56b3b218862 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:51.546871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bee81-2702-45ab-b319-e56b3b218862 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:51.547337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bee81-2702-45ab-b319-e56b3b218862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:51.593165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-559bee81-2702-45ab-b319-e56b3b218862 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:51.594480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-559bee81-2702-45ab-b319-e56b3b218862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:51.680802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc24953-7932-43da-9e18-f74735cc8a42 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:51.726127 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1029/2065] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:51.729367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bee81-2702-45ab-b319-e56b3b218862 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:51.734585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-559bee81-2702-45ab-b319-e56b3b218862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:51.759911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bee81-2702-45ab-b319-e56b3b218862 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:51.778146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:51.778910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:51.779597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:51.779597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] PATH_INFO: `/v3/users/6c8fb2a47d584c138a431e057f788185` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:51.785332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8fb2a47d584c138a431e057f788185)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:51.789555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:51.873444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:51.880598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:51.880598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:51.881048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:51.891685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:51.940470 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:51.961215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8fb2a47d584c138a431e057f788185'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:51.997716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8fb2a47d584c138a431e057f788185'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:52.008735 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:52.014432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8fb2a47d584c138a431e057f788185'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:52.041222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8fb2a47d584c138a431e057f788185'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:52.042049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cffd7e8e-45a3-4bf9-88ec-b419a2c89370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8fb2a47d584c138a431e057f788185'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:52.060782 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1030/2066] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:51 2022] DELETE /identity/v3/users/6c8fb2a47d584c138a431e057f788185 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:52.062771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccb88-22f9-4c20-9260-6f3c3a9f31e0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:52.062771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccb88-22f9-4c20-9260-6f3c3a9f31e0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:52.062771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccb88-22f9-4c20-9260-6f3c3a9f31e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:52.078626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:52.080851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:52.105975 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1037/2067] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:52.151522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b8fccb88-22f9-4c20-9260-6f3c3a9f31e0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:52.160086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b8fccb88-22f9-4c20-9260-6f3c3a9f31e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:52.339343 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1031/2068] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:52.344272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:52.346039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:52.391796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c28c-e3d1-4252-ba66-f9425b6b157e service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:52.397943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d708f-bcf6-4b65-970d-3ecffd206e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:52.399145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d708f-bcf6-4b65-970d-3ecffd206e9b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:52.399463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d708f-bcf6-4b65-970d-3ecffd206e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:52.399789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d708f-bcf6-4b65-970d-3ecffd206e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:52.400482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d708f-bcf6-4b65-970d-3ecffd206e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:52.400816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d708f-bcf6-4b65-970d-3ecffd206e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:52.402615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d708f-bcf6-4b65-970d-3ecffd206e9b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:52.424480 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1038/2069] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:52.430645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fccb88-22f9-4c20-9260-6f3c3a9f31e0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:52.442208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fccb88-22f9-4c20-9260-6f3c3a9f31e0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:52.459098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05879f5d-bc56-43c8-9536-b7fd9a25bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:52.460084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05879f5d-bc56-43c8-9536-b7fd9a25bbfe admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:52.460572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05879f5d-bc56-43c8-9536-b7fd9a25bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:52.461134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05879f5d-bc56-43c8-9536-b7fd9a25bbfe admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:52.461871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05879f5d-bc56-43c8-9536-b7fd9a25bbfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:52.467694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05879f5d-bc56-43c8-9536-b7fd9a25bbfe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:52.564436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d708f-bcf6-4b65-970d-3ecffd206e9b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:52.565073 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1032/2070] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:52 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:52.580015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d708f-bcf6-4b65-970d-3ecffd206e9b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:52.673393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ce7c9-9d74-479e-a854-b3d7967f614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:52.674551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ce7c9-9d74-479e-a854-b3d7967f614b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:52.675203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ce7c9-9d74-479e-a854-b3d7967f614b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:52.675655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ce7c9-9d74-479e-a854-b3d7967f614b admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:52.676602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ce7c9-9d74-479e-a854-b3d7967f614b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:52.679981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ce7c9-9d74-479e-a854-b3d7967f614b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:52.746383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05879f5d-bc56-43c8-9536-b7fd9a25bbfe admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:52.758500 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1039/2071] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:52 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:52.765086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05879f5d-bc56-43c8-9536-b7fd9a25bbfe admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:52.774861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbe1f7-388d-4966-9699-2defbad0fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:52.775808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbe1f7-388d-4966-9699-2defbad0fa29 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:52.776252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbe1f7-388d-4966-9699-2defbad0fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:52.776683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbe1f7-388d-4966-9699-2defbad0fa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:52.777846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbe1f7-388d-4966-9699-2defbad0fa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:52.779635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbe1f7-388d-4966-9699-2defbad0fa29 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:52.800646 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1033/2072] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:52.806852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ce7c9-9d74-479e-a854-b3d7967f614b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:52.830526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ce7c9-9d74-479e-a854-b3d7967f614b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:52.847640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd39e2-d6bd-40bb-a91b-650740fccf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:52.852692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd39e2-d6bd-40bb-a91b-650740fccf59 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:52.853712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd39e2-d6bd-40bb-a91b-650740fccf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:52.854155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd39e2-d6bd-40bb-a91b-650740fccf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:52.855213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd39e2-d6bd-40bb-a91b-650740fccf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:52.857182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd39e2-d6bd-40bb-a91b-650740fccf59 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:52.873419 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1040/2073] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:52.877739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbe1f7-388d-4966-9699-2defbad0fa29 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:52.892364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbe1f7-388d-4966-9699-2defbad0fa29 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:52.899724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773e602-47e8-4008-b706-86e1493da11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:52.900962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773e602-47e8-4008-b706-86e1493da11f admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:52.901423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773e602-47e8-4008-b706-86e1493da11f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:52.901872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773e602-47e8-4008-b706-86e1493da11f admin admin] PATH_INFO: `/v3/projects/e62838577e3e4c8189e936f3453b2fa4/users/f268dddf034d43ed9d679dd7396836cc/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:52.935362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773e602-47e8-4008-b706-86e1493da11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62838577e3e4c8189e936f3453b2fa4, user_id=f268dddf034d43ed9d679dd7396836cc, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:52.938886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773e602-47e8-4008-b706-86e1493da11f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:52.965438 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1034/2074] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:52 2022] PUT /identity/v3/projects/e62838577e3e4c8189e936f3453b2fa4/users/f268dddf034d43ed9d679dd7396836cc/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:52.977571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfac2f6-d33f-4d0f-bf6b-423ce4134026 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:52.978231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfac2f6-d33f-4d0f-bf6b-423ce4134026 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:52.978738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfac2f6-d33f-4d0f-bf6b-423ce4134026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:53.057751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fdfac2f6-d33f-4d0f-bf6b-423ce4134026 None None] MFA Rules not processed for user `f268dddf034d43ed9d679dd7396836cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:53.059113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fdfac2f6-d33f-4d0f-bf6b-423ce4134026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:53.268072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773e602-47e8-4008-b706-86e1493da11f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:53.270093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9773e602-47e8-4008-b706-86e1493da11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:53.308691 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1041/2075] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:45:53.327018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfac2f6-d33f-4d0f-bf6b-423ce4134026 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:53.394436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773e602-47e8-4008-b706-86e1493da11f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:53.408701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:53.409380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:53.409800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:53.410100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] PATH_INFO: `/v3/projects/79f9ad4f3606435bae9b93133042cc30` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:53.415364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f9ad4f3606435bae9b93133042cc30)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:53.421651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:53.426104 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:53.485422 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:53.537188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f9ad4f3606435bae9b93133042cc30', 'request_id': 'req-179864fe-2a72-4c73-907b-44fe6acd3f40'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:53.557803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f9ad4f3606435bae9b93133042cc30', 'request_id': 'req-179864fe-2a72-4c73-907b-44fe6acd3f40'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:53.577419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f9ad4f3606435bae9b93133042cc30', 'request_id': 'req-179864fe-2a72-4c73-907b-44fe6acd3f40'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:53.608009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] The token cache is being invalidate because project 79f9ad4f3606435bae9b93133042cc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:53.608418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:53.609696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfac2f6-d33f-4d0f-bf6b-423ce4134026 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:53.610132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-179864fe-2a72-4c73-907b-44fe6acd3f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:53.616760 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1035/2076] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:53 2022] DELETE /identity/v3/projects/79f9ad4f3606435bae9b93133042cc30 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:45:53.621470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980110ca-cf2b-4385-8659-0e79008ef677 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:53.622131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980110ca-cf2b-4385-8659-0e79008ef677 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:53.622131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980110ca-cf2b-4385-8659-0e79008ef677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:53.686198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-980110ca-cf2b-4385-8659-0e79008ef677 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:53.686198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-980110ca-cf2b-4385-8659-0e79008ef677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:53.751629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f47f29-ef70-4f78-b087-8bf19074914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:53.752841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f47f29-ef70-4f78-b087-8bf19074914d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:53.752841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f47f29-ef70-4f78-b087-8bf19074914d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:53.753233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f47f29-ef70-4f78-b087-8bf19074914d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:53.754036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f47f29-ef70-4f78-b087-8bf19074914d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:53.757168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f47f29-ef70-4f78-b087-8bf19074914d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:53.801990 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1036/2077] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:53.808592 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1042/2078] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:53 2022] POST /identity/v3/projects => generated 377 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:53.812637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540d32e-7a48-4289-a806-c0adda1a24de None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:53.813254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540d32e-7a48-4289-a806-c0adda1a24de None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:53.813710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540d32e-7a48-4289-a806-c0adda1a24de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:53.824601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f47f29-ef70-4f78-b087-8bf19074914d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:53.826880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1f47f29-ef70-4f78-b087-8bf19074914d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:53.851209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0540d32e-7a48-4289-a806-c0adda1a24de None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:53.853098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0540d32e-7a48-4289-a806-c0adda1a24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:53.964711 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1037/2079] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:53.971127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540d32e-7a48-4289-a806-c0adda1a24de None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:53.996200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540d32e-7a48-4289-a806-c0adda1a24de None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.008976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbd6d4-c051-4ea3-83a2-cef5b7e88672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.009477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbd6d4-c051-4ea3-83a2-cef5b7e88672 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.009853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbd6d4-c051-4ea3-83a2-cef5b7e88672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.010195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbd6d4-c051-4ea3-83a2-cef5b7e88672 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.011701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbd6d4-c051-4ea3-83a2-cef5b7e88672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:54.011701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbd6d4-c051-4ea3-83a2-cef5b7e88672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.012873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbd6d4-c051-4ea3-83a2-cef5b7e88672 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.027641 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1038/2080] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:45:54.031890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbd6d4-c051-4ea3-83a2-cef5b7e88672 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.058852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbd6d4-c051-4ea3-83a2-cef5b7e88672 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.073418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c804-455c-481b-89ce-5cf008fe170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.074085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c804-455c-481b-89ce-5cf008fe170e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.074343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c804-455c-481b-89ce-5cf008fe170e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.074614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c804-455c-481b-89ce-5cf008fe170e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.075254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38c804-455c-481b-89ce-5cf008fe170e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.077231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38c804-455c-481b-89ce-5cf008fe170e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.102897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f47f29-ef70-4f78-b087-8bf19074914d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.109970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21ac4-1509-43a3-8594-92ddcd748607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.118210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21ac4-1509-43a3-8594-92ddcd748607 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.118491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21ac4-1509-43a3-8594-92ddcd748607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.118778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21ac4-1509-43a3-8594-92ddcd748607 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.120857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc21ac4-1509-43a3-8594-92ddcd748607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.125561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc21ac4-1509-43a3-8594-92ddcd748607 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.130771 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:54.159650 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1039/2081] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:54 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:54.164199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c804-455c-481b-89ce-5cf008fe170e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.175099 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1043/2082] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:53 2022] POST /identity/v3/users => generated 295 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:54.177742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21ac4-1509-43a3-8594-92ddcd748607 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.189065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21ac4-1509-43a3-8594-92ddcd748607 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.301177 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:54.320017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b833bae-c94c-410b-bdd7-f65ae73b24b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.320809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c804-455c-481b-89ce-5cf008fe170e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.321443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833bae-c94c-410b-bdd7-f65ae73b24b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.321954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833bae-c94c-410b-bdd7-f65ae73b24b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.322646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833bae-c94c-410b-bdd7-f65ae73b24b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.323947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b833bae-c94c-410b-bdd7-f65ae73b24b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.326632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b833bae-c94c-410b-bdd7-f65ae73b24b9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.326842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714be2bb-3c25-46f9-a7bf-0461f8c3b047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.327674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714be2bb-3c25-46f9-a7bf-0461f8c3b047 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.328033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714be2bb-3c25-46f9-a7bf-0461f8c3b047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.328642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714be2bb-3c25-46f9-a7bf-0461f8c3b047 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.329373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714be2bb-3c25-46f9-a7bf-0461f8c3b047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.331572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714be2bb-3c25-46f9-a7bf-0461f8c3b047 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.355149 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1044/2083] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:54.357609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b833bae-c94c-410b-bdd7-f65ae73b24b9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.367053 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1040/2084] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:54 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:45:54.371072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714be2bb-3c25-46f9-a7bf-0461f8c3b047 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.377168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b833bae-c94c-410b-bdd7-f65ae73b24b9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.381167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef07e-f0a0-4b93-8ed4-332e5d5d7edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.381935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef07e-f0a0-4b93-8ed4-332e5d5d7edd admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.382313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef07e-f0a0-4b93-8ed4-332e5d5d7edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.382601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef07e-f0a0-4b93-8ed4-332e5d5d7edd admin admin] PATH_INFO: `/v3/projects/da72dc10a95d414d94f261d69035fdcc/users/739c9b59a1294fa3a370c479aa0b0628/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.389424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714be2bb-3c25-46f9-a7bf-0461f8c3b047 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.395012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b8b54-163f-4751-88d9-8f8e335ad237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.395643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b8b54-163f-4751-88d9-8f8e335ad237 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.395945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b8b54-163f-4751-88d9-8f8e335ad237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.396237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b8b54-163f-4751-88d9-8f8e335ad237 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.397598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b8b54-163f-4751-88d9-8f8e335ad237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.399696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b8b54-163f-4751-88d9-8f8e335ad237 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.415710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbef07e-f0a0-4b93-8ed4-332e5d5d7edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da72dc10a95d414d94f261d69035fdcc, user_id=739c9b59a1294fa3a370c479aa0b0628, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.420773 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1041/2085] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:54.422175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b8b54-163f-4751-88d9-8f8e335ad237 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.433980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbef07e-f0a0-4b93-8ed4-332e5d5d7edd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.434305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b8b54-163f-4751-88d9-8f8e335ad237 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.440178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e9799-e924-4191-821a-b3564df2cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.440997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e9799-e924-4191-821a-b3564df2cf50 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.441279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e9799-e924-4191-821a-b3564df2cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.441557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e9799-e924-4191-821a-b3564df2cf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.442307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e9799-e924-4191-821a-b3564df2cf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.444004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e9799-e924-4191-821a-b3564df2cf50 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.465316 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1042/2086] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:54.467527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e9799-e924-4191-821a-b3564df2cf50 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.477428 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1045/2087] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:54 2022] PUT /identity/v3/projects/da72dc10a95d414d94f261d69035fdcc/users/739c9b59a1294fa3a370c479aa0b0628/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:54.482233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef07e-f0a0-4b93-8ed4-332e5d5d7edd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.492175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e9799-e924-4191-821a-b3564df2cf50 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.567347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef07e-f0a0-4b93-8ed4-332e5d5d7edd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.575819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09632157-e32d-4982-81f3-c3b23461cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.575819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09632157-e32d-4982-81f3-c3b23461cf64 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.575819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09632157-e32d-4982-81f3-c3b23461cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.575819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09632157-e32d-4982-81f3-c3b23461cf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.576229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09632157-e32d-4982-81f3-c3b23461cf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.576468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09632157-e32d-4982-81f3-c3b23461cf64 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.591500 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1046/2088] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:54.592392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09632157-e32d-4982-81f3-c3b23461cf64 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.605139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09632157-e32d-4982-81f3-c3b23461cf64 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:54.620440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118a36d-2a09-42a1-8f4f-3813cf5d72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.622440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a36d-2a09-42a1-8f4f-3813cf5d72e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.622440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a36d-2a09-42a1-8f4f-3813cf5d72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.622440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a36d-2a09-42a1-8f4f-3813cf5d72e3 admin admin] PATH_INFO: `/v3/projects/bdebe0fcd25d4fe2a091f0ca3b223dbe/users/a2dfb2187da34c4bba960f9b33affc70/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.624506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cdb62-f6c9-49fc-9ea2-042734e2c441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:54.625566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cdb62-f6c9-49fc-9ea2-042734e2c441 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.626080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cdb62-f6c9-49fc-9ea2-042734e2c441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.626557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cdb62-f6c9-49fc-9ea2-042734e2c441 admin admin] PATH_INFO: `/v3/projects/da72dc10a95d414d94f261d69035fdcc/users/739c9b59a1294fa3a370c479aa0b0628/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.629274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cdb62-f6c9-49fc-9ea2-042734e2c441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da72dc10a95d414d94f261d69035fdcc, user_id=739c9b59a1294fa3a370c479aa0b0628, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.632545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cdb62-f6c9-49fc-9ea2-042734e2c441 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.644101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118a36d-2a09-42a1-8f4f-3813cf5d72e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdebe0fcd25d4fe2a091f0ca3b223dbe, user_id=a2dfb2187da34c4bba960f9b33affc70, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:54.647389 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1047/2089] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:54 2022] PUT /identity/v3/projects/da72dc10a95d414d94f261d69035fdcc/users/739c9b59a1294fa3a370c479aa0b0628/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:54.647564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118a36d-2a09-42a1-8f4f-3813cf5d72e3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:54.659316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956dc2-f770-462a-9df3-f3df081c85d3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.659833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956dc2-f770-462a-9df3-f3df081c85d3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.659949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956dc2-f770-462a-9df3-f3df081c85d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.697110 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1043/2090] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:54 2022] PUT /identity/v3/projects/bdebe0fcd25d4fe2a091f0ca3b223dbe/users/a2dfb2187da34c4bba960f9b33affc70/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:54.699371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2e1b8-b5fa-48ca-94c9-fb21664696d6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.701476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2e1b8-b5fa-48ca-94c9-fb21664696d6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.702092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2e1b8-b5fa-48ca-94c9-fb21664696d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.759316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c3956dc2-f770-462a-9df3-f3df081c85d3 None None] MFA Rules not processed for user `739c9b59a1294fa3a370c479aa0b0628`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:54.760725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c3956dc2-f770-462a-9df3-f3df081c85d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:54.762220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6bd2e1b8-b5fa-48ca-94c9-fb21664696d6 None None] MFA Rules not processed for user `a2dfb2187da34c4bba960f9b33affc70`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:54.763764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6bd2e1b8-b5fa-48ca-94c9-fb21664696d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:54.837344 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:54.862493 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1048/2091] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:54.866446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1426f-a6d0-42f7-8a47-6f72aee6e9ad None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:54.866446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1426f-a6d0-42f7-8a47-6f72aee6e9ad None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:54.867611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1426f-a6d0-42f7-8a47-6f72aee6e9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:54.903476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1aa1426f-a6d0-42f7-8a47-6f72aee6e9ad None None] MFA Rules not processed for user `f268dddf034d43ed9d679dd7396836cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:54.904706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1aa1426f-a6d0-42f7-8a47-6f72aee6e9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:54.918173 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1044/2092] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:54.923441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2e1b8-b5fa-48ca-94c9-fb21664696d6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:54.925452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6bd2e1b8-b5fa-48ca-94c9-fb21664696d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:54.974015 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:55.030069 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1049/2093] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:55.033758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1426f-a6d0-42f7-8a47-6f72aee6e9ad None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:55.043948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2e1b8-b5fa-48ca-94c9-fb21664696d6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:55.094773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:55.096259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1426f-a6d0-42f7-8a47-6f72aee6e9ad None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:55.097327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:55.097593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:55.097874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] PATH_INFO: `/v3/users/6b22975b582b4e7398f6b2eeb9298f31` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:55.099541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b22975b582b4e7398f6b2eeb9298f31)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:55.104858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:55.112390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c90ef-54fb-4308-9e5b-9d1ee35f335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:55.114292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c90ef-54fb-4308-9e5b-9d1ee35f335f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:55.114588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c90ef-54fb-4308-9e5b-9d1ee35f335f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:55.114952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c90ef-54fb-4308-9e5b-9d1ee35f335f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:55.115705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c90ef-54fb-4308-9e5b-9d1ee35f335f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:55.118812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c90ef-54fb-4308-9e5b-9d1ee35f335f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:55.187745 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1050/2094] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:55 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:55.189057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c90ef-54fb-4308-9e5b-9d1ee35f335f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:55.221469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b22975b582b4e7398f6b2eeb9298f31'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:55.257926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b22975b582b4e7398f6b2eeb9298f31'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:55.305200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b22975b582b4e7398f6b2eeb9298f31'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:55.316072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b22975b582b4e7398f6b2eeb9298f31'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:55.317803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5d4b8a01-ffb0-4135-bb07-aa35a5d3274c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b22975b582b4e7398f6b2eeb9298f31'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:55.344375 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1045/2095] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:54 2022] DELETE /identity/v3/users/6b22975b582b4e7398f6b2eeb9298f31 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:55.344566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c90ef-54fb-4308-9e5b-9d1ee35f335f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:55.349930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b0d9-bb87-4ce6-8a56-7e2fee96e79c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:55.350404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b0d9-bb87-4ce6-8a56-7e2fee96e79c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:55.350666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b0d9-bb87-4ce6-8a56-7e2fee96e79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:55.410812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-99b3b0d9-bb87-4ce6-8a56-7e2fee96e79c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:55.413584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-99b3b0d9-bb87-4ce6-8a56-7e2fee96e79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:55.565977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fb50f-1f2a-48c5-8182-0dac3905e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:55.566897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fb50f-1f2a-48c5-8182-0dac3905e985 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:55.567246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fb50f-1f2a-48c5-8182-0dac3905e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:55.567629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fb50f-1f2a-48c5-8182-0dac3905e985 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:55.568357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fb50f-1f2a-48c5-8182-0dac3905e985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:55.571188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fb50f-1f2a-48c5-8182-0dac3905e985 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:55.604175 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1051/2096] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:45:55 2022] POST /identity/v3/users => generated 294 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:45:55.605342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fb50f-1f2a-48c5-8182-0dac3905e985 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:55.607915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fc0fb50f-1f2a-48c5-8182-0dac3905e985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:55.690496 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:55.712405 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1046/2097] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:55.719816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3b0d9-bb87-4ce6-8a56-7e2fee96e79c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:55.720650 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:55.722229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-99b3b0d9-bb87-4ce6-8a56-7e2fee96e79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:55.749827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3b0d9-bb87-4ce6-8a56-7e2fee96e79c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:55.752268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fb50f-1f2a-48c5-8182-0dac3905e985 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:55.757429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c5039-f1cc-4712-9d2b-5f6cb5231438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:55.758987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c5039-f1cc-4712-9d2b-5f6cb5231438 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:55.759450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c5039-f1cc-4712-9d2b-5f6cb5231438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:55.759912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c5039-f1cc-4712-9d2b-5f6cb5231438 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:55.760725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c5039-f1cc-4712-9d2b-5f6cb5231438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:55.762969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88622aad-2bb2-434f-b2ef-12e1c22907a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:55.763540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c5039-f1cc-4712-9d2b-5f6cb5231438 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:55.763665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88622aad-2bb2-434f-b2ef-12e1c22907a8 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:55.763933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88622aad-2bb2-434f-b2ef-12e1c22907a8 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:55.764219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88622aad-2bb2-434f-b2ef-12e1c22907a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:55.766490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-88622aad-2bb2-434f-b2ef-12e1c22907a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:55.797944 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1047/2098] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:55.797944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c5039-f1cc-4712-9d2b-5f6cb5231438 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:55.799622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-552c5039-f1cc-4712-9d2b-5f6cb5231438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:55.931679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88622aad-2bb2-434f-b2ef-12e1c22907a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:55.934258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88622aad-2bb2-434f-b2ef-12e1c22907a8 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:55.949248 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1052/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:55.949474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c5039-f1cc-4712-9d2b-5f6cb5231438 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:55.950951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88622aad-2bb2-434f-b2ef-12e1c22907a8 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:55.961566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9eb95a-06e6-4e12-95c7-fa09d447affe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:55.962221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9eb95a-06e6-4e12-95c7-fa09d447affe service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:55.962498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9eb95a-06e6-4e12-95c7-fa09d447affe service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:55.962767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9eb95a-06e6-4e12-95c7-fa09d447affe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:55.971185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88622aad-2bb2-434f-b2ef-12e1c22907a8 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:55.983103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23462f0-badc-4110-967b-6899a48e8718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:55.984166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23462f0-badc-4110-967b-6899a48e8718 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:55.984744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23462f0-badc-4110-967b-6899a48e8718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:55.985427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23462f0-badc-4110-967b-6899a48e8718 admin admin] PATH_INFO: `/v3/projects/3dda88afd84148eeb4d54bef68ed5791/users/9e10262829ee4ddfbb9b0fab05f4bba9/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:55.998681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9eb95a-06e6-4e12-95c7-fa09d447affe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:56.004964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9eb95a-06e6-4e12-95c7-fa09d447affe service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:56.025954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23462f0-badc-4110-967b-6899a48e8718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dda88afd84148eeb4d54bef68ed5791, user_id=9e10262829ee4ddfbb9b0fab05f4bba9, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:56.031302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23462f0-badc-4110-967b-6899a48e8718 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:56.048722 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1048/2100] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:56.068511 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1053/2101] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:55 2022] PUT /identity/v3/projects/3dda88afd84148eeb4d54bef68ed5791/users/9e10262829ee4ddfbb9b0fab05f4bba9/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:56.071209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9eb95a-06e6-4e12-95c7-fa09d447affe service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:56.085903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9eb95a-06e6-4e12-95c7-fa09d447affe service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:56.236563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c063e4-732f-4681-a481-b8dc43eabf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:56.237216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c063e4-732f-4681-a481-b8dc43eabf73 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:56.237491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c063e4-732f-4681-a481-b8dc43eabf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:56.237761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c063e4-732f-4681-a481-b8dc43eabf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:56.239057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c063e4-732f-4681-a481-b8dc43eabf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:56.241512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c063e4-732f-4681-a481-b8dc43eabf73 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:56.276556 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1049/2102] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:45:56.279799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23462f0-badc-4110-967b-6899a48e8718 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:56.300928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23462f0-badc-4110-967b-6899a48e8718 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:56.309938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e1c12-0fca-4a6c-abd8-314cfc9dda88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:56.310562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1c12-0fca-4a6c-abd8-314cfc9dda88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:56.310847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1c12-0fca-4a6c-abd8-314cfc9dda88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:56.311150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1c12-0fca-4a6c-abd8-314cfc9dda88 admin admin] PATH_INFO: `/v3/projects/3dda88afd84148eeb4d54bef68ed5791/users/9e10262829ee4ddfbb9b0fab05f4bba9/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:56.319115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e1c12-0fca-4a6c-abd8-314cfc9dda88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dda88afd84148eeb4d54bef68ed5791, user_id=9e10262829ee4ddfbb9b0fab05f4bba9, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:56.322118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e1c12-0fca-4a6c-abd8-314cfc9dda88 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:56.360833 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1054/2103] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:45:56 2022] PUT /identity/v3/projects/3dda88afd84148eeb4d54bef68ed5791/users/9e10262829ee4ddfbb9b0fab05f4bba9/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:56.367837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d4492-dcf2-4dae-8091-556cc13ce4b5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:56.368555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d4492-dcf2-4dae-8091-556cc13ce4b5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:56.369228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d4492-dcf2-4dae-8091-556cc13ce4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:56.452649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fc6d4492-dcf2-4dae-8091-556cc13ce4b5 None None] MFA Rules not processed for user `9e10262829ee4ddfbb9b0fab05f4bba9`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:56.452649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc6d4492-dcf2-4dae-8091-556cc13ce4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:56.692880 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1050/2104] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:57.265199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e1c12-0fca-4a6c-abd8-314cfc9dda88 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:57.267805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-997e1c12-0fca-4a6c-abd8-314cfc9dda88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:57.498308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d4492-dcf2-4dae-8091-556cc13ce4b5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:57.500335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc6d4492-dcf2-4dae-8091-556cc13ce4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:57.523753 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:57.534534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e1c12-0fca-4a6c-abd8-314cfc9dda88 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:57.562532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c23e51-d3d3-461d-9231-354174f94f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:57.565665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c23e51-d3d3-461d-9231-354174f94f46 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:57.566025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c23e51-d3d3-461d-9231-354174f94f46 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:57.566967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c23e51-d3d3-461d-9231-354174f94f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:57.597594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c23e51-d3d3-461d-9231-354174f94f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:57.609286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c23e51-d3d3-461d-9231-354174f94f46 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:57.647421 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1055/2105] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:57.779832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d4492-dcf2-4dae-8091-556cc13ce4b5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:57.809709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:57.826608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:57.827015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:57.830924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] PATH_INFO: `/v3/projects/6f71e12cab704f7b8b66cfdbd3c22c05` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:57.832640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f71e12cab704f7b8b66cfdbd3c22c05)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:57.835404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:57.939322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f71e12cab704f7b8b66cfdbd3c22c05', 'request_id': 'req-c56973fb-3afb-4de1-9f3a-f9274541c85e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:57.954167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f71e12cab704f7b8b66cfdbd3c22c05', 'request_id': 'req-c56973fb-3afb-4de1-9f3a-f9274541c85e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:57.964872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f71e12cab704f7b8b66cfdbd3c22c05', 'request_id': 'req-c56973fb-3afb-4de1-9f3a-f9274541c85e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:57.986048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] The token cache is being invalidate because project 6f71e12cab704f7b8b66cfdbd3c22c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:57.990848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:57.991930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:57.994975 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1051/2106] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:57 2022] DELETE /identity/v3/projects/6f71e12cab704f7b8b66cfdbd3c22c05 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:57.998953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c23e51-d3d3-461d-9231-354174f94f46 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:58.020296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c23e51-d3d3-461d-9231-354174f94f46 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:58.127460 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:58.159380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:58.160020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:58.160439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:58.161123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] PATH_INFO: `/v3/users/4465806e4893418ebf7a8a2b856f24c1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:58.162434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4465806e4893418ebf7a8a2b856f24c1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:58.166474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:58.311764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:58.313753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:58.324604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4465806e4893418ebf7a8a2b856f24c1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:58.369459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4465806e4893418ebf7a8a2b856f24c1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:58.388908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4465806e4893418ebf7a8a2b856f24c1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:58.406817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4465806e4893418ebf7a8a2b856f24c1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:58.408246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4465806e4893418ebf7a8a2b856f24c1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:58.422768 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1056/2107] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:45:57 2022] DELETE /identity/v3/users/4465806e4893418ebf7a8a2b856f24c1 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:58.529812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56973fb-3afb-4de1-9f3a-f9274541c85e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:58.623815 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:58.704958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff9101-8eed-438a-b6fa-e1b31a575043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:58.707419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff9101-8eed-438a-b6fa-e1b31a575043 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:58.707774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff9101-8eed-438a-b6fa-e1b31a575043 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:58.709390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff9101-8eed-438a-b6fa-e1b31a575043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:58.714205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-73ff9101-8eed-438a-b6fa-e1b31a575043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:58.841067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff9101-8eed-438a-b6fa-e1b31a575043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:58.847955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff9101-8eed-438a-b6fa-e1b31a575043 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:58.898686 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1052/2108] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:45:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:45:59.110594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:59.112522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:59.248156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850607ee-6420-4ee8-8dfc-22a94262d526 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:59.258085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:59.258988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:59.259426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:59.259792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] PATH_INFO: `/v3/projects/41f1ad01b2af4728893c4186754123ea` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:59.261160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f1ad01b2af4728893c4186754123ea)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:59.263956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:59.378183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f1ad01b2af4728893c4186754123ea', 'request_id': 'req-d985c77c-5189-43b8-bb8f-325541485ccd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:59.404965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f1ad01b2af4728893c4186754123ea', 'request_id': 'req-d985c77c-5189-43b8-bb8f-325541485ccd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:59.419327 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:59.431778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f1ad01b2af4728893c4186754123ea', 'request_id': 'req-d985c77c-5189-43b8-bb8f-325541485ccd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:59.482074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] The token cache is being invalidate because project 41f1ad01b2af4728893c4186754123ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:45:59.482411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:59.490264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d985c77c-5189-43b8-bb8f-325541485ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:45:59.502345 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1057/2109] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:45:59 2022] DELETE /identity/v3/projects/41f1ad01b2af4728893c4186754123ea => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:59.508199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c358a-138b-41da-9bcf-46a23190ed05 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:59.508560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c358a-138b-41da-9bcf-46a23190ed05 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:59.508810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c358a-138b-41da-9bcf-46a23190ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:59.582762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-390c358a-138b-41da-9bcf-46a23190ed05 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:59.586474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-390c358a-138b-41da-9bcf-46a23190ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:59.787190 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1053/2110] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:59.803747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a1482-8b18-4bd9-92a9-be44c9a10409 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:59.804170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a1482-8b18-4bd9-92a9-be44c9a10409 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:59.804390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a1482-8b18-4bd9-92a9-be44c9a10409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:59.840326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b68a1482-8b18-4bd9-92a9-be44c9a10409 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:45:59.841799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b68a1482-8b18-4bd9-92a9-be44c9a10409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:45:59.867572 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1058/2111] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:45:59.868952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c358a-138b-41da-9bcf-46a23190ed05 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:59.886714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c358a-138b-41da-9bcf-46a23190ed05 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:59.896538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130d80-6e6f-4fca-901d-7f1ce033ec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:59.897873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130d80-6e6f-4fca-901d-7f1ce033ec88 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:59.898155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130d80-6e6f-4fca-901d-7f1ce033ec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:59.898443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130d80-6e6f-4fca-901d-7f1ce033ec88 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:59.900040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130d80-6e6f-4fca-901d-7f1ce033ec88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:45:59.900367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130d80-6e6f-4fca-901d-7f1ce033ec88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:59.902801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130d80-6e6f-4fca-901d-7f1ce033ec88 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:45:59.930155 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1054/2112] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:45:59.931662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a1482-8b18-4bd9-92a9-be44c9a10409 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:45:59.959981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a1482-8b18-4bd9-92a9-be44c9a10409 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:45:59.967270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3bb7-b653-40aa-acd4-2e86af20770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:45:59.968015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3bb7-b653-40aa-acd4-2e86af20770a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:45:59.968387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3bb7-b653-40aa-acd4-2e86af20770a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:45:59.968868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3bb7-b653-40aa-acd4-2e86af20770a admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:45:59.969743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3bb7-b653-40aa-acd4-2e86af20770a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:45:59.972164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3bb7-b653-40aa-acd4-2e86af20770a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:00.095347 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1059/2113] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:45:59 2022] POST /identity/v3/projects => generated 405 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:00.102480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130d80-6e6f-4fca-901d-7f1ce033ec88 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:00.120030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130d80-6e6f-4fca-901d-7f1ce033ec88 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:00.208657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766000ac-b973-4edc-a25b-a663bc2e1a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:00.210309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766000ac-b973-4edc-a25b-a663bc2e1a55 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:00.210309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766000ac-b973-4edc-a25b-a663bc2e1a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:00.210640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766000ac-b973-4edc-a25b-a663bc2e1a55 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:00.211441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766000ac-b973-4edc-a25b-a663bc2e1a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:00.213840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766000ac-b973-4edc-a25b-a663bc2e1a55 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:00.226593 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:00.258901 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1055/2114] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:00 2022] POST /identity/v3/users => generated 303 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:00.260394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3bb7-b653-40aa-acd4-2e86af20770a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:00.298475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3bb7-b653-40aa-acd4-2e86af20770a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:00.345636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095bcd4-63bf-47c5-8171-db547545fa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:00.347152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095bcd4-63bf-47c5-8171-db547545fa22 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:00.347916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095bcd4-63bf-47c5-8171-db547545fa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:00.348425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095bcd4-63bf-47c5-8171-db547545fa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:00.350661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095bcd4-63bf-47c5-8171-db547545fa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:00.364215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095bcd4-63bf-47c5-8171-db547545fa22 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:00.406931 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1060/2115] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:00.411838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766000ac-b973-4edc-a25b-a663bc2e1a55 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:00.427618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766000ac-b973-4edc-a25b-a663bc2e1a55 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:00.462285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dffa6d-760c-42ce-a478-a60e37e65dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:00.462936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dffa6d-760c-42ce-a478-a60e37e65dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:00.463226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dffa6d-760c-42ce-a478-a60e37e65dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:00.463502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dffa6d-760c-42ce-a478-a60e37e65dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:00.464168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dffa6d-760c-42ce-a478-a60e37e65dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:00.466059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dffa6d-760c-42ce-a478-a60e37e65dc2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:00.510492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095bcd4-63bf-47c5-8171-db547545fa22 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:00.519985 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1056/2116] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:00.526189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095bcd4-63bf-47c5-8171-db547545fa22 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:00.546168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62814986-2d8e-4a79-9521-4e4bbd03bc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:00.547431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62814986-2d8e-4a79-9521-4e4bbd03bc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:00.548748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62814986-2d8e-4a79-9521-4e4bbd03bc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:00.549351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62814986-2d8e-4a79-9521-4e4bbd03bc02 admin admin] PATH_INFO: `/v3/projects/9d9381c7ab7046248c2a9196ceea678d/users/a3d35038822f4938b970f1042634d4c2/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:00.580371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62814986-2d8e-4a79-9521-4e4bbd03bc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9381c7ab7046248c2a9196ceea678d, user_id=a3d35038822f4938b970f1042634d4c2, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:00.583965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62814986-2d8e-4a79-9521-4e4bbd03bc02 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:00.622168 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1061/2117] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:00 2022] PUT /identity/v3/projects/9d9381c7ab7046248c2a9196ceea678d/users/a3d35038822f4938b970f1042634d4c2/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:00.638717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf425c4d-707d-4052-87ff-97d234139b5b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:00.639593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf425c4d-707d-4052-87ff-97d234139b5b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:00.639593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf425c4d-707d-4052-87ff-97d234139b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:00.767134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cf425c4d-707d-4052-87ff-97d234139b5b None None] MFA Rules not processed for user `a3d35038822f4938b970f1042634d4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:00.772990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cf425c4d-707d-4052-87ff-97d234139b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:00.948447 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1057/2118] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:00.953729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62814986-2d8e-4a79-9521-4e4bbd03bc02 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:01.129200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62814986-2d8e-4a79-9521-4e4bbd03bc02 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:01.135563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc012642-aee9-4999-9e39-760d4b67ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:01.136303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc012642-aee9-4999-9e39-760d4b67ccf3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:01.136613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc012642-aee9-4999-9e39-760d4b67ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:01.136890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc012642-aee9-4999-9e39-760d4b67ccf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:01.137549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc012642-aee9-4999-9e39-760d4b67ccf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:01.139654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc012642-aee9-4999-9e39-760d4b67ccf3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:01.176338 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1062/2119] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:00 2022] POST /identity/v3/projects => generated 409 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:01.183187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf425c4d-707d-4052-87ff-97d234139b5b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:01.206145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf425c4d-707d-4052-87ff-97d234139b5b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:01.314506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47850f-4d22-4557-93f2-2c4b2849ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:01.315567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47850f-4d22-4557-93f2-2c4b2849ef67 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:01.316051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47850f-4d22-4557-93f2-2c4b2849ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:01.316340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47850f-4d22-4557-93f2-2c4b2849ef67 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:01.317144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47850f-4d22-4557-93f2-2c4b2849ef67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:01.320120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47850f-4d22-4557-93f2-2c4b2849ef67 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:01.359629 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1058/2120] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:01 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:01.361669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc012642-aee9-4999-9e39-760d4b67ccf3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:01.412830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc012642-aee9-4999-9e39-760d4b67ccf3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:01.424080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6d89a-4a59-43a2-bece-64582f7327b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:01.425439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6d89a-4a59-43a2-bece-64582f7327b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:01.425922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6d89a-4a59-43a2-bece-64582f7327b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:01.426413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6d89a-4a59-43a2-bece-64582f7327b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:01.427267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6d89a-4a59-43a2-bece-64582f7327b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:01.430337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6d89a-4a59-43a2-bece-64582f7327b2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:01.446762 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1063/2121] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:01.451804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47850f-4d22-4557-93f2-2c4b2849ef67 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:01.468342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47850f-4d22-4557-93f2-2c4b2849ef67 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:01.476084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a879b-67f4-4707-a184-053459b6d234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:01.477202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a879b-67f4-4707-a184-053459b6d234 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:01.477712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a879b-67f4-4707-a184-053459b6d234 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:01.478215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a879b-67f4-4707-a184-053459b6d234 admin admin] PATH_INFO: `/v3/projects/4f6b7bebe7f647e094ef04d16950e5cc/users/a86f6661a1834f86bc6a00dd81aba031/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:01.526464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a879b-67f4-4707-a184-053459b6d234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6b7bebe7f647e094ef04d16950e5cc, user_id=a86f6661a1834f86bc6a00dd81aba031, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:01.533847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a879b-67f4-4707-a184-053459b6d234 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:01.575828 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1059/2122] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:01 2022] PUT /identity/v3/projects/4f6b7bebe7f647e094ef04d16950e5cc/users/a86f6661a1834f86bc6a00dd81aba031/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:01.580546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6d89a-4a59-43a2-bece-64582f7327b2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:01.596714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6d89a-4a59-43a2-bece-64582f7327b2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:01.615020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a879b-67f4-4707-a184-053459b6d234 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:01.618161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-749a879b-67f4-4707-a184-053459b6d234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:01.700502 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:01.776085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a879b-67f4-4707-a184-053459b6d234 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:01.781695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:01.782573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:01.782858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:01.783054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103c54f-2c05-418d-9443-5bc8e19b8e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:01.783637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103c54f-2c05-418d-9443-5bc8e19b8e60 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:01.783752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] PATH_INFO: `/v3/users/a2dfb2187da34c4bba960f9b33affc70` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:01.783921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103c54f-2c05-418d-9443-5bc8e19b8e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:01.784469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103c54f-2c05-418d-9443-5bc8e19b8e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:01.785977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103c54f-2c05-418d-9443-5bc8e19b8e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:01.786268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2dfb2187da34c4bba960f9b33affc70)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:01.788334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103c54f-2c05-418d-9443-5bc8e19b8e60 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:01.790472 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:01.791743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:01.824581 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1064/2123] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:01.826052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103c54f-2c05-418d-9443-5bc8e19b8e60 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:01.855316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103c54f-2c05-418d-9443-5bc8e19b8e60 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:01.868077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8273f-3cb3-40d9-9af2-65ddda84d112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:01.872380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8273f-3cb3-40d9-9af2-65ddda84d112 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:01.872839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8273f-3cb3-40d9-9af2-65ddda84d112 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:01.873187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8273f-3cb3-40d9-9af2-65ddda84d112 admin admin] PATH_INFO: `/v3/projects/4f6b7bebe7f647e094ef04d16950e5cc/users/a86f6661a1834f86bc6a00dd81aba031/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:01.879129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8273f-3cb3-40d9-9af2-65ddda84d112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6b7bebe7f647e094ef04d16950e5cc, user_id=a86f6661a1834f86bc6a00dd81aba031, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:01.883326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8273f-3cb3-40d9-9af2-65ddda84d112 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:01.919766 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1065/2124] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:01 2022] PUT /identity/v3/projects/4f6b7bebe7f647e094ef04d16950e5cc/users/a86f6661a1834f86bc6a00dd81aba031/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:01.932343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7f607-3362-4dfc-826c-b8dd51f52e10 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:01.932644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7f607-3362-4dfc-826c-b8dd51f52e10 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:01.932941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7f607-3362-4dfc-826c-b8dd51f52e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:01.938228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2dfb2187da34c4bba960f9b33affc70'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:01.958133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2dfb2187da34c4bba960f9b33affc70'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:01.992665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2dfb2187da34c4bba960f9b33affc70'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.012764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d3f7f607-3362-4dfc-826c-b8dd51f52e10 None None] MFA Rules not processed for user `a86f6661a1834f86bc6a00dd81aba031`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:02.014072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d3f7f607-3362-4dfc-826c-b8dd51f52e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:02.018857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2dfb2187da34c4bba960f9b33affc70'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.021044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4891ef56-73ba-4c05-a605-fed7df670e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2dfb2187da34c4bba960f9b33affc70'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.044203 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1060/2125] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:01 2022] DELETE /identity/v3/users/a2dfb2187da34c4bba960f9b33affc70 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:02.047067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100459-0351-4324-965c-5f091b026268 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:02.047369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100459-0351-4324-965c-5f091b026268 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:02.047645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100459-0351-4324-965c-5f091b026268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:02.089616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-44100459-0351-4324-965c-5f091b026268 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:02.091107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-44100459-0351-4324-965c-5f091b026268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:02.208463 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1066/2126] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:02.218023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7f607-3362-4dfc-826c-b8dd51f52e10 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:02.222695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d3f7f607-3362-4dfc-826c-b8dd51f52e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:02.223041 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1061/2127] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:02.248933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100459-0351-4324-965c-5f091b026268 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:02.248933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-44100459-0351-4324-965c-5f091b026268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:02.368944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7f607-3362-4dfc-826c-b8dd51f52e10 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:02.402479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:02.402479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:02.402479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:02.402479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] PATH_INFO: `/v3/users/a3d35038822f4938b970f1042634d4c2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:02.402958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d35038822f4938b970f1042634d4c2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:02.402958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:02.518431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d35038822f4938b970f1042634d4c2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.537897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d35038822f4938b970f1042634d4c2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.539272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100459-0351-4324-965c-5f091b026268 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:02.544840 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:02.547052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890a8fd-6672-4b47-a328-8d23de64763c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:02.549413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890a8fd-6672-4b47-a328-8d23de64763c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:02.550719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890a8fd-6672-4b47-a328-8d23de64763c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:02.552151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890a8fd-6672-4b47-a328-8d23de64763c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:02.564107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d35038822f4938b970f1042634d4c2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.570735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890a8fd-6672-4b47-a328-8d23de64763c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:02.573533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890a8fd-6672-4b47-a328-8d23de64763c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:02.575928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d35038822f4938b970f1042634d4c2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.577530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9e7738d9-a1a5-45fa-8e1a-4175aca8366e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d35038822f4938b970f1042634d4c2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:02.581300 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:02.592429 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1067/2128] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:02 2022] DELETE /identity/v3/users/a3d35038822f4938b970f1042634d4c2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:02.604047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce2d90-5a73-4ff0-a0db-84f905b8a8cc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:02.604047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce2d90-5a73-4ff0-a0db-84f905b8a8cc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:02.604047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce2d90-5a73-4ff0-a0db-84f905b8a8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:02.609400 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1062/2129] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:02.649980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-62ce2d90-5a73-4ff0-a0db-84f905b8a8cc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:02.655154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-62ce2d90-5a73-4ff0-a0db-84f905b8a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:02.872456 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1068/2130] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:02.912837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890a8fd-6672-4b47-a328-8d23de64763c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:02.926855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890a8fd-6672-4b47-a328-8d23de64763c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.072530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421126-e6a5-481c-b988-7d1a37a3d825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.073249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421126-e6a5-481c-b988-7d1a37a3d825 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.073530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421126-e6a5-481c-b988-7d1a37a3d825 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.073806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421126-e6a5-481c-b988-7d1a37a3d825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.104494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da421126-e6a5-481c-b988-7d1a37a3d825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.106033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da421126-e6a5-481c-b988-7d1a37a3d825 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.139801 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1063/2131] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:03.392516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce2d90-5a73-4ff0-a0db-84f905b8a8cc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.396515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-62ce2d90-5a73-4ff0-a0db-84f905b8a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:03.429838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce2d90-5a73-4ff0-a0db-84f905b8a8cc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:03.446391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:03.447258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:03.447544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:03.447819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] PATH_INFO: `/v3/projects/bdebe0fcd25d4fe2a091f0ca3b223dbe` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:03.449115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdebe0fcd25d4fe2a091f0ca3b223dbe)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:03.450984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:03.610256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdebe0fcd25d4fe2a091f0ca3b223dbe', 'request_id': 'req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.620492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdebe0fcd25d4fe2a091f0ca3b223dbe', 'request_id': 'req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.628881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdebe0fcd25d4fe2a091f0ca3b223dbe', 'request_id': 'req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.657864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] The token cache is being invalidate because project bdebe0fcd25d4fe2a091f0ca3b223dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:03.658313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.658848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:03.660409 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1069/2132] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:03 2022] DELETE /identity/v3/projects/bdebe0fcd25d4fe2a091f0ca3b223dbe => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:03.665288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421126-e6a5-481c-b988-7d1a37a3d825 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:03.686871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421126-e6a5-481c-b988-7d1a37a3d825 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.039353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:04.040068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.040306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.040581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] PATH_INFO: `/v3/users/9e10262829ee4ddfbb9b0fab05f4bba9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.042091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e10262829ee4ddfbb9b0fab05f4bba9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:04.049065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:04.159121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e10262829ee4ddfbb9b0fab05f4bba9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.192742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e10262829ee4ddfbb9b0fab05f4bba9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.204987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e10262829ee4ddfbb9b0fab05f4bba9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.217668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e10262829ee4ddfbb9b0fab05f4bba9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.218919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e10262829ee4ddfbb9b0fab05f4bba9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.222700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:04.224300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:04.231913 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1064/2133] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:03 2022] DELETE /identity/v3/users/9e10262829ee4ddfbb9b0fab05f4bba9 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:04.274334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d21eb-6cb0-4e01-a065-6e33bf8e9bcd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.579919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:04.581445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:04.581727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:04.582156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] PATH_INFO: `/v3/projects/9d9381c7ab7046248c2a9196ceea678d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:04.590567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9381c7ab7046248c2a9196ceea678d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:04.592661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:04.649847 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:04.809982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9381c7ab7046248c2a9196ceea678d', 'request_id': 'req-25966740-cf5d-4514-9b2c-5266412843b7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.822943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9381c7ab7046248c2a9196ceea678d', 'request_id': 'req-25966740-cf5d-4514-9b2c-5266412843b7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.835636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9381c7ab7046248c2a9196ceea678d', 'request_id': 'req-25966740-cf5d-4514-9b2c-5266412843b7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.861438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] The token cache is being invalidate because project 9d9381c7ab7046248c2a9196ceea678d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:04.862156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.863204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:04.870851 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1070/2134] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:04 2022] DELETE /identity/v3/projects/9d9381c7ab7046248c2a9196ceea678d => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:04.871206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:04.873926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:04.910285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305bef7-4282-4b97-bdcf-b3b4dea2df04 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:04.988612 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:05.135646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:05.136345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:05.136647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:05.137046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] PATH_INFO: `/v3/users/a86f6661a1834f86bc6a00dd81aba031` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:05.138312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86f6661a1834f86bc6a00dd81aba031)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:05.142784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:05.217935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:05.219442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:05.249869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25966740-cf5d-4514-9b2c-5266412843b7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:05.269636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:05.270330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:05.270608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:05.270929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] PATH_INFO: `/v3/projects/3dda88afd84148eeb4d54bef68ed5791` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:05.274940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dda88afd84148eeb4d54bef68ed5791)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:05.290786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:05.323669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86f6661a1834f86bc6a00dd81aba031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.371646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86f6661a1834f86bc6a00dd81aba031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.409633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86f6661a1834f86bc6a00dd81aba031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.449252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86f6661a1834f86bc6a00dd81aba031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.451748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a1c7678-0592-4717-8374-4138ca242a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86f6661a1834f86bc6a00dd81aba031'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.464603 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1065/2135] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:04 2022] DELETE /identity/v3/users/a86f6661a1834f86bc6a00dd81aba031 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:05.482956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dda88afd84148eeb4d54bef68ed5791', 'request_id': 'req-f9c736a6-ceb1-483d-8cfd-92a85167013d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.502924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dda88afd84148eeb4d54bef68ed5791', 'request_id': 'req-f9c736a6-ceb1-483d-8cfd-92a85167013d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.523589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dda88afd84148eeb4d54bef68ed5791', 'request_id': 'req-f9c736a6-ceb1-483d-8cfd-92a85167013d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.557283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] The token cache is being invalidate because project 3dda88afd84148eeb4d54bef68ed5791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:05.559214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.561512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f9c736a6-ceb1-483d-8cfd-92a85167013d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:05.563775 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1071/2136] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:05 2022] DELETE /identity/v3/projects/3dda88afd84148eeb4d54bef68ed5791 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:05.568643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a0276-f520-4fff-af77-aaabaf604bb6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:05.568930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a0276-f520-4fff-af77-aaabaf604bb6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:05.569207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a0276-f520-4fff-af77-aaabaf604bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:05.611938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f46a0276-f520-4fff-af77-aaabaf604bb6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:05.613784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f46a0276-f520-4fff-af77-aaabaf604bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:05.781754 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1066/2137] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:05.790227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dfef5-7cc3-4840-b281-efa3bbb6a866 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:05.790773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dfef5-7cc3-4840-b281-efa3bbb6a866 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:05.790773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dfef5-7cc3-4840-b281-efa3bbb6a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:05.815918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6f7dfef5-7cc3-4840-b281-efa3bbb6a866 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:05.817200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6f7dfef5-7cc3-4840-b281-efa3bbb6a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:05.836048 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1072/2138] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:05.841447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a0276-f520-4fff-af77-aaabaf604bb6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:05.854098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a0276-f520-4fff-af77-aaabaf604bb6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:05.876078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:05.876877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:05.880048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:05.880363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:05.882797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:05.883138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:05.886368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:05.920203 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1067/2139] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:05.924816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dfef5-7cc3-4840-b281-efa3bbb6a866 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:05.936951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dfef5-7cc3-4840-b281-efa3bbb6a866 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:05.950931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b51db-bade-4782-b74e-67a048bae00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:05.951581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b51db-bade-4782-b74e-67a048bae00a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:05.951867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b51db-bade-4782-b74e-67a048bae00a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:05.952144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b51db-bade-4782-b74e-67a048bae00a admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:05.953297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b51db-bade-4782-b74e-67a048bae00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:05.955388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b51db-bade-4782-b74e-67a048bae00a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:06.004191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:06.006729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:06.033099 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1073/2140] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:05 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:06.036398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353b0ca-2171-4336-af97-a951709f9156 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:06.038602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b51db-bade-4782-b74e-67a048bae00a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:06.116957 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:06.214585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:06.215886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:06.216498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:06.217416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] PATH_INFO: `/v3/projects/4f6b7bebe7f647e094ef04d16950e5cc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:06.229199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6b7bebe7f647e094ef04d16950e5cc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:06.236062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:06.268482 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:06.283233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b51db-bade-4782-b74e-67a048bae00a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:06.313407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730851-2b18-4724-bf25-1e70f245f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:06.314048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730851-2b18-4724-bf25-1e70f245f042 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:06.314374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730851-2b18-4724-bf25-1e70f245f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:06.314700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730851-2b18-4724-bf25-1e70f245f042 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:06.315468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09730851-2b18-4724-bf25-1e70f245f042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:06.317380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09730851-2b18-4724-bf25-1e70f245f042 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:06.407057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6b7bebe7f647e094ef04d16950e5cc', 'request_id': 'req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:06.407288 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1074/2141] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:06 2022] POST /identity/v3/users => generated 294 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:06.408132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730851-2b18-4724-bf25-1e70f245f042 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:06.441031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6b7bebe7f647e094ef04d16950e5cc', 'request_id': 'req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:06.441648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730851-2b18-4724-bf25-1e70f245f042 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:06.462487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6b7bebe7f647e094ef04d16950e5cc', 'request_id': 'req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:06.494853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] The token cache is being invalidate because project 4f6b7bebe7f647e094ef04d16950e5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:06.495462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:06.496831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5790a8a-c8f2-4591-8db9-d4ec4e48b1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:06.500297 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1068/2142] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:06 2022] DELETE /identity/v3/projects/4f6b7bebe7f647e094ef04d16950e5cc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:06.512961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f57d-a4ee-4203-811e-ce444ad2c851 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:06.513660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f57d-a4ee-4203-811e-ce444ad2c851 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:06.514298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f57d-a4ee-4203-811e-ce444ad2c851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:06.582122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8471f57d-a4ee-4203-811e-ce444ad2c851 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:06.584561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8471f57d-a4ee-4203-811e-ce444ad2c851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:06.623905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324ecf-2a8d-4766-8ee9-cc80693fbcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:06.625407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324ecf-2a8d-4766-8ee9-cc80693fbcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:06.625861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324ecf-2a8d-4766-8ee9-cc80693fbcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:06.626299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324ecf-2a8d-4766-8ee9-cc80693fbcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:06.627096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f324ecf-2a8d-4766-8ee9-cc80693fbcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:06.629054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f324ecf-2a8d-4766-8ee9-cc80693fbcd6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:06.681738 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1075/2143] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:06.686145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324ecf-2a8d-4766-8ee9-cc80693fbcd6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:06.695180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8f324ecf-2a8d-4766-8ee9-cc80693fbcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:06.721270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324ecf-2a8d-4766-8ee9-cc80693fbcd6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:06.745919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d574b8-cb84-4ddc-b027-26b2fed5aea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:06.748431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d574b8-cb84-4ddc-b027-26b2fed5aea7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:06.748751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d574b8-cb84-4ddc-b027-26b2fed5aea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:06.751367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d574b8-cb84-4ddc-b027-26b2fed5aea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:06.752159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d574b8-cb84-4ddc-b027-26b2fed5aea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:06.761344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d574b8-cb84-4ddc-b027-26b2fed5aea7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:06.763123 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1069/2144] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:06.773414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d35a-e5de-401d-a6cc-c3d6fcc12eac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:06.774016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d35a-e5de-401d-a6cc-c3d6fcc12eac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:06.774702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d35a-e5de-401d-a6cc-c3d6fcc12eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:06.794392 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1076/2145] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:06.798272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d574b8-cb84-4ddc-b027-26b2fed5aea7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:06.825232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-91c0d35a-e5de-401d-a6cc-c3d6fcc12eac None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:06.827164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d574b8-cb84-4ddc-b027-26b2fed5aea7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:06.832953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-91c0d35a-e5de-401d-a6cc-c3d6fcc12eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:06.835052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987683c8-f3f0-4629-8844-0a1c7220b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:06.836150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987683c8-f3f0-4629-8844-0a1c7220b620 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:06.836582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987683c8-f3f0-4629-8844-0a1c7220b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:06.837055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987683c8-f3f0-4629-8844-0a1c7220b620 admin admin] PATH_INFO: `/v3/projects/9ea5b720ddab4e6d9cd381dc755b6f26/users/cdd7ac4e5a1a4a7aa1108dd96b345253/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:06.855724 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1070/2146] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:06.857419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d35a-e5de-401d-a6cc-c3d6fcc12eac None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:06.859287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987683c8-f3f0-4629-8844-0a1c7220b620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea5b720ddab4e6d9cd381dc755b6f26, user_id=cdd7ac4e5a1a4a7aa1108dd96b345253, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:06.863105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987683c8-f3f0-4629-8844-0a1c7220b620 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:06.874582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d35a-e5de-401d-a6cc-c3d6fcc12eac None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:06.880042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357c96-3f05-4a1b-b44c-0217fc65b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:06.885524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357c96-3f05-4a1b-b44c-0217fc65b72e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:06.890488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357c96-3f05-4a1b-b44c-0217fc65b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:06.890929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357c96-3f05-4a1b-b44c-0217fc65b72e admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:06.891821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51357c96-3f05-4a1b-b44c-0217fc65b72e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:06.892232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51357c96-3f05-4a1b-b44c-0217fc65b72e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:06.894261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51357c96-3f05-4a1b-b44c-0217fc65b72e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:06.905195 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1077/2147] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:06 2022] PUT /identity/v3/projects/9ea5b720ddab4e6d9cd381dc755b6f26/users/cdd7ac4e5a1a4a7aa1108dd96b345253/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:06.916766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8693f-9cd2-4150-91cd-df69717f385b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:06.917322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8693f-9cd2-4150-91cd-df69717f385b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:06.918038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8693f-9cd2-4150-91cd-df69717f385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:06.935629 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1071/2148] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:06.939185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357c96-3f05-4a1b-b44c-0217fc65b72e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:06.956478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357c96-3f05-4a1b-b44c-0217fc65b72e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:06.968252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0bd8693f-9cd2-4150-91cd-df69717f385b None None] MFA Rules not processed for user `cdd7ac4e5a1a4a7aa1108dd96b345253`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:06.970262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0bd8693f-9cd2-4150-91cd-df69717f385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:07.023226 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:07.084601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccf8f7-1d23-4025-979a-3a22275dd819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:07.091351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccf8f7-1d23-4025-979a-3a22275dd819 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.091747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccf8f7-1d23-4025-979a-3a22275dd819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:07.092100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccf8f7-1d23-4025-979a-3a22275dd819 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:07.096171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccf8f7-1d23-4025-979a-3a22275dd819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:07.097398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccf8f7-1d23-4025-979a-3a22275dd819 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:07.133851 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1078/2149] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:07.139626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8693f-9cd2-4150-91cd-df69717f385b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:07.163806 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1072/2150] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:06 2022] POST /identity/v3/projects => generated 413 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:07.167237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8693f-9cd2-4150-91cd-df69717f385b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:07.167640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccf8f7-1d23-4025-979a-3a22275dd819 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:07.262856 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:07.319049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798de3a5-d4ef-41f8-9157-e99bc9d006a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:07.320506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798de3a5-d4ef-41f8-9157-e99bc9d006a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.321266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798de3a5-d4ef-41f8-9157-e99bc9d006a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:07.321995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798de3a5-d4ef-41f8-9157-e99bc9d006a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:07.323047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798de3a5-d4ef-41f8-9157-e99bc9d006a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:07.325788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798de3a5-d4ef-41f8-9157-e99bc9d006a1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:07.352503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccf8f7-1d23-4025-979a-3a22275dd819 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:07.359376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857341c5-b6ff-469e-a3ba-867cdca68d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:07.360118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857341c5-b6ff-469e-a3ba-867cdca68d22 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.360385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857341c5-b6ff-469e-a3ba-867cdca68d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:07.360767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857341c5-b6ff-469e-a3ba-867cdca68d22 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:07.364316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857341c5-b6ff-469e-a3ba-867cdca68d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:07.367310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857341c5-b6ff-469e-a3ba-867cdca68d22 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:07.433314 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1079/2151] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:07 2022] POST /identity/v3/projects => generated 387 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:07.433456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798de3a5-d4ef-41f8-9157-e99bc9d006a1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:07.438329 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1073/2152] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:07 2022] POST /identity/v3/users => generated 307 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:07.442108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857341c5-b6ff-469e-a3ba-867cdca68d22 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:07.467390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857341c5-b6ff-469e-a3ba-867cdca68d22 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:07.629370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798de3a5-d4ef-41f8-9157-e99bc9d006a1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:07.641117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fd24-5f4d-4b46-bdd7-499220fb52f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:07.642017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fd24-5f4d-4b46-bdd7-499220fb52f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.642300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fd24-5f4d-4b46-bdd7-499220fb52f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:07.650628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fd24-5f4d-4b46-bdd7-499220fb52f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:07.651588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434fd24-5f4d-4b46-bdd7-499220fb52f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:07.659277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434fd24-5f4d-4b46-bdd7-499220fb52f4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:07.664838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21aca02-c319-49c8-9290-a4a5159eb820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:07.665794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aca02-c319-49c8-9290-a4a5159eb820 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.666306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aca02-c319-49c8-9290-a4a5159eb820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:07.666696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aca02-c319-49c8-9290-a4a5159eb820 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:07.667613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aca02-c319-49c8-9290-a4a5159eb820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:07.671023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aca02-c319-49c8-9290-a4a5159eb820 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:07.696049 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1080/2153] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:07 2022] POST /identity/v3/users => generated 300 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:07.700005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fd24-5f4d-4b46-bdd7-499220fb52f4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:07.715565 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1074/2154] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:07.717672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fd24-5f4d-4b46-bdd7-499220fb52f4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:07.720751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21aca02-c319-49c8-9290-a4a5159eb820 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:07.742729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f5777-3249-4ecb-91be-93da7b3b0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:07.746356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f5777-3249-4ecb-91be-93da7b3b0099 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.747044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f5777-3249-4ecb-91be-93da7b3b0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:07.747947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f5777-3249-4ecb-91be-93da7b3b0099 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:07.749424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f5777-3249-4ecb-91be-93da7b3b0099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:07.752493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21aca02-c319-49c8-9290-a4a5159eb820 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:07.753373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f5777-3249-4ecb-91be-93da7b3b0099 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:07.761523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1939fb-0cf2-4a5a-93c8-712cb5345f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:07.763651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1939fb-0cf2-4a5a-93c8-712cb5345f40 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.765247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1939fb-0cf2-4a5a-93c8-712cb5345f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:07.765873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1939fb-0cf2-4a5a-93c8-712cb5345f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:07.769049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1939fb-0cf2-4a5a-93c8-712cb5345f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:07.774595 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1081/2155] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:07.774973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1939fb-0cf2-4a5a-93c8-712cb5345f40 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:07.775874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f5777-3249-4ecb-91be-93da7b3b0099 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:07.794445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f5777-3249-4ecb-91be-93da7b3b0099 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:07.798071 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1075/2156] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:07.803924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1939fb-0cf2-4a5a-93c8-712cb5345f40 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:07.809075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e647222-09f8-4042-afb1-0eca35b8e3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:07.809775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e647222-09f8-4042-afb1-0eca35b8e3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.810059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e647222-09f8-4042-afb1-0eca35b8e3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:07.810340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e647222-09f8-4042-afb1-0eca35b8e3dd admin admin] PATH_INFO: `/v3/projects/209ec766e42844a0bd50c06d4ae3e43e/users/d40e09d984e648c3999404ee621ae60a/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:07.835869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e647222-09f8-4042-afb1-0eca35b8e3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=209ec766e42844a0bd50c06d4ae3e43e, user_id=d40e09d984e648c3999404ee621ae60a, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:07.838894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e647222-09f8-4042-afb1-0eca35b8e3dd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:07.850634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1939fb-0cf2-4a5a-93c8-712cb5345f40 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:07.868149 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1082/2157] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:07 2022] PUT /identity/v3/projects/209ec766e42844a0bd50c06d4ae3e43e/users/d40e09d984e648c3999404ee621ae60a/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:07.868953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497a69e-7d32-4abd-b217-9923cc7a482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:07.872574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e647222-09f8-4042-afb1-0eca35b8e3dd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:07.874357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497a69e-7d32-4abd-b217-9923cc7a482b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.875117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497a69e-7d32-4abd-b217-9923cc7a482b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:07.876514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497a69e-7d32-4abd-b217-9923cc7a482b admin admin] PATH_INFO: `/v3/projects/796e6e3631804c6db3fae3e40e4702fb/users/c68fb32e68194933b6c69383572c27b6/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:07.925571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497a69e-7d32-4abd-b217-9923cc7a482b admin admin] RBAC: Authorizing `identity:create_grant(project_id=796e6e3631804c6db3fae3e40e4702fb, user_id=c68fb32e68194933b6c69383572c27b6, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:07.930949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497a69e-7d32-4abd-b217-9923cc7a482b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:07.982998 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1076/2158] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:07 2022] PUT /identity/v3/projects/796e6e3631804c6db3fae3e40e4702fb/users/c68fb32e68194933b6c69383572c27b6/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:07.993689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916eea-5645-462a-b1cb-007d3ab1d732 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:07.994190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916eea-5645-462a-b1cb-007d3ab1d732 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:08.008293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916eea-5645-462a-b1cb-007d3ab1d732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:08.081683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e647222-09f8-4042-afb1-0eca35b8e3dd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:08.100282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-38916eea-5645-462a-b1cb-007d3ab1d732 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:08.101903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-38916eea-5645-462a-b1cb-007d3ab1d732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:08.156292 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:08.163351 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:08.279436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683e2a5-1ef4-4914-a893-fa29a1cfdcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:08.279924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683e2a5-1ef4-4914-a893-fa29a1cfdcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:08.280272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683e2a5-1ef4-4914-a893-fa29a1cfdcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:08.280562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683e2a5-1ef4-4914-a893-fa29a1cfdcd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:08.281296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683e2a5-1ef4-4914-a893-fa29a1cfdcd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:08.283166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683e2a5-1ef4-4914-a893-fa29a1cfdcd4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:08.323998 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1083/2159] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:08.325140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683e2a5-1ef4-4914-a893-fa29a1cfdcd4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:08.330447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f683e2a5-1ef4-4914-a893-fa29a1cfdcd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:08.401793 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1077/2160] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:08.402475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916eea-5645-462a-b1cb-007d3ab1d732 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:08.418668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916eea-5645-462a-b1cb-007d3ab1d732 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:08.426931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a2625-ff37-411a-96e1-2ee504bbafac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:08.429213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a2625-ff37-411a-96e1-2ee504bbafac admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:08.429494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a2625-ff37-411a-96e1-2ee504bbafac admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:08.429771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a2625-ff37-411a-96e1-2ee504bbafac admin admin] PATH_INFO: `/v3/projects/209ec766e42844a0bd50c06d4ae3e43e/users/d40e09d984e648c3999404ee621ae60a/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:08.432709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a2625-ff37-411a-96e1-2ee504bbafac admin admin] RBAC: Authorizing `identity:create_grant(project_id=209ec766e42844a0bd50c06d4ae3e43e, user_id=d40e09d984e648c3999404ee621ae60a, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:08.435515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a2625-ff37-411a-96e1-2ee504bbafac admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:08.453511 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1078/2161] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:08 2022] PUT /identity/v3/projects/209ec766e42844a0bd50c06d4ae3e43e/users/d40e09d984e648c3999404ee621ae60a/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:08.465743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a2625-ff37-411a-96e1-2ee504bbafac admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:08.472684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-863a2625-ff37-411a-96e1-2ee504bbafac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:08.582092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683e2a5-1ef4-4914-a893-fa29a1cfdcd4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:08.666042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a2625-ff37-411a-96e1-2ee504bbafac admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:08.686388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1895d2-0aea-44df-81d9-643511d04761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:08.687677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1895d2-0aea-44df-81d9-643511d04761 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:08.688404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1895d2-0aea-44df-81d9-643511d04761 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:08.688759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1895d2-0aea-44df-81d9-643511d04761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:08.701526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8fa24-cc62-41e2-8870-e2f15e07a478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:08.703563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8fa24-cc62-41e2-8870-e2f15e07a478 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:08.704004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8fa24-cc62-41e2-8870-e2f15e07a478 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:08.704434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8fa24-cc62-41e2-8870-e2f15e07a478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:08.709442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7fc8fa24-cc62-41e2-8870-e2f15e07a478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:08.796794 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:08.813775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8fa24-cc62-41e2-8870-e2f15e07a478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:08.815822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8fa24-cc62-41e2-8870-e2f15e07a478 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:08.822656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1895d2-0aea-44df-81d9-643511d04761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:08.824546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1895d2-0aea-44df-81d9-643511d04761 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:08.835993 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1084/2162] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:08.837864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787afd-c2a1-4965-81eb-e09a21481ca2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:08.838448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787afd-c2a1-4965-81eb-e09a21481ca2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:08.838951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787afd-c2a1-4965-81eb-e09a21481ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:08.861469 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1079/2163] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:08.888763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-68787afd-c2a1-4965-81eb-e09a21481ca2 None None] MFA Rules not processed for user `d40e09d984e648c3999404ee621ae60a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:08.890597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-68787afd-c2a1-4965-81eb-e09a21481ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:09.200376 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1085/2164] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:10.140764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1895d2-0aea-44df-81d9-643511d04761 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:10.143040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ef1895d2-0aea-44df-81d9-643511d04761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:10.197931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1895d2-0aea-44df-81d9-643511d04761 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:10.223231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0fa87-a1c6-4abe-a481-2e1c775c85d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:10.223990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0fa87-a1c6-4abe-a481-2e1c775c85d2 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:10.224669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0fa87-a1c6-4abe-a481-2e1c775c85d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:10.224669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0fa87-a1c6-4abe-a481-2e1c775c85d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:10.246473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0fa87-a1c6-4abe-a481-2e1c775c85d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:10.246473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0fa87-a1c6-4abe-a481-2e1c775c85d2 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:10.259966 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1080/2165] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:10.651865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787afd-c2a1-4965-81eb-e09a21481ca2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:10.685632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787afd-c2a1-4965-81eb-e09a21481ca2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:10.727080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdba8e0-a653-43e6-9be4-93c1fb0754d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:10.727785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdba8e0-a653-43e6-9be4-93c1fb0754d4 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:10.728222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdba8e0-a653-43e6-9be4-93c1fb0754d4 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:10.728356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdba8e0-a653-43e6-9be4-93c1fb0754d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:10.879459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdba8e0-a653-43e6-9be4-93c1fb0754d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:10.883167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdba8e0-a653-43e6-9be4-93c1fb0754d4 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:10.897909 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1086/2166] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:14.001825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0fa87-a1c6-4abe-a481-2e1c775c85d2 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:14.016722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0fa87-a1c6-4abe-a481-2e1c775c85d2 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:14.022356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:14.023391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:14.023771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:14.024137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] PATH_INFO: `/v3/users/cdd7ac4e5a1a4a7aa1108dd96b345253` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:14.025731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd7ac4e5a1a4a7aa1108dd96b345253)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:14.028282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:14.081478 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:14.110504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd7ac4e5a1a4a7aa1108dd96b345253'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:14.133361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd7ac4e5a1a4a7aa1108dd96b345253'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:14.144771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd7ac4e5a1a4a7aa1108dd96b345253'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:14.154477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd7ac4e5a1a4a7aa1108dd96b345253'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:14.155243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd7ac4e5a1a4a7aa1108dd96b345253'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:14.163524 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1081/2167] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:13 2022] DELETE /identity/v3/users/cdd7ac4e5a1a4a7aa1108dd96b345253 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:14.169076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f4007-a0bb-4d39-91cd-8e11bf66d7c8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:14.169645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f4007-a0bb-4d39-91cd-8e11bf66d7c8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:14.169764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f4007-a0bb-4d39-91cd-8e11bf66d7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:14.191484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-743f4007-a0bb-4d39-91cd-8e11bf66d7c8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:14.192500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-743f4007-a0bb-4d39-91cd-8e11bf66d7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:14.265683 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1087/2168] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:14.284496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:14.285981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:14.367304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe064e47-6f55-4c39-b5f6-23865ac40cf9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:14.371596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25c6e-4d31-47b6-8aa7-1d17489f6eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:14.372998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25c6e-4d31-47b6-8aa7-1d17489f6eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:14.373283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25c6e-4d31-47b6-8aa7-1d17489f6eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:14.373563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25c6e-4d31-47b6-8aa7-1d17489f6eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:14.386387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25c6e-4d31-47b6-8aa7-1d17489f6eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:14.388068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25c6e-4d31-47b6-8aa7-1d17489f6eb3 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:14.408463 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1082/2169] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:15.557485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f4007-a0bb-4d39-91cd-8e11bf66d7c8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:15.560314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-743f4007-a0bb-4d39-91cd-8e11bf66d7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:15.600096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f4007-a0bb-4d39-91cd-8e11bf66d7c8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:15.627487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:15.628631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:15.629144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:15.629646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] PATH_INFO: `/v3/projects/9ea5b720ddab4e6d9cd381dc755b6f26` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:15.642977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea5b720ddab4e6d9cd381dc755b6f26)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:15.651783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:15.683035 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:15.796018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea5b720ddab4e6d9cd381dc755b6f26', 'request_id': 'req-40bd5821-440e-4a49-8d4d-8a4507186198'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:15.811106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea5b720ddab4e6d9cd381dc755b6f26', 'request_id': 'req-40bd5821-440e-4a49-8d4d-8a4507186198'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:15.825053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea5b720ddab4e6d9cd381dc755b6f26', 'request_id': 'req-40bd5821-440e-4a49-8d4d-8a4507186198'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:15.846327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] The token cache is being invalidate because project 9ea5b720ddab4e6d9cd381dc755b6f26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:15.847130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:15.850145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:15.852448 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1088/2170] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:15 2022] DELETE /identity/v3/projects/9ea5b720ddab4e6d9cd381dc755b6f26 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:15.857058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25c6e-4d31-47b6-8aa7-1d17489f6eb3 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:15.872702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25c6e-4d31-47b6-8aa7-1d17489f6eb3 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:16.111778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:16.115149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:16.115530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:16.115815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] PATH_INFO: `/v3/users/d40e09d984e648c3999404ee621ae60a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:16.118599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40e09d984e648c3999404ee621ae60a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:16.126974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:16.261661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40e09d984e648c3999404ee621ae60a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:16.275625 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:16.291425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40e09d984e648c3999404ee621ae60a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:16.305534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40e09d984e648c3999404ee621ae60a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:16.318193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40e09d984e648c3999404ee621ae60a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:16.320121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c3378b-eb71-41ed-92aa-6c7b2b0934cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40e09d984e648c3999404ee621ae60a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:16.335895 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1083/2171] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:15 2022] DELETE /identity/v3/users/d40e09d984e648c3999404ee621ae60a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:16.800780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:16.802230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:16.829696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd5821-440e-4a49-8d4d-8a4507186198 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:16.996516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:16.997406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:16.997971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:16.998528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] PATH_INFO: `/v3/projects/209ec766e42844a0bd50c06d4ae3e43e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:17.001101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209ec766e42844a0bd50c06d4ae3e43e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:17.009374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:17.113212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209ec766e42844a0bd50c06d4ae3e43e', 'request_id': 'req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:17.127128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209ec766e42844a0bd50c06d4ae3e43e', 'request_id': 'req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:17.139942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209ec766e42844a0bd50c06d4ae3e43e', 'request_id': 'req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:17.171356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] The token cache is being invalidate because project 209ec766e42844a0bd50c06d4ae3e43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:17.171649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:17.172368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ba4226b1-95d8-4984-8b5a-41f2ffdf6d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:17.174395 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1089/2172] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:16 2022] DELETE /identity/v3/projects/209ec766e42844a0bd50c06d4ae3e43e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:17.179892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a593e-dd04-4291-99e1-b94a90ec717d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:17.180438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a593e-dd04-4291-99e1-b94a90ec717d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:17.180438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a593e-dd04-4291-99e1-b94a90ec717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:17.228608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-169a593e-dd04-4291-99e1-b94a90ec717d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:17.229940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-169a593e-dd04-4291-99e1-b94a90ec717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:17.497377 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1084/2173] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:17.507960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f116d21-a2f5-4d0b-be42-b27e614f9a80 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:17.508695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f116d21-a2f5-4d0b-be42-b27e614f9a80 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:17.509218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f116d21-a2f5-4d0b-be42-b27e614f9a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:17.539887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2f116d21-a2f5-4d0b-be42-b27e614f9a80 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:17.541640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2f116d21-a2f5-4d0b-be42-b27e614f9a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:17.559073 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1090/2174] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:17.564957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a593e-dd04-4291-99e1-b94a90ec717d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:17.583999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a593e-dd04-4291-99e1-b94a90ec717d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:17.602848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c92ce-2ff3-4238-a456-71d00452890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:17.605763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c92ce-2ff3-4238-a456-71d00452890c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:17.606118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c92ce-2ff3-4238-a456-71d00452890c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:17.606413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c92ce-2ff3-4238-a456-71d00452890c admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:17.607101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c92ce-2ff3-4238-a456-71d00452890c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:17.607405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c92ce-2ff3-4238-a456-71d00452890c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:17.613878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c92ce-2ff3-4238-a456-71d00452890c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:17.647419 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1085/2175] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:17.653253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f116d21-a2f5-4d0b-be42-b27e614f9a80 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:17.683005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f116d21-a2f5-4d0b-be42-b27e614f9a80 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:17.701206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8973c-8f45-4778-bec0-3ab7bfbe0f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:17.703055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8973c-8f45-4778-bec0-3ab7bfbe0f14 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:17.703916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8973c-8f45-4778-bec0-3ab7bfbe0f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:17.704700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8973c-8f45-4778-bec0-3ab7bfbe0f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:17.706186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8973c-8f45-4778-bec0-3ab7bfbe0f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:17.710704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8973c-8f45-4778-bec0-3ab7bfbe0f14 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:17.813947 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:17.822547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad7ce6-5bf2-4b54-ad44-867061ea06b9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:17.823020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad7ce6-5bf2-4b54-ad44-867061ea06b9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:17.823614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad7ce6-5bf2-4b54-ad44-867061ea06b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:17.835861 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1091/2176] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:17 2022] POST /identity/v3/projects => generated 391 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:17.836996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8973c-8f45-4778-bec0-3ab7bfbe0f14 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:17.875984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e7ad7ce6-5bf2-4b54-ad44-867061ea06b9 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:17.877863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e7ad7ce6-5bf2-4b54-ad44-867061ea06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:18.023025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8973c-8f45-4778-bec0-3ab7bfbe0f14 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:18.032395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3eec-6e2f-4cb5-be07-a761bc975a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:18.039028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3eec-6e2f-4cb5-be07-a761bc975a19 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:18.039351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3eec-6e2f-4cb5-be07-a761bc975a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:18.039812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3eec-6e2f-4cb5-be07-a761bc975a19 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:18.040808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3eec-6e2f-4cb5-be07-a761bc975a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:18.046452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3eec-6e2f-4cb5-be07-a761bc975a19 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:18.103230 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1092/2177] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:17 2022] POST /identity/v3/users => generated 296 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:18.105791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3eec-6e2f-4cb5-be07-a761bc975a19 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:18.116420 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1086/2178] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:46:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:18.128801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3eec-6e2f-4cb5-be07-a761bc975a19 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:18.135923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad7ce6-5bf2-4b54-ad44-867061ea06b9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:18.139842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e7ad7ce6-5bf2-4b54-ad44-867061ea06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:18.142734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957883aa-4c44-4fb8-b409-12b608dab017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:18.143904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957883aa-4c44-4fb8-b409-12b608dab017 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:18.144382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957883aa-4c44-4fb8-b409-12b608dab017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:18.144961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957883aa-4c44-4fb8-b409-12b608dab017 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:18.147023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957883aa-4c44-4fb8-b409-12b608dab017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:18.150499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957883aa-4c44-4fb8-b409-12b608dab017 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:18.203437 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1093/2179] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:18.208333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957883aa-4c44-4fb8-b409-12b608dab017 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:18.265821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957883aa-4c44-4fb8-b409-12b608dab017 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:18.281179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5b85c-d1b4-4c31-99c1-f85be0b60ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:18.284281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5b85c-d1b4-4c31-99c1-f85be0b60ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:18.286158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5b85c-d1b4-4c31-99c1-f85be0b60ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:18.286816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5b85c-d1b4-4c31-99c1-f85be0b60ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:18.287663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5b85c-d1b4-4c31-99c1-f85be0b60ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:18.289524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5b85c-d1b4-4c31-99c1-f85be0b60ad4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:18.304587 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1094/2180] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:18.310786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5b85c-d1b4-4c31-99c1-f85be0b60ad4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:18.328079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5b85c-d1b4-4c31-99c1-f85be0b60ad4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:18.347605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d440d34-0611-4e2a-941e-198a80120302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:18.348315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440d34-0611-4e2a-941e-198a80120302 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:18.348601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440d34-0611-4e2a-941e-198a80120302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:18.348964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d440d34-0611-4e2a-941e-198a80120302 admin admin] PATH_INFO: `/v3/projects/3a7095fbfa8e417aa2d7b5b77821f656/users/4c9990899e5947f386e94df2b9ee744d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:18.390792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d440d34-0611-4e2a-941e-198a80120302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7095fbfa8e417aa2d7b5b77821f656, user_id=4c9990899e5947f386e94df2b9ee744d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:18.393704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d440d34-0611-4e2a-941e-198a80120302 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:18.430166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad7ce6-5bf2-4b54-ad44-867061ea06b9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:18.437100 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1095/2181] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:18 2022] PUT /identity/v3/projects/3a7095fbfa8e417aa2d7b5b77821f656/users/4c9990899e5947f386e94df2b9ee744d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:18.448076 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:18.462659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038f6e-95a7-4623-935a-8ef9eceffeec None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:18.464204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038f6e-95a7-4623-935a-8ef9eceffeec None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:18.464983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038f6e-95a7-4623-935a-8ef9eceffeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:18.611498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d5038f6e-95a7-4623-935a-8ef9eceffeec None None] MFA Rules not processed for user `4c9990899e5947f386e94df2b9ee744d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:18.613505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d5038f6e-95a7-4623-935a-8ef9eceffeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:18.632570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba65b99-1aae-41dd-a76a-0a4572baec70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:18.633445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba65b99-1aae-41dd-a76a-0a4572baec70 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:18.633740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba65b99-1aae-41dd-a76a-0a4572baec70 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:18.634923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba65b99-1aae-41dd-a76a-0a4572baec70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:18.871002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba65b99-1aae-41dd-a76a-0a4572baec70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:18.873426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba65b99-1aae-41dd-a76a-0a4572baec70 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:18.894818 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1087/2182] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:18.914345 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1096/2183] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:18.920786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba65b99-1aae-41dd-a76a-0a4572baec70 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:19.244688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba65b99-1aae-41dd-a76a-0a4572baec70 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:19.269538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b30859-e84e-44ea-a0da-ac8d0a773af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:19.270740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b30859-e84e-44ea-a0da-ac8d0a773af5 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:19.271252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b30859-e84e-44ea-a0da-ac8d0a773af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:19.272938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b30859-e84e-44ea-a0da-ac8d0a773af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:19.276262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b30859-e84e-44ea-a0da-ac8d0a773af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:19.299448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b30859-e84e-44ea-a0da-ac8d0a773af5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:19.317191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173a52e-f36e-418b-bfbc-85ad5bcf4e9d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:19.317399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173a52e-f36e-418b-bfbc-85ad5bcf4e9d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:19.317821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173a52e-f36e-418b-bfbc-85ad5bcf4e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:19.358363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1173a52e-f36e-418b-bfbc-85ad5bcf4e9d None None] MFA Rules not processed for user `c68fb32e68194933b6c69383572c27b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:19.359615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1173a52e-f36e-418b-bfbc-85ad5bcf4e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:19.409971 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:19.428851 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1088/2184] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:18 2022] POST /identity/v3/projects => generated 391 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:19.429931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b30859-e84e-44ea-a0da-ac8d0a773af5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:19.528902 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:19.538738 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1097/2185] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:19 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:19.549675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f74709-eb20-4804-8c06-8975c1226806 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:19.550252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f74709-eb20-4804-8c06-8975c1226806 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:19.550743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f74709-eb20-4804-8c06-8975c1226806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:19.586761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b30859-e84e-44ea-a0da-ac8d0a773af5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:19.587671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-38f74709-eb20-4804-8c06-8975c1226806 None None] MFA Rules not processed for user `c68fb32e68194933b6c69383572c27b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:19.589342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-38f74709-eb20-4804-8c06-8975c1226806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:19.592343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1062c-4291-4888-9956-cc45b07fdb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:19.593030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1062c-4291-4888-9956-cc45b07fdb9c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:19.593319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1062c-4291-4888-9956-cc45b07fdb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:19.593818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1062c-4291-4888-9956-cc45b07fdb9c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:19.594644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1062c-4291-4888-9956-cc45b07fdb9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:19.596787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1062c-4291-4888-9956-cc45b07fdb9c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:19.637622 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1089/2186] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:19 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:19.642966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1062c-4291-4888-9956-cc45b07fdb9c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:19.667174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1062c-4291-4888-9956-cc45b07fdb9c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:19.678846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06794bd6-9825-44dc-a922-60f5716afd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:19.680019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06794bd6-9825-44dc-a922-60f5716afd98 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:19.680522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06794bd6-9825-44dc-a922-60f5716afd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:19.681061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06794bd6-9825-44dc-a922-60f5716afd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:19.682506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06794bd6-9825-44dc-a922-60f5716afd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:19.685805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06794bd6-9825-44dc-a922-60f5716afd98 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:19.713175 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1090/2187] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:46:19.717443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06794bd6-9825-44dc-a922-60f5716afd98 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:19.719904 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1098/2188] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:19 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:19.736484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06794bd6-9825-44dc-a922-60f5716afd98 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:19.743307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0ff9c-2bf9-4621-80d3-05ac2393b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:19.744362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0ff9c-2bf9-4621-80d3-05ac2393b17f admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:19.744637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0ff9c-2bf9-4621-80d3-05ac2393b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:19.744964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0ff9c-2bf9-4621-80d3-05ac2393b17f admin admin] PATH_INFO: `/v3/projects/7329070b182f46c3bf73c9e4a73191da/users/36c568273eb0405399ca91f2ba610886/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:19.763842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0ff9c-2bf9-4621-80d3-05ac2393b17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7329070b182f46c3bf73c9e4a73191da, user_id=36c568273eb0405399ca91f2ba610886, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:19.770633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0ff9c-2bf9-4621-80d3-05ac2393b17f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:19.806882 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1091/2189] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:19 2022] PUT /identity/v3/projects/7329070b182f46c3bf73c9e4a73191da/users/36c568273eb0405399ca91f2ba610886/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:19.808327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f74709-eb20-4804-8c06-8975c1226806 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:19.856482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f74709-eb20-4804-8c06-8975c1226806 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:19.882871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0ff9c-2bf9-4621-80d3-05ac2393b17f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:19.885086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a4c0ff9c-2bf9-4621-80d3-05ac2393b17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:20.042794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc420d9-c08b-4a12-b816-f9caf926e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:20.044092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc420d9-c08b-4a12-b816-f9caf926e430 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:20.044578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc420d9-c08b-4a12-b816-f9caf926e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:20.045111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc420d9-c08b-4a12-b816-f9caf926e430 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:20.046411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc420d9-c08b-4a12-b816-f9caf926e430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:20.049788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc420d9-c08b-4a12-b816-f9caf926e430 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:20.062014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0ff9c-2bf9-4621-80d3-05ac2393b17f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:20.073838 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1099/2190] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:20.074022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12298be-711a-4218-884d-5ea262712340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:20.074022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12298be-711a-4218-884d-5ea262712340 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:20.074022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12298be-711a-4218-884d-5ea262712340 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:20.074022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12298be-711a-4218-884d-5ea262712340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:20.075876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc420d9-c08b-4a12-b816-f9caf926e430 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:20.092744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc420d9-c08b-4a12-b816-f9caf926e430 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:20.101419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f31eb-e8ec-4319-8aea-22589a7fb0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:20.102451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f31eb-e8ec-4319-8aea-22589a7fb0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:20.102858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f31eb-e8ec-4319-8aea-22589a7fb0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:20.103265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f31eb-e8ec-4319-8aea-22589a7fb0d8 admin admin] PATH_INFO: `/v3/projects/7329070b182f46c3bf73c9e4a73191da/users/36c568273eb0405399ca91f2ba610886/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:20.105961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f31eb-e8ec-4319-8aea-22589a7fb0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7329070b182f46c3bf73c9e4a73191da, user_id=36c568273eb0405399ca91f2ba610886, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:20.109596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f31eb-e8ec-4319-8aea-22589a7fb0d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:20.152650 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1100/2191] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:20 2022] PUT /identity/v3/projects/7329070b182f46c3bf73c9e4a73191da/users/36c568273eb0405399ca91f2ba610886/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:20.158938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f7710-24b2-4a8e-bbd6-c22ca0ae49c9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:20.159224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f7710-24b2-4a8e-bbd6-c22ca0ae49c9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:20.159531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f7710-24b2-4a8e-bbd6-c22ca0ae49c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:20.190182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12298be-711a-4218-884d-5ea262712340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:20.192548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12298be-711a-4218-884d-5ea262712340 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:20.209703 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1092/2192] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:19 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:46:20.211516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01139-f49e-45db-9189-21057cce48cd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:20.212129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01139-f49e-45db-9189-21057cce48cd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:20.212805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01139-f49e-45db-9189-21057cce48cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:20.233537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7b8f7710-24b2-4a8e-bbd6-c22ca0ae49c9 None None] MFA Rules not processed for user `36c568273eb0405399ca91f2ba610886`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:20.234890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7b8f7710-24b2-4a8e-bbd6-c22ca0ae49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:20.237476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cbc01139-f49e-45db-9189-21057cce48cd None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:20.238694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cbc01139-f49e-45db-9189-21057cce48cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:20.276863 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:20.309050 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:20.357018 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1093/2193] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:46:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:20.385310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc01139-f49e-45db-9189-21057cce48cd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:20.387767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cbc01139-f49e-45db-9189-21057cce48cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:20.419173 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1101/2194] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:20.548179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc01139-f49e-45db-9189-21057cce48cd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:20.557769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005568d-d1d2-49c6-8b49-479f62e06d3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:20.558985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005568d-d1d2-49c6-8b49-479f62e06d3d service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:20.559392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005568d-d1d2-49c6-8b49-479f62e06d3d service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:20.559821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005568d-d1d2-49c6-8b49-479f62e06d3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:20.571642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005568d-d1d2-49c6-8b49-479f62e06d3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:20.574496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005568d-d1d2-49c6-8b49-479f62e06d3d service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:20.588492 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1094/2195] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:46:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:46:21.671971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f7710-24b2-4a8e-bbd6-c22ca0ae49c9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:21.675420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7b8f7710-24b2-4a8e-bbd6-c22ca0ae49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:21.956959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f7710-24b2-4a8e-bbd6-c22ca0ae49c9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:21.980737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f656d-dbd9-4e13-8cfd-0978661cb437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:21.981387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f656d-dbd9-4e13-8cfd-0978661cb437 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:21.981661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f656d-dbd9-4e13-8cfd-0978661cb437 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:21.981938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f656d-dbd9-4e13-8cfd-0978661cb437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:21.987118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-072f656d-dbd9-4e13-8cfd-0978661cb437 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:22.150931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f656d-dbd9-4e13-8cfd-0978661cb437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:22.152578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f656d-dbd9-4e13-8cfd-0978661cb437 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:22.179493 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1102/2196] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:22.390953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005568d-d1d2-49c6-8b49-479f62e06d3d service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:22.424558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005568d-d1d2-49c6-8b49-479f62e06d3d service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:22.442964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3c137-29e6-41cf-91fe-b5dbfcb3ec18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:22.444206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3c137-29e6-41cf-91fe-b5dbfcb3ec18 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:22.444716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3c137-29e6-41cf-91fe-b5dbfcb3ec18 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:22.445180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3c137-29e6-41cf-91fe-b5dbfcb3ec18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:22.464915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3c137-29e6-41cf-91fe-b5dbfcb3ec18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:22.468588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3c137-29e6-41cf-91fe-b5dbfcb3ec18 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:22.501930 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1095/2197] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:46:24.245457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f656d-dbd9-4e13-8cfd-0978661cb437 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:24.430436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f656d-dbd9-4e13-8cfd-0978661cb437 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:24.468503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:24.469501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:24.469989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:24.470463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] PATH_INFO: `/v3/users/4c9990899e5947f386e94df2b9ee744d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:24.472513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9990899e5947f386e94df2b9ee744d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:24.479707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:24.496818 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:24.655241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9990899e5947f386e94df2b9ee744d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:24.711160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9990899e5947f386e94df2b9ee744d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:24.737686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9990899e5947f386e94df2b9ee744d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:24.771735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9990899e5947f386e94df2b9ee744d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:24.781248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9990899e5947f386e94df2b9ee744d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:24.838112 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1103/2198] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:24 2022] DELETE /identity/v3/users/4c9990899e5947f386e94df2b9ee744d => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:24.840911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ce645-768c-45d1-8383-50c96ce11b70 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:24.841539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ce645-768c-45d1-8383-50c96ce11b70 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:24.842145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ce645-768c-45d1-8383-50c96ce11b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:24.878077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9e2ce645-768c-45d1-8383-50c96ce11b70 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:24.879478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9e2ce645-768c-45d1-8383-50c96ce11b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:25.159274 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1096/2199] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:25.178329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:25.181173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:25.353151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dae0c-7fbb-4cb9-89f5-6f83ed5d712f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:25.373490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88433e1-a4c4-45f5-bf96-7534f2f6f79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:25.374140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88433e1-a4c4-45f5-bf96-7534f2f6f79f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:25.374418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88433e1-a4c4-45f5-bf96-7534f2f6f79f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:25.374687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88433e1-a4c4-45f5-bf96-7534f2f6f79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:25.414774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88433e1-a4c4-45f5-bf96-7534f2f6f79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:25.416258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88433e1-a4c4-45f5-bf96-7534f2f6f79f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:25.456449 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1104/2200] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:46:26.118859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ce645-768c-45d1-8383-50c96ce11b70 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:26.121637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9e2ce645-768c-45d1-8383-50c96ce11b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:26.186885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ce645-768c-45d1-8383-50c96ce11b70 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:26.221616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:26.222704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:26.222834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:26.223180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] PATH_INFO: `/v3/projects/3a7095fbfa8e417aa2d7b5b77821f656` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:26.236443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7095fbfa8e417aa2d7b5b77821f656)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:26.241449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:26.457811 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:26.489052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7095fbfa8e417aa2d7b5b77821f656', 'request_id': 'req-450d06e0-0003-4b68-bc33-6106792a3157'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.500795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7095fbfa8e417aa2d7b5b77821f656', 'request_id': 'req-450d06e0-0003-4b68-bc33-6106792a3157'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.510198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7095fbfa8e417aa2d7b5b77821f656', 'request_id': 'req-450d06e0-0003-4b68-bc33-6106792a3157'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.540383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] The token cache is being invalidate because project 3a7095fbfa8e417aa2d7b5b77821f656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:26.540922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.544590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.551123 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1097/2201] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:26 2022] DELETE /identity/v3/projects/3a7095fbfa8e417aa2d7b5b77821f656 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:26.557442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88433e1-a4c4-45f5-bf96-7534f2f6f79f service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:26.568225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88433e1-a4c4-45f5-bf96-7534f2f6f79f service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:26.681365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:26.682621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:26.683409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:26.683992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] PATH_INFO: `/v3/users/36c568273eb0405399ca91f2ba610886` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:26.686042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c568273eb0405399ca91f2ba610886)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:26.690031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:26.783845 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:26.859081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c568273eb0405399ca91f2ba610886'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.896737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c568273eb0405399ca91f2ba610886'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.939059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c568273eb0405399ca91f2ba610886'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.968948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c568273eb0405399ca91f2ba610886'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.971766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c90f1ee7-e65f-4e49-8040-2587fef8b1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c568273eb0405399ca91f2ba610886'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:26.987331 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1105/2202] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:26 2022] DELETE /identity/v3/users/36c568273eb0405399ca91f2ba610886 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:27.731636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:27.733276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:27.755451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d06e0-0003-4b68-bc33-6106792a3157 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:27.999010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:27.999722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:28.000003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:28.000320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] PATH_INFO: `/v3/projects/7329070b182f46c3bf73c9e4a73191da` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:28.007801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7329070b182f46c3bf73c9e4a73191da)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:28.010895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:28.161049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7329070b182f46c3bf73c9e4a73191da', 'request_id': 'req-d6ce165b-502a-4ce7-b952-68673d4b4a36'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:28.177007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7329070b182f46c3bf73c9e4a73191da', 'request_id': 'req-d6ce165b-502a-4ce7-b952-68673d4b4a36'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:28.200681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7329070b182f46c3bf73c9e4a73191da', 'request_id': 'req-d6ce165b-502a-4ce7-b952-68673d4b4a36'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:28.267167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] The token cache is being invalidate because project 7329070b182f46c3bf73c9e4a73191da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:28.267656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:28.268845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6ce165b-502a-4ce7-b952-68673d4b4a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:28.272535 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1098/2203] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:27 2022] DELETE /identity/v3/projects/7329070b182f46c3bf73c9e4a73191da => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:28.278364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee732d1-27ff-4fa7-9a2d-68c8ab10298e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:28.278929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee732d1-27ff-4fa7-9a2d-68c8ab10298e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:28.279439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee732d1-27ff-4fa7-9a2d-68c8ab10298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:28.335147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4ee732d1-27ff-4fa7-9a2d-68c8ab10298e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:28.338403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4ee732d1-27ff-4fa7-9a2d-68c8ab10298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:28.561265 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1106/2204] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:28.562984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e23b-1405-4769-b186-d9963cd0376d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:28.564000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e23b-1405-4769-b186-d9963cd0376d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:28.564000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e23b-1405-4769-b186-d9963cd0376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:28.595528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f765e23b-1405-4769-b186-d9963cd0376d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:28.597408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f765e23b-1405-4769-b186-d9963cd0376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:28.636516 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1099/2205] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:28.641418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee732d1-27ff-4fa7-9a2d-68c8ab10298e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:28.655913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee732d1-27ff-4fa7-9a2d-68c8ab10298e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:28.671018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127607d-dfba-455c-9000-750e8aafb0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:28.671657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127607d-dfba-455c-9000-750e8aafb0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:28.671948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127607d-dfba-455c-9000-750e8aafb0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:28.672226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127607d-dfba-455c-9000-750e8aafb0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:28.673151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127607d-dfba-455c-9000-750e8aafb0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:28.673456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127607d-dfba-455c-9000-750e8aafb0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:28.675525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127607d-dfba-455c-9000-750e8aafb0a2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:28.692996 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1107/2206] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:28.697937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e23b-1405-4769-b186-d9963cd0376d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:28.715419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e23b-1405-4769-b186-d9963cd0376d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:28.726232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa034b-1b78-4fad-85e7-327283cdedd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:28.726864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa034b-1b78-4fad-85e7-327283cdedd7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:28.727139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa034b-1b78-4fad-85e7-327283cdedd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:28.727407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa034b-1b78-4fad-85e7-327283cdedd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:28.728041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa034b-1b78-4fad-85e7-327283cdedd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:28.729993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa034b-1b78-4fad-85e7-327283cdedd7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:28.842530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127607d-dfba-455c-9000-750e8aafb0a2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:28.867704 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1100/2207] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:28 2022] POST /identity/v3/projects => generated 411 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:28.881765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127607d-dfba-455c-9000-750e8aafb0a2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:29.043683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ed333-c192-48c5-8d0e-724b16a0839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:29.044303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ed333-c192-48c5-8d0e-724b16a0839a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.044585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ed333-c192-48c5-8d0e-724b16a0839a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.044965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ed333-c192-48c5-8d0e-724b16a0839a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.045522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ed333-c192-48c5-8d0e-724b16a0839a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:29.047467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ed333-c192-48c5-8d0e-724b16a0839a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:29.102418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1108/2208] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:28 2022] POST /identity/v3/users => generated 306 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:29.105017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa034b-1b78-4fad-85e7-327283cdedd7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:29.118385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa034b-1b78-4fad-85e7-327283cdedd7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:29.128817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272b08b-cbd6-4a7e-99b9-243a0e36680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:29.130932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272b08b-cbd6-4a7e-99b9-243a0e36680a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.131405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272b08b-cbd6-4a7e-99b9-243a0e36680a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.131741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272b08b-cbd6-4a7e-99b9-243a0e36680a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.132647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272b08b-cbd6-4a7e-99b9-243a0e36680a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:29.134576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272b08b-cbd6-4a7e-99b9-243a0e36680a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:29.149653 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1101/2209] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:29.153391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ed333-c192-48c5-8d0e-724b16a0839a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:29.172382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ed333-c192-48c5-8d0e-724b16a0839a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:29.185692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a29841-1011-4187-86b9-88b924a2df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:29.187054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a29841-1011-4187-86b9-88b924a2df3f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.187929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a29841-1011-4187-86b9-88b924a2df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.187929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a29841-1011-4187-86b9-88b924a2df3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.188741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a29841-1011-4187-86b9-88b924a2df3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:29.194188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a29841-1011-4187-86b9-88b924a2df3f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:29.231582 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1109/2210] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:29.233293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272b08b-cbd6-4a7e-99b9-243a0e36680a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:29.251144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272b08b-cbd6-4a7e-99b9-243a0e36680a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:29.280170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875cc0f-875a-493b-a93f-9f95f935dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:29.281349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875cc0f-875a-493b-a93f-9f95f935dbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.281516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875cc0f-875a-493b-a93f-9f95f935dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.281867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875cc0f-875a-493b-a93f-9f95f935dbc0 admin admin] PATH_INFO: `/v3/projects/d6fc999da7a34c55a9dedc87ae05088c/users/366f85a9ef434089a62008580c0b38b5/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.338004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875cc0f-875a-493b-a93f-9f95f935dbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fc999da7a34c55a9dedc87ae05088c, user_id=366f85a9ef434089a62008580c0b38b5, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:29.345983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875cc0f-875a-493b-a93f-9f95f935dbc0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:29.358490 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:29.390231 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1102/2211] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:29 2022] PUT /identity/v3/projects/d6fc999da7a34c55a9dedc87ae05088c/users/366f85a9ef434089a62008580c0b38b5/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:29.402535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12674d72-d041-412d-8a2a-54f8998cef18 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.403545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12674d72-d041-412d-8a2a-54f8998cef18 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.404048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12674d72-d041-412d-8a2a-54f8998cef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.443927 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:29.457590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-12674d72-d041-412d-8a2a-54f8998cef18 None None] MFA Rules not processed for user `366f85a9ef434089a62008580c0b38b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:29.506686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-12674d72-d041-412d-8a2a-54f8998cef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:29.633223 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1110/2212] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:29 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:29.639151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875cc0f-875a-493b-a93f-9f95f935dbc0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:29.745961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875cc0f-875a-493b-a93f-9f95f935dbc0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:29.751770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e257803-9676-4ede-9038-d10d5040b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:29.754506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e257803-9676-4ede-9038-d10d5040b7da admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.756108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e257803-9676-4ede-9038-d10d5040b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.757827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e257803-9676-4ede-9038-d10d5040b7da admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.759692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e257803-9676-4ede-9038-d10d5040b7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:29.764965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e257803-9676-4ede-9038-d10d5040b7da admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:29.824934 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1103/2213] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:29 2022] POST /identity/v3/projects => generated 411 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:29.829343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12674d72-d041-412d-8a2a-54f8998cef18 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:29.846322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12674d72-d041-412d-8a2a-54f8998cef18 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:29.950909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7044c-5b75-4543-bb28-e48952a8e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:29.951610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7044c-5b75-4543-bb28-e48952a8e0da admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:29.951897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7044c-5b75-4543-bb28-e48952a8e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:29.952177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7044c-5b75-4543-bb28-e48952a8e0da admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:29.953120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7044c-5b75-4543-bb28-e48952a8e0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:29.961653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7044c-5b75-4543-bb28-e48952a8e0da admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:29.999075 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1111/2214] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:29 2022] POST /identity/v3/users => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:29.999307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e257803-9676-4ede-9038-d10d5040b7da admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:30.015407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e257803-9676-4ede-9038-d10d5040b7da admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:30.022173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439358ff-a8d8-4598-b4ad-0bcd3179c2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:30.022802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439358ff-a8d8-4598-b4ad-0bcd3179c2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:30.023088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439358ff-a8d8-4598-b4ad-0bcd3179c2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:30.023349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439358ff-a8d8-4598-b4ad-0bcd3179c2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:30.024008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439358ff-a8d8-4598-b4ad-0bcd3179c2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:30.026887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439358ff-a8d8-4598-b4ad-0bcd3179c2e4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:30.060946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7044c-5b75-4543-bb28-e48952a8e0da admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:30.061838 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1104/2215] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:30.078223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7044c-5b75-4543-bb28-e48952a8e0da admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:30.098942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31904abf-beb9-45b2-8fd3-5c80caa0691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:30.099748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31904abf-beb9-45b2-8fd3-5c80caa0691d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:30.100036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31904abf-beb9-45b2-8fd3-5c80caa0691d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:30.100322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31904abf-beb9-45b2-8fd3-5c80caa0691d admin admin] PATH_INFO: `/v3/projects/09b3bc0b6f32439892fda7e2a97ac59a/users/9839aa44186a45858cf1a9be99435cc2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:30.132586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31904abf-beb9-45b2-8fd3-5c80caa0691d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b3bc0b6f32439892fda7e2a97ac59a, user_id=9839aa44186a45858cf1a9be99435cc2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:30.135642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31904abf-beb9-45b2-8fd3-5c80caa0691d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:30.172659 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1112/2216] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:30 2022] PUT /identity/v3/projects/09b3bc0b6f32439892fda7e2a97ac59a/users/9839aa44186a45858cf1a9be99435cc2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:30.175830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439358ff-a8d8-4598-b4ad-0bcd3179c2e4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:30.189109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439358ff-a8d8-4598-b4ad-0bcd3179c2e4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:30.298741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c71127-26c7-4b8f-9aec-d9bec8d9322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:30.301435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c71127-26c7-4b8f-9aec-d9bec8d9322b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:30.301435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c71127-26c7-4b8f-9aec-d9bec8d9322b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:30.301435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c71127-26c7-4b8f-9aec-d9bec8d9322b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:30.301435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c71127-26c7-4b8f-9aec-d9bec8d9322b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:30.304319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c71127-26c7-4b8f-9aec-d9bec8d9322b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:30.318499 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1105/2217] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:30.325072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31904abf-beb9-45b2-8fd3-5c80caa0691d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:30.338592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31904abf-beb9-45b2-8fd3-5c80caa0691d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:30.349475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6bb19-6ae5-45ab-b37a-b45ebe8929c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:30.350718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6bb19-6ae5-45ab-b37a-b45ebe8929c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:30.351185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6bb19-6ae5-45ab-b37a-b45ebe8929c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:30.351538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6bb19-6ae5-45ab-b37a-b45ebe8929c1 admin admin] PATH_INFO: `/v3/projects/09b3bc0b6f32439892fda7e2a97ac59a/users/9839aa44186a45858cf1a9be99435cc2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:30.356376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6bb19-6ae5-45ab-b37a-b45ebe8929c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b3bc0b6f32439892fda7e2a97ac59a, user_id=9839aa44186a45858cf1a9be99435cc2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:30.359290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6bb19-6ae5-45ab-b37a-b45ebe8929c1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:30.385914 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1113/2218] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:30 2022] PUT /identity/v3/projects/09b3bc0b6f32439892fda7e2a97ac59a/users/9839aa44186a45858cf1a9be99435cc2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:30.392985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5bf90-9c47-48da-8620-36fc052c4846 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:30.393430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5bf90-9c47-48da-8620-36fc052c4846 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:30.395028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5bf90-9c47-48da-8620-36fc052c4846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:30.535523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d2b5bf90-9c47-48da-8620-36fc052c4846 None None] MFA Rules not processed for user `9839aa44186a45858cf1a9be99435cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:30.537781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d2b5bf90-9c47-48da-8620-36fc052c4846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:30.624422 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:30.701830 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1106/2219] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:30 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:30.831653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6bb19-6ae5-45ab-b37a-b45ebe8929c1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:30.834814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-79a6bb19-6ae5-45ab-b37a-b45ebe8929c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:31.017947 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:31.069143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6bb19-6ae5-45ab-b37a-b45ebe8929c1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:31.079089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f331c-138f-4a72-80e4-c797edfecbe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:31.079730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f331c-138f-4a72-80e4-c797edfecbe4 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.080007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f331c-138f-4a72-80e4-c797edfecbe4 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.080275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f331c-138f-4a72-80e4-c797edfecbe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.093479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f331c-138f-4a72-80e4-c797edfecbe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:31.095458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f331c-138f-4a72-80e4-c797edfecbe4 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:31.110334 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1114/2220] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:30 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:31.150904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5bf90-9c47-48da-8620-36fc052c4846 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:31.167101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5bf90-9c47-48da-8620-36fc052c4846 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:31.175993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e14a2a-631c-4213-8b32-c90da4872007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:31.177180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e14a2a-631c-4213-8b32-c90da4872007 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.177457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e14a2a-631c-4213-8b32-c90da4872007 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.177722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e14a2a-631c-4213-8b32-c90da4872007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.261231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e14a2a-631c-4213-8b32-c90da4872007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:31.262833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e14a2a-631c-4213-8b32-c90da4872007 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:31.273429 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1107/2221] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:31 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:31.316859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f331c-138f-4a72-80e4-c797edfecbe4 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:31.391120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f331c-138f-4a72-80e4-c797edfecbe4 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:31.396487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:31.397395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.397676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.397952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] PATH_INFO: `/v3/users/366f85a9ef434089a62008580c0b38b5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.399135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366f85a9ef434089a62008580c0b38b5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:31.401445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:31.480600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366f85a9ef434089a62008580c0b38b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.502512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366f85a9ef434089a62008580c0b38b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.515656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366f85a9ef434089a62008580c0b38b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.530127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366f85a9ef434089a62008580c0b38b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.531335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366f85a9ef434089a62008580c0b38b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:31.544185 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1115/2222] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:31 2022] DELETE /identity/v3/users/366f85a9ef434089a62008580c0b38b5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:31.550438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a9f4e-ef92-4f81-bb12-ef5a1cfc3d18 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.550812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a9f4e-ef92-4f81-bb12-ef5a1cfc3d18 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.551092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a9f4e-ef92-4f81-bb12-ef5a1cfc3d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.593306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-899a9f4e-ef92-4f81-bb12-ef5a1cfc3d18 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:31.594643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-899a9f4e-ef92-4f81-bb12-ef5a1cfc3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:31.676008 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1108/2223] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:31.744681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:31.747237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:31.845159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d060a-06f2-4a06-8274-bd05063a51f0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:31.849575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd475d-fe23-447b-8e5c-3f0826116c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:31.850478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd475d-fe23-447b-8e5c-3f0826116c96 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.850819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd475d-fe23-447b-8e5c-3f0826116c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.851181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd475d-fe23-447b-8e5c-3f0826116c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.861587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd475d-fe23-447b-8e5c-3f0826116c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:31.863152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd475d-fe23-447b-8e5c-3f0826116c96 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:31.876241 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1116/2224] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:31.924296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a9f4e-ef92-4f81-bb12-ef5a1cfc3d18 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:31.924762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-899a9f4e-ef92-4f81-bb12-ef5a1cfc3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:31.939089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a9f4e-ef92-4f81-bb12-ef5a1cfc3d18 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:31.945345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:31.946122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:31.946471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:31.946964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] PATH_INFO: `/v3/users/f268dddf034d43ed9d679dd7396836cc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:31.948777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f268dddf034d43ed9d679dd7396836cc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:31.950769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.067975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f268dddf034d43ed9d679dd7396836cc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.094621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f268dddf034d43ed9d679dd7396836cc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.105826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f268dddf034d43ed9d679dd7396836cc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.119501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f268dddf034d43ed9d679dd7396836cc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.120255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f268dddf034d43ed9d679dd7396836cc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.128676 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1109/2225] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:31 2022] DELETE /identity/v3/users/f268dddf034d43ed9d679dd7396836cc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:32.134081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3644a-ead9-4197-84ca-7f8a55dcf9e9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.134081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3644a-ead9-4197-84ca-7f8a55dcf9e9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.134405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3644a-ead9-4197-84ca-7f8a55dcf9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.143156 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:32.160035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9da3644a-ead9-4197-84ca-7f8a55dcf9e9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:32.162131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9da3644a-ead9-4197-84ca-7f8a55dcf9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:32.293305 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1117/2226] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:32.303735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.306132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:32.315262 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:32.414718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e36c9f-68cc-43cc-a98c-57f519409372 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.422568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839a369-6265-48b5-90f6-e6745796918a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.423968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839a369-6265-48b5-90f6-e6745796918a service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.424447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839a369-6265-48b5-90f6-e6745796918a service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.425218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839a369-6265-48b5-90f6-e6745796918a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.447873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839a369-6265-48b5-90f6-e6745796918a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.450468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839a369-6265-48b5-90f6-e6745796918a service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.501068 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1110/2227] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:32.652213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3644a-ead9-4197-84ca-7f8a55dcf9e9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.653803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9da3644a-ead9-4197-84ca-7f8a55dcf9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:32.668367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3644a-ead9-4197-84ca-7f8a55dcf9e9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.678973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.680016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.680863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.681158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] PATH_INFO: `/v3/projects/d6fc999da7a34c55a9dedc87ae05088c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.683450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fc999da7a34c55a9dedc87ae05088c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.687162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.786110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fc999da7a34c55a9dedc87ae05088c', 'request_id': 'req-3b358031-5ff7-4856-84d7-f6d32b646752'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.798819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fc999da7a34c55a9dedc87ae05088c', 'request_id': 'req-3b358031-5ff7-4856-84d7-f6d32b646752'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.807053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fc999da7a34c55a9dedc87ae05088c', 'request_id': 'req-3b358031-5ff7-4856-84d7-f6d32b646752'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.822455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] The token cache is being invalidate because project d6fc999da7a34c55a9dedc87ae05088c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:32.822959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.823824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:32.829235 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1118/2228] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:32 2022] DELETE /identity/v3/projects/d6fc999da7a34c55a9dedc87ae05088c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:32.830636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839a369-6265-48b5-90f6-e6745796918a service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:32.843025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839a369-6265-48b5-90f6-e6745796918a service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:32.917832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:32.918880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:32.919255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:32.919665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] PATH_INFO: `/v3/users/9839aa44186a45858cf1a9be99435cc2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:32.921086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9839aa44186a45858cf1a9be99435cc2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:32.923298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:32.992737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9839aa44186a45858cf1a9be99435cc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.011379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9839aa44186a45858cf1a9be99435cc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.024415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9839aa44186a45858cf1a9be99435cc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.045672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9839aa44186a45858cf1a9be99435cc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.045672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9839aa44186a45858cf1a9be99435cc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:33.064364 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1111/2229] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:32 2022] DELETE /identity/v3/users/9839aa44186a45858cf1a9be99435cc2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:33.906104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:33.909203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:33.951954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b358031-5ff7-4856-84d7-f6d32b646752 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:34.184396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:34.185385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:34.187263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:34.187739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] PATH_INFO: `/v3/projects/e62838577e3e4c8189e936f3453b2fa4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:34.193271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62838577e3e4c8189e936f3453b2fa4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:34.195693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:34.405386 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:34.475799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62838577e3e4c8189e936f3453b2fa4', 'request_id': 'req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.503951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62838577e3e4c8189e936f3453b2fa4', 'request_id': 'req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.528080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62838577e3e4c8189e936f3453b2fa4', 'request_id': 'req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.579461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] The token cache is being invalidate because project e62838577e3e4c8189e936f3453b2fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:34.580205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.584238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:34.599754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:34.601431 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1119/2230] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:33 2022] DELETE /identity/v3/projects/e62838577e3e4c8189e936f3453b2fa4 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:34.602500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:34.622787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e17d1-e495-484e-b1eb-7b75768cddbc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:34.681511 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:34.758216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:34.760610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:34.841392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:34.842069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:34.854265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:34.854265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] PATH_INFO: `/v3/users/739c9b59a1294fa3a370c479aa0b0628` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:34.854265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=739c9b59a1294fa3a370c479aa0b0628)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:34.854865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:35.040867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739c9b59a1294fa3a370c479aa0b0628'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.093085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739c9b59a1294fa3a370c479aa0b0628'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.109086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739c9b59a1294fa3a370c479aa0b0628'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.115526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cbe03-69cf-4e4d-b79e-59f6bd17a79a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:35.127579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:35.130305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739c9b59a1294fa3a370c479aa0b0628'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.131576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.132416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.133437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] PATH_INFO: `/v3/projects/09b3bc0b6f32439892fda7e2a97ac59a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.135716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fbc1327-ce1c-4dea-b726-284f98294397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739c9b59a1294fa3a370c479aa0b0628'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.136744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b3bc0b6f32439892fda7e2a97ac59a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:35.141424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:35.167186 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1112/2231] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:34 2022] DELETE /identity/v3/users/739c9b59a1294fa3a370c479aa0b0628 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:35.224674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b3bc0b6f32439892fda7e2a97ac59a', 'request_id': 'req-a7a1636d-66f7-4442-b52d-317e8774a4ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.235441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b3bc0b6f32439892fda7e2a97ac59a', 'request_id': 'req-a7a1636d-66f7-4442-b52d-317e8774a4ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.245922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b3bc0b6f32439892fda7e2a97ac59a', 'request_id': 'req-a7a1636d-66f7-4442-b52d-317e8774a4ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.265786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] The token cache is being invalidate because project 09b3bc0b6f32439892fda7e2a97ac59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:35.266181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.267984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7a1636d-66f7-4442-b52d-317e8774a4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:35.272671 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1120/2232] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:34 2022] DELETE /identity/v3/projects/09b3bc0b6f32439892fda7e2a97ac59a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:35.277207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454183d-8d37-49d2-a0bd-698224123b38 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.277519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454183d-8d37-49d2-a0bd-698224123b38 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.277770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454183d-8d37-49d2-a0bd-698224123b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.313377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8454183d-8d37-49d2-a0bd-698224123b38 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:35.316069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8454183d-8d37-49d2-a0bd-698224123b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:35.413499 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1113/2233] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:35.419575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57d7e7-dbd8-4f02-b93a-d8f5086f02e9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.420051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57d7e7-dbd8-4f02-b93a-d8f5086f02e9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.420512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57d7e7-dbd8-4f02-b93a-d8f5086f02e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.485422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6b57d7e7-dbd8-4f02-b93a-d8f5086f02e9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:35.487544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6b57d7e7-dbd8-4f02-b93a-d8f5086f02e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:35.499530 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1121/2234] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:35.504137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454183d-8d37-49d2-a0bd-698224123b38 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:35.523250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454183d-8d37-49d2-a0bd-698224123b38 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:35.529161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d93b8-28f7-4e47-9e52-54d4b557efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:35.529795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d93b8-28f7-4e47-9e52-54d4b557efb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.530073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d93b8-28f7-4e47-9e52-54d4b557efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.530347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d93b8-28f7-4e47-9e52-54d4b557efb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.531017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d93b8-28f7-4e47-9e52-54d4b557efb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:35.531311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d93b8-28f7-4e47-9e52-54d4b557efb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:35.533020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d93b8-28f7-4e47-9e52-54d4b557efb5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:35.571507 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1114/2235] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:46:35.579091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57d7e7-dbd8-4f02-b93a-d8f5086f02e9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:35.595914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57d7e7-dbd8-4f02-b93a-d8f5086f02e9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:35.602868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38b08e-a0cb-43d2-b8e7-c6485b6c486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:35.604100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38b08e-a0cb-43d2-b8e7-c6485b6c486a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.604488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38b08e-a0cb-43d2-b8e7-c6485b6c486a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.604896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38b08e-a0cb-43d2-b8e7-c6485b6c486a admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.605666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38b08e-a0cb-43d2-b8e7-c6485b6c486a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:35.607751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38b08e-a0cb-43d2-b8e7-c6485b6c486a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:35.652733 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1122/2236] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:35 2022] POST /identity/v3/projects => generated 405 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:35.657707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d93b8-28f7-4e47-9e52-54d4b557efb5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:35.674118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d93b8-28f7-4e47-9e52-54d4b557efb5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:35.731744 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:35.776266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000a1d4-e4b9-42dc-a1f9-0010d196e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:35.776819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000a1d4-e4b9-42dc-a1f9-0010d196e60f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.777100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000a1d4-e4b9-42dc-a1f9-0010d196e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.777371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000a1d4-e4b9-42dc-a1f9-0010d196e60f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.778063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000a1d4-e4b9-42dc-a1f9-0010d196e60f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:35.780102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000a1d4-e4b9-42dc-a1f9-0010d196e60f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:35.811373 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1115/2237] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:35 2022] POST /identity/v3/users => generated 303 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:35.821273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38b08e-a0cb-43d2-b8e7-c6485b6c486a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:35.841020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38b08e-a0cb-43d2-b8e7-c6485b6c486a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:35.851074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2174ac6-7596-4523-9534-5ba57c36408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:35.851978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174ac6-7596-4523-9534-5ba57c36408a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.852463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174ac6-7596-4523-9534-5ba57c36408a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.853238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174ac6-7596-4523-9534-5ba57c36408a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.854167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2174ac6-7596-4523-9534-5ba57c36408a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:35.856090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2174ac6-7596-4523-9534-5ba57c36408a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:35.877294 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1123/2238] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:35.880182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000a1d4-e4b9-42dc-a1f9-0010d196e60f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:35.890887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000a1d4-e4b9-42dc-a1f9-0010d196e60f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:35.897121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3b03-6286-4d24-a199-d2f94848ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:35.897749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3b03-6286-4d24-a199-d2f94848ae07 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.898028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3b03-6286-4d24-a199-d2f94848ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.898302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3b03-6286-4d24-a199-d2f94848ae07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.898960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a3b03-6286-4d24-a199-d2f94848ae07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:35.900612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a3b03-6286-4d24-a199-d2f94848ae07 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:35.916659 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1116/2239] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:35.919662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2174ac6-7596-4523-9534-5ba57c36408a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:35.933547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2174ac6-7596-4523-9534-5ba57c36408a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:35.939519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e564a8-8204-47ed-b800-5f9816c15eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:35.940426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e564a8-8204-47ed-b800-5f9816c15eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:35.940807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e564a8-8204-47ed-b800-5f9816c15eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:35.941187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e564a8-8204-47ed-b800-5f9816c15eb0 admin admin] PATH_INFO: `/v3/projects/243c4232ad0243a289bd14fa4823ac71/users/6aeeab8af64a4a76aba0b46330569207/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:35.947553 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:35.968842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e564a8-8204-47ed-b800-5f9816c15eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243c4232ad0243a289bd14fa4823ac71, user_id=6aeeab8af64a4a76aba0b46330569207, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:35.973517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e564a8-8204-47ed-b800-5f9816c15eb0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.002531 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1124/2240] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:35 2022] PUT /identity/v3/projects/243c4232ad0243a289bd14fa4823ac71/users/6aeeab8af64a4a76aba0b46330569207/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:36.005174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87cac9-df45-4450-87de-c1457f896d97 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.005174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87cac9-df45-4450-87de-c1457f896d97 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.005554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87cac9-df45-4450-87de-c1457f896d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.081619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5a87cac9-df45-4450-87de-c1457f896d97 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:36.089152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5a87cac9-df45-4450-87de-c1457f896d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:36.309321 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1117/2241] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:36.366639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e564a8-8204-47ed-b800-5f9816c15eb0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:36.372851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-07e564a8-8204-47ed-b800-5f9816c15eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:36.477167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e564a8-8204-47ed-b800-5f9816c15eb0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:36.483793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc8cbb-86ba-4285-a663-f66a2214f425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:36.484925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc8cbb-86ba-4285-a663-f66a2214f425 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:36.485403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc8cbb-86ba-4285-a663-f66a2214f425 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:36.486669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc8cbb-86ba-4285-a663-f66a2214f425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:36.508212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc8cbb-86ba-4285-a663-f66a2214f425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:36.509771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc8cbb-86ba-4285-a663-f66a2214f425 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:36.523412 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1125/2242] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:37.363305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87cac9-df45-4450-87de-c1457f896d97 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:37.366393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5a87cac9-df45-4450-87de-c1457f896d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:37.390053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87cac9-df45-4450-87de-c1457f896d97 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:37.397959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:37.398931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.399435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.399945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] PATH_INFO: `/v3/projects/da72dc10a95d414d94f261d69035fdcc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:37.401592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da72dc10a95d414d94f261d69035fdcc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:37.405541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:37.438616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43b97c-b78d-4038-a420-73c25b390c11 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.439164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43b97c-b78d-4038-a420-73c25b390c11 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.439164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43b97c-b78d-4038-a420-73c25b390c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:37.483392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1b43b97c-b78d-4038-a420-73c25b390c11 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:37.490762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b43b97c-b78d-4038-a420-73c25b390c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:37.513113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da72dc10a95d414d94f261d69035fdcc', 'request_id': 'req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.526947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da72dc10a95d414d94f261d69035fdcc', 'request_id': 'req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.536030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da72dc10a95d414d94f261d69035fdcc', 'request_id': 'req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.563481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] The token cache is being invalidate because project da72dc10a95d414d94f261d69035fdcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:37.563970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.565090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a2fc00fe-c9a2-4d8c-b769-ac58a91d95e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:37.573367 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1118/2243] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:37 2022] DELETE /identity/v3/projects/da72dc10a95d414d94f261d69035fdcc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:37.584444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7e13c-e958-4bd0-b4aa-a0007732c37b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.584925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7e13c-e958-4bd0-b4aa-a0007732c37b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.585381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7e13c-e958-4bd0-b4aa-a0007732c37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:37.680507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0bf7e13c-e958-4bd0-b4aa-a0007732c37b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:37.682513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0bf7e13c-e958-4bd0-b4aa-a0007732c37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:37.760890 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1126/2244] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 00:46:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:37.761969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43b97c-b78d-4038-a420-73c25b390c11 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:37.763473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b43b97c-b78d-4038-a420-73c25b390c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:37.873742 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:37.975022 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1119/2245] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:37.986982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2337be-d4db-4101-9f1d-a21b0a663a28 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:37.987323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2337be-d4db-4101-9f1d-a21b0a663a28 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:37.987537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2337be-d4db-4101-9f1d-a21b0a663a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.039017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ba2337be-d4db-4101-9f1d-a21b0a663a28 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:38.053412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ba2337be-d4db-4101-9f1d-a21b0a663a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:38.059009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43b97c-b78d-4038-a420-73c25b390c11 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.077063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa2544-a7d2-43a7-b1f4-f89a585a2425 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.077063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa2544-a7d2-43a7-b1f4-f89a585a2425 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.077063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa2544-a7d2-43a7-b1f4-f89a585a2425 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.077063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa2544-a7d2-43a7-b1f4-f89a585a2425 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.078185 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1120/2246] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:38.088733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2337be-d4db-4101-9f1d-a21b0a663a28 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.103462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2337be-d4db-4101-9f1d-a21b0a663a28 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.109173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa2544-a7d2-43a7-b1f4-f89a585a2425 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.110273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a3a4a-f810-401e-925c-418691f61ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.110802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa2544-a7d2-43a7-b1f4-f89a585a2425 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.110978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a3a4a-f810-401e-925c-418691f61ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.111226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a3a4a-f810-401e-925c-418691f61ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.111452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a3a4a-f810-401e-925c-418691f61ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.112088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a3a4a-f810-401e-925c-418691f61ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:38.112383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a3a4a-f810-401e-925c-418691f61ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.114918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a3a4a-f810-401e-925c-418691f61ec1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.136071 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1127/2247] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:46:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:38.146079 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1121/2248] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:38.147681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa2544-a7d2-43a7-b1f4-f89a585a2425 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.176982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa2544-a7d2-43a7-b1f4-f89a585a2425 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.189333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8e743-e403-4bea-bbce-a0d744844f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.189980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8e743-e403-4bea-bbce-a0d744844f98 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.190263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8e743-e403-4bea-bbce-a0d744844f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.190542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8e743-e403-4bea-bbce-a0d744844f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.191220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8e743-e403-4bea-bbce-a0d744844f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.193658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8e743-e403-4bea-bbce-a0d744844f98 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.256943 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:38.296967 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1128/2249] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:38 2022] POST /identity/v3/projects => generated 393 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:38.297976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a3a4a-f810-401e-925c-418691f61ec1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.346456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a3a4a-f810-401e-925c-418691f61ec1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.538435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90453c73-7597-4c4c-b978-a4ea3edb5b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.539452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90453c73-7597-4c4c-b978-a4ea3edb5b26 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.539452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90453c73-7597-4c4c-b978-a4ea3edb5b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.539724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90453c73-7597-4c4c-b978-a4ea3edb5b26 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.540572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90453c73-7597-4c4c-b978-a4ea3edb5b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.543144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90453c73-7597-4c4c-b978-a4ea3edb5b26 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.590597 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1122/2250] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:38 2022] POST /identity/v3/users => generated 297 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:38.591581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8e743-e403-4bea-bbce-a0d744844f98 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.611905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8e743-e403-4bea-bbce-a0d744844f98 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.619065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa182f-619e-4042-8f57-d41fdab64091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.619879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa182f-619e-4042-8f57-d41fdab64091 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.620184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa182f-619e-4042-8f57-d41fdab64091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.620770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa182f-619e-4042-8f57-d41fdab64091 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.622059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa182f-619e-4042-8f57-d41fdab64091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.624093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa182f-619e-4042-8f57-d41fdab64091 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.647666 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1129/2251] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:38.650371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90453c73-7597-4c4c-b978-a4ea3edb5b26 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.667411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90453c73-7597-4c4c-b978-a4ea3edb5b26 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.674783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5183d3b-7f17-4fe7-a5a1-92a50702bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.676211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183d3b-7f17-4fe7-a5a1-92a50702bcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.677109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183d3b-7f17-4fe7-a5a1-92a50702bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.677655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183d3b-7f17-4fe7-a5a1-92a50702bcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.678824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183d3b-7f17-4fe7-a5a1-92a50702bcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.680825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183d3b-7f17-4fe7-a5a1-92a50702bcd7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.698471 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1123/2252] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:38.699419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa182f-619e-4042-8f57-d41fdab64091 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:38.714302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa182f-619e-4042-8f57-d41fdab64091 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:38.724496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3195-9330-4b60-9f0f-0ffa259078a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:38.725666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3195-9330-4b60-9f0f-0ffa259078a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.726017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3195-9330-4b60-9f0f-0ffa259078a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.726392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3195-9330-4b60-9f0f-0ffa259078a0 admin admin] PATH_INFO: `/v3/projects/d419271a0cd74caf8d4b073f35fa860e/users/7722e1af42d345a6b3c7d09fb77af0bf/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.749518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea3195-9330-4b60-9f0f-0ffa259078a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d419271a0cd74caf8d4b073f35fa860e, user_id=7722e1af42d345a6b3c7d09fb77af0bf, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:38.752977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea3195-9330-4b60-9f0f-0ffa259078a0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:38.776804 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1130/2253] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:38 2022] PUT /identity/v3/projects/d419271a0cd74caf8d4b073f35fa860e/users/7722e1af42d345a6b3c7d09fb77af0bf/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:38.788156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92c9c-f71a-4a52-9a44-2041700e0e68 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:38.788434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92c9c-f71a-4a52-9a44-2041700e0e68 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:38.788866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92c9c-f71a-4a52-9a44-2041700e0e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:38.823807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-56c92c9c-f71a-4a52-9a44-2041700e0e68 None None] MFA Rules not processed for user `7722e1af42d345a6b3c7d09fb77af0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:38.825336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-56c92c9c-f71a-4a52-9a44-2041700e0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:38.996940 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1124/2254] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:39.002648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3195-9330-4b60-9f0f-0ffa259078a0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:39.137449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3195-9330-4b60-9f0f-0ffa259078a0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:39.146280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa47724-da16-4a62-9143-74de540ad6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:39.147229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47724-da16-4a62-9143-74de540ad6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:39.147708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47724-da16-4a62-9143-74de540ad6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:39.148251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47724-da16-4a62-9143-74de540ad6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:39.149118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa47724-da16-4a62-9143-74de540ad6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:39.151708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa47724-da16-4a62-9143-74de540ad6b4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:39.200773 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1131/2255] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:39 2022] POST /identity/v3/projects => generated 391 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:39.206709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c92c9c-f71a-4a52-9a44-2041700e0e68 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:39.241740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c92c9c-f71a-4a52-9a44-2041700e0e68 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:39.305411 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:39.469071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128263ef-c57e-473a-86ae-54b7a37c897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:39.470806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128263ef-c57e-473a-86ae-54b7a37c897f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:39.475343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128263ef-c57e-473a-86ae-54b7a37c897f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:39.475903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128263ef-c57e-473a-86ae-54b7a37c897f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:39.478357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128263ef-c57e-473a-86ae-54b7a37c897f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:39.483266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128263ef-c57e-473a-86ae-54b7a37c897f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:39.528773 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1125/2256] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:39 2022] POST /identity/v3/users => generated 302 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:39.535963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa47724-da16-4a62-9143-74de540ad6b4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:39.615981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa47724-da16-4a62-9143-74de540ad6b4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:39.628501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a3745-7b01-46f8-bdca-f5e3abc6ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:39.629573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a3745-7b01-46f8-bdca-f5e3abc6ef07 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:39.630181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a3745-7b01-46f8-bdca-f5e3abc6ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:39.630582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a3745-7b01-46f8-bdca-f5e3abc6ef07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:39.631352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a3745-7b01-46f8-bdca-f5e3abc6ef07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:39.635749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a3745-7b01-46f8-bdca-f5e3abc6ef07 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:39.665670 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1132/2257] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:39.669565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128263ef-c57e-473a-86ae-54b7a37c897f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:39.688366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128263ef-c57e-473a-86ae-54b7a37c897f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:39.693921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68039f-53f2-4a00-bde5-ffdbdbc87025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:39.694867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68039f-53f2-4a00-bde5-ffdbdbc87025 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:39.695145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68039f-53f2-4a00-bde5-ffdbdbc87025 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:39.695575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68039f-53f2-4a00-bde5-ffdbdbc87025 admin admin] PATH_INFO: `/v3/projects/f1c3fe0ddce24ae0a6b8257dd5a02d66/users/5ce3031d22044e17969f1230296b0e15/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:39.729343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68039f-53f2-4a00-bde5-ffdbdbc87025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c3fe0ddce24ae0a6b8257dd5a02d66, user_id=5ce3031d22044e17969f1230296b0e15, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:39.731831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68039f-53f2-4a00-bde5-ffdbdbc87025 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:39.767414 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1126/2258] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:39 2022] PUT /identity/v3/projects/f1c3fe0ddce24ae0a6b8257dd5a02d66/users/5ce3031d22044e17969f1230296b0e15/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:46:39.771845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a3745-7b01-46f8-bdca-f5e3abc6ef07 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:39.784083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a3745-7b01-46f8-bdca-f5e3abc6ef07 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:39.939398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ce8c8-f17f-430b-a536-6587d681dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:39.940550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ce8c8-f17f-430b-a536-6587d681dd57 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:39.941258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ce8c8-f17f-430b-a536-6587d681dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:39.942540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ce8c8-f17f-430b-a536-6587d681dd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:39.944269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ce8c8-f17f-430b-a536-6587d681dd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:39.947845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ce8c8-f17f-430b-a536-6587d681dd57 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:39.982174 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1133/2259] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:39.987031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68039f-53f2-4a00-bde5-ffdbdbc87025 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:40.026019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68039f-53f2-4a00-bde5-ffdbdbc87025 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:40.062358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df463a-09e9-4a05-823b-36402e4e7c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:40.063051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df463a-09e9-4a05-823b-36402e4e7c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:40.063330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df463a-09e9-4a05-823b-36402e4e7c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:40.063602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df463a-09e9-4a05-823b-36402e4e7c56 admin admin] PATH_INFO: `/v3/projects/f1c3fe0ddce24ae0a6b8257dd5a02d66/users/5ce3031d22044e17969f1230296b0e15/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:40.066121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df463a-09e9-4a05-823b-36402e4e7c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c3fe0ddce24ae0a6b8257dd5a02d66, user_id=5ce3031d22044e17969f1230296b0e15, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:40.069239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df463a-09e9-4a05-823b-36402e4e7c56 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:40.122775 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1127/2260] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:39 2022] PUT /identity/v3/projects/f1c3fe0ddce24ae0a6b8257dd5a02d66/users/5ce3031d22044e17969f1230296b0e15/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:40.125204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e41a1-01c5-4aab-8185-ffa7110a34cb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:40.125717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e41a1-01c5-4aab-8185-ffa7110a34cb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:40.126008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e41a1-01c5-4aab-8185-ffa7110a34cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:40.185030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8d9e41a1-01c5-4aab-8185-ffa7110a34cb None None] MFA Rules not processed for user `5ce3031d22044e17969f1230296b0e15`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:40.186953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8d9e41a1-01c5-4aab-8185-ffa7110a34cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:40.225795 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:40.357538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1134/2261] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:40.771943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df463a-09e9-4a05-823b-36402e4e7c56 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:40.773874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-71df463a-09e9-4a05-823b-36402e4e7c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:40.975193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df463a-09e9-4a05-823b-36402e4e7c56 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:40.982683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650b0bc-5305-4698-8cd9-ed85afe10d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:40.983334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650b0bc-5305-4698-8cd9-ed85afe10d4c service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:40.983602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650b0bc-5305-4698-8cd9-ed85afe10d4c service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:40.984298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650b0bc-5305-4698-8cd9-ed85afe10d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:41.001395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650b0bc-5305-4698-8cd9-ed85afe10d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:41.003900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650b0bc-5305-4698-8cd9-ed85afe10d4c service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:41.025791 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1128/2262] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:42.230914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e41a1-01c5-4aab-8185-ffa7110a34cb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:42.233526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8d9e41a1-01c5-4aab-8185-ffa7110a34cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:42.258756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e41a1-01c5-4aab-8185-ffa7110a34cb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:42.266341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c365c62-4806-4225-9c64-fdaee57f6ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:42.267675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c365c62-4806-4225-9c64-fdaee57f6ef9 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:42.268241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c365c62-4806-4225-9c64-fdaee57f6ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:42.268986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c365c62-4806-4225-9c64-fdaee57f6ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:42.439208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c365c62-4806-4225-9c64-fdaee57f6ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:42.446018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c365c62-4806-4225-9c64-fdaee57f6ef9 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:42.472906 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1135/2263] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:46:42.533879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650b0bc-5305-4698-8cd9-ed85afe10d4c service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:42.694968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650b0bc-5305-4698-8cd9-ed85afe10d4c service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:42.708210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:42.711481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:42.711909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:42.712551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] PATH_INFO: `/v3/users/7722e1af42d345a6b3c7d09fb77af0bf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:42.714612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7722e1af42d345a6b3c7d09fb77af0bf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:42.719576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:42.726024 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:42.880957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7722e1af42d345a6b3c7d09fb77af0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:42.907048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7722e1af42d345a6b3c7d09fb77af0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:42.927908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7722e1af42d345a6b3c7d09fb77af0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:42.966574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7722e1af42d345a6b3c7d09fb77af0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:42.966574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7722e1af42d345a6b3c7d09fb77af0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:42.986996 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1129/2264] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:42 2022] DELETE /identity/v3/users/7722e1af42d345a6b3c7d09fb77af0bf => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:42.989301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126c225-4f88-4a45-935c-6066a9b3d09a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:42.990327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126c225-4f88-4a45-935c-6066a9b3d09a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:42.990327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126c225-4f88-4a45-935c-6066a9b3d09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:43.023681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4126c225-4f88-4a45-935c-6066a9b3d09a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:43.026985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4126c225-4f88-4a45-935c-6066a9b3d09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:43.221022 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1136/2265] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:46:43.264177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:43.266702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:43.487873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93d87d-c818-43cf-a3ce-9a23dfc3236e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:43.555448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262f4e2-ee91-4b8c-89c4-1f0272a43ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:43.556828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262f4e2-ee91-4b8c-89c4-1f0272a43ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:43.559209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262f4e2-ee91-4b8c-89c4-1f0272a43ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:43.561234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262f4e2-ee91-4b8c-89c4-1f0272a43ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:43.574889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262f4e2-ee91-4b8c-89c4-1f0272a43ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:43.579020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262f4e2-ee91-4b8c-89c4-1f0272a43ce6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:43.624153 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1130/2266] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:46:44.140308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126c225-4f88-4a45-935c-6066a9b3d09a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:44.143221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4126c225-4f88-4a45-935c-6066a9b3d09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:44.252284 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:44.277628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126c225-4f88-4a45-935c-6066a9b3d09a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:44.286936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90ad1b-66bb-4140-a54d-4d4d5fcbb770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:44.288086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90ad1b-66bb-4140-a54d-4d4d5fcbb770 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:44.288473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90ad1b-66bb-4140-a54d-4d4d5fcbb770 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:44.289197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90ad1b-66bb-4140-a54d-4d4d5fcbb770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:44.291721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dd90ad1b-66bb-4140-a54d-4d4d5fcbb770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:44.311760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90ad1b-66bb-4140-a54d-4d4d5fcbb770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:44.320874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90ad1b-66bb-4140-a54d-4d4d5fcbb770 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:44.345178 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1137/2267] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:45.799588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262f4e2-ee91-4b8c-89c4-1f0272a43ce6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:45.803097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e262f4e2-ee91-4b8c-89c4-1f0272a43ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:45.827147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262f4e2-ee91-4b8c-89c4-1f0272a43ce6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:45.839190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:45.839991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:45.840523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:45.841078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] PATH_INFO: `/v3/projects/d419271a0cd74caf8d4b073f35fa860e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:45.843963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d419271a0cd74caf8d4b073f35fa860e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:45.846397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:45.962708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd419271a0cd74caf8d4b073f35fa860e', 'request_id': 'req-4e4d9447-d25e-42dc-b441-3db507494118'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:45.977805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd419271a0cd74caf8d4b073f35fa860e', 'request_id': 'req-4e4d9447-d25e-42dc-b441-3db507494118'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:45.993630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd419271a0cd74caf8d4b073f35fa860e', 'request_id': 'req-4e4d9447-d25e-42dc-b441-3db507494118'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:46.021546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] The token cache is being invalidate because project d419271a0cd74caf8d4b073f35fa860e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:46.021986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:46.027641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:46.030128 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1131/2268] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:45 2022] DELETE /identity/v3/projects/d419271a0cd74caf8d4b073f35fa860e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:46.033985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90ad1b-66bb-4140-a54d-4d4d5fcbb770 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:46.055960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90ad1b-66bb-4140-a54d-4d4d5fcbb770 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:46.214210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:46.215337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:46.215874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:46.216397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] PATH_INFO: `/v3/users/5ce3031d22044e17969f1230296b0e15` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:46.218022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce3031d22044e17969f1230296b0e15)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:46.220318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:46.350172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce3031d22044e17969f1230296b0e15'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:46.377094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce3031d22044e17969f1230296b0e15'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:46.398013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce3031d22044e17969f1230296b0e15'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:46.409359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce3031d22044e17969f1230296b0e15'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:46.411780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce3031d22044e17969f1230296b0e15'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:46.426279 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1138/2269] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:46 2022] DELETE /identity/v3/users/5ce3031d22044e17969f1230296b0e15 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:48.148950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:48.150460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:48.158682 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:48.352677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d9447-d25e-42dc-b441-3db507494118 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:48.451748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73e925-8ad7-4d50-8727-394484d73592 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:48.457839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73e925-8ad7-4d50-8727-394484d73592 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:48.458367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73e925-8ad7-4d50-8727-394484d73592 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:48.458602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73e925-8ad7-4d50-8727-394484d73592 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:48.460970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ae73e925-8ad7-4d50-8727-394484d73592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:48.495519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73e925-8ad7-4d50-8727-394484d73592 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:48.497323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73e925-8ad7-4d50-8727-394484d73592 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:48.539360 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1132/2270] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:48.654889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:48.657131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:48.890494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4003973-fd79-4a5e-9d44-8f9d795c3877 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:48.897803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:48.898991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:48.899272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:48.900025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] PATH_INFO: `/v3/projects/f1c3fe0ddce24ae0a6b8257dd5a02d66` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:48.901621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c3fe0ddce24ae0a6b8257dd5a02d66)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:48.904642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:48.916920 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:49.051139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c3fe0ddce24ae0a6b8257dd5a02d66', 'request_id': 'req-b0556ba7-111f-4b64-8b6d-ec636de19acd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:49.086828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c3fe0ddce24ae0a6b8257dd5a02d66', 'request_id': 'req-b0556ba7-111f-4b64-8b6d-ec636de19acd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:49.112723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c3fe0ddce24ae0a6b8257dd5a02d66', 'request_id': 'req-b0556ba7-111f-4b64-8b6d-ec636de19acd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:49.142005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] The token cache is being invalidate because project f1c3fe0ddce24ae0a6b8257dd5a02d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:46:49.142305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:49.145558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b0556ba7-111f-4b64-8b6d-ec636de19acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:46:49.156945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2051a7-e0e4-48ec-8152-4f159e2a9a70 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:49.157505 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1139/2271] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:46:48 2022] DELETE /identity/v3/projects/f1c3fe0ddce24ae0a6b8257dd5a02d66 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:49.158186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2051a7-e0e4-48ec-8152-4f159e2a9a70 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:49.158701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2051a7-e0e4-48ec-8152-4f159e2a9a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:49.203752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2c2051a7-e0e4-48ec-8152-4f159e2a9a70 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:49.207541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2c2051a7-e0e4-48ec-8152-4f159e2a9a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:49.407617 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1133/2272] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:49.418990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52384c-de0d-4d1c-9c4b-e2267842a686 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:49.420009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52384c-de0d-4d1c-9c4b-e2267842a686 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:49.420313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52384c-de0d-4d1c-9c4b-e2267842a686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:49.459505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9e52384c-de0d-4d1c-9c4b-e2267842a686 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:49.460942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9e52384c-de0d-4d1c-9c4b-e2267842a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:49.479216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2051a7-e0e4-48ec-8152-4f159e2a9a70 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:49.479830 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1140/2273] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:49.495066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2051a7-e0e4-48ec-8152-4f159e2a9a70 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:49.505712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aff28a-abfd-4cc5-aa61-d3d40d09b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:49.506876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff28a-abfd-4cc5-aa61-d3d40d09b4ec admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:49.507381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff28a-abfd-4cc5-aa61-d3d40d09b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:49.507889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff28a-abfd-4cc5-aa61-d3d40d09b4ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:49.509239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aff28a-abfd-4cc5-aa61-d3d40d09b4ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:46:49.509953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aff28a-abfd-4cc5-aa61-d3d40d09b4ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:49.512253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aff28a-abfd-4cc5-aa61-d3d40d09b4ec admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:49.529613 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1134/2274] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:46:49.533839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52384c-de0d-4d1c-9c4b-e2267842a686 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:49.551201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52384c-de0d-4d1c-9c4b-e2267842a686 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:49.557108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a4d63-f3f9-4eaf-b23f-df7de05e8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:49.557854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a4d63-f3f9-4eaf-b23f-df7de05e8ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:49.558877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a4d63-f3f9-4eaf-b23f-df7de05e8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:49.559226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a4d63-f3f9-4eaf-b23f-df7de05e8ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:49.559972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a4d63-f3f9-4eaf-b23f-df7de05e8ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:49.562052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a4d63-f3f9-4eaf-b23f-df7de05e8ed1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:49.658440 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1141/2275] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:49 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:49.659067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aff28a-abfd-4cc5-aa61-d3d40d09b4ec admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:49.674856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aff28a-abfd-4cc5-aa61-d3d40d09b4ec admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:49.759547 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:49.840648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444926-5935-41b8-8554-5faaddde5095 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:49.842176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444926-5935-41b8-8554-5faaddde5095 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:49.843420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444926-5935-41b8-8554-5faaddde5095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:49.883496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fc444926-5935-41b8-8554-5faaddde5095 None None] MFA Rules not processed for user `a24b98f6af634c61af828bb20ce1e945`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:49.885191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fc444926-5935-41b8-8554-5faaddde5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:49.885546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347a3e8-d4af-4b24-9c2e-f43ca31bce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:49.886181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347a3e8-d4af-4b24-9c2e-f43ca31bce4e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:49.886468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347a3e8-d4af-4b24-9c2e-f43ca31bce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:49.886733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347a3e8-d4af-4b24-9c2e-f43ca31bce4e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:49.887409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347a3e8-d4af-4b24-9c2e-f43ca31bce4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:49.889389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347a3e8-d4af-4b24-9c2e-f43ca31bce4e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:49.937136 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1135/2276] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:49 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:46:49.943774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347a3e8-d4af-4b24-9c2e-f43ca31bce4e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:49.964463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347a3e8-d4af-4b24-9c2e-f43ca31bce4e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:49.977626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355de5e-82dc-4672-9e4b-952df88dc6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:49.978307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355de5e-82dc-4672-9e4b-952df88dc6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:49.978590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355de5e-82dc-4672-9e4b-952df88dc6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:49.978907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355de5e-82dc-4672-9e4b-952df88dc6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:49.979518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355de5e-82dc-4672-9e4b-952df88dc6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:49.981166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355de5e-82dc-4672-9e4b-952df88dc6f7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:50.001331 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1136/2277] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:46:50.005897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355de5e-82dc-4672-9e4b-952df88dc6f7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:50.020739 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1142/2278] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:50.050129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355de5e-82dc-4672-9e4b-952df88dc6f7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:50.065418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705bc2d-cb5d-4c45-a4df-0669f960e108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:50.068976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705bc2d-cb5d-4c45-a4df-0669f960e108 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:50.068976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705bc2d-cb5d-4c45-a4df-0669f960e108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:50.068976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705bc2d-cb5d-4c45-a4df-0669f960e108 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:50.070793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705bc2d-cb5d-4c45-a4df-0669f960e108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:50.074859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705bc2d-cb5d-4c45-a4df-0669f960e108 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:50.112406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc444926-5935-41b8-8554-5faaddde5095 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:50.114356 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1137/2279] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:50.128431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc444926-5935-41b8-8554-5faaddde5095 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:50.147336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e7f1c-bc93-416d-b6a6-8a2f6d82c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:50.148026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e7f1c-bc93-416d-b6a6-8a2f6d82c747 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:50.148305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e7f1c-bc93-416d-b6a6-8a2f6d82c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:50.148577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e7f1c-bc93-416d-b6a6-8a2f6d82c747 admin admin] PATH_INFO: `/v3/projects/bf3b8f8475874a7988dc35023a58d083/users/1e43026c56e0462b976a840266ea8acf/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:50.213331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e7f1c-bc93-416d-b6a6-8a2f6d82c747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3b8f8475874a7988dc35023a58d083, user_id=1e43026c56e0462b976a840266ea8acf, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:50.218997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e7f1c-bc93-416d-b6a6-8a2f6d82c747 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:50.241245 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1143/2280] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:50 2022] PUT /identity/v3/projects/bf3b8f8475874a7988dc35023a58d083/users/1e43026c56e0462b976a840266ea8acf/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:50.246341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2717-a07f-4d4b-8663-231c0107d3ff None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:50.246896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2717-a07f-4d4b-8663-231c0107d3ff None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:50.246896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2717-a07f-4d4b-8663-231c0107d3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:50.272566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-219c2717-a07f-4d4b-8663-231c0107d3ff None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:50.274078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-219c2717-a07f-4d4b-8663-231c0107d3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:50.374313 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1138/2281] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:50.384718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e7f1c-bc93-416d-b6a6-8a2f6d82c747 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:50.396717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3f8e7f1c-bc93-416d-b6a6-8a2f6d82c747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:50.523669 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:50.528492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e7f1c-bc93-416d-b6a6-8a2f6d82c747 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:50.538921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9df9d3-431d-4d41-8047-d978b0769db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:50.539674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df9d3-431d-4d41-8047-d978b0769db1 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:50.540941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df9d3-431d-4d41-8047-d978b0769db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:50.541570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9df9d3-431d-4d41-8047-d978b0769db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:50.565250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9df9d3-431d-4d41-8047-d978b0769db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:50.567951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9df9d3-431d-4d41-8047-d978b0769db1 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:50.589406 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1144/2282] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:51.233874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc0cd6-aeae-4bb3-a556-9f6f9afded1e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:51.233874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc0cd6-aeae-4bb3-a556-9f6f9afded1e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:51.233874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc0cd6-aeae-4bb3-a556-9f6f9afded1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:51.296221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-70fc0cd6-aeae-4bb3-a556-9f6f9afded1e None None] MFA Rules not processed for user `6aeeab8af64a4a76aba0b46330569207`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:51.301996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-70fc0cd6-aeae-4bb3-a556-9f6f9afded1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:51.452520 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1139/2283] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:46:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:51.458257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9df9d3-431d-4d41-8047-d978b0769db1 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:51.460177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8b9df9d3-431d-4d41-8047-d978b0769db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:51.491089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9df9d3-431d-4d41-8047-d978b0769db1 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:51.505433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac917c4-5978-4039-946f-a0557a23b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:51.506161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac917c4-5978-4039-946f-a0557a23b9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:51.506686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac917c4-5978-4039-946f-a0557a23b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:51.507150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac917c4-5978-4039-946f-a0557a23b9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:51.507992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac917c4-5978-4039-946f-a0557a23b9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:51.510177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac917c4-5978-4039-946f-a0557a23b9c2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:51.575837 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1145/2284] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:46:51 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:51.579225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc0cd6-aeae-4bb3-a556-9f6f9afded1e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:51.617805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc0cd6-aeae-4bb3-a556-9f6f9afded1e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:51.671541 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:51.741227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4125a06-4814-4be0-af09-aa5a6227ab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:51.742069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4125a06-4814-4be0-af09-aa5a6227ab6b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:51.742576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4125a06-4814-4be0-af09-aa5a6227ab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:51.742983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4125a06-4814-4be0-af09-aa5a6227ab6b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:51.743868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4125a06-4814-4be0-af09-aa5a6227ab6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:51.747789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4125a06-4814-4be0-af09-aa5a6227ab6b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:51.783079 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1140/2285] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:46:51 2022] POST /identity/v3/users => generated 308 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:46:51.787658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac917c4-5978-4039-946f-a0557a23b9c2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:51.809906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac917c4-5978-4039-946f-a0557a23b9c2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:51.818818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06109377-735a-4be3-a76b-ac629efeff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:51.820146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06109377-735a-4be3-a76b-ac629efeff26 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:51.820765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06109377-735a-4be3-a76b-ac629efeff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:51.821255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06109377-735a-4be3-a76b-ac629efeff26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:51.822775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06109377-735a-4be3-a76b-ac629efeff26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:51.825873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06109377-735a-4be3-a76b-ac629efeff26 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:51.841580 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1146/2286] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:51.845932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4125a06-4814-4be0-af09-aa5a6227ab6b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:51.861495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4125a06-4814-4be0-af09-aa5a6227ab6b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:51.868690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa787ff2-3498-493b-b2bd-4f8890b20385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:51.870222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa787ff2-3498-493b-b2bd-4f8890b20385 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:51.870870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa787ff2-3498-493b-b2bd-4f8890b20385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:51.871565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa787ff2-3498-493b-b2bd-4f8890b20385 admin admin] PATH_INFO: `/v3/projects/05160ab4f4b04e24b016240b33e45c5e/users/cc7a070200d94d2f80db75cefb33c841/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:51.895829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa787ff2-3498-493b-b2bd-4f8890b20385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05160ab4f4b04e24b016240b33e45c5e, user_id=cc7a070200d94d2f80db75cefb33c841, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:51.900554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa787ff2-3498-493b-b2bd-4f8890b20385 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:51.930445 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1141/2287] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:51 2022] PUT /identity/v3/projects/05160ab4f4b04e24b016240b33e45c5e/users/cc7a070200d94d2f80db75cefb33c841/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:51.934459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06109377-735a-4be3-a76b-ac629efeff26 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:51.949956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06109377-735a-4be3-a76b-ac629efeff26 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:52.092450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdcdc3-ab72-4c74-8230-e8f9df4e343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:52.094940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdcdc3-ab72-4c74-8230-e8f9df4e343c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:52.095419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdcdc3-ab72-4c74-8230-e8f9df4e343c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:52.095849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdcdc3-ab72-4c74-8230-e8f9df4e343c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:52.099147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdcdc3-ab72-4c74-8230-e8f9df4e343c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:52.105506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdcdc3-ab72-4c74-8230-e8f9df4e343c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:52.121925 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1147/2288] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:46:52.125729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa787ff2-3498-493b-b2bd-4f8890b20385 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:52.138957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa787ff2-3498-493b-b2bd-4f8890b20385 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:52.145358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a677d-1ac9-4a68-b172-596498bf10a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:52.146157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a677d-1ac9-4a68-b172-596498bf10a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:52.147422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a677d-1ac9-4a68-b172-596498bf10a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:52.147635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a677d-1ac9-4a68-b172-596498bf10a0 admin admin] PATH_INFO: `/v3/projects/05160ab4f4b04e24b016240b33e45c5e/users/cc7a070200d94d2f80db75cefb33c841/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:52.151149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a677d-1ac9-4a68-b172-596498bf10a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05160ab4f4b04e24b016240b33e45c5e, user_id=cc7a070200d94d2f80db75cefb33c841, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:52.154515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a677d-1ac9-4a68-b172-596498bf10a0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:52.175585 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1142/2289] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:46:52 2022] PUT /identity/v3/projects/05160ab4f4b04e24b016240b33e45c5e/users/cc7a070200d94d2f80db75cefb33c841/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:46:57.087558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386447a4-aca2-4aca-aa00-56e3cad6960e None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:57.088937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386447a4-aca2-4aca-aa00-56e3cad6960e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:57.089631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386447a4-aca2-4aca-aa00-56e3cad6960e None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:57.092887 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1148/2290] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:46:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:46:57.114524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83e58-1685-423c-b8d9-f26a2bec212a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:57.115913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83e58-1685-423c-b8d9-f26a2bec212a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:57.116593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83e58-1685-423c-b8d9-f26a2bec212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:57.178872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d3f83e58-1685-423c-b8d9-f26a2bec212a None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:46:57.183577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d3f83e58-1685-423c-b8d9-f26a2bec212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:57.356168 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1143/2291] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:46:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:46:57.547780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386447a4-aca2-4aca-aa00-56e3cad6960e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:57.550931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-386447a4-aca2-4aca-aa00-56e3cad6960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:57.595301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386447a4-aca2-4aca-aa00-56e3cad6960e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:57.610496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cd707-5f27-4bc2-a744-65badc82ed2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:57.611656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cd707-5f27-4bc2-a744-65badc82ed2e service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:57.612108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cd707-5f27-4bc2-a744-65badc82ed2e service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:57.613036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cd707-5f27-4bc2-a744-65badc82ed2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:57.641288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cd707-5f27-4bc2-a744-65badc82ed2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:57.645457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cd707-5f27-4bc2-a744-65badc82ed2e service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:57.704074 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1149/2292] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:03.976140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83e58-1685-423c-b8d9-f26a2bec212a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:03.978618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d3f83e58-1685-423c-b8d9-f26a2bec212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:04.166337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83e58-1685-423c-b8d9-f26a2bec212a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:04.172347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:04.173339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:04.173723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:04.174926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] PATH_INFO: `/v3/users/729379ca02904136b0d5c96d6b28c490` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:04.176388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=729379ca02904136b0d5c96d6b28c490)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:04.180039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:04.208096 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:04.263302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729379ca02904136b0d5c96d6b28c490'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.286965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729379ca02904136b0d5c96d6b28c490'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.296452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729379ca02904136b0d5c96d6b28c490'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.307741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729379ca02904136b0d5c96d6b28c490'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.308843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729379ca02904136b0d5c96d6b28c490'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.320363 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1144/2293] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:03 2022] DELETE /identity/v3/users/729379ca02904136b0d5c96d6b28c490 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:04.570553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b70615-2e85-4c7b-b523-30195887ca95 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:04.571084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b70615-2e85-4c7b-b523-30195887ca95 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:04.571084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b70615-2e85-4c7b-b523-30195887ca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:04.596367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f9b70615-2e85-4c7b-b523-30195887ca95 None None] MFA Rules not processed for user `c5bef756c5c74e688ded867d98a6d29a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:04.598416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f9b70615-2e85-4c7b-b523-30195887ca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:04.665914 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1150/2294] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:04.873872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:04.875688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:05.080243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741d766-a3aa-4d58-af18-48fbe5003929 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:05.094993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:05.095660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:05.095942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:05.096213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] PATH_INFO: `/v3/projects/6be4ac47d8094dd2854afeadbfae9c96` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:05.097795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be4ac47d8094dd2854afeadbfae9c96)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:05.099749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:05.213637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be4ac47d8094dd2854afeadbfae9c96', 'request_id': 'req-36dbb664-3c42-473e-970c-0e88843c1550'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.230175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be4ac47d8094dd2854afeadbfae9c96', 'request_id': 'req-36dbb664-3c42-473e-970c-0e88843c1550'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.248396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be4ac47d8094dd2854afeadbfae9c96', 'request_id': 'req-36dbb664-3c42-473e-970c-0e88843c1550'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.276943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] The token cache is being invalidate because project 6be4ac47d8094dd2854afeadbfae9c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:05.277509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.278032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.285008 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1145/2295] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:04 2022] DELETE /identity/v3/projects/6be4ac47d8094dd2854afeadbfae9c96 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:05.287563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b70615-2e85-4c7b-b523-30195887ca95 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:05.318837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b70615-2e85-4c7b-b523-30195887ca95 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:05.465979 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:05.501101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:05.501939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:05.502320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:05.502696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] PATH_INFO: `/v3/users/2785a638c2a3448ca63e04e749ce01dc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:05.504590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2785a638c2a3448ca63e04e749ce01dc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:05.508513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:05.618768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2785a638c2a3448ca63e04e749ce01dc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.647332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2785a638c2a3448ca63e04e749ce01dc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.656611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2785a638c2a3448ca63e04e749ce01dc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.672653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2785a638c2a3448ca63e04e749ce01dc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.673488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea389f8-7bf9-4d02-96e0-7936943401bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2785a638c2a3448ca63e04e749ce01dc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:05.691169 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1151/2296] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:05 2022] DELETE /identity/v3/users/2785a638c2a3448ca63e04e749ce01dc => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:06.151433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:06.154051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:06.191243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbb664-3c42-473e-970c-0e88843c1550 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:06.266648 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:06.364258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:06.364954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:06.365238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:06.365515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] PATH_INFO: `/v3/projects/509418800d6f4e79b70f4170e7583a62` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:06.366855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=509418800d6f4e79b70f4170e7583a62)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:06.368867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:06.464854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509418800d6f4e79b70f4170e7583a62', 'request_id': 'req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:06.480697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509418800d6f4e79b70f4170e7583a62', 'request_id': 'req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:06.506572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509418800d6f4e79b70f4170e7583a62', 'request_id': 'req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:06.524765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] The token cache is being invalidate because project 509418800d6f4e79b70f4170e7583a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:06.527106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:06.528078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b77f0f2d-475d-4ff4-a5f5-0e3a123f95aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:06.530186 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1146/2297] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:06 2022] DELETE /identity/v3/projects/509418800d6f4e79b70f4170e7583a62 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:06.537106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b589f29-8d9c-4d98-8dc7-d4eed1eef175 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:06.551759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b589f29-8d9c-4d98-8dc7-d4eed1eef175 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:06.552389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b589f29-8d9c-4d98-8dc7-d4eed1eef175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:06.611637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2b589f29-8d9c-4d98-8dc7-d4eed1eef175 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:06.626472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2b589f29-8d9c-4d98-8dc7-d4eed1eef175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:06.734256 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1152/2298] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:47:06.744807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26babf-39cc-4484-b54e-2ed3aad5a534 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:06.744807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26babf-39cc-4484-b54e-2ed3aad5a534 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:06.744807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26babf-39cc-4484-b54e-2ed3aad5a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:06.791040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5f26babf-39cc-4484-b54e-2ed3aad5a534 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:06.792970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f26babf-39cc-4484-b54e-2ed3aad5a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:06.823529 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1147/2299] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:06.827996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b589f29-8d9c-4d98-8dc7-d4eed1eef175 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:06.841417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b589f29-8d9c-4d98-8dc7-d4eed1eef175 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:06.873513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949023c0-66de-4bc9-9f6d-ac6210e6bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:06.874149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949023c0-66de-4bc9-9f6d-ac6210e6bc16 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:06.874430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949023c0-66de-4bc9-9f6d-ac6210e6bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:06.874701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949023c0-66de-4bc9-9f6d-ac6210e6bc16 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:06.875437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949023c0-66de-4bc9-9f6d-ac6210e6bc16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:47:06.875797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949023c0-66de-4bc9-9f6d-ac6210e6bc16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:06.877483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949023c0-66de-4bc9-9f6d-ac6210e6bc16 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:06.909804 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1153/2300] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:06.911110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26babf-39cc-4484-b54e-2ed3aad5a534 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:06.924204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26babf-39cc-4484-b54e-2ed3aad5a534 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:06.940294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2ef6b-8e27-4af2-ae00-7a9f5aa05b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:06.941004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2ef6b-8e27-4af2-ae00-7a9f5aa05b09 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:06.941283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2ef6b-8e27-4af2-ae00-7a9f5aa05b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:06.942050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2ef6b-8e27-4af2-ae00-7a9f5aa05b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:06.942697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2ef6b-8e27-4af2-ae00-7a9f5aa05b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:06.944714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2ef6b-8e27-4af2-ae00-7a9f5aa05b09 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:07.044054 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1148/2301] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:06 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:07.051955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949023c0-66de-4bc9-9f6d-ac6210e6bc16 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:07.073354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949023c0-66de-4bc9-9f6d-ac6210e6bc16 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:07.251137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475ffc9-0518-4a04-b62b-1fffbb95a54d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:07.251585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475ffc9-0518-4a04-b62b-1fffbb95a54d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:07.251802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475ffc9-0518-4a04-b62b-1fffbb95a54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:07.294829 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:07.318410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3475ffc9-0518-4a04-b62b-1fffbb95a54d None None] MFA Rules not processed for user `1e43026c56e0462b976a840266ea8acf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:07.319658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3475ffc9-0518-4a04-b62b-1fffbb95a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:07.320066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ca9b2-87e0-4c85-a2ee-51365f3bd071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:07.320729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ca9b2-87e0-4c85-a2ee-51365f3bd071 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:07.321011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ca9b2-87e0-4c85-a2ee-51365f3bd071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:07.321282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ca9b2-87e0-4c85-a2ee-51365f3bd071 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:07.321928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ca9b2-87e0-4c85-a2ee-51365f3bd071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:07.323874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ca9b2-87e0-4c85-a2ee-51365f3bd071 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:07.387566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1154/2302] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:07 2022] POST /identity/v3/users => generated 286 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:07.389027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ca9b2-87e0-4c85-a2ee-51365f3bd071 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:07.416799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ca9b2-87e0-4c85-a2ee-51365f3bd071 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:07.437109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8170c-c671-42e4-95a7-b2ba03d4cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:07.437951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8170c-c671-42e4-95a7-b2ba03d4cc44 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:07.438359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8170c-c671-42e4-95a7-b2ba03d4cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:07.438770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8170c-c671-42e4-95a7-b2ba03d4cc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:07.439761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8170c-c671-42e4-95a7-b2ba03d4cc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:07.442183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8170c-c671-42e4-95a7-b2ba03d4cc44 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:07.480308 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1155/2303] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:07.483167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8170c-c671-42e4-95a7-b2ba03d4cc44 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:07.513812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8170c-c671-42e4-95a7-b2ba03d4cc44 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:07.538503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803627-7eea-4274-b6fa-f05c661d8682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:07.539186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803627-7eea-4274-b6fa-f05c661d8682 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:07.539623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803627-7eea-4274-b6fa-f05c661d8682 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:07.540090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803627-7eea-4274-b6fa-f05c661d8682 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:07.540942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8803627-7eea-4274-b6fa-f05c661d8682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:07.551906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8803627-7eea-4274-b6fa-f05c661d8682 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:07.571355 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1156/2304] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:07.573074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803627-7eea-4274-b6fa-f05c661d8682 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:07.585095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803627-7eea-4274-b6fa-f05c661d8682 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:07.595050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78f42d-9150-4137-b205-23cace7a2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:07.595745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78f42d-9150-4137-b205-23cace7a2ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:07.596174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78f42d-9150-4137-b205-23cace7a2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:07.597007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78f42d-9150-4137-b205-23cace7a2ff7 admin admin] PATH_INFO: `/v3/projects/9973342fa45244baa401e4b2da068670/users/3ba6c3f92bf24362a619775aa0358f06/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:07.604411 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1149/2305] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:47:07.610556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475ffc9-0518-4a04-b62b-1fffbb95a54d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:07.615015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3475ffc9-0518-4a04-b62b-1fffbb95a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:07.631245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78f42d-9150-4137-b205-23cace7a2ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9973342fa45244baa401e4b2da068670, user_id=3ba6c3f92bf24362a619775aa0358f06, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:07.634062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78f42d-9150-4137-b205-23cace7a2ff7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:07.658273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475ffc9-0518-4a04-b62b-1fffbb95a54d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:07.668376 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1157/2306] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:07 2022] PUT /identity/v3/projects/9973342fa45244baa401e4b2da068670/users/3ba6c3f92bf24362a619775aa0358f06/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:07.684315 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:07.696718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1aec6-79bb-4ce9-9f51-62b7451ad90f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:07.696718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1aec6-79bb-4ce9-9f51-62b7451ad90f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:07.696718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1aec6-79bb-4ce9-9f51-62b7451ad90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:07.779609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f3b1aec6-79bb-4ce9-9f51-62b7451ad90f None None] MFA Rules not processed for user `3ba6c3f92bf24362a619775aa0358f06`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:07.782411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f3b1aec6-79bb-4ce9-9f51-62b7451ad90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:07.845531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767aeb2-0714-49f7-a457-d367fe09cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:07.846162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767aeb2-0714-49f7-a457-d367fe09cd4b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:07.846632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767aeb2-0714-49f7-a457-d367fe09cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:07.847450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767aeb2-0714-49f7-a457-d367fe09cd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:07.848217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767aeb2-0714-49f7-a457-d367fe09cd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:07.850519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767aeb2-0714-49f7-a457-d367fe09cd4b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:07.871321 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1158/2307] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:07.877964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1aec6-79bb-4ce9-9f51-62b7451ad90f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:07.898108 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1150/2308] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:07 2022] POST /identity/v3/projects => generated 385 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:07.902245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767aeb2-0714-49f7-a457-d367fe09cd4b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:07.906135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1aec6-79bb-4ce9-9f51-62b7451ad90f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.007292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767aeb2-0714-49f7-a457-d367fe09cd4b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.011662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a856d-6eda-42b2-89fb-a1e4e640271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.012384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a856d-6eda-42b2-89fb-a1e4e640271a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.012822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a856d-6eda-42b2-89fb-a1e4e640271a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.012961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a856d-6eda-42b2-89fb-a1e4e640271a admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.013752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a856d-6eda-42b2-89fb-a1e4e640271a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.016064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a856d-6eda-42b2-89fb-a1e4e640271a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.019487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d57039-10a2-4c92-b33f-4b60b9b94a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.021408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d57039-10a2-4c92-b33f-4b60b9b94a02 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.021782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d57039-10a2-4c92-b33f-4b60b9b94a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.022133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d57039-10a2-4c92-b33f-4b60b9b94a02 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.022846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d57039-10a2-4c92-b33f-4b60b9b94a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.030022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d57039-10a2-4c92-b33f-4b60b9b94a02 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.068808 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1151/2309] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:07 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:08.072341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d57039-10a2-4c92-b33f-4b60b9b94a02 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.083641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1159/2310] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:07 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:08.089907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a856d-6eda-42b2-89fb-a1e4e640271a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.092795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d57039-10a2-4c92-b33f-4b60b9b94a02 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.119862 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:08.241451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc154ad-dad9-42c2-9d1c-506fcd0df1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.242097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc154ad-dad9-42c2-9d1c-506fcd0df1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.242379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc154ad-dad9-42c2-9d1c-506fcd0df1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.242656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc154ad-dad9-42c2-9d1c-506fcd0df1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.243320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc154ad-dad9-42c2-9d1c-506fcd0df1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.250583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc154ad-dad9-42c2-9d1c-506fcd0df1b5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.258472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a856d-6eda-42b2-89fb-a1e4e640271a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.272470 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1152/2311] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:08.274133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d34a-85b4-4ed7-850b-2e2e1a2ab98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.274805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d34a-85b4-4ed7-850b-2e2e1a2ab98c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.275262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d34a-85b4-4ed7-850b-2e2e1a2ab98c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.276264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d34a-85b4-4ed7-850b-2e2e1a2ab98c admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.276974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3d34a-85b4-4ed7-850b-2e2e1a2ab98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.278369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc154ad-dad9-42c2-9d1c-506fcd0df1b5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.280836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3d34a-85b4-4ed7-850b-2e2e1a2ab98c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.292802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc154ad-dad9-42c2-9d1c-506fcd0df1b5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.304418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd896476-50ab-4cd0-870e-73e88be9d423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.306639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd896476-50ab-4cd0-870e-73e88be9d423 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.307147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd896476-50ab-4cd0-870e-73e88be9d423 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.307588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd896476-50ab-4cd0-870e-73e88be9d423 admin admin] PATH_INFO: `/v3/projects/c9c240f9d6124be58cbe9b067b12e5a0/users/1e63516d1b05413ab70a60696c0d9d1d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.317339 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1160/2312] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:08 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:47:08.321597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d34a-85b4-4ed7-850b-2e2e1a2ab98c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.328046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd896476-50ab-4cd0-870e-73e88be9d423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c240f9d6124be58cbe9b067b12e5a0, user_id=1e63516d1b05413ab70a60696c0d9d1d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.332017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd896476-50ab-4cd0-870e-73e88be9d423 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.337945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d34a-85b4-4ed7-850b-2e2e1a2ab98c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.343829 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:08.355211 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1153/2313] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:08 2022] PUT /identity/v3/projects/c9c240f9d6124be58cbe9b067b12e5a0/users/1e63516d1b05413ab70a60696c0d9d1d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:08.356398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810f2d6-2759-4830-b4ce-5f738ecd45d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.357414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810f2d6-2759-4830-b4ce-5f738ecd45d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.357696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810f2d6-2759-4830-b4ce-5f738ecd45d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.357974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810f2d6-2759-4830-b4ce-5f738ecd45d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.358642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810f2d6-2759-4830-b4ce-5f738ecd45d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.360503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd896476-50ab-4cd0-870e-73e88be9d423 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.360647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810f2d6-2759-4830-b4ce-5f738ecd45d4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.377583 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1161/2314] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:08.383458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810f2d6-2759-4830-b4ce-5f738ecd45d4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.397380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810f2d6-2759-4830-b4ce-5f738ecd45d4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.494132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdfa4f-4d42-4d11-a15a-451da4770885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.494471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdfa4f-4d42-4d11-a15a-451da4770885 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.495040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdfa4f-4d42-4d11-a15a-451da4770885 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.495322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdfa4f-4d42-4d11-a15a-451da4770885 admin admin] PATH_INFO: `/v3/projects/4e226b1abea4476387c6bfbab3e6a5cf/users/76e1a702fcc44ab6b2b69ae41eebf550/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.506467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd896476-50ab-4cd0-870e-73e88be9d423 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.513166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca31e-2a4a-4500-b804-e40e88e956e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.513849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca31e-2a4a-4500-b804-e40e88e956e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.514132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca31e-2a4a-4500-b804-e40e88e956e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.514410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca31e-2a4a-4500-b804-e40e88e956e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.515267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca31e-2a4a-4500-b804-e40e88e956e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.517423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca31e-2a4a-4500-b804-e40e88e956e9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.521955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdfa4f-4d42-4d11-a15a-451da4770885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e226b1abea4476387c6bfbab3e6a5cf, user_id=76e1a702fcc44ab6b2b69ae41eebf550, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.525606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdfa4f-4d42-4d11-a15a-451da4770885 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.530397 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1154/2315] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:08.535806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca31e-2a4a-4500-b804-e40e88e956e9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.543489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1162/2316] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:08 2022] PUT /identity/v3/projects/4e226b1abea4476387c6bfbab3e6a5cf/users/76e1a702fcc44ab6b2b69ae41eebf550/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:08.547895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdfa4f-4d42-4d11-a15a-451da4770885 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.550178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca31e-2a4a-4500-b804-e40e88e956e9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.619868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326137e7-a7a9-44c4-a702-b028ccee6d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.621188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326137e7-a7a9-44c4-a702-b028ccee6d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.621775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326137e7-a7a9-44c4-a702-b028ccee6d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.622307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326137e7-a7a9-44c4-a702-b028ccee6d0f admin admin] PATH_INFO: `/v3/projects/c9c240f9d6124be58cbe9b067b12e5a0/users/1e63516d1b05413ab70a60696c0d9d1d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.624496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326137e7-a7a9-44c4-a702-b028ccee6d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c240f9d6124be58cbe9b067b12e5a0, user_id=1e63516d1b05413ab70a60696c0d9d1d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.627211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326137e7-a7a9-44c4-a702-b028ccee6d0f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.637476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdfa4f-4d42-4d11-a15a-451da4770885 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.643186 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1155/2317] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:08 2022] PUT /identity/v3/projects/c9c240f9d6124be58cbe9b067b12e5a0/users/1e63516d1b05413ab70a60696c0d9d1d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:08.668208 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:08.734259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c246f2-f7fb-4e63-a615-c7b0b38a1015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.735311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c246f2-f7fb-4e63-a615-c7b0b38a1015 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.735601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c246f2-f7fb-4e63-a615-c7b0b38a1015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.735960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c246f2-f7fb-4e63-a615-c7b0b38a1015 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.736705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c246f2-f7fb-4e63-a615-c7b0b38a1015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.739714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c246f2-f7fb-4e63-a615-c7b0b38a1015 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.761654 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1163/2318] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:47:08.763357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326137e7-a7a9-44c4-a702-b028ccee6d0f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:08.787237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326137e7-a7a9-44c4-a702-b028ccee6d0f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:08.798277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e7e80-65d4-4035-b6ae-905d017e3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:08.802006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e7e80-65d4-4035-b6ae-905d017e3d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.802319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e7e80-65d4-4035-b6ae-905d017e3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.802648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e7e80-65d4-4035-b6ae-905d017e3d45 admin admin] PATH_INFO: `/v3/projects/4e226b1abea4476387c6bfbab3e6a5cf/users/76e1a702fcc44ab6b2b69ae41eebf550/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.809823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e7e80-65d4-4035-b6ae-905d017e3d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e226b1abea4476387c6bfbab3e6a5cf, user_id=76e1a702fcc44ab6b2b69ae41eebf550, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:08.814098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e7e80-65d4-4035-b6ae-905d017e3d45 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:08.840138 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1156/2319] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:08 2022] PUT /identity/v3/projects/4e226b1abea4476387c6bfbab3e6a5cf/users/76e1a702fcc44ab6b2b69ae41eebf550/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:08.854329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebca75-b8ce-4dba-a0ed-e240af3ff90c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:08.854597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebca75-b8ce-4dba-a0ed-e240af3ff90c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:08.854885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebca75-b8ce-4dba-a0ed-e240af3ff90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:08.913969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dbebca75-b8ce-4dba-a0ed-e240af3ff90c None None] MFA Rules not processed for user `76e1a702fcc44ab6b2b69ae41eebf550`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:08.916339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dbebca75-b8ce-4dba-a0ed-e240af3ff90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:09.247525 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1164/2320] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:09.885177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e7e80-65d4-4035-b6ae-905d017e3d45 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:09.887269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c72e7e80-65d4-4035-b6ae-905d017e3d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:10.201831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e7e80-65d4-4035-b6ae-905d017e3d45 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:10.218752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5393e60-4283-462e-9628-f229d570d128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:10.219749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393e60-4283-462e-9628-f229d570d128 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:10.219749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393e60-4283-462e-9628-f229d570d128 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:10.220027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393e60-4283-462e-9628-f229d570d128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:10.241131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5393e60-4283-462e-9628-f229d570d128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:10.243023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5393e60-4283-462e-9628-f229d570d128 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:10.256730 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:10.281507 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1157/2321] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:12.366094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed667ad-1551-48bb-85a3-da923c65d065 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:12.367089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed667ad-1551-48bb-85a3-da923c65d065 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:12.367533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed667ad-1551-48bb-85a3-da923c65d065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:12.442359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2ed667ad-1551-48bb-85a3-da923c65d065 None None] MFA Rules not processed for user `cc7a070200d94d2f80db75cefb33c841`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:12.443970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2ed667ad-1551-48bb-85a3-da923c65d065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:12.696215 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1165/2322] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:14.689700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698b1bb-7eb3-4881-87ab-34c0ae64d783 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:14.690897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698b1bb-7eb3-4881-87ab-34c0ae64d783 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:14.691687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698b1bb-7eb3-4881-87ab-34c0ae64d783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:14.725489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c698b1bb-7eb3-4881-87ab-34c0ae64d783 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:14.727329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c698b1bb-7eb3-4881-87ab-34c0ae64d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:14.837735 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1158/2323] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:47:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:47:14.858901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed667ad-1551-48bb-85a3-da923c65d065 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:14.860724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2ed667ad-1551-48bb-85a3-da923c65d065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:14.918288 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:15.039111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed667ad-1551-48bb-85a3-da923c65d065 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:15.054849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dc87b-c5af-4207-9ff1-e1105958f208 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:15.055680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dc87b-c5af-4207-9ff1-e1105958f208 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:15.056416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dc87b-c5af-4207-9ff1-e1105958f208 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:15.056640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dc87b-c5af-4207-9ff1-e1105958f208 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:15.073217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dc87b-c5af-4207-9ff1-e1105958f208 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:15.075667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dc87b-c5af-4207-9ff1-e1105958f208 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:15.102239 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1166/2324] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:47:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:47:18.077075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698b1bb-7eb3-4881-87ab-34c0ae64d783 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:18.271241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698b1bb-7eb3-4881-87ab-34c0ae64d783 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:18.290784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:18.291841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:18.292394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:18.292757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] PATH_INFO: `/v3/users/3ba6c3f92bf24362a619775aa0358f06` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:18.298613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba6c3f92bf24362a619775aa0358f06)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:18.304517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:18.450078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba6c3f92bf24362a619775aa0358f06'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:18.484747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba6c3f92bf24362a619775aa0358f06'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:18.499442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba6c3f92bf24362a619775aa0358f06'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:18.518093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba6c3f92bf24362a619775aa0358f06'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:18.519215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba6c3f92bf24362a619775aa0358f06'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:18.571194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d40eb-dd0a-4cf9-9e6b-fee89a6b3b7d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:18.571906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d40eb-dd0a-4cf9-9e6b-fee89a6b3b7d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:18.572245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d40eb-dd0a-4cf9-9e6b-fee89a6b3b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:18.572365 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1159/2325] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:18 2022] DELETE /identity/v3/users/3ba6c3f92bf24362a619775aa0358f06 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:18.614048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5c6d40eb-dd0a-4cf9-9e6b-fee89a6b3b7d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:18.615612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5c6d40eb-dd0a-4cf9-9e6b-fee89a6b3b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:18.859106 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1167/2326] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:47:18.959017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:18.960799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:19.073647 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:19.203099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a78f0-8bb5-4224-8271-623243fe4596 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:19.215631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019e7e-afe6-41ac-984e-3066e5bac7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:19.216290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019e7e-afe6-41ac-984e-3066e5bac7ee service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:19.216572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019e7e-afe6-41ac-984e-3066e5bac7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:19.217023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019e7e-afe6-41ac-984e-3066e5bac7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:19.247747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c019e7e-afe6-41ac-984e-3066e5bac7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:19.258059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c019e7e-afe6-41ac-984e-3066e5bac7ee service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:19.283577 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1160/2327] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:21.931252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d40eb-dd0a-4cf9-9e6b-fee89a6b3b7d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:21.933331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5c6d40eb-dd0a-4cf9-9e6b-fee89a6b3b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:21.997912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d40eb-dd0a-4cf9-9e6b-fee89a6b3b7d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:22.020811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:22.021805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:22.023133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:22.023615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] PATH_INFO: `/v3/projects/9973342fa45244baa401e4b2da068670` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:22.032464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9973342fa45244baa401e4b2da068670)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:22.035325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:22.190006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9973342fa45244baa401e4b2da068670', 'request_id': 'req-2e08d9dd-994b-443b-b137-e5f2b78f3931'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.208978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9973342fa45244baa401e4b2da068670', 'request_id': 'req-2e08d9dd-994b-443b-b137-e5f2b78f3931'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.219766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9973342fa45244baa401e4b2da068670', 'request_id': 'req-2e08d9dd-994b-443b-b137-e5f2b78f3931'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.240175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] The token cache is being invalidate because project 9973342fa45244baa401e4b2da068670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:22.240809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.241771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.245772 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1168/2328] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:21 2022] DELETE /identity/v3/projects/9973342fa45244baa401e4b2da068670 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:22.253578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019e7e-afe6-41ac-984e-3066e5bac7ee service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:22.280710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019e7e-afe6-41ac-984e-3066e5bac7ee service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:22.429470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:22.430768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:22.431053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:22.431329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] PATH_INFO: `/v3/users/76e1a702fcc44ab6b2b69ae41eebf550` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:22.432514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e1a702fcc44ab6b2b69ae41eebf550)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:22.434489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:22.563352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e1a702fcc44ab6b2b69ae41eebf550'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.582655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e1a702fcc44ab6b2b69ae41eebf550'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.600641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e1a702fcc44ab6b2b69ae41eebf550'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.621042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e1a702fcc44ab6b2b69ae41eebf550'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.621725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f08318a2-721b-437d-abf2-271f00aac9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e1a702fcc44ab6b2b69ae41eebf550'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:22.637285 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1161/2329] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:22 2022] DELETE /identity/v3/users/76e1a702fcc44ab6b2b69ae41eebf550 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:24.642172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:24.645708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:24.669755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d9dd-994b-443b-b137-e5f2b78f3931 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:24.725673 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:24.800424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:24.801431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:24.801957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:24.802247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] PATH_INFO: `/v3/projects/4e226b1abea4476387c6bfbab3e6a5cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:24.804383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e226b1abea4476387c6bfbab3e6a5cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:24.807446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:24.921485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e226b1abea4476387c6bfbab3e6a5cf', 'request_id': 'req-2325a8fe-418a-495d-a2ab-da916a5aac29'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:24.935121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e226b1abea4476387c6bfbab3e6a5cf', 'request_id': 'req-2325a8fe-418a-495d-a2ab-da916a5aac29'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:24.948564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e226b1abea4476387c6bfbab3e6a5cf', 'request_id': 'req-2325a8fe-418a-495d-a2ab-da916a5aac29'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:24.966448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] The token cache is being invalidate because project 4e226b1abea4476387c6bfbab3e6a5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:24.967495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:24.968691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2325a8fe-418a-495d-a2ab-da916a5aac29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:24.972891 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1169/2330] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:24 2022] DELETE /identity/v3/projects/4e226b1abea4476387c6bfbab3e6a5cf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:24.978009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316c5e-0b76-4c33-aee4-92d8b7dfdb73 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:24.978805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316c5e-0b76-4c33-aee4-92d8b7dfdb73 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:24.978805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316c5e-0b76-4c33-aee4-92d8b7dfdb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:25.005402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-65316c5e-0b76-4c33-aee4-92d8b7dfdb73 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:25.009293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65316c5e-0b76-4c33-aee4-92d8b7dfdb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:25.098591 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:25.133151 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1162/2331] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:47:25.137649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dceb5-f5bb-4bcf-8dad-1d73271d7c94 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:25.138230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dceb5-f5bb-4bcf-8dad-1d73271d7c94 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:25.138696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dceb5-f5bb-4bcf-8dad-1d73271d7c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:25.195881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f74dceb5-f5bb-4bcf-8dad-1d73271d7c94 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:25.197516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f74dceb5-f5bb-4bcf-8dad-1d73271d7c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:25.207269 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1170/2332] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:47:25.213439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316c5e-0b76-4c33-aee4-92d8b7dfdb73 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:25.224956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316c5e-0b76-4c33-aee4-92d8b7dfdb73 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:25.230793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfcdb2-410c-468a-bc68-90f102983f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:25.231768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfcdb2-410c-468a-bc68-90f102983f5a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:25.232241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfcdb2-410c-468a-bc68-90f102983f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:25.232741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfcdb2-410c-468a-bc68-90f102983f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:25.233713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfcdb2-410c-468a-bc68-90f102983f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:47:25.234818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfcdb2-410c-468a-bc68-90f102983f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:25.237511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfcdb2-410c-468a-bc68-90f102983f5a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:25.255718 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1163/2333] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:25.260189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dceb5-f5bb-4bcf-8dad-1d73271d7c94 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:25.272456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dceb5-f5bb-4bcf-8dad-1d73271d7c94 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:25.277996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d410649-266a-45d8-88ed-c4603adb0cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:25.278969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d410649-266a-45d8-88ed-c4603adb0cae admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:25.279445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d410649-266a-45d8-88ed-c4603adb0cae admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:25.279910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d410649-266a-45d8-88ed-c4603adb0cae admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:25.281387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d410649-266a-45d8-88ed-c4603adb0cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:25.284317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d410649-266a-45d8-88ed-c4603adb0cae admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:25.325973 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1171/2334] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:25 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:25.330757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfcdb2-410c-468a-bc68-90f102983f5a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:25.349672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfcdb2-410c-468a-bc68-90f102983f5a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:25.509699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a55c80-6d5a-43a7-9000-a677db0652be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:25.510680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a55c80-6d5a-43a7-9000-a677db0652be admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:25.511276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a55c80-6d5a-43a7-9000-a677db0652be admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:25.511741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a55c80-6d5a-43a7-9000-a677db0652be admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:25.512648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a55c80-6d5a-43a7-9000-a677db0652be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:25.518838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a55c80-6d5a-43a7-9000-a677db0652be admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:25.560502 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1164/2335] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:25 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:25.565004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d410649-266a-45d8-88ed-c4603adb0cae admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:25.578099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d410649-266a-45d8-88ed-c4603adb0cae admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:25.585451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1df9d9-fe53-4a0d-8b59-de356234a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:25.586872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1df9d9-fe53-4a0d-8b59-de356234a112 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:25.587401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1df9d9-fe53-4a0d-8b59-de356234a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:25.587887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1df9d9-fe53-4a0d-8b59-de356234a112 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:25.589142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1df9d9-fe53-4a0d-8b59-de356234a112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:25.591472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1df9d9-fe53-4a0d-8b59-de356234a112 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:25.606202 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1172/2336] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:25.616701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a55c80-6d5a-43a7-9000-a677db0652be admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:25.634039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a55c80-6d5a-43a7-9000-a677db0652be admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:25.647497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5795bb7-0e58-4ccc-b01e-fecae3497175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:25.648048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5795bb7-0e58-4ccc-b01e-fecae3497175 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:25.648335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5795bb7-0e58-4ccc-b01e-fecae3497175 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:25.648682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5795bb7-0e58-4ccc-b01e-fecae3497175 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:25.650283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5795bb7-0e58-4ccc-b01e-fecae3497175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:25.651014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5795bb7-0e58-4ccc-b01e-fecae3497175 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:25.677511 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1165/2337] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:25.681986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1df9d9-fe53-4a0d-8b59-de356234a112 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:25.698893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1df9d9-fe53-4a0d-8b59-de356234a112 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:25.714340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76cab1-3962-40a9-83df-7da594df5dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:25.715907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76cab1-3962-40a9-83df-7da594df5dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:25.716490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76cab1-3962-40a9-83df-7da594df5dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:25.717758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76cab1-3962-40a9-83df-7da594df5dc1 admin admin] PATH_INFO: `/v3/projects/daeb4b8374514419b145bb656f028168/users/0993c1870aa7438e9889d60fc3f644a4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:25.744744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76cab1-3962-40a9-83df-7da594df5dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daeb4b8374514419b145bb656f028168, user_id=0993c1870aa7438e9889d60fc3f644a4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:25.752070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76cab1-3962-40a9-83df-7da594df5dc1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:25.777972 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1173/2338] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:25 2022] PUT /identity/v3/projects/daeb4b8374514419b145bb656f028168/users/0993c1870aa7438e9889d60fc3f644a4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:25.789784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8222b6f-3d99-4f7e-90a2-88621e427b5d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:25.791169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8222b6f-3d99-4f7e-90a2-88621e427b5d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:25.792105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8222b6f-3d99-4f7e-90a2-88621e427b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:25.850867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f8222b6f-3d99-4f7e-90a2-88621e427b5d None None] MFA Rules not processed for user `0993c1870aa7438e9889d60fc3f644a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:25.855031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8222b6f-3d99-4f7e-90a2-88621e427b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:26.003708 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1166/2339] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:26.008265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76cab1-3962-40a9-83df-7da594df5dc1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:26.164568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76cab1-3962-40a9-83df-7da594df5dc1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:26.171455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82145a-7d8e-459e-b1d5-72db74945f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:26.172756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82145a-7d8e-459e-b1d5-72db74945f1e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:26.173367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82145a-7d8e-459e-b1d5-72db74945f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:26.174054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82145a-7d8e-459e-b1d5-72db74945f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:26.175042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82145a-7d8e-459e-b1d5-72db74945f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:26.177698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82145a-7d8e-459e-b1d5-72db74945f1e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:26.195790 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:26.264816 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1174/2340] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:26 2022] POST /identity/v3/projects => generated 381 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:26.270355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8222b6f-3d99-4f7e-90a2-88621e427b5d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:26.299420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8222b6f-3d99-4f7e-90a2-88621e427b5d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:26.394396 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:26.429257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bde36-cca0-48a0-816f-11db2a346add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:26.430391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bde36-cca0-48a0-816f-11db2a346add admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:26.430887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bde36-cca0-48a0-816f-11db2a346add admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:26.435534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bde36-cca0-48a0-816f-11db2a346add admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:26.436844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bde36-cca0-48a0-816f-11db2a346add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:26.441046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bde36-cca0-48a0-816f-11db2a346add admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:26.462879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eff4e-2fb1-4540-b75f-4dea63493c93 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:26.464188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eff4e-2fb1-4540-b75f-4dea63493c93 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:26.464876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eff4e-2fb1-4540-b75f-4dea63493c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:26.494648 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1167/2341] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:26 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:26.504962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bde36-cca0-48a0-816f-11db2a346add admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:26.530214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bde36-cca0-48a0-816f-11db2a346add admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:26.545812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ea22-2b2b-48b5-a7a1-9e15c9fe6531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:26.546545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ea22-2b2b-48b5-a7a1-9e15c9fe6531 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:26.546899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ea22-2b2b-48b5-a7a1-9e15c9fe6531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:26.547019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9c4eff4e-2fb1-4540-b75f-4dea63493c93 None None] MFA Rules not processed for user `1e63516d1b05413ab70a60696c0d9d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:26.547874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ea22-2b2b-48b5-a7a1-9e15c9fe6531 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:26.549253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6ea22-2b2b-48b5-a7a1-9e15c9fe6531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:26.551161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6ea22-2b2b-48b5-a7a1-9e15c9fe6531 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:26.553536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9c4eff4e-2fb1-4540-b75f-4dea63493c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:26.565625 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1168/2342] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:26.571398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ea22-2b2b-48b5-a7a1-9e15c9fe6531 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:26.593149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ea22-2b2b-48b5-a7a1-9e15c9fe6531 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:26.603492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168f5d2-0c25-4c9a-9de3-5866cfda21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:26.623597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168f5d2-0c25-4c9a-9de3-5866cfda21b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:26.624370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168f5d2-0c25-4c9a-9de3-5866cfda21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:26.625138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168f5d2-0c25-4c9a-9de3-5866cfda21b6 admin admin] PATH_INFO: `/v3/projects/a2c53ab55dec41888ee9abb2aa615aa7/users/dc9adecc50ef426b985fbade7bf02030/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:26.674394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168f5d2-0c25-4c9a-9de3-5866cfda21b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c53ab55dec41888ee9abb2aa615aa7, user_id=dc9adecc50ef426b985fbade7bf02030, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:26.681134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168f5d2-0c25-4c9a-9de3-5866cfda21b6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:26.726701 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1175/2343] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:47:26.727529 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1169/2344] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:26 2022] PUT /identity/v3/projects/a2c53ab55dec41888ee9abb2aa615aa7/users/dc9adecc50ef426b985fbade7bf02030/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:26.727703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eff4e-2fb1-4540-b75f-4dea63493c93 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:26.742571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eff4e-2fb1-4540-b75f-4dea63493c93 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:26.742867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168f5d2-0c25-4c9a-9de3-5866cfda21b6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:26.748572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3168f5d2-0c25-4c9a-9de3-5866cfda21b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:26.903476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168f5d2-0c25-4c9a-9de3-5866cfda21b6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:26.913952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb86cd5-5235-41ac-80ea-c49e87a9f1b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:26.914638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb86cd5-5235-41ac-80ea-c49e87a9f1b5 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:26.914878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb86cd5-5235-41ac-80ea-c49e87a9f1b5 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:26.915159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb86cd5-5235-41ac-80ea-c49e87a9f1b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:26.938823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa061e0-5547-4b6e-a0c6-eb9b2fef37ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:26.939680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa061e0-5547-4b6e-a0c6-eb9b2fef37ae admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:26.939680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa061e0-5547-4b6e-a0c6-eb9b2fef37ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:26.941542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa061e0-5547-4b6e-a0c6-eb9b2fef37ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:26.943294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa061e0-5547-4b6e-a0c6-eb9b2fef37ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:26.945762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa061e0-5547-4b6e-a0c6-eb9b2fef37ae admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:26.975441 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1176/2345] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:26.981185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa061e0-5547-4b6e-a0c6-eb9b2fef37ae admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:27.016052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa061e0-5547-4b6e-a0c6-eb9b2fef37ae admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:27.029935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d48832-1754-4fd2-ba2a-04ff3185594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:27.031485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d48832-1754-4fd2-ba2a-04ff3185594b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:27.032137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d48832-1754-4fd2-ba2a-04ff3185594b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:27.032265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d48832-1754-4fd2-ba2a-04ff3185594b admin admin] PATH_INFO: `/v3/projects/a2c53ab55dec41888ee9abb2aa615aa7/users/dc9adecc50ef426b985fbade7bf02030/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:27.054939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d48832-1754-4fd2-ba2a-04ff3185594b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c53ab55dec41888ee9abb2aa615aa7, user_id=dc9adecc50ef426b985fbade7bf02030, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:27.054939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d48832-1754-4fd2-ba2a-04ff3185594b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:27.077142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb86cd5-5235-41ac-80ea-c49e87a9f1b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:27.078629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb86cd5-5235-41ac-80ea-c49e87a9f1b5 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:27.091281 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1177/2346] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:26 2022] PUT /identity/v3/projects/a2c53ab55dec41888ee9abb2aa615aa7/users/dc9adecc50ef426b985fbade7bf02030/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:27.108111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6abf1-f7e7-44cd-bc80-04ffeeb0a5c8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:27.108412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6abf1-f7e7-44cd-bc80-04ffeeb0a5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:27.109440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6abf1-f7e7-44cd-bc80-04ffeeb0a5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:27.115026 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1170/2347] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:47:27.218418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-15c6abf1-f7e7-44cd-bc80-04ffeeb0a5c8 None None] MFA Rules not processed for user `dc9adecc50ef426b985fbade7bf02030`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:27.220248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-15c6abf1-f7e7-44cd-bc80-04ffeeb0a5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:27.477712 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:27.564212 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1178/2348] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:27.961763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb86cd5-5235-41ac-80ea-c49e87a9f1b5 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:27.963465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cbb86cd5-5235-41ac-80ea-c49e87a9f1b5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:28.124240 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:28.183124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb86cd5-5235-41ac-80ea-c49e87a9f1b5 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:28.385044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938b785-d25b-43d0-9b8a-7c5f91b58404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:28.385847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938b785-d25b-43d0-9b8a-7c5f91b58404 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:28.385996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938b785-d25b-43d0-9b8a-7c5f91b58404 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:28.386209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938b785-d25b-43d0-9b8a-7c5f91b58404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:28.400065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938b785-d25b-43d0-9b8a-7c5f91b58404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:28.401714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938b785-d25b-43d0-9b8a-7c5f91b58404 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:28.430592 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1171/2349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:29.641835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6abf1-f7e7-44cd-bc80-04ffeeb0a5c8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:29.948027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6abf1-f7e7-44cd-bc80-04ffeeb0a5c8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:29.980069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:29.980867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:29.981440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:29.981440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] PATH_INFO: `/v3/users/0993c1870aa7438e9889d60fc3f644a4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:29.983247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0993c1870aa7438e9889d60fc3f644a4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:29.985259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:30.132978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0993c1870aa7438e9889d60fc3f644a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:30.178030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0993c1870aa7438e9889d60fc3f644a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:30.194700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0993c1870aa7438e9889d60fc3f644a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:30.217699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0993c1870aa7438e9889d60fc3f644a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:30.218837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0993c1870aa7438e9889d60fc3f644a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:30.245307 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1179/2350] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:29 2022] DELETE /identity/v3/users/0993c1870aa7438e9889d60fc3f644a4 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:30.249209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c84c-4f50-4739-95e2-4ade0ad8d93f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:30.249749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c84c-4f50-4739-95e2-4ade0ad8d93f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:30.249749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c84c-4f50-4739-95e2-4ade0ad8d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:30.287662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2887c84c-4f50-4739-95e2-4ade0ad8d93f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:30.290389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2887c84c-4f50-4739-95e2-4ade0ad8d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:30.536965 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1172/2351] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:30.549868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:30.552285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:30.734713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36357854-30e4-4968-ba6d-0de33a7472a5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:30.748515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e62f0b-c719-48bd-9073-8e36d7916274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:30.761278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62f0b-c719-48bd-9073-8e36d7916274 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:30.775368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62f0b-c719-48bd-9073-8e36d7916274 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:30.777706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62f0b-c719-48bd-9073-8e36d7916274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:30.818783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e62f0b-c719-48bd-9073-8e36d7916274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:30.821028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e62f0b-c719-48bd-9073-8e36d7916274 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:30.857047 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1180/2352] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:32.247215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c84c-4f50-4739-95e2-4ade0ad8d93f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:32.248744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2887c84c-4f50-4739-95e2-4ade0ad8d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:32.274341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c84c-4f50-4739-95e2-4ade0ad8d93f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:32.287100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:32.289014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:32.291278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:32.291729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] PATH_INFO: `/v3/projects/daeb4b8374514419b145bb656f028168` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:32.296336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daeb4b8374514419b145bb656f028168)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:32.303186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:32.416791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daeb4b8374514419b145bb656f028168', 'request_id': 'req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.434591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daeb4b8374514419b145bb656f028168', 'request_id': 'req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.449525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daeb4b8374514419b145bb656f028168', 'request_id': 'req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.453034 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:32.494880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] The token cache is being invalidate because project daeb4b8374514419b145bb656f028168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:32.496487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.497478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.511809 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1173/2353] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:32 2022] DELETE /identity/v3/projects/daeb4b8374514419b145bb656f028168 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:32.513533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e62f0b-c719-48bd-9073-8e36d7916274 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:32.528066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e62f0b-c719-48bd-9073-8e36d7916274 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:32.567737 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:32.676910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:32.677773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:32.678265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:32.678638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] PATH_INFO: `/v3/users/dc9adecc50ef426b985fbade7bf02030` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:32.679949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9adecc50ef426b985fbade7bf02030)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:32.682500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:32.744021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9adecc50ef426b985fbade7bf02030'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.763148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9adecc50ef426b985fbade7bf02030'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.778862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9adecc50ef426b985fbade7bf02030'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.790286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9adecc50ef426b985fbade7bf02030'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.791723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a001443c-26a8-4d5c-9841-877118adf8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9adecc50ef426b985fbade7bf02030'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:32.800459 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1181/2354] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:32 2022] DELETE /identity/v3/users/dc9adecc50ef426b985fbade7bf02030 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:33.355670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:33.362581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:33.421589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa7a95-5037-4547-bfb1-216fc4e10bb4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:33.702627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:33.703617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:33.704184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:33.705926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] PATH_INFO: `/v3/projects/a2c53ab55dec41888ee9abb2aa615aa7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:33.713945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c53ab55dec41888ee9abb2aa615aa7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:33.716648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:33.885190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c53ab55dec41888ee9abb2aa615aa7', 'request_id': 'req-fcb04f91-655a-454d-88ed-3b12bfa757d9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:33.897263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c53ab55dec41888ee9abb2aa615aa7', 'request_id': 'req-fcb04f91-655a-454d-88ed-3b12bfa757d9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:33.909631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c53ab55dec41888ee9abb2aa615aa7', 'request_id': 'req-fcb04f91-655a-454d-88ed-3b12bfa757d9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:33.984008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] The token cache is being invalidate because project a2c53ab55dec41888ee9abb2aa615aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:33.987557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:33.988950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fcb04f91-655a-454d-88ed-3b12bfa757d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:34.000117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13550-baf0-4c17-934d-364e14c402a3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:34.001234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13550-baf0-4c17-934d-364e14c402a3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:34.001933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13550-baf0-4c17-934d-364e14c402a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:34.005978 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1174/2355] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:33 2022] DELETE /identity/v3/projects/a2c53ab55dec41888ee9abb2aa615aa7 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:34.076938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cce13550-baf0-4c17-934d-364e14c402a3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:34.078592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cce13550-baf0-4c17-934d-364e14c402a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:34.270075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1345e5-39b6-4222-99c0-2002b8ef4f1d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:34.270778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1345e5-39b6-4222-99c0-2002b8ef4f1d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:34.271267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1345e5-39b6-4222-99c0-2002b8ef4f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:34.287453 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1182/2356] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:34.317997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7e1345e5-39b6-4222-99c0-2002b8ef4f1d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:34.326116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7e1345e5-39b6-4222-99c0-2002b8ef4f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:34.370267 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1175/2357] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:34.377381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce13550-baf0-4c17-934d-364e14c402a3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:34.399984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce13550-baf0-4c17-934d-364e14c402a3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:34.420750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022521f-33d2-4d74-b962-0eb9012b71f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:34.421803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022521f-33d2-4d74-b962-0eb9012b71f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:34.422308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022521f-33d2-4d74-b962-0eb9012b71f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:34.422781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022521f-33d2-4d74-b962-0eb9012b71f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:34.425946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022521f-33d2-4d74-b962-0eb9012b71f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:47:34.426580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022521f-33d2-4d74-b962-0eb9012b71f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:34.428671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022521f-33d2-4d74-b962-0eb9012b71f1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:34.507347 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1183/2358] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:34.510057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1345e5-39b6-4222-99c0-2002b8ef4f1d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:34.521921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1345e5-39b6-4222-99c0-2002b8ef4f1d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:34.549784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1a0c-2922-4daa-bdac-86af5db6b895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:34.553917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1a0c-2922-4daa-bdac-86af5db6b895 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:34.556135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1a0c-2922-4daa-bdac-86af5db6b895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:34.557184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1a0c-2922-4daa-bdac-86af5db6b895 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:34.564492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac1a0c-2922-4daa-bdac-86af5db6b895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:34.571879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac1a0c-2922-4daa-bdac-86af5db6b895 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:34.638868 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1176/2359] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:34 2022] POST /identity/v3/projects => generated 397 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:34.643511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022521f-33d2-4d74-b962-0eb9012b71f1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:34.664345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022521f-33d2-4d74-b962-0eb9012b71f1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:34.681380 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:34.897862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ed84-efd1-4423-9f74-3c9c86a8bac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:34.899749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ed84-efd1-4423-9f74-3c9c86a8bac3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:34.900382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ed84-efd1-4423-9f74-3c9c86a8bac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:34.901008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ed84-efd1-4423-9f74-3c9c86a8bac3 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:34.902082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608ed84-efd1-4423-9f74-3c9c86a8bac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:34.916216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608ed84-efd1-4423-9f74-3c9c86a8bac3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:34.995428 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1184/2360] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:34 2022] POST /identity/v3/users => generated 299 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:34.996751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1a0c-2922-4daa-bdac-86af5db6b895 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:35.011020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1a0c-2922-4daa-bdac-86af5db6b895 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:35.023408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d639-71ab-4676-8615-ed3a0f99b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:35.024126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d639-71ab-4676-8615-ed3a0f99b00b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:35.024567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d639-71ab-4676-8615-ed3a0f99b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:35.024950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d639-71ab-4676-8615-ed3a0f99b00b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:35.025702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5d639-71ab-4676-8615-ed3a0f99b00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:35.034162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5d639-71ab-4676-8615-ed3a0f99b00b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:35.074506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ed84-efd1-4423-9f74-3c9c86a8bac3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:35.088983 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1177/2361] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:35.117830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ed84-efd1-4423-9f74-3c9c86a8bac3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:35.133410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b1baf-a6a1-4f66-bd65-71a6da6e12c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:35.138870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b1baf-a6a1-4f66-bd65-71a6da6e12c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:35.142703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b1baf-a6a1-4f66-bd65-71a6da6e12c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:35.143178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b1baf-a6a1-4f66-bd65-71a6da6e12c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:35.145646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b1baf-a6a1-4f66-bd65-71a6da6e12c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:35.154019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b1baf-a6a1-4f66-bd65-71a6da6e12c9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:35.176953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d639-71ab-4676-8615-ed3a0f99b00b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:35.192717 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1185/2362] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:35.193068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d639-71ab-4676-8615-ed3a0f99b00b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:35.209646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143e122-cbf4-43cd-8b08-8a57ad580504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:35.210176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143e122-cbf4-43cd-8b08-8a57ad580504 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:35.210549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143e122-cbf4-43cd-8b08-8a57ad580504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:35.210917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143e122-cbf4-43cd-8b08-8a57ad580504 admin admin] PATH_INFO: `/v3/projects/4c9189bd828c41a88fe9333fb5ec9351/users/5d0158da7efc485ebd6a1e1db617b5e7/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:35.229530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143e122-cbf4-43cd-8b08-8a57ad580504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9189bd828c41a88fe9333fb5ec9351, user_id=5d0158da7efc485ebd6a1e1db617b5e7, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:35.232403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143e122-cbf4-43cd-8b08-8a57ad580504 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:35.280223 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1178/2363] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:35 2022] PUT /identity/v3/projects/4c9189bd828c41a88fe9333fb5ec9351/users/5d0158da7efc485ebd6a1e1db617b5e7/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:35.286321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290902-483e-4c20-8272-a89b63766c77 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:35.286955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290902-483e-4c20-8272-a89b63766c77 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:35.287457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290902-483e-4c20-8272-a89b63766c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:35.326276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-02290902-483e-4c20-8272-a89b63766c77 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:35.328946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-02290902-483e-4c20-8272-a89b63766c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:35.595112 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1186/2364] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:35.784972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143e122-cbf4-43cd-8b08-8a57ad580504 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:35.789556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a143e122-cbf4-43cd-8b08-8a57ad580504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:36.003702 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:36.180574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143e122-cbf4-43cd-8b08-8a57ad580504 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:36.194219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb99da-7f35-4a61-bd55-5946621819c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:36.195166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb99da-7f35-4a61-bd55-5946621819c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:36.195432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb99da-7f35-4a61-bd55-5946621819c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:36.195919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb99da-7f35-4a61-bd55-5946621819c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:36.226352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb99da-7f35-4a61-bd55-5946621819c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:36.229993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb99da-7f35-4a61-bd55-5946621819c3 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:36.258927 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1179/2365] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:41.308402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbef3a-756a-4743-9ee8-9a31501ef4ff None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:41.310290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbef3a-756a-4743-9ee8-9a31501ef4ff None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:41.310742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbef3a-756a-4743-9ee8-9a31501ef4ff None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:41.314596 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1187/2366] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:47:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:47:41.336584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0469-85ea-43e5-87e2-118d9996919e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:41.338399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0469-85ea-43e5-87e2-118d9996919e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:41.339439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0469-85ea-43e5-87e2-118d9996919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:41.399163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9e3f0469-85ea-43e5-87e2-118d9996919e None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:41.402369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9e3f0469-85ea-43e5-87e2-118d9996919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:41.707864 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1180/2367] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:47:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:41.734224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbef3a-756a-4743-9ee8-9a31501ef4ff None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:41.769501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbef3a-756a-4743-9ee8-9a31501ef4ff None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:41.786056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05db3e5-b1f1-439a-a181-c62257b42b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:41.787094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05db3e5-b1f1-439a-a181-c62257b42b0e service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:41.787381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05db3e5-b1f1-439a-a181-c62257b42b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:41.787664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05db3e5-b1f1-439a-a181-c62257b42b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:41.799150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb941534-6976-4858-a39a-6e29cc4e0186 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:41.800101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb941534-6976-4858-a39a-6e29cc4e0186 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:41.800385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb941534-6976-4858-a39a-6e29cc4e0186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:41.855656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05db3e5-b1f1-439a-a181-c62257b42b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:41.863457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05db3e5-b1f1-439a-a181-c62257b42b0e service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:41.872007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-eb941534-6976-4858-a39a-6e29cc4e0186 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:41.874563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eb941534-6976-4858-a39a-6e29cc4e0186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:41.909257 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1188/2368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:42.060779 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1181/2369] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:47:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:42.169498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05db3e5-b1f1-439a-a181-c62257b42b0e service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:42.171227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c05db3e5-b1f1-439a-a181-c62257b42b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:42.370022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05db3e5-b1f1-439a-a181-c62257b42b0e service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:42.377494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc282-0c25-43c2-a27d-8db38008e3ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:42.378433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc282-0c25-43c2-a27d-8db38008e3ff service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:42.378874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc282-0c25-43c2-a27d-8db38008e3ff service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:42.379324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc282-0c25-43c2-a27d-8db38008e3ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:42.390805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc282-0c25-43c2-a27d-8db38008e3ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:42.394906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc282-0c25-43c2-a27d-8db38008e3ff service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:42.420309 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1189/2370] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:47:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:47:44.006107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb941534-6976-4858-a39a-6e29cc4e0186 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:44.008800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eb941534-6976-4858-a39a-6e29cc4e0186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:44.081924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb941534-6976-4858-a39a-6e29cc4e0186 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:44.133458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:44.138972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:44.141460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:44.143049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] PATH_INFO: `/v3/users/6aeeab8af64a4a76aba0b46330569207` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:44.148753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aeeab8af64a4a76aba0b46330569207)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:44.175338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:44.358103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aeeab8af64a4a76aba0b46330569207'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:44.373288 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:44.384351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aeeab8af64a4a76aba0b46330569207'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:44.398532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aeeab8af64a4a76aba0b46330569207'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:44.420435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aeeab8af64a4a76aba0b46330569207'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:44.422639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aeeab8af64a4a76aba0b46330569207'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:44.437479 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1182/2371] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:44 2022] DELETE /identity/v3/users/6aeeab8af64a4a76aba0b46330569207 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:46.272993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc282-0c25-43c2-a27d-8db38008e3ff service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:46.312242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc282-0c25-43c2-a27d-8db38008e3ff service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:46.338040 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:46.536725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:46.541719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:46.543021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:46.543021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] PATH_INFO: `/v3/projects/243c4232ad0243a289bd14fa4823ac71` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:46.543706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=243c4232ad0243a289bd14fa4823ac71)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:46.545694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:46.665415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243c4232ad0243a289bd14fa4823ac71', 'request_id': 'req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:46.690114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243c4232ad0243a289bd14fa4823ac71', 'request_id': 'req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:46.726156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243c4232ad0243a289bd14fa4823ac71', 'request_id': 'req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:46.756680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] The token cache is being invalidate because project 243c4232ad0243a289bd14fa4823ac71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:46.757733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:46.760259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:46.767923 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1190/2372] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:46 2022] DELETE /identity/v3/projects/243c4232ad0243a289bd14fa4823ac71 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:46.768922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:46.770964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:46.807609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f4399-7150-4700-b266-43a97ff0c80f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:47.010555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:47.011151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:47.011426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:47.011704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] PATH_INFO: `/v3/users/cc7a070200d94d2f80db75cefb33c841` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:47.013059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7a070200d94d2f80db75cefb33c841)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:47.015140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:47.142762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7a070200d94d2f80db75cefb33c841'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:47.179817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7a070200d94d2f80db75cefb33c841'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:47.195903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7a070200d94d2f80db75cefb33c841'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:47.222842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7a070200d94d2f80db75cefb33c841'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:47.223968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a3fe9516-adc0-4292-aac2-bafd39eee4b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7a070200d94d2f80db75cefb33c841'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:47.233673 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1183/2373] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:46 2022] DELETE /identity/v3/users/cc7a070200d94d2f80db75cefb33c841 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:47:50.288488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:50.290928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:50.375714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c55fb-a7af-49fc-a89a-cfbe0cf88a8f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:50.562234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:50.562876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:50.563936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:50.564437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] PATH_INFO: `/v3/projects/05160ab4f4b04e24b016240b33e45c5e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:50.573692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05160ab4f4b04e24b016240b33e45c5e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:50.579586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:50.753415 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:50.771292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05160ab4f4b04e24b016240b33e45c5e', 'request_id': 'req-6c308922-c447-4e61-86f8-cd2b05ed3499'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:50.789265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05160ab4f4b04e24b016240b33e45c5e', 'request_id': 'req-6c308922-c447-4e61-86f8-cd2b05ed3499'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:50.803454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05160ab4f4b04e24b016240b33e45c5e', 'request_id': 'req-6c308922-c447-4e61-86f8-cd2b05ed3499'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:50.840145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] The token cache is being invalidate because project 05160ab4f4b04e24b016240b33e45c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:50.840653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:50.841723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6c308922-c447-4e61-86f8-cd2b05ed3499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:50.845227 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1191/2374] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:50 2022] DELETE /identity/v3/projects/05160ab4f4b04e24b016240b33e45c5e => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:47:50.849946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3662-3661-4cf2-bbf2-9d9986c33b13 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:50.850456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3662-3661-4cf2-bbf2-9d9986c33b13 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:50.850717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3662-3661-4cf2-bbf2-9d9986c33b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:50.899896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-716a3662-3661-4cf2-bbf2-9d9986c33b13 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:50.901352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-716a3662-3661-4cf2-bbf2-9d9986c33b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:51.170086 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:51.286817 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1184/2375] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:51.294398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928306bb-8525-483e-b56d-796ad084da0c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:51.295191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928306bb-8525-483e-b56d-796ad084da0c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:51.295734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928306bb-8525-483e-b56d-796ad084da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:51.350000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-928306bb-8525-483e-b56d-796ad084da0c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:51.352161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-928306bb-8525-483e-b56d-796ad084da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:51.377080 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1192/2376] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:51.381513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a3662-3661-4cf2-bbf2-9d9986c33b13 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:51.428073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a3662-3661-4cf2-bbf2-9d9986c33b13 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:51.454705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b46ef3-84a6-443f-a2d5-27c69965cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:51.458321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b46ef3-84a6-443f-a2d5-27c69965cf00 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:51.458832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b46ef3-84a6-443f-a2d5-27c69965cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:51.460974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b46ef3-84a6-443f-a2d5-27c69965cf00 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:51.467035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b46ef3-84a6-443f-a2d5-27c69965cf00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:47:51.470874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b46ef3-84a6-443f-a2d5-27c69965cf00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:51.475942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b46ef3-84a6-443f-a2d5-27c69965cf00 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:51.514007 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1185/2377] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:51.518181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928306bb-8525-483e-b56d-796ad084da0c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:51.533227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928306bb-8525-483e-b56d-796ad084da0c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:51.542071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2a170-938a-426a-8b48-20fd3ddae52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:51.544062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a170-938a-426a-8b48-20fd3ddae52e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:51.547617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a170-938a-426a-8b48-20fd3ddae52e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:51.548830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a170-938a-426a-8b48-20fd3ddae52e admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:51.549973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2a170-938a-426a-8b48-20fd3ddae52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:51.553075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2a170-938a-426a-8b48-20fd3ddae52e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:51.638591 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1193/2378] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:51 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:51.644911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b46ef3-84a6-443f-a2d5-27c69965cf00 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:51.663262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b46ef3-84a6-443f-a2d5-27c69965cf00 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:51.785775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f751e-58d8-46f6-9dc1-b625a0c0c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:51.786645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f751e-58d8-46f6-9dc1-b625a0c0c46a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:51.786981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f751e-58d8-46f6-9dc1-b625a0c0c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:51.787423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f751e-58d8-46f6-9dc1-b625a0c0c46a admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:51.788088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f751e-58d8-46f6-9dc1-b625a0c0c46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:51.791318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f751e-58d8-46f6-9dc1-b625a0c0c46a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:51.839530 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1186/2379] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:51 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:51.841440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2a170-938a-426a-8b48-20fd3ddae52e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:51.855626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2a170-938a-426a-8b48-20fd3ddae52e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:51.862289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0e6f-835d-4057-889a-92ecfba3aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:51.862289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0e6f-835d-4057-889a-92ecfba3aa10 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:51.862804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0e6f-835d-4057-889a-92ecfba3aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:51.862804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0e6f-835d-4057-889a-92ecfba3aa10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:51.863534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff0e6f-835d-4057-889a-92ecfba3aa10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:51.870518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff0e6f-835d-4057-889a-92ecfba3aa10 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:51.892857 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1194/2380] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:51.894675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f751e-58d8-46f6-9dc1-b625a0c0c46a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:51.916021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f751e-58d8-46f6-9dc1-b625a0c0c46a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:51.921398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d7a74-70cd-450d-bed0-ffca324e5048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:51.922058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d7a74-70cd-450d-bed0-ffca324e5048 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:51.922329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d7a74-70cd-450d-bed0-ffca324e5048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:51.923965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d7a74-70cd-450d-bed0-ffca324e5048 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:51.929277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d7a74-70cd-450d-bed0-ffca324e5048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:51.931019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d7a74-70cd-450d-bed0-ffca324e5048 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:51.950995 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1187/2381] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:51.953373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0e6f-835d-4057-889a-92ecfba3aa10 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:51.971439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0e6f-835d-4057-889a-92ecfba3aa10 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:51.978579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803ba1-3c58-4f39-a8a7-f0470a6510f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:51.980320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803ba1-3c58-4f39-a8a7-f0470a6510f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:51.980594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803ba1-3c58-4f39-a8a7-f0470a6510f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:51.980913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803ba1-3c58-4f39-a8a7-f0470a6510f4 admin admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16/users/cda5affea11b414e953a847d7fa8ae5e/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:52.024999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f803ba1-3c58-4f39-a8a7-f0470a6510f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b94eaa25a6419d8b445a9a11a71e16, user_id=cda5affea11b414e953a847d7fa8ae5e, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:52.030047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f803ba1-3c58-4f39-a8a7-f0470a6510f4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:52.069791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1195/2382] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:51 2022] PUT /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16/users/cda5affea11b414e953a847d7fa8ae5e/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:52.168611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6e3ad-5c22-4b83-96eb-103560ccd101 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:52.168932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6e3ad-5c22-4b83-96eb-103560ccd101 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:52.169215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6e3ad-5c22-4b83-96eb-103560ccd101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:52.252986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b8c6e3ad-5c22-4b83-96eb-103560ccd101 None None] MFA Rules not processed for user `cda5affea11b414e953a847d7fa8ae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:52.257257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b8c6e3ad-5c22-4b83-96eb-103560ccd101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:52.522909 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1188/2383] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:52.529269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803ba1-3c58-4f39-a8a7-f0470a6510f4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:52.901103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803ba1-3c58-4f39-a8a7-f0470a6510f4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:52.946339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c73009-1a45-4bec-85ef-a8c925fd21ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:52.947781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c73009-1a45-4bec-85ef-a8c925fd21ce admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:52.950360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c73009-1a45-4bec-85ef-a8c925fd21ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:52.953893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c73009-1a45-4bec-85ef-a8c925fd21ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:52.955449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c73009-1a45-4bec-85ef-a8c925fd21ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:52.968562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c73009-1a45-4bec-85ef-a8c925fd21ce admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:53.059044 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1196/2384] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:52 2022] POST /identity/v3/projects => generated 383 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:47:53.064654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6e3ad-5c22-4b83-96eb-103560ccd101 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:53.083683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6e3ad-5c22-4b83-96eb-103560ccd101 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:53.202355 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:53.242696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ce197-54af-4c12-aabf-9a8897375151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:53.244185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce197-54af-4c12-aabf-9a8897375151 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:53.244950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce197-54af-4c12-aabf-9a8897375151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:53.245936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce197-54af-4c12-aabf-9a8897375151 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:53.247064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ce197-54af-4c12-aabf-9a8897375151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:53.253179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ce197-54af-4c12-aabf-9a8897375151 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:53.300465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c73009-1a45-4bec-85ef-a8c925fd21ce admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:53.301589 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1189/2385] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:53 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:53.330972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c73009-1a45-4bec-85ef-a8c925fd21ce admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:53.342936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb10a7-167f-4243-a50f-5434d21bfb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:53.345040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb10a7-167f-4243-a50f-5434d21bfb03 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:53.345703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb10a7-167f-4243-a50f-5434d21bfb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:53.347054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb10a7-167f-4243-a50f-5434d21bfb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:53.348068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb10a7-167f-4243-a50f-5434d21bfb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:53.350692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb10a7-167f-4243-a50f-5434d21bfb03 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:53.390128 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1197/2386] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:47:53.396296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ce197-54af-4c12-aabf-9a8897375151 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:53.419390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ce197-54af-4c12-aabf-9a8897375151 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:53.427988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567aa00-1c44-4630-8a41-86b376d9554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:53.428961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567aa00-1c44-4630-8a41-86b376d9554b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:53.429364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567aa00-1c44-4630-8a41-86b376d9554b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:53.429752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567aa00-1c44-4630-8a41-86b376d9554b admin admin] PATH_INFO: `/v3/projects/43c048fec3d94f3389e9bda290edcf6d/users/a6f0cc5aa6f3480ba7dd17b38fc0b474/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:53.490712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567aa00-1c44-4630-8a41-86b376d9554b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c048fec3d94f3389e9bda290edcf6d, user_id=a6f0cc5aa6f3480ba7dd17b38fc0b474, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:53.496501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567aa00-1c44-4630-8a41-86b376d9554b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:53.564274 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1190/2387] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:53 2022] PUT /identity/v3/projects/43c048fec3d94f3389e9bda290edcf6d/users/a6f0cc5aa6f3480ba7dd17b38fc0b474/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:47:53.566166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb10a7-167f-4243-a50f-5434d21bfb03 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:53.588031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb10a7-167f-4243-a50f-5434d21bfb03 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:53.714951 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:53.816187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288b39a-e49f-485c-8a75-fcc0cc2c5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:53.817872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288b39a-e49f-485c-8a75-fcc0cc2c5c50 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:53.818087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288b39a-e49f-485c-8a75-fcc0cc2c5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:53.818696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288b39a-e49f-485c-8a75-fcc0cc2c5c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:53.820528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288b39a-e49f-485c-8a75-fcc0cc2c5c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:53.823751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288b39a-e49f-485c-8a75-fcc0cc2c5c50 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:53.908721 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1198/2388] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:53.911169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567aa00-1c44-4630-8a41-86b376d9554b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:53.983971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567aa00-1c44-4630-8a41-86b376d9554b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:54.019065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea900e-0324-4feb-b95a-51ecef99163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:54.022602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea900e-0324-4feb-b95a-51ecef99163f admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:54.025741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea900e-0324-4feb-b95a-51ecef99163f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:54.038483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea900e-0324-4feb-b95a-51ecef99163f admin admin] PATH_INFO: `/v3/projects/43c048fec3d94f3389e9bda290edcf6d/users/a6f0cc5aa6f3480ba7dd17b38fc0b474/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:54.074575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea900e-0324-4feb-b95a-51ecef99163f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c048fec3d94f3389e9bda290edcf6d, user_id=a6f0cc5aa6f3480ba7dd17b38fc0b474, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:54.095837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea900e-0324-4feb-b95a-51ecef99163f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:54.139474 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1191/2389] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:53 2022] PUT /identity/v3/projects/43c048fec3d94f3389e9bda290edcf6d/users/a6f0cc5aa6f3480ba7dd17b38fc0b474/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:54.143991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d353-495b-4f16-91a8-8524911521b6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:54.144284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d353-495b-4f16-91a8-8524911521b6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:54.144719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d353-495b-4f16-91a8-8524911521b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:54.231380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-79c8d353-495b-4f16-91a8-8524911521b6 None None] MFA Rules not processed for user `a6f0cc5aa6f3480ba7dd17b38fc0b474`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:54.238179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-79c8d353-495b-4f16-91a8-8524911521b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:54.450311 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1199/2390] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:54.467379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea900e-0324-4feb-b95a-51ecef99163f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:54.476715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-32ea900e-0324-4feb-b95a-51ecef99163f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:54.742958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea900e-0324-4feb-b95a-51ecef99163f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:54.751324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108de1e-07e9-42fe-8399-af053dfdb9ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:54.752090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108de1e-07e9-42fe-8399-af053dfdb9ba service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:54.753338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108de1e-07e9-42fe-8399-af053dfdb9ba service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:54.754124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108de1e-07e9-42fe-8399-af053dfdb9ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:54.768199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108de1e-07e9-42fe-8399-af053dfdb9ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:54.770432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108de1e-07e9-42fe-8399-af053dfdb9ba service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:54.805366 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1192/2391] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:54.821627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52835a-6f56-40fd-86c2-6a1a018af692 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:54.822215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52835a-6f56-40fd-86c2-6a1a018af692 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:54.822215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52835a-6f56-40fd-86c2-6a1a018af692 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:54.823867 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1200/2392] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:47:54.838190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108de1e-07e9-42fe-8399-af053dfdb9ba service nova] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:47:54.866244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108de1e-07e9-42fe-8399-af053dfdb9ba service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:54.894430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108de1e-07e9-42fe-8399-af053dfdb9ba service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:54.908242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6f0cc5aa6f3480ba7dd17b38fc0b474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c048fec3d94f3389e9bda290edcf6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:54.909703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:54.910344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:54.910780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:54.913351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:54.916376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:54.920023 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1193/2393] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:47:54 2022] GET /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 381 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:55.510245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896242c-bb0e-4bd2-9c53-37d1779c2119 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:55.510824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896242c-bb0e-4bd2-9c53-37d1779c2119 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:55.512642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896242c-bb0e-4bd2-9c53-37d1779c2119 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:55.516086 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1201/2394] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:47:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:47:55.525531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:47:55.531354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:55.655219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:55.708019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8e6ee-81c7-49a2-aa29-d053e11e38c9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:55.747202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949f514-cd81-4b3d-92c4-482b7133ce65 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6f0cc5aa6f3480ba7dd17b38fc0b474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c048fec3d94f3389e9bda290edcf6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:55.747891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949f514-cd81-4b3d-92c4-482b7133ce65 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:55.748175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949f514-cd81-4b3d-92c4-482b7133ce65 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:55.753071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949f514-cd81-4b3d-92c4-482b7133ce65 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:55.755432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949f514-cd81-4b3d-92c4-482b7133ce65 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:55.760029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949f514-cd81-4b3d-92c4-482b7133ce65 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:55.762055 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1194/2395] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:47:55 2022] GET /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 381 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:55.956783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95f44-5847-4324-8baa-5123396ac1d7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:55.957300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95f44-5847-4324-8baa-5123396ac1d7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:55.957403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95f44-5847-4324-8baa-5123396ac1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:56.030392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-30e95f44-5847-4324-8baa-5123396ac1d7 None None] MFA Rules not processed for user `cda5affea11b414e953a847d7fa8ae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:56.034175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-30e95f44-5847-4324-8baa-5123396ac1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:56.249378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9948b-c8a3-4002-bd6e-845017ccf6d7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:56.250049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9948b-c8a3-4002-bd6e-845017ccf6d7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:56.250727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9948b-c8a3-4002-bd6e-845017ccf6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:56.261622 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1202/2396] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:56.277553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e95f44-5847-4324-8baa-5123396ac1d7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:56.324398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e95f44-5847-4324-8baa-5123396ac1d7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:56.342919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-85a9948b-c8a3-4002-bd6e-845017ccf6d7 None None] MFA Rules not processed for user `5d0158da7efc485ebd6a1e1db617b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:56.346315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85a9948b-c8a3-4002-bd6e-845017ccf6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:56.352267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f660f-b9b9-42c7-8d18-fba6b17b715c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:56.354891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f660f-b9b9-42c7-8d18-fba6b17b715c service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:56.359040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f660f-b9b9-42c7-8d18-fba6b17b715c service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:56.359576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f660f-b9b9-42c7-8d18-fba6b17b715c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:56.416343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f660f-b9b9-42c7-8d18-fba6b17b715c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:56.418653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f660f-b9b9-42c7-8d18-fba6b17b715c service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:56.465504 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1203/2397] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:47:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:47:56.566178 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:56.615168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f660f-b9b9-42c7-8d18-fba6b17b715c service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:56.617222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db2f660f-b9b9-42c7-8d18-fba6b17b715c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:56.633056 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1195/2398] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:47:56.840210 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:56.861317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9948b-c8a3-4002-bd6e-845017ccf6d7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:56.869091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85a9948b-c8a3-4002-bd6e-845017ccf6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:56.889772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f660f-b9b9-42c7-8d18-fba6b17b715c service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:56.896315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e00a0-af70-4a22-ab03-a8f817ec7d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:56.896990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e00a0-af70-4a22-ab03-a8f817ec7d95 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:56.897274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e00a0-af70-4a22-ab03-a8f817ec7d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:56.918692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e00a0-af70-4a22-ab03-a8f817ec7d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:56.919889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e00a0-af70-4a22-ab03-a8f817ec7d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:56.928320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e00a0-af70-4a22-ab03-a8f817ec7d95 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:56.929743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9948b-c8a3-4002-bd6e-845017ccf6d7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:56.976668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:56.977364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:56.977857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:56.978341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] PATH_INFO: `/v3/users/c68fb32e68194933b6c69383572c27b6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:57.001678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68fb32e68194933b6c69383572c27b6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:57.012376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:57.019001 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1204/2399] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:56 2022] POST /identity/v3/projects => generated 395 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:47:57.026141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e00a0-af70-4a22-ab03-a8f817ec7d95 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:57.296322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68fb32e68194933b6c69383572c27b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:57.335814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68fb32e68194933b6c69383572c27b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:57.355054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68fb32e68194933b6c69383572c27b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:57.361428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e00a0-af70-4a22-ab03-a8f817ec7d95 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:57.385619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68fb32e68194933b6c69383572c27b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:57.387193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68fb32e68194933b6c69383572c27b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:57.398907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93743235-c9f7-4d11-a69d-1fbceb198b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:57.404412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93743235-c9f7-4d11-a69d-1fbceb198b71 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:57.407930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93743235-c9f7-4d11-a69d-1fbceb198b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:57.408384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93743235-c9f7-4d11-a69d-1fbceb198b71 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:57.413704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93743235-c9f7-4d11-a69d-1fbceb198b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:57.416532 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1196/2400] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:56 2022] DELETE /identity/v3/users/c68fb32e68194933b6c69383572c27b6 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:57.423814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93743235-c9f7-4d11-a69d-1fbceb198b71 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:57.488484 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1205/2401] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:47:57 2022] POST /identity/v3/users => generated 304 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:47:57.491708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:57.494113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:57.793623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa5676-837e-42b6-b19e-9533d57d197e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:57.821167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fcf7d-b647-4230-9d00-26e1c6128cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:57.821804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fcf7d-b647-4230-9d00-26e1c6128cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:57.822949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fcf7d-b647-4230-9d00-26e1c6128cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:57.822949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fcf7d-b647-4230-9d00-26e1c6128cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:57.823157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fcf7d-b647-4230-9d00-26e1c6128cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:57.824602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fcf7d-b647-4230-9d00-26e1c6128cf0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:57.858577 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1197/2402] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:57.858723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93743235-c9f7-4d11-a69d-1fbceb198b71 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:57.890035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93743235-c9f7-4d11-a69d-1fbceb198b71 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:57.907696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b679-9b80-44da-8068-4478cb2089f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:57.908401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b679-9b80-44da-8068-4478cb2089f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:57.915375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b679-9b80-44da-8068-4478cb2089f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:57.915764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b679-9b80-44da-8068-4478cb2089f7 admin admin] PATH_INFO: `/v3/projects/716e9330890d4c57a0d13b8bda0b7a58/users/b8f3bef1995348c5a70b0f3388f96541/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:57.982977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78b679-9b80-44da-8068-4478cb2089f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=716e9330890d4c57a0d13b8bda0b7a58, user_id=b8f3bef1995348c5a70b0f3388f96541, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:57.990949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78b679-9b80-44da-8068-4478cb2089f7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:58.008697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fcf7d-b647-4230-9d00-26e1c6128cf0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:58.011763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a47fcf7d-b647-4230-9d00-26e1c6128cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:58.038727 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1206/2403] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:57 2022] PUT /identity/v3/projects/716e9330890d4c57a0d13b8bda0b7a58/users/b8f3bef1995348c5a70b0f3388f96541/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:47:58.055252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b679-9b80-44da-8068-4478cb2089f7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:58.058082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fcf7d-b647-4230-9d00-26e1c6128cf0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:58.200721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b679-9b80-44da-8068-4478cb2089f7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:58.207257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae253ad-8031-48e8-930e-7288797b4d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:58.208092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae253ad-8031-48e8-930e-7288797b4d32 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:58.208437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae253ad-8031-48e8-930e-7288797b4d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:58.208833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae253ad-8031-48e8-930e-7288797b4d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:58.209758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae253ad-8031-48e8-930e-7288797b4d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:58.212091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae253ad-8031-48e8-930e-7288797b4d32 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:58.232018 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1207/2404] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:47:58.235597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7a6c-fc7a-49b7-af72-e95c802ba688 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:58.236157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7a6c-fc7a-49b7-af72-e95c802ba688 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:58.236611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7a6c-fc7a-49b7-af72-e95c802ba688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:58.270136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-82ea7a6c-fc7a-49b7-af72-e95c802ba688 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:58.271736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-82ea7a6c-fc7a-49b7-af72-e95c802ba688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:58.307973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:58.308663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:58.308961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:58.309245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] PATH_INFO: `/v3/projects/796e6e3631804c6db3fae3e40e4702fb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:58.319073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=796e6e3631804c6db3fae3e40e4702fb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:58.328046 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:58.331024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:58.364588 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:58.447284 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1208/2405] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:47:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:58.451560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7a6c-fc7a-49b7-af72-e95c802ba688 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:58.483889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7a6c-fc7a-49b7-af72-e95c802ba688 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:58.499954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796e6e3631804c6db3fae3e40e4702fb', 'request_id': 'req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:58.513171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796e6e3631804c6db3fae3e40e4702fb', 'request_id': 'req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:58.525859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796e6e3631804c6db3fae3e40e4702fb', 'request_id': 'req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:58.550686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] The token cache is being invalidate because project 796e6e3631804c6db3fae3e40e4702fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:58.553722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:58.555903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:58.560497 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1198/2406] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:58 2022] DELETE /identity/v3/projects/796e6e3631804c6db3fae3e40e4702fb => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:47:58.561947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:58.568396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:58.659641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c91785-b4e9-45f0-947d-0ef69a5ebdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:58.660336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c91785-b4e9-45f0-947d-0ef69a5ebdea admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:58.660614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c91785-b4e9-45f0-947d-0ef69a5ebdea admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:58.660912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c91785-b4e9-45f0-947d-0ef69a5ebdea admin admin] PATH_INFO: `/v3/projects/716e9330890d4c57a0d13b8bda0b7a58/users/b8f3bef1995348c5a70b0f3388f96541/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:58.669840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c91785-b4e9-45f0-947d-0ef69a5ebdea admin admin] RBAC: Authorizing `identity:create_grant(project_id=716e9330890d4c57a0d13b8bda0b7a58, user_id=b8f3bef1995348c5a70b0f3388f96541, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:58.672684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c91785-b4e9-45f0-947d-0ef69a5ebdea admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:58.716009 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1209/2407] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:47:58 2022] PUT /identity/v3/projects/716e9330890d4c57a0d13b8bda0b7a58/users/b8f3bef1995348c5a70b0f3388f96541/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:58.717179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84cb6e-bc55-4158-ad80-83391763e90d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:58.717524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84cb6e-bc55-4158-ad80-83391763e90d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:58.717801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84cb6e-bc55-4158-ad80-83391763e90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:58.784885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7c84cb6e-bc55-4158-ad80-83391763e90d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:58.786338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c84cb6e-bc55-4158-ad80-83391763e90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:58.940400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5f867-53eb-4965-a1ba-b50d8d79bb7f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:59.037772 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1210/2408] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:59.038321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bd498-c7a3-435c-845e-9ffd350802cd None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:59.038618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bd498-c7a3-435c-845e-9ffd350802cd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:59.038901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bd498-c7a3-435c-845e-9ffd350802cd None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:59.040674 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1211/2409] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:47:59.052036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:59.052320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:59.052597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:59.134221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:47:59.135523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:59.171476 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1212/2410] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:47:59.173299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:47:59.189576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:59.316420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40061f4-4b3e-4232-8b62-c53f2c82746c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:59.317169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40061f4-4b3e-4232-8b62-c53f2c82746c service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:59.317452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40061f4-4b3e-4232-8b62-c53f2c82746c service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:59.317819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40061f4-4b3e-4232-8b62-c53f2c82746c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:59.349804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f40061f4-4b3e-4232-8b62-c53f2c82746c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:59.455445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:59.458735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:59.502976 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:59.548296 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:59.609828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40061f4-4b3e-4232-8b62-c53f2c82746c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:59.612221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40061f4-4b3e-4232-8b62-c53f2c82746c service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:59.639235 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1199/2411] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:47:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1078 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:47:59.643694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40061f4-4b3e-4232-8b62-c53f2c82746c service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:59.676371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566d103-626e-411a-83bd-9c4c7fe98a9b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:59.680847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40061f4-4b3e-4232-8b62-c53f2c82746c service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:59.691333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d2fac-5617-44b4-9ff2-c9cebaa38b51 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6f0cc5aa6f3480ba7dd17b38fc0b474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c048fec3d94f3389e9bda290edcf6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:59.692223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d2fac-5617-44b4-9ff2-c9cebaa38b51 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:59.692612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d2fac-5617-44b4-9ff2-c9cebaa38b51 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:59.693040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d2fac-5617-44b4-9ff2-c9cebaa38b51 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:59.694532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d2fac-5617-44b4-9ff2-c9cebaa38b51 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:59.696952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d2fac-5617-44b4-9ff2-c9cebaa38b51 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:59.705432 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1213/2412] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:47:59 2022] GET /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 381 bytes in 533 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:59.728438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e99afa-9b63-4f7f-a86f-bc3d22fe8a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:59.731854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e99afa-9b63-4f7f-a86f-bc3d22fe8a80 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:59.761163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e99afa-9b63-4f7f-a86f-bc3d22fe8a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:59.770272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e99afa-9b63-4f7f-a86f-bc3d22fe8a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:59.770272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e99afa-9b63-4f7f-a86f-bc3d22fe8a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:47:59.770272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e99afa-9b63-4f7f-a86f-bc3d22fe8a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:59.770272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e99afa-9b63-4f7f-a86f-bc3d22fe8a80 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:59.834475 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1200/2413] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:47:59.836045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d2fac-5617-44b4-9ff2-c9cebaa38b51 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:59.851061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d2fac-5617-44b4-9ff2-c9cebaa38b51 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:59.887980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc530d-e826-4af9-bdf7-fab094126647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:59.889987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc530d-e826-4af9-bdf7-fab094126647 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:59.903537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc530d-e826-4af9-bdf7-fab094126647 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:59.904029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc530d-e826-4af9-bdf7-fab094126647 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:59.904965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc530d-e826-4af9-bdf7-fab094126647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:59.912019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc530d-e826-4af9-bdf7-fab094126647 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:00.074299 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1214/2414] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:47:59 2022] POST /identity/v3/projects => generated 399 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:00.080034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e99afa-9b63-4f7f-a86f-bc3d22fe8a80 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:00.105645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e99afa-9b63-4f7f-a86f-bc3d22fe8a80 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:00.140133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a980b63-d58c-4c94-943a-4870b99bacec None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:00.140428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a980b63-d58c-4c94-943a-4870b99bacec None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:00.140769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a980b63-d58c-4c94-943a-4870b99bacec None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:00.144324 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1215/2415] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:48:00.164447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a980b63-d58c-4c94-943a-4870b99bacec None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:48:00.489911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bf690-7960-4f7d-9900-ed5e25023e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:00.491162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bf690-7960-4f7d-9900-ed5e25023e6d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:00.491975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bf690-7960-4f7d-9900-ed5e25023e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:00.492676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bf690-7960-4f7d-9900-ed5e25023e6d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:00.494984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bf690-7960-4f7d-9900-ed5e25023e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:00.550756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bf690-7960-4f7d-9900-ed5e25023e6d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:00.554659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a980b63-d58c-4c94-943a-4870b99bacec None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:00.680711 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1201/2416] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:00 2022] POST /identity/v3/users => generated 300 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:00.684869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bf690-7960-4f7d-9900-ed5e25023e6d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:00.751820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bf690-7960-4f7d-9900-ed5e25023e6d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:00.786184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7d868-1e46-4dad-a4d9-695a61ff6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:00.787077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7d868-1e46-4dad-a4d9-695a61ff6745 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:00.787354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7d868-1e46-4dad-a4d9-695a61ff6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:00.787727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7d868-1e46-4dad-a4d9-695a61ff6745 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:00.788543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7d868-1e46-4dad-a4d9-695a61ff6745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:00.790316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7d868-1e46-4dad-a4d9-695a61ff6745 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:00.847250 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1202/2417] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:00.856366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7d868-1e46-4dad-a4d9-695a61ff6745 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:00.858407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a980b63-d58c-4c94-943a-4870b99bacec None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:00.878749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea6327-fc45-4263-bd35-936beb83a4d4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6f0cc5aa6f3480ba7dd17b38fc0b474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c048fec3d94f3389e9bda290edcf6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:00.883341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea6327-fc45-4263-bd35-936beb83a4d4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:00.886937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea6327-fc45-4263-bd35-936beb83a4d4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:00.891757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea6327-fc45-4263-bd35-936beb83a4d4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:00.893728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7d868-1e46-4dad-a4d9-695a61ff6745 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:00.894591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea6327-fc45-4263-bd35-936beb83a4d4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:00.905261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea6327-fc45-4263-bd35-936beb83a4d4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:00.913589 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1216/2418] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:48:00 2022] GET /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 381 bytes in 749 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:00.923601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f61f0-473d-4656-ae17-13aead46d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:00.925155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f61f0-473d-4656-ae17-13aead46d7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:00.933004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f61f0-473d-4656-ae17-13aead46d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:00.933575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f61f0-473d-4656-ae17-13aead46d7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:00.939713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f61f0-473d-4656-ae17-13aead46d7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:00.939713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f61f0-473d-4656-ae17-13aead46d7e0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:01.019793 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1203/2419] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:01.020019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afc596-ea61-4e8c-8b4a-f2c90dd9e4be None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:01.020019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afc596-ea61-4e8c-8b4a-f2c90dd9e4be None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:01.020019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afc596-ea61-4e8c-8b4a-f2c90dd9e4be None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:01.020819 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1217/2420] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:48:01.029951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f61f0-473d-4656-ae17-13aead46d7e0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:01.055958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afc596-ea61-4e8c-8b4a-f2c90dd9e4be None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:48:01.085087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f61f0-473d-4656-ae17-13aead46d7e0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:01.114673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b9aad-13e0-4ca1-a232-57fec9b0f2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:01.116111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b9aad-13e0-4ca1-a232-57fec9b0f2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:01.117325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b9aad-13e0-4ca1-a232-57fec9b0f2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:01.118227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b9aad-13e0-4ca1-a232-57fec9b0f2e3 admin admin] PATH_INFO: `/v3/projects/c89259ef29e04d5e87793ae9aafdcbf9/users/2ab51886a81f4e1194e0c1ac50eef9d4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:01.121977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afc596-ea61-4e8c-8b4a-f2c90dd9e4be None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:01.161249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afc596-ea61-4e8c-8b4a-f2c90dd9e4be None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:01.180304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d44b-422c-4cfc-af07-11c793a08bdd tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6f0cc5aa6f3480ba7dd17b38fc0b474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c048fec3d94f3389e9bda290edcf6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:01.180778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d44b-422c-4cfc-af07-11c793a08bdd tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:01.181184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d44b-422c-4cfc-af07-11c793a08bdd tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:01.181479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d44b-422c-4cfc-af07-11c793a08bdd tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:01.185650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1d44b-422c-4cfc-af07-11c793a08bdd tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:01.188646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1d44b-422c-4cfc-af07-11c793a08bdd tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:01.194720 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1218/2421] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:48:01 2022] GET /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 381 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:48:01.235763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b9aad-13e0-4ca1-a232-57fec9b0f2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89259ef29e04d5e87793ae9aafdcbf9, user_id=2ab51886a81f4e1194e0c1ac50eef9d4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:01.245293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b9aad-13e0-4ca1-a232-57fec9b0f2e3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:01.349955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f2102-c125-4bc7-90d5-5e98871f4fd0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:01.351249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f2102-c125-4bc7-90d5-5e98871f4fd0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:01.351565 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1204/2422] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:01 2022] PUT /identity/v3/projects/c89259ef29e04d5e87793ae9aafdcbf9/users/2ab51886a81f4e1194e0c1ac50eef9d4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:01.352099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f2102-c125-4bc7-90d5-5e98871f4fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:01.401379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4d2f2102-c125-4bc7-90d5-5e98871f4fd0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:01.404264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4d2f2102-c125-4bc7-90d5-5e98871f4fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:01.443936 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:01.504091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6427fdb-c376-4e0f-9c23-a0dc36964ca3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:01.504927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6427fdb-c376-4e0f-9c23-a0dc36964ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:01.505558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6427fdb-c376-4e0f-9c23-a0dc36964ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:01.663000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c6427fdb-c376-4e0f-9c23-a0dc36964ca3 None None] MFA Rules not processed for user `cda5affea11b414e953a847d7fa8ae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:01.668190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c6427fdb-c376-4e0f-9c23-a0dc36964ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:01.719185 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1219/2423] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:48:01.874693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f2102-c125-4bc7-90d5-5e98871f4fd0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:01.878591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4d2f2102-c125-4bc7-90d5-5e98871f4fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:01.907956 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1205/2424] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:48:02.132828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f2102-c125-4bc7-90d5-5e98871f4fd0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:02.148923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71ab11-a9d3-4cde-a9f0-240e56020ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:02.149569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71ab11-a9d3-4cde-a9f0-240e56020ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:02.149890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71ab11-a9d3-4cde-a9f0-240e56020ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:02.150194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71ab11-a9d3-4cde-a9f0-240e56020ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:02.168524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71ab11-a9d3-4cde-a9f0-240e56020ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:02.170222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71ab11-a9d3-4cde-a9f0-240e56020ee5 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:02.213485 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1220/2425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:05.341053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6427fdb-c376-4e0f-9c23-a0dc36964ca3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:05.343371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c6427fdb-c376-4e0f-9c23-a0dc36964ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:05.372414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6427fdb-c376-4e0f-9c23-a0dc36964ca3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:05.389594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:05.390928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:05.393596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:05.397973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] PATH_INFO: `/v3/users/e94cc0780af240188e5024335e581dea` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:05.402587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94cc0780af240188e5024335e581dea)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:05.410129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:05.438241 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:05.536393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94cc0780af240188e5024335e581dea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:05.559820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94cc0780af240188e5024335e581dea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:05.585482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94cc0780af240188e5024335e581dea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:05.648858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94cc0780af240188e5024335e581dea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:05.650437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94cc0780af240188e5024335e581dea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:05.694109 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1206/2426] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:05 2022] DELETE /identity/v3/users/e94cc0780af240188e5024335e581dea => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:05.697673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f73a5-d87a-43a9-bfa2-a12d4ecc8383 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:05.717176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f73a5-d87a-43a9-bfa2-a12d4ecc8383 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:05.717716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f73a5-d87a-43a9-bfa2-a12d4ecc8383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:05.823920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d10f73a5-d87a-43a9-bfa2-a12d4ecc8383 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:05.825206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d10f73a5-d87a-43a9-bfa2-a12d4ecc8383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:05.989986 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1221/2427] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:06.050708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:06.052825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:06.215256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b1ff-4593-4fa3-ba5a-70c2b257e526 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:06.227621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77256968-ea99-4e42-95f0-79ea2cbc70e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:06.228416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77256968-ea99-4e42-95f0-79ea2cbc70e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:06.228862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77256968-ea99-4e42-95f0-79ea2cbc70e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:06.229250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77256968-ea99-4e42-95f0-79ea2cbc70e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:06.262061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77256968-ea99-4e42-95f0-79ea2cbc70e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:06.264686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77256968-ea99-4e42-95f0-79ea2cbc70e6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:06.293868 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1207/2428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:08.092383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f73a5-d87a-43a9-bfa2-a12d4ecc8383 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:08.094624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d10f73a5-d87a-43a9-bfa2-a12d4ecc8383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:08.119735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f73a5-d87a-43a9-bfa2-a12d4ecc8383 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:08.144337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:08.147376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:08.147804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:08.148454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] PATH_INFO: `/v3/projects/e0ee493430f849718083118f0a4e61c0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:08.153368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ee493430f849718083118f0a4e61c0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:08.160240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:08.353806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ee493430f849718083118f0a4e61c0', 'request_id': 'req-48b5b771-2a1a-4291-bb24-73b39fa2e111'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.370915 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:08.379494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ee493430f849718083118f0a4e61c0', 'request_id': 'req-48b5b771-2a1a-4291-bb24-73b39fa2e111'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.397733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ee493430f849718083118f0a4e61c0', 'request_id': 'req-48b5b771-2a1a-4291-bb24-73b39fa2e111'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.446482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] The token cache is being invalidate because project e0ee493430f849718083118f0a4e61c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:08.447232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.451785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.460122 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1222/2429] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:08 2022] DELETE /identity/v3/projects/e0ee493430f849718083118f0a4e61c0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:08.463782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77256968-ea99-4e42-95f0-79ea2cbc70e6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:08.491799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77256968-ea99-4e42-95f0-79ea2cbc70e6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:08.707000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:08.708468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:08.710727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:08.711031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] PATH_INFO: `/v3/users/59d367cbc5374d16b0f8b140e2f5c271` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:08.713203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d367cbc5374d16b0f8b140e2f5c271)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:08.715520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:08.848655 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:08.894172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d367cbc5374d16b0f8b140e2f5c271'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.920873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d367cbc5374d16b0f8b140e2f5c271'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.937402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d367cbc5374d16b0f8b140e2f5c271'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.954714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d367cbc5374d16b0f8b140e2f5c271'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.964583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d367cbc5374d16b0f8b140e2f5c271'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:08.986505 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1208/2430] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:08 2022] DELETE /identity/v3/users/59d367cbc5374d16b0f8b140e2f5c271 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:09.541123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:09.547967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:09.801155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5b771-2a1a-4291-bb24-73b39fa2e111 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:09.999978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23f9fa-d2ca-4050-93b8-404ff78d78e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:10.002105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23f9fa-d2ca-4050-93b8-404ff78d78e0 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:10.002410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23f9fa-d2ca-4050-93b8-404ff78d78e0 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:10.002692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23f9fa-d2ca-4050-93b8-404ff78d78e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:10.008914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6f23f9fa-d2ca-4050-93b8-404ff78d78e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:10.061130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:10.062878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:10.198733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23f9fa-d2ca-4050-93b8-404ff78d78e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:10.210763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23f9fa-d2ca-4050-93b8-404ff78d78e0 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:10.244604 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1223/2431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:10.359553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5310b9-e593-4d8b-b9cf-e97af7465173 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:10.382967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:10.383706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:10.384033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:10.384354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] PATH_INFO: `/v3/projects/3f086c8824d84edd98b3c5ca4f6b7f72` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:10.385723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f086c8824d84edd98b3c5ca4f6b7f72)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:10.388029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:10.612820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f086c8824d84edd98b3c5ca4f6b7f72', 'request_id': 'req-f99b7fa2-f687-489a-bd10-a727f37c3f49'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:10.645437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f086c8824d84edd98b3c5ca4f6b7f72', 'request_id': 'req-f99b7fa2-f687-489a-bd10-a727f37c3f49'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:10.670788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f086c8824d84edd98b3c5ca4f6b7f72', 'request_id': 'req-f99b7fa2-f687-489a-bd10-a727f37c3f49'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:10.709169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] The token cache is being invalidate because project 3f086c8824d84edd98b3c5ca4f6b7f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:10.711683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:10.712468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f99b7fa2-f687-489a-bd10-a727f37c3f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:10.721324 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1209/2432] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:10 2022] DELETE /identity/v3/projects/3f086c8824d84edd98b3c5ca4f6b7f72 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:10.723855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02605ba4-25af-4c18-8ece-1d4c36ec8b5b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:10.724332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02605ba4-25af-4c18-8ece-1d4c36ec8b5b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:10.724477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02605ba4-25af-4c18-8ece-1d4c36ec8b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:10.835986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-02605ba4-25af-4c18-8ece-1d4c36ec8b5b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:10.837588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-02605ba4-25af-4c18-8ece-1d4c36ec8b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:10.883463 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:11.024678 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1224/2433] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:11.096570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb38604-4aeb-41b2-883c-9691239b1983 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:11.097278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb38604-4aeb-41b2-883c-9691239b1983 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:11.099553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb38604-4aeb-41b2-883c-9691239b1983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:11.148178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fdb38604-4aeb-41b2-883c-9691239b1983 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:11.150261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fdb38604-4aeb-41b2-883c-9691239b1983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:11.183577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02605ba4-25af-4c18-8ece-1d4c36ec8b5b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:11.185562 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1210/2434] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:11.199311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02605ba4-25af-4c18-8ece-1d4c36ec8b5b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:11.211574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c5af0-e7cf-4f2c-8de5-d18033d9c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:11.212265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c5af0-e7cf-4f2c-8de5-d18033d9c163 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:11.212538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c5af0-e7cf-4f2c-8de5-d18033d9c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:11.212890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c5af0-e7cf-4f2c-8de5-d18033d9c163 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:11.215768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c5af0-e7cf-4f2c-8de5-d18033d9c163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:48:11.216128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c5af0-e7cf-4f2c-8de5-d18033d9c163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:11.223871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c5af0-e7cf-4f2c-8de5-d18033d9c163 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:11.262911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb38604-4aeb-41b2-883c-9691239b1983 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:11.278491 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1225/2435] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:11.282398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb38604-4aeb-41b2-883c-9691239b1983 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:11.297976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f3889-acb2-41be-91ff-7a3ab63550e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:11.298634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f3889-acb2-41be-91ff-7a3ab63550e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:11.298896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f3889-acb2-41be-91ff-7a3ab63550e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:11.303413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f3889-acb2-41be-91ff-7a3ab63550e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:11.304107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f3889-acb2-41be-91ff-7a3ab63550e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:11.306117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f3889-acb2-41be-91ff-7a3ab63550e5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:11.408978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c5af0-e7cf-4f2c-8de5-d18033d9c163 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:11.419193 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1211/2436] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:11 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:48:11.423901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c5eb7-1520-4ac9-a8ca-2dd89dc4c951 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:11.424254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c5eb7-1520-4ac9-a8ca-2dd89dc4c951 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:11.424460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c5eb7-1520-4ac9-a8ca-2dd89dc4c951 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:11.430442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c5af0-e7cf-4f2c-8de5-d18033d9c163 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:11.433161 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1212/2437] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:48:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:48:11.436402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c5eb7-1520-4ac9-a8ca-2dd89dc4c951 None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:48:11.439714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-887c5eb7-1520-4ac9-a8ca-2dd89dc4c951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:11.486133 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:11.672648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c5eb7-1520-4ac9-a8ca-2dd89dc4c951 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:11.675183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-887c5eb7-1520-4ac9-a8ca-2dd89dc4c951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:11.681723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c047ad-d989-41ba-b955-3308576635f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:11.682614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c047ad-d989-41ba-b955-3308576635f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:11.682614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c047ad-d989-41ba-b955-3308576635f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:11.682894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c047ad-d989-41ba-b955-3308576635f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:11.683535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c047ad-d989-41ba-b955-3308576635f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:11.689020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c047ad-d989-41ba-b955-3308576635f4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:11.757964 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1226/2438] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:11 2022] POST /identity/v3/users => generated 287 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:11.770486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c047ad-d989-41ba-b955-3308576635f4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:11.800004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c047ad-d989-41ba-b955-3308576635f4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:11.831559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182faf0-ea71-465c-810c-547325897204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:11.832245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182faf0-ea71-465c-810c-547325897204 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:11.832529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182faf0-ea71-465c-810c-547325897204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:11.832854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182faf0-ea71-465c-810c-547325897204 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:11.833583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182faf0-ea71-465c-810c-547325897204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:11.837423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182faf0-ea71-465c-810c-547325897204 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:11.885595 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1227/2439] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:11.891911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182faf0-ea71-465c-810c-547325897204 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:11.914421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c5eb7-1520-4ac9-a8ca-2dd89dc4c951 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:11.927139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9f6db-ed00-4e1d-a1de-ab27dad9afe9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6f0cc5aa6f3480ba7dd17b38fc0b474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c048fec3d94f3389e9bda290edcf6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:11.927817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9f6db-ed00-4e1d-a1de-ab27dad9afe9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:11.928100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9f6db-ed00-4e1d-a1de-ab27dad9afe9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:11.928377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9f6db-ed00-4e1d-a1de-ab27dad9afe9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:11.930350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182faf0-ea71-465c-810c-547325897204 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:11.935318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9f6db-ed00-4e1d-a1de-ab27dad9afe9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:11.938196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9f6db-ed00-4e1d-a1de-ab27dad9afe9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:11.945007 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1213/2440] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:48:11 2022] GET /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 381 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:11.966367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225064e-df5f-4a26-b886-10ecf45b0e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:11.967578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225064e-df5f-4a26-b886-10ecf45b0e46 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:11.968193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225064e-df5f-4a26-b886-10ecf45b0e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:11.969435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225064e-df5f-4a26-b886-10ecf45b0e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:11.971492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225064e-df5f-4a26-b886-10ecf45b0e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:11.976737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225064e-df5f-4a26-b886-10ecf45b0e46 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:12.025491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9f6db-ed00-4e1d-a1de-ab27dad9afe9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:12.035462 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1228/2441] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:12.045174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9f6db-ed00-4e1d-a1de-ab27dad9afe9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:12.059442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0413-5904-4c48-a807-9aceb24e5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:12.060183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0413-5904-4c48-a807-9aceb24e5b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:12.060474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0413-5904-4c48-a807-9aceb24e5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:12.060789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0413-5904-4c48-a807-9aceb24e5b00 admin admin] PATH_INFO: `/v3/projects/924c4188dbcd4bcbb4cc76aed769c0c1/users/80f50eb98d76433eacaa60c62d94ad69/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:12.096854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0413-5904-4c48-a807-9aceb24e5b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924c4188dbcd4bcbb4cc76aed769c0c1, user_id=80f50eb98d76433eacaa60c62d94ad69, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:12.099702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0413-5904-4c48-a807-9aceb24e5b00 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:12.136650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4c88-df54-4148-b2cc-69446f111170 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:12.136970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4c88-df54-4148-b2cc-69446f111170 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:12.137241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4c88-df54-4148-b2cc-69446f111170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:12.141368 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1214/2442] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:12 2022] PUT /identity/v3/projects/924c4188dbcd4bcbb4cc76aed769c0c1/users/80f50eb98d76433eacaa60c62d94ad69/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:48:12.161382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-498f4c88-df54-4148-b2cc-69446f111170 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:12.162955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-498f4c88-df54-4148-b2cc-69446f111170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:12.236229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbbe7d-524f-4717-8048-56c9746bb319 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:12.236562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbbe7d-524f-4717-8048-56c9746bb319 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:12.236874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbbe7d-524f-4717-8048-56c9746bb319 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:12.238655 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1215/2443] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:48:12.246594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbbe7d-524f-4717-8048-56c9746bb319 None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:48:12.269640 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1229/2444] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:12.359762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4c88-df54-4148-b2cc-69446f111170 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:12.362817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-498f4c88-df54-4148-b2cc-69446f111170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:12.403994 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:12.447278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbbe7d-524f-4717-8048-56c9746bb319 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:12.496212 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:12.522145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4c88-df54-4148-b2cc-69446f111170 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:12.531536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cee605-2482-4058-a731-7abe415793ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:12.532187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cee605-2482-4058-a731-7abe415793ac service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:12.532467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cee605-2482-4058-a731-7abe415793ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:12.533978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cee605-2482-4058-a731-7abe415793ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:12.559350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cee605-2482-4058-a731-7abe415793ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:12.560887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cee605-2482-4058-a731-7abe415793ac service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:12.597768 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1230/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:12.611707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbbe7d-524f-4717-8048-56c9746bb319 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:12.618264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af180fbc-04b4-4e3f-a1e9-c0b457df8291 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6f0cc5aa6f3480ba7dd17b38fc0b474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c048fec3d94f3389e9bda290edcf6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:12.619361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af180fbc-04b4-4e3f-a1e9-c0b457df8291 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:12.619646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af180fbc-04b4-4e3f-a1e9-c0b457df8291 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:12.620171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af180fbc-04b4-4e3f-a1e9-c0b457df8291 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:12.621493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af180fbc-04b4-4e3f-a1e9-c0b457df8291 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:12.624253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af180fbc-04b4-4e3f-a1e9-c0b457df8291 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:12.642889 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1216/2446] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:48:12 2022] GET /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 381 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:12.695292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69820bcc-ff6d-431d-b0d3-78288ecf87e9 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:12.695893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69820bcc-ff6d-431d-b0d3-78288ecf87e9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:12.696254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69820bcc-ff6d-431d-b0d3-78288ecf87e9 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:12.700112 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1231/2447] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:48:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:48:12.716091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af180fbc-04b4-4e3f-a1e9-c0b457df8291 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:48:12.764223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af180fbc-04b4-4e3f-a1e9-c0b457df8291 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:12.789216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af180fbc-04b4-4e3f-a1e9-c0b457df8291 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:12.802431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509552-af2d-4770-967e-c08f474de9d8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6f0cc5aa6f3480ba7dd17b38fc0b474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c048fec3d94f3389e9bda290edcf6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:12.804337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509552-af2d-4770-967e-c08f474de9d8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:12.805760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509552-af2d-4770-967e-c08f474de9d8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:12.808107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509552-af2d-4770-967e-c08f474de9d8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:12.811563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509552-af2d-4770-967e-c08f474de9d8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:12.815856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509552-af2d-4770-967e-c08f474de9d8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:12.834700 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1217/2448] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:48:12 2022] GET /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 381 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:13.147168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9375d5c-b016-4913-a2c7-75f1eabdaa3c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:13.147924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9375d5c-b016-4913-a2c7-75f1eabdaa3c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:13.154229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9375d5c-b016-4913-a2c7-75f1eabdaa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:13.297935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c9375d5c-b016-4913-a2c7-75f1eabdaa3c None None] MFA Rules not processed for user `cda5affea11b414e953a847d7fa8ae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:13.299222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c9375d5c-b016-4913-a2c7-75f1eabdaa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:13.497799 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1232/2449] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:16.434581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36a7d-da88-4f81-b430-154428834f47 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:16.435204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36a7d-da88-4f81-b430-154428834f47 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:16.435204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36a7d-da88-4f81-b430-154428834f47 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:16.436944 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1218/2450] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:48:16.442667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9375d5c-b016-4913-a2c7-75f1eabdaa3c None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:48:16.445202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c9375d5c-b016-4913-a2c7-75f1eabdaa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:16.467757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9375d5c-b016-4913-a2c7-75f1eabdaa3c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:16.491586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9375d5c-b016-4913-a2c7-75f1eabdaa3c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:16.513304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf6337-56fd-4a39-92b2-c7fd05977eb4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6f0cc5aa6f3480ba7dd17b38fc0b474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43c048fec3d94f3389e9bda290edcf6d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:16.517038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6337-56fd-4a39-92b2-c7fd05977eb4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:16.517324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6337-56fd-4a39-92b2-c7fd05977eb4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:16.517600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6337-56fd-4a39-92b2-c7fd05977eb4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:16.525534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf6337-56fd-4a39-92b2-c7fd05977eb4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:16.528223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf6337-56fd-4a39-92b2-c7fd05977eb4 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:16.548982 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1233/2451] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:48:16 2022] GET /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 381 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:16.793481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e36a7d-da88-4f81-b430-154428834f47 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:16.799086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65e36a7d-da88-4f81-b430-154428834f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:16.838384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e36a7d-da88-4f81-b430-154428834f47 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:16.850867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:16.852050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:16.852811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:16.853310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] PATH_INFO: `/v3/users/cda5affea11b414e953a847d7fa8ae5e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:16.857246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda5affea11b414e953a847d7fa8ae5e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:16.867622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:17.075076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda5affea11b414e953a847d7fa8ae5e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:17.144613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda5affea11b414e953a847d7fa8ae5e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:17.178510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda5affea11b414e953a847d7fa8ae5e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:17.222520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda5affea11b414e953a847d7fa8ae5e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:17.223621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda5affea11b414e953a847d7fa8ae5e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:17.280252 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1219/2452] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:16 2022] DELETE /identity/v3/users/cda5affea11b414e953a847d7fa8ae5e => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:17.282471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68331436-392e-4adc-b469-456602475a3b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:17.282772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68331436-392e-4adc-b469-456602475a3b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:17.283051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68331436-392e-4adc-b469-456602475a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:17.408839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-68331436-392e-4adc-b469-456602475a3b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:17.409969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-68331436-392e-4adc-b469-456602475a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:17.814609 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1234/2453] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:17.951628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:17.953623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:18.241320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4871f-1b41-487c-8962-e96231feeff2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:18.252964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba710c-89e9-4ecc-964b-6d98cd62b508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:18.254016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba710c-89e9-4ecc-964b-6d98cd62b508 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:18.254304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba710c-89e9-4ecc-964b-6d98cd62b508 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:18.254587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba710c-89e9-4ecc-964b-6d98cd62b508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:18.275877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba710c-89e9-4ecc-964b-6d98cd62b508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:18.277569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba710c-89e9-4ecc-964b-6d98cd62b508 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:18.341139 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1220/2454] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:19.098593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247de9e-84b1-416c-b5d0-68eee12b5643 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:19.099105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247de9e-84b1-416c-b5d0-68eee12b5643 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:19.099208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247de9e-84b1-416c-b5d0-68eee12b5643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:19.247199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7247de9e-84b1-416c-b5d0-68eee12b5643 None None] MFA Rules not processed for user `b8f3bef1995348c5a70b0f3388f96541`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:19.259506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7247de9e-84b1-416c-b5d0-68eee12b5643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:19.287611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba710c-89e9-4ecc-964b-6d98cd62b508 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:19.289092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a8ba710c-89e9-4ecc-964b-6d98cd62b508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:19.320594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba710c-89e9-4ecc-964b-6d98cd62b508 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:19.344555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:19.345570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:19.350821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:19.351392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] PATH_INFO: `/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:19.355297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b94eaa25a6419d8b445a9a11a71e16)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:19.375671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:19.432103 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:19.485727 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:19.505673 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1235/2455] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:19.518341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e14bd-872f-4fb9-a242-71f71a729907 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:19.518819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e14bd-872f-4fb9-a242-71f71a729907 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:19.519210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e14bd-872f-4fb9-a242-71f71a729907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:19.587486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f58e14bd-872f-4fb9-a242-71f71a729907 None None] MFA Rules not processed for user `5d0158da7efc485ebd6a1e1db617b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:19.590919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f58e14bd-872f-4fb9-a242-71f71a729907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:19.622238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b94eaa25a6419d8b445a9a11a71e16', 'request_id': 'req-5ba38b34-f276-483e-afd3-dbab7b395160'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:19.633148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b94eaa25a6419d8b445a9a11a71e16', 'request_id': 'req-5ba38b34-f276-483e-afd3-dbab7b395160'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:19.659301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b94eaa25a6419d8b445a9a11a71e16', 'request_id': 'req-5ba38b34-f276-483e-afd3-dbab7b395160'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:19.692776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] The token cache is being invalidate because project c6b94eaa25a6419d8b445a9a11a71e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:19.693071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:19.701574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:19.703707 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1221/2456] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:19 2022] DELETE /identity/v3/projects/c6b94eaa25a6419d8b445a9a11a71e16 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:48:19.710937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:19.712750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:19.848214 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1236/2457] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:19.879718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e14bd-872f-4fb9-a242-71f71a729907 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:19.881288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f58e14bd-872f-4fb9-a242-71f71a729907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:19.972036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba38b34-f276-483e-afd3-dbab7b395160 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:19.987999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:19.988640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:19.988943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:19.989240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] PATH_INFO: `/v3/users/a6f0cc5aa6f3480ba7dd17b38fc0b474` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:19.992255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f0cc5aa6f3480ba7dd17b38fc0b474)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:19.995646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:20.132496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f0cc5aa6f3480ba7dd17b38fc0b474'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:20.167897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f0cc5aa6f3480ba7dd17b38fc0b474'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:20.192199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f0cc5aa6f3480ba7dd17b38fc0b474'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:20.219471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f0cc5aa6f3480ba7dd17b38fc0b474'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:20.220806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-91cacddf-1d3d-466e-b628-30faf273d7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f0cc5aa6f3480ba7dd17b38fc0b474'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:20.244178 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1222/2458] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:19 2022] DELETE /identity/v3/users/a6f0cc5aa6f3480ba7dd17b38fc0b474 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:20.265790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e14bd-872f-4fb9-a242-71f71a729907 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:20.525211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:20.528386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:20.528746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:20.533114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:20.538790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:20.603023 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:20.756910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:20.761672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:20.798363 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1237/2459] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 919 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:48:20.920366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebaccd-c9d0-402e-8f21-e8b31091adc6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:20.921950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebaccd-c9d0-402e-8f21-e8b31091adc6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:20.922412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebaccd-c9d0-402e-8f21-e8b31091adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:20.988979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c5ebaccd-c9d0-402e-8f21-e8b31091adc6 None None] MFA Rules not processed for user `1e43026c56e0462b976a840266ea8acf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:20.997920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c5ebaccd-c9d0-402e-8f21-e8b31091adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:21.079000 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:21.234497 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1223/2460] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:22.125376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:22.129380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:22.270756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9260d9-e8bc-4fac-9e1f-9aeba4086466 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:22.276472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:22.277196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:22.277510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:22.277789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] PATH_INFO: `/v3/projects/43c048fec3d94f3389e9bda290edcf6d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:22.279015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c048fec3d94f3389e9bda290edcf6d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:22.282223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:22.380979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c048fec3d94f3389e9bda290edcf6d', 'request_id': 'req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:22.395112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c048fec3d94f3389e9bda290edcf6d', 'request_id': 'req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:22.411482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c048fec3d94f3389e9bda290edcf6d', 'request_id': 'req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:22.427865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] The token cache is being invalidate because project 43c048fec3d94f3389e9bda290edcf6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:22.428170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:22.428918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7fc81cc1-e098-44bf-8331-7b48b2e40e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:22.432423 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1238/2461] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:22 2022] DELETE /identity/v3/projects/43c048fec3d94f3389e9bda290edcf6d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:48:22.439200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753539-271a-451e-8a32-c07b3a9c2c9f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:22.440126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753539-271a-451e-8a32-c07b3a9c2c9f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:22.440476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753539-271a-451e-8a32-c07b3a9c2c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:22.506759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9c753539-271a-451e-8a32-c07b3a9c2c9f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:22.509167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9c753539-271a-451e-8a32-c07b3a9c2c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:22.668972 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1224/2462] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:22.670292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fde5c-d9d9-468e-826e-60135dd34528 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:22.671435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fde5c-d9d9-468e-826e-60135dd34528 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:22.672766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fde5c-d9d9-468e-826e-60135dd34528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:22.723255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5d3fde5c-d9d9-468e-826e-60135dd34528 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:22.731861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5d3fde5c-d9d9-468e-826e-60135dd34528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:22.757154 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1239/2463] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:22.758860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753539-271a-451e-8a32-c07b3a9c2c9f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:22.786080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753539-271a-451e-8a32-c07b3a9c2c9f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:22.821020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e6840-876d-4533-8ef3-ca04694a911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:22.822054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e6840-876d-4533-8ef3-ca04694a911d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:22.822518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e6840-876d-4533-8ef3-ca04694a911d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:22.822972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e6840-876d-4533-8ef3-ca04694a911d admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:22.824011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e6840-876d-4533-8ef3-ca04694a911d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:48:22.824538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e6840-876d-4533-8ef3-ca04694a911d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:22.829448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e6840-876d-4533-8ef3-ca04694a911d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:22.861000 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1225/2464] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:22.865600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fde5c-d9d9-468e-826e-60135dd34528 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:22.878971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fde5c-d9d9-468e-826e-60135dd34528 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:22.894842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb67769-b845-4cb5-a692-741d8df49b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:22.895723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb67769-b845-4cb5-a692-741d8df49b13 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:22.896190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb67769-b845-4cb5-a692-741d8df49b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:22.896677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb67769-b845-4cb5-a692-741d8df49b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:22.897536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb67769-b845-4cb5-a692-741d8df49b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:22.903144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb67769-b845-4cb5-a692-741d8df49b13 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:22.977411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e6840-876d-4533-8ef3-ca04694a911d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:22.987211 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1240/2465] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:22 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:22.992893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e6840-876d-4533-8ef3-ca04694a911d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:23.129185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1927820-83a6-4605-9dc6-cf1c5e4319a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:23.130107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1927820-83a6-4605-9dc6-cf1c5e4319a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:23.130352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1927820-83a6-4605-9dc6-cf1c5e4319a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:23.130672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1927820-83a6-4605-9dc6-cf1c5e4319a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:23.131264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1927820-83a6-4605-9dc6-cf1c5e4319a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:23.133272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1927820-83a6-4605-9dc6-cf1c5e4319a3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:23.195816 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1226/2466] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:22 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:48:23.197582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb67769-b845-4cb5-a692-741d8df49b13 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:23.209240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb67769-b845-4cb5-a692-741d8df49b13 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:23.258798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430202-f25a-41c3-a60e-5a4cf933f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:23.277570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430202-f25a-41c3-a60e-5a4cf933f67e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:23.278114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430202-f25a-41c3-a60e-5a4cf933f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:23.278596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430202-f25a-41c3-a60e-5a4cf933f67e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:23.279738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11430202-f25a-41c3-a60e-5a4cf933f67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:23.283257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11430202-f25a-41c3-a60e-5a4cf933f67e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:23.331241 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1241/2467] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:23.337385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1927820-83a6-4605-9dc6-cf1c5e4319a3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:23.353992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1927820-83a6-4605-9dc6-cf1c5e4319a3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:23.383148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669934a-bbb1-446e-8dcf-a53c54f08d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:23.388527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669934a-bbb1-446e-8dcf-a53c54f08d43 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:23.388873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669934a-bbb1-446e-8dcf-a53c54f08d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:23.389059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669934a-bbb1-446e-8dcf-a53c54f08d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:23.391619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669934a-bbb1-446e-8dcf-a53c54f08d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:23.404492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669934a-bbb1-446e-8dcf-a53c54f08d43 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:23.449318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430202-f25a-41c3-a60e-5a4cf933f67e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:23.451981 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1227/2468] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:23.476201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430202-f25a-41c3-a60e-5a4cf933f67e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:23.492592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7076ce-f448-43bf-8b0d-cc040fdeb544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:23.495610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7076ce-f448-43bf-8b0d-cc040fdeb544 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:23.497662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7076ce-f448-43bf-8b0d-cc040fdeb544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:23.498698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7076ce-f448-43bf-8b0d-cc040fdeb544 admin admin] PATH_INFO: `/v3/projects/81793aa60f054fd9a6d14301d3e76ced/users/ff22e779b6ca4d6dbda4127579d0f656/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:23.513682 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:23.553270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7076ce-f448-43bf-8b0d-cc040fdeb544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81793aa60f054fd9a6d14301d3e76ced, user_id=ff22e779b6ca4d6dbda4127579d0f656, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:23.556254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7076ce-f448-43bf-8b0d-cc040fdeb544 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:23.593544 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1242/2469] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:23 2022] PUT /identity/v3/projects/81793aa60f054fd9a6d14301d3e76ced/users/ff22e779b6ca4d6dbda4127579d0f656/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:23.606663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa927a6-05b2-4c60-94e2-33cf6789e090 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:23.607301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa927a6-05b2-4c60-94e2-33cf6789e090 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:23.613054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa927a6-05b2-4c60-94e2-33cf6789e090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:23.736750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-caa927a6-05b2-4c60-94e2-33cf6789e090 None None] MFA Rules not processed for user `ff22e779b6ca4d6dbda4127579d0f656`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:23.750584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-caa927a6-05b2-4c60-94e2-33cf6789e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:23.884080 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:23.997671 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1228/2470] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:24.006070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7076ce-f448-43bf-8b0d-cc040fdeb544 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:24.073724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed30b71-7242-4505-8f9c-2280ed270e90 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:24.074691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed30b71-7242-4505-8f9c-2280ed270e90 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:24.075288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed30b71-7242-4505-8f9c-2280ed270e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:24.170371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4ed30b71-7242-4505-8f9c-2280ed270e90 None None] MFA Rules not processed for user `2ab51886a81f4e1194e0c1ac50eef9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:24.178608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4ed30b71-7242-4505-8f9c-2280ed270e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:24.355506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7076ce-f448-43bf-8b0d-cc040fdeb544 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:24.395445 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1229/2471] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:24.401516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc9eb8-f20a-4dcf-b483-ee2070584e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:24.406205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc9eb8-f20a-4dcf-b483-ee2070584e93 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:24.406693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc9eb8-f20a-4dcf-b483-ee2070584e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:24.407443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15387574-574e-40bb-8d2c-3ed4f4088cc9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:24.407945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15387574-574e-40bb-8d2c-3ed4f4088cc9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:24.408451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15387574-574e-40bb-8d2c-3ed4f4088cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:24.412314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc9eb8-f20a-4dcf-b483-ee2070584e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:24.413626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc9eb8-f20a-4dcf-b483-ee2070584e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:24.429576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc9eb8-f20a-4dcf-b483-ee2070584e93 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:24.454154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-15387574-574e-40bb-8d2c-3ed4f4088cc9 None None] MFA Rules not processed for user `2ab51886a81f4e1194e0c1ac50eef9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:24.455601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-15387574-574e-40bb-8d2c-3ed4f4088cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:24.477381 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1230/2472] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:24.490535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15387574-574e-40bb-8d2c-3ed4f4088cc9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:24.492506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-15387574-574e-40bb-8d2c-3ed4f4088cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:24.538942 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1243/2473] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:24 2022] POST /identity/v3/projects => generated 393 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:24.541571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc9eb8-f20a-4dcf-b483-ee2070584e93 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:24.746431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15387574-574e-40bb-8d2c-3ed4f4088cc9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:24.800757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc9eb8-f20a-4dcf-b483-ee2070584e93 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:24.824390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea89fb4-f48f-4896-9da8-e4c385836ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:24.825190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea89fb4-f48f-4896-9da8-e4c385836ebb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:24.825574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea89fb4-f48f-4896-9da8-e4c385836ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:24.829668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea89fb4-f48f-4896-9da8-e4c385836ebb admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:24.835372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea89fb4-f48f-4896-9da8-e4c385836ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:24.842903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea89fb4-f48f-4896-9da8-e4c385836ebb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:24.932302 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1244/2474] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:24 2022] POST /identity/v3/users => generated 303 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:24.938269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea89fb4-f48f-4896-9da8-e4c385836ebb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:24.941941 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:24.966129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea89fb4-f48f-4896-9da8-e4c385836ebb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:24.978549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8abab-2ea5-4493-8493-1ccd7beff5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:24.979667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8abab-2ea5-4493-8493-1ccd7beff5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:24.982288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8abab-2ea5-4493-8493-1ccd7beff5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:24.983034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8abab-2ea5-4493-8493-1ccd7beff5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:24.984152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8abab-2ea5-4493-8493-1ccd7beff5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:24.988878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8abab-2ea5-4493-8493-1ccd7beff5d1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:25.005477 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1245/2475] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:48:25.010419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8abab-2ea5-4493-8493-1ccd7beff5d1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:25.014696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2927b5-8a5c-42cd-b66d-198da7c17c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:25.015463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2927b5-8a5c-42cd-b66d-198da7c17c44 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:25.015888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2927b5-8a5c-42cd-b66d-198da7c17c44 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:25.016301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2927b5-8a5c-42cd-b66d-198da7c17c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:25.034603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8abab-2ea5-4493-8493-1ccd7beff5d1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:25.042333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ec377-05a5-45b9-a40a-5bea4be5c23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:25.043316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ec377-05a5-45b9-a40a-5bea4be5c23b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:25.044029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ec377-05a5-45b9-a40a-5bea4be5c23b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:25.045152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ec377-05a5-45b9-a40a-5bea4be5c23b admin admin] PATH_INFO: `/v3/projects/22f0f50d2f844181b573f170f2150d14/users/f8f80d4e25834321a2a21e11b51c49e2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:25.094347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ec377-05a5-45b9-a40a-5bea4be5c23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f0f50d2f844181b573f170f2150d14, user_id=f8f80d4e25834321a2a21e11b51c49e2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:25.102858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ec377-05a5-45b9-a40a-5bea4be5c23b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:25.155575 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1246/2476] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:25 2022] PUT /identity/v3/projects/22f0f50d2f844181b573f170f2150d14/users/f8f80d4e25834321a2a21e11b51c49e2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:25.160370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ec377-05a5-45b9-a40a-5bea4be5c23b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:25.167552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2927b5-8a5c-42cd-b66d-198da7c17c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:25.169373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2927b5-8a5c-42cd-b66d-198da7c17c44 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:25.213090 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1231/2477] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:25.214972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad3fc4-a113-439e-8505-b2653ea8b313 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:25.217299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad3fc4-a113-439e-8505-b2653ea8b313 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:25.217841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad3fc4-a113-439e-8505-b2653ea8b313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:25.264507 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:25.313337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-92ad3fc4-a113-439e-8505-b2653ea8b313 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:25.320347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-92ad3fc4-a113-439e-8505-b2653ea8b313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:25.437883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ec377-05a5-45b9-a40a-5bea4be5c23b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:25.452416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eae93-fb48-4390-8807-53210cb913f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:25.453087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eae93-fb48-4390-8807-53210cb913f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:25.453391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eae93-fb48-4390-8807-53210cb913f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:25.453749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eae93-fb48-4390-8807-53210cb913f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:25.454654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eae93-fb48-4390-8807-53210cb913f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:25.456305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eae93-fb48-4390-8807-53210cb913f9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:25.485627 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1247/2478] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:25.487064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eae93-fb48-4390-8807-53210cb913f9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:25.503846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eae93-fb48-4390-8807-53210cb913f9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:25.511371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648175a-b7ce-4fbc-aba5-a3034ddd27c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:25.512074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648175a-b7ce-4fbc-aba5-a3034ddd27c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:25.513945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648175a-b7ce-4fbc-aba5-a3034ddd27c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:25.514312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648175a-b7ce-4fbc-aba5-a3034ddd27c6 admin admin] PATH_INFO: `/v3/projects/22f0f50d2f844181b573f170f2150d14/users/f8f80d4e25834321a2a21e11b51c49e2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:25.514428 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1232/2479] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 00:48:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:25.517247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648175a-b7ce-4fbc-aba5-a3034ddd27c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f0f50d2f844181b573f170f2150d14, user_id=f8f80d4e25834321a2a21e11b51c49e2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:25.521012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648175a-b7ce-4fbc-aba5-a3034ddd27c6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:25.542087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad3fc4-a113-439e-8505-b2653ea8b313 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:25.543638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-92ad3fc4-a113-439e-8505-b2653ea8b313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:25.559220 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1248/2480] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:25 2022] PUT /identity/v3/projects/22f0f50d2f844181b573f170f2150d14/users/f8f80d4e25834321a2a21e11b51c49e2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:25.569980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e1011-19e2-4d8b-8698-4508a65411fb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:25.570337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e1011-19e2-4d8b-8698-4508a65411fb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:25.570598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e1011-19e2-4d8b-8698-4508a65411fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:25.661055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-469e1011-19e2-4d8b-8698-4508a65411fb None None] MFA Rules not processed for user `f8f80d4e25834321a2a21e11b51c49e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:25.662920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-469e1011-19e2-4d8b-8698-4508a65411fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:25.825443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad3fc4-a113-439e-8505-b2653ea8b313 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:25.906191 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1249/2481] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:25.938927 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:26.010287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db235401-fe78-4f38-bd35-8425f7ba8620 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:26.012194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235401-fe78-4f38-bd35-8425f7ba8620 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:26.012784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235401-fe78-4f38-bd35-8425f7ba8620 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:26.013288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235401-fe78-4f38-bd35-8425f7ba8620 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:26.193327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db235401-fe78-4f38-bd35-8425f7ba8620 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:26.195430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db235401-fe78-4f38-bd35-8425f7ba8620 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:26.207334 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1233/2482] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:48:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:48:27.435643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639b37d-069e-4e95-9a61-1cb4a18802a4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:27.436573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639b37d-069e-4e95-9a61-1cb4a18802a4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:27.437214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639b37d-069e-4e95-9a61-1cb4a18802a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:27.508287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2639b37d-069e-4e95-9a61-1cb4a18802a4 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:27.510366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2639b37d-069e-4e95-9a61-1cb4a18802a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:27.587463 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1250/2483] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:48:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:27.594495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db235401-fe78-4f38-bd35-8425f7ba8620 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:27.613388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db235401-fe78-4f38-bd35-8425f7ba8620 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:27.620880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb3d8-86ca-4b25-802e-645d20ee4913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:27.621935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb3d8-86ca-4b25-802e-645d20ee4913 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:27.622429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb3d8-86ca-4b25-802e-645d20ee4913 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:27.623531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb3d8-86ca-4b25-802e-645d20ee4913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:27.638560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cb3d8-86ca-4b25-802e-645d20ee4913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:27.642204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cb3d8-86ca-4b25-802e-645d20ee4913 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:27.656447 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1234/2484] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:48:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:27.935230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639b37d-069e-4e95-9a61-1cb4a18802a4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:27.937483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2639b37d-069e-4e95-9a61-1cb4a18802a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:28.156189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639b37d-069e-4e95-9a61-1cb4a18802a4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:28.170126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fdd93-d486-42b7-998b-4a12dd06f912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:28.171077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdd93-d486-42b7-998b-4a12dd06f912 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:28.171471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdd93-d486-42b7-998b-4a12dd06f912 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:28.171896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdd93-d486-42b7-998b-4a12dd06f912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:28.194152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fdd93-d486-42b7-998b-4a12dd06f912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:28.195923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fdd93-d486-42b7-998b-4a12dd06f912 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:28.230240 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1251/2485] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:37.650401 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=45 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:38.112055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb3d8-86ca-4b25-802e-645d20ee4913 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:38.134054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb3d8-86ca-4b25-802e-645d20ee4913 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:38.150970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485d79-21b9-4ea2-bc03-5cefc2464e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:38.151902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485d79-21b9-4ea2-bc03-5cefc2464e15 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:38.152274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485d79-21b9-4ea2-bc03-5cefc2464e15 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:38.152712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485d79-21b9-4ea2-bc03-5cefc2464e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:38.214662 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:38.356320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45485d79-21b9-4ea2-bc03-5cefc2464e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:38.365009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45485d79-21b9-4ea2-bc03-5cefc2464e15 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:38.392183 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1235/2486] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:38.458105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fdd93-d486-42b7-998b-4a12dd06f912 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:38.592829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485d79-21b9-4ea2-bc03-5cefc2464e15 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:38.594341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-45485d79-21b9-4ea2-bc03-5cefc2464e15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:38.661463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fdd93-d486-42b7-998b-4a12dd06f912 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:38.688070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:38.688916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:38.689181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:38.689459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] PATH_INFO: `/v3/users/ff22e779b6ca4d6dbda4127579d0f656` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:38.690701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff22e779b6ca4d6dbda4127579d0f656)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:38.693315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:38.753916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45485d79-21b9-4ea2-bc03-5cefc2464e15 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:38.760131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:38.761162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:38.761446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:38.761873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] PATH_INFO: `/v3/users/2f399df50fd34de3b8d9c69d8461fc13` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:38.763338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f399df50fd34de3b8d9c69d8461fc13)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:38.767676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:38.830610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff22e779b6ca4d6dbda4127579d0f656'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.864479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff22e779b6ca4d6dbda4127579d0f656'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.876513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f399df50fd34de3b8d9c69d8461fc13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.883013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff22e779b6ca4d6dbda4127579d0f656'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.899011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff22e779b6ca4d6dbda4127579d0f656'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.900583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-314c2e79-5004-4685-a466-8f6b5b75258b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff22e779b6ca4d6dbda4127579d0f656'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.902967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f399df50fd34de3b8d9c69d8461fc13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.916535 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1252/2487] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:38 2022] DELETE /identity/v3/users/ff22e779b6ca4d6dbda4127579d0f656 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:38.922207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f399df50fd34de3b8d9c69d8461fc13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.922491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4de2b-779e-44f6-8bf1-e20805644c6d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:38.922599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4de2b-779e-44f6-8bf1-e20805644c6d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:38.922913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4de2b-779e-44f6-8bf1-e20805644c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:38.940503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f399df50fd34de3b8d9c69d8461fc13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.941381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ac4560b-54df-4af5-8aec-6f37d33f3afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f399df50fd34de3b8d9c69d8461fc13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:38.954275 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1236/2488] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:38 2022] DELETE /identity/v3/users/2f399df50fd34de3b8d9c69d8461fc13 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:38.956903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9320f-0247-4f94-b042-e9702f18ce7d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:38.957310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9320f-0247-4f94-b042-e9702f18ce7d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:38.957777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9320f-0247-4f94-b042-e9702f18ce7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:38.965529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a5e4de2b-779e-44f6-8bf1-e20805644c6d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:38.967116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a5e4de2b-779e-44f6-8bf1-e20805644c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:39.016445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9fe9320f-0247-4f94-b042-e9702f18ce7d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:39.018503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9fe9320f-0247-4f94-b042-e9702f18ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:39.041200 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:39.117555 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1253/2489] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:39.157377 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1237/2490] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:39.163909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4de2b-779e-44f6-8bf1-e20805644c6d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.166378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a5e4de2b-779e-44f6-8bf1-e20805644c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:39.174006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9320f-0247-4f94-b042-e9702f18ce7d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:39.176427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9fe9320f-0247-4f94-b042-e9702f18ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:39.248604 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:39.299860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9320f-0247-4f94-b042-e9702f18ce7d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.302565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4de2b-779e-44f6-8bf1-e20805644c6d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:39.303867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74162f4d-909b-47ed-b7b6-d096a38352ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.304704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74162f4d-909b-47ed-b7b6-d096a38352ac service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.305179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74162f4d-909b-47ed-b7b6-d096a38352ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.305398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74162f4d-909b-47ed-b7b6-d096a38352ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.310007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbfe6-7991-42cd-9087-9cff70dbabbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:39.311798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbfe6-7991-42cd-9087-9cff70dbabbb service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.312259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbfe6-7991-42cd-9087-9cff70dbabbb service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.312813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbfe6-7991-42cd-9087-9cff70dbabbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:39.320579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74162f4d-909b-47ed-b7b6-d096a38352ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.323416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74162f4d-909b-47ed-b7b6-d096a38352ac service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.325124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dbfe6-7991-42cd-9087-9cff70dbabbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:39.327888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dbfe6-7991-42cd-9087-9cff70dbabbb service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:39.343875 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1238/2491] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:39.368588 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1254/2492] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:39.952198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebae5fb-4d55-488f-bac9-95394bf38d16 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:39.953201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebae5fb-4d55-488f-bac9-95394bf38d16 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:39.953201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebae5fb-4d55-488f-bac9-95394bf38d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:40.014367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2ebae5fb-4d55-488f-bac9-95394bf38d16 None None] MFA Rules not processed for user `80f50eb98d76433eacaa60c62d94ad69`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:40.016497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2ebae5fb-4d55-488f-bac9-95394bf38d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:40.213288 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1239/2493] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:40.214042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbfe6-7991-42cd-9087-9cff70dbabbb service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:40.220288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6a0dbfe6-7991-42cd-9087-9cff70dbabbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:40.493740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbfe6-7991-42cd-9087-9cff70dbabbb service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:40.503000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5622a-a3a9-4693-baa2-880ece6037be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:40.505977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5622a-a3a9-4693-baa2-880ece6037be service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:40.506720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5622a-a3a9-4693-baa2-880ece6037be service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:40.507304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5622a-a3a9-4693-baa2-880ece6037be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:40.523086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5622a-a3a9-4693-baa2-880ece6037be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:40.527326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5622a-a3a9-4693-baa2-880ece6037be service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:40.547643 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1255/2494] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:41.171955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebae5fb-4d55-488f-bac9-95394bf38d16 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:41.176068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2ebae5fb-4d55-488f-bac9-95394bf38d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:41.247363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebae5fb-4d55-488f-bac9-95394bf38d16 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:41.254498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:41.255167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:41.255451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:41.255731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] PATH_INFO: `/v3/projects/c5b69c18338643abba49d008af53c18e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:41.257317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b69c18338643abba49d008af53c18e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:41.259302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:41.325855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5622a-a3a9-4693-baa2-880ece6037be service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:41.330200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-69f5622a-a3a9-4693-baa2-880ece6037be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:41.369773 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:41.374354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5622a-a3a9-4693-baa2-880ece6037be service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:41.378252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b69c18338643abba49d008af53c18e', 'request_id': 'req-e5de19cc-22a3-4053-9709-5a97b673059c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.396243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b69c18338643abba49d008af53c18e', 'request_id': 'req-e5de19cc-22a3-4053-9709-5a97b673059c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.405062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b69c18338643abba49d008af53c18e', 'request_id': 'req-e5de19cc-22a3-4053-9709-5a97b673059c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.433717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] The token cache is being invalidate because project c5b69c18338643abba49d008af53c18e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:41.434169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.435626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.441396 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1240/2495] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:41 2022] DELETE /identity/v3/projects/c5b69c18338643abba49d008af53c18e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:41.445329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:41.449147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:41.619379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:41.620067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:41.620335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:41.620602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] PATH_INFO: `/v3/projects/81793aa60f054fd9a6d14301d3e76ced` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:41.621840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81793aa60f054fd9a6d14301d3e76ced)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:41.624710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:41.700784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de19cc-22a3-4053-9709-5a97b673059c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:41.713319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81793aa60f054fd9a6d14301d3e76ced', 'request_id': 'req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.715721 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:41.728000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81793aa60f054fd9a6d14301d3e76ced', 'request_id': 'req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.740106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81793aa60f054fd9a6d14301d3e76ced', 'request_id': 'req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.770281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] The token cache is being invalidate because project 81793aa60f054fd9a6d14301d3e76ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:41.772080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.775081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:41.778541 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1256/2496] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:41 2022] DELETE /identity/v3/projects/81793aa60f054fd9a6d14301d3e76ced => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:41.783738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:41.786750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:42.004870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e2a60-fd3f-45bf-8ff1-d920ec4968c4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:42.022787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:42.023778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:42.024289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:42.024832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] PATH_INFO: `/v3/users/f8f80d4e25834321a2a21e11b51c49e2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:42.026928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f80d4e25834321a2a21e11b51c49e2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:42.030812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:42.031434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:42.034602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:42.035860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:42.036363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] PATH_INFO: `/v3/users/979e77a796e24cdc88af45b7c9a37428` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:42.041988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979e77a796e24cdc88af45b7c9a37428)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:42.052220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:42.207395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f80d4e25834321a2a21e11b51c49e2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.214543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979e77a796e24cdc88af45b7c9a37428'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.251835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979e77a796e24cdc88af45b7c9a37428'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.254351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f80d4e25834321a2a21e11b51c49e2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.263481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979e77a796e24cdc88af45b7c9a37428'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.268952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f80d4e25834321a2a21e11b51c49e2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.275998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979e77a796e24cdc88af45b7c9a37428'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.276977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979e77a796e24cdc88af45b7c9a37428'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.279805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f80d4e25834321a2a21e11b51c49e2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.281286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f80d4e25834321a2a21e11b51c49e2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:42.283308 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:42.300402 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1241/2497] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:41 2022] DELETE /identity/v3/users/979e77a796e24cdc88af45b7c9a37428 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:42.300722 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1257/2498] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:41 2022] DELETE /identity/v3/users/f8f80d4e25834321a2a21e11b51c49e2 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:48:43.932435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:43.937594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:44.048965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:44.048965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:44.136473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a4682-249a-40a4-aaf3-b9e725b18ab0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:44.147445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:44.148515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:44.149106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:44.149594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] PATH_INFO: `/v3/projects/22f0f50d2f844181b573f170f2150d14` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:44.151224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f0f50d2f844181b573f170f2150d14)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:44.153552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:44.222161 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:44.228708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a536-e182-417f-a577-163e9b1022ad admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:44.235956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:44.237652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:44.240738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:44.241262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] PATH_INFO: `/v3/projects/40a4d63f1fad438bb90a4c6e94aacd3e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:44.242736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a4d63f1fad438bb90a4c6e94aacd3e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:44.246378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:44.317530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f0f50d2f844181b573f170f2150d14', 'request_id': 'req-61323585-e72d-4e74-bca3-d15c5085bf31'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.332653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f0f50d2f844181b573f170f2150d14', 'request_id': 'req-61323585-e72d-4e74-bca3-d15c5085bf31'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.374412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f0f50d2f844181b573f170f2150d14', 'request_id': 'req-61323585-e72d-4e74-bca3-d15c5085bf31'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.410573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a4d63f1fad438bb90a4c6e94aacd3e', 'request_id': 'req-48e5f250-42c1-4262-9185-284200cae87c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.415250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] The token cache is being invalidate because project 22f0f50d2f844181b573f170f2150d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:44.416290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.418727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61323585-e72d-4e74-bca3-d15c5085bf31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.425372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a4d63f1fad438bb90a4c6e94aacd3e', 'request_id': 'req-48e5f250-42c1-4262-9185-284200cae87c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.428274 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1242/2499] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:43 2022] DELETE /identity/v3/projects/22f0f50d2f844181b573f170f2150d14 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:44.434025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51484-a46f-4873-9fe6-fc21314741e9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:44.435186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51484-a46f-4873-9fe6-fc21314741e9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:44.436503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51484-a46f-4873-9fe6-fc21314741e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:44.452102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a4d63f1fad438bb90a4c6e94aacd3e', 'request_id': 'req-48e5f250-42c1-4262-9185-284200cae87c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.481974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] The token cache is being invalidate because project 40a4d63f1fad438bb90a4c6e94aacd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:44.484650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.486635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48e5f250-42c1-4262-9185-284200cae87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:44.499597 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1258/2500] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:44 2022] DELETE /identity/v3/projects/40a4d63f1fad438bb90a4c6e94aacd3e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:44.503045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b5da-d5ad-45c7-b937-4f9646f4bcc7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:44.503587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b5da-d5ad-45c7-b937-4f9646f4bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:44.504124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7b5da-d5ad-45c7-b937-4f9646f4bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:44.506129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a9e51484-a46f-4873-9fe6-fc21314741e9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:44.508099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a9e51484-a46f-4873-9fe6-fc21314741e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:44.547844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f6f7b5da-d5ad-45c7-b937-4f9646f4bcc7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:44.556748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f6f7b5da-d5ad-45c7-b937-4f9646f4bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:44.674154 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1243/2501] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:48:44.682645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfd22d-1656-4b90-b068-943fbf532b2f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:44.683016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfd22d-1656-4b90-b068-943fbf532b2f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:44.683541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfd22d-1656-4b90-b068-943fbf532b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:44.712856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8ddfd22d-1656-4b90-b068-943fbf532b2f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:44.714422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8ddfd22d-1656-4b90-b068-943fbf532b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:44.722483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1259/2502] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:44.730176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bdfd0-f919-45b0-aff5-7bba5511a5a2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:44.730468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bdfd0-f919-45b0-aff5-7bba5511a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:44.730796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bdfd0-f919-45b0-aff5-7bba5511a5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:44.732182 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1244/2503] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:44.736742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfd22d-1656-4b90-b068-943fbf532b2f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:44.749642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfd22d-1656-4b90-b068-943fbf532b2f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:44.757964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67bbf8-59cb-4364-907a-504aa5b0eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:44.758763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67bbf8-59cb-4364-907a-504aa5b0eb18 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:44.760016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67bbf8-59cb-4364-907a-504aa5b0eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:44.760424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67bbf8-59cb-4364-907a-504aa5b0eb18 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:44.761296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67bbf8-59cb-4364-907a-504aa5b0eb18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:48:44.761939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67bbf8-59cb-4364-907a-504aa5b0eb18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:44.764293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67bbf8-59cb-4364-907a-504aa5b0eb18 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:44.777827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ec9bdfd0-f919-45b0-aff5-7bba5511a5a2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:44.779076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ec9bdfd0-f919-45b0-aff5-7bba5511a5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:44.782395 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1245/2504] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:48:44.788382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67bbf8-59cb-4364-907a-504aa5b0eb18 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:44.795735 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1260/2505] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:48:44.802283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bdfd0-f919-45b0-aff5-7bba5511a5a2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:44.806383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67bbf8-59cb-4364-907a-504aa5b0eb18 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:44.813009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb35994-6395-40e1-b729-0a2219265158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:44.813815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bdfd0-f919-45b0-aff5-7bba5511a5a2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:44.813982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb35994-6395-40e1-b729-0a2219265158 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:44.814105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb35994-6395-40e1-b729-0a2219265158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:44.814403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb35994-6395-40e1-b729-0a2219265158 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:44.815043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb35994-6395-40e1-b729-0a2219265158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:44.817163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb35994-6395-40e1-b729-0a2219265158 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:44.829762 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:44.842994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb1275-0ada-4216-a9ad-5c3856d53126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:44.843863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb1275-0ada-4216-a9ad-5c3856d53126 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:44.844368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb1275-0ada-4216-a9ad-5c3856d53126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:44.847227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb1275-0ada-4216-a9ad-5c3856d53126 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:44.848943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb1275-0ada-4216-a9ad-5c3856d53126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:48:44.849249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb1275-0ada-4216-a9ad-5c3856d53126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:44.854319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb1275-0ada-4216-a9ad-5c3856d53126 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:44.862507 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1246/2506] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:44 2022] POST /identity/v3/projects => generated 395 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:44.869321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb35994-6395-40e1-b729-0a2219265158 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:44.895124 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1261/2507] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:44.896456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb1275-0ada-4216-a9ad-5c3856d53126 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:44.925544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb1275-0ada-4216-a9ad-5c3856d53126 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:45.005383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb35994-6395-40e1-b729-0a2219265158 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:45.011947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb27733-0800-4534-bb0a-c048c1e92378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:45.012806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb27733-0800-4534-bb0a-c048c1e92378 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.013109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb27733-0800-4534-bb0a-c048c1e92378 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.013384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb27733-0800-4534-bb0a-c048c1e92378 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.014078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb27733-0800-4534-bb0a-c048c1e92378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:45.016363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb27733-0800-4534-bb0a-c048c1e92378 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:45.083426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882f19b-9648-4a3b-af9f-0ac9e4c3b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:45.087197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f19b-9648-4a3b-af9f-0ac9e4c3b727 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.088105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f19b-9648-4a3b-af9f-0ac9e4c3b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.090165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f19b-9648-4a3b-af9f-0ac9e4c3b727 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.093227 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1247/2508] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:44 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:45.098986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb27733-0800-4534-bb0a-c048c1e92378 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:45.099232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882f19b-9648-4a3b-af9f-0ac9e4c3b727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:45.112412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882f19b-9648-4a3b-af9f-0ac9e4c3b727 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:45.121293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb27733-0800-4534-bb0a-c048c1e92378 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:45.137381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108d71a-69de-4ceb-a36a-3c9831ddc805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:45.138033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108d71a-69de-4ceb-a36a-3c9831ddc805 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.138317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108d71a-69de-4ceb-a36a-3c9831ddc805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.138636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108d71a-69de-4ceb-a36a-3c9831ddc805 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.139408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108d71a-69de-4ceb-a36a-3c9831ddc805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:45.141097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108d71a-69de-4ceb-a36a-3c9831ddc805 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:45.145971 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:45.171553 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1262/2509] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:44 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:48:45.175777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882f19b-9648-4a3b-af9f-0ac9e4c3b727 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:45.184841 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1248/2510] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:48:45.186253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108d71a-69de-4ceb-a36a-3c9831ddc805 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:45.200076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108d71a-69de-4ceb-a36a-3c9831ddc805 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:45.296665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80938ebd-363b-40d2-ad8e-61d4ed9ab890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:45.298211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80938ebd-363b-40d2-ad8e-61d4ed9ab890 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.298605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80938ebd-363b-40d2-ad8e-61d4ed9ab890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.298887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80938ebd-363b-40d2-ad8e-61d4ed9ab890 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.300930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80938ebd-363b-40d2-ad8e-61d4ed9ab890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:45.302520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80938ebd-363b-40d2-ad8e-61d4ed9ab890 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:45.303303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882f19b-9648-4a3b-af9f-0ac9e4c3b727 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:45.309612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8778b-719f-4498-8a6f-94d9808e87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:45.311251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8778b-719f-4498-8a6f-94d9808e87d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.311761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8778b-719f-4498-8a6f-94d9808e87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.312554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8778b-719f-4498-8a6f-94d9808e87d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.320152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8778b-719f-4498-8a6f-94d9808e87d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:45.323667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8778b-719f-4498-8a6f-94d9808e87d1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:45.324673 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1249/2511] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:45.326897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80938ebd-363b-40d2-ad8e-61d4ed9ab890 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:45.347383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80938ebd-363b-40d2-ad8e-61d4ed9ab890 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:45.361237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829ee82-3045-4f85-b285-1e70b5c8d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:45.361956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829ee82-3045-4f85-b285-1e70b5c8d73d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.362271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829ee82-3045-4f85-b285-1e70b5c8d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.362530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829ee82-3045-4f85-b285-1e70b5c8d73d admin admin] PATH_INFO: `/v3/projects/80bb1917c24c4b2691adcbcc01f01e46/users/d5a12c60c8de4fb681d464a23b06697c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.384257 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1263/2512] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:45 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:48:45.386310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829ee82-3045-4f85-b285-1e70b5c8d73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80bb1917c24c4b2691adcbcc01f01e46, user_id=d5a12c60c8de4fb681d464a23b06697c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:45.387495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8778b-719f-4498-8a6f-94d9808e87d1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:45.393237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829ee82-3045-4f85-b285-1e70b5c8d73d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:45.418794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8778b-719f-4498-8a6f-94d9808e87d1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:45.427026 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1250/2513] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:45 2022] PUT /identity/v3/projects/80bb1917c24c4b2691adcbcc01f01e46/users/d5a12c60c8de4fb681d464a23b06697c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:45.429103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a736-bec8-40ca-8d39-fa36fc3d747d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.430718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a736-bec8-40ca-8d39-fa36fc3d747d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.430718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a736-bec8-40ca-8d39-fa36fc3d747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.481821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-09e1a736-bec8-40ca-8d39-fa36fc3d747d None None] MFA Rules not processed for user `d5a12c60c8de4fb681d464a23b06697c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:45.484315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09e1a736-bec8-40ca-8d39-fa36fc3d747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:45.552122 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:45.579891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91915148-d565-47de-b87b-0f801568f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:45.580787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91915148-d565-47de-b87b-0f801568f22b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.581171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91915148-d565-47de-b87b-0f801568f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.581552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91915148-d565-47de-b87b-0f801568f22b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.597746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91915148-d565-47de-b87b-0f801568f22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:45.604194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91915148-d565-47de-b87b-0f801568f22b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:45.649717 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1251/2514] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:45.650806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a736-bec8-40ca-8d39-fa36fc3d747d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:45.651476 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1264/2515] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:45.663159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a736-bec8-40ca-8d39-fa36fc3d747d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:45.669079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00ba86-79be-49ec-82ce-34ebc9287e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:45.669796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00ba86-79be-49ec-82ce-34ebc9287e23 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.670172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00ba86-79be-49ec-82ce-34ebc9287e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.670579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00ba86-79be-49ec-82ce-34ebc9287e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.671294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00ba86-79be-49ec-82ce-34ebc9287e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:45.673020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00ba86-79be-49ec-82ce-34ebc9287e23 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:45.688149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91915148-d565-47de-b87b-0f801568f22b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:45.692834 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1252/2516] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:45.701896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91915148-d565-47de-b87b-0f801568f22b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:45.707960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b1753-feca-4ffc-99fb-239f99689458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:45.708800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b1753-feca-4ffc-99fb-239f99689458 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.709176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b1753-feca-4ffc-99fb-239f99689458 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.709528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b1753-feca-4ffc-99fb-239f99689458 admin admin] PATH_INFO: `/v3/projects/d8e85ec3893d4cafb7e702f4c1bbcad0/users/efa3ceb9ee6a4107aa9cb7f0771f880f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.733327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b1753-feca-4ffc-99fb-239f99689458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e85ec3893d4cafb7e702f4c1bbcad0, user_id=efa3ceb9ee6a4107aa9cb7f0771f880f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:45.737063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b1753-feca-4ffc-99fb-239f99689458 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:45.807706 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1265/2517] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:45 2022] PUT /identity/v3/projects/d8e85ec3893d4cafb7e702f4c1bbcad0/users/efa3ceb9ee6a4107aa9cb7f0771f880f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:45.818312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d72b75-46e2-4ce5-b46e-4bcb5bffe342 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:45.818625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d72b75-46e2-4ce5-b46e-4bcb5bffe342 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:45.818945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d72b75-46e2-4ce5-b46e-4bcb5bffe342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:45.870036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a6d72b75-46e2-4ce5-b46e-4bcb5bffe342 None None] MFA Rules not processed for user `efa3ceb9ee6a4107aa9cb7f0771f880f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:45.871628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a6d72b75-46e2-4ce5-b46e-4bcb5bffe342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:46.045287 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1253/2518] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:46.047241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b1753-feca-4ffc-99fb-239f99689458 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:46.159991 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:46.168248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b1753-feca-4ffc-99fb-239f99689458 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:46.174370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c3c07-62e5-47fe-b85f-9d163591d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:46.175605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c3c07-62e5-47fe-b85f-9d163591d503 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:46.176108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c3c07-62e5-47fe-b85f-9d163591d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:46.176592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c3c07-62e5-47fe-b85f-9d163591d503 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:46.178193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c3c07-62e5-47fe-b85f-9d163591d503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:46.181256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c3c07-62e5-47fe-b85f-9d163591d503 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:46.218769 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1266/2519] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:46 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:46.224026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d72b75-46e2-4ce5-b46e-4bcb5bffe342 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:46.237755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d72b75-46e2-4ce5-b46e-4bcb5bffe342 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:46.330052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8b98-3364-42d4-8057-826bbccdc0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:46.331061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8b98-3364-42d4-8057-826bbccdc0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:46.331528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8b98-3364-42d4-8057-826bbccdc0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:46.332384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8b98-3364-42d4-8057-826bbccdc0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:46.333261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c8b98-3364-42d4-8057-826bbccdc0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:46.335772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c8b98-3364-42d4-8057-826bbccdc0c6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:46.360603 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1254/2520] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:46 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:46.364870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c3c07-62e5-47fe-b85f-9d163591d503 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:46.377145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c3c07-62e5-47fe-b85f-9d163591d503 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:46.383620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ffbb2-75c6-4bcb-af08-73285b2c65b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:46.384357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffbb2-75c6-4bcb-af08-73285b2c65b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:46.384766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffbb2-75c6-4bcb-af08-73285b2c65b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:46.385134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffbb2-75c6-4bcb-af08-73285b2c65b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:46.386532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ffbb2-75c6-4bcb-af08-73285b2c65b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:46.388461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ffbb2-75c6-4bcb-af08-73285b2c65b9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:46.400511 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1267/2521] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:46.405118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8b98-3364-42d4-8057-826bbccdc0c6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:46.436928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8b98-3364-42d4-8057-826bbccdc0c6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:46.465574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed41df-f5df-416a-89aa-e270acdda775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:46.466430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed41df-f5df-416a-89aa-e270acdda775 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:46.466741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed41df-f5df-416a-89aa-e270acdda775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:46.467131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed41df-f5df-416a-89aa-e270acdda775 admin admin] PATH_INFO: `/v3/projects/c8a40904cd7146fd8ff10f1455fe459f/users/b4ff0c382a0c4b0089798b3fffd24223/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:46.498297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed41df-f5df-416a-89aa-e270acdda775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a40904cd7146fd8ff10f1455fe459f, user_id=b4ff0c382a0c4b0089798b3fffd24223, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:46.501296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed41df-f5df-416a-89aa-e270acdda775 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:46.526244 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1255/2522] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:46 2022] PUT /identity/v3/projects/c8a40904cd7146fd8ff10f1455fe459f/users/b4ff0c382a0c4b0089798b3fffd24223/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:46.530654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ffbb2-75c6-4bcb-af08-73285b2c65b9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:46.546693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ffbb2-75c6-4bcb-af08-73285b2c65b9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:46.604917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed41df-f5df-416a-89aa-e270acdda775 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:46.608188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b1ed41df-f5df-416a-89aa-e270acdda775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:46.634821 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:46.648781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa706207-6980-492f-942a-6726054cdb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:46.649431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa706207-6980-492f-942a-6726054cdb59 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:46.649709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa706207-6980-492f-942a-6726054cdb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:46.649981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa706207-6980-492f-942a-6726054cdb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:46.650628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa706207-6980-492f-942a-6726054cdb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:46.652329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa706207-6980-492f-942a-6726054cdb59 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:46.667574 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1268/2523] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:46.668848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa706207-6980-492f-942a-6726054cdb59 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:46.680137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa706207-6980-492f-942a-6726054cdb59 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:46.689548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a703fcb-f0e0-4930-b5c1-22c7e9514cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:46.690221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a703fcb-f0e0-4930-b5c1-22c7e9514cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:46.690501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a703fcb-f0e0-4930-b5c1-22c7e9514cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:46.690777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a703fcb-f0e0-4930-b5c1-22c7e9514cfd admin admin] PATH_INFO: `/v3/projects/c8a40904cd7146fd8ff10f1455fe459f/users/b4ff0c382a0c4b0089798b3fffd24223/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:46.692883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a703fcb-f0e0-4930-b5c1-22c7e9514cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a40904cd7146fd8ff10f1455fe459f, user_id=b4ff0c382a0c4b0089798b3fffd24223, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:46.695556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a703fcb-f0e0-4930-b5c1-22c7e9514cfd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:46.709069 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1269/2524] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:46 2022] PUT /identity/v3/projects/c8a40904cd7146fd8ff10f1455fe459f/users/b4ff0c382a0c4b0089798b3fffd24223/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:46.746181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed41df-f5df-416a-89aa-e270acdda775 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:46.801129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9adf31-b77d-4aad-89aa-b1b9bfb0fd9c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:46.801450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9adf31-b77d-4aad-89aa-b1b9bfb0fd9c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:46.801685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9adf31-b77d-4aad-89aa-b1b9bfb0fd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:46.837554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0e9adf31-b77d-4aad-89aa-b1b9bfb0fd9c None None] MFA Rules not processed for user `b4ff0c382a0c4b0089798b3fffd24223`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:46.838786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0e9adf31-b77d-4aad-89aa-b1b9bfb0fd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:46.869810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae41d4-706a-410b-ad5a-21ee26003af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:46.870954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae41d4-706a-410b-ad5a-21ee26003af6 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:46.871387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae41d4-706a-410b-ad5a-21ee26003af6 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:46.871716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae41d4-706a-410b-ad5a-21ee26003af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:46.948678 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1270/2525] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:48:46.981745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae41d4-706a-410b-ad5a-21ee26003af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:46.983956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae41d4-706a-410b-ad5a-21ee26003af6 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:46.994220 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1256/2526] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:46 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:47.052124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9adf31-b77d-4aad-89aa-b1b9bfb0fd9c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:47.055378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3651e-4c72-4f60-ad32-09c8c0576cdf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:47.055815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3651e-4c72-4f60-ad32-09c8c0576cdf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:47.055951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3651e-4c72-4f60-ad32-09c8c0576cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:47.091293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9adf31-b77d-4aad-89aa-b1b9bfb0fd9c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:47.093620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-74c3651e-4c72-4f60-ad32-09c8c0576cdf None None] MFA Rules not processed for user `d5a12c60c8de4fb681d464a23b06697c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:47.095191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-74c3651e-4c72-4f60-ad32-09c8c0576cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:47.109253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd0f25-ad7b-4e51-a995-3d6c99b38a4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:47.109531 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1257/2527] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:48:47.110198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd0f25-ad7b-4e51-a995-3d6c99b38a4c service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:47.110536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd0f25-ad7b-4e51-a995-3d6c99b38a4c service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:47.111013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd0f25-ad7b-4e51-a995-3d6c99b38a4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:47.121058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd0f25-ad7b-4e51-a995-3d6c99b38a4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:47.125521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd0f25-ad7b-4e51-a995-3d6c99b38a4c service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:47.136868 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1271/2528] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:47.983539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3651e-4c72-4f60-ad32-09c8c0576cdf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:48.089876 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:48.130636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3651e-4c72-4f60-ad32-09c8c0576cdf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:48.147854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:48.148752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:48.149112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:48.149441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] PATH_INFO: `/v3/users/d5a12c60c8de4fb681d464a23b06697c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:48.150662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a12c60c8de4fb681d464a23b06697c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:48.152723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:48.197916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd0f25-ad7b-4e51-a995-3d6c99b38a4c service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:48.199531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-53dd0f25-ad7b-4e51-a995-3d6c99b38a4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:48.250210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a12c60c8de4fb681d464a23b06697c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:48.273389 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:48.299478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a12c60c8de4fb681d464a23b06697c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:48.319937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a12c60c8de4fb681d464a23b06697c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:48.345449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a12c60c8de4fb681d464a23b06697c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:48.347503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5dd3c32a-eb7e-4af8-82f4-0ce62ca48a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a12c60c8de4fb681d464a23b06697c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:48.376929 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1258/2529] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:47 2022] DELETE /identity/v3/users/d5a12c60c8de4fb681d464a23b06697c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:48.384072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a9ef-1f5a-434a-96cd-314a711be8a1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:48.384072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a9ef-1f5a-434a-96cd-314a711be8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:48.384072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a9ef-1f5a-434a-96cd-314a711be8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:48.387831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd0f25-ad7b-4e51-a995-3d6c99b38a4c service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:48.429786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1902a9ef-1f5a-434a-96cd-314a711be8a1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:48.431055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1902a9ef-1f5a-434a-96cd-314a711be8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:48.509600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78233694-505f-420d-8336-386183a8ed67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:48.510816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78233694-505f-420d-8336-386183a8ed67 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:48.512561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78233694-505f-420d-8336-386183a8ed67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:48.513019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78233694-505f-420d-8336-386183a8ed67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:48.516779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-78233694-505f-420d-8336-386183a8ed67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:48.594527 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1259/2530] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:48.606895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902a9ef-1f5a-434a-96cd-314a711be8a1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:48.610925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1902a9ef-1f5a-434a-96cd-314a711be8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:48.643411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902a9ef-1f5a-434a-96cd-314a711be8a1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:48.652474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56576a-c36f-4a8a-9eaf-e262e698639b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:48.653057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56576a-c36f-4a8a-9eaf-e262e698639b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:48.653334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56576a-c36f-4a8a-9eaf-e262e698639b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:48.655104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56576a-c36f-4a8a-9eaf-e262e698639b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:48.678217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56576a-c36f-4a8a-9eaf-e262e698639b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:48.680034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56576a-c36f-4a8a-9eaf-e262e698639b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:48.711068 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1260/2531] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:48.729621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78233694-505f-420d-8336-386183a8ed67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:48.731069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78233694-505f-420d-8336-386183a8ed67 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:48.762907 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1272/2532] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:49.224108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56576a-c36f-4a8a-9eaf-e262e698639b service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:49.226263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4f56576a-c36f-4a8a-9eaf-e262e698639b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:49.249784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56576a-c36f-4a8a-9eaf-e262e698639b service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:49.276328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:49.277455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:49.278030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:49.280066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] PATH_INFO: `/v3/projects/80bb1917c24c4b2691adcbcc01f01e46` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:49.284337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80bb1917c24c4b2691adcbcc01f01e46)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:49.293521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:49.412034 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:49.429128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80bb1917c24c4b2691adcbcc01f01e46', 'request_id': 'req-7c6b7a19-99c7-406b-b420-d059c830b9e1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:49.442471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80bb1917c24c4b2691adcbcc01f01e46', 'request_id': 'req-7c6b7a19-99c7-406b-b420-d059c830b9e1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:49.453828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80bb1917c24c4b2691adcbcc01f01e46', 'request_id': 'req-7c6b7a19-99c7-406b-b420-d059c830b9e1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:49.468679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] The token cache is being invalidate because project 80bb1917c24c4b2691adcbcc01f01e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:49.469343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:49.470252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7c6b7a19-99c7-406b-b420-d059c830b9e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:49.477927 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1261/2533] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:49 2022] DELETE /identity/v3/projects/80bb1917c24c4b2691adcbcc01f01e46 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:49.478219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ed924-9e89-47de-a52a-b932acccda71 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:49.479143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ed924-9e89-47de-a52a-b932acccda71 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:49.479423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ed924-9e89-47de-a52a-b932acccda71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:49.510320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-107ed924-9e89-47de-a52a-b932acccda71 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:49.512504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-107ed924-9e89-47de-a52a-b932acccda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:49.610118 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1273/2534] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:48:49.614170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937cf6e-21b6-4a80-8f45-1081aa895d35 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:49.614911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937cf6e-21b6-4a80-8f45-1081aa895d35 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:49.615362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937cf6e-21b6-4a80-8f45-1081aa895d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:49.643577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f937cf6e-21b6-4a80-8f45-1081aa895d35 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:49.645560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f937cf6e-21b6-4a80-8f45-1081aa895d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:49.678469 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1262/2535] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:49.678728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ed924-9e89-47de-a52a-b932acccda71 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:49.704086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ed924-9e89-47de-a52a-b932acccda71 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:49.716180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4107d8-a0d5-4c8a-857f-e2513acddfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:49.717734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4107d8-a0d5-4c8a-857f-e2513acddfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:49.718349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4107d8-a0d5-4c8a-857f-e2513acddfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:49.718984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4107d8-a0d5-4c8a-857f-e2513acddfc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:49.721767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4107d8-a0d5-4c8a-857f-e2513acddfc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:48:49.722460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4107d8-a0d5-4c8a-857f-e2513acddfc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:49.726136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4107d8-a0d5-4c8a-857f-e2513acddfc0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:49.757704 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1274/2536] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:48:49.759542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937cf6e-21b6-4a80-8f45-1081aa895d35 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:49.775670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937cf6e-21b6-4a80-8f45-1081aa895d35 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:49.783094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1825-6fd1-4031-b24d-d2ed1deb3717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:49.784385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1825-6fd1-4031-b24d-d2ed1deb3717 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:49.784783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1825-6fd1-4031-b24d-d2ed1deb3717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:49.785059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb1825-6fd1-4031-b24d-d2ed1deb3717 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:49.785724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb1825-6fd1-4031-b24d-d2ed1deb3717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:49.788358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb1825-6fd1-4031-b24d-d2ed1deb3717 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:49.833961 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1263/2537] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:49 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:49.838073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4107d8-a0d5-4c8a-857f-e2513acddfc0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:49.851049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4107d8-a0d5-4c8a-857f-e2513acddfc0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:49.862604 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:49.974326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5088f-eaf4-46d0-aa03-216989da4052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:49.976004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5088f-eaf4-46d0-aa03-216989da4052 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:49.976408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5088f-eaf4-46d0-aa03-216989da4052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:49.976828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5088f-eaf4-46d0-aa03-216989da4052 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:49.977637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5088f-eaf4-46d0-aa03-216989da4052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:49.979921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5088f-eaf4-46d0-aa03-216989da4052 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:50.013754 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1275/2538] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:49 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:50.021249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1825-6fd1-4031-b24d-d2ed1deb3717 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:50.041739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb1825-6fd1-4031-b24d-d2ed1deb3717 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:50.061531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c401-98e0-410b-94dd-18343df4620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:50.062918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c401-98e0-410b-94dd-18343df4620a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:50.063415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c401-98e0-410b-94dd-18343df4620a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:50.063935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c401-98e0-410b-94dd-18343df4620a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:50.065175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6c401-98e0-410b-94dd-18343df4620a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:50.068757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6c401-98e0-410b-94dd-18343df4620a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:50.088359 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1264/2539] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:50.092550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5088f-eaf4-46d0-aa03-216989da4052 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:50.104149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5088f-eaf4-46d0-aa03-216989da4052 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:50.109734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa9569-b57d-4bdf-b740-33d6087c91d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:50.111102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9569-b57d-4bdf-b740-33d6087c91d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:50.111102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9569-b57d-4bdf-b740-33d6087c91d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:50.111102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9569-b57d-4bdf-b740-33d6087c91d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:50.111785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa9569-b57d-4bdf-b740-33d6087c91d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:50.113629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa9569-b57d-4bdf-b740-33d6087c91d1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:50.132682 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1276/2540] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:50.137006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c401-98e0-410b-94dd-18343df4620a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:50.148909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c401-98e0-410b-94dd-18343df4620a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:50.156942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267faf4b-1e06-4885-9a3f-31cd6ac7b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:50.157744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267faf4b-1e06-4885-9a3f-31cd6ac7b2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:50.158129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267faf4b-1e06-4885-9a3f-31cd6ac7b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:50.158404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267faf4b-1e06-4885-9a3f-31cd6ac7b2e6 admin admin] PATH_INFO: `/v3/projects/dbd865e323184a67ae37cb93f7334adb/users/c10bfa3078e14866b10189c65037c2de/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:50.177742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267faf4b-1e06-4885-9a3f-31cd6ac7b2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd865e323184a67ae37cb93f7334adb, user_id=c10bfa3078e14866b10189c65037c2de, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:50.181620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267faf4b-1e06-4885-9a3f-31cd6ac7b2e6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:50.222751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbced4b-fc77-478b-ae18-7a21d00f10f1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:50.223296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbced4b-fc77-478b-ae18-7a21d00f10f1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:50.223755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbced4b-fc77-478b-ae18-7a21d00f10f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:50.227152 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1265/2541] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:50 2022] PUT /identity/v3/projects/dbd865e323184a67ae37cb93f7334adb/users/c10bfa3078e14866b10189c65037c2de/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:50.253551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ddbced4b-fc77-478b-ae18-7a21d00f10f1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:50.257857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ddbced4b-fc77-478b-ae18-7a21d00f10f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:50.417704 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1277/2542] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:50.449554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267faf4b-1e06-4885-9a3f-31cd6ac7b2e6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:50.459410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-267faf4b-1e06-4885-9a3f-31cd6ac7b2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:50.614491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267faf4b-1e06-4885-9a3f-31cd6ac7b2e6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:50.628569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4179a3c-45f2-48b4-bc77-b1307cdf13ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:50.629723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4179a3c-45f2-48b4-bc77-b1307cdf13ec service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:50.630226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4179a3c-45f2-48b4-bc77-b1307cdf13ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:50.630627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4179a3c-45f2-48b4-bc77-b1307cdf13ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:50.653762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4179a3c-45f2-48b4-bc77-b1307cdf13ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:50.658845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4179a3c-45f2-48b4-bc77-b1307cdf13ec service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:50.682692 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1266/2543] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:50.863224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbced4b-fc77-478b-ae18-7a21d00f10f1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:50.864794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ddbced4b-fc77-478b-ae18-7a21d00f10f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:50.885851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbced4b-fc77-478b-ae18-7a21d00f10f1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:50.895712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:50.896564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:50.896936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:50.897284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] PATH_INFO: `/v3/users/efa3ceb9ee6a4107aa9cb7f0771f880f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:50.898773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa3ceb9ee6a4107aa9cb7f0771f880f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:50.901579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:50.987420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa3ceb9ee6a4107aa9cb7f0771f880f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.005071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa3ceb9ee6a4107aa9cb7f0771f880f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.016923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa3ceb9ee6a4107aa9cb7f0771f880f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.027376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa3ceb9ee6a4107aa9cb7f0771f880f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.028169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa3ceb9ee6a4107aa9cb7f0771f880f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.031448 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:51.041227 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1278/2544] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:50 2022] DELETE /identity/v3/users/efa3ceb9ee6a4107aa9cb7f0771f880f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:51.043517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710218d7-7ab0-4ae8-b0c0-0038da1a3d5d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:51.052962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710218d7-7ab0-4ae8-b0c0-0038da1a3d5d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:51.053157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710218d7-7ab0-4ae8-b0c0-0038da1a3d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:51.077778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-710218d7-7ab0-4ae8-b0c0-0038da1a3d5d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:51.079142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-710218d7-7ab0-4ae8-b0c0-0038da1a3d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:51.168326 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1267/2545] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:48:51.178741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:51.182600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:51.289065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69236569-7545-4d3f-851f-62a197183a5a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:51.294129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd379-eaa9-4a29-8ec0-33dff0b218f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:51.296164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd379-eaa9-4a29-8ec0-33dff0b218f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:51.296603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd379-eaa9-4a29-8ec0-33dff0b218f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:51.297005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd379-eaa9-4a29-8ec0-33dff0b218f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:51.309671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd379-eaa9-4a29-8ec0-33dff0b218f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:51.311262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd379-eaa9-4a29-8ec0-33dff0b218f7 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:51.325974 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1279/2546] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:51.691621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710218d7-7ab0-4ae8-b0c0-0038da1a3d5d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:51.693229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-710218d7-7ab0-4ae8-b0c0-0038da1a3d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:51.708642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710218d7-7ab0-4ae8-b0c0-0038da1a3d5d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:51.720914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:51.721612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:51.721894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:51.722316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] PATH_INFO: `/v3/projects/d8e85ec3893d4cafb7e702f4c1bbcad0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:51.723950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e85ec3893d4cafb7e702f4c1bbcad0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:51.725945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:51.734375 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:51.793113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e85ec3893d4cafb7e702f4c1bbcad0', 'request_id': 'req-354ff630-2cbf-43f2-ac10-fba5f3e970b0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.809533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e85ec3893d4cafb7e702f4c1bbcad0', 'request_id': 'req-354ff630-2cbf-43f2-ac10-fba5f3e970b0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.828324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e85ec3893d4cafb7e702f4c1bbcad0', 'request_id': 'req-354ff630-2cbf-43f2-ac10-fba5f3e970b0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.853124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] The token cache is being invalidate because project d8e85ec3893d4cafb7e702f4c1bbcad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:51.853934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.854300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:51.860853 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1268/2547] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:51 2022] DELETE /identity/v3/projects/d8e85ec3893d4cafb7e702f4c1bbcad0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:51.862044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd379-eaa9-4a29-8ec0-33dff0b218f7 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:51.873717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd379-eaa9-4a29-8ec0-33dff0b218f7 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:51.943840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:51.944487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:51.944933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:51.945275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] PATH_INFO: `/v3/users/b4ff0c382a0c4b0089798b3fffd24223` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:51.949775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ff0c382a0c4b0089798b3fffd24223)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:51.952713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:51.961464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:51.964006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:52.026497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ff0c382a0c4b0089798b3fffd24223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:52.043569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ff0c382a0c4b0089798b3fffd24223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:52.055229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ff0c382a0c4b0089798b3fffd24223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:52.064227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ff0c382a0c4b0089798b3fffd24223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:52.065342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ff0c382a0c4b0089798b3fffd24223'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:52.076332 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1280/2548] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:48:51 2022] DELETE /identity/v3/users/b4ff0c382a0c4b0089798b3fffd24223 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:52.080665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ff630-2cbf-43f2-ac10-fba5f3e970b0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:52.199794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424184ea-8e29-4d91-bbc8-cfe7e9f3dfd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:52.201617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424184ea-8e29-4d91-bbc8-cfe7e9f3dfd4 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:52.202309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424184ea-8e29-4d91-bbc8-cfe7e9f3dfd4 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:52.202756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424184ea-8e29-4d91-bbc8-cfe7e9f3dfd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:52.205098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-424184ea-8e29-4d91-bbc8-cfe7e9f3dfd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:52.255891 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:52.318068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424184ea-8e29-4d91-bbc8-cfe7e9f3dfd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:52.319829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424184ea-8e29-4d91-bbc8-cfe7e9f3dfd4 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:52.336326 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1269/2549] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:52.998099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:53.007227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:53.093863 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:53.160144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdce9b-d805-45e3-8943-4a773e918b22 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:53.166199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:53.167289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:53.167687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:53.168134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] PATH_INFO: `/v3/projects/c8a40904cd7146fd8ff10f1455fe459f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:53.169863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a40904cd7146fd8ff10f1455fe459f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:53.172228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:53.253781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a40904cd7146fd8ff10f1455fe459f', 'request_id': 'req-d519f6fd-2c16-4dd1-a116-ab9194788958'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:53.268711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a40904cd7146fd8ff10f1455fe459f', 'request_id': 'req-d519f6fd-2c16-4dd1-a116-ab9194788958'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:53.277247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a40904cd7146fd8ff10f1455fe459f', 'request_id': 'req-d519f6fd-2c16-4dd1-a116-ab9194788958'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:53.298611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] The token cache is being invalidate because project c8a40904cd7146fd8ff10f1455fe459f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:48:53.299130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:53.301013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d519f6fd-2c16-4dd1-a116-ab9194788958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:48:53.303534 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1281/2550] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:48:52 2022] DELETE /identity/v3/projects/c8a40904cd7146fd8ff10f1455fe459f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:53.309933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b451c9-3534-4f26-bbf2-46b18ab24091 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:53.311434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b451c9-3534-4f26-bbf2-46b18ab24091 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:53.311434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b451c9-3534-4f26-bbf2-46b18ab24091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:53.333736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a1b451c9-3534-4f26-bbf2-46b18ab24091 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:53.334618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a1b451c9-3534-4f26-bbf2-46b18ab24091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:53.440361 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1270/2551] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:53.444481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a52a73-f436-4109-accd-d00ede0e1647 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:53.446560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a52a73-f436-4109-accd-d00ede0e1647 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:53.447242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a52a73-f436-4109-accd-d00ede0e1647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:53.486640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-70a52a73-f436-4109-accd-d00ede0e1647 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:53.493303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-70a52a73-f436-4109-accd-d00ede0e1647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:53.514549 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1282/2552] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:53.520058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b451c9-3534-4f26-bbf2-46b18ab24091 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:53.538424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b451c9-3534-4f26-bbf2-46b18ab24091 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:53.553516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69340-5bcd-4650-a411-90a6ac899a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:53.554302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69340-5bcd-4650-a411-90a6ac899a59 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:53.554580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69340-5bcd-4650-a411-90a6ac899a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:53.554852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69340-5bcd-4650-a411-90a6ac899a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:53.555500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba69340-5bcd-4650-a411-90a6ac899a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:48:53.555801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba69340-5bcd-4650-a411-90a6ac899a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:53.558041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba69340-5bcd-4650-a411-90a6ac899a59 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:53.579369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a52a73-f436-4109-accd-d00ede0e1647 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:53.580933 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1271/2553] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:48:53.592132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a52a73-f436-4109-accd-d00ede0e1647 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:53.598029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b3cf3-a42a-4b4d-9af5-3f0c828c8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:53.598733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b3cf3-a42a-4b4d-9af5-3f0c828c8e9b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:53.599017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b3cf3-a42a-4b4d-9af5-3f0c828c8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:53.599293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b3cf3-a42a-4b4d-9af5-3f0c828c8e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:53.599966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b3cf3-a42a-4b4d-9af5-3f0c828c8e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:53.602970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b3cf3-a42a-4b4d-9af5-3f0c828c8e9b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:53.656232 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1283/2554] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:48:53 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:48:53.656796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69340-5bcd-4650-a411-90a6ac899a59 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:53.671756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69340-5bcd-4650-a411-90a6ac899a59 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:53.774485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c61c4-0b71-4ebf-8254-386b3438e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:53.775286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c61c4-0b71-4ebf-8254-386b3438e04b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:53.776472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c61c4-0b71-4ebf-8254-386b3438e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:53.776803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c61c4-0b71-4ebf-8254-386b3438e04b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:53.777463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c61c4-0b71-4ebf-8254-386b3438e04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:53.780858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c61c4-0b71-4ebf-8254-386b3438e04b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:53.815552 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1272/2555] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:48:53 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:48:53.819434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b3cf3-a42a-4b4d-9af5-3f0c828c8e9b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:53.840805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b3cf3-a42a-4b4d-9af5-3f0c828c8e9b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:53.852431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134605e1-8e83-408c-86be-299bc0b78a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:53.853837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134605e1-8e83-408c-86be-299bc0b78a1d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:53.854994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134605e1-8e83-408c-86be-299bc0b78a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:53.857811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134605e1-8e83-408c-86be-299bc0b78a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:53.858889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134605e1-8e83-408c-86be-299bc0b78a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:53.860996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134605e1-8e83-408c-86be-299bc0b78a1d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:53.891518 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1284/2556] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:53.896035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c61c4-0b71-4ebf-8254-386b3438e04b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:53.909657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c61c4-0b71-4ebf-8254-386b3438e04b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:53.922697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63098d25-b305-48e7-85dc-26df3a8e4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:53.923502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63098d25-b305-48e7-85dc-26df3a8e4b60 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:53.923790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63098d25-b305-48e7-85dc-26df3a8e4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:53.924063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63098d25-b305-48e7-85dc-26df3a8e4b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:53.924752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63098d25-b305-48e7-85dc-26df3a8e4b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:53.926440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63098d25-b305-48e7-85dc-26df3a8e4b60 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:53.945619 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1273/2557] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:48:53.951865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134605e1-8e83-408c-86be-299bc0b78a1d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:53.974044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134605e1-8e83-408c-86be-299bc0b78a1d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:53.981024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e75a85-eef2-4f28-aa0c-b6a89eafcf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:53.982675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e75a85-eef2-4f28-aa0c-b6a89eafcf51 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:53.983209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e75a85-eef2-4f28-aa0c-b6a89eafcf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:53.984351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e75a85-eef2-4f28-aa0c-b6a89eafcf51 admin admin] PATH_INFO: `/v3/projects/8d60a9bdaee646508bf9f42d390191d3/users/2a896789dc814debba3a0a8f8f0c8943/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:54.014545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e75a85-eef2-4f28-aa0c-b6a89eafcf51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d60a9bdaee646508bf9f42d390191d3, user_id=2a896789dc814debba3a0a8f8f0c8943, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:54.019837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e75a85-eef2-4f28-aa0c-b6a89eafcf51 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:54.056946 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1285/2558] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:48:53 2022] PUT /identity/v3/projects/8d60a9bdaee646508bf9f42d390191d3/users/2a896789dc814debba3a0a8f8f0c8943/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:48:54.058134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6a87f-6bee-4f73-a995-aa45d382ef5f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:54.061213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6a87f-6bee-4f73-a995-aa45d382ef5f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:54.061500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6a87f-6bee-4f73-a995-aa45d382ef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:54.104577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-02d6a87f-6bee-4f73-a995-aa45d382ef5f None None] MFA Rules not processed for user `2a896789dc814debba3a0a8f8f0c8943`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:54.105971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-02d6a87f-6bee-4f73-a995-aa45d382ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:54.139389 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:54.258742 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1274/2559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:54.269568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a0305-e5d2-419e-b7a5-843d1ce0fca3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:54.269921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a0305-e5d2-419e-b7a5-843d1ce0fca3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:54.270264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a0305-e5d2-419e-b7a5-843d1ce0fca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:54.330845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3f1a0305-e5d2-419e-b7a5-843d1ce0fca3 None None] MFA Rules not processed for user `2a896789dc814debba3a0a8f8f0c8943`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:54.349481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3f1a0305-e5d2-419e-b7a5-843d1ce0fca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:54.390719 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1286/2560] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:55.307449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6a87f-6bee-4f73-a995-aa45d382ef5f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:55.309203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-02d6a87f-6bee-4f73-a995-aa45d382ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:55.453990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6a87f-6bee-4f73-a995-aa45d382ef5f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:55.462004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476754f-8d71-4cba-a932-7a801436976c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:55.462947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476754f-8d71-4cba-a932-7a801436976c service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:55.463404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476754f-8d71-4cba-a932-7a801436976c service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:55.463963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476754f-8d71-4cba-a932-7a801436976c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:55.476958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476754f-8d71-4cba-a932-7a801436976c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:55.482852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476754f-8d71-4cba-a932-7a801436976c service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:55.514426 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1275/2561] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:56.393278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a0305-e5d2-419e-b7a5-843d1ce0fca3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:56.394793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3f1a0305-e5d2-419e-b7a5-843d1ce0fca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:56.525233 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:56.572881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a0305-e5d2-419e-b7a5-843d1ce0fca3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:56.588911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:56.589559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:56.589918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:56.590100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:56.592170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:56.624781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:56.626563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:56.660845 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1287/2562] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:48:57.959918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10269041-fcd6-464f-8835-ee5a36e93f57 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:57.960556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10269041-fcd6-464f-8835-ee5a36e93f57 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:57.960556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10269041-fcd6-464f-8835-ee5a36e93f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:58.032415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-10269041-fcd6-464f-8835-ee5a36e93f57 None None] MFA Rules not processed for user `c10bfa3078e14866b10189c65037c2de`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:48:58.033789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-10269041-fcd6-464f-8835-ee5a36e93f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:58.203495 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1276/2563] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:48:59.792475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:59.797058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:59.843224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10269041-fcd6-464f-8835-ee5a36e93f57 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:59.846062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-10269041-fcd6-464f-8835-ee5a36e93f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:59.868102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10269041-fcd6-464f-8835-ee5a36e93f57 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:59.891232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7bac-8c2e-4255-9dbc-a7924abeb59d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:59.892213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7bac-8c2e-4255-9dbc-a7924abeb59d service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:59.892479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7bac-8c2e-4255-9dbc-a7924abeb59d service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:59.892954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7bac-8c2e-4255-9dbc-a7924abeb59d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:59.904044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d7bac-8c2e-4255-9dbc-a7924abeb59d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:59.905603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20722b33-45db-4b99-986c-a6d4c34bef36 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:59.906948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d7bac-8c2e-4255-9dbc-a7924abeb59d service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:59.909838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425df1e4-1bae-4547-a33b-9b07994457a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:59.910703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425df1e4-1bae-4547-a33b-9b07994457a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:59.911061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425df1e4-1bae-4547-a33b-9b07994457a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:59.911408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425df1e4-1bae-4547-a33b-9b07994457a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:59.913545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-425df1e4-1bae-4547-a33b-9b07994457a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:59.923412 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1277/2564] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:59.924392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7bac-8c2e-4255-9dbc-a7924abeb59d service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:48:59.926129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-409d7bac-8c2e-4255-9dbc-a7924abeb59d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:59.933452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425df1e4-1bae-4547-a33b-9b07994457a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:59.938888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425df1e4-1bae-4547-a33b-9b07994457a3 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:59.950649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7bac-8c2e-4255-9dbc-a7924abeb59d service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:48:59.962164 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1288/2565] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:48:59.963108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b64e7-da00-4a82-a9e2-c1dbad08a8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:48:59.963998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b64e7-da00-4a82-a9e2-c1dbad08a8fc service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:48:59.964352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b64e7-da00-4a82-a9e2-c1dbad08a8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:48:59.965124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b64e7-da00-4a82-a9e2-c1dbad08a8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:48:59.967606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-001b64e7-da00-4a82-a9e2-c1dbad08a8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:48:59.981194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b64e7-da00-4a82-a9e2-c1dbad08a8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:48:59.984575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b64e7-da00-4a82-a9e2-c1dbad08a8fc service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:48:59.995637 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1278/2566] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:48:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:01.710194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0d83-e79b-4775-b220-66d4eb5f07e3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:01.710738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0d83-e79b-4775-b220-66d4eb5f07e3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:01.710827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0d83-e79b-4775-b220-66d4eb5f07e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:01.770582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-eb8c0d83-e79b-4775-b220-66d4eb5f07e3 None None] MFA Rules not processed for user `c5bef756c5c74e688ded867d98a6d29a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:01.772307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eb8c0d83-e79b-4775-b220-66d4eb5f07e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:01.935611 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1289/2567] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:05.133039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b64e7-da00-4a82-a9e2-c1dbad08a8fc service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:05.154584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b64e7-da00-4a82-a9e2-c1dbad08a8fc service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:05.167238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630d74-937e-45a2-82f1-b72391eccc25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:05.167878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630d74-937e-45a2-82f1-b72391eccc25 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:05.168162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630d74-937e-45a2-82f1-b72391eccc25 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:05.168433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630d74-937e-45a2-82f1-b72391eccc25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:05.174096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-28630d74-937e-45a2-82f1-b72391eccc25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:05.205592 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:05.209715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28630d74-937e-45a2-82f1-b72391eccc25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:05.212221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28630d74-937e-45a2-82f1-b72391eccc25 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:05.252752 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1279/2568] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:11.916484 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=64 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:12.582769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0d83-e79b-4775-b220-66d4eb5f07e3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:12.584309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eb8c0d83-e79b-4775-b220-66d4eb5f07e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:12.750505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0d83-e79b-4775-b220-66d4eb5f07e3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:12.762851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:12.763534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:12.763853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:12.764129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] PATH_INFO: `/v3/users/80f50eb98d76433eacaa60c62d94ad69` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:12.765385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f50eb98d76433eacaa60c62d94ad69)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:12.767345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:12.841772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f50eb98d76433eacaa60c62d94ad69'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:12.865555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f50eb98d76433eacaa60c62d94ad69'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:12.876378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f50eb98d76433eacaa60c62d94ad69'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:12.886577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f50eb98d76433eacaa60c62d94ad69'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:12.887432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55878827-b03d-49e7-a04c-bf50f669067f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f50eb98d76433eacaa60c62d94ad69'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:12.894659 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1290/2569] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:12 2022] DELETE /identity/v3/users/80f50eb98d76433eacaa60c62d94ad69 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:13.251774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630d74-937e-45a2-82f1-b72391eccc25 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:13.296818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630d74-937e-45a2-82f1-b72391eccc25 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:13.494536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:13.495673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:13.496212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:13.496795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] PATH_INFO: `/v3/projects/924c4188dbcd4bcbb4cc76aed769c0c1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:13.499092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] RBAC: Authorizing `identity:delete_project(project_id=924c4188dbcd4bcbb4cc76aed769c0c1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:13.504167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:13.626808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924c4188dbcd4bcbb4cc76aed769c0c1', 'request_id': 'req-dc0599f5-bd62-4c04-9db7-060a4d67975c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:13.673864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924c4188dbcd4bcbb4cc76aed769c0c1', 'request_id': 'req-dc0599f5-bd62-4c04-9db7-060a4d67975c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:13.689813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924c4188dbcd4bcbb4cc76aed769c0c1', 'request_id': 'req-dc0599f5-bd62-4c04-9db7-060a4d67975c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:13.738252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] The token cache is being invalidate because project 924c4188dbcd4bcbb4cc76aed769c0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:13.738618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:13.739376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dc0599f5-bd62-4c04-9db7-060a4d67975c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:13.745535 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1280/2570] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:13 2022] DELETE /identity/v3/projects/924c4188dbcd4bcbb4cc76aed769c0c1 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:13.748380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1ff46-fc8e-4a4c-b313-86ce995f50e6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:13.748944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1ff46-fc8e-4a4c-b313-86ce995f50e6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:13.748944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1ff46-fc8e-4a4c-b313-86ce995f50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:13.799720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-18c1ff46-fc8e-4a4c-b313-86ce995f50e6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:13.801366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-18c1ff46-fc8e-4a4c-b313-86ce995f50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:13.913510 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1291/2571] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:13.915251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546fe5-ec71-446a-a0ce-caed00da7c8d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:13.915538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546fe5-ec71-446a-a0ce-caed00da7c8d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:13.915812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546fe5-ec71-446a-a0ce-caed00da7c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:13.939018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-83546fe5-ec71-446a-a0ce-caed00da7c8d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:13.941296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-83546fe5-ec71-446a-a0ce-caed00da7c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:13.954035 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1281/2572] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:13.958082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1ff46-fc8e-4a4c-b313-86ce995f50e6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:13.969992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1ff46-fc8e-4a4c-b313-86ce995f50e6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:13.975626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb97a6-21d0-4a05-8700-d82f3378dc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:13.976900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb97a6-21d0-4a05-8700-d82f3378dc6c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:13.976900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb97a6-21d0-4a05-8700-d82f3378dc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:13.977301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb97a6-21d0-4a05-8700-d82f3378dc6c admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:13.978170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb97a6-21d0-4a05-8700-d82f3378dc6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:13.978579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb97a6-21d0-4a05-8700-d82f3378dc6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:13.980574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb97a6-21d0-4a05-8700-d82f3378dc6c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:13.993938 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1292/2573] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:49:13.999460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83546fe5-ec71-446a-a0ce-caed00da7c8d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:14.008958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83546fe5-ec71-446a-a0ce-caed00da7c8d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:14.015235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dc635-afee-483f-8bc7-f5c5c6ee51e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:14.015866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dc635-afee-483f-8bc7-f5c5c6ee51e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:14.016181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dc635-afee-483f-8bc7-f5c5c6ee51e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:14.016413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dc635-afee-483f-8bc7-f5c5c6ee51e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:14.017381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dc635-afee-483f-8bc7-f5c5c6ee51e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:14.019328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dc635-afee-483f-8bc7-f5c5c6ee51e1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:14.058314 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1282/2574] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:13 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:14.061969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb97a6-21d0-4a05-8700-d82f3378dc6c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:14.077939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb97a6-21d0-4a05-8700-d82f3378dc6c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:14.094089 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:14.189396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e460bab-45c5-4397-9ae8-9924d2c18125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:14.190874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460bab-45c5-4397-9ae8-9924d2c18125 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:14.191586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460bab-45c5-4397-9ae8-9924d2c18125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:14.192307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460bab-45c5-4397-9ae8-9924d2c18125 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:14.193636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e460bab-45c5-4397-9ae8-9924d2c18125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:14.197797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e460bab-45c5-4397-9ae8-9924d2c18125 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:14.247617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dc635-afee-483f-8bc7-f5c5c6ee51e1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:14.259245 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1293/2575] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:14 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:14.264819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dc635-afee-483f-8bc7-f5c5c6ee51e1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:14.272143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adc74e-52c1-467b-be12-71ef46e23597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:14.272956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc74e-52c1-467b-be12-71ef46e23597 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:14.273490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc74e-52c1-467b-be12-71ef46e23597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:14.273977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc74e-52c1-467b-be12-71ef46e23597 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:14.274738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adc74e-52c1-467b-be12-71ef46e23597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:14.276453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adc74e-52c1-467b-be12-71ef46e23597 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:14.291764 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1283/2576] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:14.298959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e460bab-45c5-4397-9ae8-9924d2c18125 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:14.313868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e460bab-45c5-4397-9ae8-9924d2c18125 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:14.319015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93285d7-c81e-491e-9b4c-672423f172ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:14.319704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93285d7-c81e-491e-9b4c-672423f172ed admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:14.319885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93285d7-c81e-491e-9b4c-672423f172ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:14.320203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93285d7-c81e-491e-9b4c-672423f172ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:14.320859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93285d7-c81e-491e-9b4c-672423f172ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:14.322800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93285d7-c81e-491e-9b4c-672423f172ed admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:14.342303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adc74e-52c1-467b-be12-71ef46e23597 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:14.343234 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1294/2577] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:49:14.357017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adc74e-52c1-467b-be12-71ef46e23597 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:14.362269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eda48a-eace-4021-8b3b-cf4967911bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:14.363029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eda48a-eace-4021-8b3b-cf4967911bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:14.363522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eda48a-eace-4021-8b3b-cf4967911bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:14.363870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eda48a-eace-4021-8b3b-cf4967911bdd admin admin] PATH_INFO: `/v3/projects/b9790689725747ce8c1b18cdefb12c85/users/f8b9d723cf9f4786a444cc1a33857abb/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:14.383498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eda48a-eace-4021-8b3b-cf4967911bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9790689725747ce8c1b18cdefb12c85, user_id=f8b9d723cf9f4786a444cc1a33857abb, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:14.397712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eda48a-eace-4021-8b3b-cf4967911bdd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:14.442690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734db67e-41b4-4063-b6da-594161fb5771 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:14.443110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734db67e-41b4-4063-b6da-594161fb5771 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:14.443519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734db67e-41b4-4063-b6da-594161fb5771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:14.447064 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1284/2578] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:14 2022] PUT /identity/v3/projects/b9790689725747ce8c1b18cdefb12c85/users/f8b9d723cf9f4786a444cc1a33857abb/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:14.473733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-734db67e-41b4-4063-b6da-594161fb5771 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:14.474972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-734db67e-41b4-4063-b6da-594161fb5771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:14.563104 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1295/2579] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:14.573521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eda48a-eace-4021-8b3b-cf4967911bdd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:14.576337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b4eda48a-eace-4021-8b3b-cf4967911bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:14.607493 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:14.647252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eda48a-eace-4021-8b3b-cf4967911bdd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:14.651375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8b932-6784-4537-baa1-a35118fef25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:14.652052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8b932-6784-4537-baa1-a35118fef25a service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:14.652342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8b932-6784-4537-baa1-a35118fef25a service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:14.652644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8b932-6784-4537-baa1-a35118fef25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:14.666571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8b932-6784-4537-baa1-a35118fef25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:14.668070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8b932-6784-4537-baa1-a35118fef25a service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:14.680468 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1285/2580] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:15.094366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d739-f4c9-41ba-b3a4-e278a9a1b106 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:15.099376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d739-f4c9-41ba-b3a4-e278a9a1b106 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:15.099659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d739-f4c9-41ba-b3a4-e278a9a1b106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:15.145674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b894d739-f4c9-41ba-b3a4-e278a9a1b106 None None] MFA Rules not processed for user `5d0158da7efc485ebd6a1e1db617b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:15.149413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b894d739-f4c9-41ba-b3a4-e278a9a1b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:15.250947 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1296/2581] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:17.100474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8b932-6784-4537-baa1-a35118fef25a service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:17.102756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-93d8b932-6784-4537-baa1-a35118fef25a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:17.131605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8b932-6784-4537-baa1-a35118fef25a service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:17.139514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:17.141222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:17.142865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:17.143544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:17.148520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:17.289220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:17.292841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:17.307944 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1286/2582] 10.222.0.27 () {60 vars in 1396 bytes} [Wed Oct 19 00:49:17 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:20.082556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d739-f4c9-41ba-b3a4-e278a9a1b106 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:20.085407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b894d739-f4c9-41ba-b3a4-e278a9a1b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:20.149498 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:20.216932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d739-f4c9-41ba-b3a4-e278a9a1b106 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:20.227658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73333c5a-219b-4708-8f4a-38b46086bc2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:20.228338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73333c5a-219b-4708-8f4a-38b46086bc2c service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:20.228593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73333c5a-219b-4708-8f4a-38b46086bc2c service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:20.230443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73333c5a-219b-4708-8f4a-38b46086bc2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:20.234949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-73333c5a-219b-4708-8f4a-38b46086bc2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:20.261361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73333c5a-219b-4708-8f4a-38b46086bc2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:20.263324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73333c5a-219b-4708-8f4a-38b46086bc2c service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:20.280964 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1297/2583] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:23.555899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:23.557824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:23.672101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d9643-ce8f-4db9-b7e5-969c4c7bcf84 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:23.679553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4879f-e0e1-418f-ac85-6dd02ce575ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:23.680332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4879f-e0e1-418f-ac85-6dd02ce575ae service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:23.681103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4879f-e0e1-418f-ac85-6dd02ce575ae service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:23.681522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4879f-e0e1-418f-ac85-6dd02ce575ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:23.684158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-acd4879f-e0e1-418f-ac85-6dd02ce575ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:23.706268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4879f-e0e1-418f-ac85-6dd02ce575ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:23.708500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4879f-e0e1-418f-ac85-6dd02ce575ae service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:23.720738 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1287/2584] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:24.998843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6802-c8dc-45ff-a846-8d90c159b587 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:24.999372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6802-c8dc-45ff-a846-8d90c159b587 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:24.999372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6802-c8dc-45ff-a846-8d90c159b587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:25.039424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1bcb6802-c8dc-45ff-a846-8d90c159b587 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:25.057205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1bcb6802-c8dc-45ff-a846-8d90c159b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:25.163097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8fbef-998f-446d-a42f-fadd012da788 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:25.163584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8fbef-998f-446d-a42f-fadd012da788 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:25.163735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8fbef-998f-446d-a42f-fadd012da788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:25.269175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ead8fbef-998f-446d-a42f-fadd012da788 None None] MFA Rules not processed for user `f8b9d723cf9f4786a444cc1a33857abb`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:25.270829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ead8fbef-998f-446d-a42f-fadd012da788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:25.304981 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1298/2585] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:25.330318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6802-c8dc-45ff-a846-8d90c159b587 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:25.332182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1bcb6802-c8dc-45ff-a846-8d90c159b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:25.492455 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:25.552321 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1288/2586] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:25.558827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6802-c8dc-45ff-a846-8d90c159b587 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:25.564443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1997-cd7e-4a3d-8863-c5d7a89f25b0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:25.565188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1997-cd7e-4a3d-8863-c5d7a89f25b0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:25.566171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1997-cd7e-4a3d-8863-c5d7a89f25b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:25.570199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b541c1-badc-4da3-9da3-9c01343596f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:25.570959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b541c1-badc-4da3-9da3-9c01343596f4 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:25.571269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b541c1-badc-4da3-9da3-9c01343596f4 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:25.571603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b541c1-badc-4da3-9da3-9c01343596f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:25.598530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b541c1-badc-4da3-9da3-9c01343596f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:25.600717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b541c1-badc-4da3-9da3-9c01343596f4 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:25.620480 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1299/2587] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:49:25.667110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ed4e1997-cd7e-4a3d-8863-c5d7a89f25b0 None None] MFA Rules not processed for user `f8b9d723cf9f4786a444cc1a33857abb`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:25.669648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ed4e1997-cd7e-4a3d-8863-c5d7a89f25b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:25.705607 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1289/2588] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:25.990152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b541c1-badc-4da3-9da3-9c01343596f4 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:25.991999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-98b541c1-badc-4da3-9da3-9c01343596f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:26.036723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b541c1-badc-4da3-9da3-9c01343596f4 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:26.061408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d64ff-2ba6-4d98-b324-575676a40c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:26.070886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d64ff-2ba6-4d98-b324-575676a40c52 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:26.071186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d64ff-2ba6-4d98-b324-575676a40c52 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:26.071463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d64ff-2ba6-4d98-b324-575676a40c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:26.100717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d64ff-2ba6-4d98-b324-575676a40c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:26.102347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d64ff-2ba6-4d98-b324-575676a40c52 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:26.161393 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1300/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:27.337029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1997-cd7e-4a3d-8863-c5d7a89f25b0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:27.348263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1997-cd7e-4a3d-8863-c5d7a89f25b0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:27.353386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e13bae-dd2e-422b-a629-725820c00e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:27.354751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e13bae-dd2e-422b-a629-725820c00e1b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:27.356335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e13bae-dd2e-422b-a629-725820c00e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:27.356898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e13bae-dd2e-422b-a629-725820c00e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:27.359879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-01e13bae-dd2e-422b-a629-725820c00e1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:27.375390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e13bae-dd2e-422b-a629-725820c00e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:27.377377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e13bae-dd2e-422b-a629-725820c00e1b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:27.410250 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1290/2590] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:27.464428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d64ff-2ba6-4d98-b324-575676a40c52 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:27.482200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d64ff-2ba6-4d98-b324-575676a40c52 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:27.497611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f72381-57b0-4931-802a-ad0a6d6829aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:27.505452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f72381-57b0-4931-802a-ad0a6d6829aa service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:27.507366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f72381-57b0-4931-802a-ad0a6d6829aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:27.509962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f72381-57b0-4931-802a-ad0a6d6829aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:27.512525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-67f72381-57b0-4931-802a-ad0a6d6829aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:27.536666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f72381-57b0-4931-802a-ad0a6d6829aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:27.539506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f72381-57b0-4931-802a-ad0a6d6829aa service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:27.561853 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1301/2591] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:28.332041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37357f8-197f-4dab-9626-f90f5ba9826c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:28.332041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37357f8-197f-4dab-9626-f90f5ba9826c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:28.332041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37357f8-197f-4dab-9626-f90f5ba9826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:28.394901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f37357f8-197f-4dab-9626-f90f5ba9826c None None] MFA Rules not processed for user `2ab51886a81f4e1194e0c1ac50eef9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:28.404924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f37357f8-197f-4dab-9626-f90f5ba9826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:28.653564 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1291/2592] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:34.453145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234fb8e-aeae-4b66-bc0a-802a4f3c35c7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:34.453145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234fb8e-aeae-4b66-bc0a-802a4f3c35c7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:34.454399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234fb8e-aeae-4b66-bc0a-802a4f3c35c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:34.487283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f234fb8e-aeae-4b66-bc0a-802a4f3c35c7 None None] MFA Rules not processed for user `a24b98f6af634c61af828bb20ce1e945`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:34.492109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f234fb8e-aeae-4b66-bc0a-802a4f3c35c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:34.538068 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:34.646586 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1302/2593] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:49:38.435947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37357f8-197f-4dab-9626-f90f5ba9826c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:38.488701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37357f8-197f-4dab-9626-f90f5ba9826c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:38.504708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92581ac2-0a72-4c7b-9e2b-09694fcc30fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:38.505707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581ac2-0a72-4c7b-9e2b-09694fcc30fd service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:38.506421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581ac2-0a72-4c7b-9e2b-09694fcc30fd service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:38.507256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92581ac2-0a72-4c7b-9e2b-09694fcc30fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:38.509636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-92581ac2-0a72-4c7b-9e2b-09694fcc30fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:38.525056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92581ac2-0a72-4c7b-9e2b-09694fcc30fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:38.529205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92581ac2-0a72-4c7b-9e2b-09694fcc30fd service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:38.544468 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1292/2594] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:39.318509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234fb8e-aeae-4b66-bc0a-802a4f3c35c7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:39.326109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f234fb8e-aeae-4b66-bc0a-802a4f3c35c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:39.362244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234fb8e-aeae-4b66-bc0a-802a4f3c35c7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:39.390101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:39.390764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:39.391246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:39.391682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] PATH_INFO: `/v3/users/c10bfa3078e14866b10189c65037c2de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:39.401683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10bfa3078e14866b10189c65037c2de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:39.403946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:39.519247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10bfa3078e14866b10189c65037c2de'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.560655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10bfa3078e14866b10189c65037c2de'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.579684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10bfa3078e14866b10189c65037c2de'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.599135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10bfa3078e14866b10189c65037c2de'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.600128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21530a4f-8b93-49b3-8953-f5db3d1fe21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10bfa3078e14866b10189c65037c2de'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:39.612703 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1303/2595] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:49:39 2022] DELETE /identity/v3/users/c10bfa3078e14866b10189c65037c2de => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:40.487164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92581ac2-0a72-4c7b-9e2b-09694fcc30fd service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:40.520542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92581ac2-0a72-4c7b-9e2b-09694fcc30fd service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:40.678839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:40.679660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:40.680014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:40.680291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] PATH_INFO: `/v3/projects/dbd865e323184a67ae37cb93f7334adb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:40.681878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd865e323184a67ae37cb93f7334adb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:40.685987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:40.811268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd865e323184a67ae37cb93f7334adb', 'request_id': 'req-127bfbe0-0593-4b4a-858a-3b3462f319b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:40.832073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd865e323184a67ae37cb93f7334adb', 'request_id': 'req-127bfbe0-0593-4b4a-858a-3b3462f319b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:40.853836 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:40.875607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd865e323184a67ae37cb93f7334adb', 'request_id': 'req-127bfbe0-0593-4b4a-858a-3b3462f319b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:40.945863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] The token cache is being invalidate because project dbd865e323184a67ae37cb93f7334adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:49:40.947375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:40.952027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-127bfbe0-0593-4b4a-858a-3b3462f319b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:49:40.959171 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1293/2596] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:40 2022] DELETE /identity/v3/projects/dbd865e323184a67ae37cb93f7334adb => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:49:40.967835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6893dd-7ad4-469d-ab09-976c7dcb2efa None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:40.968307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6893dd-7ad4-469d-ab09-976c7dcb2efa None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:40.968417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6893dd-7ad4-469d-ab09-976c7dcb2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:41.058269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7e6893dd-7ad4-469d-ab09-976c7dcb2efa None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:41.065887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7e6893dd-7ad4-469d-ab09-976c7dcb2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:41.275406 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1304/2597] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:41.284471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be51980-fbcf-4767-8fe8-870c702c7161 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:41.285209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be51980-fbcf-4767-8fe8-870c702c7161 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:41.285705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be51980-fbcf-4767-8fe8-870c702c7161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:41.329535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4be51980-fbcf-4767-8fe8-870c702c7161 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:41.332116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4be51980-fbcf-4767-8fe8-870c702c7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:41.361231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6893dd-7ad4-469d-ab09-976c7dcb2efa None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:41.362170 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1294/2598] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:41.377791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6893dd-7ad4-469d-ab09-976c7dcb2efa None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:41.393076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5712757-76b5-4e2b-aec2-a937720d7359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:41.393750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5712757-76b5-4e2b-aec2-a937720d7359 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:41.394030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5712757-76b5-4e2b-aec2-a937720d7359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:41.395773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5712757-76b5-4e2b-aec2-a937720d7359 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:41.396588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5712757-76b5-4e2b-aec2-a937720d7359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:49:41.396818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5712757-76b5-4e2b-aec2-a937720d7359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:41.400400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5712757-76b5-4e2b-aec2-a937720d7359 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:41.457641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1305/2599] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:49:41.462188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be51980-fbcf-4767-8fe8-870c702c7161 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:41.479546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be51980-fbcf-4767-8fe8-870c702c7161 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:41.500400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fbcd0-7479-404b-bb65-ca39fe80179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:41.501163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbcd0-7479-404b-bb65-ca39fe80179c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:41.501340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbcd0-7479-404b-bb65-ca39fe80179c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:41.506239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbcd0-7479-404b-bb65-ca39fe80179c admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:41.507975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbcd0-7479-404b-bb65-ca39fe80179c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:41.511482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbcd0-7479-404b-bb65-ca39fe80179c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:41.633872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5712757-76b5-4e2b-aec2-a937720d7359 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:41.636551 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1295/2600] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:49:41 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:41.653719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5712757-76b5-4e2b-aec2-a937720d7359 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:41.758864 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:41.871332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5099e1-358c-49e4-8cb3-a0449e0523df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:41.872159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5099e1-358c-49e4-8cb3-a0449e0523df admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:41.872551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5099e1-358c-49e4-8cb3-a0449e0523df admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:41.872980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5099e1-358c-49e4-8cb3-a0449e0523df admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:41.878176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5099e1-358c-49e4-8cb3-a0449e0523df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:41.881954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5099e1-358c-49e4-8cb3-a0449e0523df admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:41.980449 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1306/2601] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:49:41 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:49:41.985243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fbcd0-7479-404b-bb65-ca39fe80179c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:42.014306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fbcd0-7479-404b-bb65-ca39fe80179c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:42.026060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ad776-0b63-4957-b953-844c358e8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:42.027973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ad776-0b63-4957-b953-844c358e8b42 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:42.029137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ad776-0b63-4957-b953-844c358e8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:42.029868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ad776-0b63-4957-b953-844c358e8b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:42.033454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ad776-0b63-4957-b953-844c358e8b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:42.038722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ad776-0b63-4957-b953-844c358e8b42 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:42.079054 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1296/2602] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:42.085111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5099e1-358c-49e4-8cb3-a0449e0523df admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:42.114969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5099e1-358c-49e4-8cb3-a0449e0523df admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:42.135917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e416b6-b8b3-4d0a-8047-548aecf2486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:42.138179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e416b6-b8b3-4d0a-8047-548aecf2486f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:42.138508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e416b6-b8b3-4d0a-8047-548aecf2486f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:42.139629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e416b6-b8b3-4d0a-8047-548aecf2486f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:42.144962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e416b6-b8b3-4d0a-8047-548aecf2486f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:42.147657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e416b6-b8b3-4d0a-8047-548aecf2486f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:42.174013 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1307/2603] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:49:42.177091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ad776-0b63-4957-b953-844c358e8b42 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:42.224147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ad776-0b63-4957-b953-844c358e8b42 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:42.233581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466b64f-ac8a-4d53-966a-4a1455f4de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:42.234321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b64f-ac8a-4d53-966a-4a1455f4de27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:42.234531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b64f-ac8a-4d53-966a-4a1455f4de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:42.234809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b64f-ac8a-4d53-966a-4a1455f4de27 admin admin] PATH_INFO: `/v3/projects/9bd2de014bb94e17824f48a23cd16a65/users/85b59e131dd940b1b397f5ed429c814f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:42.305367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466b64f-ac8a-4d53-966a-4a1455f4de27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd2de014bb94e17824f48a23cd16a65, user_id=85b59e131dd940b1b397f5ed429c814f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:42.308502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466b64f-ac8a-4d53-966a-4a1455f4de27 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:42.339652 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1297/2604] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:49:42 2022] PUT /identity/v3/projects/9bd2de014bb94e17824f48a23cd16a65/users/85b59e131dd940b1b397f5ed429c814f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:49:42.346266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99fe6e-826b-4637-b0d7-acd8fcfe3244 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:42.346739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99fe6e-826b-4637-b0d7-acd8fcfe3244 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:42.347017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99fe6e-826b-4637-b0d7-acd8fcfe3244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:42.426377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fa99fe6e-826b-4637-b0d7-acd8fcfe3244 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:42.428763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fa99fe6e-826b-4637-b0d7-acd8fcfe3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:42.563878 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1308/2605] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:42.579477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466b64f-ac8a-4d53-966a-4a1455f4de27 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:42.581387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6466b64f-ac8a-4d53-966a-4a1455f4de27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:42.900989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466b64f-ac8a-4d53-966a-4a1455f4de27 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:42.930078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0c51e-abd5-4be7-8680-0ccddf07c25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:42.934371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0c51e-abd5-4be7-8680-0ccddf07c25c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:42.934880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0c51e-abd5-4be7-8680-0ccddf07c25c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:42.935376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0c51e-abd5-4be7-8680-0ccddf07c25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:42.971828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0c51e-abd5-4be7-8680-0ccddf07c25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:42.974542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0c51e-abd5-4be7-8680-0ccddf07c25c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:42.995516 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1298/2606] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:47.367551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99fe6e-826b-4637-b0d7-acd8fcfe3244 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:47.371275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fa99fe6e-826b-4637-b0d7-acd8fcfe3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:47.803139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99fe6e-826b-4637-b0d7-acd8fcfe3244 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:47.838104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:47.841488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:47.842052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:47.844691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:47.851200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:47.883772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:47.887046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:47.911341 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1309/2607] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:49.371495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0c51e-abd5-4be7-8680-0ccddf07c25c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:49.390704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0c51e-abd5-4be7-8680-0ccddf07c25c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:49.411327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddc55a-dc59-41df-a848-ff415ce0121b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:49.414696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddc55a-dc59-41df-a848-ff415ce0121b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:49.414981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddc55a-dc59-41df-a848-ff415ce0121b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:49.419062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddc55a-dc59-41df-a848-ff415ce0121b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:49.427954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-31ddc55a-dc59-41df-a848-ff415ce0121b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:49.500578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddc55a-dc59-41df-a848-ff415ce0121b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:49.500578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddc55a-dc59-41df-a848-ff415ce0121b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:49.536143 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1299/2608] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:53.767619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:53.769180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:53.957670 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:54.022797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b308b-68f5-4748-9466-d432c0813595 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:54.030792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:54.031230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:54.031612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:54.031992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:54.034803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:54.154090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:54.157189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:54.183782 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1310/2609] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:49:56.275046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639909eb-6d87-4b14-8205-3a3a8ad0e487 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:56.277100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639909eb-6d87-4b14-8205-3a3a8ad0e487 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:56.277580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639909eb-6d87-4b14-8205-3a3a8ad0e487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:56.311293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-639909eb-6d87-4b14-8205-3a3a8ad0e487 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:56.314243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-639909eb-6d87-4b14-8205-3a3a8ad0e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:56.503363 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1300/2610] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 00:49:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:49:56.513435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:56.520290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:56.799695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fe8b7-91c0-492f-991e-109490c18e30 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:56.825306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc579a8-d7cd-4986-9a82-7bb9ec91e9b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:56.826094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc579a8-d7cd-4986-9a82-7bb9ec91e9b3 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:56.827738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc579a8-d7cd-4986-9a82-7bb9ec91e9b3 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:56.834371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc579a8-d7cd-4986-9a82-7bb9ec91e9b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:56.861302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc579a8-d7cd-4986-9a82-7bb9ec91e9b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:56.879137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc579a8-d7cd-4986-9a82-7bb9ec91e9b3 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:56.911531 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1311/2611] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:49:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:49:59.636141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11503c-4752-4b78-b34b-962df5b6187b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:59.637447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11503c-4752-4b78-b34b-962df5b6187b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:59.637912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11503c-4752-4b78-b34b-962df5b6187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:59.698069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6c11503c-4752-4b78-b34b-962df5b6187b None None] MFA Rules not processed for user `85b59e131dd940b1b397f5ed429c814f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:49:59.700216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6c11503c-4752-4b78-b34b-962df5b6187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:59.715602 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:59.896935 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1301/2612] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:49:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:00.424242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc579a8-d7cd-4986-9a82-7bb9ec91e9b3 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:00.429282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ebc579a8-d7cd-4986-9a82-7bb9ec91e9b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:00.616220 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:00.653562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc579a8-d7cd-4986-9a82-7bb9ec91e9b3 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:00.682811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042185e3-d40b-4ad9-96a7-10409b53eca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:00.685100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042185e3-d40b-4ad9-96a7-10409b53eca8 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:00.686032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042185e3-d40b-4ad9-96a7-10409b53eca8 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:00.687233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042185e3-d40b-4ad9-96a7-10409b53eca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:00.708676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042185e3-d40b-4ad9-96a7-10409b53eca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:00.712536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042185e3-d40b-4ad9-96a7-10409b53eca8 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:00.775035 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1312/2613] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:06.109006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ee92-b008-44a7-86a9-0eec097a071d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:06.109975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ee92-b008-44a7-86a9-0eec097a071d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:06.109975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ee92-b008-44a7-86a9-0eec097a071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:06.162857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3f30ee92-b008-44a7-86a9-0eec097a071d None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:06.164590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3f30ee92-b008-44a7-86a9-0eec097a071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:06.185648 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1302/2614] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:50:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:06.220356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042185e3-d40b-4ad9-96a7-10409b53eca8 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:06.246064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042185e3-d40b-4ad9-96a7-10409b53eca8 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:06.261970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556486f8-434a-460e-ba99-c5a776c281d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:06.262737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556486f8-434a-460e-ba99-c5a776c281d6 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:06.263075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556486f8-434a-460e-ba99-c5a776c281d6 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:06.263681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556486f8-434a-460e-ba99-c5a776c281d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:06.285309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556486f8-434a-460e-ba99-c5a776c281d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:06.287311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556486f8-434a-460e-ba99-c5a776c281d6 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:06.308599 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1313/2615] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:50:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:50:07.792579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2365-cf28-4399-ae49-96e248bccede None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:07.793715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2365-cf28-4399-ae49-96e248bccede None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:07.794185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2365-cf28-4399-ae49-96e248bccede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:07.848476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1bfb2365-cf28-4399-ae49-96e248bccede None None] MFA Rules not processed for user `85b59e131dd940b1b397f5ed429c814f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:07.851141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1bfb2365-cf28-4399-ae49-96e248bccede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:07.911004 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1303/2616] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:16.298621 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=12 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:17.838261 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=31 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:17.931854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90c1f7-a76a-4ef2-a6a6-27ea2cc7eae9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:17.932720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90c1f7-a76a-4ef2-a6a6-27ea2cc7eae9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:17.932720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90c1f7-a76a-4ef2-a6a6-27ea2cc7eae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:18.003677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7a90c1f7-a76a-4ef2-a6a6-27ea2cc7eae9 None None] MFA Rules not processed for user `2ab51886a81f4e1194e0c1ac50eef9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:18.008511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7a90c1f7-a76a-4ef2-a6a6-27ea2cc7eae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:18.242474 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1314/2617] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:19.157365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb2365-cf28-4399-ae49-96e248bccede None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:19.159514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1bfb2365-cf28-4399-ae49-96e248bccede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:19.186288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb2365-cf28-4399-ae49-96e248bccede None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:19.195490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:19.200968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:19.201682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:19.202197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] PATH_INFO: `/v3/users/f8b9d723cf9f4786a444cc1a33857abb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:19.203890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b9d723cf9f4786a444cc1a33857abb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:19.209057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:19.304089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b9d723cf9f4786a444cc1a33857abb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:19.334674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b9d723cf9f4786a444cc1a33857abb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:19.347088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b9d723cf9f4786a444cc1a33857abb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:19.375386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b9d723cf9f4786a444cc1a33857abb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:19.379238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b9d723cf9f4786a444cc1a33857abb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:19.394697 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1304/2618] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:50:19 2022] DELETE /identity/v3/users/f8b9d723cf9f4786a444cc1a33857abb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:19.675864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90c1f7-a76a-4ef2-a6a6-27ea2cc7eae9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:19.678182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7a90c1f7-a76a-4ef2-a6a6-27ea2cc7eae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:19.714140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90c1f7-a76a-4ef2-a6a6-27ea2cc7eae9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:19.834276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4262ab-fc95-4722-bdb6-8a7e58ebc452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:19.834990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4262ab-fc95-4722-bdb6-8a7e58ebc452 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:19.835182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4262ab-fc95-4722-bdb6-8a7e58ebc452 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:19.835458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4262ab-fc95-4722-bdb6-8a7e58ebc452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:19.840690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7f4262ab-fc95-4722-bdb6-8a7e58ebc452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:19.897305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4262ab-fc95-4722-bdb6-8a7e58ebc452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:19.909595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4262ab-fc95-4722-bdb6-8a7e58ebc452 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:19.933331 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1315/2619] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:20.371885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:20.375525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:20.544316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9a219-649f-489b-91b6-23cc3a426cf4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:20.549725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:20.550415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:20.550736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:20.551250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] PATH_INFO: `/v3/projects/b9790689725747ce8c1b18cdefb12c85` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:20.552872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9790689725747ce8c1b18cdefb12c85)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:20.559015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:20.729456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9790689725747ce8c1b18cdefb12c85', 'request_id': 'req-213e88d5-371d-4c85-9203-fa8a595279ec'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:20.748486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9790689725747ce8c1b18cdefb12c85', 'request_id': 'req-213e88d5-371d-4c85-9203-fa8a595279ec'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:20.765838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9790689725747ce8c1b18cdefb12c85', 'request_id': 'req-213e88d5-371d-4c85-9203-fa8a595279ec'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:20.810487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] The token cache is being invalidate because project b9790689725747ce8c1b18cdefb12c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:50:20.810818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:20.812408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-213e88d5-371d-4c85-9203-fa8a595279ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:20.818091 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1305/2620] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:20 2022] DELETE /identity/v3/projects/b9790689725747ce8c1b18cdefb12c85 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:20.823795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7738-ce91-444c-9d7b-449cb44e1771 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:20.824803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7738-ce91-444c-9d7b-449cb44e1771 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:20.825254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7738-ce91-444c-9d7b-449cb44e1771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:20.863748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-002e7738-ce91-444c-9d7b-449cb44e1771 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:20.865560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-002e7738-ce91-444c-9d7b-449cb44e1771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:21.126676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357350-01f8-4382-80e5-8f3c55bfba05 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:21.126945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357350-01f8-4382-80e5-8f3c55bfba05 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:21.127217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357350-01f8-4382-80e5-8f3c55bfba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:21.136751 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:21.151627 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1316/2621] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:21.159920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503b872-0281-4f21-bdd5-6f501372e323 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:21.161689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503b872-0281-4f21-bdd5-6f501372e323 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:21.162708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503b872-0281-4f21-bdd5-6f501372e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:21.182211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f6357350-01f8-4382-80e5-8f3c55bfba05 None None] MFA Rules not processed for user `5d0158da7efc485ebd6a1e1db617b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:21.183779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f6357350-01f8-4382-80e5-8f3c55bfba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:21.233805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0503b872-0281-4f21-bdd5-6f501372e323 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:21.236231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0503b872-0281-4f21-bdd5-6f501372e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:21.255076 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1317/2622] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:21.260661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503b872-0281-4f21-bdd5-6f501372e323 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:21.326425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503b872-0281-4f21-bdd5-6f501372e323 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:21.350491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac87a06-2a91-4b0d-b162-bf9f8e86e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:21.351472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac87a06-2a91-4b0d-b162-bf9f8e86e981 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:21.352074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac87a06-2a91-4b0d-b162-bf9f8e86e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:21.356639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac87a06-2a91-4b0d-b162-bf9f8e86e981 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:21.358142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac87a06-2a91-4b0d-b162-bf9f8e86e981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:50:21.358734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac87a06-2a91-4b0d-b162-bf9f8e86e981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:21.367367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac87a06-2a91-4b0d-b162-bf9f8e86e981 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:21.412906 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1318/2623] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:50:21.414082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac87a06-2a91-4b0d-b162-bf9f8e86e981 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:21.442557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac87a06-2a91-4b0d-b162-bf9f8e86e981 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:21.466988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67afc8e-53ed-45ab-a21f-6e7962788067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:21.468711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67afc8e-53ed-45ab-a21f-6e7962788067 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:21.468711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67afc8e-53ed-45ab-a21f-6e7962788067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:21.468711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67afc8e-53ed-45ab-a21f-6e7962788067 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:21.469079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67afc8e-53ed-45ab-a21f-6e7962788067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:21.469186 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1306/2624] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:21.471136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67afc8e-53ed-45ab-a21f-6e7962788067 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:21.549457 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1319/2625] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:50:21 2022] POST /identity/v3/projects => generated 405 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:50:21.554248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357350-01f8-4382-80e5-8f3c55bfba05 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:21.627905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357350-01f8-4382-80e5-8f3c55bfba05 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:21.773423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169fb68-8f4d-4cbf-860a-5a96b08eab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:21.775822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169fb68-8f4d-4cbf-860a-5a96b08eab14 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:21.776235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169fb68-8f4d-4cbf-860a-5a96b08eab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:21.776776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169fb68-8f4d-4cbf-860a-5a96b08eab14 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:21.777584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169fb68-8f4d-4cbf-860a-5a96b08eab14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:21.786047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169fb68-8f4d-4cbf-860a-5a96b08eab14 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:21.866832 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1307/2626] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:50:21 2022] POST /identity/v3/users => generated 303 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:50:21.868735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67afc8e-53ed-45ab-a21f-6e7962788067 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:21.900504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67afc8e-53ed-45ab-a21f-6e7962788067 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:21.925849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e9d47-092e-4f56-8ccb-e2cc77e04963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:21.933044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e9d47-092e-4f56-8ccb-e2cc77e04963 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:21.935028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e9d47-092e-4f56-8ccb-e2cc77e04963 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:21.935479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e9d47-092e-4f56-8ccb-e2cc77e04963 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:21.953508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e9d47-092e-4f56-8ccb-e2cc77e04963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:21.979600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e9d47-092e-4f56-8ccb-e2cc77e04963 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:21.982278 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:22.003195 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1320/2627] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:50:22.004314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169fb68-8f4d-4cbf-860a-5a96b08eab14 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:22.032686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169fb68-8f4d-4cbf-860a-5a96b08eab14 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:22.050660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fd104-a31f-4ff4-a92d-8667bd08e264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:22.051465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fd104-a31f-4ff4-a92d-8667bd08e264 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:22.051760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fd104-a31f-4ff4-a92d-8667bd08e264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:22.052029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fd104-a31f-4ff4-a92d-8667bd08e264 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:22.052714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fd104-a31f-4ff4-a92d-8667bd08e264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:22.056416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fd104-a31f-4ff4-a92d-8667bd08e264 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:22.074894 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1308/2628] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:50:22.081433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e9d47-092e-4f56-8ccb-e2cc77e04963 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:22.100886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e9d47-092e-4f56-8ccb-e2cc77e04963 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:22.132245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eff33d-87de-4086-b834-5020f009dd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:22.132971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eff33d-87de-4086-b834-5020f009dd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:22.133345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eff33d-87de-4086-b834-5020f009dd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:22.133534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eff33d-87de-4086-b834-5020f009dd0a admin admin] PATH_INFO: `/v3/projects/a044d2a9e1a24070af00b9705381e4e7/users/6795756089364e3d81d0c7c1589d35a9/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:22.169927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eff33d-87de-4086-b834-5020f009dd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a044d2a9e1a24070af00b9705381e4e7, user_id=6795756089364e3d81d0c7c1589d35a9, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:22.172551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eff33d-87de-4086-b834-5020f009dd0a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:22.228722 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1321/2629] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:50:22 2022] PUT /identity/v3/projects/a044d2a9e1a24070af00b9705381e4e7/users/6795756089364e3d81d0c7c1589d35a9/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:22.230375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f08f1-f180-4747-a741-033696d1795b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:22.230662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f08f1-f180-4747-a741-033696d1795b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:22.231036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f08f1-f180-4747-a741-033696d1795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:22.253863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1c8f08f1-f180-4747-a741-033696d1795b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:22.255350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1c8f08f1-f180-4747-a741-033696d1795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:22.490595 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1309/2630] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:50:22.504930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eff33d-87de-4086-b834-5020f009dd0a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:22.512295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-97eff33d-87de-4086-b834-5020f009dd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:22.636052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eff33d-87de-4086-b834-5020f009dd0a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:22.650194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5712-2aa2-42d0-98d9-506bf0d50295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:22.651276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5712-2aa2-42d0-98d9-506bf0d50295 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:22.651776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5712-2aa2-42d0-98d9-506bf0d50295 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:22.652290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5712-2aa2-42d0-98d9-506bf0d50295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:22.665634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e5712-2aa2-42d0-98d9-506bf0d50295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:22.667858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e5712-2aa2-42d0-98d9-506bf0d50295 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:22.687188 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1322/2631] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:50:32.470319 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:32.675692 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:34.111792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8219c-86e7-4092-a247-2405b7d4451f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:34.112699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8219c-86e7-4092-a247-2405b7d4451f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:34.113129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8219c-86e7-4092-a247-2405b7d4451f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:34.149910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-89c8219c-86e7-4092-a247-2405b7d4451f None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:34.151508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-89c8219c-86e7-4092-a247-2405b7d4451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:34.284075 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1310/2632] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 00:50:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:34.299345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5712-2aa2-42d0-98d9-506bf0d50295 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:34.302024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a87e5712-2aa2-42d0-98d9-506bf0d50295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:34.460809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5712-2aa2-42d0-98d9-506bf0d50295 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:34.472649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74995277-cbfe-4c5e-9b36-9a8b16d3ef31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:34.473719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74995277-cbfe-4c5e-9b36-9a8b16d3ef31 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:34.474222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74995277-cbfe-4c5e-9b36-9a8b16d3ef31 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:34.474667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74995277-cbfe-4c5e-9b36-9a8b16d3ef31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:34.498344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74995277-cbfe-4c5e-9b36-9a8b16d3ef31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:34.500185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74995277-cbfe-4c5e-9b36-9a8b16d3ef31 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:34.519236 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1323/2633] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:50:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:40.850727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8219c-86e7-4092-a247-2405b7d4451f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:40.853165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-89c8219c-86e7-4092-a247-2405b7d4451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:41.075919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8219c-86e7-4092-a247-2405b7d4451f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:41.090307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb6f3a-cdf0-435d-bbca-d2afc6f39a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:41.091224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6f3a-cdf0-435d-bbca-d2afc6f39a11 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:41.091660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6f3a-cdf0-435d-bbca-d2afc6f39a11 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:41.092284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6f3a-cdf0-435d-bbca-d2afc6f39a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:41.094656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2ccb6f3a-cdf0-435d-bbca-d2afc6f39a11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:41.212170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb6f3a-cdf0-435d-bbca-d2afc6f39a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:41.214752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb6f3a-cdf0-435d-bbca-d2afc6f39a11 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:41.270944 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1311/2634] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:41.802506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef60d51-366d-4dc8-9183-331017ea24aa None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:41.803047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef60d51-366d-4dc8-9183-331017ea24aa None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:41.803309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef60d51-366d-4dc8-9183-331017ea24aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:41.847011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6ef60d51-366d-4dc8-9183-331017ea24aa None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:41.849726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6ef60d51-366d-4dc8-9183-331017ea24aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:41.873917 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1324/2635] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 00:50:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:41.886628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb6f3a-cdf0-435d-bbca-d2afc6f39a11 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:41.899079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb6f3a-cdf0-435d-bbca-d2afc6f39a11 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:41.909247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765d4bb-ca06-431f-a0c6-b338aeb745e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:41.909876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765d4bb-ca06-431f-a0c6-b338aeb745e1 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:41.910332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765d4bb-ca06-431f-a0c6-b338aeb745e1 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:41.912144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765d4bb-ca06-431f-a0c6-b338aeb745e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:41.944334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765d4bb-ca06-431f-a0c6-b338aeb745e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:41.949010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765d4bb-ca06-431f-a0c6-b338aeb745e1 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:41.989058 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1312/2636] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:50:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:42.299563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81ad9d-0ffc-441a-8cfc-5e58d730def8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:42.299857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81ad9d-0ffc-441a-8cfc-5e58d730def8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:42.300136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81ad9d-0ffc-441a-8cfc-5e58d730def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:42.371053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1e81ad9d-0ffc-441a-8cfc-5e58d730def8 None None] MFA Rules not processed for user `6795756089364e3d81d0c7c1589d35a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:42.372575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1e81ad9d-0ffc-441a-8cfc-5e58d730def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:42.516571 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1325/2637] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:42.982309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765d4bb-ca06-431f-a0c6-b338aeb745e1 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:42.984442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6765d4bb-ca06-431f-a0c6-b338aeb745e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:43.025404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765d4bb-ca06-431f-a0c6-b338aeb745e1 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:43.031855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62580d5-1dba-442b-929e-0fb04c91e602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:43.033286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62580d5-1dba-442b-929e-0fb04c91e602 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:43.033586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62580d5-1dba-442b-929e-0fb04c91e602 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:43.033895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62580d5-1dba-442b-929e-0fb04c91e602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:43.051494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62580d5-1dba-442b-929e-0fb04c91e602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:43.052431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62580d5-1dba-442b-929e-0fb04c91e602 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:43.081942 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1313/2638] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:42 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:52.393769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81ad9d-0ffc-441a-8cfc-5e58d730def8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:52.397017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1e81ad9d-0ffc-441a-8cfc-5e58d730def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:52.449835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81ad9d-0ffc-441a-8cfc-5e58d730def8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:52.458966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:52.462627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:52.463200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:52.464535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] PATH_INFO: `/v3/users/2a896789dc814debba3a0a8f8f0c8943` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:52.467815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a896789dc814debba3a0a8f8f0c8943)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:52.471533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:52.551787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a896789dc814debba3a0a8f8f0c8943'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:52.587184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a896789dc814debba3a0a8f8f0c8943'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:52.593011 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:52.605371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a896789dc814debba3a0a8f8f0c8943'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:52.641894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a896789dc814debba3a0a8f8f0c8943'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:52.642689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a896789dc814debba3a0a8f8f0c8943'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:52.660669 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1326/2639] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:50:52 2022] DELETE /identity/v3/users/2a896789dc814debba3a0a8f8f0c8943 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:52.662002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc772a-87ab-446b-b673-ea27ab0814ae None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:52.662940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc772a-87ab-446b-b673-ea27ab0814ae None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:52.663980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc772a-87ab-446b-b673-ea27ab0814ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:52.710520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-25fc772a-87ab-446b-b673-ea27ab0814ae None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:52.712258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-25fc772a-87ab-446b-b673-ea27ab0814ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:52.725038 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:52.843536 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1314/2640] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:50:52.875841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:52.896401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:53.102959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fe06-d93e-46c9-955c-b6888aa4764e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:53.115246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c639d-bf17-4bd9-8ab0-bcdb506c86f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:53.116332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c639d-bf17-4bd9-8ab0-bcdb506c86f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:53.116763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c639d-bf17-4bd9-8ab0-bcdb506c86f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:53.117143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c639d-bf17-4bd9-8ab0-bcdb506c86f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:53.176394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c639d-bf17-4bd9-8ab0-bcdb506c86f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:53.176394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c639d-bf17-4bd9-8ab0-bcdb506c86f3 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:53.180279 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1327/2641] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:53.736531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc772a-87ab-446b-b673-ea27ab0814ae None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:53.740461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-25fc772a-87ab-446b-b673-ea27ab0814ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:53.746748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c639d-bf17-4bd9-8ab0-bcdb506c86f3 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:53.748199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-569c639d-bf17-4bd9-8ab0-bcdb506c86f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:53.769837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c639d-bf17-4bd9-8ab0-bcdb506c86f3 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:53.775862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:53.776572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:53.776882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:53.777617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] PATH_INFO: `/v3/projects/8d60a9bdaee646508bf9f42d390191d3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:53.778483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d60a9bdaee646508bf9f42d390191d3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:53.780646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:53.864613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d60a9bdaee646508bf9f42d390191d3', 'request_id': 'req-04dc6318-1c0a-46b4-a85c-4ffadba723b0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:53.881580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d60a9bdaee646508bf9f42d390191d3', 'request_id': 'req-04dc6318-1c0a-46b4-a85c-4ffadba723b0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:53.900788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d60a9bdaee646508bf9f42d390191d3', 'request_id': 'req-04dc6318-1c0a-46b4-a85c-4ffadba723b0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:53.923828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc772a-87ab-446b-b673-ea27ab0814ae None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:53.924277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] The token cache is being invalidate because project 8d60a9bdaee646508bf9f42d390191d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:50:53.924829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:53.925995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04dc6318-1c0a-46b4-a85c-4ffadba723b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:53.932003 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1328/2642] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:53 2022] DELETE /identity/v3/projects/8d60a9bdaee646508bf9f42d390191d3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:53.933612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d03fd-8e82-423b-b86f-fe71f6560b5a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:53.934250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d03fd-8e82-423b-b86f-fe71f6560b5a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:53.934987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d03fd-8e82-423b-b86f-fe71f6560b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:53.961997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-778d03fd-8e82-423b-b86f-fe71f6560b5a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:53.963573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-778d03fd-8e82-423b-b86f-fe71f6560b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:54.029302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6543449-5779-4044-851e-475e2512063b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:54.030350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543449-5779-4044-851e-475e2512063b service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:54.030813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543449-5779-4044-851e-475e2512063b service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:54.032656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543449-5779-4044-851e-475e2512063b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:54.035140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d6543449-5779-4044-851e-475e2512063b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:54.071284 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1329/2643] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:54.072770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ceaac-72cc-4f69-aacf-69404c444da9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:54.073305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ceaac-72cc-4f69-aacf-69404c444da9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:54.073781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ceaac-72cc-4f69-aacf-69404c444da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:54.097701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4a0ceaac-72cc-4f69-aacf-69404c444da9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:54.099174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4a0ceaac-72cc-4f69-aacf-69404c444da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:54.112183 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1330/2644] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:54.113331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ceaac-72cc-4f69-aacf-69404c444da9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:54.116303 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:54.126488 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:54.131819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ceaac-72cc-4f69-aacf-69404c444da9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:54.140510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1258db0-9bb8-4fa2-b621-651ebff5847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:54.141589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1258db0-9bb8-4fa2-b621-651ebff5847b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:54.142819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1258db0-9bb8-4fa2-b621-651ebff5847b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:54.143446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1258db0-9bb8-4fa2-b621-651ebff5847b admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:54.144301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1258db0-9bb8-4fa2-b621-651ebff5847b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:50:54.144823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1258db0-9bb8-4fa2-b621-651ebff5847b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:54.146730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1258db0-9bb8-4fa2-b621-651ebff5847b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:54.160028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6543449-5779-4044-851e-475e2512063b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:54.161718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6543449-5779-4044-851e-475e2512063b service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:54.166264 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1331/2645] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:50:54.167240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1258db0-9bb8-4fa2-b621-651ebff5847b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:54.181061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1258db0-9bb8-4fa2-b621-651ebff5847b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:54.182843 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1315/2646] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:54.204468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb86d5d-e108-4630-a549-cd9012049168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:54.205201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb86d5d-e108-4630-a549-cd9012049168 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:54.205769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb86d5d-e108-4630-a549-cd9012049168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:54.206121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb86d5d-e108-4630-a549-cd9012049168 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:54.207498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb86d5d-e108-4630-a549-cd9012049168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:54.210689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb86d5d-e108-4630-a549-cd9012049168 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:54.260670 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1332/2647] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:50:54 2022] POST /identity/v3/projects => generated 401 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:50:54.265313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6543449-5779-4044-851e-475e2512063b service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:54.279459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6543449-5779-4044-851e-475e2512063b service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:54.368881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f091-a4ab-4eab-a2ec-df743ada8d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:54.369531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f091-a4ab-4eab-a2ec-df743ada8d19 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:54.369885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f091-a4ab-4eab-a2ec-df743ada8d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:54.370262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f091-a4ab-4eab-a2ec-df743ada8d19 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:54.370999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07f091-a4ab-4eab-a2ec-df743ada8d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:54.373099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07f091-a4ab-4eab-a2ec-df743ada8d19 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:54.417295 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1316/2648] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:50:54 2022] POST /identity/v3/users => generated 301 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:50:54.418688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb86d5d-e108-4630-a549-cd9012049168 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:54.449520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb86d5d-e108-4630-a549-cd9012049168 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:54.457613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c161121-a3d6-4fcd-b837-a8dfeeda5e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:54.458379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c161121-a3d6-4fcd-b837-a8dfeeda5e71 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:54.458657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c161121-a3d6-4fcd-b837-a8dfeeda5e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:54.458935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c161121-a3d6-4fcd-b837-a8dfeeda5e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:54.459593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c161121-a3d6-4fcd-b837-a8dfeeda5e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:54.463444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c161121-a3d6-4fcd-b837-a8dfeeda5e71 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:54.487156 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1333/2649] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:50:54.487498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f091-a4ab-4eab-a2ec-df743ada8d19 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:54.499721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f091-a4ab-4eab-a2ec-df743ada8d19 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:54.505685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404bbf9-9292-4d63-8468-0f07e2681cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:54.506375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404bbf9-9292-4d63-8468-0f07e2681cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:54.506673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404bbf9-9292-4d63-8468-0f07e2681cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:54.507022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404bbf9-9292-4d63-8468-0f07e2681cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:54.508540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404bbf9-9292-4d63-8468-0f07e2681cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:54.510351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404bbf9-9292-4d63-8468-0f07e2681cd2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:54.524670 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1317/2650] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:50:54.526913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c161121-a3d6-4fcd-b837-a8dfeeda5e71 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:54.542065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c161121-a3d6-4fcd-b837-a8dfeeda5e71 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:54.547613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05162242-2915-42b5-abdb-0384bf99e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:54.548487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162242-2915-42b5-abdb-0384bf99e8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:54.548877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162242-2915-42b5-abdb-0384bf99e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:54.549239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162242-2915-42b5-abdb-0384bf99e8ab admin admin] PATH_INFO: `/v3/projects/368fcef85f354a39ae2db155ed1efebc/users/d5c223545f214383ad8c867a233971de/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:54.569214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05162242-2915-42b5-abdb-0384bf99e8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=368fcef85f354a39ae2db155ed1efebc, user_id=d5c223545f214383ad8c867a233971de, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:54.572672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05162242-2915-42b5-abdb-0384bf99e8ab admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:54.589863 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1334/2651] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:50:54 2022] PUT /identity/v3/projects/368fcef85f354a39ae2db155ed1efebc/users/d5c223545f214383ad8c867a233971de/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:50:54.602433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb61893-5ab6-40e9-b2b3-e30a74a4d3fe None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:54.602794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb61893-5ab6-40e9-b2b3-e30a74a4d3fe None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:54.603077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb61893-5ab6-40e9-b2b3-e30a74a4d3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:54.662543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7fb61893-5ab6-40e9-b2b3-e30a74a4d3fe None None] MFA Rules not processed for user `d5c223545f214383ad8c867a233971de`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:54.664950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7fb61893-5ab6-40e9-b2b3-e30a74a4d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:54.751525 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1318/2652] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:55.473835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05162242-2915-42b5-abdb-0384bf99e8ab admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:55.479014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-05162242-2915-42b5-abdb-0384bf99e8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:55.565272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05162242-2915-42b5-abdb-0384bf99e8ab admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:55.573224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e6951-18d5-4ae6-bf97-1f3672324b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:55.574015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e6951-18d5-4ae6-bf97-1f3672324b46 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:55.574311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e6951-18d5-4ae6-bf97-1f3672324b46 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:55.574710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e6951-18d5-4ae6-bf97-1f3672324b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:55.583811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e6951-18d5-4ae6-bf97-1f3672324b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:55.585911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e6951-18d5-4ae6-bf97-1f3672324b46 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:55.597699 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1335/2653] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:55 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:50:55.673082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb61893-5ab6-40e9-b2b3-e30a74a4d3fe None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:55.746284 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:55.761735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb61893-5ab6-40e9-b2b3-e30a74a4d3fe None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:55.770101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:55.770961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:55.771247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:55.771524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] PATH_INFO: `/v3/users/d5c223545f214383ad8c867a233971de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:55.772774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c223545f214383ad8c867a233971de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:55.775059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:55.886285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c223545f214383ad8c867a233971de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:55.903251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c223545f214383ad8c867a233971de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:55.915832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c223545f214383ad8c867a233971de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:55.930291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c223545f214383ad8c867a233971de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:55.931916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c223545f214383ad8c867a233971de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:55.939694 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1319/2654] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:50:55 2022] DELETE /identity/v3/users/d5c223545f214383ad8c867a233971de => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:55.944708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6c9a-0793-4652-83fe-0fbcc353f3d5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:55.945070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6c9a-0793-4652-83fe-0fbcc353f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:55.945348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6c9a-0793-4652-83fe-0fbcc353f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:55.966256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-168f6c9a-0793-4652-83fe-0fbcc353f3d5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:55.967670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-168f6c9a-0793-4652-83fe-0fbcc353f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:56.053364 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1336/2655] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:56.065042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:56.067138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:56.154967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de40873-fb24-4aba-84aa-c004bb8fcd64 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:56.159357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4b927-9846-4c96-b53e-7241b658fe8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:56.160010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b927-9846-4c96-b53e-7241b658fe8b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:56.160294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b927-9846-4c96-b53e-7241b658fe8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:56.160592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b927-9846-4c96-b53e-7241b658fe8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:56.172434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4b927-9846-4c96-b53e-7241b658fe8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:56.173938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4b927-9846-4c96-b53e-7241b658fe8b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:56.195633 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1320/2656] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:56.550099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f6c9a-0793-4652-83fe-0fbcc353f3d5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:56.551734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-168f6c9a-0793-4652-83fe-0fbcc353f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:56.573380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f6c9a-0793-4652-83fe-0fbcc353f3d5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:56.582888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:56.583825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:56.584477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:56.585339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] PATH_INFO: `/v3/projects/368fcef85f354a39ae2db155ed1efebc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:56.598221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=368fcef85f354a39ae2db155ed1efebc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:56.601429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:56.638979 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:56.692800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368fcef85f354a39ae2db155ed1efebc', 'request_id': 'req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:56.706374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368fcef85f354a39ae2db155ed1efebc', 'request_id': 'req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:56.720503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368fcef85f354a39ae2db155ed1efebc', 'request_id': 'req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:56.742498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] The token cache is being invalidate because project 368fcef85f354a39ae2db155ed1efebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:50:56.743070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:56.743913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbd44d5-55a3-49ef-b79b-4a3d9f15b0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:50:56.748899 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1337/2657] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:56 2022] DELETE /identity/v3/projects/368fcef85f354a39ae2db155ed1efebc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:56.751269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9288f2-5cc2-4dba-b6c7-81bd265d8435 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:56.752194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9288f2-5cc2-4dba-b6c7-81bd265d8435 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:56.752480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9288f2-5cc2-4dba-b6c7-81bd265d8435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:56.783495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7c9288f2-5cc2-4dba-b6c7-81bd265d8435 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:56.786211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7c9288f2-5cc2-4dba-b6c7-81bd265d8435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:56.878020 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1321/2658] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:50:56.886760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba8cb7-7513-4c7f-8e3b-c5bba9638854 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:56.887306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba8cb7-7513-4c7f-8e3b-c5bba9638854 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:56.887666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba8cb7-7513-4c7f-8e3b-c5bba9638854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:56.911970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f9ba8cb7-7513-4c7f-8e3b-c5bba9638854 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:56.914087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f9ba8cb7-7513-4c7f-8e3b-c5bba9638854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:56.923489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1338/2659] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:56.927155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9288f2-5cc2-4dba-b6c7-81bd265d8435 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:56.947085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9288f2-5cc2-4dba-b6c7-81bd265d8435 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:56.953787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a382b70-0d65-4579-9931-ee298a6b1074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:56.954521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a382b70-0d65-4579-9931-ee298a6b1074 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:56.954890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a382b70-0d65-4579-9931-ee298a6b1074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:56.955377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a382b70-0d65-4579-9931-ee298a6b1074 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:56.956324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a382b70-0d65-4579-9931-ee298a6b1074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:50:56.956909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a382b70-0d65-4579-9931-ee298a6b1074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:56.959149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a382b70-0d65-4579-9931-ee298a6b1074 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:56.970115 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:56.979092 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1322/2660] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:50:56.981415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba8cb7-7513-4c7f-8e3b-c5bba9638854 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:56.994304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba8cb7-7513-4c7f-8e3b-c5bba9638854 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:57.001086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22b812-16dc-4610-8985-3f9f7344d2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:57.001833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22b812-16dc-4610-8985-3f9f7344d2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:57.002431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22b812-16dc-4610-8985-3f9f7344d2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:57.002831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22b812-16dc-4610-8985-3f9f7344d2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:57.003467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22b812-16dc-4610-8985-3f9f7344d2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:57.005661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22b812-16dc-4610-8985-3f9f7344d2c8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:57.057010 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1339/2661] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:50:56 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:50:57.061324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a382b70-0d65-4579-9931-ee298a6b1074 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:57.073407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a382b70-0d65-4579-9931-ee298a6b1074 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:57.175863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566f2a-4cad-48b8-91f3-c790f8284feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:57.176513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566f2a-4cad-48b8-91f3-c790f8284feb admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:57.176821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566f2a-4cad-48b8-91f3-c790f8284feb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:57.177093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566f2a-4cad-48b8-91f3-c790f8284feb admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:57.177724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07566f2a-4cad-48b8-91f3-c790f8284feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:57.180095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07566f2a-4cad-48b8-91f3-c790f8284feb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:57.212767 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1323/2662] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:50:57 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:50:57.214864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22b812-16dc-4610-8985-3f9f7344d2c8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:57.226748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22b812-16dc-4610-8985-3f9f7344d2c8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:57.232656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f704623-b715-409e-9c7e-3c4593049cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:57.233517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f704623-b715-409e-9c7e-3c4593049cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:57.233857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f704623-b715-409e-9c7e-3c4593049cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:57.234202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f704623-b715-409e-9c7e-3c4593049cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:57.234992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f704623-b715-409e-9c7e-3c4593049cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:57.236937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f704623-b715-409e-9c7e-3c4593049cc5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:57.258778 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1340/2663] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:50:57.262483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566f2a-4cad-48b8-91f3-c790f8284feb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:57.281484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566f2a-4cad-48b8-91f3-c790f8284feb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:57.287637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c5be8-4a35-46c6-a8c9-b81c797d9200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:57.289183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c5be8-4a35-46c6-a8c9-b81c797d9200 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:57.289183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c5be8-4a35-46c6-a8c9-b81c797d9200 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:57.289457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c5be8-4a35-46c6-a8c9-b81c797d9200 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:57.290439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c5be8-4a35-46c6-a8c9-b81c797d9200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:57.292666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c5be8-4a35-46c6-a8c9-b81c797d9200 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:57.310178 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1324/2664] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:50:57.313720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f704623-b715-409e-9c7e-3c4593049cc5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:57.331583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f704623-b715-409e-9c7e-3c4593049cc5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:57.341180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bdede-619b-4c90-b043-78287415e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:57.342072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bdede-619b-4c90-b043-78287415e0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:57.344143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bdede-619b-4c90-b043-78287415e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:57.344143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bdede-619b-4c90-b043-78287415e0b0 admin admin] PATH_INFO: `/v3/projects/400e1a39f12245c394ef6e85c5a514ae/users/e382623f1cf8489db5c5e75c65caef20/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:57.367036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bdede-619b-4c90-b043-78287415e0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400e1a39f12245c394ef6e85c5a514ae, user_id=e382623f1cf8489db5c5e75c65caef20, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:57.371047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bdede-619b-4c90-b043-78287415e0b0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:57.391388 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1341/2665] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:50:57 2022] PUT /identity/v3/projects/400e1a39f12245c394ef6e85c5a514ae/users/e382623f1cf8489db5c5e75c65caef20/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:50:57.404411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285959-14de-4139-bdaa-c8da1116ae17 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:57.404731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285959-14de-4139-bdaa-c8da1116ae17 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:57.405012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285959-14de-4139-bdaa-c8da1116ae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:57.439439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4f285959-14de-4139-bdaa-c8da1116ae17 None None] MFA Rules not processed for user `e382623f1cf8489db5c5e75c65caef20`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:50:57.440807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4f285959-14de-4139-bdaa-c8da1116ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:57.540273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bdede-619b-4c90-b043-78287415e0b0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:57.542529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bf6bdede-619b-4c90-b043-78287415e0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:57.569154 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1325/2666] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:50:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:50:57.660496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bdede-619b-4c90-b043-78287415e0b0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:57.669530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:57.670173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:57.670449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:57.670719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:57.672540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:57.792452 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:57.839666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:57.845505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:57.874618 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1342/2667] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:57.974801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f285959-14de-4139-bdaa-c8da1116ae17 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:57.991605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f285959-14de-4139-bdaa-c8da1116ae17 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:57.996671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668613c4-a860-4c16-8631-c7bc291805db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:57.997696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668613c4-a860-4c16-8631-c7bc291805db service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:57.998223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668613c4-a860-4c16-8631-c7bc291805db service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:57.998739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668613c4-a860-4c16-8631-c7bc291805db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:58.001442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-668613c4-a860-4c16-8631-c7bc291805db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:58.015247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668613c4-a860-4c16-8631-c7bc291805db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:58.017395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668613c4-a860-4c16-8631-c7bc291805db service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:58.029462 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1326/2668] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:59.094932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:50:59.097287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:50:59.112336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8086f3-d822-466b-93d8-c615e049a3dd service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:50:59.119668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6cffc-1c36-466f-a0ce-f5c23f66ce6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:50:59.120546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6cffc-1c36-466f-a0ce-f5c23f66ce6a service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:50:59.121013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6cffc-1c36-466f-a0ce-f5c23f66ce6a service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:50:59.121465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6cffc-1c36-466f-a0ce-f5c23f66ce6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:50:59.131252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6cffc-1c36-466f-a0ce-f5c23f66ce6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:50:59.133886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6cffc-1c36-466f-a0ce-f5c23f66ce6a service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:50:59.149445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1343/2669] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:50:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:00.674960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668613c4-a860-4c16-8631-c7bc291805db service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:00.789939 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:00.797732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668613c4-a860-4c16-8631-c7bc291805db service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:00.804202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:00.805195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:00.805536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:00.805898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] PATH_INFO: `/v3/users/e382623f1cf8489db5c5e75c65caef20` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:00.807181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e382623f1cf8489db5c5e75c65caef20)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:00.809445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:00.872002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e382623f1cf8489db5c5e75c65caef20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:00.891879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e382623f1cf8489db5c5e75c65caef20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:00.901434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e382623f1cf8489db5c5e75c65caef20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:00.910137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e382623f1cf8489db5c5e75c65caef20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:00.910972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e382623f1cf8489db5c5e75c65caef20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:00.920318 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1327/2670] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:00 2022] DELETE /identity/v3/users/e382623f1cf8489db5c5e75c65caef20 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:00.928037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375690e9-e873-4831-a382-67d792dfffb6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:00.928517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375690e9-e873-4831-a382-67d792dfffb6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:00.929246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375690e9-e873-4831-a382-67d792dfffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:00.953967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-375690e9-e873-4831-a382-67d792dfffb6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:00.955636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-375690e9-e873-4831-a382-67d792dfffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:01.066625 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1344/2671] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:01.107679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:01.109589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:01.195931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4e286-ff71-4124-b731-2b0478970527 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:01.202247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f932a-a639-4d66-b298-b664ff5cdcd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:01.203060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f932a-a639-4d66-b298-b664ff5cdcd5 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:01.203224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f932a-a639-4d66-b298-b664ff5cdcd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:01.203643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f932a-a639-4d66-b298-b664ff5cdcd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:01.216028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f932a-a639-4d66-b298-b664ff5cdcd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:01.218514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f932a-a639-4d66-b298-b664ff5cdcd5 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:01.230157 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1328/2672] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:01.411811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375690e9-e873-4831-a382-67d792dfffb6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:01.413930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-375690e9-e873-4831-a382-67d792dfffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:01.442874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375690e9-e873-4831-a382-67d792dfffb6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:01.458456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:01.459404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:01.459872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:01.460359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] PATH_INFO: `/v3/users/1e43026c56e0462b976a840266ea8acf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:01.462858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e43026c56e0462b976a840266ea8acf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:01.465384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:01.534400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e43026c56e0462b976a840266ea8acf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:01.565280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e43026c56e0462b976a840266ea8acf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:01.585742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e43026c56e0462b976a840266ea8acf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:01.601806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e43026c56e0462b976a840266ea8acf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:01.605122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e43026c56e0462b976a840266ea8acf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:01.622164 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1345/2673] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:01 2022] DELETE /identity/v3/users/1e43026c56e0462b976a840266ea8acf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:02.454650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f932a-a639-4d66-b298-b664ff5cdcd5 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:02.456409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-863f932a-a639-4d66-b298-b664ff5cdcd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:02.499690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f932a-a639-4d66-b298-b664ff5cdcd5 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:02.675913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:02.681490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:02.706673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:02.707437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:02.707790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:02.708154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] PATH_INFO: `/v3/projects/400e1a39f12245c394ef6e85c5a514ae` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:02.710592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=400e1a39f12245c394ef6e85c5a514ae)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:02.727104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:02.736432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc46ee-d266-4ed2-bb65-5ac2a44f5348 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:02.753660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:02.754697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:02.757675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:02.758042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] PATH_INFO: `/v3/projects/bf3b8f8475874a7988dc35023a58d083` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:02.761262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3b8f8475874a7988dc35023a58d083)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:02.767684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:02.799206 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:02.864759 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:02.867551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400e1a39f12245c394ef6e85c5a514ae', 'request_id': 'req-d5ec5c6d-c62d-4320-8d78-9f426827acbe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.882752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400e1a39f12245c394ef6e85c5a514ae', 'request_id': 'req-d5ec5c6d-c62d-4320-8d78-9f426827acbe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.889048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3b8f8475874a7988dc35023a58d083', 'request_id': 'req-6d43693b-837d-40dc-a1bf-d806f4d2885c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.894934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400e1a39f12245c394ef6e85c5a514ae', 'request_id': 'req-d5ec5c6d-c62d-4320-8d78-9f426827acbe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.900947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3b8f8475874a7988dc35023a58d083', 'request_id': 'req-6d43693b-837d-40dc-a1bf-d806f4d2885c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.921348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3b8f8475874a7988dc35023a58d083', 'request_id': 'req-6d43693b-837d-40dc-a1bf-d806f4d2885c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.939278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] The token cache is being invalidate because project 400e1a39f12245c394ef6e85c5a514ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:02.939902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.942278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.946696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] The token cache is being invalidate because project bf3b8f8475874a7988dc35023a58d083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:02.947058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.948010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d43693b-837d-40dc-a1bf-d806f4d2885c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:02.949004 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1329/2674] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:02 2022] DELETE /identity/v3/projects/400e1a39f12245c394ef6e85c5a514ae => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:02.950213 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1346/2675] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:02 2022] DELETE /identity/v3/projects/bf3b8f8475874a7988dc35023a58d083 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:02.954266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:02.954952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913cdbf-09ce-4b74-9e86-8a3d543c0d79 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:02.955421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913cdbf-09ce-4b74-9e86-8a3d543c0d79 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:02.955860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913cdbf-09ce-4b74-9e86-8a3d543c0d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:02.956785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:03.006354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4913cdbf-09ce-4b74-9e86-8a3d543c0d79 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:03.007643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4913cdbf-09ce-4b74-9e86-8a3d543c0d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:03.145396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec5c6d-c62d-4320-8d78-9f426827acbe admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:03.197132 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1347/2676] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:03.206427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd17a0-a37f-4832-ac81-dd01838d0491 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:03.206988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd17a0-a37f-4832-ac81-dd01838d0491 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:03.207411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd17a0-a37f-4832-ac81-dd01838d0491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:03.261564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dcfd17a0-a37f-4832-ac81-dd01838d0491 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:03.263051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dcfd17a0-a37f-4832-ac81-dd01838d0491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:03.286323 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1348/2677] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:51:03.291243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd17a0-a37f-4832-ac81-dd01838d0491 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:03.308549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd17a0-a37f-4832-ac81-dd01838d0491 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:03.318365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb2e27-f2b8-4612-8281-4fa9ff573e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:03.319050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb2e27-f2b8-4612-8281-4fa9ff573e5e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:03.319411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb2e27-f2b8-4612-8281-4fa9ff573e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:03.319751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb2e27-f2b8-4612-8281-4fa9ff573e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:03.321088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb2e27-f2b8-4612-8281-4fa9ff573e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:51:03.321088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb2e27-f2b8-4612-8281-4fa9ff573e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:03.322384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb2e27-f2b8-4612-8281-4fa9ff573e5e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:03.354613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:03.355891 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1349/2678] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:51:03.358506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:03.359499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:03.360353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb2e27-f2b8-4612-8281-4fa9ff573e5e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:03.361066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] PATH_INFO: `/v3/users/1e63516d1b05413ab70a60696c0d9d1d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:03.364280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e63516d1b05413ab70a60696c0d9d1d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:03.369063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:03.379707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb2e27-f2b8-4612-8281-4fa9ff573e5e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:03.392341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c829e-70b6-484f-8ac0-222ed3677bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:03.393001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c829e-70b6-484f-8ac0-222ed3677bbb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:03.393321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c829e-70b6-484f-8ac0-222ed3677bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:03.394513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c829e-70b6-484f-8ac0-222ed3677bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:03.394513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c829e-70b6-484f-8ac0-222ed3677bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:03.396394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c829e-70b6-484f-8ac0-222ed3677bbb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:03.453584 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1350/2679] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:03 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:03.457801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c829e-70b6-484f-8ac0-222ed3677bbb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:03.484946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e63516d1b05413ab70a60696c0d9d1d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:03.512700 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:03.533646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e63516d1b05413ab70a60696c0d9d1d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:03.551576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e63516d1b05413ab70a60696c0d9d1d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:03.579755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e63516d1b05413ab70a60696c0d9d1d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:03.584371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e63516d1b05413ab70a60696c0d9d1d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:03.605174 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1330/2680] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:02 2022] DELETE /identity/v3/users/1e63516d1b05413ab70a60696c0d9d1d => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:03.614744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c829e-70b6-484f-8ac0-222ed3677bbb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:03.672042 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:03.740761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdb994-dfa5-4860-9b5a-0d31a690e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:03.742879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdb994-dfa5-4860-9b5a-0d31a690e734 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:03.743368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdb994-dfa5-4860-9b5a-0d31a690e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:03.743839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdb994-dfa5-4860-9b5a-0d31a690e734 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:03.744740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdb994-dfa5-4860-9b5a-0d31a690e734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:03.746986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdb994-dfa5-4860-9b5a-0d31a690e734 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:03.795000 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1351/2681] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:03 2022] POST /identity/v3/users => generated 289 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:51:03.799934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:03.802090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:03.878127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7f0bc-0367-4476-a2f0-61c43bee8e5b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:03.891179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba471-ca53-4171-bb7c-fa6078c84898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:03.892091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba471-ca53-4171-bb7c-fa6078c84898 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:03.892454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba471-ca53-4171-bb7c-fa6078c84898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:03.892837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cba471-ca53-4171-bb7c-fa6078c84898 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:03.894050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cba471-ca53-4171-bb7c-fa6078c84898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:03.895824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cba471-ca53-4171-bb7c-fa6078c84898 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:03.916778 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1331/2682] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:03.921335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdb994-dfa5-4860-9b5a-0d31a690e734 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:03.941756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdb994-dfa5-4860-9b5a-0d31a690e734 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:03.950554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e27f4-1528-419f-a794-1219e769ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:03.951599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e27f4-1528-419f-a794-1219e769ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:03.952094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e27f4-1528-419f-a794-1219e769ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:03.952600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e27f4-1528-419f-a794-1219e769ef68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:03.953546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e27f4-1528-419f-a794-1219e769ef68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:03.955458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e27f4-1528-419f-a794-1219e769ef68 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:03.986721 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1352/2683] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:51:03.992927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba471-ca53-4171-bb7c-fa6078c84898 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:04.012012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cba471-ca53-4171-bb7c-fa6078c84898 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:04.027724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3742f2e-2ae4-43f7-b1b3-d0a602e87073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:04.029686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3742f2e-2ae4-43f7-b1b3-d0a602e87073 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:04.030173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3742f2e-2ae4-43f7-b1b3-d0a602e87073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:04.041192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3742f2e-2ae4-43f7-b1b3-d0a602e87073 admin admin] PATH_INFO: `/v3/projects/3b47200f231b4ac0a9e658295916e32b/users/e1f203c2e330487e9a1bdfff7e60af3b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:04.090785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3742f2e-2ae4-43f7-b1b3-d0a602e87073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b47200f231b4ac0a9e658295916e32b, user_id=e1f203c2e330487e9a1bdfff7e60af3b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:04.090785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3742f2e-2ae4-43f7-b1b3-d0a602e87073 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:04.132297 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1332/2684] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:03 2022] PUT /identity/v3/projects/3b47200f231b4ac0a9e658295916e32b/users/e1f203c2e330487e9a1bdfff7e60af3b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:04.138182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde872a5-42ab-49fc-8a36-caf598e428ab None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:04.138773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde872a5-42ab-49fc-8a36-caf598e428ab None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:04.139413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde872a5-42ab-49fc-8a36-caf598e428ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:04.184913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fde872a5-42ab-49fc-8a36-caf598e428ab None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:04.186403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fde872a5-42ab-49fc-8a36-caf598e428ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:04.321837 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1353/2685] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:04.375522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3742f2e-2ae4-43f7-b1b3-d0a602e87073 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:04.380242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f3742f2e-2ae4-43f7-b1b3-d0a602e87073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:04.510281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3742f2e-2ae4-43f7-b1b3-d0a602e87073 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:04.515921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49688cd6-87af-459b-bdca-23fd48a3cf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:04.518180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49688cd6-87af-459b-bdca-23fd48a3cf18 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:04.518656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49688cd6-87af-459b-bdca-23fd48a3cf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:04.519128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49688cd6-87af-459b-bdca-23fd48a3cf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:04.534121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49688cd6-87af-459b-bdca-23fd48a3cf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:04.536138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49688cd6-87af-459b-bdca-23fd48a3cf18 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:04.556865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1333/2686] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:05.291022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde872a5-42ab-49fc-8a36-caf598e428ab None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:05.293366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fde872a5-42ab-49fc-8a36-caf598e428ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:05.336843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde872a5-42ab-49fc-8a36-caf598e428ab None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:05.345885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:05.362626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:05.363216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:05.363828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] PATH_INFO: `/v3/projects/c9c240f9d6124be58cbe9b067b12e5a0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:05.368109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c240f9d6124be58cbe9b067b12e5a0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:05.372312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:05.551924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c240f9d6124be58cbe9b067b12e5a0', 'request_id': 'req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:05.574173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c240f9d6124be58cbe9b067b12e5a0', 'request_id': 'req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:05.596825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c240f9d6124be58cbe9b067b12e5a0', 'request_id': 'req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:05.622336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] The token cache is being invalidate because project c9c240f9d6124be58cbe9b067b12e5a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:05.622645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:05.623455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1a8408ca-35e8-468c-aa6e-cdc932cb60a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:05.625038 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1354/2687] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:05 2022] DELETE /identity/v3/projects/c9c240f9d6124be58cbe9b067b12e5a0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:05.634210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b339f-20ec-4d5f-970d-d7abe20f0278 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:05.634691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b339f-20ec-4d5f-970d-d7abe20f0278 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:05.634814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b339f-20ec-4d5f-970d-d7abe20f0278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:05.671852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a38b339f-20ec-4d5f-970d-d7abe20f0278 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:05.673604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a38b339f-20ec-4d5f-970d-d7abe20f0278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:05.856366 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1334/2688] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:05.858611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ef32-caa8-45d2-aac0-d1cacb539073 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:05.858972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ef32-caa8-45d2-aac0-d1cacb539073 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:05.859602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ef32-caa8-45d2-aac0-d1cacb539073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:05.914968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6863ef32-caa8-45d2-aac0-d1cacb539073 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:05.918599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6863ef32-caa8-45d2-aac0-d1cacb539073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:05.949784 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1355/2689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:05.954220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b339f-20ec-4d5f-970d-d7abe20f0278 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:05.976151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b339f-20ec-4d5f-970d-d7abe20f0278 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:05.990279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b266-4d30-4a2d-8239-9822b9d42719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:05.993202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b266-4d30-4a2d-8239-9822b9d42719 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:05.994225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b266-4d30-4a2d-8239-9822b9d42719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:05.995177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b266-4d30-4a2d-8239-9822b9d42719 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:05.996681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812b266-4d30-4a2d-8239-9822b9d42719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:51:05.997525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812b266-4d30-4a2d-8239-9822b9d42719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:06.003254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812b266-4d30-4a2d-8239-9822b9d42719 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:06.008286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ef32-caa8-45d2-aac0-d1cacb539073 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:06.010365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6863ef32-caa8-45d2-aac0-d1cacb539073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:06.051698 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1335/2690] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:51:06.051857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ef32-caa8-45d2-aac0-d1cacb539073 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:06.053189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b266-4d30-4a2d-8239-9822b9d42719 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:06.065197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:06.066791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:06.067529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:06.067808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] PATH_INFO: `/v3/users/6795756089364e3d81d0c7c1589d35a9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:06.071945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6795756089364e3d81d0c7c1589d35a9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:06.075218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:06.082849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b266-4d30-4a2d-8239-9822b9d42719 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:06.098806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcc5f8-d265-430d-9199-ae8814715a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:06.099861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcc5f8-d265-430d-9199-ae8814715a54 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:06.101251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcc5f8-d265-430d-9199-ae8814715a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:06.102445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcc5f8-d265-430d-9199-ae8814715a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:06.105109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcc5f8-d265-430d-9199-ae8814715a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:06.108477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcc5f8-d265-430d-9199-ae8814715a54 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:06.162082 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:06.211099 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1336/2691] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:06 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:06.215224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcc5f8-d265-430d-9199-ae8814715a54 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:06.226643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6795756089364e3d81d0c7c1589d35a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:06.239892 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:06.267455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6795756089364e3d81d0c7c1589d35a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:06.281247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6795756089364e3d81d0c7c1589d35a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:06.296113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6795756089364e3d81d0c7c1589d35a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:06.298000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6795756089364e3d81d0c7c1589d35a9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:06.308709 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1356/2692] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:06 2022] DELETE /identity/v3/users/6795756089364e3d81d0c7c1589d35a9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:51:06.368125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcc5f8-d265-430d-9199-ae8814715a54 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:06.504016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f61779-c9d9-4b81-a961-1dda381ef6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:06.504568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f61779-c9d9-4b81-a961-1dda381ef6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:06.504876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f61779-c9d9-4b81-a961-1dda381ef6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:06.505289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f61779-c9d9-4b81-a961-1dda381ef6f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:06.505945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f61779-c9d9-4b81-a961-1dda381ef6f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:06.507980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f61779-c9d9-4b81-a961-1dda381ef6f4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:06.554768 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1337/2693] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:06 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:06.559103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:06.560749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:06.576985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00973aeb-81f6-4890-833f-773f536a44dd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:06.584004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d2996-279b-4e0e-bb05-80487c0fefd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:06.585501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d2996-279b-4e0e-bb05-80487c0fefd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:06.585876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d2996-279b-4e0e-bb05-80487c0fefd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:06.586263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d2996-279b-4e0e-bb05-80487c0fefd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:06.587014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d2996-279b-4e0e-bb05-80487c0fefd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:06.589017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d2996-279b-4e0e-bb05-80487c0fefd4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:06.609158 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1357/2694] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:06.611956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f61779-c9d9-4b81-a961-1dda381ef6f4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:06.628567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f61779-c9d9-4b81-a961-1dda381ef6f4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:06.639997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d9dfe-bbbd-4314-b7b5-895132eefe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:06.641174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9dfe-bbbd-4314-b7b5-895132eefe0d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:06.641467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9dfe-bbbd-4314-b7b5-895132eefe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:06.641743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9dfe-bbbd-4314-b7b5-895132eefe0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:06.642408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d9dfe-bbbd-4314-b7b5-895132eefe0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:06.644064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d9dfe-bbbd-4314-b7b5-895132eefe0d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:06.681997 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1338/2695] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:51:06.686403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d2996-279b-4e0e-bb05-80487c0fefd4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:06.702296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d2996-279b-4e0e-bb05-80487c0fefd4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:06.711257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f322c3-b370-43de-8d4d-7362914de029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:06.712094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f322c3-b370-43de-8d4d-7362914de029 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:06.712473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f322c3-b370-43de-8d4d-7362914de029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:06.714016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f322c3-b370-43de-8d4d-7362914de029 admin admin] PATH_INFO: `/v3/projects/8afb1bcb4dfd4a6c89c54312cb2e6377/users/7323365b46824abfacf50c9435816bbf/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:06.735838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f322c3-b370-43de-8d4d-7362914de029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8afb1bcb4dfd4a6c89c54312cb2e6377, user_id=7323365b46824abfacf50c9435816bbf, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:06.742174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f322c3-b370-43de-8d4d-7362914de029 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:06.792819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d00bf-8876-467b-b651-b59483959dbb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:06.793377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d00bf-8876-467b-b651-b59483959dbb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:06.796046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d00bf-8876-467b-b651-b59483959dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:06.796238 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1358/2696] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:06 2022] PUT /identity/v3/projects/8afb1bcb4dfd4a6c89c54312cb2e6377/users/7323365b46824abfacf50c9435816bbf/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:06.836308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2b7d00bf-8876-467b-b651-b59483959dbb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:06.843232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2b7d00bf-8876-467b-b651-b59483959dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:06.882962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f322c3-b370-43de-8d4d-7362914de029 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:06.885977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-28f322c3-b370-43de-8d4d-7362914de029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:07.000899 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1339/2697] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:07.072136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f322c3-b370-43de-8d4d-7362914de029 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:07.076006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d00bf-8876-467b-b651-b59483959dbb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:07.079303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2b7d00bf-8876-467b-b651-b59483959dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:07.086291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:07.086947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:07.087270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:07.087623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] PATH_INFO: `/v3/projects/a044d2a9e1a24070af00b9705381e4e7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:07.090694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a044d2a9e1a24070af00b9705381e4e7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:07.095048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:07.144225 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:07.198725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a044d2a9e1a24070af00b9705381e4e7', 'request_id': 'req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.218289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d00bf-8876-467b-b651-b59483959dbb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:07.218482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a044d2a9e1a24070af00b9705381e4e7', 'request_id': 'req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.225699 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:07.228369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a044d2a9e1a24070af00b9705381e4e7', 'request_id': 'req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.254111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] The token cache is being invalidate because project a044d2a9e1a24070af00b9705381e4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:07.254413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.255111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.257222 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1359/2698] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:06 2022] DELETE /identity/v3/projects/a044d2a9e1a24070af00b9705381e4e7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:07.264105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:07.265562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:07.389825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123540a-0941-4648-affa-17f27b52edb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:07.392255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123540a-0941-4648-affa-17f27b52edb1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:07.392756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123540a-0941-4648-affa-17f27b52edb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:07.393198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123540a-0941-4648-affa-17f27b52edb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:07.398569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1123540a-0941-4648-affa-17f27b52edb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:07.425764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6e48c-d8ec-429a-a6d8-ee3e189f7efe admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:07.431197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123540a-0941-4648-affa-17f27b52edb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:07.434576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123540a-0941-4648-affa-17f27b52edb1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:07.440582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:07.441280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:07.441560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:07.441834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] PATH_INFO: `/v3/users/c5bef756c5c74e688ded867d98a6d29a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:07.443639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5bef756c5c74e688ded867d98a6d29a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:07.446413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:07.466646 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1340/2699] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:07.468333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d1df5-fede-4b1a-8372-63d59cd4ba91 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:07.471854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d1df5-fede-4b1a-8372-63d59cd4ba91 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:07.472461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d1df5-fede-4b1a-8372-63d59cd4ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:07.521895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c82d1df5-fede-4b1a-8372-63d59cd4ba91 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:07.526923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c82d1df5-fede-4b1a-8372-63d59cd4ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:07.549592 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1341/2700] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:07.558765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a5a24-2747-48a9-97ff-3da52e3501c2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:07.559458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a5a24-2747-48a9-97ff-3da52e3501c2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:07.559978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a5a24-2747-48a9-97ff-3da52e3501c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:07.606019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-072a5a24-2747-48a9-97ff-3da52e3501c2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:07.607461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-072a5a24-2747-48a9-97ff-3da52e3501c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:07.626891 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1342/2701] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:51:07.631433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a5a24-2747-48a9-97ff-3da52e3501c2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:07.658819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a5a24-2747-48a9-97ff-3da52e3501c2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:07.669513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d12b39-0255-4a8d-9b32-1179cb5aab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:07.670258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d12b39-0255-4a8d-9b32-1179cb5aab78 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:07.672199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d12b39-0255-4a8d-9b32-1179cb5aab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:07.672562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d12b39-0255-4a8d-9b32-1179cb5aab78 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:07.674123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d12b39-0255-4a8d-9b32-1179cb5aab78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:51:07.675289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d12b39-0255-4a8d-9b32-1179cb5aab78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:07.677058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d12b39-0255-4a8d-9b32-1179cb5aab78 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:07.681450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5bef756c5c74e688ded867d98a6d29a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.703105 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1343/2702] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:51:07.707493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d12b39-0255-4a8d-9b32-1179cb5aab78 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:07.728383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d12b39-0255-4a8d-9b32-1179cb5aab78 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:07.729374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5bef756c5c74e688ded867d98a6d29a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.734748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db686dac-1fed-41c2-b971-b8406bd00264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:07.735715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db686dac-1fed-41c2-b971-b8406bd00264 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:07.736455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db686dac-1fed-41c2-b971-b8406bd00264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:07.736923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db686dac-1fed-41c2-b971-b8406bd00264 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:07.738125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db686dac-1fed-41c2-b971-b8406bd00264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:07.742017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db686dac-1fed-41c2-b971-b8406bd00264 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:07.748251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5bef756c5c74e688ded867d98a6d29a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.773100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5bef756c5c74e688ded867d98a6d29a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.774110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48babd9e-3917-4aa9-81c2-6afc600825f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5bef756c5c74e688ded867d98a6d29a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:07.786143 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1344/2703] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:07 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:07.791269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db686dac-1fed-41c2-b971-b8406bd00264 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:07.795547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-db686dac-1fed-41c2-b971-b8406bd00264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:07.811685 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1360/2704] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:07 2022] DELETE /identity/v3/users/c5bef756c5c74e688ded867d98a6d29a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:07.814190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0dbc-8d73-4392-a2a5-93265a1fb481 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:07.814328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0dbc-8d73-4392-a2a5-93265a1fb481 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:07.814610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0dbc-8d73-4392-a2a5-93265a1fb481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:07.859809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3fad0dbc-8d73-4392-a2a5-93265a1fb481 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:07.861574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3fad0dbc-8d73-4392-a2a5-93265a1fb481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:07.985645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db686dac-1fed-41c2-b971-b8406bd00264 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:08.028982 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1361/2705] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:08.094606 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:08.104187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0dbc-8d73-4392-a2a5-93265a1fb481 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:08.106149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3fad0dbc-8d73-4392-a2a5-93265a1fb481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:08.117692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566057c8-b29f-4455-9991-f37e5770a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:08.118471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566057c8-b29f-4455-9991-f37e5770a0fa admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:08.118851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566057c8-b29f-4455-9991-f37e5770a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:08.119222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566057c8-b29f-4455-9991-f37e5770a0fa admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:08.120014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566057c8-b29f-4455-9991-f37e5770a0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:08.122074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566057c8-b29f-4455-9991-f37e5770a0fa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:08.127380 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:08.178409 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1345/2706] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:07 2022] POST /identity/v3/users => generated 291 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:08.179352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566057c8-b29f-4455-9991-f37e5770a0fa admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:08.237696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566057c8-b29f-4455-9991-f37e5770a0fa admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:08.251344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ee6fc-e9f8-4bc9-9018-dcf79abfa27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:08.252462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ee6fc-e9f8-4bc9-9018-dcf79abfa27f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:08.253112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ee6fc-e9f8-4bc9-9018-dcf79abfa27f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:08.254920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ee6fc-e9f8-4bc9-9018-dcf79abfa27f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:08.259354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0dbc-8d73-4392-a2a5-93265a1fb481 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:08.261348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ee6fc-e9f8-4bc9-9018-dcf79abfa27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:08.269014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ee6fc-e9f8-4bc9-9018-dcf79abfa27f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:08.269903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68308dc6-f8b6-44a2-94b9-5036e0106135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:08.270769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68308dc6-f8b6-44a2-94b9-5036e0106135 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:08.271057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68308dc6-f8b6-44a2-94b9-5036e0106135 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:08.271342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68308dc6-f8b6-44a2-94b9-5036e0106135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:08.291008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68308dc6-f8b6-44a2-94b9-5036e0106135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:08.292522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68308dc6-f8b6-44a2-94b9-5036e0106135 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:08.316056 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1362/2707] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:08.330532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68308dc6-f8b6-44a2-94b9-5036e0106135 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:08.331811 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1346/2708] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:08.352204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68308dc6-f8b6-44a2-94b9-5036e0106135 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:08.379747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca61e8b-090b-4e49-884c-df7bfde0a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:08.380394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca61e8b-090b-4e49-884c-df7bfde0a71f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:08.381437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca61e8b-090b-4e49-884c-df7bfde0a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:08.381894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca61e8b-090b-4e49-884c-df7bfde0a71f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:08.382894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca61e8b-090b-4e49-884c-df7bfde0a71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:08.384732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca61e8b-090b-4e49-884c-df7bfde0a71f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:08.418438 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1363/2709] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:51:08.423589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ee6fc-e9f8-4bc9-9018-dcf79abfa27f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:08.449490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ee6fc-e9f8-4bc9-9018-dcf79abfa27f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:08.461544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefa1e7-5839-4745-8dd2-42b19f88dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:08.463597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefa1e7-5839-4745-8dd2-42b19f88dfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:08.463886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefa1e7-5839-4745-8dd2-42b19f88dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:08.464164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefa1e7-5839-4745-8dd2-42b19f88dfb9 admin admin] PATH_INFO: `/v3/projects/f69ef772c8bb45358f98bf5b8ff2e670/users/2f386bc9a48641a4bcd3b09ae45bea70/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:08.527234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefa1e7-5839-4745-8dd2-42b19f88dfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69ef772c8bb45358f98bf5b8ff2e670, user_id=2f386bc9a48641a4bcd3b09ae45bea70, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:08.535296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefa1e7-5839-4745-8dd2-42b19f88dfb9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:08.573576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05160d-ad13-404d-aaa6-c367bbe4c52b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:08.574119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05160d-ad13-404d-aaa6-c367bbe4c52b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:08.574119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05160d-ad13-404d-aaa6-c367bbe4c52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:08.578145 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1347/2710] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:08 2022] PUT /identity/v3/projects/f69ef772c8bb45358f98bf5b8ff2e670/users/2f386bc9a48641a4bcd3b09ae45bea70/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:08.606044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2c05160d-ad13-404d-aaa6-c367bbe4c52b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:08.607935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2c05160d-ad13-404d-aaa6-c367bbe4c52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:08.760813 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1364/2711] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:08.794317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefa1e7-5839-4745-8dd2-42b19f88dfb9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:08.869075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05160d-ad13-404d-aaa6-c367bbe4c52b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:08.870605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2c05160d-ad13-404d-aaa6-c367bbe4c52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:08.901989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05160d-ad13-404d-aaa6-c367bbe4c52b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:08.920393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:08.921089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:08.921377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:08.921699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] PATH_INFO: `/v3/projects/fd215e75fbda44c9a04e669cde1dfaa1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:08.923102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd215e75fbda44c9a04e669cde1dfaa1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:08.925429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:08.995875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefa1e7-5839-4745-8dd2-42b19f88dfb9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:09.006178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31fd35-5036-457a-b353-adfaaeb546cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:09.006924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31fd35-5036-457a-b353-adfaaeb546cf service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:09.007205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31fd35-5036-457a-b353-adfaaeb546cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:09.007481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31fd35-5036-457a-b353-adfaaeb546cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:09.035093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31fd35-5036-457a-b353-adfaaeb546cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:09.037527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31fd35-5036-457a-b353-adfaaeb546cf service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:09.040988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd215e75fbda44c9a04e669cde1dfaa1', 'request_id': 'req-0054aa94-84f7-4389-82c3-b465e851a7ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.062960 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1348/2712] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:09.065135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd215e75fbda44c9a04e669cde1dfaa1', 'request_id': 'req-0054aa94-84f7-4389-82c3-b465e851a7ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.079692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd215e75fbda44c9a04e669cde1dfaa1', 'request_id': 'req-0054aa94-84f7-4389-82c3-b465e851a7ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.106759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] The token cache is being invalidate because project fd215e75fbda44c9a04e669cde1dfaa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:09.107070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.107811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.115146 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1365/2713] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:08 2022] DELETE /identity/v3/projects/fd215e75fbda44c9a04e669cde1dfaa1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:09.121407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31fd35-5036-457a-b353-adfaaeb546cf service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:09.139363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31fd35-5036-457a-b353-adfaaeb546cf service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:09.288095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:09.288858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:09.289161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:09.289463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] PATH_INFO: `/v3/users/886050a9ea1a46428ee4927b2e5fdbe7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:09.290822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886050a9ea1a46428ee4927b2e5fdbe7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:09.292930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:09.393038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886050a9ea1a46428ee4927b2e5fdbe7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.397030 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:09.432500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886050a9ea1a46428ee4927b2e5fdbe7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.447927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886050a9ea1a46428ee4927b2e5fdbe7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.467693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886050a9ea1a46428ee4927b2e5fdbe7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.471770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a39a153c-fbf1-479b-a9aa-de62031dccf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886050a9ea1a46428ee4927b2e5fdbe7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:09.488526 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1349/2714] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:09 2022] DELETE /identity/v3/users/886050a9ea1a46428ee4927b2e5fdbe7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:10.781496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:10.783428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:10.805687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054aa94-84f7-4389-82c3-b465e851a7ef admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:10.886266 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:10.975970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:10.976723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:10.977237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:10.977711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] PATH_INFO: `/v3/projects/5f2fec863e8446128e270320b0ef204d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:10.979428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2fec863e8446128e270320b0ef204d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:10.982805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:11.132842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2fec863e8446128e270320b0ef204d', 'request_id': 'req-447623b5-4c24-4b3c-9d86-0cf3505aef4b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:11.145574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2fec863e8446128e270320b0ef204d', 'request_id': 'req-447623b5-4c24-4b3c-9d86-0cf3505aef4b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:11.163478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2fec863e8446128e270320b0ef204d', 'request_id': 'req-447623b5-4c24-4b3c-9d86-0cf3505aef4b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:11.190379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] The token cache is being invalidate because project 5f2fec863e8446128e270320b0ef204d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:11.191692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:11.201189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-447623b5-4c24-4b3c-9d86-0cf3505aef4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:11.203418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1366/2715] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:10 2022] DELETE /identity/v3/projects/5f2fec863e8446128e270320b0ef204d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:11.208924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e693145-67d4-4bc8-bfc8-c7285aee121a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:11.209964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e693145-67d4-4bc8-bfc8-c7285aee121a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:11.210080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e693145-67d4-4bc8-bfc8-c7285aee121a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:11.251302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4e693145-67d4-4bc8-bfc8-c7285aee121a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:11.254465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4e693145-67d4-4bc8-bfc8-c7285aee121a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:11.291230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0ccf-c87e-451e-9592-9227f5b9460d None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:11.292288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0ccf-c87e-451e-9592-9227f5b9460d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:11.297443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0ccf-c87e-451e-9592-9227f5b9460d None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:11.299326 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1367/2716] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 19 00:51:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:51:11.337224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a076b-2033-4e00-8018-d12c6d6a2fdf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:11.337425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a076b-2033-4e00-8018-d12c6d6a2fdf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:11.337741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a076b-2033-4e00-8018-d12c6d6a2fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:11.381819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-749a076b-2033-4e00-8018-d12c6d6a2fdf None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:11.384820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-749a076b-2033-4e00-8018-d12c6d6a2fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:11.428715 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1350/2717] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:11.439376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1e34-430e-44cc-9b92-256697323d95 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:11.440081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1e34-430e-44cc-9b92-256697323d95 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:11.440600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1e34-430e-44cc-9b92-256697323d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:11.550602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9a2b1e34-430e-44cc-9b92-256697323d95 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:11.551853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9a2b1e34-430e-44cc-9b92-256697323d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:11.576696 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1351/2718] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:11.577670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b1e34-430e-44cc-9b92-256697323d95 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:11.592401 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1368/2719] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 00:51:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:51:11.605675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b1e34-430e-44cc-9b92-256697323d95 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:11.612479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476e96d-2420-42f5-bc81-84422a0424ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:11.613155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476e96d-2420-42f5-bc81-84422a0424ec admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:11.613430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476e96d-2420-42f5-bc81-84422a0424ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:11.613699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476e96d-2420-42f5-bc81-84422a0424ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:11.614370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476e96d-2420-42f5-bc81-84422a0424ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:51:11.614856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476e96d-2420-42f5-bc81-84422a0424ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:11.617343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476e96d-2420-42f5-bc81-84422a0424ec admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:11.668978 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1352/2720] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:51:11.670844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a076b-2033-4e00-8018-d12c6d6a2fdf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:11.692194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a076b-2033-4e00-8018-d12c6d6a2fdf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:11.717654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34bed1-f5ee-4dec-a535-8775f2c35673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:11.718961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34bed1-f5ee-4dec-a535-8775f2c35673 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:11.721070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34bed1-f5ee-4dec-a535-8775f2c35673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:11.721355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34bed1-f5ee-4dec-a535-8775f2c35673 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:11.722019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34bed1-f5ee-4dec-a535-8775f2c35673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:11.724193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34bed1-f5ee-4dec-a535-8775f2c35673 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:11.801238 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1369/2721] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:11 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:11.807121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476e96d-2420-42f5-bc81-84422a0424ec admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:11.827930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476e96d-2420-42f5-bc81-84422a0424ec admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:11.976649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded9705-882f-477d-85c8-adc7870207e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:11.977476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded9705-882f-477d-85c8-adc7870207e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:11.977901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded9705-882f-477d-85c8-adc7870207e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:11.978262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded9705-882f-477d-85c8-adc7870207e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:11.979965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded9705-882f-477d-85c8-adc7870207e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:11.983982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded9705-882f-477d-85c8-adc7870207e7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:11.998740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34bed1-f5ee-4dec-a535-8775f2c35673 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:12.001017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc34bed1-f5ee-4dec-a535-8775f2c35673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:12.036357 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1353/2722] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:11 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:12.038547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded9705-882f-477d-85c8-adc7870207e7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:12.057223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded9705-882f-477d-85c8-adc7870207e7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:12.065584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e41df-4819-41e7-af77-18b38fc2b203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:12.066570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e41df-4819-41e7-af77-18b38fc2b203 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:12.066961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e41df-4819-41e7-af77-18b38fc2b203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:12.067243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e41df-4819-41e7-af77-18b38fc2b203 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:12.068149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e41df-4819-41e7-af77-18b38fc2b203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:12.074714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e41df-4819-41e7-af77-18b38fc2b203 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:12.096752 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1354/2723] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:12.104815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e41df-4819-41e7-af77-18b38fc2b203 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:12.137011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e41df-4819-41e7-af77-18b38fc2b203 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:12.144012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79501fa0-80b7-4f34-9009-c34dbf68ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:12.145244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79501fa0-80b7-4f34-9009-c34dbf68ddaf admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:12.145529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79501fa0-80b7-4f34-9009-c34dbf68ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:12.147219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79501fa0-80b7-4f34-9009-c34dbf68ddaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:12.148330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79501fa0-80b7-4f34-9009-c34dbf68ddaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:12.150481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79501fa0-80b7-4f34-9009-c34dbf68ddaf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:12.168774 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1355/2724] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:12.173140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79501fa0-80b7-4f34-9009-c34dbf68ddaf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:12.187764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79501fa0-80b7-4f34-9009-c34dbf68ddaf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:12.199151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d63b9-8c59-4ccc-abcc-44b6e37c9d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:12.199852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d63b9-8c59-4ccc-abcc-44b6e37c9d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:12.200227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d63b9-8c59-4ccc-abcc-44b6e37c9d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:12.200575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d63b9-8c59-4ccc-abcc-44b6e37c9d8d admin admin] PATH_INFO: `/v3/projects/5685c970486040e2bc073d3bc1a5e577/users/02e52a53aba2448096ac85fcfaa598a1/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:12.223137 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:12.230026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d63b9-8c59-4ccc-abcc-44b6e37c9d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5685c970486040e2bc073d3bc1a5e577, user_id=02e52a53aba2448096ac85fcfaa598a1, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:12.238709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d63b9-8c59-4ccc-abcc-44b6e37c9d8d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:12.278430 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1356/2725] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:12 2022] PUT /identity/v3/projects/5685c970486040e2bc073d3bc1a5e577/users/02e52a53aba2448096ac85fcfaa598a1/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:12.279963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d63b9-8c59-4ccc-abcc-44b6e37c9d8d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:12.281855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c29d63b9-8c59-4ccc-abcc-44b6e37c9d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:12.319375 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:12.400075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34bed1-f5ee-4dec-a535-8775f2c35673 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:12.460825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d63b9-8c59-4ccc-abcc-44b6e37c9d8d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:12.472432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:12.473140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:12.473422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:12.473701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] PATH_INFO: `/v3/users/2ab51886a81f4e1194e0c1ac50eef9d4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:12.481088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab51886a81f4e1194e0c1ac50eef9d4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:12.483079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:12.541964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14534508-ad4b-4d0d-9038-1b891a479cbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:12.542661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14534508-ad4b-4d0d-9038-1b891a479cbf service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:12.542946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14534508-ad4b-4d0d-9038-1b891a479cbf service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:12.543220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14534508-ad4b-4d0d-9038-1b891a479cbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:12.563012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14534508-ad4b-4d0d-9038-1b891a479cbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:12.566427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14534508-ad4b-4d0d-9038-1b891a479cbf service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:12.589061 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1370/2726] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:51:12.590488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431a31e-2833-416a-ac52-532bb33c8d99 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:12.590774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431a31e-2833-416a-ac52-532bb33c8d99 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:12.591051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431a31e-2833-416a-ac52-532bb33c8d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:12.617522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab51886a81f4e1194e0c1ac50eef9d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:12.634853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab51886a81f4e1194e0c1ac50eef9d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:12.643080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f431a31e-2833-416a-ac52-532bb33c8d99 None None] MFA Rules not processed for user `02e52a53aba2448096ac85fcfaa598a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:12.645304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f431a31e-2833-416a-ac52-532bb33c8d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:12.647804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab51886a81f4e1194e0c1ac50eef9d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:12.663489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab51886a81f4e1194e0c1ac50eef9d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:12.665384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab51886a81f4e1194e0c1ac50eef9d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:12.680903 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1357/2727] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:12 2022] DELETE /identity/v3/users/2ab51886a81f4e1194e0c1ac50eef9d4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:12.758483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1371/2728] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:12.761118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:12.763101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:12.863096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580021d-0b98-4716-9fcd-7d63eaff7f53 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:12.874111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491a1aa-7fd7-474b-8ac3-8f3012bcfc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:12.874726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491a1aa-7fd7-474b-8ac3-8f3012bcfc28 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:12.877548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491a1aa-7fd7-474b-8ac3-8f3012bcfc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:12.877877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491a1aa-7fd7-474b-8ac3-8f3012bcfc28 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:12.879951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491a1aa-7fd7-474b-8ac3-8f3012bcfc28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:12.887851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491a1aa-7fd7-474b-8ac3-8f3012bcfc28 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:12.922903 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:12.946915 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1358/2729] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:12 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:12.950405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431a31e-2833-416a-ac52-532bb33c8d99 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:12.964536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431a31e-2833-416a-ac52-532bb33c8d99 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:13.030118 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:13.052733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e9758-ede3-48e3-8522-c1a8d250bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:13.054336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e9758-ede3-48e3-8522-c1a8d250bac8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:13.055037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e9758-ede3-48e3-8522-c1a8d250bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:13.055632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e9758-ede3-48e3-8522-c1a8d250bac8 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:13.056547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e9758-ede3-48e3-8522-c1a8d250bac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:13.059928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e9758-ede3-48e3-8522-c1a8d250bac8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:13.107103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1372/2730] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:12 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:13.107617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491a1aa-7fd7-474b-8ac3-8f3012bcfc28 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:13.123252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491a1aa-7fd7-474b-8ac3-8f3012bcfc28 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:13.138038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c9f94-8238-499b-b940-15bb12936d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:13.138559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c9f94-8238-499b-b940-15bb12936d09 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:13.138902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c9f94-8238-499b-b940-15bb12936d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:13.139203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c9f94-8238-499b-b940-15bb12936d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:13.139802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c9f94-8238-499b-b940-15bb12936d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:13.142861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c9f94-8238-499b-b940-15bb12936d09 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:13.175469 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1359/2731] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:13.178150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e9758-ede3-48e3-8522-c1a8d250bac8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:13.201104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e9758-ede3-48e3-8522-c1a8d250bac8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:13.218037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b8f7-0de8-46c8-aefa-27d4b2c1b1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:13.219217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b8f7-0de8-46c8-aefa-27d4b2c1b1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:13.219987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b8f7-0de8-46c8-aefa-27d4b2c1b1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:13.220503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b8f7-0de8-46c8-aefa-27d4b2c1b1a4 admin admin] PATH_INFO: `/v3/projects/de53ed8b72264939a73db1e03615aeed/users/43ad1b75defc4e15bdbd02e7983f449d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:13.259372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547b8f7-0de8-46c8-aefa-27d4b2c1b1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de53ed8b72264939a73db1e03615aeed, user_id=43ad1b75defc4e15bdbd02e7983f449d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:13.265311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547b8f7-0de8-46c8-aefa-27d4b2c1b1a4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:13.311299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c9f94-8238-499b-b940-15bb12936d09 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:13.326440 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1373/2732] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:13 2022] PUT /identity/v3/projects/de53ed8b72264939a73db1e03615aeed/users/43ad1b75defc4e15bdbd02e7983f449d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:13.329637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c9f94-8238-499b-b940-15bb12936d09 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:13.559837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b8f7-0de8-46c8-aefa-27d4b2c1b1a4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:13.567865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f547b8f7-0de8-46c8-aefa-27d4b2c1b1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:13.599300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3946f87-d86b-4257-9670-ed58b7bf21f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:13.600803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3946f87-d86b-4257-9670-ed58b7bf21f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:13.602889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3946f87-d86b-4257-9670-ed58b7bf21f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:13.603087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3946f87-d86b-4257-9670-ed58b7bf21f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:13.606162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3946f87-d86b-4257-9670-ed58b7bf21f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:13.613408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3946f87-d86b-4257-9670-ed58b7bf21f0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:13.650266 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1360/2733] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:51:13.652429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3946f87-d86b-4257-9670-ed58b7bf21f0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:13.676930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3946f87-d86b-4257-9670-ed58b7bf21f0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:13.691236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdc378-417d-409f-90a3-111ddc05fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:13.694659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdc378-417d-409f-90a3-111ddc05fb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:13.695386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdc378-417d-409f-90a3-111ddc05fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:13.695386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdc378-417d-409f-90a3-111ddc05fb26 admin admin] PATH_INFO: `/v3/projects/de53ed8b72264939a73db1e03615aeed/users/43ad1b75defc4e15bdbd02e7983f449d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:13.700360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdc378-417d-409f-90a3-111ddc05fb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de53ed8b72264939a73db1e03615aeed, user_id=43ad1b75defc4e15bdbd02e7983f449d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:13.707645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdc378-417d-409f-90a3-111ddc05fb26 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:13.752340 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1361/2734] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:13 2022] PUT /identity/v3/projects/de53ed8b72264939a73db1e03615aeed/users/43ad1b75defc4e15bdbd02e7983f449d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:13.754172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f2adb-9f1f-454c-9a61-7e8b4d4f0b72 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:13.754819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f2adb-9f1f-454c-9a61-7e8b4d4f0b72 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:13.756641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f2adb-9f1f-454c-9a61-7e8b4d4f0b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:13.816784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b8f7-0de8-46c8-aefa-27d4b2c1b1a4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:13.893270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6e7f2adb-9f1f-454c-9a61-7e8b4d4f0b72 None None] MFA Rules not processed for user `43ad1b75defc4e15bdbd02e7983f449d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:13.895628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6e7f2adb-9f1f-454c-9a61-7e8b4d4f0b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:13.963627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:13.964306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:13.964798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:13.966011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] PATH_INFO: `/v3/projects/c89259ef29e04d5e87793ae9aafdcbf9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:13.969298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89259ef29e04d5e87793ae9aafdcbf9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:13.972133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:14.098299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89259ef29e04d5e87793ae9aafdcbf9', 'request_id': 'req-8290291c-07ea-4c74-93ed-24c6193d36c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:14.109425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89259ef29e04d5e87793ae9aafdcbf9', 'request_id': 'req-8290291c-07ea-4c74-93ed-24c6193d36c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:14.120260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89259ef29e04d5e87793ae9aafdcbf9', 'request_id': 'req-8290291c-07ea-4c74-93ed-24c6193d36c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:14.139173 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:14.160540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] The token cache is being invalidate because project c89259ef29e04d5e87793ae9aafdcbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:14.164013 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1362/2735] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:14.174488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:14.175689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8290291c-07ea-4c74-93ed-24c6193d36c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:14.176492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c232505-8cc9-4225-b88e-b2b6d557d91f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:14.177670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c232505-8cc9-4225-b88e-b2b6d557d91f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:14.178195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c232505-8cc9-4225-b88e-b2b6d557d91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:14.182886 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1374/2736] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:13 2022] DELETE /identity/v3/projects/c89259ef29e04d5e87793ae9aafdcbf9 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:14.184940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bba25-25b7-4802-a007-cfb10efa407a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:14.185726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bba25-25b7-4802-a007-cfb10efa407a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:14.186227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bba25-25b7-4802-a007-cfb10efa407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:14.213535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c05bba25-25b7-4802-a007-cfb10efa407a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:14.215603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c05bba25-25b7-4802-a007-cfb10efa407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:14.245261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2c232505-8cc9-4225-b88e-b2b6d557d91f None None] MFA Rules not processed for user `02e52a53aba2448096ac85fcfaa598a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:14.248015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2c232505-8cc9-4225-b88e-b2b6d557d91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:14.372234 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1375/2737] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:14.374064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d58bc1-4422-442d-87d4-5862ad2002c3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:14.374348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d58bc1-4422-442d-87d4-5862ad2002c3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:14.374645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d58bc1-4422-442d-87d4-5862ad2002c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:14.374980 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:14.393065 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1363/2738] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:14.408051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-90d58bc1-4422-442d-87d4-5862ad2002c3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:14.408863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c232505-8cc9-4225-b88e-b2b6d557d91f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:14.409521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-90d58bc1-4422-442d-87d4-5862ad2002c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:14.410997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2c232505-8cc9-4225-b88e-b2b6d557d91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:14.423868 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1376/2739] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:14.424826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d58bc1-4422-442d-87d4-5862ad2002c3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:14.437059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d58bc1-4422-442d-87d4-5862ad2002c3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:14.444876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbfff2-2ef5-4dcd-9bdb-0208d0eb3010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:14.445527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbfff2-2ef5-4dcd-9bdb-0208d0eb3010 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:14.445885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbfff2-2ef5-4dcd-9bdb-0208d0eb3010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:14.446172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbfff2-2ef5-4dcd-9bdb-0208d0eb3010 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:14.447977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbfff2-2ef5-4dcd-9bdb-0208d0eb3010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:51:14.448726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbfff2-2ef5-4dcd-9bdb-0208d0eb3010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:14.451283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbfff2-2ef5-4dcd-9bdb-0208d0eb3010 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:14.484712 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1377/2740] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:51:14.486869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbfff2-2ef5-4dcd-9bdb-0208d0eb3010 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:14.501000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbfff2-2ef5-4dcd-9bdb-0208d0eb3010 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:14.527003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796de27-9001-4045-8e19-60c60d890023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:14.527776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796de27-9001-4045-8e19-60c60d890023 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:14.528121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796de27-9001-4045-8e19-60c60d890023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:14.528730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796de27-9001-4045-8e19-60c60d890023 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:14.529981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796de27-9001-4045-8e19-60c60d890023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:14.532301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796de27-9001-4045-8e19-60c60d890023 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:14.634758 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1378/2741] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:14 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:14.635726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c232505-8cc9-4225-b88e-b2b6d557d91f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:14.636418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796de27-9001-4045-8e19-60c60d890023 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:14.819862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796de27-9001-4045-8e19-60c60d890023 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:14.841301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba6ee8-b901-4435-91e8-ba7eefe0f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:14.841782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba6ee8-b901-4435-91e8-ba7eefe0f13a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:14.842096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba6ee8-b901-4435-91e8-ba7eefe0f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:14.842849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba6ee8-b901-4435-91e8-ba7eefe0f13a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:14.843768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba6ee8-b901-4435-91e8-ba7eefe0f13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:14.850583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba6ee8-b901-4435-91e8-ba7eefe0f13a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:14.885169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e31bd-68bb-416c-91c6-b673d6cd80cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:14.886139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e31bd-68bb-416c-91c6-b673d6cd80cb service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:14.888746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e31bd-68bb-416c-91c6-b673d6cd80cb service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:14.889225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e31bd-68bb-416c-91c6-b673d6cd80cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:14.893918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-918e31bd-68bb-416c-91c6-b673d6cd80cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:14.935362 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1379/2742] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:14 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:14.949080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba6ee8-b901-4435-91e8-ba7eefe0f13a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:14.984178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba6ee8-b901-4435-91e8-ba7eefe0f13a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:14.995342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c5431-791d-4efb-ba2f-304fd7eb814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:14.995981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5431-791d-4efb-ba2f-304fd7eb814d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:14.996262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5431-791d-4efb-ba2f-304fd7eb814d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:14.996547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5431-791d-4efb-ba2f-304fd7eb814d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:14.997241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c5431-791d-4efb-ba2f-304fd7eb814d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:14.999917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c5431-791d-4efb-ba2f-304fd7eb814d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:15.026455 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1380/2743] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:15.027482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c5431-791d-4efb-ba2f-304fd7eb814d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:15.062443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c5431-791d-4efb-ba2f-304fd7eb814d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:15.073587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e31bd-68bb-416c-91c6-b673d6cd80cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:15.079185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e31bd-68bb-416c-91c6-b673d6cd80cb service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:15.099524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e31a9-ec95-4e70-a0b0-578de84a1b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:15.100074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e31a9-ec95-4e70-a0b0-578de84a1b7f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:15.100359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e31a9-ec95-4e70-a0b0-578de84a1b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:15.100658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e31a9-ec95-4e70-a0b0-578de84a1b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:15.101717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e31a9-ec95-4e70-a0b0-578de84a1b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:15.107125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e31a9-ec95-4e70-a0b0-578de84a1b7f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:15.131960 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1381/2745] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:15.137132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e31a9-ec95-4e70-a0b0-578de84a1b7f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:15.144055 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1364/2745] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:15.156214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e31a9-ec95-4e70-a0b0-578de84a1b7f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:15.207101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93405b-6660-4969-8340-7bf6f07d5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:15.207805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93405b-6660-4969-8340-7bf6f07d5f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:15.208089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93405b-6660-4969-8340-7bf6f07d5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:15.209304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93405b-6660-4969-8340-7bf6f07d5f50 admin admin] PATH_INFO: `/v3/projects/fd535e93856549acae05601d44c5ac53/users/3bd86c53880840b6b64c43d2e21be454/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:15.281138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93405b-6660-4969-8340-7bf6f07d5f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd535e93856549acae05601d44c5ac53, user_id=3bd86c53880840b6b64c43d2e21be454, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:15.298121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93405b-6660-4969-8340-7bf6f07d5f50 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:15.316884 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:15.333619 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1382/2746] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:15 2022] PUT /identity/v3/projects/fd535e93856549acae05601d44c5ac53/users/3bd86c53880840b6b64c43d2e21be454/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:15.337948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643658-b08c-450c-be06-1f71b702070b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:15.338905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643658-b08c-450c-be06-1f71b702070b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:15.340769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643658-b08c-450c-be06-1f71b702070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:15.402341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0d643658-b08c-450c-be06-1f71b702070b None None] MFA Rules not processed for user `3bd86c53880840b6b64c43d2e21be454`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:15.403833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0d643658-b08c-450c-be06-1f71b702070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:15.467793 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:15.658691 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1365/2747] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:15.671094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93405b-6660-4969-8340-7bf6f07d5f50 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:15.673843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ee93405b-6660-4969-8340-7bf6f07d5f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:15.806727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93405b-6660-4969-8340-7bf6f07d5f50 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:15.814243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b3a1c-fb78-46db-ae70-47e243522240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:15.815073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b3a1c-fb78-46db-ae70-47e243522240 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:15.815486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b3a1c-fb78-46db-ae70-47e243522240 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:15.815860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b3a1c-fb78-46db-ae70-47e243522240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:15.829602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b3a1c-fb78-46db-ae70-47e243522240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:15.831455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b3a1c-fb78-46db-ae70-47e243522240 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:15.858214 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1383/2748] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:16.348878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643658-b08c-450c-be06-1f71b702070b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:16.466547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643658-b08c-450c-be06-1f71b702070b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:16.481046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:16.482586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:16.483063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:16.483394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] PATH_INFO: `/v3/users/3bd86c53880840b6b64c43d2e21be454` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:16.487739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd86c53880840b6b64c43d2e21be454)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:16.492942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:16.671306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd86c53880840b6b64c43d2e21be454'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:16.712037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd86c53880840b6b64c43d2e21be454'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:16.725304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd86c53880840b6b64c43d2e21be454'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:16.755376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd86c53880840b6b64c43d2e21be454'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:16.757658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd86c53880840b6b64c43d2e21be454'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:16.773103 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1366/2749] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:16 2022] DELETE /identity/v3/users/3bd86c53880840b6b64c43d2e21be454 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:16.777013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91b5c-801f-4a05-b22a-4495f8374808 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:16.778237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91b5c-801f-4a05-b22a-4495f8374808 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:16.778801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91b5c-801f-4a05-b22a-4495f8374808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:16.808737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2bf91b5c-801f-4a05-b22a-4495f8374808 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:16.809992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2bf91b5c-801f-4a05-b22a-4495f8374808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:16.985742 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1384/2750] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:17.003438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:17.005149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:17.225905 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:17.280115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fd39c-5f7f-4837-adfd-0edfcdced184 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:17.286320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fb146-efc8-4687-a872-80ac78e9d1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:17.286961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fb146-efc8-4687-a872-80ac78e9d1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:17.289172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fb146-efc8-4687-a872-80ac78e9d1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:17.289498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fb146-efc8-4687-a872-80ac78e9d1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:17.322389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fb146-efc8-4687-a872-80ac78e9d1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:17.325523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fb146-efc8-4687-a872-80ac78e9d1b0 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:17.361890 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1367/2751] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:51:17.924688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c448c-9fe1-493f-ab02-c716ef591d3e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:17.925772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c448c-9fe1-493f-ab02-c716ef591d3e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:17.926268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c448c-9fe1-493f-ab02-c716ef591d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:18.013506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f59c448c-9fe1-493f-ab02-c716ef591d3e None None] MFA Rules not processed for user `e1f203c2e330487e9a1bdfff7e60af3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:18.015302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f59c448c-9fe1-493f-ab02-c716ef591d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:18.190673 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1385/2752] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:18.211297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fb146-efc8-4687-a872-80ac78e9d1b0 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:18.213561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b43fb146-efc8-4687-a872-80ac78e9d1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:18.420234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fb146-efc8-4687-a872-80ac78e9d1b0 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:18.446755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecc434-c6a4-4ffc-8b47-7dc4e31c82c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:18.449475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc434-c6a4-4ffc-8b47-7dc4e31c82c8 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:18.449797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc434-c6a4-4ffc-8b47-7dc4e31c82c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:18.453205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc434-c6a4-4ffc-8b47-7dc4e31c82c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:18.478913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecc434-c6a4-4ffc-8b47-7dc4e31c82c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:18.481168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecc434-c6a4-4ffc-8b47-7dc4e31c82c8 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:18.505271 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1368/2753] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:18.655322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c448c-9fe1-493f-ab02-c716ef591d3e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:18.662014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f59c448c-9fe1-493f-ab02-c716ef591d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:18.721569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c448c-9fe1-493f-ab02-c716ef591d3e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:18.759988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:18.766640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:18.767173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:18.771165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] PATH_INFO: `/v3/projects/fd535e93856549acae05601d44c5ac53` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:18.774990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd535e93856549acae05601d44c5ac53)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:18.782158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:18.807332 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:18.953225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd535e93856549acae05601d44c5ac53', 'request_id': 'req-4f8eae90-084e-4a86-bf61-602a6237d2e3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:18.975062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd535e93856549acae05601d44c5ac53', 'request_id': 'req-4f8eae90-084e-4a86-bf61-602a6237d2e3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:18.988429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd535e93856549acae05601d44c5ac53', 'request_id': 'req-4f8eae90-084e-4a86-bf61-602a6237d2e3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:19.041569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] The token cache is being invalidate because project fd535e93856549acae05601d44c5ac53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:19.041880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:19.045219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8eae90-084e-4a86-bf61-602a6237d2e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:19.049862 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1386/2754] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:18 2022] DELETE /identity/v3/projects/fd535e93856549acae05601d44c5ac53 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:19.061529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de110-5d8c-4844-a65f-1238b7c83ee5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:19.062648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de110-5d8c-4844-a65f-1238b7c83ee5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:19.062648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de110-5d8c-4844-a65f-1238b7c83ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:19.173262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cf8de110-5d8c-4844-a65f-1238b7c83ee5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:19.177249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cf8de110-5d8c-4844-a65f-1238b7c83ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:19.476537 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1369/2755] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:19.494199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522fcc9-9816-4f16-997e-9bd9ef43ce31 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:19.494568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522fcc9-9816-4f16-997e-9bd9ef43ce31 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:19.494811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522fcc9-9816-4f16-997e-9bd9ef43ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:19.530363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1522fcc9-9816-4f16-997e-9bd9ef43ce31 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:19.532428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1522fcc9-9816-4f16-997e-9bd9ef43ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:19.567368 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1387/2756] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:19.573653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de110-5d8c-4844-a65f-1238b7c83ee5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:19.593321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de110-5d8c-4844-a65f-1238b7c83ee5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:19.606263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d288ed-0a36-46b7-847e-205e94141e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:19.608231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d288ed-0a36-46b7-847e-205e94141e6a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:19.608560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d288ed-0a36-46b7-847e-205e94141e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:19.608868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d288ed-0a36-46b7-847e-205e94141e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:19.609705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d288ed-0a36-46b7-847e-205e94141e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:51:19.609860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d288ed-0a36-46b7-847e-205e94141e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:19.619622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d288ed-0a36-46b7-847e-205e94141e6a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:19.654561 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1370/2757] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:51:19.659808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522fcc9-9816-4f16-997e-9bd9ef43ce31 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:19.675202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522fcc9-9816-4f16-997e-9bd9ef43ce31 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:19.692807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48713ac-cb2b-4c90-a865-a1435affbdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:19.693945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48713ac-cb2b-4c90-a865-a1435affbdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:19.694512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48713ac-cb2b-4c90-a865-a1435affbdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:19.695141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48713ac-cb2b-4c90-a865-a1435affbdc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:19.696490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48713ac-cb2b-4c90-a865-a1435affbdc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:19.708981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48713ac-cb2b-4c90-a865-a1435affbdc2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:19.780196 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1388/2758] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:19 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:19.784444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d288ed-0a36-46b7-847e-205e94141e6a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:19.806069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d288ed-0a36-46b7-847e-205e94141e6a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:19.925699 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:19.938241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf40c85-e836-4dac-9ceb-2912b49b36b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:19.938930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf40c85-e836-4dac-9ceb-2912b49b36b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:19.939211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf40c85-e836-4dac-9ceb-2912b49b36b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:19.939481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf40c85-e836-4dac-9ceb-2912b49b36b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:19.940139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf40c85-e836-4dac-9ceb-2912b49b36b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:19.944081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf40c85-e836-4dac-9ceb-2912b49b36b3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:19.985160 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1371/2759] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:19 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:19.989195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48713ac-cb2b-4c90-a865-a1435affbdc2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:20.007562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48713ac-cb2b-4c90-a865-a1435affbdc2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:20.019041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bcdae-723c-429f-8abf-a8fcecd1b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:20.020013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bcdae-723c-429f-8abf-a8fcecd1b6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:20.020471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bcdae-723c-429f-8abf-a8fcecd1b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:20.020947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bcdae-723c-429f-8abf-a8fcecd1b6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:20.022610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bcdae-723c-429f-8abf-a8fcecd1b6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:20.029672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bcdae-723c-429f-8abf-a8fcecd1b6a7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:20.055743 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1389/2760] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:20.061857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf40c85-e836-4dac-9ceb-2912b49b36b3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:20.082704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf40c85-e836-4dac-9ceb-2912b49b36b3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:20.097270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ba209-4c4d-4de4-b7d9-4957a22728fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:20.098183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba209-4c4d-4de4-b7d9-4957a22728fb admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:20.098471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba209-4c4d-4de4-b7d9-4957a22728fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:20.098851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba209-4c4d-4de4-b7d9-4957a22728fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:20.099619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ba209-4c4d-4de4-b7d9-4957a22728fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:20.104298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ba209-4c4d-4de4-b7d9-4957a22728fb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:20.136400 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1372/2761] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:20.140743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bcdae-723c-429f-8abf-a8fcecd1b6a7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:20.155391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bcdae-723c-429f-8abf-a8fcecd1b6a7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:20.170474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fe38e-0514-45a7-8d4c-dfbb267f0639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:20.171971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fe38e-0514-45a7-8d4c-dfbb267f0639 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:20.172520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fe38e-0514-45a7-8d4c-dfbb267f0639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:20.173052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fe38e-0514-45a7-8d4c-dfbb267f0639 admin admin] PATH_INFO: `/v3/projects/b1cc62a2d9b2463bac035f21a8e714de/users/ca9482d7531248e89235a1f850047156/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:20.215345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fe38e-0514-45a7-8d4c-dfbb267f0639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1cc62a2d9b2463bac035f21a8e714de, user_id=ca9482d7531248e89235a1f850047156, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:20.218828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fe38e-0514-45a7-8d4c-dfbb267f0639 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:20.249555 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1390/2762] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:20 2022] PUT /identity/v3/projects/b1cc62a2d9b2463bac035f21a8e714de/users/ca9482d7531248e89235a1f850047156/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:20.262305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005e84a-a42a-4796-a422-b1fd912dedcf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:20.262638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005e84a-a42a-4796-a422-b1fd912dedcf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:20.262912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005e84a-a42a-4796-a422-b1fd912dedcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:20.320441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4005e84a-a42a-4796-a422-b1fd912dedcf None None] MFA Rules not processed for user `ca9482d7531248e89235a1f850047156`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:20.324054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4005e84a-a42a-4796-a422-b1fd912dedcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:20.540026 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1373/2763] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:21.357628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fe38e-0514-45a7-8d4c-dfbb267f0639 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:21.361927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0e3fe38e-0514-45a7-8d4c-dfbb267f0639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:21.611040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fe38e-0514-45a7-8d4c-dfbb267f0639 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:21.643416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee13ba-cd00-47a0-8778-2db61c6977b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:21.644009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee13ba-cd00-47a0-8778-2db61c6977b7 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:21.644302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee13ba-cd00-47a0-8778-2db61c6977b7 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:21.647511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee13ba-cd00-47a0-8778-2db61c6977b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:21.679150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee13ba-cd00-47a0-8778-2db61c6977b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:21.682473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee13ba-cd00-47a0-8778-2db61c6977b7 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:21.725668 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1391/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:21.777556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005e84a-a42a-4796-a422-b1fd912dedcf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:21.880773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285905b7-7f61-4a5d-b889-83a6f9899130 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:21.881161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285905b7-7f61-4a5d-b889-83a6f9899130 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:21.881434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285905b7-7f61-4a5d-b889-83a6f9899130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:21.909236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005e84a-a42a-4796-a422-b1fd912dedcf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:21.918286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:21.919534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:21.920258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:21.920809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] PATH_INFO: `/v3/users/ca9482d7531248e89235a1f850047156` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:21.922958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9482d7531248e89235a1f850047156)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:21.926716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:21.962463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-285905b7-7f61-4a5d-b889-83a6f9899130 None None] MFA Rules not processed for user `7323365b46824abfacf50c9435816bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:21.966263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-285905b7-7f61-4a5d-b889-83a6f9899130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:21.997007 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:22.123207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9482d7531248e89235a1f850047156'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:22.157423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9482d7531248e89235a1f850047156'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:22.168910 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:22.210754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9482d7531248e89235a1f850047156'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:22.227565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9482d7531248e89235a1f850047156'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:22.231355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61262001-00e7-4501-99e3-c86d0f0be32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9482d7531248e89235a1f850047156'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:22.239772 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1374/2765] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:21 2022] DELETE /identity/v3/users/ca9482d7531248e89235a1f850047156 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:22.245392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7bfd-44b8-4e8a-b53d-8aea2219cc4d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:22.245774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7bfd-44b8-4e8a-b53d-8aea2219cc4d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:22.246776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7bfd-44b8-4e8a-b53d-8aea2219cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:22.285140 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1392/2766] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:22.291149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285905b7-7f61-4a5d-b889-83a6f9899130 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:22.294703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-285905b7-7f61-4a5d-b889-83a6f9899130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:22.296853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-940f7bfd-44b8-4e8a-b53d-8aea2219cc4d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:22.300728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-940f7bfd-44b8-4e8a-b53d-8aea2219cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:22.362486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285905b7-7f61-4a5d-b889-83a6f9899130 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:22.516912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1ee6-8502-4b54-990a-20b887af37b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:22.517967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1ee6-8502-4b54-990a-20b887af37b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:22.519151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1ee6-8502-4b54-990a-20b887af37b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:22.519585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1ee6-8502-4b54-990a-20b887af37b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:22.520568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1ee6-8502-4b54-990a-20b887af37b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:22.523517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1ee6-8502-4b54-990a-20b887af37b9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:22.541156 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1375/2767] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:51:22.577174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7bfd-44b8-4e8a-b53d-8aea2219cc4d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:22.583387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-940f7bfd-44b8-4e8a-b53d-8aea2219cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:22.622214 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1393/2768] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:22 2022] POST /identity/v3/projects => generated 383 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:22.628361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1ee6-8502-4b54-990a-20b887af37b9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:22.816410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7bfd-44b8-4e8a-b53d-8aea2219cc4d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:22.859747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1ee6-8502-4b54-990a-20b887af37b9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:22.888874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0188f4-85fe-4f69-9aac-70f6196fc235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:22.890415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0188f4-85fe-4f69-9aac-70f6196fc235 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:22.891133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0188f4-85fe-4f69-9aac-70f6196fc235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:22.891925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0188f4-85fe-4f69-9aac-70f6196fc235 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:22.893399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0188f4-85fe-4f69-9aac-70f6196fc235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:22.897760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0188f4-85fe-4f69-9aac-70f6196fc235 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:22.957243 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1394/2769] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:22 2022] POST /identity/v3/users => generated 298 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:22.960526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0188f4-85fe-4f69-9aac-70f6196fc235 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:22.999516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc9225-f384-4b59-bdfe-324f3c906306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:23.001225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc9225-f384-4b59-bdfe-324f3c906306 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:23.001713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc9225-f384-4b59-bdfe-324f3c906306 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:23.001986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0188f4-85fe-4f69-9aac-70f6196fc235 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:23.002450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc9225-f384-4b59-bdfe-324f3c906306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:23.021584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8a041-1714-4ac5-b11a-a4d8a96669d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:23.025645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a041-1714-4ac5-b11a-a4d8a96669d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:23.026138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a041-1714-4ac5-b11a-a4d8a96669d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:23.026657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a041-1714-4ac5-b11a-a4d8a96669d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:23.029599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc9225-f384-4b59-bdfe-324f3c906306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:23.029868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8a041-1714-4ac5-b11a-a4d8a96669d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:23.033710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc9225-f384-4b59-bdfe-324f3c906306 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:23.037724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8a041-1714-4ac5-b11a-a4d8a96669d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:23.073589 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1395/2770] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:23.080989 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1376/2771] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:23.108740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8a041-1714-4ac5-b11a-a4d8a96669d8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:23.161285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8a041-1714-4ac5-b11a-a4d8a96669d8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:23.199278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a743c7-78ca-4657-9242-39ef7e58fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:23.202618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a743c7-78ca-4657-9242-39ef7e58fcbc admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:23.203777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a743c7-78ca-4657-9242-39ef7e58fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:23.205350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a743c7-78ca-4657-9242-39ef7e58fcbc admin admin] PATH_INFO: `/v3/projects/9fd8811380834e25984c59a5db32dafe/users/0b496adf117b428690bf79ce25400371/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:23.250104 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:23.274791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a743c7-78ca-4657-9242-39ef7e58fcbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd8811380834e25984c59a5db32dafe, user_id=0b496adf117b428690bf79ce25400371, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:23.281737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a743c7-78ca-4657-9242-39ef7e58fcbc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:23.325246 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1396/2772] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:23 2022] PUT /identity/v3/projects/9fd8811380834e25984c59a5db32dafe/users/0b496adf117b428690bf79ce25400371/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:23.327326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc9225-f384-4b59-bdfe-324f3c906306 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:23.357222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc9225-f384-4b59-bdfe-324f3c906306 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:23.473536 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:23.504683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acd6b1-9720-4ae7-8d99-8cb1b863bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:23.505307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acd6b1-9720-4ae7-8d99-8cb1b863bddc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:23.505678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acd6b1-9720-4ae7-8d99-8cb1b863bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:23.505962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acd6b1-9720-4ae7-8d99-8cb1b863bddc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:23.506620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acd6b1-9720-4ae7-8d99-8cb1b863bddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:23.508561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acd6b1-9720-4ae7-8d99-8cb1b863bddc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:23.527374 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1377/2773] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:51:23.533905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a743c7-78ca-4657-9242-39ef7e58fcbc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:23.554995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a743c7-78ca-4657-9242-39ef7e58fcbc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:23.562718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6a39d-08f2-4198-8079-4da15db59912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:23.563587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a39d-08f2-4198-8079-4da15db59912 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:23.564207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a39d-08f2-4198-8079-4da15db59912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:23.564974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a39d-08f2-4198-8079-4da15db59912 admin admin] PATH_INFO: `/v3/projects/9fd8811380834e25984c59a5db32dafe/users/0b496adf117b428690bf79ce25400371/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:23.571218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6a39d-08f2-4198-8079-4da15db59912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd8811380834e25984c59a5db32dafe, user_id=0b496adf117b428690bf79ce25400371, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:23.577639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6a39d-08f2-4198-8079-4da15db59912 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:23.622577 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1397/2774] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:23 2022] PUT /identity/v3/projects/9fd8811380834e25984c59a5db32dafe/users/0b496adf117b428690bf79ce25400371/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:23.762013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acd6b1-9720-4ae7-8d99-8cb1b863bddc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:23.775611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e7acd6b1-9720-4ae7-8d99-8cb1b863bddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:23.814108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acd6b1-9720-4ae7-8d99-8cb1b863bddc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:24.008611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:24.008611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:24.008611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:24.008611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] PATH_INFO: `/v3/projects/b1cc62a2d9b2463bac035f21a8e714de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:24.009683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1cc62a2d9b2463bac035f21a8e714de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:24.009683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:24.117257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1cc62a2d9b2463bac035f21a8e714de', 'request_id': 'req-7df81566-d76b-4c9a-a2b2-71561aab16bc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:24.130222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1cc62a2d9b2463bac035f21a8e714de', 'request_id': 'req-7df81566-d76b-4c9a-a2b2-71561aab16bc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:24.141690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1cc62a2d9b2463bac035f21a8e714de', 'request_id': 'req-7df81566-d76b-4c9a-a2b2-71561aab16bc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:24.183875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] The token cache is being invalidate because project b1cc62a2d9b2463bac035f21a8e714de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:24.184247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:24.184995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7df81566-d76b-4c9a-a2b2-71561aab16bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:24.188304 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1378/2775] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:23 2022] DELETE /identity/v3/projects/b1cc62a2d9b2463bac035f21a8e714de => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:24.193437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c4c0-965c-4468-80cd-c539c31e0be2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:24.194289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c4c0-965c-4468-80cd-c539c31e0be2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:24.194591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c4c0-965c-4468-80cd-c539c31e0be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:24.236050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1ea1c4c0-965c-4468-80cd-c539c31e0be2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:24.238484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1ea1c4c0-965c-4468-80cd-c539c31e0be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:24.477579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ec87-3810-491b-80a3-490df42cd58d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:24.477959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ec87-3810-491b-80a3-490df42cd58d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:24.478360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ec87-3810-491b-80a3-490df42cd58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:24.485254 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1398/2776] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:24.518291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7714ec87-3810-491b-80a3-490df42cd58d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:24.519771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7714ec87-3810-491b-80a3-490df42cd58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:24.564753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1c4c0-965c-4468-80cd-c539c31e0be2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:24.574256 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1379/2777] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:24.582444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1c4c0-965c-4468-80cd-c539c31e0be2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:24.591813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e4114-aa22-456d-abf4-1ea441a74010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:24.592455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e4114-aa22-456d-abf4-1ea441a74010 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:24.592788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e4114-aa22-456d-abf4-1ea441a74010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:24.593067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e4114-aa22-456d-abf4-1ea441a74010 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:24.593733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e4114-aa22-456d-abf4-1ea441a74010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:51:24.594098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e4114-aa22-456d-abf4-1ea441a74010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:24.597853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e4114-aa22-456d-abf4-1ea441a74010 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:24.628871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714ec87-3810-491b-80a3-490df42cd58d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:24.652596 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1399/2778] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:51:24.662636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714ec87-3810-491b-80a3-490df42cd58d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:24.694729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16c56-b9fa-4995-9db0-1b29fc05ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:24.695462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16c56-b9fa-4995-9db0-1b29fc05ce3b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:24.696994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16c56-b9fa-4995-9db0-1b29fc05ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:24.697304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16c56-b9fa-4995-9db0-1b29fc05ce3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:24.698235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16c56-b9fa-4995-9db0-1b29fc05ce3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:24.703463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16c56-b9fa-4995-9db0-1b29fc05ce3b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:24.801206 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1380/2779] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:24 2022] POST /identity/v3/projects => generated 359 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:24.806125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e4114-aa22-456d-abf4-1ea441a74010 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:24.823096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e4114-aa22-456d-abf4-1ea441a74010 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:25.025059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cf916-fa40-42ac-ac64-2d43db5a7c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:25.026069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cf916-fa40-42ac-ac64-2d43db5a7c2c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:25.026665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cf916-fa40-42ac-ac64-2d43db5a7c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:25.030929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cf916-fa40-42ac-ac64-2d43db5a7c2c admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:25.032046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cf916-fa40-42ac-ac64-2d43db5a7c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:25.041581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cf916-fa40-42ac-ac64-2d43db5a7c2c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:25.132738 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1400/2780] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:24 2022] POST /identity/v3/users => generated 280 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:25.138664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16c56-b9fa-4995-9db0-1b29fc05ce3b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:25.164288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16c56-b9fa-4995-9db0-1b29fc05ce3b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:25.181801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae622439-feb6-4d58-a317-a956bec2a5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:25.182613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae622439-feb6-4d58-a317-a956bec2a5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:25.182977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae622439-feb6-4d58-a317-a956bec2a5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:25.183464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae622439-feb6-4d58-a317-a956bec2a5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:25.184712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae622439-feb6-4d58-a317-a956bec2a5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:25.189900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae622439-feb6-4d58-a317-a956bec2a5b0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:25.227610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cf916-fa40-42ac-ac64-2d43db5a7c2c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:25.229184 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1381/2781] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:25.240263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cf916-fa40-42ac-ac64-2d43db5a7c2c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:25.247699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6b812-f4b3-4f15-a4ce-d20c8d45ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:25.248333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6b812-f4b3-4f15-a4ce-d20c8d45ad4e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:25.248742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6b812-f4b3-4f15-a4ce-d20c8d45ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:25.249023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6b812-f4b3-4f15-a4ce-d20c8d45ad4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:25.249684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6b812-f4b3-4f15-a4ce-d20c8d45ad4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:25.251410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6b812-f4b3-4f15-a4ce-d20c8d45ad4e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:25.271662 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1401/2782] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:25.275644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae622439-feb6-4d58-a317-a956bec2a5b0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:25.289038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae622439-feb6-4d58-a317-a956bec2a5b0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:25.294709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaff4b0-4587-4ff8-bfa8-fa642f72d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:25.295460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaff4b0-4587-4ff8-bfa8-fa642f72d387 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:25.295748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaff4b0-4587-4ff8-bfa8-fa642f72d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:25.296061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaff4b0-4587-4ff8-bfa8-fa642f72d387 admin admin] PATH_INFO: `/v3/projects/17e562eb048b447e93a9ae77de571ebc/users/babbf6d13b71418f85d2a0f180eb46c9/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:25.318850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaff4b0-4587-4ff8-bfa8-fa642f72d387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e562eb048b447e93a9ae77de571ebc, user_id=babbf6d13b71418f85d2a0f180eb46c9, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:25.324607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaff4b0-4587-4ff8-bfa8-fa642f72d387 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:25.346537 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1382/2783] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:25 2022] PUT /identity/v3/projects/17e562eb048b447e93a9ae77de571ebc/users/babbf6d13b71418f85d2a0f180eb46c9/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:51:25.359396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae119-e2e4-4dde-93d8-6f6253bf7b3e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:25.360682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae119-e2e4-4dde-93d8-6f6253bf7b3e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:25.361019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae119-e2e4-4dde-93d8-6f6253bf7b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:25.420522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9beae119-e2e4-4dde-93d8-6f6253bf7b3e None None] MFA Rules not processed for user `babbf6d13b71418f85d2a0f180eb46c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:25.425834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9beae119-e2e4-4dde-93d8-6f6253bf7b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:25.488778 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:25.567630 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1402/2784] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:26.085470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62196d-01d8-4030-9e6c-30897fb5028d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:26.086118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62196d-01d8-4030-9e6c-30897fb5028d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:26.086625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62196d-01d8-4030-9e6c-30897fb5028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:26.119115 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:26.143418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1e62196d-01d8-4030-9e6c-30897fb5028d None None] MFA Rules not processed for user `e1f203c2e330487e9a1bdfff7e60af3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:26.150264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e62196d-01d8-4030-9e6c-30897fb5028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:26.325381 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1383/2785] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:26.354820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beae119-e2e4-4dde-93d8-6f6253bf7b3e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:26.356603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9beae119-e2e4-4dde-93d8-6f6253bf7b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:26.558521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beae119-e2e4-4dde-93d8-6f6253bf7b3e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:26.567540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d61272-0f72-42c7-b231-d14cf53d7256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:26.568723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d61272-0f72-42c7-b231-d14cf53d7256 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:26.569277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d61272-0f72-42c7-b231-d14cf53d7256 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:26.569277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d61272-0f72-42c7-b231-d14cf53d7256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:26.585806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d61272-0f72-42c7-b231-d14cf53d7256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:26.590869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d61272-0f72-42c7-b231-d14cf53d7256 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:26.629521 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1403/2786] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:26.714876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62196d-01d8-4030-9e6c-30897fb5028d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:26.952703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62196d-01d8-4030-9e6c-30897fb5028d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:26.972398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:26.973429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:26.973960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:26.974490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] PATH_INFO: `/v3/users/babbf6d13b71418f85d2a0f180eb46c9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:26.977705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=babbf6d13b71418f85d2a0f180eb46c9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:26.979945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:27.077554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babbf6d13b71418f85d2a0f180eb46c9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:27.102781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babbf6d13b71418f85d2a0f180eb46c9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:27.116037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babbf6d13b71418f85d2a0f180eb46c9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:27.151332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babbf6d13b71418f85d2a0f180eb46c9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:27.153314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babbf6d13b71418f85d2a0f180eb46c9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:27.200339 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1384/2787] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:26 2022] DELETE /identity/v3/users/babbf6d13b71418f85d2a0f180eb46c9 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:27.204701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a1bb-aa3d-45f1-81c9-653cb4d9bc0f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:27.205164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a1bb-aa3d-45f1-81c9-653cb4d9bc0f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:27.205611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a1bb-aa3d-45f1-81c9-653cb4d9bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:27.241522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cfb5a1bb-aa3d-45f1-81c9-653cb4d9bc0f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:27.242770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cfb5a1bb-aa3d-45f1-81c9-653cb4d9bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:27.345383 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1404/2788] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:27.371544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:27.373557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:27.470626 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:27.525728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05066c5a-6c7e-42c1-895f-b47ccdb51ab0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:27.539728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52878767-852e-443b-9279-837d20b709a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:27.540348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52878767-852e-443b-9279-837d20b709a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:27.540864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52878767-852e-443b-9279-837d20b709a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:27.541344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52878767-852e-443b-9279-837d20b709a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:27.565697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52878767-852e-443b-9279-837d20b709a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:27.567336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52878767-852e-443b-9279-837d20b709a3 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:27.589259 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1385/2789] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:29.187763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5a1bb-aa3d-45f1-81c9-653cb4d9bc0f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:29.189392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cfb5a1bb-aa3d-45f1-81c9-653cb4d9bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:29.219261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5a1bb-aa3d-45f1-81c9-653cb4d9bc0f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:29.234495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:29.235181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:29.235621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:29.235939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] PATH_INFO: `/v3/projects/17e562eb048b447e93a9ae77de571ebc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:29.245625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e562eb048b447e93a9ae77de571ebc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:29.247630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:29.339556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e562eb048b447e93a9ae77de571ebc', 'request_id': 'req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:29.342285 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:29.363776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e562eb048b447e93a9ae77de571ebc', 'request_id': 'req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:29.390377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e562eb048b447e93a9ae77de571ebc', 'request_id': 'req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:29.406297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] The token cache is being invalidate because project 17e562eb048b447e93a9ae77de571ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:29.406788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:29.418497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1cdb6cc3-6bc5-4449-abdc-bab3021de03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:29.432193 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1405/2790] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:29 2022] DELETE /identity/v3/projects/17e562eb048b447e93a9ae77de571ebc => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:29.434079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c286-f2aa-4403-bbbd-ffa6eeb26970 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:29.438816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c286-f2aa-4403-bbbd-ffa6eeb26970 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:29.439384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c286-f2aa-4403-bbbd-ffa6eeb26970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:29.482726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ab83c286-f2aa-4403-bbbd-ffa6eeb26970 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:29.484073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ab83c286-f2aa-4403-bbbd-ffa6eeb26970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:29.673546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213ae7-db52-4ada-a3fb-bfa46b226adb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:29.674010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213ae7-db52-4ada-a3fb-bfa46b226adb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:29.674396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213ae7-db52-4ada-a3fb-bfa46b226adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:29.681923 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1386/2791] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:51:29.707851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-36213ae7-db52-4ada-a3fb-bfa46b226adb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:29.709687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-36213ae7-db52-4ada-a3fb-bfa46b226adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:29.740819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83c286-f2aa-4403-bbbd-ffa6eeb26970 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:29.748210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1406/2792] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:29.763349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83c286-f2aa-4403-bbbd-ffa6eeb26970 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:29.812897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a134a-0375-4a03-84fa-ee4e544d4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:29.827584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a134a-0375-4a03-84fa-ee4e544d4f46 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:29.827923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a134a-0375-4a03-84fa-ee4e544d4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:29.828220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a134a-0375-4a03-84fa-ee4e544d4f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:29.828937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a134a-0375-4a03-84fa-ee4e544d4f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:51:29.829259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a134a-0375-4a03-84fa-ee4e544d4f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:29.830922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a134a-0375-4a03-84fa-ee4e544d4f46 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:29.877005 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1387/2793] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:51:29.881959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213ae7-db52-4ada-a3fb-bfa46b226adb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:29.905315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213ae7-db52-4ada-a3fb-bfa46b226adb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:29.964010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4eb5a-d0a0-4e4c-9f89-a1aa7d804d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:29.965081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4eb5a-d0a0-4e4c-9f89-a1aa7d804d9e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:29.965614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4eb5a-d0a0-4e4c-9f89-a1aa7d804d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:29.966783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4eb5a-d0a0-4e4c-9f89-a1aa7d804d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:29.970084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4eb5a-d0a0-4e4c-9f89-a1aa7d804d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:29.980313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4eb5a-d0a0-4e4c-9f89-a1aa7d804d9e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:30.082443 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1407/2794] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:29 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:30.093275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a134a-0375-4a03-84fa-ee4e544d4f46 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:30.106177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a134a-0375-4a03-84fa-ee4e544d4f46 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:30.275834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7621-e300-42da-85f1-c1d123791677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:30.276710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7621-e300-42da-85f1-c1d123791677 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:30.277074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7621-e300-42da-85f1-c1d123791677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:30.277265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7621-e300-42da-85f1-c1d123791677 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:30.277899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7621-e300-42da-85f1-c1d123791677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:30.286367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7621-e300-42da-85f1-c1d123791677 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:30.333046 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1388/2795] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:30 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:30.337420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4eb5a-d0a0-4e4c-9f89-a1aa7d804d9e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:30.356639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4eb5a-d0a0-4e4c-9f89-a1aa7d804d9e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:30.370496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e91e0-281c-42e1-a51a-3a6a143da259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:30.371233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e91e0-281c-42e1-a51a-3a6a143da259 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:30.372675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e91e0-281c-42e1-a51a-3a6a143da259 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:30.372675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e91e0-281c-42e1-a51a-3a6a143da259 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:30.372675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e91e0-281c-42e1-a51a-3a6a143da259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:30.374265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e91e0-281c-42e1-a51a-3a6a143da259 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:30.397287 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1408/2796] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:30.402858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7621-e300-42da-85f1-c1d123791677 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:30.416472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7621-e300-42da-85f1-c1d123791677 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:30.432988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a0024-6318-4656-9f6e-9453880e1df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:30.435190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0024-6318-4656-9f6e-9453880e1df8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:30.435777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0024-6318-4656-9f6e-9453880e1df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:30.435777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0024-6318-4656-9f6e-9453880e1df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:30.436424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a0024-6318-4656-9f6e-9453880e1df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:30.438312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a0024-6318-4656-9f6e-9453880e1df8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:30.461758 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1389/2797] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:30.466951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e91e0-281c-42e1-a51a-3a6a143da259 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:30.481859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e91e0-281c-42e1-a51a-3a6a143da259 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:30.501442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06031f-02e2-4d22-bc74-a3fa6453045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:30.502315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06031f-02e2-4d22-bc74-a3fa6453045e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:30.502611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06031f-02e2-4d22-bc74-a3fa6453045e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:30.502928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06031f-02e2-4d22-bc74-a3fa6453045e admin admin] PATH_INFO: `/v3/projects/3642cd3632604ea8aa75cf14c9fef293/users/2542aef0e4464018bf9d4563ffe9030d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:30.532543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06031f-02e2-4d22-bc74-a3fa6453045e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3642cd3632604ea8aa75cf14c9fef293, user_id=2542aef0e4464018bf9d4563ffe9030d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:30.535324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06031f-02e2-4d22-bc74-a3fa6453045e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:30.568855 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1409/2798] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:30 2022] PUT /identity/v3/projects/3642cd3632604ea8aa75cf14c9fef293/users/2542aef0e4464018bf9d4563ffe9030d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:30.575284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff755fb9-0ef4-4d32-ac3b-5004c1125291 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:30.575574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff755fb9-0ef4-4d32-ac3b-5004c1125291 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:30.575905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff755fb9-0ef4-4d32-ac3b-5004c1125291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:30.603362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ff755fb9-0ef4-4d32-ac3b-5004c1125291 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:30.604637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ff755fb9-0ef4-4d32-ac3b-5004c1125291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:30.703832 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:30.758378 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1390/2799] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:30.775621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06031f-02e2-4d22-bc74-a3fa6453045e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:30.777527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c06031f-02e2-4d22-bc74-a3fa6453045e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:30.937673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06031f-02e2-4d22-bc74-a3fa6453045e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:30.948492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770803-a4bd-4fd6-9b95-47fa7b75dbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:30.950582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770803-a4bd-4fd6-9b95-47fa7b75dbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:30.951021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770803-a4bd-4fd6-9b95-47fa7b75dbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:30.951302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770803-a4bd-4fd6-9b95-47fa7b75dbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:30.982769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8770803-a4bd-4fd6-9b95-47fa7b75dbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:30.985692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8770803-a4bd-4fd6-9b95-47fa7b75dbc1 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:31.071223 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1410/2800] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:34.015942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bbee3-8303-4d8b-9e93-0932bd44a331 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:34.016768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bbee3-8303-4d8b-9e93-0932bd44a331 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:34.016768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bbee3-8303-4d8b-9e93-0932bd44a331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:34.073815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-609bbee3-8303-4d8b-9e93-0932bd44a331 None None] MFA Rules not processed for user `2f386bc9a48641a4bcd3b09ae45bea70`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:34.075652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-609bbee3-8303-4d8b-9e93-0932bd44a331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:34.191022 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1391/2801] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:34.205152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770803-a4bd-4fd6-9b95-47fa7b75dbc1 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:34.207129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d8770803-a4bd-4fd6-9b95-47fa7b75dbc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:34.485825 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:34.726971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770803-a4bd-4fd6-9b95-47fa7b75dbc1 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:34.737411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71aaf8-7bd9-406e-8f1c-b4882d578f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:34.738054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71aaf8-7bd9-406e-8f1c-b4882d578f27 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:34.738336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71aaf8-7bd9-406e-8f1c-b4882d578f27 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:34.738611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71aaf8-7bd9-406e-8f1c-b4882d578f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:34.760192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71aaf8-7bd9-406e-8f1c-b4882d578f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:34.762349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71aaf8-7bd9-406e-8f1c-b4882d578f27 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:34.785117 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1411/2802] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:51:36.419465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baa56d-9a58-4229-8d09-1b3112f8e226 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:36.419998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baa56d-9a58-4229-8d09-1b3112f8e226 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:36.419998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baa56d-9a58-4229-8d09-1b3112f8e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:36.498328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f4baa56d-9a58-4229-8d09-1b3112f8e226 None None] MFA Rules not processed for user `2f386bc9a48641a4bcd3b09ae45bea70`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:36.505055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f4baa56d-9a58-4229-8d09-1b3112f8e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:36.525824 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1392/2803] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:37.673070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590c5cf-14da-4d85-9694-c0d0b890ee30 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:37.674004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590c5cf-14da-4d85-9694-c0d0b890ee30 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:37.674516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590c5cf-14da-4d85-9694-c0d0b890ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:37.827390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0590c5cf-14da-4d85-9694-c0d0b890ee30 None None] MFA Rules not processed for user `0b496adf117b428690bf79ce25400371`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:37.832795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0590c5cf-14da-4d85-9694-c0d0b890ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:38.079483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1412/2804] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:40.033739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baa56d-9a58-4229-8d09-1b3112f8e226 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:40.070820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baa56d-9a58-4229-8d09-1b3112f8e226 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:40.101824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accca98-102e-4a4b-8bd0-77b965bb72aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:40.102480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accca98-102e-4a4b-8bd0-77b965bb72aa service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:40.107228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accca98-102e-4a4b-8bd0-77b965bb72aa service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:40.107834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accca98-102e-4a4b-8bd0-77b965bb72aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:40.112459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0accca98-102e-4a4b-8bd0-77b965bb72aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:40.300263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accca98-102e-4a4b-8bd0-77b965bb72aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:40.302657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accca98-102e-4a4b-8bd0-77b965bb72aa service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:40.328948 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1393/2805] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:45.011294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590c5cf-14da-4d85-9694-c0d0b890ee30 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:45.015176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0590c5cf-14da-4d85-9694-c0d0b890ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:45.314153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590c5cf-14da-4d85-9694-c0d0b890ee30 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:45.335592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78810385-0f31-4a68-a023-40157fa4a979 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:45.338285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78810385-0f31-4a68-a023-40157fa4a979 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:45.342135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78810385-0f31-4a68-a023-40157fa4a979 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:45.342604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78810385-0f31-4a68-a023-40157fa4a979 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:45.345278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-78810385-0f31-4a68-a023-40157fa4a979 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:45.369821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78810385-0f31-4a68-a023-40157fa4a979 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:45.377404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78810385-0f31-4a68-a023-40157fa4a979 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:45.424058 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1413/2806] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:50.315976 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=72 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:52.062290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce4d7-49fb-4de7-966d-40d9acd26a06 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:52.062980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce4d7-49fb-4de7-966d-40d9acd26a06 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:52.063345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce4d7-49fb-4de7-966d-40d9acd26a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:52.115949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6724ac-61a5-4084-baa7-99209f65fcd5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:52.116435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6724ac-61a5-4084-baa7-99209f65fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:52.118669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6724ac-61a5-4084-baa7-99209f65fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:52.146393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fdfce4d7-49fb-4de7-966d-40d9acd26a06 None None] MFA Rules not processed for user `2542aef0e4464018bf9d4563ffe9030d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:52.149009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fdfce4d7-49fb-4de7-966d-40d9acd26a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:52.201141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7b6724ac-61a5-4084-baa7-99209f65fcd5 None None] MFA Rules not processed for user `7323365b46824abfacf50c9435816bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:52.202414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7b6724ac-61a5-4084-baa7-99209f65fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:52.220844 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1414/2807] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:51:52.330733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6724ac-61a5-4084-baa7-99209f65fcd5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:52.332875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7b6724ac-61a5-4084-baa7-99209f65fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:52.341888 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1394/2808] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:52.348990 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:52.354311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed6f2-8fa9-4f3f-ab79-fa971e71b2dd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:52.354673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed6f2-8fa9-4f3f-ab79-fa971e71b2dd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:52.355027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed6f2-8fa9-4f3f-ab79-fa971e71b2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:52.368344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6724ac-61a5-4084-baa7-99209f65fcd5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:52.387411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:52.387411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:52.387411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:52.387411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:52.388892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:52.396881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c1eed6f2-8fa9-4f3f-ab79-fa971e71b2dd None None] MFA Rules not processed for user `2542aef0e4464018bf9d4563ffe9030d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:52.399266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c1eed6f2-8fa9-4f3f-ab79-fa971e71b2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:52.417175 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1395/2809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:52.485413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:52.487167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:52.512303 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1415/2810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:53.905953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed6f2-8fa9-4f3f-ab79-fa971e71b2dd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:53.920399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed6f2-8fa9-4f3f-ab79-fa971e71b2dd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:53.929830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b84c15-6936-4392-9d2b-21fcb7e85fd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:53.930742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b84c15-6936-4392-9d2b-21fcb7e85fd5 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:53.931230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b84c15-6936-4392-9d2b-21fcb7e85fd5 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:53.931877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b84c15-6936-4392-9d2b-21fcb7e85fd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:53.942387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b84c15-6936-4392-9d2b-21fcb7e85fd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:53.944885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b84c15-6936-4392-9d2b-21fcb7e85fd5 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:53.968263 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1396/2811] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:54.267708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:54.270581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:54.287161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba347-18b5-4a3f-a2ee-aa0055fa7e60 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:54.294057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:54.295896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:54.296422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:54.296959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] PATH_INFO: `/v3/users/85b59e131dd940b1b397f5ed429c814f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:54.298527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b59e131dd940b1b397f5ed429c814f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:54.301632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:54.386464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b59e131dd940b1b397f5ed429c814f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:54.405533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b59e131dd940b1b397f5ed429c814f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:54.420286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b59e131dd940b1b397f5ed429c814f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:54.476368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b59e131dd940b1b397f5ed429c814f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:54.477186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-089c8d5d-fc8e-49b1-8292-51aae7c28b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b59e131dd940b1b397f5ed429c814f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:54.486102 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1416/2812] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:51:54 2022] DELETE /identity/v3/users/85b59e131dd940b1b397f5ed429c814f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:55.051735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b84c15-6936-4392-9d2b-21fcb7e85fd5 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:55.076239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b84c15-6936-4392-9d2b-21fcb7e85fd5 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:55.233423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:55.234726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:55.241307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:55.241976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] PATH_INFO: `/v3/projects/9bd2de014bb94e17824f48a23cd16a65` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:55.244465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd2de014bb94e17824f48a23cd16a65)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:55.246878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:55.368787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd2de014bb94e17824f48a23cd16a65', 'request_id': 'req-668e4ed3-430b-4358-8b1e-6123bc2dd981'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:55.393866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd2de014bb94e17824f48a23cd16a65', 'request_id': 'req-668e4ed3-430b-4358-8b1e-6123bc2dd981'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:55.411966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd2de014bb94e17824f48a23cd16a65', 'request_id': 'req-668e4ed3-430b-4358-8b1e-6123bc2dd981'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:55.428208 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:55.434059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] The token cache is being invalidate because project 9bd2de014bb94e17824f48a23cd16a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:51:55.435298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:55.436820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-668e4ed3-430b-4358-8b1e-6123bc2dd981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:51:55.439549 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1397/2813] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:55 2022] DELETE /identity/v3/projects/9bd2de014bb94e17824f48a23cd16a65 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:55.445199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d13471-fd18-4329-8b80-07e72326a714 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:55.445815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d13471-fd18-4329-8b80-07e72326a714 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:55.445815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d13471-fd18-4329-8b80-07e72326a714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:55.540874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-91d13471-fd18-4329-8b80-07e72326a714 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:55.545891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-91d13471-fd18-4329-8b80-07e72326a714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:55.763641 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:55.799713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09d150-b770-45e9-b416-530bbac61082 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:55.799984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09d150-b770-45e9-b416-530bbac61082 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:55.800258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09d150-b770-45e9-b416-530bbac61082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:55.800386 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1417/2814] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:55.870662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fd09d150-b770-45e9-b416-530bbac61082 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:55.876487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fd09d150-b770-45e9-b416-530bbac61082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:55.910331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d13471-fd18-4329-8b80-07e72326a714 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:55.917976 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1398/2815] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:55.929268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d13471-fd18-4329-8b80-07e72326a714 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:55.953386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20335f2-3980-4881-81f4-cbc34d175013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:55.954042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20335f2-3980-4881-81f4-cbc34d175013 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:55.961846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20335f2-3980-4881-81f4-cbc34d175013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:55.967095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20335f2-3980-4881-81f4-cbc34d175013 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:55.967700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20335f2-3980-4881-81f4-cbc34d175013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:51:55.968035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20335f2-3980-4881-81f4-cbc34d175013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:55.969740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20335f2-3980-4881-81f4-cbc34d175013 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:55.996290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09d150-b770-45e9-b416-530bbac61082 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:56.005818 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1418/2816] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:51:56.010116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09d150-b770-45e9-b416-530bbac61082 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:56.015719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db9bd6-58ff-4d09-8086-ddd13de81846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:56.016291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9bd6-58ff-4d09-8086-ddd13de81846 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:56.016668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9bd6-58ff-4d09-8086-ddd13de81846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:56.017020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9bd6-58ff-4d09-8086-ddd13de81846 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:56.017778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db9bd6-58ff-4d09-8086-ddd13de81846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:56.020862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db9bd6-58ff-4d09-8086-ddd13de81846 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:56.099665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20335f2-3980-4881-81f4-cbc34d175013 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:56.107715 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1399/2817] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:51:55 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:51:56.112417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20335f2-3980-4881-81f4-cbc34d175013 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:56.265892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c176383-f7b7-48e1-92a7-2c92713ade87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:56.266707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c176383-f7b7-48e1-92a7-2c92713ade87 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:56.267064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c176383-f7b7-48e1-92a7-2c92713ade87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:56.267507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c176383-f7b7-48e1-92a7-2c92713ade87 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:56.268154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c176383-f7b7-48e1-92a7-2c92713ade87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:56.271143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c176383-f7b7-48e1-92a7-2c92713ade87 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:56.361970 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1419/2818] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:51:56 2022] POST /identity/v3/users => generated 296 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:51:56.367950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db9bd6-58ff-4d09-8086-ddd13de81846 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:56.384862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db9bd6-58ff-4d09-8086-ddd13de81846 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:56.395231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eebdd-053b-463f-977a-e04a7741b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:56.396078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eebdd-053b-463f-977a-e04a7741b9be admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:56.396287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eebdd-053b-463f-977a-e04a7741b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:56.398244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eebdd-053b-463f-977a-e04a7741b9be admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:56.400198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15eebdd-053b-463f-977a-e04a7741b9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:56.409812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15eebdd-053b-463f-977a-e04a7741b9be admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:56.434150 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1400/2819] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:56.435048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c176383-f7b7-48e1-92a7-2c92713ade87 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:56.448525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c176383-f7b7-48e1-92a7-2c92713ade87 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:56.454660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec180aa-fb3f-4799-83c0-df852cfd9a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:56.473946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec180aa-fb3f-4799-83c0-df852cfd9a91 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:56.474606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec180aa-fb3f-4799-83c0-df852cfd9a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:56.475295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec180aa-fb3f-4799-83c0-df852cfd9a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:56.477550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec180aa-fb3f-4799-83c0-df852cfd9a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:56.479483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec180aa-fb3f-4799-83c0-df852cfd9a91 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:56.503842 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1420/2820] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:51:56.510009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eebdd-053b-463f-977a-e04a7741b9be admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:56.558134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eebdd-053b-463f-977a-e04a7741b9be admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:56.564962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c4023-51d3-4d2d-8f86-be1675976f6e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:56.565641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c4023-51d3-4d2d-8f86-be1675976f6e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:56.566016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c4023-51d3-4d2d-8f86-be1675976f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:56.585030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469939d-ed4a-4e2b-aadb-48cd648032b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:56.585915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469939d-ed4a-4e2b-aadb-48cd648032b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:56.586503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469939d-ed4a-4e2b-aadb-48cd648032b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:56.586931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469939d-ed4a-4e2b-aadb-48cd648032b2 admin admin] PATH_INFO: `/v3/projects/1a1c816191c44b799ffe501cad81ffba/users/8b723ed2b79d4049ac0ee542d18b45c3/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:56.608069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b94c4023-51d3-4d2d-8f86-be1675976f6e None None] MFA Rules not processed for user `02e52a53aba2448096ac85fcfaa598a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:56.610049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b94c4023-51d3-4d2d-8f86-be1675976f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:56.621040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469939d-ed4a-4e2b-aadb-48cd648032b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1c816191c44b799ffe501cad81ffba, user_id=8b723ed2b79d4049ac0ee542d18b45c3, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:56.624424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469939d-ed4a-4e2b-aadb-48cd648032b2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:56.661317 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1401/2821] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:51:56 2022] PUT /identity/v3/projects/1a1c816191c44b799ffe501cad81ffba/users/8b723ed2b79d4049ac0ee542d18b45c3/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:51:56.669568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b26c-3018-4067-81de-f0e8db5f0de2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:56.669858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b26c-3018-4067-81de-f0e8db5f0de2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:56.670138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42b26c-3018-4067-81de-f0e8db5f0de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:56.739634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9e42b26c-3018-4067-81de-f0e8db5f0de2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:51:56.741096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9e42b26c-3018-4067-81de-f0e8db5f0de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:56.747609 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1421/2822] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:51:56.883137 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1402/2823] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:51:56.899521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c4023-51d3-4d2d-8f86-be1675976f6e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:56.901679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b94c4023-51d3-4d2d-8f86-be1675976f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:56.924562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42b26c-3018-4067-81de-f0e8db5f0de2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:51:56.931188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9e42b26c-3018-4067-81de-f0e8db5f0de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:57.073522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c4023-51d3-4d2d-8f86-be1675976f6e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:57.169647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42b26c-3018-4067-81de-f0e8db5f0de2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:51:57.178564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe5ddb-4b21-4116-9074-aed6b4c0d61c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:57.179638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe5ddb-4b21-4116-9074-aed6b4c0d61c service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:57.180204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe5ddb-4b21-4116-9074-aed6b4c0d61c service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:57.180684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe5ddb-4b21-4116-9074-aed6b4c0d61c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:57.183000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cbe5ddb-4b21-4116-9074-aed6b4c0d61c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:51:57.188277 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:57.208669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe5ddb-4b21-4116-9074-aed6b4c0d61c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:57.213788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe5ddb-4b21-4116-9074-aed6b4c0d61c service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:57.267163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79554132-0df5-4e2f-94aa-3385db1c2aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:51:57.267856 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1403/2824] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:51:57.268018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79554132-0df5-4e2f-94aa-3385db1c2aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:51:57.268432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79554132-0df5-4e2f-94aa-3385db1c2aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:51:57.268827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79554132-0df5-4e2f-94aa-3385db1c2aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:51:57.298896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79554132-0df5-4e2f-94aa-3385db1c2aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:51:57.301479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79554132-0df5-4e2f-94aa-3385db1c2aa7 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:51:57.337808 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1422/2825] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:52:02.073289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe5ddb-4b21-4116-9074-aed6b4c0d61c service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:02.094579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe5ddb-4b21-4116-9074-aed6b4c0d61c service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:02.102685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6403ff-edf3-42a4-b9ba-2b92f82c2ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:02.103339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6403ff-edf3-42a4-b9ba-2b92f82c2ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:02.103623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6403ff-edf3-42a4-b9ba-2b92f82c2ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:02.103899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6403ff-edf3-42a4-b9ba-2b92f82c2ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:02.108644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1d6403ff-edf3-42a4-b9ba-2b92f82c2ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:02.170868 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:02.377420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6403ff-edf3-42a4-b9ba-2b92f82c2ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:02.379565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6403ff-edf3-42a4-b9ba-2b92f82c2ee2 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:02.437471 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1404/2826] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:52:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:52:07.317680 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=14 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:12.425631 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=34 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:15.772090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce2cd-199c-4faf-bd4d-99c81c341906 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:15.772721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce2cd-199c-4faf-bd4d-99c81c341906 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:15.772721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce2cd-199c-4faf-bd4d-99c81c341906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:15.853079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c7bce2cd-199c-4faf-bd4d-99c81c341906 None None] MFA Rules not processed for user `8b723ed2b79d4049ac0ee542d18b45c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:15.855888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c7bce2cd-199c-4faf-bd4d-99c81c341906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:16.207261 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1423/2827] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:16.224508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6503-1af8-4732-ba3a-95baaa8a0e87 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:16.225968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6503-1af8-4732-ba3a-95baaa8a0e87 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:16.226717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6503-1af8-4732-ba3a-95baaa8a0e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:16.273683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ba6e6503-1af8-4732-ba3a-95baaa8a0e87 None None] MFA Rules not processed for user `8b723ed2b79d4049ac0ee542d18b45c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:16.277315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ba6e6503-1af8-4732-ba3a-95baaa8a0e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:16.295475 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1405/2828] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:18.241826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bce2cd-199c-4faf-bd4d-99c81c341906 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:18.244347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c7bce2cd-199c-4faf-bd4d-99c81c341906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:18.271787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bce2cd-199c-4faf-bd4d-99c81c341906 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:18.280459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5167657-e3f8-4903-9a21-b1f59a6957b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:18.281631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5167657-e3f8-4903-9a21-b1f59a6957b4 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:18.282208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5167657-e3f8-4903-9a21-b1f59a6957b4 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:18.282800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5167657-e3f8-4903-9a21-b1f59a6957b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:18.302447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5167657-e3f8-4903-9a21-b1f59a6957b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:18.305428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5167657-e3f8-4903-9a21-b1f59a6957b4 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:18.329956 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1424/2829] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:52:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:52:26.262021 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:28.315868 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=38 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:29.051390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99193c4-5a93-4804-a940-060157754a94 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:29.052314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99193c4-5a93-4804-a940-060157754a94 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:29.052899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99193c4-5a93-4804-a940-060157754a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:29.092028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b99193c4-5a93-4804-a940-060157754a94 None None] MFA Rules not processed for user `2f386bc9a48641a4bcd3b09ae45bea70`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:29.093453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b99193c4-5a93-4804-a940-060157754a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:29.169960 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1406/2830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:30.761845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8e77c-f998-4d0b-a7c2-c0350ca7e2eb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:30.762771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8e77c-f998-4d0b-a7c2-c0350ca7e2eb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:30.764061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8e77c-f998-4d0b-a7c2-c0350ca7e2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:30.791858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e9b8e77c-f998-4d0b-a7c2-c0350ca7e2eb None None] MFA Rules not processed for user `02e52a53aba2448096ac85fcfaa598a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:30.793436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e9b8e77c-f998-4d0b-a7c2-c0350ca7e2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:30.881123 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1425/2831] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:33.942950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99193c4-5a93-4804-a940-060157754a94 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:33.981464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99193c4-5a93-4804-a940-060157754a94 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:33.986228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:33.986861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:33.987144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:33.987424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:33.989466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:34.044590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:34.046956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:34.091538 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1407/2832] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:52:40.873956 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=25 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:42.592849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8e77c-f998-4d0b-a7c2-c0350ca7e2eb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:42.619718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8e77c-f998-4d0b-a7c2-c0350ca7e2eb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:42.632837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7893e2b-4866-434f-9633-6c122cf1d1be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:42.633551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7893e2b-4866-434f-9633-6c122cf1d1be service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:42.634006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7893e2b-4866-434f-9633-6c122cf1d1be service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:42.634277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7893e2b-4866-434f-9633-6c122cf1d1be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:42.636177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e7893e2b-4866-434f-9633-6c122cf1d1be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:42.651918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7893e2b-4866-434f-9633-6c122cf1d1be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:42.654036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7893e2b-4866-434f-9633-6c122cf1d1be service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:42.672937 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1426/2833] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:52:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:52:44.084139 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=48 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:48.862115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:48.863921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:48.891110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc0a76-86a1-4e19-b8ae-2f84fbbbc6d2 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:48.898860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:48.899554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:48.899839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:48.900253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] PATH_INFO: `/v3/users/a24b98f6af634c61af828bb20ce1e945` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:48.901946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24b98f6af634c61af828bb20ce1e945)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:48.904097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:49.031756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24b98f6af634c61af828bb20ce1e945'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.063157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24b98f6af634c61af828bb20ce1e945'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.079370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24b98f6af634c61af828bb20ce1e945'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.118872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24b98f6af634c61af828bb20ce1e945'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.119631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24b98f6af634c61af828bb20ce1e945'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.131913 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1408/2834] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:52:48 2022] DELETE /identity/v3/users/a24b98f6af634c61af828bb20ce1e945 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:49.617964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7893e2b-4866-434f-9633-6c122cf1d1be service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:49.631790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7893e2b-4866-434f-9633-6c122cf1d1be service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:49.705898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:49.707382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:49.708580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:49.709055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] PATH_INFO: `/v3/projects/a0676f376817483389300f03ed99cced` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:49.710469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0676f376817483389300f03ed99cced)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:49.713264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:49.809121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0676f376817483389300f03ed99cced', 'request_id': 'req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.820351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0676f376817483389300f03ed99cced', 'request_id': 'req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.829805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0676f376817483389300f03ed99cced', 'request_id': 'req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.847804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] The token cache is being invalidate because project a0676f376817483389300f03ed99cced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:52:49.848402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.849395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:49.852306 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1427/2835] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:52:49 2022] DELETE /identity/v3/projects/a0676f376817483389300f03ed99cced => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:49.856663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:49.858960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:49.877244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe50cb0-6626-4c20-a35f-1099de034edb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:49.987196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:49.988346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:49.988836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:49.989660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] PATH_INFO: `/v3/users/171c3ef9ce28423eb069bb8e67b3a367` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:49.992969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=171c3ef9ce28423eb069bb8e67b3a367)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:49.995584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:50.098918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171c3ef9ce28423eb069bb8e67b3a367'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:50.125282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171c3ef9ce28423eb069bb8e67b3a367'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:50.131095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171c3ef9ce28423eb069bb8e67b3a367'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:50.141512 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:50.174495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171c3ef9ce28423eb069bb8e67b3a367'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:50.176341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37e3cadf-4243-417b-88b2-d09f82594567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171c3ef9ce28423eb069bb8e67b3a367'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:50.198484 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1409/2836] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:52:49 2022] DELETE /identity/v3/users/171c3ef9ce28423eb069bb8e67b3a367 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:52:50.793882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:50.800542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:50.817364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6e10c-bc8a-453d-b5f7-128a7ea1e884 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:50.989106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:50.989988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:50.990560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:50.993280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] PATH_INFO: `/v3/projects/c234e27d4de44dc8be5033b9b5bb9161` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:50.995033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c234e27d4de44dc8be5033b9b5bb9161)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:50.999721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:51.049298 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:51.101448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c234e27d4de44dc8be5033b9b5bb9161', 'request_id': 'req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:51.113018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c234e27d4de44dc8be5033b9b5bb9161', 'request_id': 'req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:51.120215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c234e27d4de44dc8be5033b9b5bb9161', 'request_id': 'req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:51.136924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] The token cache is being invalidate because project c234e27d4de44dc8be5033b9b5bb9161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:52:51.137894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:51.138819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-68797587-7a9f-458f-9efe-d4a9d2a7d7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:51.140900 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1428/2837] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:52:50 2022] DELETE /identity/v3/projects/c234e27d4de44dc8be5033b9b5bb9161 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:51.145857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7fe7-fb06-42fa-ae77-6d49af332e19 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:51.146773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7fe7-fb06-42fa-ae77-6d49af332e19 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:51.147238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7fe7-fb06-42fa-ae77-6d49af332e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:51.254025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-36fb7fe7-fb06-42fa-ae77-6d49af332e19 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:51.255467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-36fb7fe7-fb06-42fa-ae77-6d49af332e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:51.343994 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1410/2838] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:52:51.353277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c094108-eba2-4ba0-841f-aa8109793de1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:51.353502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c094108-eba2-4ba0-841f-aa8109793de1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:51.353746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c094108-eba2-4ba0-841f-aa8109793de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:51.393043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7c094108-eba2-4ba0-841f-aa8109793de1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:51.395056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c094108-eba2-4ba0-841f-aa8109793de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:51.406864 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1429/2839] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:51.411010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7fe7-fb06-42fa-ae77-6d49af332e19 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:51.432154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7fe7-fb06-42fa-ae77-6d49af332e19 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:51.459095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2590071-cff9-47e3-80f8-073b0af49070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:51.460346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2590071-cff9-47e3-80f8-073b0af49070 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:51.465131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2590071-cff9-47e3-80f8-073b0af49070 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:51.468200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2590071-cff9-47e3-80f8-073b0af49070 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:51.472911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2590071-cff9-47e3-80f8-073b0af49070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:52:51.475964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2590071-cff9-47e3-80f8-073b0af49070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:51.482124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2590071-cff9-47e3-80f8-073b0af49070 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:51.501183 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1411/2840] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:52:51.502643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c094108-eba2-4ba0-841f-aa8109793de1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:51.517936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c094108-eba2-4ba0-841f-aa8109793de1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:51.541215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bd2a9-92b5-44f8-a888-0437f9589b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:51.542274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd2a9-92b5-44f8-a888-0437f9589b74 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:51.542561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd2a9-92b5-44f8-a888-0437f9589b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:51.542994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd2a9-92b5-44f8-a888-0437f9589b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:51.545815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bd2a9-92b5-44f8-a888-0437f9589b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:51.551952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bd2a9-92b5-44f8-a888-0437f9589b74 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:51.598131 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1430/2841] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:52:51 2022] POST /identity/v3/projects => generated 401 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:52:51.604005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2590071-cff9-47e3-80f8-073b0af49070 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:51.619606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2590071-cff9-47e3-80f8-073b0af49070 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:51.712985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179a969-47c2-4d6f-b4f2-349d9986d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:51.713966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179a969-47c2-4d6f-b4f2-349d9986d6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:51.714349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179a969-47c2-4d6f-b4f2-349d9986d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:51.715343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179a969-47c2-4d6f-b4f2-349d9986d6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:51.716083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179a969-47c2-4d6f-b4f2-349d9986d6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:51.718208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179a969-47c2-4d6f-b4f2-349d9986d6d6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:51.755493 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1412/2842] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:52:51 2022] POST /identity/v3/users => generated 301 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:52:51.759256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bd2a9-92b5-44f8-a888-0437f9589b74 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:51.779546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bd2a9-92b5-44f8-a888-0437f9589b74 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:51.786658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bb91f-3cca-407b-a270-6959cc202017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:51.787985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bb91f-3cca-407b-a270-6959cc202017 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:51.788270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bb91f-3cca-407b-a270-6959cc202017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:51.788543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bb91f-3cca-407b-a270-6959cc202017 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:51.789230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bb91f-3cca-407b-a270-6959cc202017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:51.791464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bb91f-3cca-407b-a270-6959cc202017 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:51.813631 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1431/2843] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:52:51.814885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179a969-47c2-4d6f-b4f2-349d9986d6d6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:51.828056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179a969-47c2-4d6f-b4f2-349d9986d6d6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:51.839219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47596dd9-ebf8-4a32-9eaf-4de74023fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:51.840011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47596dd9-ebf8-4a32-9eaf-4de74023fbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:51.840403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47596dd9-ebf8-4a32-9eaf-4de74023fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:51.840826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47596dd9-ebf8-4a32-9eaf-4de74023fbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:51.841606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47596dd9-ebf8-4a32-9eaf-4de74023fbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:51.843426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47596dd9-ebf8-4a32-9eaf-4de74023fbe0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:51.892649 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1413/2844] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:52:51.892936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bb91f-3cca-407b-a270-6959cc202017 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:51.894007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bb91f-3cca-407b-a270-6959cc202017 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:51.900814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270f8e-6b92-49bd-9751-8e65db928747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:51.902036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270f8e-6b92-49bd-9751-8e65db928747 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:51.903004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270f8e-6b92-49bd-9751-8e65db928747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:51.903453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270f8e-6b92-49bd-9751-8e65db928747 admin admin] PATH_INFO: `/v3/projects/b77e5631b0954981b2b18b1372df6608/users/2afe56c7bd2d43e79ece511774f6f876/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:51.924931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82270f8e-6b92-49bd-9751-8e65db928747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77e5631b0954981b2b18b1372df6608, user_id=2afe56c7bd2d43e79ece511774f6f876, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:51.928126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82270f8e-6b92-49bd-9751-8e65db928747 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:51.946176 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1432/2845] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:52:51 2022] PUT /identity/v3/projects/b77e5631b0954981b2b18b1372df6608/users/2afe56c7bd2d43e79ece511774f6f876/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:51.960769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3341cf-3a4a-47c6-9d00-77a39936ad01 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:51.961012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3341cf-3a4a-47c6-9d00-77a39936ad01 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:51.961138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3341cf-3a4a-47c6-9d00-77a39936ad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:52.011205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7a3341cf-3a4a-47c6-9d00-77a39936ad01 None None] MFA Rules not processed for user `2afe56c7bd2d43e79ece511774f6f876`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:52.012504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7a3341cf-3a4a-47c6-9d00-77a39936ad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:52.047016 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:52.121072 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1414/2846] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:51 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:52.122295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270f8e-6b92-49bd-9751-8e65db928747 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:52.227470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270f8e-6b92-49bd-9751-8e65db928747 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:52.235510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304752b-8655-4efa-a757-b335bb6c71da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:52.236312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304752b-8655-4efa-a757-b335bb6c71da admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:52.236605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304752b-8655-4efa-a757-b335bb6c71da admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:52.236932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304752b-8655-4efa-a757-b335bb6c71da admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:52.238909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304752b-8655-4efa-a757-b335bb6c71da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:52.241717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304752b-8655-4efa-a757-b335bb6c71da admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:52.294922 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1433/2847] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:52:52 2022] POST /identity/v3/projects => generated 401 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:52:52.295038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3341cf-3a4a-47c6-9d00-77a39936ad01 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:52.307301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3341cf-3a4a-47c6-9d00-77a39936ad01 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:52.386857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b84a-7f2e-49a4-b375-68462b63646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:52.387578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b84a-7f2e-49a4-b375-68462b63646f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:52.387930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b84a-7f2e-49a4-b375-68462b63646f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:52.388275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b84a-7f2e-49a4-b375-68462b63646f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:52.389078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356b84a-7f2e-49a4-b375-68462b63646f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:52.392408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356b84a-7f2e-49a4-b375-68462b63646f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:52.438052 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1415/2848] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:52:52 2022] POST /identity/v3/users => generated 307 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:52:52.438265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304752b-8655-4efa-a757-b335bb6c71da admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:52.455081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304752b-8655-4efa-a757-b335bb6c71da admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:52.461990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8de20-3732-4b4c-a374-299570d8bbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:52.463218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8de20-3732-4b4c-a374-299570d8bbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:52.464161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8de20-3732-4b4c-a374-299570d8bbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:52.465405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8de20-3732-4b4c-a374-299570d8bbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:52.466286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8de20-3732-4b4c-a374-299570d8bbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:52.468422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8de20-3732-4b4c-a374-299570d8bbf5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:52.486234 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1434/2849] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:52:52.491428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b84a-7f2e-49a4-b375-68462b63646f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:52.506124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b84a-7f2e-49a4-b375-68462b63646f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:52.528348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7206570-57b2-43ca-9863-06c5d84577bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:52.529461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7206570-57b2-43ca-9863-06c5d84577bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:52.530028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7206570-57b2-43ca-9863-06c5d84577bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:52.530539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7206570-57b2-43ca-9863-06c5d84577bb admin admin] PATH_INFO: `/v3/projects/66fc5d7296674627a26a14e49ca98ec0/users/4f8ac94b437047d0b025e77a28ab889b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:52.582125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7206570-57b2-43ca-9863-06c5d84577bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fc5d7296674627a26a14e49ca98ec0, user_id=4f8ac94b437047d0b025e77a28ab889b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:52.585525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7206570-57b2-43ca-9863-06c5d84577bb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:52.618591 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1416/2850] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:52:52 2022] PUT /identity/v3/projects/66fc5d7296674627a26a14e49ca98ec0/users/4f8ac94b437047d0b025e77a28ab889b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:52.620144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8de20-3732-4b4c-a374-299570d8bbf5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:52.641486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8de20-3732-4b4c-a374-299570d8bbf5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:52.666991 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:52.805042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ffe3c-fecd-4821-9251-a745d16c5993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:52.805667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ffe3c-fecd-4821-9251-a745d16c5993 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:52.805944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ffe3c-fecd-4821-9251-a745d16c5993 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:52.806212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ffe3c-fecd-4821-9251-a745d16c5993 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:52.806861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ffe3c-fecd-4821-9251-a745d16c5993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:52.813288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ffe3c-fecd-4821-9251-a745d16c5993 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:52.843014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7206570-57b2-43ca-9863-06c5d84577bb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:52.844516 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1435/2851] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:52:52.870146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7206570-57b2-43ca-9863-06c5d84577bb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:52.884100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d89819-a8bc-4367-ab84-786d9c1a3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:52.885131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89819-a8bc-4367-ab84-786d9c1a3710 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:52.885131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89819-a8bc-4367-ab84-786d9c1a3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:52.885397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89819-a8bc-4367-ab84-786d9c1a3710 admin admin] PATH_INFO: `/v3/projects/66fc5d7296674627a26a14e49ca98ec0/users/4f8ac94b437047d0b025e77a28ab889b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:52.889713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d89819-a8bc-4367-ab84-786d9c1a3710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fc5d7296674627a26a14e49ca98ec0, user_id=4f8ac94b437047d0b025e77a28ab889b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:52.892449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d89819-a8bc-4367-ab84-786d9c1a3710 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:52.920423 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1417/2852] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:52:52 2022] PUT /identity/v3/projects/66fc5d7296674627a26a14e49ca98ec0/users/4f8ac94b437047d0b025e77a28ab889b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:52:52.922788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5477-aa3c-4ad4-a4ce-0aa69a696d90 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:52.923407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5477-aa3c-4ad4-a4ce-0aa69a696d90 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:52.923876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5477-aa3c-4ad4-a4ce-0aa69a696d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:52.977642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8d9b5477-aa3c-4ad4-a4ce-0aa69a696d90 None None] MFA Rules not processed for user `4f8ac94b437047d0b025e77a28ab889b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:52.981946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8d9b5477-aa3c-4ad4-a4ce-0aa69a696d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:53.124706 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1436/2853] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:52 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:53.242580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d89819-a8bc-4367-ab84-786d9c1a3710 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:53.255702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-56d89819-a8bc-4367-ab84-786d9c1a3710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:53.383653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d89819-a8bc-4367-ab84-786d9c1a3710 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:53.395086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba43f6-9c7d-4e4b-ac12-fbcad2a8a5ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:53.395670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba43f6-9c7d-4e4b-ac12-fbcad2a8a5ef service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:53.395974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba43f6-9c7d-4e4b-ac12-fbcad2a8a5ef service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:53.396995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba43f6-9c7d-4e4b-ac12-fbcad2a8a5ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:53.409091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba43f6-9c7d-4e4b-ac12-fbcad2a8a5ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:53.412118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba43f6-9c7d-4e4b-ac12-fbcad2a8a5ef service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:53.433014 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1418/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:52:53 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:52:54.082184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5477-aa3c-4ad4-a4ce-0aa69a696d90 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:54.083824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8d9b5477-aa3c-4ad4-a4ce-0aa69a696d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:54.106057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5477-aa3c-4ad4-a4ce-0aa69a696d90 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:54.113840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7789fa-04c9-4e3c-9cf3-89e209b78526 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:54.114726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7789fa-04c9-4e3c-9cf3-89e209b78526 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:54.115326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7789fa-04c9-4e3c-9cf3-89e209b78526 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:54.115922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7789fa-04c9-4e3c-9cf3-89e209b78526 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:54.191416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7789fa-04c9-4e3c-9cf3-89e209b78526 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:54.193317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7789fa-04c9-4e3c-9cf3-89e209b78526 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:54.203615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1437/2855] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:52:54 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:52:54.232075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba43f6-9c7d-4e4b-ac12-fbcad2a8a5ef service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:54.240187 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:54.322962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba43f6-9c7d-4e4b-ac12-fbcad2a8a5ef service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:54.328674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:54.329399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:54.329926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:54.330206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] PATH_INFO: `/v3/users/2afe56c7bd2d43e79ece511774f6f876` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:54.331565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afe56c7bd2d43e79ece511774f6f876)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:54.334152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:54.429973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afe56c7bd2d43e79ece511774f6f876'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:54.497735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afe56c7bd2d43e79ece511774f6f876'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:54.517727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afe56c7bd2d43e79ece511774f6f876'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:54.535840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afe56c7bd2d43e79ece511774f6f876'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:54.537024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afe56c7bd2d43e79ece511774f6f876'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:54.554559 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1419/2856] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:52:54 2022] DELETE /identity/v3/users/2afe56c7bd2d43e79ece511774f6f876 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:54.559452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27281cf-56b9-4068-b8c8-1b6f114c9ad5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:54.559726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27281cf-56b9-4068-b8c8-1b6f114c9ad5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:54.560191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27281cf-56b9-4068-b8c8-1b6f114c9ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:54.601729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b27281cf-56b9-4068-b8c8-1b6f114c9ad5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:54.603466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b27281cf-56b9-4068-b8c8-1b6f114c9ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:54.678426 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:54.718035 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1438/2857] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:54.733788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:54.736483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:54.890807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da0fcd-049c-4cfa-9d1e-24058a648788 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:54.895653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7010846-eae8-4d2c-8f60-274ffbfda154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:54.896280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7010846-eae8-4d2c-8f60-274ffbfda154 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:54.896606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7010846-eae8-4d2c-8f60-274ffbfda154 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:54.896908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7010846-eae8-4d2c-8f60-274ffbfda154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:54.915529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7010846-eae8-4d2c-8f60-274ffbfda154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:54.917100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7010846-eae8-4d2c-8f60-274ffbfda154 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:54.930308 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1420/2858] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:52:55.146869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27281cf-56b9-4068-b8c8-1b6f114c9ad5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:55.148531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b27281cf-56b9-4068-b8c8-1b6f114c9ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:55.205067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27281cf-56b9-4068-b8c8-1b6f114c9ad5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:55.216263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:55.217274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:55.217731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:55.218177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] PATH_INFO: `/v3/users/8b723ed2b79d4049ac0ee542d18b45c3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:55.219907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b723ed2b79d4049ac0ee542d18b45c3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:55.223266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:55.289849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b723ed2b79d4049ac0ee542d18b45c3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:55.308363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b723ed2b79d4049ac0ee542d18b45c3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:55.319277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b723ed2b79d4049ac0ee542d18b45c3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:55.335232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b723ed2b79d4049ac0ee542d18b45c3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:55.336125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b723ed2b79d4049ac0ee542d18b45c3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:55.347330 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1439/2859] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:52:55 2022] DELETE /identity/v3/users/8b723ed2b79d4049ac0ee542d18b45c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:55.606315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7010846-eae8-4d2c-8f60-274ffbfda154 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:55.607940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e7010846-eae8-4d2c-8f60-274ffbfda154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:55.655921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7010846-eae8-4d2c-8f60-274ffbfda154 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:55.709066 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:55.842180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:55.842459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:55.842641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:55.842869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] PATH_INFO: `/v3/projects/b77e5631b0954981b2b18b1372df6608` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:55.845171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77e5631b0954981b2b18b1372df6608)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:55.847172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:55.908090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:55.910292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:55.939140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4c185-b562-41ee-9db5-d387f105e465 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:55.961116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:55.967409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:55.967662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:55.967910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] PATH_INFO: `/v3/projects/1a1c816191c44b799ffe501cad81ffba` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:55.975821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1c816191c44b799ffe501cad81ffba)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:55.977796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:56.011252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77e5631b0954981b2b18b1372df6608', 'request_id': 'req-7d5cccbb-8b57-405e-a976-fc750c095b5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.029931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77e5631b0954981b2b18b1372df6608', 'request_id': 'req-7d5cccbb-8b57-405e-a976-fc750c095b5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.070227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77e5631b0954981b2b18b1372df6608', 'request_id': 'req-7d5cccbb-8b57-405e-a976-fc750c095b5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.096753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] The token cache is being invalidate because project b77e5631b0954981b2b18b1372df6608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:52:56.097175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.097970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.100655 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1421/2860] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:52:55 2022] DELETE /identity/v3/projects/b77e5631b0954981b2b18b1372df6608 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:56.104446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:56.106521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:56.147599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1c816191c44b799ffe501cad81ffba', 'request_id': 'req-1f553f39-ac20-4600-ae06-8ac357b71cb5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.166695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1c816191c44b799ffe501cad81ffba', 'request_id': 'req-1f553f39-ac20-4600-ae06-8ac357b71cb5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.181603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1c816191c44b799ffe501cad81ffba', 'request_id': 'req-1f553f39-ac20-4600-ae06-8ac357b71cb5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.203174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] The token cache is being invalidate because project 1a1c816191c44b799ffe501cad81ffba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:52:56.205248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.210410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1f553f39-ac20-4600-ae06-8ac357b71cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.212575 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1440/2861] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:52:55 2022] DELETE /identity/v3/projects/1a1c816191c44b799ffe501cad81ffba => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:56.217163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7cbf5-af09-4178-8e1e-1be56e4963f7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:56.217713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7cbf5-af09-4178-8e1e-1be56e4963f7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:56.218155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7cbf5-af09-4178-8e1e-1be56e4963f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:56.259048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cccbb-8b57-405e-a976-fc750c095b5f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:56.261185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-80c7cbf5-af09-4178-8e1e-1be56e4963f7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:56.264874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-80c7cbf5-af09-4178-8e1e-1be56e4963f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:56.337202 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:56.361264 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:56.385295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:56.386997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:56.387279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:56.387549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] PATH_INFO: `/v3/users/4f8ac94b437047d0b025e77a28ab889b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:56.389997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8ac94b437047d0b025e77a28ab889b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:56.395969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:56.415503 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1441/2862] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:56.418774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd1f9e-ec66-4911-8196-26cb9256e0e1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:56.419585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd1f9e-ec66-4911-8196-26cb9256e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:56.419751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd1f9e-ec66-4911-8196-26cb9256e0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:56.482364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aadd1f9e-ec66-4911-8196-26cb9256e0e1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:56.483762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aadd1f9e-ec66-4911-8196-26cb9256e0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:56.507916 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1442/2863] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:56.511058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd1f9e-ec66-4911-8196-26cb9256e0e1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:56.538236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd1f9e-ec66-4911-8196-26cb9256e0e1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:56.546565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a5740-5e79-41bd-a472-07d79c37176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:56.547349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a5740-5e79-41bd-a472-07d79c37176b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:56.547700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a5740-5e79-41bd-a472-07d79c37176b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:56.548119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a5740-5e79-41bd-a472-07d79c37176b admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:56.549149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a5740-5e79-41bd-a472-07d79c37176b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:52:56.549528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a5740-5e79-41bd-a472-07d79c37176b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:56.555444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a5740-5e79-41bd-a472-07d79c37176b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:56.592206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8ac94b437047d0b025e77a28ab889b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.628476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8ac94b437047d0b025e77a28ab889b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.646489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1443/2864] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:52:56.647007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8ac94b437047d0b025e77a28ab889b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.648897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a5740-5e79-41bd-a472-07d79c37176b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:56.656768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8ac94b437047d0b025e77a28ab889b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.657835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8ac94b437047d0b025e77a28ab889b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:56.678979 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1422/2865] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:52:56 2022] DELETE /identity/v3/users/4f8ac94b437047d0b025e77a28ab889b => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:56.717154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a5740-5e79-41bd-a472-07d79c37176b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:56.954157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060046e4-7b29-4a91-8064-2051f5f7b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:56.955247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060046e4-7b29-4a91-8064-2051f5f7b284 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:56.955701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060046e4-7b29-4a91-8064-2051f5f7b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:56.956897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060046e4-7b29-4a91-8064-2051f5f7b284 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:56.957873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060046e4-7b29-4a91-8064-2051f5f7b284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:56.960289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060046e4-7b29-4a91-8064-2051f5f7b284 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:57.034659 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1444/2866] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:52:56 2022] POST /identity/v3/projects => generated 371 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:52:57.039366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:57.041279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:57.079600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260a8dc-6a4b-4ccf-bc33-808f09f12af9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:57.163484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118bfda-d091-4c03-94f7-7c6819792d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:57.164130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118bfda-d091-4c03-94f7-7c6819792d81 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:57.165151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118bfda-d091-4c03-94f7-7c6819792d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:57.165504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118bfda-d091-4c03-94f7-7c6819792d81 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:57.166555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118bfda-d091-4c03-94f7-7c6819792d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:57.168333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118bfda-d091-4c03-94f7-7c6819792d81 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:57.197722 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1423/2867] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:52:57 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:52:57.201234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060046e4-7b29-4a91-8064-2051f5f7b284 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:57.220657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060046e4-7b29-4a91-8064-2051f5f7b284 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:57.237039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114ebb-ba00-4b88-87d6-7dc2b4821cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:57.237995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114ebb-ba00-4b88-87d6-7dc2b4821cdf admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:57.238354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114ebb-ba00-4b88-87d6-7dc2b4821cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:57.238643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76114ebb-ba00-4b88-87d6-7dc2b4821cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:57.239439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76114ebb-ba00-4b88-87d6-7dc2b4821cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:57.241275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76114ebb-ba00-4b88-87d6-7dc2b4821cdf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:57.281329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1445/2868] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:52:57.282134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118bfda-d091-4c03-94f7-7c6819792d81 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:57.300844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118bfda-d091-4c03-94f7-7c6819792d81 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:57.334044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6c89a-9627-4c5e-bc0f-4cdbbc7297d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:57.334681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c89a-9627-4c5e-bc0f-4cdbbc7297d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:57.334966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c89a-9627-4c5e-bc0f-4cdbbc7297d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:57.335244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c89a-9627-4c5e-bc0f-4cdbbc7297d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:57.336235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6c89a-9627-4c5e-bc0f-4cdbbc7297d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:57.337557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6c89a-9627-4c5e-bc0f-4cdbbc7297d6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:57.357649 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1424/2869] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:52:57.362522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114ebb-ba00-4b88-87d6-7dc2b4821cdf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:57.385938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76114ebb-ba00-4b88-87d6-7dc2b4821cdf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:57.395413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7a256-53aa-403c-8ef7-c31527422156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:57.396117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a256-53aa-403c-8ef7-c31527422156 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:57.396398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a256-53aa-403c-8ef7-c31527422156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:57.396716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a256-53aa-403c-8ef7-c31527422156 admin admin] PATH_INFO: `/v3/projects/248e481eb8de408fbb0e819a5a1f136e/users/60cdb88d047841efb92e55cd533edab9/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:57.427990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7a256-53aa-403c-8ef7-c31527422156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248e481eb8de408fbb0e819a5a1f136e, user_id=60cdb88d047841efb92e55cd533edab9, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:57.430967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7a256-53aa-403c-8ef7-c31527422156 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:57.461261 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1446/2870] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:52:57 2022] PUT /identity/v3/projects/248e481eb8de408fbb0e819a5a1f136e/users/60cdb88d047841efb92e55cd533edab9/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:57.463068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26475a37-c215-48dc-84d6-80d2b9b8387d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:57.463447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26475a37-c215-48dc-84d6-80d2b9b8387d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:57.463705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26475a37-c215-48dc-84d6-80d2b9b8387d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:57.514529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-26475a37-c215-48dc-84d6-80d2b9b8387d None None] MFA Rules not processed for user `60cdb88d047841efb92e55cd533edab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:57.516185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-26475a37-c215-48dc-84d6-80d2b9b8387d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:57.591253 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:57.681891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee5863-87ce-4823-b188-d6e35d7dc16e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:57.682525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee5863-87ce-4823-b188-d6e35d7dc16e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:57.682990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee5863-87ce-4823-b188-d6e35d7dc16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:57.684068 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1425/2871] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:57.717837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f4ee5863-87ce-4823-b188-d6e35d7dc16e None None] MFA Rules not processed for user `60cdb88d047841efb92e55cd533edab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:57.719994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f4ee5863-87ce-4823-b188-d6e35d7dc16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:57.755310 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1447/2872] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:57.776194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26475a37-c215-48dc-84d6-80d2b9b8387d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:57.778279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-26475a37-c215-48dc-84d6-80d2b9b8387d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:57.894275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9e960-4c65-48b2-a4c8-9a6e64576632 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:57.894275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9e960-4c65-48b2-a4c8-9a6e64576632 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:57.894566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9e960-4c65-48b2-a4c8-9a6e64576632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:57.969398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a7d9e960-4c65-48b2-a4c8-9a6e64576632 None None] MFA Rules not processed for user `02e52a53aba2448096ac85fcfaa598a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:57.977133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7d9e960-4c65-48b2-a4c8-9a6e64576632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:57.998066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26475a37-c215-48dc-84d6-80d2b9b8387d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:58.009470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:58.010471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:58.011039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:58.011529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] PATH_INFO: `/v3/projects/66fc5d7296674627a26a14e49ca98ec0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:58.013389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66fc5d7296674627a26a14e49ca98ec0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:58.018425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:58.083525 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1448/2873] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:58.084539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9e960-4c65-48b2-a4c8-9a6e64576632 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:58.088860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7d9e960-4c65-48b2-a4c8-9a6e64576632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:58.100822 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:58.162770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66fc5d7296674627a26a14e49ca98ec0', 'request_id': 'req-5fe19b03-ebaa-41a8-9639-1003bca9c906'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:58.175365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66fc5d7296674627a26a14e49ca98ec0', 'request_id': 'req-5fe19b03-ebaa-41a8-9639-1003bca9c906'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:58.188171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66fc5d7296674627a26a14e49ca98ec0', 'request_id': 'req-5fe19b03-ebaa-41a8-9639-1003bca9c906'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:58.206142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] The token cache is being invalidate because project 66fc5d7296674627a26a14e49ca98ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:52:58.206502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:58.207428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5fe19b03-ebaa-41a8-9639-1003bca9c906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:58.209811 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1426/2874] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:52:57 2022] DELETE /identity/v3/projects/66fc5d7296674627a26a14e49ca98ec0 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:58.215152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6047c-8c38-414a-b98a-d7369845551c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:58.215519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6047c-8c38-414a-b98a-d7369845551c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:58.224022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6047c-8c38-414a-b98a-d7369845551c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:58.269634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c8a6047c-8c38-414a-b98a-d7369845551c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:58.270885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c8a6047c-8c38-414a-b98a-d7369845551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:58.308399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9e960-4c65-48b2-a4c8-9a6e64576632 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:58.432583 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1427/2875] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:58.434810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21053a0c-04aa-4490-9ac2-c3e44b717d82 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:58.435138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21053a0c-04aa-4490-9ac2-c3e44b717d82 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:58.435510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21053a0c-04aa-4490-9ac2-c3e44b717d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:58.482066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-21053a0c-04aa-4490-9ac2-c3e44b717d82 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:58.484066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-21053a0c-04aa-4490-9ac2-c3e44b717d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:58.490655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecbf0e-1923-46dd-a460-4618eba3168e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:58.491299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecbf0e-1923-46dd-a460-4618eba3168e service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:58.491627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecbf0e-1923-46dd-a460-4618eba3168e service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:58.491907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecbf0e-1923-46dd-a460-4618eba3168e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:58.494459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b7ecbf0e-1923-46dd-a460-4618eba3168e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:58.509136 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1428/2876] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:52:58.513793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21053a0c-04aa-4490-9ac2-c3e44b717d82 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:58.523624 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:58.538862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21053a0c-04aa-4490-9ac2-c3e44b717d82 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:58.549491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601d0f2-5b13-4ab8-b7e1-9d14a5892805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:58.550178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601d0f2-5b13-4ab8-b7e1-9d14a5892805 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:58.550460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601d0f2-5b13-4ab8-b7e1-9d14a5892805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:58.550735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601d0f2-5b13-4ab8-b7e1-9d14a5892805 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:58.551835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601d0f2-5b13-4ab8-b7e1-9d14a5892805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:52:58.552159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601d0f2-5b13-4ab8-b7e1-9d14a5892805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:58.555568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601d0f2-5b13-4ab8-b7e1-9d14a5892805 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:58.596218 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1429/2877] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:52:58.602508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601d0f2-5b13-4ab8-b7e1-9d14a5892805 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:58.614731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecbf0e-1923-46dd-a460-4618eba3168e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:58.619131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecbf0e-1923-46dd-a460-4618eba3168e service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:58.619845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601d0f2-5b13-4ab8-b7e1-9d14a5892805 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:58.636791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4530-757a-48d2-8a62-669869803200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:58.637413 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1449/2878] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:52:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:52:58.641691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4530-757a-48d2-8a62-669869803200 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:58.642049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4530-757a-48d2-8a62-669869803200 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:58.642279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4530-757a-48d2-8a62-669869803200 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:58.642950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4530-757a-48d2-8a62-669869803200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:58.645472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4530-757a-48d2-8a62-669869803200 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:58.733685 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1430/2879] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:52:58 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:52:58.739327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecbf0e-1923-46dd-a460-4618eba3168e service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:58.757276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecbf0e-1923-46dd-a460-4618eba3168e service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:58.856924 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:58.913791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e19f9-088c-41fa-b0f0-bf4982b0539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:58.914706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e19f9-088c-41fa-b0f0-bf4982b0539d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:58.915087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e19f9-088c-41fa-b0f0-bf4982b0539d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:58.915460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e19f9-088c-41fa-b0f0-bf4982b0539d admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:58.916203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e19f9-088c-41fa-b0f0-bf4982b0539d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:58.918525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e19f9-088c-41fa-b0f0-bf4982b0539d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:58.958858 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1450/2880] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:52:58 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:52:58.964091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4530-757a-48d2-8a62-669869803200 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:58.979800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4530-757a-48d2-8a62-669869803200 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:59.000519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59855c4-8549-4c25-bff0-ecdcd064bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:59.000519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59855c4-8549-4c25-bff0-ecdcd064bfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:59.000519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59855c4-8549-4c25-bff0-ecdcd064bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:59.000519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59855c4-8549-4c25-bff0-ecdcd064bfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:59.001178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59855c4-8549-4c25-bff0-ecdcd064bfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:59.001178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59855c4-8549-4c25-bff0-ecdcd064bfc9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:59.026804 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1431/2881] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:52:59.031669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e19f9-088c-41fa-b0f0-bf4982b0539d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:59.046003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e19f9-088c-41fa-b0f0-bf4982b0539d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:59.069616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2ed38-c01a-489d-9e39-f583d32f9181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:59.071591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2ed38-c01a-489d-9e39-f583d32f9181 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:59.075204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2ed38-c01a-489d-9e39-f583d32f9181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:59.075689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2ed38-c01a-489d-9e39-f583d32f9181 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:59.076768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2ed38-c01a-489d-9e39-f583d32f9181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:59.083684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2ed38-c01a-489d-9e39-f583d32f9181 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:59.111495 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1451/2882] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:52:59.119132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59855c4-8549-4c25-bff0-ecdcd064bfc9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:59.126635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2ed38-c01a-489d-9e39-f583d32f9181 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:59.129994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0ea2ed38-c01a-489d-9e39-f583d32f9181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:59.140195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59855c4-8549-4c25-bff0-ecdcd064bfc9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:59.154253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebf1dc-6ad2-42c1-8c5f-7591179ee0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:59.155512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebf1dc-6ad2-42c1-8c5f-7591179ee0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:59.156373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebf1dc-6ad2-42c1-8c5f-7591179ee0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:59.156985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebf1dc-6ad2-42c1-8c5f-7591179ee0ae admin admin] PATH_INFO: `/v3/projects/5a7bc6ded408446ea09e56df3117e8ed/users/89ad3153612d421f8e8f28705e44f334/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:59.161429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2ed38-c01a-489d-9e39-f583d32f9181 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:52:59.176833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebf1dc-6ad2-42c1-8c5f-7591179ee0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7bc6ded408446ea09e56df3117e8ed, user_id=89ad3153612d421f8e8f28705e44f334, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:59.178405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:52:59.179079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:59.179366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:59.179644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] PATH_INFO: `/v3/users/e1f203c2e330487e9a1bdfff7e60af3b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:59.180940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f203c2e330487e9a1bdfff7e60af3b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:52:59.181608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebf1dc-6ad2-42c1-8c5f-7591179ee0ae admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:59.182873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:52:59.209033 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1432/2883] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:52:59 2022] PUT /identity/v3/projects/5a7bc6ded408446ea09e56df3117e8ed/users/89ad3153612d421f8e8f28705e44f334/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:52:59.287745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c784-45a1-4ba6-b7b4-957547196b2b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:52:59.287970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c784-45a1-4ba6-b7b4-957547196b2b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:52:59.288233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c784-45a1-4ba6-b7b4-957547196b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:52:59.288807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f203c2e330487e9a1bdfff7e60af3b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:59.316918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f203c2e330487e9a1bdfff7e60af3b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:59.328779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f203c2e330487e9a1bdfff7e60af3b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:59.343986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f203c2e330487e9a1bdfff7e60af3b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:59.344933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f203c2e330487e9a1bdfff7e60af3b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:52:59.345719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f738c784-45a1-4ba6-b7b4-957547196b2b None None] MFA Rules not processed for user `89ad3153612d421f8e8f28705e44f334`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:52:59.347212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f738c784-45a1-4ba6-b7b4-957547196b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:59.357186 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1452/2884] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:52:59 2022] DELETE /identity/v3/users/e1f203c2e330487e9a1bdfff7e60af3b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:52:59.497645 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1433/2885] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:52:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:52:59.954040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:59.955096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:52:59.974335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738c784-45a1-4ba6-b7b4-957547196b2b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:52:59.975991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f738c784-45a1-4ba6-b7b4-957547196b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:00.080475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5b247-acf7-4b67-9cd9-bce8e138cfb4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:00.092752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:00.093402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.093685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.093957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] PATH_INFO: `/v3/projects/3b47200f231b4ac0a9e658295916e32b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.096009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b47200f231b4ac0a9e658295916e32b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:00.097682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:00.102879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738c784-45a1-4ba6-b7b4-957547196b2b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:00.121814 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:00.150045 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:00.165585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b47200f231b4ac0a9e658295916e32b', 'request_id': 'req-41e4d075-9173-41d5-bd3c-6affcee2ce8d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.174622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b47200f231b4ac0a9e658295916e32b', 'request_id': 'req-41e4d075-9173-41d5-bd3c-6affcee2ce8d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.182095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b47200f231b4ac0a9e658295916e32b', 'request_id': 'req-41e4d075-9173-41d5-bd3c-6affcee2ce8d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.182777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e036d-5a27-4920-baa2-3a11a2f74d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:00.183442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e036d-5a27-4920-baa2-3a11a2f74d49 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.183705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e036d-5a27-4920-baa2-3a11a2f74d49 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.184115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e036d-5a27-4920-baa2-3a11a2f74d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.195565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] The token cache is being invalidate because project 3b47200f231b4ac0a9e658295916e32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:53:00.195935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.196700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41e4d075-9173-41d5-bd3c-6affcee2ce8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.198902 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1453/2886] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:52:59 2022] DELETE /identity/v3/projects/3b47200f231b4ac0a9e658295916e32b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:00.203611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954719b5-bd26-4f66-ac39-5ec519fd2b0d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.203902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954719b5-bd26-4f66-ac39-5ec519fd2b0d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.204184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954719b5-bd26-4f66-ac39-5ec519fd2b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.227616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-954719b5-bd26-4f66-ac39-5ec519fd2b0d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:00.229883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-954719b5-bd26-4f66-ac39-5ec519fd2b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:00.258511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e036d-5a27-4920-baa2-3a11a2f74d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:00.260133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e036d-5a27-4920-baa2-3a11a2f74d49 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:00.270707 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1434/2887] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:52:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:00.304006 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1454/2888] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:53:00.320302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54a123-8cee-4b22-8b5e-9bd6094ed4be None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.320302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54a123-8cee-4b22-8b5e-9bd6094ed4be None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.320302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54a123-8cee-4b22-8b5e-9bd6094ed4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.334613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1e54a123-8cee-4b22-8b5e-9bd6094ed4be None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:00.335842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e54a123-8cee-4b22-8b5e-9bd6094ed4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:00.344773 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1435/2889] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:00.349482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954719b5-bd26-4f66-ac39-5ec519fd2b0d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:00.368408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954719b5-bd26-4f66-ac39-5ec519fd2b0d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:00.373296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c22c47-b7d4-4216-8a83-a8f126c72472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:00.373936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c22c47-b7d4-4216-8a83-a8f126c72472 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.374214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c22c47-b7d4-4216-8a83-a8f126c72472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.374493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c22c47-b7d4-4216-8a83-a8f126c72472 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.375173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c22c47-b7d4-4216-8a83-a8f126c72472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:53:00.375479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c22c47-b7d4-4216-8a83-a8f126c72472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:00.377136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c22c47-b7d4-4216-8a83-a8f126c72472 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:00.394511 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1455/2890] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:53:00.395810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54a123-8cee-4b22-8b5e-9bd6094ed4be None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:00.408681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54a123-8cee-4b22-8b5e-9bd6094ed4be None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:00.412723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d761-db0a-4567-84e4-96dd94c219f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:00.413495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d761-db0a-4567-84e4-96dd94c219f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.413779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d761-db0a-4567-84e4-96dd94c219f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.414052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d761-db0a-4567-84e4-96dd94c219f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.414841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d761-db0a-4567-84e4-96dd94c219f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:00.416757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d761-db0a-4567-84e4-96dd94c219f1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:00.465954 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1436/2891] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:53:00 2022] POST /identity/v3/projects => generated 397 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:53:00.470239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c22c47-b7d4-4216-8a83-a8f126c72472 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:00.492895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c22c47-b7d4-4216-8a83-a8f126c72472 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:00.535424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d761-db0a-4567-84e4-96dd94c219f1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:00.535424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9759d761-db0a-4567-84e4-96dd94c219f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:00.569853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e37e9-6adf-4a31-bf32-b684c700bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:00.570622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e37e9-6adf-4a31-bf32-b684c700bcbc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.570846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e37e9-6adf-4a31-bf32-b684c700bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.571120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e37e9-6adf-4a31-bf32-b684c700bcbc admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.571749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e37e9-6adf-4a31-bf32-b684c700bcbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:00.575522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e37e9-6adf-4a31-bf32-b684c700bcbc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:00.600943 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1456/2892] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:53:00 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:53:00.602577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4450a-3cc9-4d70-b410-364808cedca7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.602872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4450a-3cc9-4d70-b410-364808cedca7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.603158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4450a-3cc9-4d70-b410-364808cedca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.625624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-33b4450a-3cc9-4d70-b410-364808cedca7 None None] MFA Rules not processed for user `5d0158da7efc485ebd6a1e1db617b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:00.625926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d761-db0a-4567-84e4-96dd94c219f1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:00.626857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-33b4450a-3cc9-4d70-b410-364808cedca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:00.631113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:00.631831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.632205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.632542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] PATH_INFO: `/v3/users/89ad3153612d421f8e8f28705e44f334` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.636086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ad3153612d421f8e8f28705e44f334)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:00.636694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:00.659660 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:00.683083 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:00.710693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ad3153612d421f8e8f28705e44f334'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.713856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1457/2893] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:00.715155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4450a-3cc9-4d70-b410-364808cedca7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:00.740414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ad3153612d421f8e8f28705e44f334'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.743829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4450a-3cc9-4d70-b410-364808cedca7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:00.754023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da2abf-8d76-40de-935e-d31de5899cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:00.754843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da2abf-8d76-40de-935e-d31de5899cfe admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.755288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da2abf-8d76-40de-935e-d31de5899cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.757195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ad3153612d421f8e8f28705e44f334'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.759525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da2abf-8d76-40de-935e-d31de5899cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.761134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da2abf-8d76-40de-935e-d31de5899cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:00.763825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da2abf-8d76-40de-935e-d31de5899cfe admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:00.774209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ad3153612d421f8e8f28705e44f334'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.782587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17007b88-53d8-4082-9860-7abb9aad11a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ad3153612d421f8e8f28705e44f334'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:00.785856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1458/2894] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:53:00.796112 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1437/2895] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:53:00 2022] DELETE /identity/v3/users/89ad3153612d421f8e8f28705e44f334 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:00.800871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b1ac2-1a7b-4dc3-9fcd-19c1c29018ba None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:00.801163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b1ac2-1a7b-4dc3-9fcd-19c1c29018ba None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:00.801442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b1ac2-1a7b-4dc3-9fcd-19c1c29018ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:00.804680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da2abf-8d76-40de-935e-d31de5899cfe admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:00.806758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-53da2abf-8d76-40de-935e-d31de5899cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:00.829208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-426b1ac2-1a7b-4dc3-9fcd-19c1c29018ba None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:00.832079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da2abf-8d76-40de-935e-d31de5899cfe admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:00.832360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-426b1ac2-1a7b-4dc3-9fcd-19c1c29018ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:00.915547 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1438/2896] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:00.926017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b1ac2-1a7b-4dc3-9fcd-19c1c29018ba None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:00.928291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-426b1ac2-1a7b-4dc3-9fcd-19c1c29018ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:01.021721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b1ac2-1a7b-4dc3-9fcd-19c1c29018ba None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:01.030082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba6976-59a1-4fdc-9156-c2703647811b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:01.031725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6976-59a1-4fdc-9156-c2703647811b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:01.032026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6976-59a1-4fdc-9156-c2703647811b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:01.032304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6976-59a1-4fdc-9156-c2703647811b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:01.035211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae069456-b07c-47bf-b1f9-96e092d82d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:01.035887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae069456-b07c-47bf-b1f9-96e092d82d1b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:01.036210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae069456-b07c-47bf-b1f9-96e092d82d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:01.038720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae069456-b07c-47bf-b1f9-96e092d82d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:01.039430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae069456-b07c-47bf-b1f9-96e092d82d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:01.041459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae069456-b07c-47bf-b1f9-96e092d82d1b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:01.063597 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1459/2897] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:53:01.064877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae069456-b07c-47bf-b1f9-96e092d82d1b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:01.066743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba6976-59a1-4fdc-9156-c2703647811b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:01.071527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba6976-59a1-4fdc-9156-c2703647811b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:01.104385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae069456-b07c-47bf-b1f9-96e092d82d1b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:01.118784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b095c5-0638-4783-a70d-d3e1badb776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:01.119745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b095c5-0638-4783-a70d-d3e1badb776d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:01.120236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b095c5-0638-4783-a70d-d3e1badb776d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:01.120787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b095c5-0638-4783-a70d-d3e1badb776d admin admin] PATH_INFO: `/v3/projects/39e5e345d67e457b9f51a84aa0914ca7/users/b85df86a633d469489cf2fdc7eaec5cf/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:01.121044 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1439/2898] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:01.161909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b095c5-0638-4783-a70d-d3e1badb776d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e5e345d67e457b9f51a84aa0914ca7, user_id=b85df86a633d469489cf2fdc7eaec5cf, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:01.165058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b095c5-0638-4783-a70d-d3e1badb776d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:01.206636 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1460/2899] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:53:01 2022] PUT /identity/v3/projects/39e5e345d67e457b9f51a84aa0914ca7/users/b85df86a633d469489cf2fdc7eaec5cf/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:01.212577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd7cf7-9525-4b67-a84e-c33bfa89bda1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:01.212891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd7cf7-9525-4b67-a84e-c33bfa89bda1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:01.213158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd7cf7-9525-4b67-a84e-c33bfa89bda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:01.272363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-34fd7cf7-9525-4b67-a84e-c33bfa89bda1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:01.273784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-34fd7cf7-9525-4b67-a84e-c33bfa89bda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:01.338039 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:01.396334 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1440/2900] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:01.404931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b095c5-0638-4783-a70d-d3e1badb776d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:01.407762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1b095c5-0638-4783-a70d-d3e1badb776d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:01.639974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b095c5-0638-4783-a70d-d3e1badb776d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:01.670658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265042d-328a-41d1-bf51-1a828c764382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:01.671504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265042d-328a-41d1-bf51-1a828c764382 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:01.671869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265042d-328a-41d1-bf51-1a828c764382 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:01.672243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265042d-328a-41d1-bf51-1a828c764382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:01.685088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265042d-328a-41d1-bf51-1a828c764382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:01.687485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265042d-328a-41d1-bf51-1a828c764382 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:01.712701 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1461/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:02.167766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd7cf7-9525-4b67-a84e-c33bfa89bda1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:02.170114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-34fd7cf7-9525-4b67-a84e-c33bfa89bda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:02.196203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd7cf7-9525-4b67-a84e-c33bfa89bda1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:02.224190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:02.226475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:02.227859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:02.228362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] PATH_INFO: `/v3/projects/5a7bc6ded408446ea09e56df3117e8ed` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:02.233267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7bc6ded408446ea09e56df3117e8ed)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:02.242729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:02.369815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7bc6ded408446ea09e56df3117e8ed', 'request_id': 'req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:02.386352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7bc6ded408446ea09e56df3117e8ed', 'request_id': 'req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:02.413995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7bc6ded408446ea09e56df3117e8ed', 'request_id': 'req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:02.434556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] The token cache is being invalidate because project 5a7bc6ded408446ea09e56df3117e8ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:53:02.435393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:02.436941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-becde3d9-c7aa-4ae8-ac56-b11e39f3b23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:02.440570 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1441/2902] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:53:02 2022] DELETE /identity/v3/projects/5a7bc6ded408446ea09e56df3117e8ed => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:02.445612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e392-363f-4f56-bd68-ef939fce28f4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:02.446117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e392-363f-4f56-bd68-ef939fce28f4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:02.446245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e392-363f-4f56-bd68-ef939fce28f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:02.495020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8560e392-363f-4f56-bd68-ef939fce28f4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:02.503354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8560e392-363f-4f56-bd68-ef939fce28f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:02.595304 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:02.630361 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1462/2903] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:02.638582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939a1d2-f866-452a-aa5a-b3dd9c705ac8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:02.641213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939a1d2-f866-452a-aa5a-b3dd9c705ac8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:02.645230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939a1d2-f866-452a-aa5a-b3dd9c705ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:02.682273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1939a1d2-f866-452a-aa5a-b3dd9c705ac8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:02.683872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1939a1d2-f866-452a-aa5a-b3dd9c705ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:02.698270 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1442/2904] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:02.702242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560e392-363f-4f56-bd68-ef939fce28f4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:02.719132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560e392-363f-4f56-bd68-ef939fce28f4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:02.741548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3953f-d08e-4a5d-911d-eaa2c20d96eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:02.743212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3953f-d08e-4a5d-911d-eaa2c20d96eb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:02.743567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3953f-d08e-4a5d-911d-eaa2c20d96eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:02.743924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3953f-d08e-4a5d-911d-eaa2c20d96eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:02.746029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3953f-d08e-4a5d-911d-eaa2c20d96eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:53:02.746434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3953f-d08e-4a5d-911d-eaa2c20d96eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:02.752879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3953f-d08e-4a5d-911d-eaa2c20d96eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:02.821649 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1463/2905] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:53:02.823560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939a1d2-f866-452a-aa5a-b3dd9c705ac8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:02.845163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939a1d2-f866-452a-aa5a-b3dd9c705ac8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:02.857757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afcf0d-766e-48f7-a115-58b9987ec8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:02.858454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afcf0d-766e-48f7-a115-58b9987ec8cd admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:02.858701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afcf0d-766e-48f7-a115-58b9987ec8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:02.860906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afcf0d-766e-48f7-a115-58b9987ec8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:02.862235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afcf0d-766e-48f7-a115-58b9987ec8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:02.871556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afcf0d-766e-48f7-a115-58b9987ec8cd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:02.919892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3953f-d08e-4a5d-911d-eaa2c20d96eb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:02.921785 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1443/2906] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:53:02 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:53:02.936061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3953f-d08e-4a5d-911d-eaa2c20d96eb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:03.072873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526420bf-be9c-4043-81c3-257fcf6efc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:03.072873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526420bf-be9c-4043-81c3-257fcf6efc30 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:03.072873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526420bf-be9c-4043-81c3-257fcf6efc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:03.072873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526420bf-be9c-4043-81c3-257fcf6efc30 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:03.073380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526420bf-be9c-4043-81c3-257fcf6efc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:03.075633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526420bf-be9c-4043-81c3-257fcf6efc30 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:03.127478 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1464/2907] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:53:02 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:53:03.131695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afcf0d-766e-48f7-a115-58b9987ec8cd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:03.158418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afcf0d-766e-48f7-a115-58b9987ec8cd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:03.178617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981371eb-aaa0-45b4-b1b2-e1e33c96a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:03.182323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981371eb-aaa0-45b4-b1b2-e1e33c96a6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:03.183187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981371eb-aaa0-45b4-b1b2-e1e33c96a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:03.183641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981371eb-aaa0-45b4-b1b2-e1e33c96a6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:03.184337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981371eb-aaa0-45b4-b1b2-e1e33c96a6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:03.185965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981371eb-aaa0-45b4-b1b2-e1e33c96a6a0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:03.450014 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1444/2908] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:53:03.457454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526420bf-be9c-4043-81c3-257fcf6efc30 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:03.473474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526420bf-be9c-4043-81c3-257fcf6efc30 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:03.488100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32ef75-3901-444d-8fc3-60f8808f2d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:03.490159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ef75-3901-444d-8fc3-60f8808f2d7b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:03.490854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ef75-3901-444d-8fc3-60f8808f2d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:03.491415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ef75-3901-444d-8fc3-60f8808f2d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:03.492385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32ef75-3901-444d-8fc3-60f8808f2d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:03.494765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32ef75-3901-444d-8fc3-60f8808f2d7b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:03.512205 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1465/2909] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:53:03.519078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981371eb-aaa0-45b4-b1b2-e1e33c96a6a0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:03.588144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981371eb-aaa0-45b4-b1b2-e1e33c96a6a0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:03.612827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941e6b-42ae-4d5b-a559-3f8b1461ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:03.616668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941e6b-42ae-4d5b-a559-3f8b1461ae43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:03.617739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941e6b-42ae-4d5b-a559-3f8b1461ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:03.618837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941e6b-42ae-4d5b-a559-3f8b1461ae43 admin admin] PATH_INFO: `/v3/projects/fc404ab2e6a942a982cde4b6783df1aa/users/2d8cb12f6f274e71bfb97b73afe2ee89/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:03.690959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3941e6b-42ae-4d5b-a559-3f8b1461ae43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc404ab2e6a942a982cde4b6783df1aa, user_id=2d8cb12f6f274e71bfb97b73afe2ee89, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:03.704284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3941e6b-42ae-4d5b-a559-3f8b1461ae43 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:03.746881 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1445/2910] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:53:03 2022] PUT /identity/v3/projects/fc404ab2e6a942a982cde4b6783df1aa/users/2d8cb12f6f274e71bfb97b73afe2ee89/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:03.754301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765793d5-7522-4012-885c-3ccf17505027 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:03.755106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765793d5-7522-4012-885c-3ccf17505027 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:03.759409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765793d5-7522-4012-885c-3ccf17505027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:03.858132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-765793d5-7522-4012-885c-3ccf17505027 None None] MFA Rules not processed for user `2d8cb12f6f274e71bfb97b73afe2ee89`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:03.859360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-765793d5-7522-4012-885c-3ccf17505027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:04.101333 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1466/2911] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:04.114366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941e6b-42ae-4d5b-a559-3f8b1461ae43 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:04.125471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d3941e6b-42ae-4d5b-a559-3f8b1461ae43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:04.332160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941e6b-42ae-4d5b-a559-3f8b1461ae43 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:04.350811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272e5a7-6010-4b2e-81c9-90d2fbe1bcb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:04.351515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e5a7-6010-4b2e-81c9-90d2fbe1bcb1 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:04.353433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e5a7-6010-4b2e-81c9-90d2fbe1bcb1 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:04.353796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e5a7-6010-4b2e-81c9-90d2fbe1bcb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:04.373315 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:04.390425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272e5a7-6010-4b2e-81c9-90d2fbe1bcb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:04.392761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272e5a7-6010-4b2e-81c9-90d2fbe1bcb1 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:04.419033 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1446/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:05.348487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765793d5-7522-4012-885c-3ccf17505027 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:05.453060 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:05.505971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765793d5-7522-4012-885c-3ccf17505027 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:05.531758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:05.532599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:05.533332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:05.533728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] PATH_INFO: `/v3/users/2d8cb12f6f274e71bfb97b73afe2ee89` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:05.536700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8cb12f6f274e71bfb97b73afe2ee89)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:05.543998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:05.710893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8cb12f6f274e71bfb97b73afe2ee89'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:05.741368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8cb12f6f274e71bfb97b73afe2ee89'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:05.758525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8cb12f6f274e71bfb97b73afe2ee89'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:05.838548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8cb12f6f274e71bfb97b73afe2ee89'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:05.842610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8cb12f6f274e71bfb97b73afe2ee89'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:05.869346 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1467/2913] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:53:05 2022] DELETE /identity/v3/users/2d8cb12f6f274e71bfb97b73afe2ee89 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:53:05.874040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76325-9321-4796-acfa-adbb58760af6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:05.874995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76325-9321-4796-acfa-adbb58760af6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:05.875708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76325-9321-4796-acfa-adbb58760af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:05.943174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7fb76325-9321-4796-acfa-adbb58760af6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:05.954771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7fb76325-9321-4796-acfa-adbb58760af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:06.180945 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1447/2914] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:06.229036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:06.230533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:06.403647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b855e-0364-43c3-93fc-70d288a35d26 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:06.410627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0720dc0-1843-49f2-9e34-d658812a2ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:06.411628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0720dc0-1843-49f2-9e34-d658812a2ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:06.411953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0720dc0-1843-49f2-9e34-d658812a2ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:06.412484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0720dc0-1843-49f2-9e34-d658812a2ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:06.431643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0720dc0-1843-49f2-9e34-d658812a2ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:06.433985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0720dc0-1843-49f2-9e34-d658812a2ac9 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:06.460169 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1468/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:07.918138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb76325-9321-4796-acfa-adbb58760af6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:07.920458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7fb76325-9321-4796-acfa-adbb58760af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:07.947214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb76325-9321-4796-acfa-adbb58760af6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:07.969176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:07.970464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:07.970991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:07.971541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] PATH_INFO: `/v3/projects/fc404ab2e6a942a982cde4b6783df1aa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:07.973999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc404ab2e6a942a982cde4b6783df1aa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:07.976356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:08.129944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc404ab2e6a942a982cde4b6783df1aa', 'request_id': 'req-bb2d1ea6-eda5-4335-b85c-4c6976070573'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:08.143706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc404ab2e6a942a982cde4b6783df1aa', 'request_id': 'req-bb2d1ea6-eda5-4335-b85c-4c6976070573'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:08.163001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc404ab2e6a942a982cde4b6783df1aa', 'request_id': 'req-bb2d1ea6-eda5-4335-b85c-4c6976070573'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:08.183744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] The token cache is being invalidate because project fc404ab2e6a942a982cde4b6783df1aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:53:08.184051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:08.185507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb2d1ea6-eda5-4335-b85c-4c6976070573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:08.188921 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1448/2916] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:53:07 2022] DELETE /identity/v3/projects/fc404ab2e6a942a982cde4b6783df1aa => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:08.195816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e4e87-af5a-4833-994e-0cb37b3084e0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:08.196344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e4e87-af5a-4833-994e-0cb37b3084e0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:08.196587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e4e87-af5a-4833-994e-0cb37b3084e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:08.235439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1b8e4e87-af5a-4833-994e-0cb37b3084e0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:08.270566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b8e4e87-af5a-4833-994e-0cb37b3084e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:08.481143 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1469/2917] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:53:08.483535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67deb51-7e6a-4444-a5a2-4844b9350e48 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:08.484826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67deb51-7e6a-4444-a5a2-4844b9350e48 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:08.485500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67deb51-7e6a-4444-a5a2-4844b9350e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:08.544802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c67deb51-7e6a-4444-a5a2-4844b9350e48 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:08.549595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c67deb51-7e6a-4444-a5a2-4844b9350e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:08.572211 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1449/2918] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:08.577762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e4e87-af5a-4833-994e-0cb37b3084e0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:08.614260 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:08.626480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e4e87-af5a-4833-994e-0cb37b3084e0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:08.646317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1e398-8474-4a19-b006-ece7f947b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:08.651943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1e398-8474-4a19-b006-ece7f947b05c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:08.652593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1e398-8474-4a19-b006-ece7f947b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:08.653233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1e398-8474-4a19-b006-ece7f947b05c admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:08.654081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1e398-8474-4a19-b006-ece7f947b05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:53:08.657644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1e398-8474-4a19-b006-ece7f947b05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:08.661136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1e398-8474-4a19-b006-ece7f947b05c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:08.724079 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1470/2919] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:53:08.726307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67deb51-7e6a-4444-a5a2-4844b9350e48 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:08.748715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67deb51-7e6a-4444-a5a2-4844b9350e48 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:08.774440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca732044-3647-4573-8173-f2017d37f742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:08.775075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca732044-3647-4573-8173-f2017d37f742 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:08.775416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca732044-3647-4573-8173-f2017d37f742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:08.775613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca732044-3647-4573-8173-f2017d37f742 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:08.776233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca732044-3647-4573-8173-f2017d37f742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:08.789642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca732044-3647-4573-8173-f2017d37f742 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:08.904165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1e398-8474-4a19-b006-ece7f947b05c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:08.910688 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1450/2920] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:53:08 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:53:08.950498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1e398-8474-4a19-b006-ece7f947b05c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:09.097098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47e5c0-ac2f-4b68-b3ad-f83c1b8f95e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:09.098035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47e5c0-ac2f-4b68-b3ad-f83c1b8f95e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:09.098515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47e5c0-ac2f-4b68-b3ad-f83c1b8f95e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:09.099181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47e5c0-ac2f-4b68-b3ad-f83c1b8f95e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:09.100261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47e5c0-ac2f-4b68-b3ad-f83c1b8f95e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:09.103779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47e5c0-ac2f-4b68-b3ad-f83c1b8f95e5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:09.154937 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1471/2921] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:53:08 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:53:09.160052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca732044-3647-4573-8173-f2017d37f742 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:09.183053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca732044-3647-4573-8173-f2017d37f742 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:09.196126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3a291-179e-4fdb-aad5-4573913c4018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:09.196785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3a291-179e-4fdb-aad5-4573913c4018 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:09.197069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3a291-179e-4fdb-aad5-4573913c4018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:09.197341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3a291-179e-4fdb-aad5-4573913c4018 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:09.198254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3a291-179e-4fdb-aad5-4573913c4018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:09.208075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3a291-179e-4fdb-aad5-4573913c4018 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:09.233816 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1451/2922] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:53:09.238025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47e5c0-ac2f-4b68-b3ad-f83c1b8f95e5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:09.259145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47e5c0-ac2f-4b68-b3ad-f83c1b8f95e5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:09.272346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf064e60-2f3a-4c95-8158-7dfc3d492a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:09.273524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064e60-2f3a-4c95-8158-7dfc3d492a0f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:09.273976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064e60-2f3a-4c95-8158-7dfc3d492a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:09.274421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf064e60-2f3a-4c95-8158-7dfc3d492a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:09.275278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf064e60-2f3a-4c95-8158-7dfc3d492a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:09.290228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf064e60-2f3a-4c95-8158-7dfc3d492a0f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:09.308986 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1472/2923] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:53:09.313845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3a291-179e-4fdb-aad5-4573913c4018 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:09.330341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3a291-179e-4fdb-aad5-4573913c4018 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:09.339569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945811fb-d005-419a-8ee0-4acfcc25eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:09.340262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945811fb-d005-419a-8ee0-4acfcc25eaaa admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:09.340539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945811fb-d005-419a-8ee0-4acfcc25eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:09.340840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945811fb-d005-419a-8ee0-4acfcc25eaaa admin admin] PATH_INFO: `/v3/projects/9868d1ede07c453e9a0cb24d0fcdd4df/users/4eaebe4f02ee4634b92407e4e066beab/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:09.389543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945811fb-d005-419a-8ee0-4acfcc25eaaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9868d1ede07c453e9a0cb24d0fcdd4df, user_id=4eaebe4f02ee4634b92407e4e066beab, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:09.393589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945811fb-d005-419a-8ee0-4acfcc25eaaa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:09.442059 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1452/2924] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:53:09 2022] PUT /identity/v3/projects/9868d1ede07c453e9a0cb24d0fcdd4df/users/4eaebe4f02ee4634b92407e4e066beab/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:09.448124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc34bd5-4317-49e7-9215-256f54f6a6dd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:09.450270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc34bd5-4317-49e7-9215-256f54f6a6dd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:09.451646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc34bd5-4317-49e7-9215-256f54f6a6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:09.508495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3cc34bd5-4317-49e7-9215-256f54f6a6dd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:09.509968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3cc34bd5-4317-49e7-9215-256f54f6a6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:09.695399 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1473/2925] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:53:09.732788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945811fb-d005-419a-8ee0-4acfcc25eaaa admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:09.735829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-945811fb-d005-419a-8ee0-4acfcc25eaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:09.804984 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:09.896505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945811fb-d005-419a-8ee0-4acfcc25eaaa admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:09.903231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8b929-bece-40d3-aa85-2c054609ed28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:09.903879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8b929-bece-40d3-aa85-2c054609ed28 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:09.904414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8b929-bece-40d3-aa85-2c054609ed28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:09.904751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8b929-bece-40d3-aa85-2c054609ed28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:09.923447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8b929-bece-40d3-aa85-2c054609ed28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:09.928179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8b929-bece-40d3-aa85-2c054609ed28 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:09.952109 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1453/2926] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:12.422099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616bf66-45a3-47b0-b244-5b1a98f2944e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:12.422635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616bf66-45a3-47b0-b244-5b1a98f2944e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:12.422635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616bf66-45a3-47b0-b244-5b1a98f2944e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:12.516351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6616bf66-45a3-47b0-b244-5b1a98f2944e None None] MFA Rules not processed for user `b85df86a633d469489cf2fdc7eaec5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:12.517910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6616bf66-45a3-47b0-b244-5b1a98f2944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:12.658569 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:12.684458 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1474/2927] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:12.687835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330566-05d2-4449-9788-f5e238c225b5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:12.688354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330566-05d2-4449-9788-f5e238c225b5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:12.688471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330566-05d2-4449-9788-f5e238c225b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:12.716990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f8330566-05d2-4449-9788-f5e238c225b5 None None] MFA Rules not processed for user `b85df86a633d469489cf2fdc7eaec5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:12.720491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8330566-05d2-4449-9788-f5e238c225b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:12.746976 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1454/2928] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:12.761831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616bf66-45a3-47b0-b244-5b1a98f2944e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:12.763288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6616bf66-45a3-47b0-b244-5b1a98f2944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:12.915277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616bf66-45a3-47b0-b244-5b1a98f2944e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:12.954562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ea7d-932a-4b25-8c8b-02669e899677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:12.954562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ea7d-932a-4b25-8c8b-02669e899677 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:12.954562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ea7d-932a-4b25-8c8b-02669e899677 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:12.954562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ea7d-932a-4b25-8c8b-02669e899677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:12.967731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ea7d-932a-4b25-8c8b-02669e899677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:12.970399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ea7d-932a-4b25-8c8b-02669e899677 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:12.988691 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1475/2929] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:16.133078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d87d6d-045d-457e-b31f-92ac7c42d835 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:16.133571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d87d6d-045d-457e-b31f-92ac7c42d835 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:16.133638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d87d6d-045d-457e-b31f-92ac7c42d835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:16.176195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-87d87d6d-045d-457e-b31f-92ac7c42d835 None None] MFA Rules not processed for user `2542aef0e4464018bf9d4563ffe9030d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:16.177496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-87d87d6d-045d-457e-b31f-92ac7c42d835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:16.329434 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1455/2930] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:20.667404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ea7d-932a-4b25-8c8b-02669e899677 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:20.669751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9c68ea7d-932a-4b25-8c8b-02669e899677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:20.910172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ea7d-932a-4b25-8c8b-02669e899677 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:20.920392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:20.921075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:20.921358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:20.921635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:20.929069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:21.076104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:21.078902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:21.098214 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1476/2931] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:20 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:21.457428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa97bcd-7970-4d9f-b65b-10dd1ea68d3e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:21.458438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa97bcd-7970-4d9f-b65b-10dd1ea68d3e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:21.458978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa97bcd-7970-4d9f-b65b-10dd1ea68d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:21.619693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4fa97bcd-7970-4d9f-b65b-10dd1ea68d3e None None] MFA Rules not processed for user `4eaebe4f02ee4634b92407e4e066beab`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:21.629082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4fa97bcd-7970-4d9f-b65b-10dd1ea68d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:21.753179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:21.755600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:21.800918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61131700-8fba-44f5-b65f-150f89e06505 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:21.812185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f292bb-28f2-4d8f-ac50-a3f26ea22b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:21.817064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f292bb-28f2-4d8f-ac50-a3f26ea22b34 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:21.817663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f292bb-28f2-4d8f-ac50-a3f26ea22b34 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:21.818156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f292bb-28f2-4d8f-ac50-a3f26ea22b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:21.821966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-07f292bb-28f2-4d8f-ac50-a3f26ea22b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:21.855018 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1456/2932] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:21.866336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99812d26-1f4e-42d8-8fd2-19710ff397d6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:21.866653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99812d26-1f4e-42d8-8fd2-19710ff397d6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:21.866881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99812d26-1f4e-42d8-8fd2-19710ff397d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:21.943585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-99812d26-1f4e-42d8-8fd2-19710ff397d6 None None] MFA Rules not processed for user `4eaebe4f02ee4634b92407e4e066beab`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:21.944927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-99812d26-1f4e-42d8-8fd2-19710ff397d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:21.949149 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:21.985859 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1457/2933] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:22.101315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f292bb-28f2-4d8f-ac50-a3f26ea22b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:22.107088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f292bb-28f2-4d8f-ac50-a3f26ea22b34 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:22.146532 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1477/2934] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:22.609092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99812d26-1f4e-42d8-8fd2-19710ff397d6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:22.648006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99812d26-1f4e-42d8-8fd2-19710ff397d6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:22.675804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10618a-f806-462c-abe3-fa946ba387d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:22.679500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10618a-f806-462c-abe3-fa946ba387d3 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:22.680536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10618a-f806-462c-abe3-fa946ba387d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:22.681484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10618a-f806-462c-abe3-fa946ba387d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:22.716735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10618a-f806-462c-abe3-fa946ba387d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:22.719427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10618a-f806-462c-abe3-fa946ba387d3 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:22.769770 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1458/2935] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:23.007512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da22ec7-168a-4915-b010-5fb664d17b0b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:23.008004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da22ec7-168a-4915-b010-5fb664d17b0b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:23.008080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da22ec7-168a-4915-b010-5fb664d17b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:23.058890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1da22ec7-168a-4915-b010-5fb664d17b0b None None] MFA Rules not processed for user `02e52a53aba2448096ac85fcfaa598a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:23.060155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1da22ec7-168a-4915-b010-5fb664d17b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:23.234759 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1478/2936] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:32.740558 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:33.092015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afaccb-1311-4fc8-b8d4-567981e7b7be None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:33.092614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afaccb-1311-4fc8-b8d4-567981e7b7be None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:33.093066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afaccb-1311-4fc8-b8d4-567981e7b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:33.127755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-98afaccb-1311-4fc8-b8d4-567981e7b7be None None] MFA Rules not processed for user `7323365b46824abfacf50c9435816bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:33.129380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-98afaccb-1311-4fc8-b8d4-567981e7b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:33.215303 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=38 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:33.300283 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1459/2937] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:36.737871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da22ec7-168a-4915-b010-5fb664d17b0b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:36.739348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1da22ec7-168a-4915-b010-5fb664d17b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:36.762292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da22ec7-168a-4915-b010-5fb664d17b0b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:36.768567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:36.769503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:36.769933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:36.770383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] PATH_INFO: `/v3/users/2f386bc9a48641a4bcd3b09ae45bea70` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:36.771756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f386bc9a48641a4bcd3b09ae45bea70)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:36.774769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:36.867375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f386bc9a48641a4bcd3b09ae45bea70'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:36.914581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f386bc9a48641a4bcd3b09ae45bea70'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:36.949606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f386bc9a48641a4bcd3b09ae45bea70'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:36.962687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f386bc9a48641a4bcd3b09ae45bea70'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:36.963440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-835ab68b-6c85-4a5c-98f5-cf8fb0e5dfe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f386bc9a48641a4bcd3b09ae45bea70'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:36.973507 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1479/2938] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:53:36 2022] DELETE /identity/v3/users/2f386bc9a48641a4bcd3b09ae45bea70 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:37.287324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afaccb-1311-4fc8-b8d4-567981e7b7be None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:37.303437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afaccb-1311-4fc8-b8d4-567981e7b7be None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:37.398224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:37.399214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:37.399643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:37.400086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] PATH_INFO: `/v3/projects/f69ef772c8bb45358f98bf5b8ff2e670` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:37.401433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69ef772c8bb45358f98bf5b8ff2e670)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:37.403857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:37.464111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69ef772c8bb45358f98bf5b8ff2e670', 'request_id': 'req-4c4d4268-9904-4e32-8284-7e16254b91a8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:37.474173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69ef772c8bb45358f98bf5b8ff2e670', 'request_id': 'req-4c4d4268-9904-4e32-8284-7e16254b91a8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:37.483572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69ef772c8bb45358f98bf5b8ff2e670', 'request_id': 'req-4c4d4268-9904-4e32-8284-7e16254b91a8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:37.498605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] The token cache is being invalidate because project f69ef772c8bb45358f98bf5b8ff2e670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:53:37.498895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:37.499695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4d4268-9904-4e32-8284-7e16254b91a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:37.505729 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1460/2939] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:53:37 2022] DELETE /identity/v3/projects/f69ef772c8bb45358f98bf5b8ff2e670 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:37.507441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec2de0-b76b-433e-8b57-e4eefcd62852 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:37.507728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec2de0-b76b-433e-8b57-e4eefcd62852 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:37.508003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec2de0-b76b-433e-8b57-e4eefcd62852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:37.529136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f5ec2de0-b76b-433e-8b57-e4eefcd62852 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:37.530660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f5ec2de0-b76b-433e-8b57-e4eefcd62852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:37.602557 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1480/2940] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:53:37.612542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44d491-dfa8-4114-bd88-e375eef9e4a2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:37.613135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44d491-dfa8-4114-bd88-e375eef9e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:37.613588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44d491-dfa8-4114-bd88-e375eef9e4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:37.644067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fe44d491-dfa8-4114-bd88-e375eef9e4a2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:37.646979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fe44d491-dfa8-4114-bd88-e375eef9e4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:37.660999 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1461/2941] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:37.665949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec2de0-b76b-433e-8b57-e4eefcd62852 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:37.705839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec2de0-b76b-433e-8b57-e4eefcd62852 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:37.712605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff58d7f-5eea-433b-9a5b-2f8015907272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:37.712605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff58d7f-5eea-433b-9a5b-2f8015907272 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:37.712605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff58d7f-5eea-433b-9a5b-2f8015907272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:37.712936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff58d7f-5eea-433b-9a5b-2f8015907272 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:37.713719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff58d7f-5eea-433b-9a5b-2f8015907272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:53:37.714027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff58d7f-5eea-433b-9a5b-2f8015907272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:37.715878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff58d7f-5eea-433b-9a5b-2f8015907272 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:37.737262 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1481/2942] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:53:37.738725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44d491-dfa8-4114-bd88-e375eef9e4a2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:37.751206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44d491-dfa8-4114-bd88-e375eef9e4a2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:37.762331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216da58-e652-412d-886b-b8289fb87f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:37.762979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216da58-e652-412d-886b-b8289fb87f9a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:37.764028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216da58-e652-412d-886b-b8289fb87f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:37.764313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216da58-e652-412d-886b-b8289fb87f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:37.765018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216da58-e652-412d-886b-b8289fb87f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:37.767260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216da58-e652-412d-886b-b8289fb87f9a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:37.800477 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1462/2943] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:53:37 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:53:37.805050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff58d7f-5eea-433b-9a5b-2f8015907272 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:37.819290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff58d7f-5eea-433b-9a5b-2f8015907272 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:37.906497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0fc6-f070-455f-918a-700dda605e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:37.907224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0fc6-f070-455f-918a-700dda605e88 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:37.907605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0fc6-f070-455f-918a-700dda605e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:37.907950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0fc6-f070-455f-918a-700dda605e88 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:37.909252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa0fc6-f070-455f-918a-700dda605e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:37.911518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa0fc6-f070-455f-918a-700dda605e88 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:37.920794 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:37.957445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1482/2944] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:53:37 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:53:37.959335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216da58-e652-412d-886b-b8289fb87f9a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:37.973500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216da58-e652-412d-886b-b8289fb87f9a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:37.978842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff65b4d-8855-4465-b8b2-1ca098b4b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:37.980255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65b4d-8855-4465-b8b2-1ca098b4b614 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:37.980255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65b4d-8855-4465-b8b2-1ca098b4b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:37.980255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65b4d-8855-4465-b8b2-1ca098b4b614 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:37.981007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff65b4d-8855-4465-b8b2-1ca098b4b614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:37.982721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff65b4d-8855-4465-b8b2-1ca098b4b614 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:37.984420 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:38.001050 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1463/2945] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:53:38.001954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0fc6-f070-455f-918a-700dda605e88 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:38.014663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0fc6-f070-455f-918a-700dda605e88 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:38.022971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d6503-054c-49c9-848a-0c98cc699287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:38.023965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d6503-054c-49c9-848a-0c98cc699287 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:38.024438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d6503-054c-49c9-848a-0c98cc699287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:38.024937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d6503-054c-49c9-848a-0c98cc699287 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:38.026009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d6503-054c-49c9-848a-0c98cc699287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:38.028451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d6503-054c-49c9-848a-0c98cc699287 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:38.060664 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1483/2946] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:53:38.061257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff65b4d-8855-4465-b8b2-1ca098b4b614 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:38.075957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff65b4d-8855-4465-b8b2-1ca098b4b614 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:38.089391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ff97-f3c2-4eaa-85e9-a903566c318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:38.090390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ff97-f3c2-4eaa-85e9-a903566c318e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:38.091027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ff97-f3c2-4eaa-85e9-a903566c318e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:38.091485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ff97-f3c2-4eaa-85e9-a903566c318e admin admin] PATH_INFO: `/v3/projects/9c2fa98925ac4de19cd7cba6ef8b3b2c/users/cdea18bdbdad41babeb869506d9e602f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:38.133246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ff97-f3c2-4eaa-85e9-a903566c318e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2fa98925ac4de19cd7cba6ef8b3b2c, user_id=cdea18bdbdad41babeb869506d9e602f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:38.137922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ff97-f3c2-4eaa-85e9-a903566c318e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:38.169327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1464/2947] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:53:38 2022] PUT /identity/v3/projects/9c2fa98925ac4de19cd7cba6ef8b3b2c/users/cdea18bdbdad41babeb869506d9e602f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:53:38.175389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75ffc9-47d1-48b0-a1d8-6af06eac0941 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:38.175676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75ffc9-47d1-48b0-a1d8-6af06eac0941 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:38.175976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75ffc9-47d1-48b0-a1d8-6af06eac0941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:38.202370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5b75ffc9-47d1-48b0-a1d8-6af06eac0941 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:38.205982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5b75ffc9-47d1-48b0-a1d8-6af06eac0941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:38.327779 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1484/2948] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:38.343329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ff97-f3c2-4eaa-85e9-a903566c318e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:38.345939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2362ff97-f3c2-4eaa-85e9-a903566c318e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:38.576183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ff97-f3c2-4eaa-85e9-a903566c318e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:38.582019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07455617-f164-44cc-a7ad-5d899db3c8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:38.583221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455617-f164-44cc-a7ad-5d899db3c8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:38.583724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455617-f164-44cc-a7ad-5d899db3c8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:38.584178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455617-f164-44cc-a7ad-5d899db3c8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:38.595632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07455617-f164-44cc-a7ad-5d899db3c8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:38.597371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07455617-f164-44cc-a7ad-5d899db3c8e8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:38.630355 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1465/2949] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:45.367825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f5410-8036-494c-a17b-f9adb708f03e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:45.368374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f5410-8036-494c-a17b-f9adb708f03e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:45.368374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f5410-8036-494c-a17b-f9adb708f03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:45.456894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-006f5410-8036-494c-a17b-f9adb708f03e None None] MFA Rules not processed for user `cdea18bdbdad41babeb869506d9e602f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:45.458148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-006f5410-8036-494c-a17b-f9adb708f03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:45.627379 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1485/2950] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:46.413711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07455617-f164-44cc-a7ad-5d899db3c8e8 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:46.416044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-07455617-f164-44cc-a7ad-5d899db3c8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:46.646917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07455617-f164-44cc-a7ad-5d899db3c8e8 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:46.663314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eda72-d1a9-4ae1-b1cc-bb3ef23d5b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:46.663950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eda72-d1a9-4ae1-b1cc-bb3ef23d5b3d service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:46.664227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eda72-d1a9-4ae1-b1cc-bb3ef23d5b3d service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:46.664494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eda72-d1a9-4ae1-b1cc-bb3ef23d5b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:46.691640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eda72-d1a9-4ae1-b1cc-bb3ef23d5b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:46.699070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eda72-d1a9-4ae1-b1cc-bb3ef23d5b3d service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:46.716901 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1466/2951] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:48.164349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f5410-8036-494c-a17b-f9adb708f03e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:48.165913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-006f5410-8036-494c-a17b-f9adb708f03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:48.182361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f5410-8036-494c-a17b-f9adb708f03e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:48.187997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f9d57-9760-47b6-ac1f-48d166b8b0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:48.188736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f9d57-9760-47b6-ac1f-48d166b8b0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:48.189303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f9d57-9760-47b6-ac1f-48d166b8b0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:48.189729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f9d57-9760-47b6-ac1f-48d166b8b0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:48.192820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3d1f9d57-9760-47b6-ac1f-48d166b8b0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:48.222140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f9d57-9760-47b6-ac1f-48d166b8b0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:48.223998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f9d57-9760-47b6-ac1f-48d166b8b0b6 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:48.268499 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1486/2952] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:48.514527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459161e2-7676-4cc7-a184-a1144fe74da3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:48.515095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459161e2-7676-4cc7-a184-a1144fe74da3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:48.515199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459161e2-7676-4cc7-a184-a1144fe74da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:48.569789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-459161e2-7676-4cc7-a184-a1144fe74da3 None None] MFA Rules not processed for user `02e52a53aba2448096ac85fcfaa598a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:48.571893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-459161e2-7676-4cc7-a184-a1144fe74da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:48.784979 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1467/2953] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:51.572785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b3eea-ffd5-469e-bbfc-3c4b1080df11 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:51.573846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b3eea-ffd5-469e-bbfc-3c4b1080df11 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:51.574329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b3eea-ffd5-469e-bbfc-3c4b1080df11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:51.603441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f45b3eea-ffd5-469e-bbfc-3c4b1080df11 None None] MFA Rules not processed for user `cdea18bdbdad41babeb869506d9e602f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:51.605235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f45b3eea-ffd5-469e-bbfc-3c4b1080df11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:51.615404 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1487/2954] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:52.526499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459161e2-7676-4cc7-a184-a1144fe74da3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:52.527955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-459161e2-7676-4cc7-a184-a1144fe74da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:52.544279 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:52.552544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459161e2-7676-4cc7-a184-a1144fe74da3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:52.566335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:52.566995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:52.567270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:52.567540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] PATH_INFO: `/v3/users/60cdb88d047841efb92e55cd533edab9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:52.569189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60cdb88d047841efb92e55cd533edab9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:52.571384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:52.682745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60cdb88d047841efb92e55cd533edab9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:52.703272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60cdb88d047841efb92e55cd533edab9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:52.713795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60cdb88d047841efb92e55cd533edab9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:52.724076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60cdb88d047841efb92e55cd533edab9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:52.725151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60cdb88d047841efb92e55cd533edab9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:52.737401 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1468/2955] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:53:52 2022] DELETE /identity/v3/users/60cdb88d047841efb92e55cd533edab9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:52.741786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125815d4-69d1-43b0-bca8-8e910c8c67a8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:52.742699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125815d4-69d1-43b0-bca8-8e910c8c67a8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:52.743226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125815d4-69d1-43b0-bca8-8e910c8c67a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:52.777467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-125815d4-69d1-43b0-bca8-8e910c8c67a8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:52.778952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-125815d4-69d1-43b0-bca8-8e910c8c67a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:52.840326 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:52.863291 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1488/2956] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:52.873555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:52.875543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:53.000826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368206d-be3d-4de2-8e81-d5307832345f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:53.007570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c820993-7023-4a70-9f09-401928aca3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:53.008460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c820993-7023-4a70-9f09-401928aca3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:53.008949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c820993-7023-4a70-9f09-401928aca3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:53.009377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c820993-7023-4a70-9f09-401928aca3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:53.021995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c820993-7023-4a70-9f09-401928aca3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:53.024574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c820993-7023-4a70-9f09-401928aca3b8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:53.036836 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1469/2957] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:53:53.407724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125815d4-69d1-43b0-bca8-8e910c8c67a8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:53.410335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-125815d4-69d1-43b0-bca8-8e910c8c67a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:53.445389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125815d4-69d1-43b0-bca8-8e910c8c67a8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:53.459272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:53.460887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:53.461500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:53.461990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] PATH_INFO: `/v3/projects/248e481eb8de408fbb0e819a5a1f136e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:53.464291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=248e481eb8de408fbb0e819a5a1f136e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:53.466777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:53.637113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248e481eb8de408fbb0e819a5a1f136e', 'request_id': 'req-5fe6e681-7757-40e6-a61a-da4f84533c5c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:53.668462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248e481eb8de408fbb0e819a5a1f136e', 'request_id': 'req-5fe6e681-7757-40e6-a61a-da4f84533c5c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:53.680229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248e481eb8de408fbb0e819a5a1f136e', 'request_id': 'req-5fe6e681-7757-40e6-a61a-da4f84533c5c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:53.701095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] The token cache is being invalidate because project 248e481eb8de408fbb0e819a5a1f136e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:53:53.701529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:53.702461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5fe6e681-7757-40e6-a61a-da4f84533c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:53:53.706223 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1489/2958] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:53:53 2022] DELETE /identity/v3/projects/248e481eb8de408fbb0e819a5a1f136e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:53.710554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9384cfd-ae9a-48ea-b4e8-4e691fed0f2a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:53.711037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9384cfd-ae9a-48ea-b4e8-4e691fed0f2a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:53.711351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9384cfd-ae9a-48ea-b4e8-4e691fed0f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:53.738869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d9384cfd-ae9a-48ea-b4e8-4e691fed0f2a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:53.740147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d9384cfd-ae9a-48ea-b4e8-4e691fed0f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:53.832879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1470/2959] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:53.838210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac53d5-2a82-443c-b082-7b22b37b678a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:53.839112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac53d5-2a82-443c-b082-7b22b37b678a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:53.839569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac53d5-2a82-443c-b082-7b22b37b678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:53.871424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aeac53d5-2a82-443c-b082-7b22b37b678a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:53.872763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aeac53d5-2a82-443c-b082-7b22b37b678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:53.882360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1490/2960] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:53.887258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9384cfd-ae9a-48ea-b4e8-4e691fed0f2a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:53.898872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9384cfd-ae9a-48ea-b4e8-4e691fed0f2a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:53.904490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34fea7-2459-4667-b7b6-e9133a92fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:53.905946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34fea7-2459-4667-b7b6-e9133a92fb8e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:53.906380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34fea7-2459-4667-b7b6-e9133a92fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:53.906815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34fea7-2459-4667-b7b6-e9133a92fb8e admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:53.907627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34fea7-2459-4667-b7b6-e9133a92fb8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:53:53.908404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34fea7-2459-4667-b7b6-e9133a92fb8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:53.911746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34fea7-2459-4667-b7b6-e9133a92fb8e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:53.926527 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1471/2961] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:53:53.931043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac53d5-2a82-443c-b082-7b22b37b678a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:53.944349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac53d5-2a82-443c-b082-7b22b37b678a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:53.971242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d872c-734b-4150-8f34-adb9c7e196a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:53.972167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d872c-734b-4150-8f34-adb9c7e196a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:53.973727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d872c-734b-4150-8f34-adb9c7e196a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:53.974206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d872c-734b-4150-8f34-adb9c7e196a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:53.975013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d872c-734b-4150-8f34-adb9c7e196a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:53.977154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d872c-734b-4150-8f34-adb9c7e196a0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:54.042956 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1491/2962] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:53:53 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:53:54.052073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34fea7-2459-4667-b7b6-e9133a92fb8e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:54.068338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34fea7-2459-4667-b7b6-e9133a92fb8e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:54.074721 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:54.184185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a789e50-cfe8-4c51-9ac0-2d62999a739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:54.185013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a789e50-cfe8-4c51-9ac0-2d62999a739e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:54.185374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a789e50-cfe8-4c51-9ac0-2d62999a739e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:54.185744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a789e50-cfe8-4c51-9ac0-2d62999a739e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:54.186720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a789e50-cfe8-4c51-9ac0-2d62999a739e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:54.188958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a789e50-cfe8-4c51-9ac0-2d62999a739e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:54.224534 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1472/2963] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:53:54 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:53:54.228675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d872c-734b-4150-8f34-adb9c7e196a0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:54.262156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d872c-734b-4150-8f34-adb9c7e196a0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:54.290315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fd761-5c64-4ade-85ce-7fd52f7331b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:54.291471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fd761-5c64-4ade-85ce-7fd52f7331b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:54.291737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fd761-5c64-4ade-85ce-7fd52f7331b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:54.292017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fd761-5c64-4ade-85ce-7fd52f7331b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:54.292704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fd761-5c64-4ade-85ce-7fd52f7331b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:54.295192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fd761-5c64-4ade-85ce-7fd52f7331b6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:54.320224 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1492/2964] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:53:54.321218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a789e50-cfe8-4c51-9ac0-2d62999a739e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:54.341637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a789e50-cfe8-4c51-9ac0-2d62999a739e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:54.363215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cf540-b532-440b-b451-67f21fa44c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:54.363851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cf540-b532-440b-b451-67f21fa44c89 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:54.364135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cf540-b532-440b-b451-67f21fa44c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:54.364645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cf540-b532-440b-b451-67f21fa44c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:54.366151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cf540-b532-440b-b451-67f21fa44c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:54.368548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cf540-b532-440b-b451-67f21fa44c89 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:54.390064 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1473/2965] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:53:54.392800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fd761-5c64-4ade-85ce-7fd52f7331b6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:54.406883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fd761-5c64-4ade-85ce-7fd52f7331b6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:54.431226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a45f28-7a02-447d-b718-b9f4f7764f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:54.433132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a45f28-7a02-447d-b718-b9f4f7764f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:54.433431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a45f28-7a02-447d-b718-b9f4f7764f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:54.433729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a45f28-7a02-447d-b718-b9f4f7764f41 admin admin] PATH_INFO: `/v3/projects/37640d2d06604d02b384e5a2625b69e9/users/ab81208ae8f64a04bd49c018d7bf5c13/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:54.479172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a45f28-7a02-447d-b718-b9f4f7764f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37640d2d06604d02b384e5a2625b69e9, user_id=ab81208ae8f64a04bd49c018d7bf5c13, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:54.491389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a45f28-7a02-447d-b718-b9f4f7764f41 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:54.516842 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1493/2966] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:53:54 2022] PUT /identity/v3/projects/37640d2d06604d02b384e5a2625b69e9/users/ab81208ae8f64a04bd49c018d7bf5c13/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:53:54.522435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02ec2e-550e-4fae-9166-6f0791913db7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:54.522929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02ec2e-550e-4fae-9166-6f0791913db7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:54.523385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02ec2e-550e-4fae-9166-6f0791913db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:54.579080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8f02ec2e-550e-4fae-9166-6f0791913db7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:53:54.584024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8f02ec2e-550e-4fae-9166-6f0791913db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:54.723745 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1474/2967] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:53:54.745823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a45f28-7a02-447d-b718-b9f4f7764f41 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:53:54.747900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-17a45f28-7a02-447d-b718-b9f4f7764f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:53:54.868043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a45f28-7a02-447d-b718-b9f4f7764f41 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:53:54.879114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42adc36-6c1e-4421-887c-b2929f1685c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:53:54.879991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42adc36-6c1e-4421-887c-b2929f1685c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:53:54.880422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42adc36-6c1e-4421-887c-b2929f1685c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:53:54.880875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42adc36-6c1e-4421-887c-b2929f1685c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:53:54.893148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42adc36-6c1e-4421-887c-b2929f1685c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:53:54.894844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42adc36-6c1e-4421-887c-b2929f1685c9 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:53:54.913517 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1494/2968] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:00.773689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02ec2e-550e-4fae-9166-6f0791913db7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:00.779126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8f02ec2e-550e-4fae-9166-6f0791913db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:00.862313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02ec2e-550e-4fae-9166-6f0791913db7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:00.888188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068de69b-6fdf-4594-b4b0-ecfa51bc3347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:00.889210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068de69b-6fdf-4594-b4b0-ecfa51bc3347 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:00.901812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068de69b-6fdf-4594-b4b0-ecfa51bc3347 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:00.902553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068de69b-6fdf-4594-b4b0-ecfa51bc3347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:00.914850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-068de69b-6fdf-4594-b4b0-ecfa51bc3347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:01.241375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068de69b-6fdf-4594-b4b0-ecfa51bc3347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:01.244068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068de69b-6fdf-4594-b4b0-ecfa51bc3347 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:01.273994 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1475/2969] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:02.309066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42adc36-6c1e-4421-887c-b2929f1685c9 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:02.311739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f42adc36-6c1e-4421-887c-b2929f1685c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:02.320329 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:02.337329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42adc36-6c1e-4421-887c-b2929f1685c9 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:02.352135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:02.352850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:02.356894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:02.358445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] PATH_INFO: `/v3/users/b85df86a633d469489cf2fdc7eaec5cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:02.363014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85df86a633d469489cf2fdc7eaec5cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:02.367087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:02.481959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85df86a633d469489cf2fdc7eaec5cf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:02.516047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85df86a633d469489cf2fdc7eaec5cf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:02.540796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85df86a633d469489cf2fdc7eaec5cf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:02.582641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85df86a633d469489cf2fdc7eaec5cf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:02.585040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f7476ab6-59a2-4b22-afac-0738e396cb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85df86a633d469489cf2fdc7eaec5cf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:02.594300 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1495/2970] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:54:02 2022] DELETE /identity/v3/users/b85df86a633d469489cf2fdc7eaec5cf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:54:03.097452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068de69b-6fdf-4594-b4b0-ecfa51bc3347 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:03.112896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068de69b-6fdf-4594-b4b0-ecfa51bc3347 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:03.136105 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:03.286300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:03.286977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:03.287253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:03.287528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] PATH_INFO: `/v3/projects/39e5e345d67e457b9f51a84aa0914ca7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:03.293603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e5e345d67e457b9f51a84aa0914ca7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:03.295869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:03.411336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e5e345d67e457b9f51a84aa0914ca7', 'request_id': 'req-7d0e972a-562e-40d6-a60b-f69811c0970e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:03.429279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e5e345d67e457b9f51a84aa0914ca7', 'request_id': 'req-7d0e972a-562e-40d6-a60b-f69811c0970e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:03.438738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e5e345d67e457b9f51a84aa0914ca7', 'request_id': 'req-7d0e972a-562e-40d6-a60b-f69811c0970e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:03.460179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] The token cache is being invalidate because project 39e5e345d67e457b9f51a84aa0914ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:54:03.460665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:03.461496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0e972a-562e-40d6-a60b-f69811c0970e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:03.463271 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1476/2971] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:54:03 2022] DELETE /identity/v3/projects/39e5e345d67e457b9f51a84aa0914ca7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:54:03.471671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0f527-1812-4fcf-9985-0c4225fe3621 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:03.471671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0f527-1812-4fcf-9985-0c4225fe3621 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:03.471671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0f527-1812-4fcf-9985-0c4225fe3621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:03.499325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a1d0f527-1812-4fcf-9985-0c4225fe3621 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:03.502132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a1d0f527-1812-4fcf-9985-0c4225fe3621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:03.602661 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1496/2972] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:03.612820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ee0ea-a487-401c-a5c7-d064326cd941 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:03.613135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ee0ea-a487-401c-a5c7-d064326cd941 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:03.613813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ee0ea-a487-401c-a5c7-d064326cd941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:03.663632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-768ee0ea-a487-401c-a5c7-d064326cd941 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:03.664401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-768ee0ea-a487-401c-a5c7-d064326cd941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:03.676128 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1477/2973] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:03.677859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0f527-1812-4fcf-9985-0c4225fe3621 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:03.690658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0f527-1812-4fcf-9985-0c4225fe3621 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:03.696256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bfb8b-0e11-4fd0-9858-13d8261fd1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:03.701323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bfb8b-0e11-4fd0-9858-13d8261fd1db admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:03.701323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bfb8b-0e11-4fd0-9858-13d8261fd1db admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:03.701323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bfb8b-0e11-4fd0-9858-13d8261fd1db admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:03.701323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bfb8b-0e11-4fd0-9858-13d8261fd1db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:54:03.701323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bfb8b-0e11-4fd0-9858-13d8261fd1db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:03.701323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bfb8b-0e11-4fd0-9858-13d8261fd1db admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:03.716914 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1497/2974] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:54:03.725278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ee0ea-a487-401c-a5c7-d064326cd941 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:03.741250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ee0ea-a487-401c-a5c7-d064326cd941 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:03.750002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2f093-6d5a-4863-bf37-a0b184ef12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:03.750804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2f093-6d5a-4863-bf37-a0b184ef12b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:03.751502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2f093-6d5a-4863-bf37-a0b184ef12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:03.752681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2f093-6d5a-4863-bf37-a0b184ef12b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:03.753418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2f093-6d5a-4863-bf37-a0b184ef12b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:03.756348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2f093-6d5a-4863-bf37-a0b184ef12b7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:03.802059 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1478/2975] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:54:03 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:54:03.806043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bfb8b-0e11-4fd0-9858-13d8261fd1db admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:03.835859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bfb8b-0e11-4fd0-9858-13d8261fd1db admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:04.049319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6fb7f-e460-4729-8131-2ee3d40294e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:04.049319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6fb7f-e460-4729-8131-2ee3d40294e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:04.049319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6fb7f-e460-4729-8131-2ee3d40294e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:04.049319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6fb7f-e460-4729-8131-2ee3d40294e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:04.049733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6fb7f-e460-4729-8131-2ee3d40294e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:04.049733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6fb7f-e460-4729-8131-2ee3d40294e7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:04.073754 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:04.103312 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1498/2976] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:54:03 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:54:04.104431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2f093-6d5a-4863-bf37-a0b184ef12b7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:04.116486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2f093-6d5a-4863-bf37-a0b184ef12b7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:04.131658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845a58c-2dd0-405b-8dab-567ddcd44f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:04.134997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845a58c-2dd0-405b-8dab-567ddcd44f9b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:04.135528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845a58c-2dd0-405b-8dab-567ddcd44f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:04.136011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845a58c-2dd0-405b-8dab-567ddcd44f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:04.136925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845a58c-2dd0-405b-8dab-567ddcd44f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:04.139464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845a58c-2dd0-405b-8dab-567ddcd44f9b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:04.153210 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1479/2977] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:54:04.157058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6fb7f-e460-4729-8131-2ee3d40294e7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:04.168401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6fb7f-e460-4729-8131-2ee3d40294e7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:04.174601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33704089-5b6f-4cd2-aa19-402506056846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:04.175234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704089-5b6f-4cd2-aa19-402506056846 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:04.175876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704089-5b6f-4cd2-aa19-402506056846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:04.175876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704089-5b6f-4cd2-aa19-402506056846 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:04.176491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704089-5b6f-4cd2-aa19-402506056846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:04.178485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704089-5b6f-4cd2-aa19-402506056846 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:04.198940 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1499/2978] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:54:04.199239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845a58c-2dd0-405b-8dab-567ddcd44f9b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:04.214889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845a58c-2dd0-405b-8dab-567ddcd44f9b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:04.223790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3347e4-0f62-4484-a3f5-440ba7a8a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:04.224751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3347e4-0f62-4484-a3f5-440ba7a8a8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:04.225415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3347e4-0f62-4484-a3f5-440ba7a8a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:04.225837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3347e4-0f62-4484-a3f5-440ba7a8a8f9 admin admin] PATH_INFO: `/v3/projects/488f8fabd15e4e7c8837ccd25c842e46/users/ea919891e28b42fd9c7ea98cbf2362a4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:04.257815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3347e4-0f62-4484-a3f5-440ba7a8a8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488f8fabd15e4e7c8837ccd25c842e46, user_id=ea919891e28b42fd9c7ea98cbf2362a4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:04.262831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3347e4-0f62-4484-a3f5-440ba7a8a8f9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:04.308797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11db64-2d79-48d3-b2b1-65f3e14b9388 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:04.309114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11db64-2d79-48d3-b2b1-65f3e14b9388 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:04.309396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11db64-2d79-48d3-b2b1-65f3e14b9388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:04.315876 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1480/2979] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:54:04 2022] PUT /identity/v3/projects/488f8fabd15e4e7c8837ccd25c842e46/users/ea919891e28b42fd9c7ea98cbf2362a4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:54:04.350101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ab11db64-2d79-48d3-b2b1-65f3e14b9388 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:04.354222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab11db64-2d79-48d3-b2b1-65f3e14b9388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:04.476169 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1500/2980] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:04.484958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3347e4-0f62-4484-a3f5-440ba7a8a8f9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:04.487389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fd3347e4-0f62-4484-a3f5-440ba7a8a8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:04.551945 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:04.586457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3347e4-0f62-4484-a3f5-440ba7a8a8f9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:04.592100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbdd55-9306-49a5-8522-6480814976d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:04.592777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbdd55-9306-49a5-8522-6480814976d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:04.594871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbdd55-9306-49a5-8522-6480814976d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:04.596495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbdd55-9306-49a5-8522-6480814976d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:04.617019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbdd55-9306-49a5-8522-6480814976d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:04.618585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbdd55-9306-49a5-8522-6480814976d4 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:04.637205 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1481/2981] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:07.129653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11db64-2d79-48d3-b2b1-65f3e14b9388 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:07.131837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab11db64-2d79-48d3-b2b1-65f3e14b9388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:07.253649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11db64-2d79-48d3-b2b1-65f3e14b9388 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:07.261953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:07.268147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:07.268902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:07.269326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:07.272137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:07.301981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:07.303770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:07.317961 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1501/2982] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:08.514337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4342f8f-da11-492f-a74e-25fe8c7a958b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:08.514337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4342f8f-da11-492f-a74e-25fe8c7a958b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:08.514337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4342f8f-da11-492f-a74e-25fe8c7a958b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:08.596200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e4342f8f-da11-492f-a74e-25fe8c7a958b None None] MFA Rules not processed for user `ab81208ae8f64a04bd49c018d7bf5c13`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:08.597510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e4342f8f-da11-492f-a74e-25fe8c7a958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:08.717322 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1482/2983] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:08 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:08.722215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:08.724325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:08.743019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2179f-1b9a-4a2a-a809-9a64ab550b69 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:08.748569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a828e-daa4-4c5e-8f83-058caad72384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:08.749223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a828e-daa4-4c5e-8f83-058caad72384 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:08.749506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a828e-daa4-4c5e-8f83-058caad72384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:08.749782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a828e-daa4-4c5e-8f83-058caad72384 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:08.750429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a828e-daa4-4c5e-8f83-058caad72384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:08.752692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a828e-daa4-4c5e-8f83-058caad72384 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:08.802785 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1502/2984] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:54:08 2022] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:54:08.804831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4342f8f-da11-492f-a74e-25fe8c7a958b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:08.831521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4342f8f-da11-492f-a74e-25fe8c7a958b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:08.961749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ad873-f979-4355-89b5-ad8166afed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:08.962370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ad873-f979-4355-89b5-ad8166afed2d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:08.962653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ad873-f979-4355-89b5-ad8166afed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:08.962928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ad873-f979-4355-89b5-ad8166afed2d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:08.963566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ad873-f979-4355-89b5-ad8166afed2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:08.965682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ad873-f979-4355-89b5-ad8166afed2d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:08.997667 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1483/2985] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:54:08 2022] POST /identity/v3/users => generated 303 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:54:08.998896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a828e-daa4-4c5e-8f83-058caad72384 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:09.012413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a828e-daa4-4c5e-8f83-058caad72384 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:09.025130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6ebc-78df-4751-8003-4998955ec58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:09.026684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6ebc-78df-4751-8003-4998955ec58b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:09.027801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6ebc-78df-4751-8003-4998955ec58b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:09.030654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6ebc-78df-4751-8003-4998955ec58b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:09.032079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f6ebc-78df-4751-8003-4998955ec58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:09.048246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f6ebc-78df-4751-8003-4998955ec58b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:09.094598 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1503/2986] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:54:09.096558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ad873-f979-4355-89b5-ad8166afed2d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:09.117464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ad873-f979-4355-89b5-ad8166afed2d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:09.140741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d992c7e-a7ed-4234-9e2b-a636d6b07fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:09.140741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d992c7e-a7ed-4234-9e2b-a636d6b07fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:09.140741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d992c7e-a7ed-4234-9e2b-a636d6b07fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:09.140741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d992c7e-a7ed-4234-9e2b-a636d6b07fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:09.141278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d992c7e-a7ed-4234-9e2b-a636d6b07fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:09.141622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d992c7e-a7ed-4234-9e2b-a636d6b07fd9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:09.164329 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1484/2987] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:54:09.165629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6ebc-78df-4751-8003-4998955ec58b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:09.177573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6ebc-78df-4751-8003-4998955ec58b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:09.184055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df980d2-ad25-4cf1-bde3-039dc84b78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:09.185039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df980d2-ad25-4cf1-bde3-039dc84b78c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:09.185483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df980d2-ad25-4cf1-bde3-039dc84b78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:09.185912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df980d2-ad25-4cf1-bde3-039dc84b78c0 admin admin] PATH_INFO: `/v3/projects/f7f8e91f5c3a4069b89f5982180cc085/users/c9c74540f9b343618e9989940a802d41/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:09.221923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df980d2-ad25-4cf1-bde3-039dc84b78c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f8e91f5c3a4069b89f5982180cc085, user_id=c9c74540f9b343618e9989940a802d41, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:09.232663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df980d2-ad25-4cf1-bde3-039dc84b78c0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:09.280896 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1504/2988] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:54:09 2022] PUT /identity/v3/projects/f7f8e91f5c3a4069b89f5982180cc085/users/c9c74540f9b343618e9989940a802d41/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:54:12.718422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d992c7e-a7ed-4234-9e2b-a636d6b07fd9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:12.721083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6d992c7e-a7ed-4234-9e2b-a636d6b07fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:12.909047 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:13.012854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d992c7e-a7ed-4234-9e2b-a636d6b07fd9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:13.199247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12aa4c-7ab2-4931-bd08-ba0df734e930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:13.201447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12aa4c-7ab2-4931-bd08-ba0df734e930 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:13.201447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12aa4c-7ab2-4931-bd08-ba0df734e930 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:13.201447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12aa4c-7ab2-4931-bd08-ba0df734e930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:13.203099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bf12aa4c-7ab2-4931-bd08-ba0df734e930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:13.346164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12aa4c-7ab2-4931-bd08-ba0df734e930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:13.347404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12aa4c-7ab2-4931-bd08-ba0df734e930 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:13.363768 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1485/2989] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:12 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:15.683289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0844-29b8-4486-9811-50408c3252c2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:15.683834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0844-29b8-4486-9811-50408c3252c2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:15.683834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0844-29b8-4486-9811-50408c3252c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:15.722789 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:15.762567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-253e0844-29b8-4486-9811-50408c3252c2 None None] MFA Rules not processed for user `ea919891e28b42fd9c7ea98cbf2362a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:15.763835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-253e0844-29b8-4486-9811-50408c3252c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:16.089399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c9c74-4422-4296-82de-adcc345a70c9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:16.089835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c9c74-4422-4296-82de-adcc345a70c9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:16.090042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c9c74-4422-4296-82de-adcc345a70c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:16.107261 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1505/2990] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:16.168007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-979c9c74-4422-4296-82de-adcc345a70c9 None None] MFA Rules not processed for user `ea919891e28b42fd9c7ea98cbf2362a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:16.171154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-979c9c74-4422-4296-82de-adcc345a70c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:16.235349 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1486/2991] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:16.561957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0844-29b8-4486-9811-50408c3252c2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:16.609215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0844-29b8-4486-9811-50408c3252c2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:16.630983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b28b86-0a3c-40a1-a2d5-966bf3e141eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:16.631708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b28b86-0a3c-40a1-a2d5-966bf3e141eb service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:16.632019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b28b86-0a3c-40a1-a2d5-966bf3e141eb service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:16.632370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b28b86-0a3c-40a1-a2d5-966bf3e141eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:16.645696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b28b86-0a3c-40a1-a2d5-966bf3e141eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:16.648275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b28b86-0a3c-40a1-a2d5-966bf3e141eb service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:16.674729 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1506/2992] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:17.876249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c9c74-4422-4296-82de-adcc345a70c9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:17.877808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-979c9c74-4422-4296-82de-adcc345a70c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:18.166206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c9c74-4422-4296-82de-adcc345a70c9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:18.180645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adeae1-3cb7-4f56-82a7-46205bf2b795 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:18.180645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adeae1-3cb7-4f56-82a7-46205bf2b795 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:18.180645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adeae1-3cb7-4f56-82a7-46205bf2b795 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:18.180645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adeae1-3cb7-4f56-82a7-46205bf2b795 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:18.181071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-66adeae1-3cb7-4f56-82a7-46205bf2b795 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:18.209985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adeae1-3cb7-4f56-82a7-46205bf2b795 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:18.217016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adeae1-3cb7-4f56-82a7-46205bf2b795 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:18.263531 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1487/2993] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:22.239039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e285f-fe8d-4fb1-9974-b8129e3c643a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:22.239922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e285f-fe8d-4fb1-9974-b8129e3c643a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:22.240402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e285f-fe8d-4fb1-9974-b8129e3c643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:22.281098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-990e285f-fe8d-4fb1-9974-b8129e3c643a None None] MFA Rules not processed for user `2542aef0e4464018bf9d4563ffe9030d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:22.286808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-990e285f-fe8d-4fb1-9974-b8129e3c643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:22.366570 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1507/2994] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:22.520588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adeae1-3cb7-4f56-82a7-46205bf2b795 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:22.533131 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:22.726280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adeae1-3cb7-4f56-82a7-46205bf2b795 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:22.739130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384fb38-473a-414d-bb65-f17dfacb18ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:22.740069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384fb38-473a-414d-bb65-f17dfacb18ef service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:22.740350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384fb38-473a-414d-bb65-f17dfacb18ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:22.740641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384fb38-473a-414d-bb65-f17dfacb18ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:22.744103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b384fb38-473a-414d-bb65-f17dfacb18ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:22.784054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384fb38-473a-414d-bb65-f17dfacb18ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:22.785790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384fb38-473a-414d-bb65-f17dfacb18ef service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:22.803811 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1488/2995] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:22.825261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e285f-fe8d-4fb1-9974-b8129e3c643a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:22.827350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-990e285f-fe8d-4fb1-9974-b8129e3c643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:22.865823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e285f-fe8d-4fb1-9974-b8129e3c643a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:22.883100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156c99f-8ea7-4350-823b-a3a26527d73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:22.883851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156c99f-8ea7-4350-823b-a3a26527d73b service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:22.885555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156c99f-8ea7-4350-823b-a3a26527d73b service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:22.885849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156c99f-8ea7-4350-823b-a3a26527d73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:22.909919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156c99f-8ea7-4350-823b-a3a26527d73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:22.912708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156c99f-8ea7-4350-823b-a3a26527d73b service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:22.926941 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1508/2996] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:27.956555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5de10-77ea-4ce7-9a64-a13f39aaa097 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:27.957121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5de10-77ea-4ce7-9a64-a13f39aaa097 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:27.957283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5de10-77ea-4ce7-9a64-a13f39aaa097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:28.037082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bef5de10-77ea-4ce7-9a64-a13f39aaa097 None None] MFA Rules not processed for user `c9c74540f9b343618e9989940a802d41`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:28.038627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bef5de10-77ea-4ce7-9a64-a13f39aaa097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:28.185496 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1489/2997] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:28.191007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f74920-31ab-4ef3-b466-6f43d4c171e3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:28.192579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f74920-31ab-4ef3-b466-6f43d4c171e3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:28.194164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f74920-31ab-4ef3-b466-6f43d4c171e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:28.242778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-41f74920-31ab-4ef3-b466-6f43d4c171e3 None None] MFA Rules not processed for user `ab81208ae8f64a04bd49c018d7bf5c13`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:28.245411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-41f74920-31ab-4ef3-b466-6f43d4c171e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:28.351829 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1509/2998] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:29.756396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5de10-77ea-4ce7-9a64-a13f39aaa097 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:29.773637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5de10-77ea-4ce7-9a64-a13f39aaa097 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:29.788428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1388c3-82d9-4148-92c0-2bcb65b91b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:29.789492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1388c3-82d9-4148-92c0-2bcb65b91b69 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:29.789996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1388c3-82d9-4148-92c0-2bcb65b91b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:29.794970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1388c3-82d9-4148-92c0-2bcb65b91b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:29.801939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f1388c3-82d9-4148-92c0-2bcb65b91b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:29.847633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1388c3-82d9-4148-92c0-2bcb65b91b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:29.852297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1388c3-82d9-4148-92c0-2bcb65b91b69 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:29.873756 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1490/2999] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:30.238351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f74920-31ab-4ef3-b466-6f43d4c171e3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:30.259778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f74920-31ab-4ef3-b466-6f43d4c171e3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:30.274982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9885ad-59b7-4b9f-ac15-9a40ec13a9f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:30.277653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9885ad-59b7-4b9f-ac15-9a40ec13a9f0 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:30.280592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9885ad-59b7-4b9f-ac15-9a40ec13a9f0 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:30.281164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9885ad-59b7-4b9f-ac15-9a40ec13a9f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:30.295975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9885ad-59b7-4b9f-ac15-9a40ec13a9f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:30.298586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9885ad-59b7-4b9f-ac15-9a40ec13a9f0 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:30.329641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1510/3000] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:30 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:31.306845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1388c3-82d9-4148-92c0-2bcb65b91b69 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:31.328706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1388c3-82d9-4148-92c0-2bcb65b91b69 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:31.343458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec8a3-9017-4bc4-866c-3a2e2d189eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:31.349355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec8a3-9017-4bc4-866c-3a2e2d189eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:31.350960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec8a3-9017-4bc4-866c-3a2e2d189eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:31.351208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec8a3-9017-4bc4-866c-3a2e2d189eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:31.362824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a85ec8a3-9017-4bc4-866c-3a2e2d189eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:31.392871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec8a3-9017-4bc4-866c-3a2e2d189eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:31.395099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec8a3-9017-4bc4-866c-3a2e2d189eb5 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:31.423901 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1491/3001] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:38.849229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9885ad-59b7-4b9f-ac15-9a40ec13a9f0 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:38.866072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9885ad-59b7-4b9f-ac15-9a40ec13a9f0 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:38.882628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:38.883675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:38.884167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:38.884687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:38.890225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:38.916920 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:38.930077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:38.932541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:38.956432 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1511/3002] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:40.030294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec8a3-9017-4bc4-866c-3a2e2d189eb5 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:40.062498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec8a3-9017-4bc4-866c-3a2e2d189eb5 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:40.080394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05023dd1-4092-41fe-b6ea-6c438eda1452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:40.081272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05023dd1-4092-41fe-b6ea-6c438eda1452 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:40.081778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05023dd1-4092-41fe-b6ea-6c438eda1452 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:40.082262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05023dd1-4092-41fe-b6ea-6c438eda1452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:40.086811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-05023dd1-4092-41fe-b6ea-6c438eda1452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:40.127689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05023dd1-4092-41fe-b6ea-6c438eda1452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:40.130324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05023dd1-4092-41fe-b6ea-6c438eda1452 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:40.160599 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1492/3003] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:48.947850 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:50.147638 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=75 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:52.705864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:52.707320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:52.793486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35b2b1-7197-46fe-a480-b5ea0dd6a284 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:52.799118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:52.799770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:52.800046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:52.800459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] PATH_INFO: `/v3/users/7323365b46824abfacf50c9435816bbf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:52.801697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7323365b46824abfacf50c9435816bbf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:52.804218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:52.894734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7323365b46824abfacf50c9435816bbf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:52.913969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7323365b46824abfacf50c9435816bbf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:52.926608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7323365b46824abfacf50c9435816bbf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:52.939933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7323365b46824abfacf50c9435816bbf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:52.940899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7323365b46824abfacf50c9435816bbf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:52.949973 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1512/3004] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:54:52 2022] DELETE /identity/v3/users/7323365b46824abfacf50c9435816bbf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:54:53.592748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05023dd1-4092-41fe-b6ea-6c438eda1452 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:53.610938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05023dd1-4092-41fe-b6ea-6c438eda1452 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:53.707556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:53.709332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:53.709792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:53.710229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] PATH_INFO: `/v3/projects/8afb1bcb4dfd4a6c89c54312cb2e6377` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:53.711635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8afb1bcb4dfd4a6c89c54312cb2e6377)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:53.714718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:53.770898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'request_id': 'req-baf5f1cb-2679-4982-a80b-853bd5b36bc4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:53.780004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'request_id': 'req-baf5f1cb-2679-4982-a80b-853bd5b36bc4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:53.786338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'request_id': 'req-baf5f1cb-2679-4982-a80b-853bd5b36bc4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:53.799580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] The token cache is being invalidate because project 8afb1bcb4dfd4a6c89c54312cb2e6377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:54:53.799877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:53.800582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:53.803028 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1493/3005] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:54:53 2022] DELETE /identity/v3/projects/8afb1bcb4dfd4a6c89c54312cb2e6377 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:54:53.807252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:53.809831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:53.827232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397d70c-193e-48e7-8488-57ee4b5f75c0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:53.902626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:53.903197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:53.903481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:53.903757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] PATH_INFO: `/v3/users/0b496adf117b428690bf79ce25400371` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:53.905477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b496adf117b428690bf79ce25400371)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:53.908170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:53.939396 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:53.981376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b496adf117b428690bf79ce25400371'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:53.997338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b496adf117b428690bf79ce25400371'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:54.009406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b496adf117b428690bf79ce25400371'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:54.019046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b496adf117b428690bf79ce25400371'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:54.019914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-206a2c11-a313-4e90-9b2f-0bf1532a6077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b496adf117b428690bf79ce25400371'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:54.028671 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1513/3006] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:54:53 2022] DELETE /identity/v3/users/0b496adf117b428690bf79ce25400371 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:54:54.355978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:54.357525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:54.380164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5f1cb-2679-4982-a80b-853bd5b36bc4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:54.459781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:54.460610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:54.460993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:54.461531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] PATH_INFO: `/v3/projects/9fd8811380834e25984c59a5db32dafe` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:54.462702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd8811380834e25984c59a5db32dafe)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:54.465302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:54.509905 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:54.530148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd8811380834e25984c59a5db32dafe', 'request_id': 'req-c5f8a798-d56a-4f60-9f4f-721715c8c640'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:54.540007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd8811380834e25984c59a5db32dafe', 'request_id': 'req-c5f8a798-d56a-4f60-9f4f-721715c8c640'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:54.549580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd8811380834e25984c59a5db32dafe', 'request_id': 'req-c5f8a798-d56a-4f60-9f4f-721715c8c640'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:54.564651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] The token cache is being invalidate because project 9fd8811380834e25984c59a5db32dafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:54:54.565038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:54.565724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f8a798-d56a-4f60-9f4f-721715c8c640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:54:54.572199 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1494/3007] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:54:54 2022] DELETE /identity/v3/projects/9fd8811380834e25984c59a5db32dafe => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:54:54.574390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaea3b-6436-438c-ac36-b79fc95026c7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:54.574714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaea3b-6436-438c-ac36-b79fc95026c7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:54.575219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaaea3b-6436-438c-ac36-b79fc95026c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:54.597638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aeaaea3b-6436-438c-ac36-b79fc95026c7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:54.598996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aeaaea3b-6436-438c-ac36-b79fc95026c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:54.692067 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1514/3008] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:54.702571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de098227-19f9-4a96-bdbf-bf88fb369b66 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:54.703070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de098227-19f9-4a96-bdbf-bf88fb369b66 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:54.703148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de098227-19f9-4a96-bdbf-bf88fb369b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:54.726943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-de098227-19f9-4a96-bdbf-bf88fb369b66 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:54.729082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-de098227-19f9-4a96-bdbf-bf88fb369b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:54.741031 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1495/3009] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:54.742599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaaea3b-6436-438c-ac36-b79fc95026c7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:54.756469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaaea3b-6436-438c-ac36-b79fc95026c7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:54.762633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c437d-1e1d-4790-a884-a735e266d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:54.764141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c437d-1e1d-4790-a884-a735e266d378 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:54.764421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c437d-1e1d-4790-a884-a735e266d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:54.764731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c437d-1e1d-4790-a884-a735e266d378 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:54.765637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c437d-1e1d-4790-a884-a735e266d378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:54:54.766575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c437d-1e1d-4790-a884-a735e266d378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:54.768262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c437d-1e1d-4790-a884-a735e266d378 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:54.790827 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1515/3010] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:54:54.791920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de098227-19f9-4a96-bdbf-bf88fb369b66 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:54.803510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de098227-19f9-4a96-bdbf-bf88fb369b66 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:54.809812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee54f2-ed47-4f99-a45b-21b58ae5a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:54.810437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee54f2-ed47-4f99-a45b-21b58ae5a0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:54.810718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee54f2-ed47-4f99-a45b-21b58ae5a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:54.810995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee54f2-ed47-4f99-a45b-21b58ae5a0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:54.811644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee54f2-ed47-4f99-a45b-21b58ae5a0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:54.813709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee54f2-ed47-4f99-a45b-21b58ae5a0f0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:54.845722 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1496/3011] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:54:54 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:54:54.849964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c437d-1e1d-4790-a884-a735e266d378 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:54.862818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c437d-1e1d-4790-a884-a735e266d378 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:54.943757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddf650-8efd-4f68-a90f-87cee3be37b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:54.944390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddf650-8efd-4f68-a90f-87cee3be37b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:54.947649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddf650-8efd-4f68-a90f-87cee3be37b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:54.948083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddf650-8efd-4f68-a90f-87cee3be37b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:54.949004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddf650-8efd-4f68-a90f-87cee3be37b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:54.951095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddf650-8efd-4f68-a90f-87cee3be37b8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:54.981716 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1516/3012] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:54:54 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:54:54.985835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee54f2-ed47-4f99-a45b-21b58ae5a0f0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:55.000107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee54f2-ed47-4f99-a45b-21b58ae5a0f0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:55.004996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956488-5cd4-4b11-b39c-ae1d6ab89ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:55.005635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956488-5cd4-4b11-b39c-ae1d6ab89ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:55.005908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956488-5cd4-4b11-b39c-ae1d6ab89ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:55.006177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956488-5cd4-4b11-b39c-ae1d6ab89ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:55.006821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c956488-5cd4-4b11-b39c-ae1d6ab89ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:55.008432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c956488-5cd4-4b11-b39c-ae1d6ab89ee7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:55.019704 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1497/3013] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:54:55.023789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddf650-8efd-4f68-a90f-87cee3be37b8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:55.034932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddf650-8efd-4f68-a90f-87cee3be37b8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:55.039795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a90fb9-a2ae-464a-9e46-a31c39d4fe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:55.040402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a90fb9-a2ae-464a-9e46-a31c39d4fe19 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:55.040784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a90fb9-a2ae-464a-9e46-a31c39d4fe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:55.041099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a90fb9-a2ae-464a-9e46-a31c39d4fe19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:55.041834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a90fb9-a2ae-464a-9e46-a31c39d4fe19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:55.043599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a90fb9-a2ae-464a-9e46-a31c39d4fe19 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:55.057664 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1517/3014] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:54:55.063770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956488-5cd4-4b11-b39c-ae1d6ab89ee7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:55.077897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956488-5cd4-4b11-b39c-ae1d6ab89ee7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:55.083272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82b64-2c83-4ce5-b556-e2ae106266c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:55.089670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82b64-2c83-4ce5-b556-e2ae106266c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:55.089959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82b64-2c83-4ce5-b556-e2ae106266c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:55.090241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82b64-2c83-4ce5-b556-e2ae106266c7 admin admin] PATH_INFO: `/v3/projects/b89687ea02364fd18d14ea3d813d663e/users/fb88a7f8e2db4789be47f010250c22f0/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:55.111019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b82b64-2c83-4ce5-b556-e2ae106266c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89687ea02364fd18d14ea3d813d663e, user_id=fb88a7f8e2db4789be47f010250c22f0, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:55.114689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b82b64-2c83-4ce5-b556-e2ae106266c7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:55.136103 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1498/3015] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:54:55 2022] PUT /identity/v3/projects/b89687ea02364fd18d14ea3d813d663e/users/fb88a7f8e2db4789be47f010250c22f0/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:54:55.142854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3559c-1fd3-434e-aa93-9672267f3d68 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:55.143140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3559c-1fd3-434e-aa93-9672267f3d68 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:55.143413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3559c-1fd3-434e-aa93-9672267f3d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:55.152022 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:55.165319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-03e3559c-1fd3-434e-aa93-9672267f3d68 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:54:55.167710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-03e3559c-1fd3-434e-aa93-9672267f3d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:55.283779 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1518/3016] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:54:55.313505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82b64-2c83-4ce5-b556-e2ae106266c7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:55.316531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-80b82b64-2c83-4ce5-b556-e2ae106266c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:55.393098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82b64-2c83-4ce5-b556-e2ae106266c7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:55.398042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18657aef-4054-49cc-9ecd-c222a1c78ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:55.398500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657aef-4054-49cc-9ecd-c222a1c78ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:55.398781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657aef-4054-49cc-9ecd-c222a1c78ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:55.399054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657aef-4054-49cc-9ecd-c222a1c78ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:55.412985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18657aef-4054-49cc-9ecd-c222a1c78ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:55.414892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18657aef-4054-49cc-9ecd-c222a1c78ea0 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:55.428211 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1499/3017] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:54:56.654308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3559c-1fd3-434e-aa93-9672267f3d68 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:54:56.655467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-03e3559c-1fd3-434e-aa93-9672267f3d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:56.769255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3559c-1fd3-434e-aa93-9672267f3d68 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:54:56.775913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f73e4b-3ad2-476b-8e23-f262b2093294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:54:56.776592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f73e4b-3ad2-476b-8e23-f262b2093294 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:54:56.776907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f73e4b-3ad2-476b-8e23-f262b2093294 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:54:56.777181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f73e4b-3ad2-476b-8e23-f262b2093294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:54:56.779779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e7f73e4b-3ad2-476b-8e23-f262b2093294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:54:56.891838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f73e4b-3ad2-476b-8e23-f262b2093294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:54:56.893844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f73e4b-3ad2-476b-8e23-f262b2093294 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:54:56.915272 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1519/3018] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:54:56 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:05.423096 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:05.777467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f9ec-a5af-4973-b3b4-20085385690c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:05.777764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f9ec-a5af-4973-b3b4-20085385690c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:05.778050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f9ec-a5af-4973-b3b4-20085385690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:05.870417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c0f8f9ec-a5af-4973-b3b4-20085385690c None None] MFA Rules not processed for user `fb88a7f8e2db4789be47f010250c22f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:05.871711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c0f8f9ec-a5af-4973-b3b4-20085385690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:06.045130 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1500/3019] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:06.059606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f73e4b-3ad2-476b-8e23-f262b2093294 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:06.082920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f73e4b-3ad2-476b-8e23-f262b2093294 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:06.097704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48c750-c8bc-4836-ba65-1e4e177fbee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:06.098628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48c750-c8bc-4836-ba65-1e4e177fbee2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:06.099059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48c750-c8bc-4836-ba65-1e4e177fbee2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:06.099491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48c750-c8bc-4836-ba65-1e4e177fbee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:06.127857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48c750-c8bc-4836-ba65-1e4e177fbee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:06.129738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48c750-c8bc-4836-ba65-1e4e177fbee2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:06.159034 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1520/3020] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:09.499118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f9ec-a5af-4973-b3b4-20085385690c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:09.500849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c0f8f9ec-a5af-4973-b3b4-20085385690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:09.517950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f9ec-a5af-4973-b3b4-20085385690c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:09.524396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:09.526194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:09.526755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:09.527925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] PATH_INFO: `/v3/users/02e52a53aba2448096ac85fcfaa598a1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:09.534761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e52a53aba2448096ac85fcfaa598a1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:09.538168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:09.668600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e52a53aba2448096ac85fcfaa598a1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:09.702217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e52a53aba2448096ac85fcfaa598a1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:09.720546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e52a53aba2448096ac85fcfaa598a1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:09.736446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e52a53aba2448096ac85fcfaa598a1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:09.737243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e52a53aba2448096ac85fcfaa598a1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:09.752516 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1501/3021] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:09 2022] DELETE /identity/v3/users/02e52a53aba2448096ac85fcfaa598a1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:09.757204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b455a-818d-486a-9abf-edbca2375991 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:09.759325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b455a-818d-486a-9abf-edbca2375991 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:09.760420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b455a-818d-486a-9abf-edbca2375991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:09.807700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-790b455a-818d-486a-9abf-edbca2375991 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:09.811817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-790b455a-818d-486a-9abf-edbca2375991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:09.886281 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:09.983067 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1521/3022] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:10.015142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:10.019520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:10.227724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb7485-0f8a-4564-a2b9-108f0a5d021b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:10.238404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb49b-7d99-454d-a0c9-971cec296730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:10.239049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb49b-7d99-454d-a0c9-971cec296730 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:10.239332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb49b-7d99-454d-a0c9-971cec296730 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:10.239610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb49b-7d99-454d-a0c9-971cec296730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:10.261965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb49b-7d99-454d-a0c9-971cec296730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:10.269589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb49b-7d99-454d-a0c9-971cec296730 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:10.303159 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1502/3023] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:11.387963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b455a-818d-486a-9abf-edbca2375991 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:11.389533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-790b455a-818d-486a-9abf-edbca2375991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:11.411689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b455a-818d-486a-9abf-edbca2375991 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:11.432289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:11.433007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:11.433292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:11.437132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] PATH_INFO: `/v3/projects/5685c970486040e2bc073d3bc1a5e577` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:11.440293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5685c970486040e2bc073d3bc1a5e577)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:11.446438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:11.584610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5685c970486040e2bc073d3bc1a5e577', 'request_id': 'req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:11.598903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5685c970486040e2bc073d3bc1a5e577', 'request_id': 'req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:11.618849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5685c970486040e2bc073d3bc1a5e577', 'request_id': 'req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:11.662567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] The token cache is being invalidate because project 5685c970486040e2bc073d3bc1a5e577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:11.663678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:11.665868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:11.669497 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1522/3024] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:11 2022] DELETE /identity/v3/projects/5685c970486040e2bc073d3bc1a5e577 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:11.674271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb49b-7d99-454d-a0c9-971cec296730 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:11.682096 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:11.693389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb49b-7d99-454d-a0c9-971cec296730 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:11.935100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:11.937328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:11.938789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:11.950449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] PATH_INFO: `/v3/users/43ad1b75defc4e15bdbd02e7983f449d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:11.960397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ad1b75defc4e15bdbd02e7983f449d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:11.963011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:12.054296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ad1b75defc4e15bdbd02e7983f449d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:12.071316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ad1b75defc4e15bdbd02e7983f449d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:12.086062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ad1b75defc4e15bdbd02e7983f449d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:12.096704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ad1b75defc4e15bdbd02e7983f449d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:12.097910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f72b25-08fa-489e-aa4f-19d8ed600e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ad1b75defc4e15bdbd02e7983f449d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:12.106646 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1503/3025] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:11 2022] DELETE /identity/v3/users/43ad1b75defc4e15bdbd02e7983f449d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:12.879706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:12.882967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:12.923477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9adaf9-588a-44c5-b518-9fc952b1b5e0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:13.137868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:13.138712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:13.139143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:13.139567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] PATH_INFO: `/v3/projects/de53ed8b72264939a73db1e03615aeed` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:13.143648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de53ed8b72264939a73db1e03615aeed)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:13.145874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:13.289953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de53ed8b72264939a73db1e03615aeed', 'request_id': 'req-cf6fd7d6-ef92-42c4-a960-4338bad69c84'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.303791 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:13.313670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de53ed8b72264939a73db1e03615aeed', 'request_id': 'req-cf6fd7d6-ef92-42c4-a960-4338bad69c84'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.322920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de53ed8b72264939a73db1e03615aeed', 'request_id': 'req-cf6fd7d6-ef92-42c4-a960-4338bad69c84'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.351466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] The token cache is being invalidate because project de53ed8b72264939a73db1e03615aeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:13.352002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.353636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf6fd7d6-ef92-42c4-a960-4338bad69c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.360979 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1523/3026] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:12 2022] DELETE /identity/v3/projects/de53ed8b72264939a73db1e03615aeed => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:13.361956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036e2bb-0f77-4dd2-aaa7-f7d6a1d44fc1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:13.362407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036e2bb-0f77-4dd2-aaa7-f7d6a1d44fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:13.363188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036e2bb-0f77-4dd2-aaa7-f7d6a1d44fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:13.413459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9036e2bb-0f77-4dd2-aaa7-f7d6a1d44fc1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:13.414879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9036e2bb-0f77-4dd2-aaa7-f7d6a1d44fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:13.583125 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1504/3027] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:13.592991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e85ac-1f6a-4867-a221-e41b073f05bd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:13.593579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e85ac-1f6a-4867-a221-e41b073f05bd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:13.594615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e85ac-1f6a-4867-a221-e41b073f05bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:13.654000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036e2bb-0f77-4dd2-aaa7-f7d6a1d44fc1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:13.670361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9036e2bb-0f77-4dd2-aaa7-f7d6a1d44fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:13.671335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bc7e85ac-1f6a-4867-a221-e41b073f05bd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:13.686525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc7e85ac-1f6a-4867-a221-e41b073f05bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:13.706221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036e2bb-0f77-4dd2-aaa7-f7d6a1d44fc1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:13.713594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:13.714383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:13.714713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:13.715102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] PATH_INFO: `/v3/users/4eaebe4f02ee4634b92407e4e066beab` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:13.716547 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1524/3028] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:13.717404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eaebe4f02ee4634b92407e4e066beab)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:13.717525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e85ac-1f6a-4867-a221-e41b073f05bd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:13.720115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:13.748812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e85ac-1f6a-4867-a221-e41b073f05bd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:13.761526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90221fe8-1b67-4653-b23f-328de5436d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:13.762164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90221fe8-1b67-4653-b23f-328de5436d24 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:13.762970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90221fe8-1b67-4653-b23f-328de5436d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:13.763131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90221fe8-1b67-4653-b23f-328de5436d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:13.763794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90221fe8-1b67-4653-b23f-328de5436d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:55:13.764103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90221fe8-1b67-4653-b23f-328de5436d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:13.769613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90221fe8-1b67-4653-b23f-328de5436d24 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:13.783588 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:13.799230 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1525/3029] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:55:13.800668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90221fe8-1b67-4653-b23f-328de5436d24 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:13.828931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90221fe8-1b67-4653-b23f-328de5436d24 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:13.844317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a63d-5e8b-431a-ac5f-9478f03b61a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:13.845439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a63d-5e8b-431a-ac5f-9478f03b61a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:13.845720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a63d-5e8b-431a-ac5f-9478f03b61a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:13.846000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a63d-5e8b-431a-ac5f-9478f03b61a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:13.846121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eaebe4f02ee4634b92407e4e066beab'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.846650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3a63d-5e8b-431a-ac5f-9478f03b61a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:13.852056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3a63d-5e8b-431a-ac5f-9478f03b61a8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:13.876679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eaebe4f02ee4634b92407e4e066beab'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.903005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eaebe4f02ee4634b92407e4e066beab'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.911630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eaebe4f02ee4634b92407e4e066beab'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.912277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eaebe4f02ee4634b92407e4e066beab'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:13.917234 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1526/3030] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:55:13 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:13.919168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a63d-5e8b-431a-ac5f-9478f03b61a8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:13.924508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-faa3a63d-5e8b-431a-ac5f-9478f03b61a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:13.929530 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1505/3031] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:13 2022] DELETE /identity/v3/users/4eaebe4f02ee4634b92407e4e066beab => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:14.084502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a63d-5e8b-431a-ac5f-9478f03b61a8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:14.217785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fea7a8-f2d3-47ae-8110-8adfc6b61ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:14.218853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fea7a8-f2d3-47ae-8110-8adfc6b61ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:14.219361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fea7a8-f2d3-47ae-8110-8adfc6b61ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:14.220112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fea7a8-f2d3-47ae-8110-8adfc6b61ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:14.221540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fea7a8-f2d3-47ae-8110-8adfc6b61ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:14.223817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fea7a8-f2d3-47ae-8110-8adfc6b61ae0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:14.267381 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1527/3032] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:55:13 2022] POST /identity/v3/users => generated 290 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:14.271251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:14.282219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2c40e-5f01-481d-b747-3331afb84703 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:14.298803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247cd29-84f4-4277-8493-d02d943e2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:14.299814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247cd29-84f4-4277-8493-d02d943e2c4c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:14.300338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247cd29-84f4-4277-8493-d02d943e2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:14.300859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247cd29-84f4-4277-8493-d02d943e2c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:14.301748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247cd29-84f4-4277-8493-d02d943e2c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:14.304442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247cd29-84f4-4277-8493-d02d943e2c4c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:14.330124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fea7a8-f2d3-47ae-8110-8adfc6b61ae0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:14.330792 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1506/3033] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:14.349329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fea7a8-f2d3-47ae-8110-8adfc6b61ae0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:14.363720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29195959-e4ea-4e9b-af02-cede4a5dba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:14.365256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29195959-e4ea-4e9b-af02-cede4a5dba3b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:14.365580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29195959-e4ea-4e9b-af02-cede4a5dba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:14.369304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29195959-e4ea-4e9b-af02-cede4a5dba3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:14.370085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29195959-e4ea-4e9b-af02-cede4a5dba3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:14.374199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29195959-e4ea-4e9b-af02-cede4a5dba3b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:14.405664 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1528/3034] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:55:14.410569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247cd29-84f4-4277-8493-d02d943e2c4c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:14.427918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247cd29-84f4-4277-8493-d02d943e2c4c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:14.451694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8379f-0226-415f-b355-56714d831027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:14.452968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8379f-0226-415f-b355-56714d831027 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:14.453477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8379f-0226-415f-b355-56714d831027 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:14.454015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8379f-0226-415f-b355-56714d831027 admin admin] PATH_INFO: `/v3/projects/c9918f1aecd448a5b236066379ad0efa/users/386a33909e8a4633863c237f69e857f3/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:14.483693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8379f-0226-415f-b355-56714d831027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9918f1aecd448a5b236066379ad0efa, user_id=386a33909e8a4633863c237f69e857f3, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:14.492960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8379f-0226-415f-b355-56714d831027 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:14.521634 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1507/3035] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:55:14 2022] PUT /identity/v3/projects/c9918f1aecd448a5b236066379ad0efa/users/386a33909e8a4633863c237f69e857f3/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:14.532544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff037-6382-42af-b172-375f13b2dbec None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:14.533229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff037-6382-42af-b172-375f13b2dbec None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:14.533744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff037-6382-42af-b172-375f13b2dbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:14.621054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-814ff037-6382-42af-b172-375f13b2dbec None None] MFA Rules not processed for user `386a33909e8a4633863c237f69e857f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:14.625355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-814ff037-6382-42af-b172-375f13b2dbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:14.685653 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:14.945873 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1529/3036] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:55:14.959967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8379f-0226-415f-b355-56714d831027 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:14.962514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-95a8379f-0226-415f-b355-56714d831027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:15.182931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8379f-0226-415f-b355-56714d831027 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:15.205681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433be5a7-eb47-48dc-9696-a1fdc614912c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:15.206482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433be5a7-eb47-48dc-9696-a1fdc614912c service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:15.210091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433be5a7-eb47-48dc-9696-a1fdc614912c service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:15.211512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433be5a7-eb47-48dc-9696-a1fdc614912c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:15.248711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433be5a7-eb47-48dc-9696-a1fdc614912c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:15.251114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433be5a7-eb47-48dc-9696-a1fdc614912c service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:15.299469 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1508/3037] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:15.384005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff037-6382-42af-b172-375f13b2dbec None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:15.385789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-814ff037-6382-42af-b172-375f13b2dbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:15.588601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff037-6382-42af-b172-375f13b2dbec None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:15.595128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:15.595803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:15.596404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:15.596404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] PATH_INFO: `/v3/projects/9868d1ede07c453e9a0cb24d0fcdd4df` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:15.597571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9868d1ede07c453e9a0cb24d0fcdd4df)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:15.599513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:15.707221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9868d1ede07c453e9a0cb24d0fcdd4df', 'request_id': 'req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:15.708532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aac72-c76a-4db7-95b0-96ea45571f99 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:15.709035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aac72-c76a-4db7-95b0-96ea45571f99 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:15.709135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aac72-c76a-4db7-95b0-96ea45571f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:15.725907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9868d1ede07c453e9a0cb24d0fcdd4df', 'request_id': 'req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:15.754691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9868d1ede07c453e9a0cb24d0fcdd4df', 'request_id': 'req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:15.794738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] The token cache is being invalidate because project 9868d1ede07c453e9a0cb24d0fcdd4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:15.795411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:15.796986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a0ce207-c5cf-4567-a9a1-ae59cd1dbc86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:15.802012 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1530/3038] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:15 2022] DELETE /identity/v3/projects/9868d1ede07c453e9a0cb24d0fcdd4df => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:15.805963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aae7c9-6807-469d-97d8-d5548d675653 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:15.807420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aae7c9-6807-469d-97d8-d5548d675653 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:15.808055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aae7c9-6807-469d-97d8-d5548d675653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:15.873684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-31aae7c9-6807-469d-97d8-d5548d675653 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:15.887017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-31aae7c9-6807-469d-97d8-d5548d675653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:15.893860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1e5aac72-c76a-4db7-95b0-96ea45571f99 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:15.895219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e5aac72-c76a-4db7-95b0-96ea45571f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:15.916679 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:16.039260 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:16.104390 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1531/3039] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:16.111601 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1509/3040] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:55:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:55:16.115839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5538-3309-4bcb-a63d-4fcce6cc8d64 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:16.116244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5538-3309-4bcb-a63d-4fcce6cc8d64 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:16.116614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5538-3309-4bcb-a63d-4fcce6cc8d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:16.185374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5aac72-c76a-4db7-95b0-96ea45571f99 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:16.187787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e5aac72-c76a-4db7-95b0-96ea45571f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:16.189165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c73c5538-3309-4bcb-a63d-4fcce6cc8d64 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:16.194237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c73c5538-3309-4bcb-a63d-4fcce6cc8d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:16.238679 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1532/3041] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:16.240354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5538-3309-4bcb-a63d-4fcce6cc8d64 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:16.258783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5538-3309-4bcb-a63d-4fcce6cc8d64 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:16.275336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd62924-9b7f-4f7a-ac5c-91f32d1ec9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:16.276509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd62924-9b7f-4f7a-ac5c-91f32d1ec9ff admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:16.276988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd62924-9b7f-4f7a-ac5c-91f32d1ec9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:16.277421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd62924-9b7f-4f7a-ac5c-91f32d1ec9ff admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:16.278226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd62924-9b7f-4f7a-ac5c-91f32d1ec9ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:55:16.278676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd62924-9b7f-4f7a-ac5c-91f32d1ec9ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:16.280490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd62924-9b7f-4f7a-ac5c-91f32d1ec9ff admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:16.299838 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1533/3042] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:55:16.304611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd62924-9b7f-4f7a-ac5c-91f32d1ec9ff admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:16.325671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd62924-9b7f-4f7a-ac5c-91f32d1ec9ff admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:16.340951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e7c58-564d-4356-919d-6017544f170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:16.341796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e7c58-564d-4356-919d-6017544f170a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:16.342214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e7c58-564d-4356-919d-6017544f170a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:16.342806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e7c58-564d-4356-919d-6017544f170a admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:16.343672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e7c58-564d-4356-919d-6017544f170a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:16.346199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e7c58-564d-4356-919d-6017544f170a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:16.431731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5aac72-c76a-4db7-95b0-96ea45571f99 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:16.455378 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1534/3043] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:55:16 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:16.456514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e7c58-564d-4356-919d-6017544f170a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:16.639217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3a934-4dcc-473c-a3dd-e3a7b0d617db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:16.639851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3a934-4dcc-473c-a3dd-e3a7b0d617db service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:16.640136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3a934-4dcc-473c-a3dd-e3a7b0d617db service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:16.640837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3a934-4dcc-473c-a3dd-e3a7b0d617db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:16.688478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e7c58-564d-4356-919d-6017544f170a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:16.700913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc61e5-3e11-4e44-b59a-3fe9a492d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:16.702702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc61e5-3e11-4e44-b59a-3fe9a492d6ec admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:16.702702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc61e5-3e11-4e44-b59a-3fe9a492d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:16.703065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc61e5-3e11-4e44-b59a-3fe9a492d6ec admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:16.703532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc61e5-3e11-4e44-b59a-3fe9a492d6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:16.705676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc61e5-3e11-4e44-b59a-3fe9a492d6ec admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:16.757243 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:16.767470 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1535/3044] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:55:16 2022] POST /identity/v3/users => generated 282 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:16.774563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc61e5-3e11-4e44-b59a-3fe9a492d6ec admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:16.801578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc61e5-3e11-4e44-b59a-3fe9a492d6ec admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:16.807758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69d5cf-93ac-4cfd-b6a0-0fb7323248ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:16.808391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69d5cf-93ac-4cfd-b6a0-0fb7323248ff admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:16.808697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69d5cf-93ac-4cfd-b6a0-0fb7323248ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:16.808974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69d5cf-93ac-4cfd-b6a0-0fb7323248ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:16.809629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69d5cf-93ac-4cfd-b6a0-0fb7323248ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:16.811255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69d5cf-93ac-4cfd-b6a0-0fb7323248ff admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:16.836313 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1536/3045] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:16.839184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69d5cf-93ac-4cfd-b6a0-0fb7323248ff admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:16.847324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3a934-4dcc-473c-a3dd-e3a7b0d617db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:16.851284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3a934-4dcc-473c-a3dd-e3a7b0d617db service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:16.861929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69d5cf-93ac-4cfd-b6a0-0fb7323248ff admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:16.875729 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1510/3046] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:55:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:55:16.876512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8346d41-4d4a-4ff1-b775-a7ed77c57445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:16.890384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8346d41-4d4a-4ff1-b775-a7ed77c57445 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:16.890745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8346d41-4d4a-4ff1-b775-a7ed77c57445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:16.894786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8346d41-4d4a-4ff1-b775-a7ed77c57445 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:16.897669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8346d41-4d4a-4ff1-b775-a7ed77c57445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:16.904709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8346d41-4d4a-4ff1-b775-a7ed77c57445 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:16.956831 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1537/3047] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:16.958890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3a934-4dcc-473c-a3dd-e3a7b0d617db service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:16.985394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3a934-4dcc-473c-a3dd-e3a7b0d617db service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:17.012927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15a32b-afd5-4c42-9a6a-fca33fda7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:17.014497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a32b-afd5-4c42-9a6a-fca33fda7d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:17.017853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a32b-afd5-4c42-9a6a-fca33fda7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:17.019532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a32b-afd5-4c42-9a6a-fca33fda7d84 admin admin] PATH_INFO: `/v3/projects/4dd9caff7d2f4782934111951d0c42fb/users/c9ac716a6af441a4bc02d8ef11f81487/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:17.080076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15a32b-afd5-4c42-9a6a-fca33fda7d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd9caff7d2f4782934111951d0c42fb, user_id=c9ac716a6af441a4bc02d8ef11f81487, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:17.083063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15a32b-afd5-4c42-9a6a-fca33fda7d84 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:17.127522 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1511/3048] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:55:16 2022] PUT /identity/v3/projects/4dd9caff7d2f4782934111951d0c42fb/users/c9ac716a6af441a4bc02d8ef11f81487/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:17.128050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1bc52-1884-4510-8da5-78459c7ab286 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:17.128933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1bc52-1884-4510-8da5-78459c7ab286 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:17.129381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1bc52-1884-4510-8da5-78459c7ab286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:17.132676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b0727-8605-4c4c-8043-86990a2c033e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:17.133149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b0727-8605-4c4c-8043-86990a2c033e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:17.133576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b0727-8605-4c4c-8043-86990a2c033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:17.175231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f83b0727-8605-4c4c-8043-86990a2c033e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:17.176509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f83b0727-8605-4c4c-8043-86990a2c033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:17.184897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aaa1bc52-1884-4510-8da5-78459c7ab286 None None] MFA Rules not processed for user `386a33909e8a4633863c237f69e857f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:17.187792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aaa1bc52-1884-4510-8da5-78459c7ab286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:17.361500 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1512/3049] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:55:17.361619 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1538/3050] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:17.403298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b0727-8605-4c4c-8043-86990a2c033e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:17.405154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f83b0727-8605-4c4c-8043-86990a2c033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:17.584232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b0727-8605-4c4c-8043-86990a2c033e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:17.595159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551e54-1dfb-4cd8-a640-566ea18822fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:17.595812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551e54-1dfb-4cd8-a640-566ea18822fc service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:17.596092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551e54-1dfb-4cd8-a640-566ea18822fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:17.596371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551e54-1dfb-4cd8-a640-566ea18822fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:17.647875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551e54-1dfb-4cd8-a640-566ea18822fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:17.655002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551e54-1dfb-4cd8-a640-566ea18822fc service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:17.678149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1513/3051] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:17.809047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d09a4b-898a-40b4-abbb-3cd6cf8f75c5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:17.809391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d09a4b-898a-40b4-abbb-3cd6cf8f75c5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:17.809605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d09a4b-898a-40b4-abbb-3cd6cf8f75c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:17.847878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-31d09a4b-898a-40b4-abbb-3cd6cf8f75c5 None None] MFA Rules not processed for user `ea919891e28b42fd9c7ea98cbf2362a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:17.855636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-31d09a4b-898a-40b4-abbb-3cd6cf8f75c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:17.905926 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:18.035360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1539/3052] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:18.671148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fa84f-bb92-49ff-a948-e6d421ea5eb8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:18.672012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fa84f-bb92-49ff-a948-e6d421ea5eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:18.672012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fa84f-bb92-49ff-a948-e6d421ea5eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:18.735384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a89fa84f-bb92-49ff-a948-e6d421ea5eb8 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:18.739640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a89fa84f-bb92-49ff-a948-e6d421ea5eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:18.884190 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:18.897332 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1514/3053] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 00:55:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:18.912553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d09a4b-898a-40b4-abbb-3cd6cf8f75c5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:19.090435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d09a4b-898a-40b4-abbb-3cd6cf8f75c5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:19.106636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559a21a-1ced-4b1e-a129-445eaa370ac1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:19.107559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a21a-1ced-4b1e-a129-445eaa370ac1 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:19.107995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a21a-1ced-4b1e-a129-445eaa370ac1 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:19.108416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a21a-1ced-4b1e-a129-445eaa370ac1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:19.130141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559a21a-1ced-4b1e-a129-445eaa370ac1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:19.131956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559a21a-1ced-4b1e-a129-445eaa370ac1 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:19.152112 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1540/3054] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:55:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:19.342272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fa84f-bb92-49ff-a948-e6d421ea5eb8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:19.345009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a89fa84f-bb92-49ff-a948-e6d421ea5eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:19.380284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fa84f-bb92-49ff-a948-e6d421ea5eb8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:19.403219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:19.404426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:19.405009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:19.405458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] PATH_INFO: `/v3/users/386a33909e8a4633863c237f69e857f3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:19.408470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=386a33909e8a4633863c237f69e857f3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:19.416828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:19.526303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386a33909e8a4633863c237f69e857f3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:19.549805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386a33909e8a4633863c237f69e857f3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:19.568473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386a33909e8a4633863c237f69e857f3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:19.580272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386a33909e8a4633863c237f69e857f3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:19.581455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386a33909e8a4633863c237f69e857f3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:19.588916 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1515/3055] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:19 2022] DELETE /identity/v3/users/386a33909e8a4633863c237f69e857f3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:19.593233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf4ec-3f2b-4a26-bad7-a2f525667bc0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:19.594711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf4ec-3f2b-4a26-bad7-a2f525667bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:19.595317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf4ec-3f2b-4a26-bad7-a2f525667bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:19.622353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f1fbf4ec-3f2b-4a26-bad7-a2f525667bc0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:19.624104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1fbf4ec-3f2b-4a26-bad7-a2f525667bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:19.738884 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1541/3056] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:19.769542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:19.771814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbf4ec-3f2b-4a26-bad7-a2f525667bc0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:19.772004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:19.773559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1fbf4ec-3f2b-4a26-bad7-a2f525667bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:19.798584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f88b-e9af-4a8d-8c4f-4d7411652c41 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:19.849557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:19.857577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:19.859911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:19.862257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] PATH_INFO: `/v3/users/2542aef0e4464018bf9d4563ffe9030d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:19.868142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2542aef0e4464018bf9d4563ffe9030d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:19.876514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:19.943466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbf4ec-3f2b-4a26-bad7-a2f525667bc0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:19.959425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d65e4-0b96-4d8d-99cb-75cd113ba689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:19.960290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d65e4-0b96-4d8d-99cb-75cd113ba689 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:19.961493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d65e4-0b96-4d8d-99cb-75cd113ba689 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:19.964183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d65e4-0b96-4d8d-99cb-75cd113ba689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:19.985333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2542aef0e4464018bf9d4563ffe9030d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:19.992853 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:20.001556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d65e4-0b96-4d8d-99cb-75cd113ba689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:20.003028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d65e4-0b96-4d8d-99cb-75cd113ba689 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:20.018054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2542aef0e4464018bf9d4563ffe9030d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:20.030698 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1542/3057] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:55:20.050496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2542aef0e4464018bf9d4563ffe9030d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:20.065680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2542aef0e4464018bf9d4563ffe9030d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:20.066368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2542aef0e4464018bf9d4563ffe9030d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:20.074526 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1516/3058] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:19 2022] DELETE /identity/v3/users/2542aef0e4464018bf9d4563ffe9030d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:21.726997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d65e4-0b96-4d8d-99cb-75cd113ba689 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:21.741269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d65e4-0b96-4d8d-99cb-75cd113ba689 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:21.801979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:21.803319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:21.957227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:21.959654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:21.962109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:21.964107 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:21.964240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] PATH_INFO: `/v3/projects/3642cd3632604ea8aa75cf14c9fef293` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.001796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3642cd3632604ea8aa75cf14c9fef293)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:22.008224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:22.052175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094475c-7137-4a14-af76-5042e4f6133c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:22.070344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:22.071103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.071481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.071885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] PATH_INFO: `/v3/projects/c9918f1aecd448a5b236066379ad0efa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.073230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9918f1aecd448a5b236066379ad0efa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:22.075648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:22.156275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3642cd3632604ea8aa75cf14c9fef293', 'request_id': 'req-dadca803-38c6-49fe-a06a-7732e6696e6c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.166391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3642cd3632604ea8aa75cf14c9fef293', 'request_id': 'req-dadca803-38c6-49fe-a06a-7732e6696e6c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.176106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3642cd3632604ea8aa75cf14c9fef293', 'request_id': 'req-dadca803-38c6-49fe-a06a-7732e6696e6c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.186856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9918f1aecd448a5b236066379ad0efa', 'request_id': 'req-46fd72de-4d15-46bb-9885-81c3079ea12c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.200926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9918f1aecd448a5b236066379ad0efa', 'request_id': 'req-46fd72de-4d15-46bb-9885-81c3079ea12c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.205360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] The token cache is being invalidate because project 3642cd3632604ea8aa75cf14c9fef293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:22.205654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.206991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dadca803-38c6-49fe-a06a-7732e6696e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.212707 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1543/3059] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:21 2022] DELETE /identity/v3/projects/3642cd3632604ea8aa75cf14c9fef293 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:22.218520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9918f1aecd448a5b236066379ad0efa', 'request_id': 'req-46fd72de-4d15-46bb-9885-81c3079ea12c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.219493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746304e-b6c5-4a95-99bb-ca308d535943 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.221001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746304e-b6c5-4a95-99bb-ca308d535943 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.221463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746304e-b6c5-4a95-99bb-ca308d535943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.245262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0746304e-b6c5-4a95-99bb-ca308d535943 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:22.246582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0746304e-b6c5-4a95-99bb-ca308d535943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:22.255586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] The token cache is being invalidate because project c9918f1aecd448a5b236066379ad0efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:22.256915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.260418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fd72de-4d15-46bb-9885-81c3079ea12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.274838 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1517/3060] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:21 2022] DELETE /identity/v3/projects/c9918f1aecd448a5b236066379ad0efa => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:22.280275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788268c-31e8-4edd-bc50-6322fa944007 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.280745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788268c-31e8-4edd-bc50-6322fa944007 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.281132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788268c-31e8-4edd-bc50-6322fa944007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.335354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2788268c-31e8-4edd-bc50-6322fa944007 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:22.345328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2788268c-31e8-4edd-bc50-6322fa944007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:22.380810 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1544/3061] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:22.381829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746304e-b6c5-4a95-99bb-ca308d535943 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:22.383240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0746304e-b6c5-4a95-99bb-ca308d535943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:22.405664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746304e-b6c5-4a95-99bb-ca308d535943 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:22.412488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:22.413173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.413618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.413896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] PATH_INFO: `/v3/users/fb88a7f8e2db4789be47f010250c22f0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.415074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb88a7f8e2db4789be47f010250c22f0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:22.417621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:22.449214 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:22.484793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb88a7f8e2db4789be47f010250c22f0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.500172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb88a7f8e2db4789be47f010250c22f0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.510742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb88a7f8e2db4789be47f010250c22f0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.521736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb88a7f8e2db4789be47f010250c22f0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.524809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d531dedf-5108-4aee-8de0-aa139fbc32e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb88a7f8e2db4789be47f010250c22f0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:22.534722 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1545/3062] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:22 2022] DELETE /identity/v3/users/fb88a7f8e2db4789be47f010250c22f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:22.536438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dd2b3-390f-4341-aae8-e4ff105dfb5a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.536974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dd2b3-390f-4341-aae8-e4ff105dfb5a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.537351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dd2b3-390f-4341-aae8-e4ff105dfb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.558086 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1518/3063] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:55:22.567322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8796b-b02c-4528-9460-21f5fdfbe078 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.567322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8796b-b02c-4528-9460-21f5fdfbe078 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.567488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8796b-b02c-4528-9460-21f5fdfbe078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.600842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-700dd2b3-390f-4341-aae8-e4ff105dfb5a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:22.602318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-700dd2b3-390f-4341-aae8-e4ff105dfb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:22.610363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-96e8796b-b02c-4528-9460-21f5fdfbe078 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:22.611625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-96e8796b-b02c-4528-9460-21f5fdfbe078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:22.697453 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1546/3064] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:22.699243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dd2b3-390f-4341-aae8-e4ff105dfb5a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:22.712329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dd2b3-390f-4341-aae8-e4ff105dfb5a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:22.719674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cec93-439a-4a2b-b6d1-77f02dd5f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:22.719913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cec93-439a-4a2b-b6d1-77f02dd5f56f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.720235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cec93-439a-4a2b-b6d1-77f02dd5f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.721840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cec93-439a-4a2b-b6d1-77f02dd5f56f admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.722560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cec93-439a-4a2b-b6d1-77f02dd5f56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:55:22.722935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cec93-439a-4a2b-b6d1-77f02dd5f56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:22.725125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cec93-439a-4a2b-b6d1-77f02dd5f56f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:22.732074 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1519/3065] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:22.736293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8796b-b02c-4528-9460-21f5fdfbe078 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:22.747429 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1547/3066] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:55:22.754792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cec93-439a-4a2b-b6d1-77f02dd5f56f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:22.767230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8796b-b02c-4528-9460-21f5fdfbe078 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:22.771782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cec93-439a-4a2b-b6d1-77f02dd5f56f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:22.784039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8519f-6e5f-48e2-99ec-1cdb92992fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:22.784820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8519f-6e5f-48e2-99ec-1cdb92992fdf admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.785284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8519f-6e5f-48e2-99ec-1cdb92992fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.785609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3015ec-fe1a-4300-834f-5636afac8d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:22.786234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3015ec-fe1a-4300-834f-5636afac8d75 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.786522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3015ec-fe1a-4300-834f-5636afac8d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.786631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8519f-6e5f-48e2-99ec-1cdb92992fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.786787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3015ec-fe1a-4300-834f-5636afac8d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.787360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8519f-6e5f-48e2-99ec-1cdb92992fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:22.787472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3015ec-fe1a-4300-834f-5636afac8d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:55:22.787743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3015ec-fe1a-4300-834f-5636afac8d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:22.789410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3015ec-fe1a-4300-834f-5636afac8d75 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:22.793035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8519f-6e5f-48e2-99ec-1cdb92992fdf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:22.817781 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:22.825743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1520/3067] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:55:22.826738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3015ec-fe1a-4300-834f-5636afac8d75 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:22.852884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3015ec-fe1a-4300-834f-5636afac8d75 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:22.859868 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1548/3068] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:55:22 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:22.860826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8519f-6e5f-48e2-99ec-1cdb92992fdf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:22.870712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d07b9f-147b-4196-bc7c-753814135694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:22.871604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07b9f-147b-4196-bc7c-753814135694 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:22.872605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07b9f-147b-4196-bc7c-753814135694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:22.873075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07b9f-147b-4196-bc7c-753814135694 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:22.876432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d07b9f-147b-4196-bc7c-753814135694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:22.878815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d07b9f-147b-4196-bc7c-753814135694 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:22.956332 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1521/3069] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:55:22 2022] POST /identity/v3/projects => generated 397 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:22.957723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d07b9f-147b-4196-bc7c-753814135694 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:22.984506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8519f-6e5f-48e2-99ec-1cdb92992fdf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.007310 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:23.131898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d07b9f-147b-4196-bc7c-753814135694 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.139454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762c848-0f9d-440b-b163-a158a042b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:23.140483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762c848-0f9d-440b-b163-a158a042b771 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.141070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762c848-0f9d-440b-b163-a158a042b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.141525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762c848-0f9d-440b-b163-a158a042b771 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.142323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762c848-0f9d-440b-b163-a158a042b771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:23.143427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba0f2d-e433-4eed-ac88-2eb062952024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:23.144055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba0f2d-e433-4eed-ac88-2eb062952024 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.144334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba0f2d-e433-4eed-ac88-2eb062952024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.144603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba0f2d-e433-4eed-ac88-2eb062952024 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.145318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762c848-0f9d-440b-b163-a158a042b771 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:23.145435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba0f2d-e433-4eed-ac88-2eb062952024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:23.153094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba0f2d-e433-4eed-ac88-2eb062952024 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:23.188519 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1522/3070] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:55:22 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:23.193844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762c848-0f9d-440b-b163-a158a042b771 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:23.208689 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1549/3071] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:55:22 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:23.212746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762c848-0f9d-440b-b163-a158a042b771 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.213894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba0f2d-e433-4eed-ac88-2eb062952024 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:23.221484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca97ac9-edbd-4d44-a520-474c29e1d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:23.222320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca97ac9-edbd-4d44-a520-474c29e1d11b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.222752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca97ac9-edbd-4d44-a520-474c29e1d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.223422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca97ac9-edbd-4d44-a520-474c29e1d11b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.224296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca97ac9-edbd-4d44-a520-474c29e1d11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:23.226780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca97ac9-edbd-4d44-a520-474c29e1d11b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:23.237710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba0f2d-e433-4eed-ac88-2eb062952024 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.241534 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1523/3072] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:23.245857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca97ac9-edbd-4d44-a520-474c29e1d11b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:23.248835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f92a33-e97c-4979-bd6b-8388e5c75959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:23.250516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92a33-e97c-4979-bd6b-8388e5c75959 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.250942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92a33-e97c-4979-bd6b-8388e5c75959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.251303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92a33-e97c-4979-bd6b-8388e5c75959 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.252080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f92a33-e97c-4979-bd6b-8388e5c75959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:23.254133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f92a33-e97c-4979-bd6b-8388e5c75959 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:23.260067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca97ac9-edbd-4d44-a520-474c29e1d11b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.272904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842c319-c721-4241-bf5b-75f8a5696889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:23.274057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842c319-c721-4241-bf5b-75f8a5696889 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.274908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842c319-c721-4241-bf5b-75f8a5696889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.275340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842c319-c721-4241-bf5b-75f8a5696889 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.275793 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1550/3073] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:23.277523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f92a33-e97c-4979-bd6b-8388e5c75959 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:23.278594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842c319-c721-4241-bf5b-75f8a5696889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:23.282398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842c319-c721-4241-bf5b-75f8a5696889 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:23.295193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f92a33-e97c-4979-bd6b-8388e5c75959 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.300535 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1524/3074] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:23.304475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842c319-c721-4241-bf5b-75f8a5696889 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:23.305376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fdd68-e178-4abe-9358-297979d79d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:23.305687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fdd68-e178-4abe-9358-297979d79d01 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.305969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fdd68-e178-4abe-9358-297979d79d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.306316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fdd68-e178-4abe-9358-297979d79d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.307560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fdd68-e178-4abe-9358-297979d79d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:23.310285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fdd68-e178-4abe-9358-297979d79d01 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:23.321064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842c319-c721-4241-bf5b-75f8a5696889 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.329092 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1551/3075] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:23.332753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fdd68-e178-4abe-9358-297979d79d01 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:23.334301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c663c-456f-4b9a-b069-8c38b53d54a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:23.336263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c663c-456f-4b9a-b069-8c38b53d54a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.336734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c663c-456f-4b9a-b069-8c38b53d54a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.337804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c663c-456f-4b9a-b069-8c38b53d54a4 admin admin] PATH_INFO: `/v3/projects/072952a76c8f483d9d8b5912b2e0ecb3/users/d76c8fd5fe0a49da9bad854cbe8c74e0/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.353875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fdd68-e178-4abe-9358-297979d79d01 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.360407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf29316-c8c7-4829-bf45-a8aed4d2ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:23.363470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf29316-c8c7-4829-bf45-a8aed4d2ecbd admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.363607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf29316-c8c7-4829-bf45-a8aed4d2ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.363891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf29316-c8c7-4829-bf45-a8aed4d2ecbd admin admin] PATH_INFO: `/v3/projects/f527fed1e48e443785be3b655deb762b/users/ded977ea8c0b4e18bbef90de6a59a7d3/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.366811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c663c-456f-4b9a-b069-8c38b53d54a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072952a76c8f483d9d8b5912b2e0ecb3, user_id=d76c8fd5fe0a49da9bad854cbe8c74e0, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:23.372910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c663c-456f-4b9a-b069-8c38b53d54a4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:23.391554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf29316-c8c7-4829-bf45-a8aed4d2ecbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f527fed1e48e443785be3b655deb762b, user_id=ded977ea8c0b4e18bbef90de6a59a7d3, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:23.396117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf29316-c8c7-4829-bf45-a8aed4d2ecbd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:23.398061 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1525/3076] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:55:23 2022] PUT /identity/v3/projects/072952a76c8f483d9d8b5912b2e0ecb3/users/d76c8fd5fe0a49da9bad854cbe8c74e0/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:23.404250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf463-2dff-4c73-ab5a-41ebfb12fc32 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.406434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf463-2dff-4c73-ab5a-41ebfb12fc32 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.406630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf463-2dff-4c73-ab5a-41ebfb12fc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.430039 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1552/3077] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:55:23 2022] PUT /identity/v3/projects/f527fed1e48e443785be3b655deb762b/users/ded977ea8c0b4e18bbef90de6a59a7d3/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:23.435924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e6db-6f2d-4ad8-a2fc-f582a1159734 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.436486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e6db-6f2d-4ad8-a2fc-f582a1159734 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.436800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e6db-6f2d-4ad8-a2fc-f582a1159734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.470540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d12cf463-2dff-4c73-ab5a-41ebfb12fc32 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:23.476957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d12cf463-2dff-4c73-ab5a-41ebfb12fc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:23.482255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a953e6db-6f2d-4ad8-a2fc-f582a1159734 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:23.488913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a953e6db-6f2d-4ad8-a2fc-f582a1159734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:23.634158 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1526/3078] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:23.639327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf463-2dff-4c73-ab5a-41ebfb12fc32 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:23.641062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d12cf463-2dff-4c73-ab5a-41ebfb12fc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:23.650566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1553/3079] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:55:23.660325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf463-2dff-4c73-ab5a-41ebfb12fc32 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.662176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e6db-6f2d-4ad8-a2fc-f582a1159734 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:23.666955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a953e6db-6f2d-4ad8-a2fc-f582a1159734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:23.678064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:23.680952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:23.681394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:23.681509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] PATH_INFO: `/v3/projects/b89687ea02364fd18d14ea3d813d663e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:23.684294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89687ea02364fd18d14ea3d813d663e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:23.687173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:23.710035 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:23.830230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89687ea02364fd18d14ea3d813d663e', 'request_id': 'req-ea7185bc-7a07-4798-9abf-64954061a711'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:23.857717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89687ea02364fd18d14ea3d813d663e', 'request_id': 'req-ea7185bc-7a07-4798-9abf-64954061a711'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:23.873914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89687ea02364fd18d14ea3d813d663e', 'request_id': 'req-ea7185bc-7a07-4798-9abf-64954061a711'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:23.882766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e6db-6f2d-4ad8-a2fc-f582a1159734 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:23.890346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] The token cache is being invalidate because project b89687ea02364fd18d14ea3d813d663e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:23.890745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:23.891506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:23.896934 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1527/3080] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:23 2022] DELETE /identity/v3/projects/b89687ea02364fd18d14ea3d813d663e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:23.896934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:23.900709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:23.906023 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:24.002135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d819-8875-4303-80d2-b0374dddc8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:24.002795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d819-8875-4303-80d2-b0374dddc8bc service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:24.003095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d819-8875-4303-80d2-b0374dddc8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:24.003372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d819-8875-4303-80d2-b0374dddc8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:24.006827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1c42d819-8875-4303-80d2-b0374dddc8bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:24.050942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7185bc-7a07-4798-9abf-64954061a711 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:24.064806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68832e-6518-4e7b-b342-7709887364c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:24.065727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68832e-6518-4e7b-b342-7709887364c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:24.066228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68832e-6518-4e7b-b342-7709887364c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:24.067015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68832e-6518-4e7b-b342-7709887364c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:24.070089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4d68832e-6518-4e7b-b342-7709887364c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:24.161701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42d819-8875-4303-80d2-b0374dddc8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:24.163323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42d819-8875-4303-80d2-b0374dddc8bc service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:24.187024 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1554/3081] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:55:24.188587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f733481-38f0-4e9f-8076-3e08489ff7cf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:24.188966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f733481-38f0-4e9f-8076-3e08489ff7cf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:24.189844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68832e-6518-4e7b-b342-7709887364c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:24.190087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f733481-38f0-4e9f-8076-3e08489ff7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:24.192163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68832e-6518-4e7b-b342-7709887364c6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:24.215603 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1528/3082] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:24.237392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0f733481-38f0-4e9f-8076-3e08489ff7cf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:24.238818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0f733481-38f0-4e9f-8076-3e08489ff7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:24.255118 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1555/3083] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:24.263266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec77ed-1ddf-4991-8abc-9b13577ccdc8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:24.263266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec77ed-1ddf-4991-8abc-9b13577ccdc8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:24.263573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec77ed-1ddf-4991-8abc-9b13577ccdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:24.309661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5dec77ed-1ddf-4991-8abc-9b13577ccdc8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:24.311161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5dec77ed-1ddf-4991-8abc-9b13577ccdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:24.333139 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1529/3084] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:24.337800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f733481-38f0-4e9f-8076-3e08489ff7cf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:24.353090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f733481-38f0-4e9f-8076-3e08489ff7cf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:24.366770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbec23-a309-47a6-afbe-193d649ea1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:24.367545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbec23-a309-47a6-afbe-193d649ea1af admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:24.367944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbec23-a309-47a6-afbe-193d649ea1af admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:24.368353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbec23-a309-47a6-afbe-193d649ea1af admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:24.369171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbec23-a309-47a6-afbe-193d649ea1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:55:24.369571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbec23-a309-47a6-afbe-193d649ea1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:24.371581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbec23-a309-47a6-afbe-193d649ea1af admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:24.435283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec77ed-1ddf-4991-8abc-9b13577ccdc8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:24.435527 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1556/3085] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:55:24.454205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec77ed-1ddf-4991-8abc-9b13577ccdc8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:24.469824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17b711-94f0-4a51-8b41-4662d1b2ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:24.470721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17b711-94f0-4a51-8b41-4662d1b2ea93 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:24.471179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17b711-94f0-4a51-8b41-4662d1b2ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:24.471625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17b711-94f0-4a51-8b41-4662d1b2ea93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:24.472444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17b711-94f0-4a51-8b41-4662d1b2ea93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:24.475058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17b711-94f0-4a51-8b41-4662d1b2ea93 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:24.522618 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1530/3086] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:55:24 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:55:24.526644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbec23-a309-47a6-afbe-193d649ea1af admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:24.539488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbec23-a309-47a6-afbe-193d649ea1af admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:24.762835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc00dd-dfe8-4077-839c-0866609462a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:24.764749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc00dd-dfe8-4077-839c-0866609462a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:24.767211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc00dd-dfe8-4077-839c-0866609462a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:24.770478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc00dd-dfe8-4077-839c-0866609462a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:24.771483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc00dd-dfe8-4077-839c-0866609462a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:24.785293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc00dd-dfe8-4077-839c-0866609462a5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:24.869036 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1557/3087] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:55:24 2022] POST /identity/v3/users => generated 287 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:24.871904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17b711-94f0-4a51-8b41-4662d1b2ea93 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:24.884160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17b711-94f0-4a51-8b41-4662d1b2ea93 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:24.910602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b80c8e-af6b-4490-9762-d8a8473189ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:24.912116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80c8e-af6b-4490-9762-d8a8473189ce admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:24.914525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80c8e-af6b-4490-9762-d8a8473189ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:24.916426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80c8e-af6b-4490-9762-d8a8473189ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:24.919034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b80c8e-af6b-4490-9762-d8a8473189ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:24.926978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b80c8e-af6b-4490-9762-d8a8473189ce admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:24.958309 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1531/3088] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:24.962051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc00dd-dfe8-4077-839c-0866609462a5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:24.988569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc00dd-dfe8-4077-839c-0866609462a5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:25.004402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce258ee4-e5d0-4dc3-b2cf-e8cf9f73401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:25.006692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce258ee4-e5d0-4dc3-b2cf-e8cf9f73401c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:25.008308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce258ee4-e5d0-4dc3-b2cf-e8cf9f73401c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:25.009057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce258ee4-e5d0-4dc3-b2cf-e8cf9f73401c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:25.010897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce258ee4-e5d0-4dc3-b2cf-e8cf9f73401c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:25.016899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce258ee4-e5d0-4dc3-b2cf-e8cf9f73401c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:25.083037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b80c8e-af6b-4490-9762-d8a8473189ce admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:25.087686 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1558/3089] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:55:25.118438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b80c8e-af6b-4490-9762-d8a8473189ce admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:25.149744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b51d7-f747-4357-8e80-b6ca05af2eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:25.152543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b51d7-f747-4357-8e80-b6ca05af2eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:25.153520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b51d7-f747-4357-8e80-b6ca05af2eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:25.154600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b51d7-f747-4357-8e80-b6ca05af2eb1 admin admin] PATH_INFO: `/v3/projects/8a2038ef05604eabb5fa8183ef4a9b95/users/d2db51d6d02e4884abab02dde674f062/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:25.203983 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:25.227891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b51d7-f747-4357-8e80-b6ca05af2eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2038ef05604eabb5fa8183ef4a9b95, user_id=d2db51d6d02e4884abab02dde674f062, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:25.233070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b51d7-f747-4357-8e80-b6ca05af2eb1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:25.267415 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1532/3090] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:55:25 2022] PUT /identity/v3/projects/8a2038ef05604eabb5fa8183ef4a9b95/users/d2db51d6d02e4884abab02dde674f062/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:25.281807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad2df2-d292-4091-b729-167a80cc4e80 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:25.282093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad2df2-d292-4091-b729-167a80cc4e80 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:25.282376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad2df2-d292-4091-b729-167a80cc4e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:25.343498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f7ad2df2-d292-4091-b729-167a80cc4e80 None None] MFA Rules not processed for user `d2db51d6d02e4884abab02dde674f062`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:25.346008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f7ad2df2-d292-4091-b729-167a80cc4e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:25.368143 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:25.523824 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1559/3091] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:25.543048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b51d7-f747-4357-8e80-b6ca05af2eb1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:25.545309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-362b51d7-f747-4357-8e80-b6ca05af2eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:25.739885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b51d7-f747-4357-8e80-b6ca05af2eb1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:25.774959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f350efd-6a31-47e6-8bdf-a04611c985f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:25.775904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f350efd-6a31-47e6-8bdf-a04611c985f0 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:25.776380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f350efd-6a31-47e6-8bdf-a04611c985f0 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:25.776820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f350efd-6a31-47e6-8bdf-a04611c985f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:25.793068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f350efd-6a31-47e6-8bdf-a04611c985f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:25.795005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f350efd-6a31-47e6-8bdf-a04611c985f0 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:25.842970 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1533/3092] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:28.023965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad2df2-d292-4091-b729-167a80cc4e80 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:28.177709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad2df2-d292-4091-b729-167a80cc4e80 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:28.188300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:28.193501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:28.194389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:28.194862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] PATH_INFO: `/v3/users/d2db51d6d02e4884abab02dde674f062` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:28.197397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2db51d6d02e4884abab02dde674f062)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:28.201155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:28.364027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2db51d6d02e4884abab02dde674f062'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:28.416919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2db51d6d02e4884abab02dde674f062'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:28.437940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2db51d6d02e4884abab02dde674f062'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:28.461812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2db51d6d02e4884abab02dde674f062'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:28.462442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2db51d6d02e4884abab02dde674f062'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:28.473293 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1560/3093] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:28 2022] DELETE /identity/v3/users/d2db51d6d02e4884abab02dde674f062 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:28.479028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef85f-74c3-4ceb-a642-34eebf258f73 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:28.481424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef85f-74c3-4ceb-a642-34eebf258f73 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:28.482238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef85f-74c3-4ceb-a642-34eebf258f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:28.565324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-171ef85f-74c3-4ceb-a642-34eebf258f73 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:28.569235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-171ef85f-74c3-4ceb-a642-34eebf258f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:28.814546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1534/3094] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:28.851776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:28.853367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:28.919909 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:28.977780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b28f9c-de2a-4b45-885a-3cc88d5493c0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:28.985611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02ef4-0b62-4f5c-9ca1-674144451c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:28.986146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02ef4-0b62-4f5c-9ca1-674144451c7d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:28.986429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02ef4-0b62-4f5c-9ca1-674144451c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:28.986701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02ef4-0b62-4f5c-9ca1-674144451c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:29.011314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b02ef4-0b62-4f5c-9ca1-674144451c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:29.017158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b02ef4-0b62-4f5c-9ca1-674144451c7d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:29.041346 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1561/3095] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:30.934196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef85f-74c3-4ceb-a642-34eebf258f73 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:30.935663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-171ef85f-74c3-4ceb-a642-34eebf258f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:30.951600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef85f-74c3-4ceb-a642-34eebf258f73 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:30.963371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:30.964281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:30.964753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:30.965212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] PATH_INFO: `/v3/projects/8a2038ef05604eabb5fa8183ef4a9b95` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:30.968706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2038ef05604eabb5fa8183ef4a9b95)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:30.971056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:31.058759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2038ef05604eabb5fa8183ef4a9b95', 'request_id': 'req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:31.072754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2038ef05604eabb5fa8183ef4a9b95', 'request_id': 'req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:31.088151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2038ef05604eabb5fa8183ef4a9b95', 'request_id': 'req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:31.115439 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:31.131471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] The token cache is being invalidate because project 8a2038ef05604eabb5fa8183ef4a9b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:31.131936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:31.133150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8707d01-7bc3-4d37-bc05-1ec4c7bc6d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:31.134968 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1535/3096] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:30 2022] DELETE /identity/v3/projects/8a2038ef05604eabb5fa8183ef4a9b95 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:31.141599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b6a3-bdd3-4fbe-bf5c-1e907054c3ac None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:31.142035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b6a3-bdd3-4fbe-bf5c-1e907054c3ac None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:31.142368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b6a3-bdd3-4fbe-bf5c-1e907054c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:31.198611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5844b6a3-bdd3-4fbe-bf5c-1e907054c3ac None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:31.198611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5844b6a3-bdd3-4fbe-bf5c-1e907054c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:31.302265 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1562/3097] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:31.309371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1956d-38cd-4123-99ae-5e2ba3f34918 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:31.310312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1956d-38cd-4123-99ae-5e2ba3f34918 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:31.311365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1956d-38cd-4123-99ae-5e2ba3f34918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:31.348718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c4a1956d-38cd-4123-99ae-5e2ba3f34918 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:31.348718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c4a1956d-38cd-4123-99ae-5e2ba3f34918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:31.358718 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1536/3098] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:31.364505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b6a3-bdd3-4fbe-bf5c-1e907054c3ac None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:31.382463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b6a3-bdd3-4fbe-bf5c-1e907054c3ac None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:31.393516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecb0a7-fb06-4b62-8378-3d9eb4d9d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:31.395556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecb0a7-fb06-4b62-8378-3d9eb4d9d77d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:31.397002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecb0a7-fb06-4b62-8378-3d9eb4d9d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:31.397527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecb0a7-fb06-4b62-8378-3d9eb4d9d77d admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:31.399283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecb0a7-fb06-4b62-8378-3d9eb4d9d77d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:55:31.399866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecb0a7-fb06-4b62-8378-3d9eb4d9d77d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:31.402632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecb0a7-fb06-4b62-8378-3d9eb4d9d77d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:31.436662 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1563/3099] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:55:31.439344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1956d-38cd-4123-99ae-5e2ba3f34918 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:31.449621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1956d-38cd-4123-99ae-5e2ba3f34918 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:31.459370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb897-4d26-4735-a210-ec8341dfc2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:31.460091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb897-4d26-4735-a210-ec8341dfc2eb admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:31.460379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb897-4d26-4735-a210-ec8341dfc2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:31.460723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb897-4d26-4735-a210-ec8341dfc2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:31.461411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efb897-4d26-4735-a210-ec8341dfc2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:31.463413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efb897-4d26-4735-a210-ec8341dfc2eb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:31.518602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecb0a7-fb06-4b62-8378-3d9eb4d9d77d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:31.522927 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1537/3100] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:55:31 2022] POST /identity/v3/projects => generated 391 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:31.551293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecb0a7-fb06-4b62-8378-3d9eb4d9d77d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:31.742902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d2ebb-628f-4d65-ac0f-7fdf4f723ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:31.743758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2ebb-628f-4d65-ac0f-7fdf4f723ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:31.744264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2ebb-628f-4d65-ac0f-7fdf4f723ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:31.744553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2ebb-628f-4d65-ac0f-7fdf4f723ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:31.745393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d2ebb-628f-4d65-ac0f-7fdf4f723ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:31.747414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d2ebb-628f-4d65-ac0f-7fdf4f723ea9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:31.821083 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1564/3101] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:55:31 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:55:31.825212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb897-4d26-4735-a210-ec8341dfc2eb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:31.843995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb897-4d26-4735-a210-ec8341dfc2eb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:31.869539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e9ff4-cc1f-43c6-b724-9c9ff97372d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:31.870556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e9ff4-cc1f-43c6-b724-9c9ff97372d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:31.871011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e9ff4-cc1f-43c6-b724-9c9ff97372d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:31.871465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e9ff4-cc1f-43c6-b724-9c9ff97372d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:31.877056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e9ff4-cc1f-43c6-b724-9c9ff97372d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:31.877056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e9ff4-cc1f-43c6-b724-9c9ff97372d4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:31.966924 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1538/3102] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:31.970986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d2ebb-628f-4d65-ac0f-7fdf4f723ea9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:32.022739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d2ebb-628f-4d65-ac0f-7fdf4f723ea9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:32.053813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea58992-2bf0-4b13-89bc-02d458acb118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:32.054531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58992-2bf0-4b13-89bc-02d458acb118 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:32.054818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58992-2bf0-4b13-89bc-02d458acb118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:32.056253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58992-2bf0-4b13-89bc-02d458acb118 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:32.058514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea58992-2bf0-4b13-89bc-02d458acb118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:32.060884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea58992-2bf0-4b13-89bc-02d458acb118 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:32.094088 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1565/3103] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:32.103970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e9ff4-cc1f-43c6-b724-9c9ff97372d4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:32.129526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e9ff4-cc1f-43c6-b724-9c9ff97372d4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:32.145588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaab0f6-6132-478f-9254-4aa7bd656e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:32.146567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaab0f6-6132-478f-9254-4aa7bd656e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:32.150092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaab0f6-6132-478f-9254-4aa7bd656e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:32.156607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaab0f6-6132-478f-9254-4aa7bd656e04 admin admin] PATH_INFO: `/v3/projects/5017de8e297545248369595fa5db2f7d/users/b8c5c0d3f9394736829782c7ac69ff05/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:32.210118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaab0f6-6132-478f-9254-4aa7bd656e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5017de8e297545248369595fa5db2f7d, user_id=b8c5c0d3f9394736829782c7ac69ff05, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:32.225955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaab0f6-6132-478f-9254-4aa7bd656e04 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:32.283772 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1539/3104] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:55:32 2022] PUT /identity/v3/projects/5017de8e297545248369595fa5db2f7d/users/b8c5c0d3f9394736829782c7ac69ff05/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:32.286004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e4ece-c35b-4239-84f6-65c1d7902bf6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:32.286481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e4ece-c35b-4239-84f6-65c1d7902bf6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:32.286786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e4ece-c35b-4239-84f6-65c1d7902bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:32.330770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-219e4ece-c35b-4239-84f6-65c1d7902bf6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:32.332171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-219e4ece-c35b-4239-84f6-65c1d7902bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:32.409094 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:32.475392 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1566/3105] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:32.565447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaab0f6-6132-478f-9254-4aa7bd656e04 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:32.567762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9eaab0f6-6132-478f-9254-4aa7bd656e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:32.733664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaab0f6-6132-478f-9254-4aa7bd656e04 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:32.741537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277685ec-d727-4414-88c8-83c342f22fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:32.742491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277685ec-d727-4414-88c8-83c342f22fee service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:32.743108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277685ec-d727-4414-88c8-83c342f22fee service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:32.743781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277685ec-d727-4414-88c8-83c342f22fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:32.759783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277685ec-d727-4414-88c8-83c342f22fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:32.771780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277685ec-d727-4414-88c8-83c342f22fee service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:32.791976 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1540/3106] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:33.652789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e4ece-c35b-4239-84f6-65c1d7902bf6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:33.654342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-219e4ece-c35b-4239-84f6-65c1d7902bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:33.678018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e4ece-c35b-4239-84f6-65c1d7902bf6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:33.686057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:33.689432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:33.689911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:33.690346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] PATH_INFO: `/v3/users/ab81208ae8f64a04bd49c018d7bf5c13` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:33.692702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab81208ae8f64a04bd49c018d7bf5c13)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:33.696499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:33.821345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab81208ae8f64a04bd49c018d7bf5c13'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:33.839739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab81208ae8f64a04bd49c018d7bf5c13'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:33.867113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab81208ae8f64a04bd49c018d7bf5c13'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:33.875078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab81208ae8f64a04bd49c018d7bf5c13'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:33.876076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab81208ae8f64a04bd49c018d7bf5c13'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:33.897694 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1567/3107] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:33 2022] DELETE /identity/v3/users/ab81208ae8f64a04bd49c018d7bf5c13 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:34.469743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277685ec-d727-4414-88c8-83c342f22fee service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:34.486061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277685ec-d727-4414-88c8-83c342f22fee service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:34.694669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:34.695495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:34.695881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:34.696281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] PATH_INFO: `/v3/projects/37640d2d06604d02b384e5a2625b69e9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:34.698024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=37640d2d06604d02b384e5a2625b69e9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:34.700309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:34.759864 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:34.767617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37640d2d06604d02b384e5a2625b69e9', 'request_id': 'req-7f026276-2a88-4631-800d-8e701dcac48a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:34.777699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37640d2d06604d02b384e5a2625b69e9', 'request_id': 'req-7f026276-2a88-4631-800d-8e701dcac48a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:34.788489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37640d2d06604d02b384e5a2625b69e9', 'request_id': 'req-7f026276-2a88-4631-800d-8e701dcac48a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:34.802036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] The token cache is being invalidate because project 37640d2d06604d02b384e5a2625b69e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:34.802429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:34.803235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:34.804841 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1541/3108] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:34 2022] DELETE /identity/v3/projects/37640d2d06604d02b384e5a2625b69e9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:55:34.808796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:34.810412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:34.826492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e9499-20d1-4764-8b0e-9bceb8d7505e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:34.938407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:34.939074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:34.939361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:34.939632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] PATH_INFO: `/v3/users/c9c74540f9b343618e9989940a802d41` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:34.946275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c74540f9b343618e9989940a802d41)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:34.954374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:35.061081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c74540f9b343618e9989940a802d41'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:35.072292 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:35.122018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c74540f9b343618e9989940a802d41'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:35.137510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c74540f9b343618e9989940a802d41'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:35.159603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c74540f9b343618e9989940a802d41'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:35.170459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b7abd580-f391-47d8-90c5-eb0b5bd617a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c74540f9b343618e9989940a802d41'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:35.192296 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1568/3109] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:34 2022] DELETE /identity/v3/users/c9c74540f9b343618e9989940a802d41 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:55:36.860302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:36.863974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:36.896493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026276-2a88-4631-800d-8e701dcac48a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:37.053430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:37.054185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:37.054358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:37.054641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] PATH_INFO: `/v3/projects/f7f8e91f5c3a4069b89f5982180cc085` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:37.055800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f8e91f5c3a4069b89f5982180cc085)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:37.057880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:37.180209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f8e91f5c3a4069b89f5982180cc085', 'request_id': 'req-99e9900e-b02d-4882-a535-97591739db10'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:37.204322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f8e91f5c3a4069b89f5982180cc085', 'request_id': 'req-99e9900e-b02d-4882-a535-97591739db10'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:37.205021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856faf0c-08e0-4c56-8ad2-4bdf2f1726e3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:37.205474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856faf0c-08e0-4c56-8ad2-4bdf2f1726e3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:37.205639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856faf0c-08e0-4c56-8ad2-4bdf2f1726e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:37.211954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f8e91f5c3a4069b89f5982180cc085', 'request_id': 'req-99e9900e-b02d-4882-a535-97591739db10'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:37.228103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] The token cache is being invalidate because project f7f8e91f5c3a4069b89f5982180cc085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:37.228740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:37.230989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99e9900e-b02d-4882-a535-97591739db10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:37.232732 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1542/3110] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:36 2022] DELETE /identity/v3/projects/f7f8e91f5c3a4069b89f5982180cc085 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:37.238339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b3405-8de0-4e32-b410-14685ba2aefb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:37.238670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b3405-8de0-4e32-b410-14685ba2aefb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:37.238949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b3405-8de0-4e32-b410-14685ba2aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:37.267493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0a9b3405-8de0-4e32-b410-14685ba2aefb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:37.269456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a9b3405-8de0-4e32-b410-14685ba2aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:37.313972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-856faf0c-08e0-4c56-8ad2-4bdf2f1726e3 None None] MFA Rules not processed for user `d76c8fd5fe0a49da9bad854cbe8c74e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:37.319256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-856faf0c-08e0-4c56-8ad2-4bdf2f1726e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:37.395113 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:37.414958 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1543/3111] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:37.423428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c520d-f72a-47f7-95bf-43354c3b97bb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:37.423718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c520d-f72a-47f7-95bf-43354c3b97bb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:37.423996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c520d-f72a-47f7-95bf-43354c3b97bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:37.461923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-899c520d-f72a-47f7-95bf-43354c3b97bb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:37.464075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-899c520d-f72a-47f7-95bf-43354c3b97bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:37.480231 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1544/3112] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:37.485838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c520d-f72a-47f7-95bf-43354c3b97bb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:37.505604 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1569/3113] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:37.515699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c520d-f72a-47f7-95bf-43354c3b97bb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:37.518562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1717eb-513e-448e-ab77-4f0cf21dc954 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:37.518853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1717eb-513e-448e-ab77-4f0cf21dc954 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:37.519126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1717eb-513e-448e-ab77-4f0cf21dc954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:37.529850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487197-b24b-44f5-9bf4-02d16e5e4183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:37.531606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487197-b24b-44f5-9bf4-02d16e5e4183 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:37.532425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487197-b24b-44f5-9bf4-02d16e5e4183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:37.534237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487197-b24b-44f5-9bf4-02d16e5e4183 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:37.535826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81487197-b24b-44f5-9bf4-02d16e5e4183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:55:37.536267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81487197-b24b-44f5-9bf4-02d16e5e4183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:37.540040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81487197-b24b-44f5-9bf4-02d16e5e4183 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:37.569759 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1545/3114] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:55:37.570036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2d1717eb-513e-448e-ab77-4f0cf21dc954 None None] MFA Rules not processed for user `d76c8fd5fe0a49da9bad854cbe8c74e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:37.574744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487197-b24b-44f5-9bf4-02d16e5e4183 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:37.576835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2d1717eb-513e-448e-ab77-4f0cf21dc954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:37.591896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487197-b24b-44f5-9bf4-02d16e5e4183 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:37.599362 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1570/3115] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:37.613089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1717eb-513e-448e-ab77-4f0cf21dc954 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:37.614355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffc924-7c86-4150-9285-06dc80d7b402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:37.614611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2d1717eb-513e-448e-ab77-4f0cf21dc954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:37.614995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffc924-7c86-4150-9285-06dc80d7b402 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:37.615273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffc924-7c86-4150-9285-06dc80d7b402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:37.615709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffc924-7c86-4150-9285-06dc80d7b402 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:37.616265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffc924-7c86-4150-9285-06dc80d7b402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:37.618217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffc924-7c86-4150-9285-06dc80d7b402 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:37.699447 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1546/3116] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:55:37 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:37.728505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffc924-7c86-4150-9285-06dc80d7b402 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:37.790562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1717eb-513e-448e-ab77-4f0cf21dc954 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:37.886373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffc924-7c86-4150-9285-06dc80d7b402 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:37.902876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7f1aa-73bf-454a-a194-a54cf2d48fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:37.903637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7f1aa-73bf-454a-a194-a54cf2d48fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:37.904011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7f1aa-73bf-454a-a194-a54cf2d48fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:37.904838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7f1aa-73bf-454a-a194-a54cf2d48fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:37.907755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7f1aa-73bf-454a-a194-a54cf2d48fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:37.910091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7f1aa-73bf-454a-a194-a54cf2d48fb1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:37.935367 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:37.966015 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1547/3117] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:55:37 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:37.969916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7f1aa-73bf-454a-a194-a54cf2d48fb1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:37.985478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489f25e-9a6a-4237-afc6-0d3508cc2fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:37.986264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f25e-9a6a-4237-afc6-0d3508cc2fc2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:37.986643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f25e-9a6a-4237-afc6-0d3508cc2fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:37.987014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f25e-9a6a-4237-afc6-0d3508cc2fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:38.004203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7f1aa-73bf-454a-a194-a54cf2d48fb1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:38.024001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273ff17-6dd4-4074-a13f-18f1d7e8e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:38.024845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ff17-6dd4-4074-a13f-18f1d7e8e8ec admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:38.025240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ff17-6dd4-4074-a13f-18f1d7e8e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:38.025606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ff17-6dd4-4074-a13f-18f1d7e8e8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:38.026478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273ff17-6dd4-4074-a13f-18f1d7e8e8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:38.033093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273ff17-6dd4-4074-a13f-18f1d7e8e8ec admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:38.074307 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1548/3118] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:38.093592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273ff17-6dd4-4074-a13f-18f1d7e8e8ec admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:38.135887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273ff17-6dd4-4074-a13f-18f1d7e8e8ec admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:38.150779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92cc10-3699-4d76-a048-91a6f703f0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:38.151796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92cc10-3699-4d76-a048-91a6f703f0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:38.152279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92cc10-3699-4d76-a048-91a6f703f0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:38.152795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92cc10-3699-4d76-a048-91a6f703f0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:38.154048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92cc10-3699-4d76-a048-91a6f703f0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:38.157548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92cc10-3699-4d76-a048-91a6f703f0d3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:38.180929 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1549/3119] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:38.182063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489f25e-9a6a-4237-afc6-0d3508cc2fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:38.183463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92cc10-3699-4d76-a048-91a6f703f0d3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:38.185636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489f25e-9a6a-4237-afc6-0d3508cc2fc2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:38.203100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92cc10-3699-4d76-a048-91a6f703f0d3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:38.207534 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1571/3120] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:55:38.230328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d9c8-3369-4dd8-8fba-9baa5859c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:38.231401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d9c8-3369-4dd8-8fba-9baa5859c49d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:38.231951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d9c8-3369-4dd8-8fba-9baa5859c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:38.232395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d9c8-3369-4dd8-8fba-9baa5859c49d admin admin] PATH_INFO: `/v3/projects/8a07ec61e458414f97bccd0b1726b15f/users/42bc075132584120a95caab9221b5bb5/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:38.260906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d9c8-3369-4dd8-8fba-9baa5859c49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a07ec61e458414f97bccd0b1726b15f, user_id=42bc075132584120a95caab9221b5bb5, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:38.264141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d9c8-3369-4dd8-8fba-9baa5859c49d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:38.282838 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1550/3121] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:55:38 2022] PUT /identity/v3/projects/8a07ec61e458414f97bccd0b1726b15f/users/42bc075132584120a95caab9221b5bb5/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:38.288805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f39d5-caf9-44f9-8174-55fa830c2415 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:38.289336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f39d5-caf9-44f9-8174-55fa830c2415 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:38.289710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f39d5-caf9-44f9-8174-55fa830c2415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:38.336908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fb9f39d5-caf9-44f9-8174-55fa830c2415 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:38.338817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fb9f39d5-caf9-44f9-8174-55fa830c2415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:38.445147 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1572/3122] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:38.451101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d9c8-3369-4dd8-8fba-9baa5859c49d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:38.453592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aab8d9c8-3369-4dd8-8fba-9baa5859c49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:38.542846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d9c8-3369-4dd8-8fba-9baa5859c49d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:38.551198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f5957-2569-4e91-9985-cc72c2de6e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:38.552552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5957-2569-4e91-9985-cc72c2de6e1e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:38.552878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5957-2569-4e91-9985-cc72c2de6e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:38.553151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5957-2569-4e91-9985-cc72c2de6e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:38.564497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f5957-2569-4e91-9985-cc72c2de6e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:38.566438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f5957-2569-4e91-9985-cc72c2de6e1e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:38.591584 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1551/3123] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:39.116879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f39d5-caf9-44f9-8174-55fa830c2415 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:39.120102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fb9f39d5-caf9-44f9-8174-55fa830c2415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:39.144598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f39d5-caf9-44f9-8174-55fa830c2415 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:39.188074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5f894-6e18-4b0c-b18b-680a29a983c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:39.188829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5f894-6e18-4b0c-b18b-680a29a983c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:39.189955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5f894-6e18-4b0c-b18b-680a29a983c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:39.191760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5f894-6e18-4b0c-b18b-680a29a983c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:39.195508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-88b5f894-6e18-4b0c-b18b-680a29a983c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:39.227244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5f894-6e18-4b0c-b18b-680a29a983c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:39.230705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5f894-6e18-4b0c-b18b-680a29a983c9 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:39.257573 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1573/3124] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:39.703928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d596a-fc39-47aa-8b8e-d580feff9da6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:39.704496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d596a-fc39-47aa-8b8e-d580feff9da6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:39.711125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d596a-fc39-47aa-8b8e-d580feff9da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:39.729150 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:39.769183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b60d596a-fc39-47aa-8b8e-d580feff9da6 None None] MFA Rules not processed for user `42bc075132584120a95caab9221b5bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:39.770532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b60d596a-fc39-47aa-8b8e-d580feff9da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:39.915467 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1552/3125] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:39.945593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fd40-8d2b-42d9-8ee1-bad54943af56 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:39.946048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fd40-8d2b-42d9-8ee1-bad54943af56 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:39.946458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fd40-8d2b-42d9-8ee1-bad54943af56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:39.993016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97278a-2ae6-4c50-beb6-13772fdebfb6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:39.993558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97278a-2ae6-4c50-beb6-13772fdebfb6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:39.994195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97278a-2ae6-4c50-beb6-13772fdebfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:40.004937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5092fd40-8d2b-42d9-8ee1-bad54943af56 None None] MFA Rules not processed for user `c9ac716a6af441a4bc02d8ef11f81487`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:40.006164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5092fd40-8d2b-42d9-8ee1-bad54943af56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:40.028417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bc97278a-2ae6-4c50-beb6-13772fdebfb6 None None] MFA Rules not processed for user `42bc075132584120a95caab9221b5bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:40.032427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bc97278a-2ae6-4c50-beb6-13772fdebfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:40.062137 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1553/3126] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:55:40.127573 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1574/3127] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:40.140423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4661bfb-fc9d-4214-a788-40ebae08e318 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:40.140960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4661bfb-fc9d-4214-a788-40ebae08e318 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:40.141304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4661bfb-fc9d-4214-a788-40ebae08e318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:40.194111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e4661bfb-fc9d-4214-a788-40ebae08e318 None None] MFA Rules not processed for user `c9ac716a6af441a4bc02d8ef11f81487`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:40.200517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e4661bfb-fc9d-4214-a788-40ebae08e318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:40.211779 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1554/3128] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:40.967164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092fd40-8d2b-42d9-8ee1-bad54943af56 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:40.968766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5092fd40-8d2b-42d9-8ee1-bad54943af56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:40.975845 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:41.100702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092fd40-8d2b-42d9-8ee1-bad54943af56 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:41.106824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0ff4e-7648-4f19-bab2-b8577c211eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:41.107644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0ff4e-7648-4f19-bab2-b8577c211eff service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:41.107945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0ff4e-7648-4f19-bab2-b8577c211eff service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:41.108162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0ff4e-7648-4f19-bab2-b8577c211eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:41.122989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0ff4e-7648-4f19-bab2-b8577c211eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:41.124859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0ff4e-7648-4f19-bab2-b8577c211eff service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:41.139222 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1575/3129] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:41.161597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4661bfb-fc9d-4214-a788-40ebae08e318 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:41.183590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4661bfb-fc9d-4214-a788-40ebae08e318 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:41.190133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14d196-2e12-472c-aaca-5134b8f6a736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:41.190991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14d196-2e12-472c-aaca-5134b8f6a736 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:41.191595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14d196-2e12-472c-aaca-5134b8f6a736 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:41.192021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14d196-2e12-472c-aaca-5134b8f6a736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:41.215993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14d196-2e12-472c-aaca-5134b8f6a736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:41.218232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14d196-2e12-472c-aaca-5134b8f6a736 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:41.234425 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1555/3130] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:45.922969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0ff4e-7648-4f19-bab2-b8577c211eff service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:45.939209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0ff4e-7648-4f19-bab2-b8577c211eff service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:45.954422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:45.956318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:45.956615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:45.957362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] PATH_INFO: `/v3/users/42bc075132584120a95caab9221b5bb5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:45.961509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42bc075132584120a95caab9221b5bb5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:45.967990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:46.073328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42bc075132584120a95caab9221b5bb5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.093934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42bc075132584120a95caab9221b5bb5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.110323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42bc075132584120a95caab9221b5bb5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.157191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42bc075132584120a95caab9221b5bb5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.160153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-39e721fd-f6ff-4ecd-bd10-ec1d7c199596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42bc075132584120a95caab9221b5bb5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.174916 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1576/3131] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:55:45 2022] DELETE /identity/v3/users/42bc075132584120a95caab9221b5bb5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:46.546645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14d196-2e12-472c-aaca-5134b8f6a736 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:46.566514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14d196-2e12-472c-aaca-5134b8f6a736 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:46.660855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:46.661643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:46.662001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:46.662266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] PATH_INFO: `/v3/projects/8a07ec61e458414f97bccd0b1726b15f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:46.663601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a07ec61e458414f97bccd0b1726b15f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:46.665770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:46.742813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a07ec61e458414f97bccd0b1726b15f', 'request_id': 'req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.758303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a07ec61e458414f97bccd0b1726b15f', 'request_id': 'req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.766724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a07ec61e458414f97bccd0b1726b15f', 'request_id': 'req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.792541 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:46.798278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] The token cache is being invalidate because project 8a07ec61e458414f97bccd0b1726b15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:55:46.798694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.800170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c18f8c90-6d85-4b3f-80bf-7ff8eed852ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:55:46.805966 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1556/3132] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:55:46 2022] DELETE /identity/v3/projects/8a07ec61e458414f97bccd0b1726b15f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:46.807960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678fc3d-bb92-4875-ba01-08cc4af77c2b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:46.808304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678fc3d-bb92-4875-ba01-08cc4af77c2b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:46.808693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678fc3d-bb92-4875-ba01-08cc4af77c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:46.867053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a678fc3d-bb92-4875-ba01-08cc4af77c2b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:46.867721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a678fc3d-bb92-4875-ba01-08cc4af77c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:47.040706 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1577/3133] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:47.051400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164c560-1ee3-45a4-8c72-d53ef76b50e5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:47.051663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164c560-1ee3-45a4-8c72-d53ef76b50e5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:47.052306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164c560-1ee3-45a4-8c72-d53ef76b50e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:47.092352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1164c560-1ee3-45a4-8c72-d53ef76b50e5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:47.094444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1164c560-1ee3-45a4-8c72-d53ef76b50e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:47.116962 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1557/3134] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:47.122052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678fc3d-bb92-4875-ba01-08cc4af77c2b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:47.126878 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:47.141794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678fc3d-bb92-4875-ba01-08cc4af77c2b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:47.149365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f97e5-d057-4b40-b729-bc6cd3fd882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:47.150514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f97e5-d057-4b40-b729-bc6cd3fd882a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:47.151097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f97e5-d057-4b40-b729-bc6cd3fd882a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:47.151718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f97e5-d057-4b40-b729-bc6cd3fd882a admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:47.167303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f97e5-d057-4b40-b729-bc6cd3fd882a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:55:47.169269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f97e5-d057-4b40-b729-bc6cd3fd882a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:47.172868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f97e5-d057-4b40-b729-bc6cd3fd882a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:47.204534 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1578/3135] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:55:47.208773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164c560-1ee3-45a4-8c72-d53ef76b50e5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:47.219812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164c560-1ee3-45a4-8c72-d53ef76b50e5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:47.226155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3b361-602f-4e9d-8553-a8dec41f2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:47.227172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3b361-602f-4e9d-8553-a8dec41f2864 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:47.228336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3b361-602f-4e9d-8553-a8dec41f2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:47.228888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3b361-602f-4e9d-8553-a8dec41f2864 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:47.229766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3b361-602f-4e9d-8553-a8dec41f2864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:47.240551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3b361-602f-4e9d-8553-a8dec41f2864 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:47.366577 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1558/3136] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:55:47 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:47.368646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f97e5-d057-4b40-b729-bc6cd3fd882a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:47.392731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f97e5-d057-4b40-b729-bc6cd3fd882a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:47.536588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770b13-a1d3-45d7-91d6-359c1575dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:47.537587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770b13-a1d3-45d7-91d6-359c1575dd46 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:47.538764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770b13-a1d3-45d7-91d6-359c1575dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:47.542636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770b13-a1d3-45d7-91d6-359c1575dd46 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:47.543633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82770b13-a1d3-45d7-91d6-359c1575dd46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:47.547502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82770b13-a1d3-45d7-91d6-359c1575dd46 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:47.586151 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1579/3137] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:55:47 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:55:47.592295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3b361-602f-4e9d-8553-a8dec41f2864 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:47.625574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3b361-602f-4e9d-8553-a8dec41f2864 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:47.646212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc2013-848f-4f02-aaf2-ca119e29c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:47.647305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc2013-848f-4f02-aaf2-ca119e29c650 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:47.647715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc2013-848f-4f02-aaf2-ca119e29c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:47.648173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc2013-848f-4f02-aaf2-ca119e29c650 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:47.649187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc2013-848f-4f02-aaf2-ca119e29c650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:47.652762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc2013-848f-4f02-aaf2-ca119e29c650 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:47.689888 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1559/3138] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:47.694130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770b13-a1d3-45d7-91d6-359c1575dd46 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:47.711007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770b13-a1d3-45d7-91d6-359c1575dd46 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:47.717638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e5249-a5f5-4965-9657-be9cbe46eed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:47.718748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e5249-a5f5-4965-9657-be9cbe46eed6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:47.719857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e5249-a5f5-4965-9657-be9cbe46eed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:47.719857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e5249-a5f5-4965-9657-be9cbe46eed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:47.720785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e5249-a5f5-4965-9657-be9cbe46eed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:47.722726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e5249-a5f5-4965-9657-be9cbe46eed6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:47.742832 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1580/3139] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:55:47.747089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc2013-848f-4f02-aaf2-ca119e29c650 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:47.764231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc2013-848f-4f02-aaf2-ca119e29c650 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:47.789296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25b14e-3890-4bb0-a964-7adec0a5715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:47.790219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b14e-3890-4bb0-a964-7adec0a5715c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:47.790819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b14e-3890-4bb0-a964-7adec0a5715c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:47.791258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b14e-3890-4bb0-a964-7adec0a5715c admin admin] PATH_INFO: `/v3/projects/af067aa2424f4529b0fe9908bdc1e1c1/users/310cf7ecbd9c40bdbd1bdbcea54e6a95/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:47.829858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25b14e-3890-4bb0-a964-7adec0a5715c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af067aa2424f4529b0fe9908bdc1e1c1, user_id=310cf7ecbd9c40bdbd1bdbcea54e6a95, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:47.833865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25b14e-3890-4bb0-a964-7adec0a5715c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:47.857255 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1560/3140] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:55:47 2022] PUT /identity/v3/projects/af067aa2424f4529b0fe9908bdc1e1c1/users/310cf7ecbd9c40bdbd1bdbcea54e6a95/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:55:47.867672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f47ac-112e-4090-a3f2-bd22bcf36414 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:47.868066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f47ac-112e-4090-a3f2-bd22bcf36414 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:47.868997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f47ac-112e-4090-a3f2-bd22bcf36414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:47.948694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3a1f47ac-112e-4090-a3f2-bd22bcf36414 None None] MFA Rules not processed for user `310cf7ecbd9c40bdbd1bdbcea54e6a95`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:47.950208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3a1f47ac-112e-4090-a3f2-bd22bcf36414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:48.081272 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1581/3141] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:48.496114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25b14e-3890-4bb0-a964-7adec0a5715c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:48.498155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0b25b14e-3890-4bb0-a964-7adec0a5715c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:48.741955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25b14e-3890-4bb0-a964-7adec0a5715c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:48.758684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea0a70-db72-4e98-bb91-8e30c8dacf66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:48.759571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0a70-db72-4e98-bb91-8e30c8dacf66 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:48.760000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0a70-db72-4e98-bb91-8e30c8dacf66 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:48.760444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0a70-db72-4e98-bb91-8e30c8dacf66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:48.781228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea0a70-db72-4e98-bb91-8e30c8dacf66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:48.783096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea0a70-db72-4e98-bb91-8e30c8dacf66 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:48.798502 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1561/3142] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:49.187141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be810aa-71d9-448c-a6c7-61c5350fa204 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:49.188352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be810aa-71d9-448c-a6c7-61c5350fa204 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:49.188858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be810aa-71d9-448c-a6c7-61c5350fa204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:49.318992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2be810aa-71d9-448c-a6c7-61c5350fa204 None None] MFA Rules not processed for user `ded977ea8c0b4e18bbef90de6a59a7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:49.326646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2be810aa-71d9-448c-a6c7-61c5350fa204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:49.532562 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:49.608034 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1582/3143] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:49.626034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58f646-3fb1-4347-a3a4-b0e487310dda None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:49.626314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58f646-3fb1-4347-a3a4-b0e487310dda None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:49.626587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58f646-3fb1-4347-a3a4-b0e487310dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:49.698549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-af58f646-3fb1-4347-a3a4-b0e487310dda None None] MFA Rules not processed for user `ded977ea8c0b4e18bbef90de6a59a7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:49.700054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-af58f646-3fb1-4347-a3a4-b0e487310dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:49.723020 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1562/3144] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:50.682974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be810aa-71d9-448c-a6c7-61c5350fa204 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:50.710516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be810aa-71d9-448c-a6c7-61c5350fa204 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:50.733221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02e382-6b2c-42a9-82df-e9caaff07c85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:50.735096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02e382-6b2c-42a9-82df-e9caaff07c85 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:50.735572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02e382-6b2c-42a9-82df-e9caaff07c85 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:50.736013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02e382-6b2c-42a9-82df-e9caaff07c85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:50.767872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02e382-6b2c-42a9-82df-e9caaff07c85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:50.769611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02e382-6b2c-42a9-82df-e9caaff07c85 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:50.814408 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1583/3145] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:51.726812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58f646-3fb1-4347-a3a4-b0e487310dda None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:51.728788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-af58f646-3fb1-4347-a3a4-b0e487310dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:51.862079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58f646-3fb1-4347-a3a4-b0e487310dda None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:51.867665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58c002-f182-478c-bff8-94fb517af0b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:51.868603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c002-f182-478c-bff8-94fb517af0b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:51.869630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c002-f182-478c-bff8-94fb517af0b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:51.870058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c002-f182-478c-bff8-94fb517af0b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:51.872164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6a58c002-f182-478c-bff8-94fb517af0b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:51.897013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58c002-f182-478c-bff8-94fb517af0b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:51.899040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58c002-f182-478c-bff8-94fb517af0b8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:51.918938 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1563/3146] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:55:54.051589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023412b-6e90-45f6-9ad7-ebc12accc3b8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:54.052832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023412b-6e90-45f6-9ad7-ebc12accc3b8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:54.054018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023412b-6e90-45f6-9ad7-ebc12accc3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:54.195015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7023412b-6e90-45f6-9ad7-ebc12accc3b8 None None] MFA Rules not processed for user `b8c5c0d3f9394736829782c7ac69ff05`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:54.199366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7023412b-6e90-45f6-9ad7-ebc12accc3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:54.400662 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1584/3147] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:54.412347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4f0e-a3e6-40bf-a9d7-451b2a15b0da None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:54.412883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4f0e-a3e6-40bf-a9d7-451b2a15b0da None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:54.412965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4f0e-a3e6-40bf-a9d7-451b2a15b0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:54.455247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b9aa4f0e-a3e6-40bf-a9d7-451b2a15b0da None None] MFA Rules not processed for user `b8c5c0d3f9394736829782c7ac69ff05`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:55:54.458394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b9aa4f0e-a3e6-40bf-a9d7-451b2a15b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:55:54.476933 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1564/3148] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:55:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:55:55.642781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023412b-6e90-45f6-9ad7-ebc12accc3b8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:55:55.671879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023412b-6e90-45f6-9ad7-ebc12accc3b8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:55:55.730594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e828599-0c7e-493c-ade5-d21522974bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:55:55.731257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e828599-0c7e-493c-ade5-d21522974bad service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:55:55.731547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e828599-0c7e-493c-ade5-d21522974bad service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:55:55.733820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e828599-0c7e-493c-ade5-d21522974bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:55:55.788175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e828599-0c7e-493c-ade5-d21522974bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:55:55.792759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e828599-0c7e-493c-ade5-d21522974bad service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:55:55.834463 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1585/3149] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:55:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:04.434882 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:05.810391 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=50 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:08.274198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63add-a8df-4481-8ea5-ca4558104f6e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:08.274725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63add-a8df-4481-8ea5-ca4558104f6e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:08.274725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63add-a8df-4481-8ea5-ca4558104f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:08.307847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-92a63add-a8df-4481-8ea5-ca4558104f6e None None] MFA Rules not processed for user `d76c8fd5fe0a49da9bad854cbe8c74e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:08.324827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-92a63add-a8df-4481-8ea5-ca4558104f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:08.420428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e828599-0c7e-493c-ade5-d21522974bad service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:08.422550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1e828599-0c7e-493c-ade5-d21522974bad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:08.474382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1565/3150] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:08.540267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e828599-0c7e-493c-ade5-d21522974bad service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:08.545873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:08.546908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:08.547519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:08.547997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] PATH_INFO: `/v3/users/5d0158da7efc485ebd6a1e1db617b5e7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:08.549693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0158da7efc485ebd6a1e1db617b5e7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:08.551937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:08.649122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0158da7efc485ebd6a1e1db617b5e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:08.664427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0158da7efc485ebd6a1e1db617b5e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:08.675189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0158da7efc485ebd6a1e1db617b5e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:08.685319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0158da7efc485ebd6a1e1db617b5e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:08.687084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0158da7efc485ebd6a1e1db617b5e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:08.695346 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1586/3151] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:08 2022] DELETE /identity/v3/users/5d0158da7efc485ebd6a1e1db617b5e7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:09.590442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63add-a8df-4481-8ea5-ca4558104f6e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:09.615782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63add-a8df-4481-8ea5-ca4558104f6e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:09.775324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:09.776463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:09.776930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:09.777435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] PATH_INFO: `/v3/projects/4c9189bd828c41a88fe9333fb5ec9351` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:09.780210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9189bd828c41a88fe9333fb5ec9351)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:09.782709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:09.888462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9189bd828c41a88fe9333fb5ec9351', 'request_id': 'req-e4fadffa-9343-4cc7-82c5-06db665677d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:09.900857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9189bd828c41a88fe9333fb5ec9351', 'request_id': 'req-e4fadffa-9343-4cc7-82c5-06db665677d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:09.924802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9189bd828c41a88fe9333fb5ec9351', 'request_id': 'req-e4fadffa-9343-4cc7-82c5-06db665677d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:09.943936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] The token cache is being invalidate because project 4c9189bd828c41a88fe9333fb5ec9351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:09.944241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:09.945488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:09.947478 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1566/3152] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:09 2022] DELETE /identity/v3/projects/4c9189bd828c41a88fe9333fb5ec9351 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:09.952274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:09.954661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:09.980864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f768-1f82-4d72-8b10-98ca1ab40585 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:10.074313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:10.075487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:10.075948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:10.076653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] PATH_INFO: `/v3/users/b8f3bef1995348c5a70b0f3388f96541` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:10.078214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f3bef1995348c5a70b0f3388f96541)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:10.083720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:10.118474 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:10.167420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f3bef1995348c5a70b0f3388f96541'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:10.188116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f3bef1995348c5a70b0f3388f96541'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:10.212441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f3bef1995348c5a70b0f3388f96541'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:10.234067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f3bef1995348c5a70b0f3388f96541'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:10.234905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc8ee1b8-abc6-4687-a717-afb40f551c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f3bef1995348c5a70b0f3388f96541'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:10.247066 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1587/3153] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:09 2022] DELETE /identity/v3/users/b8f3bef1995348c5a70b0f3388f96541 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:11.119558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:11.121114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:11.147123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fadffa-9343-4cc7-82c5-06db665677d4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:11.222679 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:11.287042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:11.287851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:11.288144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:11.288426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] PATH_INFO: `/v3/projects/716e9330890d4c57a0d13b8bda0b7a58` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:11.290715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=716e9330890d4c57a0d13b8bda0b7a58)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:11.292791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:11.378748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716e9330890d4c57a0d13b8bda0b7a58', 'request_id': 'req-60691fb3-f2db-4d8b-addc-1579e8ef58a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:11.398445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716e9330890d4c57a0d13b8bda0b7a58', 'request_id': 'req-60691fb3-f2db-4d8b-addc-1579e8ef58a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:11.414861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716e9330890d4c57a0d13b8bda0b7a58', 'request_id': 'req-60691fb3-f2db-4d8b-addc-1579e8ef58a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:11.436120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] The token cache is being invalidate because project 716e9330890d4c57a0d13b8bda0b7a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:11.436687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:11.440448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60691fb3-f2db-4d8b-addc-1579e8ef58a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:11.442575 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1567/3154] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:11 2022] DELETE /identity/v3/projects/716e9330890d4c57a0d13b8bda0b7a58 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:11.447923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7104378-c184-4ddd-904f-458e3fa62244 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:11.448495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7104378-c184-4ddd-904f-458e3fa62244 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:11.448847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7104378-c184-4ddd-904f-458e3fa62244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:11.520304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a7104378-c184-4ddd-904f-458e3fa62244 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:11.521708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7104378-c184-4ddd-904f-458e3fa62244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:11.525067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fc588-61be-4598-87ea-b243f53e4212 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:11.525358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fc588-61be-4598-87ea-b243f53e4212 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:11.525640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fc588-61be-4598-87ea-b243f53e4212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:11.584783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-982fc588-61be-4598-87ea-b243f53e4212 None None] MFA Rules not processed for user `c9ac716a6af441a4bc02d8ef11f81487`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:11.601557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-982fc588-61be-4598-87ea-b243f53e4212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:11.640421 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1588/3155] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:11.650935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d452b-d00c-45ff-80c5-b4619f935013 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:11.651299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d452b-d00c-45ff-80c5-b4619f935013 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:11.651971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d452b-d00c-45ff-80c5-b4619f935013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:11.683077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4a1d452b-d00c-45ff-80c5-b4619f935013 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:11.685089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4a1d452b-d00c-45ff-80c5-b4619f935013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:11.698977 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1589/3156] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:11.700516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d452b-d00c-45ff-80c5-b4619f935013 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:11.718255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d452b-d00c-45ff-80c5-b4619f935013 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:11.725879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488534-29b6-4a7b-804e-dfbec578965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:11.726790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488534-29b6-4a7b-804e-dfbec578965f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:11.727304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488534-29b6-4a7b-804e-dfbec578965f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:11.727713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488534-29b6-4a7b-804e-dfbec578965f admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:11.730577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b488534-29b6-4a7b-804e-dfbec578965f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:11.730577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b488534-29b6-4a7b-804e-dfbec578965f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:11.731371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b488534-29b6-4a7b-804e-dfbec578965f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:11.745545 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1568/3157] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:11.775438 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1590/3158] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:56:11.776482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fc588-61be-4598-87ea-b243f53e4212 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:11.809091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fc588-61be-4598-87ea-b243f53e4212 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:11.817674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d461d-b457-43dc-b7da-cfe367f1e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:11.818684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d461d-b457-43dc-b7da-cfe367f1e339 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:11.819197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d461d-b457-43dc-b7da-cfe367f1e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:11.819688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d461d-b457-43dc-b7da-cfe367f1e339 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:11.820575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d461d-b457-43dc-b7da-cfe367f1e339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:11.823563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d461d-b457-43dc-b7da-cfe367f1e339 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:11.892256 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1569/3159] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:11 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:11.895438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488534-29b6-4a7b-804e-dfbec578965f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:11.910552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488534-29b6-4a7b-804e-dfbec578965f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:12.057442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e271d-ae1a-46d1-9acc-2e7539ebd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:12.058344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e271d-ae1a-46d1-9acc-2e7539ebd1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:12.058796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e271d-ae1a-46d1-9acc-2e7539ebd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:12.059233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e271d-ae1a-46d1-9acc-2e7539ebd1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:12.060054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e271d-ae1a-46d1-9acc-2e7539ebd1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:12.063432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e271d-ae1a-46d1-9acc-2e7539ebd1b3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:12.104731 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1591/3160] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:11 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:12.106834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d461d-b457-43dc-b7da-cfe367f1e339 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:12.122855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d461d-b457-43dc-b7da-cfe367f1e339 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:12.129983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0da5b8-f345-4f01-9664-7281c8bca85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:12.130709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0da5b8-f345-4f01-9664-7281c8bca85d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:12.131089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0da5b8-f345-4f01-9664-7281c8bca85d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:12.131463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0da5b8-f345-4f01-9664-7281c8bca85d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:12.132295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0da5b8-f345-4f01-9664-7281c8bca85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:12.134128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0da5b8-f345-4f01-9664-7281c8bca85d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:12.145379 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1570/3161] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:56:12.149476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e271d-ae1a-46d1-9acc-2e7539ebd1b3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:12.160424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e271d-ae1a-46d1-9acc-2e7539ebd1b3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:12.165204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556276b9-4464-446b-85ad-3de9a1a178d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:12.165810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556276b9-4464-446b-85ad-3de9a1a178d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:12.166087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556276b9-4464-446b-85ad-3de9a1a178d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:12.166357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556276b9-4464-446b-85ad-3de9a1a178d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:12.166988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556276b9-4464-446b-85ad-3de9a1a178d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:12.168582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556276b9-4464-446b-85ad-3de9a1a178d1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:12.171540 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:12.181074 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1592/3162] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:56:12.184942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0da5b8-f345-4f01-9664-7281c8bca85d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:12.195928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0da5b8-f345-4f01-9664-7281c8bca85d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:12.202000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51a123-2039-40d4-ad24-19208906e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:12.202583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51a123-2039-40d4-ad24-19208906e0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:12.202958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51a123-2039-40d4-ad24-19208906e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:12.203335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51a123-2039-40d4-ad24-19208906e0cf admin admin] PATH_INFO: `/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02/users/54eec14382964c31809208b579dc63f0/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:12.221367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51a123-2039-40d4-ad24-19208906e0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=68515a7e0aa74f09ac726f0a27dbdc02, user_id=54eec14382964c31809208b579dc63f0, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:12.224199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51a123-2039-40d4-ad24-19208906e0cf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:12.245298 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1571/3163] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:12 2022] PUT /identity/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02/users/54eec14382964c31809208b579dc63f0/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:12.315944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362428c0-28c6-46d2-b94b-55641c44ab64 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:12.316297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362428c0-28c6-46d2-b94b-55641c44ab64 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:12.316614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362428c0-28c6-46d2-b94b-55641c44ab64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:12.354799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-362428c0-28c6-46d2-b94b-55641c44ab64 None None] MFA Rules not processed for user `54eec14382964c31809208b579dc63f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:12.356926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-362428c0-28c6-46d2-b94b-55641c44ab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:12.469419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51a123-2039-40d4-ad24-19208906e0cf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:12.471829 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1593/3164] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:12.496711 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:12.579536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51a123-2039-40d4-ad24-19208906e0cf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:12.587466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4dc01-fb70-4e18-a439-568cba86368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:12.588323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4dc01-fb70-4e18-a439-568cba86368c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:12.588874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4dc01-fb70-4e18-a439-568cba86368c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:12.589295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4dc01-fb70-4e18-a439-568cba86368c admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:12.590359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4dc01-fb70-4e18-a439-568cba86368c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:12.594804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4dc01-fb70-4e18-a439-568cba86368c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:12.632208 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1572/3165] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:12 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:12.636000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362428c0-28c6-46d2-b94b-55641c44ab64 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:12.653887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362428c0-28c6-46d2-b94b-55641c44ab64 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:12.747097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5a10c-5e4f-48e7-9a90-8ede8d78cbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:12.747843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a10c-5e4f-48e7-9a90-8ede8d78cbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:12.748202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a10c-5e4f-48e7-9a90-8ede8d78cbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:12.748438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a10c-5e4f-48e7-9a90-8ede8d78cbe1 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:12.749300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5a10c-5e4f-48e7-9a90-8ede8d78cbe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:12.754206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5a10c-5e4f-48e7-9a90-8ede8d78cbe1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:12.792263 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1594/3166] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:12 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:12.795923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4dc01-fb70-4e18-a439-568cba86368c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:12.814962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4dc01-fb70-4e18-a439-568cba86368c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:12.821591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ce4eb-3825-4f48-ad85-f2373d022252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:12.822398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce4eb-3825-4f48-ad85-f2373d022252 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:12.822800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce4eb-3825-4f48-ad85-f2373d022252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:12.823135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce4eb-3825-4f48-ad85-f2373d022252 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:12.823908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ce4eb-3825-4f48-ad85-f2373d022252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:12.825936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ce4eb-3825-4f48-ad85-f2373d022252 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:12.855219 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1573/3167] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:12.859408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5a10c-5e4f-48e7-9a90-8ede8d78cbe1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:12.882540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5a10c-5e4f-48e7-9a90-8ede8d78cbe1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:12.897348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e0ef-9fa7-409b-b9ea-54fd6cf3099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:12.898179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e0ef-9fa7-409b-b9ea-54fd6cf3099c admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:12.898561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e0ef-9fa7-409b-b9ea-54fd6cf3099c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:12.898935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e0ef-9fa7-409b-b9ea-54fd6cf3099c admin admin] PATH_INFO: `/v3/projects/315d33239f584565aeec6da5879cb48b/users/aa4f4d3f85124b7684912282f0da43e7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:12.922504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92e0ef-9fa7-409b-b9ea-54fd6cf3099c admin admin] RBAC: Authorizing `identity:create_grant(project_id=315d33239f584565aeec6da5879cb48b, user_id=aa4f4d3f85124b7684912282f0da43e7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:12.941006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92e0ef-9fa7-409b-b9ea-54fd6cf3099c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:12.988137 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1595/3168] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:12 2022] PUT /identity/v3/projects/315d33239f584565aeec6da5879cb48b/users/aa4f4d3f85124b7684912282f0da43e7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:12.988571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ce4eb-3825-4f48-ad85-f2373d022252 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:13.037729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ce4eb-3825-4f48-ad85-f2373d022252 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:13.129939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52a113-095d-4adf-a4ec-d027ca44daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:13.130879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a113-095d-4adf-a4ec-d027ca44daf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:13.131167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a113-095d-4adf-a4ec-d027ca44daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:13.131507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a113-095d-4adf-a4ec-d027ca44daf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:13.132304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52a113-095d-4adf-a4ec-d027ca44daf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:13.134107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52a113-095d-4adf-a4ec-d027ca44daf6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:13.156507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e0ef-9fa7-409b-b9ea-54fd6cf3099c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:13.168860 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1574/3169] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:13.170299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e0ef-9fa7-409b-b9ea-54fd6cf3099c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:13.178295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecd4ed-239c-4fa8-a051-5e35eed63367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:13.179497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecd4ed-239c-4fa8-a051-5e35eed63367 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:13.179497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecd4ed-239c-4fa8-a051-5e35eed63367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:13.179854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecd4ed-239c-4fa8-a051-5e35eed63367 admin admin] PATH_INFO: `/v3/projects/315d33239f584565aeec6da5879cb48b/users/aa4f4d3f85124b7684912282f0da43e7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:13.182328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecd4ed-239c-4fa8-a051-5e35eed63367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=315d33239f584565aeec6da5879cb48b, user_id=aa4f4d3f85124b7684912282f0da43e7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:13.186727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecd4ed-239c-4fa8-a051-5e35eed63367 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:13.212241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840ac4-41f6-4a44-8bd4-b6942359ade1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:13.212699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840ac4-41f6-4a44-8bd4-b6942359ade1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:13.213088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840ac4-41f6-4a44-8bd4-b6942359ade1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:13.221222 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1596/3170] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:13 2022] PUT /identity/v3/projects/315d33239f584565aeec6da5879cb48b/users/aa4f4d3f85124b7684912282f0da43e7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:13.250140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fb840ac4-41f6-4a44-8bd4-b6942359ade1 None None] MFA Rules not processed for user `aa4f4d3f85124b7684912282f0da43e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:13.253067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fb840ac4-41f6-4a44-8bd4-b6942359ade1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:13.402032 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1575/3171] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:13.404587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecd4ed-239c-4fa8-a051-5e35eed63367 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:13.427622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecd4ed-239c-4fa8-a051-5e35eed63367 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:13.432396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bcc32-8cbf-4178-9404-840746bd807c tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:13.433046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bcc32-8cbf-4178-9404-840746bd807c tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:13.433715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bcc32-8cbf-4178-9404-840746bd807c tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:13.434110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bcc32-8cbf-4178-9404-840746bd807c tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:13.435199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bcc32-8cbf-4178-9404-840746bd807c tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:13.435517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bcc32-8cbf-4178-9404-840746bd807c tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:13.438266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bcc32-8cbf-4178-9404-840746bd807c tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:13.456140 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1597/3172] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:13.460695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb840ac4-41f6-4a44-8bd4-b6942359ade1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:13.471750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb840ac4-41f6-4a44-8bd4-b6942359ade1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:13.477290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2b623-828c-403c-8e3d-8c5f6a125789 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:13.477940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2b623-828c-403c-8e3d-8c5f6a125789 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:13.478237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2b623-828c-403c-8e3d-8c5f6a125789 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:13.478519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2b623-828c-403c-8e3d-8c5f6a125789 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:13.479168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2b623-828c-403c-8e3d-8c5f6a125789 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:13.481300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2b623-828c-403c-8e3d-8c5f6a125789 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:13.488888 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:13.521313 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1576/3173] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:13 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:13.525551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bcc32-8cbf-4178-9404-840746bd807c tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:13.536569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bcc32-8cbf-4178-9404-840746bd807c tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:13.567019 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:13.614057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4be625-8690-4ac0-8663-58c39dbb5458 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:13.614909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4be625-8690-4ac0-8663-58c39dbb5458 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:13.615303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4be625-8690-4ac0-8663-58c39dbb5458 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:13.615685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4be625-8690-4ac0-8663-58c39dbb5458 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:13.616899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4be625-8690-4ac0-8663-58c39dbb5458 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:13.617339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4be625-8690-4ac0-8663-58c39dbb5458 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:13.620214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4be625-8690-4ac0-8663-58c39dbb5458 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:13.644249 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1598/3174] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:13.788303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2b623-828c-403c-8e3d-8c5f6a125789 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:13.790533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b7f2b623-828c-403c-8e3d-8c5f6a125789 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:13.898358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2b623-828c-403c-8e3d-8c5f6a125789 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:13.906243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2929c-b4a1-4136-b807-2d7aed07e535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:13.907052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2929c-b4a1-4136-b807-2d7aed07e535 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:13.907451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2929c-b4a1-4136-b807-2d7aed07e535 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:13.907792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2929c-b4a1-4136-b807-2d7aed07e535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:13.917673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2929c-b4a1-4136-b807-2d7aed07e535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:13.919303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2929c-b4a1-4136-b807-2d7aed07e535 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:13.932822 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1577/3175] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:13.950966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a36c5-1ce0-4b83-9231-5f2f7452f092 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:13.952822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a36c5-1ce0-4b83-9231-5f2f7452f092 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:13.953630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a36c5-1ce0-4b83-9231-5f2f7452f092 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:13.956565 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1599/3176] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:13.964523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2929c-b4a1-4136-b807-2d7aed07e535 service nova] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:13.981902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2929c-b4a1-4136-b807-2d7aed07e535 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:13.992732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2929c-b4a1-4136-b807-2d7aed07e535 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:13.997694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671b88-d38a-4a0e-973e-d3358c9731fc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:14.000202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671b88-d38a-4a0e-973e-d3358c9731fc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:14.000202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671b88-d38a-4a0e-973e-d3358c9731fc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:14.000202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671b88-d38a-4a0e-973e-d3358c9731fc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/973e53b78eb047b0980c820af4d4f549` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:14.001194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13671b88-d38a-4a0e-973e-d3358c9731fc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=973e53b78eb047b0980c820af4d4f549)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:14.003369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13671b88-d38a-4a0e-973e-d3358c9731fc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:14.005368 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1578/3177] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:13 2022] GET /identity/v3/projects/973e53b78eb047b0980c820af4d4f549 => generated 371 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:14.141499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a36c5-1ce0-4b83-9231-5f2f7452f092 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:14.144035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9f4a36c5-1ce0-4b83-9231-5f2f7452f092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:14.225247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a36c5-1ce0-4b83-9231-5f2f7452f092 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:14.230498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baeb57-e626-4408-8c97-7f987f6e3512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:14.231159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baeb57-e626-4408-8c97-7f987f6e3512 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:14.231448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baeb57-e626-4408-8c97-7f987f6e3512 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:14.231730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baeb57-e626-4408-8c97-7f987f6e3512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:14.234453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a8baeb57-e626-4408-8c97-7f987f6e3512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:14.249919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baeb57-e626-4408-8c97-7f987f6e3512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:14.251738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baeb57-e626-4408-8c97-7f987f6e3512 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:14.271140 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1600/3178] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:14.370942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671b88-d38a-4a0e-973e-d3358c9731fc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:14.371373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-13671b88-d38a-4a0e-973e-d3358c9731fc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:14.397863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6f7d-cf05-4059-b1c5-27c6a830fed8 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:14.398169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6f7d-cf05-4059-b1c5-27c6a830fed8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:14.398445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6f7d-cf05-4059-b1c5-27c6a830fed8 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:14.400212 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1601/3179] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:14.406187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6f7d-cf05-4059-b1c5-27c6a830fed8 None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:14.408460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b24f6f7d-cf05-4059-b1c5-27c6a830fed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:14.431649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6f7d-cf05-4059-b1c5-27c6a830fed8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:14.442808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6f7d-cf05-4059-b1c5-27c6a830fed8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:14.451822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2faaef-0875-4d12-b95a-453f62141a77 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:14.452474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2faaef-0875-4d12-b95a-453f62141a77 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:14.452790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2faaef-0875-4d12-b95a-453f62141a77 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:14.453071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2faaef-0875-4d12-b95a-453f62141a77 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/973e53b78eb047b0980c820af4d4f549` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:14.454556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2faaef-0875-4d12-b95a-453f62141a77 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=973e53b78eb047b0980c820af4d4f549)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:14.458512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2faaef-0875-4d12-b95a-453f62141a77 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:14.461033 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1602/3180] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:14 2022] GET /identity/v3/projects/973e53b78eb047b0980c820af4d4f549 => generated 371 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:56:14.477200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671b88-d38a-4a0e-973e-d3358c9731fc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:14.484005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:14.484825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:14.485897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:14.486415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] PATH_INFO: `/v3/users/310cf7ecbd9c40bdbd1bdbcea54e6a95` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:14.487889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=310cf7ecbd9c40bdbd1bdbcea54e6a95)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:14.490251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:14.589790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310cf7ecbd9c40bdbd1bdbcea54e6a95'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:14.607048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310cf7ecbd9c40bdbd1bdbcea54e6a95'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:14.611549 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:14.623484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310cf7ecbd9c40bdbd1bdbcea54e6a95'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:14.634208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310cf7ecbd9c40bdbd1bdbcea54e6a95'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:14.634945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310cf7ecbd9c40bdbd1bdbcea54e6a95'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:14.642983 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1579/3181] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:14 2022] DELETE /identity/v3/users/310cf7ecbd9c40bdbd1bdbcea54e6a95 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:14.647850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96472eee-4cf0-42e9-85b7-0c2fc80894c1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:14.648371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96472eee-4cf0-42e9-85b7-0c2fc80894c1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:14.648609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96472eee-4cf0-42e9-85b7-0c2fc80894c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:14.674627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-96472eee-4cf0-42e9-85b7-0c2fc80894c1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:14.675968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-96472eee-4cf0-42e9-85b7-0c2fc80894c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:14.815938 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1603/3182] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:14.825924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:14.828213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:14.928395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcd485-3474-4dda-9351-8093e63b3d6c None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:14.928717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcd485-3474-4dda-9351-8093e63b3d6c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:14.928999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcd485-3474-4dda-9351-8093e63b3d6c None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:14.933749 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1604/3183] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:56:14.940565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcd485-3474-4dda-9351-8093e63b3d6c None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:14.942761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7efcd485-3474-4dda-9351-8093e63b3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:14.943107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf8e54-8882-4f30-8bca-2727f5b788c1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:14.948226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0f412-97d8-4b4e-8b49-cabb84e5f27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:14.948893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0f412-97d8-4b4e-8b49-cabb84e5f27e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:14.949883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0f412-97d8-4b4e-8b49-cabb84e5f27e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:14.950162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0f412-97d8-4b4e-8b49-cabb84e5f27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:14.966584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0f412-97d8-4b4e-8b49-cabb84e5f27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:14.970083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0f412-97d8-4b4e-8b49-cabb84e5f27e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:14.986789 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1580/3184] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:15.053746 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:15.136715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcd485-3474-4dda-9351-8093e63b3d6c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:15.140314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7efcd485-3474-4dda-9351-8093e63b3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:15.255776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcd485-3474-4dda-9351-8093e63b3d6c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:15.265431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd55c96-6a92-4b41-a8a3-27cf7fc6f6c5 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:15.268922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd55c96-6a92-4b41-a8a3-27cf7fc6f6c5 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:15.269457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd55c96-6a92-4b41-a8a3-27cf7fc6f6c5 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:15.269906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd55c96-6a92-4b41-a8a3-27cf7fc6f6c5 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/973e53b78eb047b0980c820af4d4f549` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:15.272554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd55c96-6a92-4b41-a8a3-27cf7fc6f6c5 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=973e53b78eb047b0980c820af4d4f549)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:15.294772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd55c96-6a92-4b41-a8a3-27cf7fc6f6c5 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:15.301698 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1605/3185] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:14 2022] GET /identity/v3/projects/973e53b78eb047b0980c820af4d4f549 => generated 371 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:15.349737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0f412-97d8-4b4e-8b49-cabb84e5f27e service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:15.399146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0f412-97d8-4b4e-8b49-cabb84e5f27e service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:15.429104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:15.429393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:15.430743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:15.431778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/973e53b78eb047b0980c820af4d4f549` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:15.438139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:delete_project(project_id=973e53b78eb047b0980c820af4d4f549)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:15.449630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:15.613092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973e53b78eb047b0980c820af4d4f549', 'request_id': 'req-ba0a318b-e5aa-45b5-9566-f34beca87a89'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:15.626495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973e53b78eb047b0980c820af4d4f549', 'request_id': 'req-ba0a318b-e5aa-45b5-9566-f34beca87a89'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:15.636027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973e53b78eb047b0980c820af4d4f549', 'request_id': 'req-ba0a318b-e5aa-45b5-9566-f34beca87a89'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:15.654231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] The token cache is being invalidate because project 973e53b78eb047b0980c820af4d4f549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:15.655139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:15.655984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:15.657991 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1581/3186] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:15 2022] DELETE /identity/v3/projects/973e53b78eb047b0980c820af4d4f549 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:15.683219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d416b9b-0ce7-444d-8a10-c970288f82c1 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:15.683686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d416b9b-0ce7-444d-8a10-c970288f82c1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:15.685488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d416b9b-0ce7-444d-8a10-c970288f82c1 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:15.689007 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1606/3187] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:15.696656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:15.698783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:15.925877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:15.928498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:15.935393 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:16.095386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a318b-e5aa-45b5-9566-f34beca87a89 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:16.108478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e8024-33ad-43f2-8bf2-677fa63d4061 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:16.108780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e8024-33ad-43f2-8bf2-677fa63d4061 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:16.108880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e8024-33ad-43f2-8bf2-677fa63d4061 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:16.109558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e8024-33ad-43f2-8bf2-677fa63d4061 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:16.112226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e8024-33ad-43f2-8bf2-677fa63d4061 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=68515a7e0aa74f09ac726f0a27dbdc02)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:16.114521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e8024-33ad-43f2-8bf2-677fa63d4061 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:16.123509 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1582/3188] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:15 2022] GET /identity/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02 => generated 373 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:16.145104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d416b9b-0ce7-444d-8a10-c970288f82c1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:16.180549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d416b9b-0ce7-444d-8a10-c970288f82c1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:16.196368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235d6a-fb33-462c-aaa7-1431621510b8 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:16.197065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235d6a-fb33-462c-aaa7-1431621510b8 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:16.197356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235d6a-fb33-462c-aaa7-1431621510b8 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:16.197633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235d6a-fb33-462c-aaa7-1431621510b8 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:16.198313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235d6a-fb33-462c-aaa7-1431621510b8 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:16.198625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235d6a-fb33-462c-aaa7-1431621510b8 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:16.218029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235d6a-fb33-462c-aaa7-1431621510b8 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:16.250033 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1607/3189] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:16.253728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235d6a-fb33-462c-aaa7-1431621510b8 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:16.257639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb0f5a-d952-4794-b531-d663eb2458ba None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:16.258045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb0f5a-d952-4794-b531-d663eb2458ba None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:16.258446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb0f5a-d952-4794-b531-d663eb2458ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:16.266960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235d6a-fb33-462c-aaa7-1431621510b8 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:16.280731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd645405-1ac3-4bf2-9d79-b400a5a86be9 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:16.280731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd645405-1ac3-4bf2-9d79-b400a5a86be9 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:16.282330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd645405-1ac3-4bf2-9d79-b400a5a86be9 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:16.282834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd645405-1ac3-4bf2-9d79-b400a5a86be9 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:16.283653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd645405-1ac3-4bf2-9d79-b400a5a86be9 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:16.290689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd645405-1ac3-4bf2-9d79-b400a5a86be9 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:16.308816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cdcb0f5a-d952-4794-b531-d663eb2458ba None None] MFA Rules not processed for user `c9ac716a6af441a4bc02d8ef11f81487`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:16.310014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cdcb0f5a-d952-4794-b531-d663eb2458ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:16.363868 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1608/3190] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:16 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:16.369663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd645405-1ac3-4bf2-9d79-b400a5a86be9 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:16.435562 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1583/3191] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:16.465135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd645405-1ac3-4bf2-9d79-b400a5a86be9 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:16.471469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c8303-593d-4696-bcc1-e1db2916efb6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:16.472247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c8303-593d-4696-bcc1-e1db2916efb6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:16.473348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c8303-593d-4696-bcc1-e1db2916efb6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:16.473348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c8303-593d-4696-bcc1-e1db2916efb6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:16.474034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c8303-593d-4696-bcc1-e1db2916efb6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:16.474517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c8303-593d-4696-bcc1-e1db2916efb6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:16.476311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c8303-593d-4696-bcc1-e1db2916efb6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:16.495471 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1609/3192] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:16.961893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb0f5a-d952-4794-b531-d663eb2458ba None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:16.964077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cdcb0f5a-d952-4794-b531-d663eb2458ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:17.164524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb0f5a-d952-4794-b531-d663eb2458ba None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:17.249108 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:17.259589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:17.265916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:17.266215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:17.266497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] PATH_INFO: `/v3/projects/af067aa2424f4529b0fe9908bdc1e1c1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:17.269884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af067aa2424f4529b0fe9908bdc1e1c1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:17.271824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:17.360838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af067aa2424f4529b0fe9908bdc1e1c1', 'request_id': 'req-bbd1e961-25e0-49d0-a466-51434c31e294'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:17.372080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af067aa2424f4529b0fe9908bdc1e1c1', 'request_id': 'req-bbd1e961-25e0-49d0-a466-51434c31e294'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:17.381423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af067aa2424f4529b0fe9908bdc1e1c1', 'request_id': 'req-bbd1e961-25e0-49d0-a466-51434c31e294'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:17.399294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] The token cache is being invalidate because project af067aa2424f4529b0fe9908bdc1e1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:17.399673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:17.400336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bbd1e961-25e0-49d0-a466-51434c31e294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:17.402563 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1584/3193] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:16 2022] DELETE /identity/v3/projects/af067aa2424f4529b0fe9908bdc1e1c1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:17.408037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd27455-323c-4201-b539-68a6a8aac73d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:17.408587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd27455-323c-4201-b539-68a6a8aac73d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:17.408587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd27455-323c-4201-b539-68a6a8aac73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:17.444956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dfd27455-323c-4201-b539-68a6a8aac73d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:17.446421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dfd27455-323c-4201-b539-68a6a8aac73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:17.499974 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:17.561897 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1610/3194] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:17.571125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228789e-1fdb-41ba-b774-994174e859ab None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:17.572275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228789e-1fdb-41ba-b774-994174e859ab None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:17.572854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228789e-1fdb-41ba-b774-994174e859ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:17.618502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c228789e-1fdb-41ba-b774-994174e859ab None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:17.621032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c228789e-1fdb-41ba-b774-994174e859ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:17.633463 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1585/3195] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:17.638470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd27455-323c-4201-b539-68a6a8aac73d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:17.662871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd27455-323c-4201-b539-68a6a8aac73d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:17.671751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00d17c-9e15-4193-bbfc-8cb44d5623b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:17.672801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00d17c-9e15-4193-bbfc-8cb44d5623b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:17.673585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00d17c-9e15-4193-bbfc-8cb44d5623b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:17.674509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00d17c-9e15-4193-bbfc-8cb44d5623b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:17.675749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00d17c-9e15-4193-bbfc-8cb44d5623b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:17.676345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00d17c-9e15-4193-bbfc-8cb44d5623b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:17.679092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00d17c-9e15-4193-bbfc-8cb44d5623b1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:17.712697 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1611/3196] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:17.717589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228789e-1fdb-41ba-b774-994174e859ab None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:17.731399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228789e-1fdb-41ba-b774-994174e859ab None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:17.744029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa3002-4889-4cf8-aed0-dc9063da2877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:17.744716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa3002-4889-4cf8-aed0-dc9063da2877 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:17.744998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa3002-4889-4cf8-aed0-dc9063da2877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:17.745273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa3002-4889-4cf8-aed0-dc9063da2877 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:17.746088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa3002-4889-4cf8-aed0-dc9063da2877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:17.750929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa3002-4889-4cf8-aed0-dc9063da2877 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:17.797802 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1586/3197] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:17 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:17.803341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00d17c-9e15-4193-bbfc-8cb44d5623b1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:17.821428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00d17c-9e15-4193-bbfc-8cb44d5623b1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:17.869055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b287fd-0e2d-426f-a720-ffb04b845e70 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:17.869421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b287fd-0e2d-426f-a720-ffb04b845e70 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:17.869794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b287fd-0e2d-426f-a720-ffb04b845e70 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:17.871723 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1587/3198] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:17.877184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b287fd-0e2d-426f-a720-ffb04b845e70 None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:17.879802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-97b287fd-0e2d-426f-a720-ffb04b845e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:17.955404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1ba57-0214-4e80-80bd-94425caa164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:17.956392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1ba57-0214-4e80-80bd-94425caa164b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:17.956904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1ba57-0214-4e80-80bd-94425caa164b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:17.957357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1ba57-0214-4e80-80bd-94425caa164b admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:17.958157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1ba57-0214-4e80-80bd-94425caa164b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:17.961545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1ba57-0214-4e80-80bd-94425caa164b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:18.002806 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1612/3199] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:17 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:18.007073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1ba57-0214-4e80-80bd-94425caa164b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:18.029785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1ba57-0214-4e80-80bd-94425caa164b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:18.037998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955e295-18e0-458d-9b00-c30b350e0c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:18.038899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e295-18e0-458d-9b00-c30b350e0c53 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:18.039354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e295-18e0-458d-9b00-c30b350e0c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:18.040263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e295-18e0-458d-9b00-c30b350e0c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:18.041390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955e295-18e0-458d-9b00-c30b350e0c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:18.048152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955e295-18e0-458d-9b00-c30b350e0c53 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:18.078078 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1613/3200] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:56:18.079338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b287fd-0e2d-426f-a720-ffb04b845e70 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:18.081307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-97b287fd-0e2d-426f-a720-ffb04b845e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:18.082952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955e295-18e0-458d-9b00-c30b350e0c53 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:18.095759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955e295-18e0-458d-9b00-c30b350e0c53 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:18.105365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70482f55-0e87-4396-83ec-a1b5c7d706d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:18.106516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70482f55-0e87-4396-83ec-a1b5c7d706d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:18.108184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70482f55-0e87-4396-83ec-a1b5c7d706d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:18.108809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70482f55-0e87-4396-83ec-a1b5c7d706d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:18.111677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70482f55-0e87-4396-83ec-a1b5c7d706d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:18.113962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70482f55-0e87-4396-83ec-a1b5c7d706d0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:18.128227 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1614/3201] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:18.132036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70482f55-0e87-4396-83ec-a1b5c7d706d0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:18.144757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70482f55-0e87-4396-83ec-a1b5c7d706d0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:18.155218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61009b-c0bc-40df-a399-70cb48f41e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:18.156823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61009b-c0bc-40df-a399-70cb48f41e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:18.157929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61009b-c0bc-40df-a399-70cb48f41e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:18.159636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61009b-c0bc-40df-a399-70cb48f41e2a admin admin] PATH_INFO: `/v3/projects/0614a520da8b41d4870535149cca5e6c/users/ac3b9c0afb184415b4dfd1d0a62f7418/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:18.171162 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:18.190650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b287fd-0e2d-426f-a720-ffb04b845e70 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:18.201930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df13052-2e6b-47d6-acac-f01f38a9ef72 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:18.202718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df13052-2e6b-47d6-acac-f01f38a9ef72 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:18.203003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df13052-2e6b-47d6-acac-f01f38a9ef72 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:18.203280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df13052-2e6b-47d6-acac-f01f38a9ef72 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/385469b4d94c4995bb06bd61b8b4a98a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:18.204920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df13052-2e6b-47d6-acac-f01f38a9ef72 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=385469b4d94c4995bb06bd61b8b4a98a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:18.207158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df13052-2e6b-47d6-acac-f01f38a9ef72 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:18.208369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61009b-c0bc-40df-a399-70cb48f41e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0614a520da8b41d4870535149cca5e6c, user_id=ac3b9c0afb184415b4dfd1d0a62f7418, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:18.211110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61009b-c0bc-40df-a399-70cb48f41e2a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:18.216008 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1588/3202] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:17 2022] GET /identity/v3/projects/385469b4d94c4995bb06bd61b8b4a98a => generated 371 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:56:18.242340 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1615/3203] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:18 2022] PUT /identity/v3/projects/0614a520da8b41d4870535149cca5e6c/users/ac3b9c0afb184415b4dfd1d0a62f7418/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:18.244907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3b4d-051c-49be-8826-ec849e794aef None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:18.245226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3b4d-051c-49be-8826-ec849e794aef None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:18.245503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3b4d-051c-49be-8826-ec849e794aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:18.333867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-20fc3b4d-051c-49be-8826-ec849e794aef None None] MFA Rules not processed for user `ac3b9c0afb184415b4dfd1d0a62f7418`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:18.335600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-20fc3b4d-051c-49be-8826-ec849e794aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:18.472134 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1589/3204] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:18.651466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5788e-9d94-43fe-acd4-1420de4935e6 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:18.651981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5788e-9d94-43fe-acd4-1420de4935e6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:18.652074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5788e-9d94-43fe-acd4-1420de4935e6 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:18.653569 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1616/3205] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:18.670782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3b4d-051c-49be-8826-ec849e794aef None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:18.782654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3b4d-051c-49be-8826-ec849e794aef None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:18.871835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3b4d-051c-49be-8826-ec849e794aef None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:18.878790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ec30b-b92b-4f42-86a5-8696426361e1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:18.880252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec30b-b92b-4f42-86a5-8696426361e1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:18.880545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec30b-b92b-4f42-86a5-8696426361e1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:18.880936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec30b-b92b-4f42-86a5-8696426361e1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/385469b4d94c4995bb06bd61b8b4a98a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:18.882267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ec30b-b92b-4f42-86a5-8696426361e1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=385469b4d94c4995bb06bd61b8b4a98a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:18.884338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ec30b-b92b-4f42-86a5-8696426361e1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:18.898062 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1590/3206] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:18 2022] GET /identity/v3/projects/385469b4d94c4995bb06bd61b8b4a98a => generated 371 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:18.954212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5788e-9d94-43fe-acd4-1420de4935e6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:18.960582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ec30b-b92b-4f42-86a5-8696426361e1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:18.977577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ec30b-b92b-4f42-86a5-8696426361e1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:18.983973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5788e-9d94-43fe-acd4-1420de4935e6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:18.987806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947a043-4d0f-4729-a9a9-454236e6d0b6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:18.988735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947a043-4d0f-4729-a9a9-454236e6d0b6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:18.989086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947a043-4d0f-4729-a9a9-454236e6d0b6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:18.989372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947a043-4d0f-4729-a9a9-454236e6d0b6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:18.990033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947a043-4d0f-4729-a9a9-454236e6d0b6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:18.990345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947a043-4d0f-4729-a9a9-454236e6d0b6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:18.992615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947a043-4d0f-4729-a9a9-454236e6d0b6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:18.993887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac42f8-c4ff-4101-b8db-311ac6b9f70a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:18.996268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac42f8-c4ff-4101-b8db-311ac6b9f70a service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:18.996715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac42f8-c4ff-4101-b8db-311ac6b9f70a service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:18.997009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac42f8-c4ff-4101-b8db-311ac6b9f70a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:19.007666 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1591/3207] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:56:19.010162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac42f8-c4ff-4101-b8db-311ac6b9f70a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:19.013035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac42f8-c4ff-4101-b8db-311ac6b9f70a service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:19.013238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947a043-4d0f-4729-a9a9-454236e6d0b6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:19.024841 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1617/3208] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:19.030322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947a043-4d0f-4729-a9a9-454236e6d0b6 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:19.036720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1232e9-5a4c-4b43-b5d3-d863a3d0f1c4 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:19.037479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1232e9-5a4c-4b43-b5d3-d863a3d0f1c4 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:19.037998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1232e9-5a4c-4b43-b5d3-d863a3d0f1c4 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:19.038557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1232e9-5a4c-4b43-b5d3-d863a3d0f1c4 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:19.039414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1232e9-5a4c-4b43-b5d3-d863a3d0f1c4 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:19.054162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1232e9-5a4c-4b43-b5d3-d863a3d0f1c4 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:19.065614 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:19.090596 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1592/3209] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:19 2022] POST /identity/v3/users => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:19.095711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac42f8-c4ff-4101-b8db-311ac6b9f70a service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:19.114389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac42f8-c4ff-4101-b8db-311ac6b9f70a service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:19.126633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:19.128040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:19.129073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:19.133144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:19.134060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:19.134409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:19.136058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:19.182595 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1618/3210] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:19.813833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a892fe-5f64-4072-a5e1-399ef6aeafc1 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:19.814300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a892fe-5f64-4072-a5e1-399ef6aeafc1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:19.814300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a892fe-5f64-4072-a5e1-399ef6aeafc1 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:19.815633 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1593/3211] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:19.822125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:19.855825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:19.881933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90cbd2-ec23-41e1-be13-6848d426a52a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:19.897352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:19.898708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:19.898997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:19.899271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/385469b4d94c4995bb06bd61b8b4a98a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:19.905035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=385469b4d94c4995bb06bd61b8b4a98a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:19.907888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:19.911101 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1619/3212] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:19 2022] GET /identity/v3/projects/385469b4d94c4995bb06bd61b8b4a98a => generated 371 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:20.314121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209b3e0-5290-4ac2-a501-c8408eca8427 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:20.314450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209b3e0-5290-4ac2-a501-c8408eca8427 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:20.314725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209b3e0-5290-4ac2-a501-c8408eca8427 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:20.318548 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1594/3213] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:20.329287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:20.331336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:20.393087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:20.423737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0402d3-af8e-4806-a7dc-5fba91e65430 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:20.437745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d541-3c17-42a0-abf9-8b74f501d1d7 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:20.438418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d541-3c17-42a0-abf9-8b74f501d1d7 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:20.438698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d541-3c17-42a0-abf9-8b74f501d1d7 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:20.440308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d541-3c17-42a0-abf9-8b74f501d1d7 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/385469b4d94c4995bb06bd61b8b4a98a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:20.443398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425d541-3c17-42a0-abf9-8b74f501d1d7 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=385469b4d94c4995bb06bd61b8b4a98a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:20.446220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425d541-3c17-42a0-abf9-8b74f501d1d7 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:20.452429 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1620/3214] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:20 2022] GET /identity/v3/projects/385469b4d94c4995bb06bd61b8b4a98a => generated 371 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:20.509687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209b3e0-5290-4ac2-a501-c8408eca8427 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:20.539218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209b3e0-5290-4ac2-a501-c8408eca8427 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:20.550738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:20.551542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:20.551829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:20.552104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/users/f2bf37b718d04131b32324bfa197f746` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:20.598030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f2bf37b718d04131b32324bfa197f746)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:20.600025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:20.733456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2bf37b718d04131b32324bfa197f746'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:20.790183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2bf37b718d04131b32324bfa197f746'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:20.803174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2bf37b718d04131b32324bfa197f746'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:20.814488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2bf37b718d04131b32324bfa197f746'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:20.816088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86eb08e7-3a93-41f3-867c-1d8480533413 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2bf37b718d04131b32324bfa197f746'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:20.837944 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1595/3215] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:20 2022] DELETE /identity/v3/users/f2bf37b718d04131b32324bfa197f746 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:20.845892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d541-3c17-42a0-abf9-8b74f501d1d7 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:20.848388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2425d541-3c17-42a0-abf9-8b74f501d1d7 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:20.867687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d541-3c17-42a0-abf9-8b74f501d1d7 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:20.895176 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:20.964694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:20.965691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:20.965912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:20.966308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/385469b4d94c4995bb06bd61b8b4a98a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:20.968433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:delete_project(project_id=385469b4d94c4995bb06bd61b8b4a98a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:20.973565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:21.071533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385469b4d94c4995bb06bd61b8b4a98a', 'request_id': 'req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:21.090385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385469b4d94c4995bb06bd61b8b4a98a', 'request_id': 'req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:21.102288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385469b4d94c4995bb06bd61b8b4a98a', 'request_id': 'req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:21.122756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] The token cache is being invalidate because project 385469b4d94c4995bb06bd61b8b4a98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:21.124188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:21.125195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:21.126989 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1621/3216] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:20 2022] DELETE /identity/v3/projects/385469b4d94c4995bb06bd61b8b4a98a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:21.297118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead98249-c474-4508-80ce-4aba85697d7a None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:21.297511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead98249-c474-4508-80ce-4aba85697d7a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:21.297736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead98249-c474-4508-80ce-4aba85697d7a None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:21.300339 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1596/3217] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:21.307869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:21.310251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:21.473251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:21.477638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:21.594547 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:21.623656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb72e2-e4d6-4c7c-b484-5568ca0862df tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:21.629811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:21.629972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:21.630221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:21.630551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:21.631934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=68515a7e0aa74f09ac726f0a27dbdc02)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:21.634102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:21.636232 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1622/3218] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:21 2022] GET /identity/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02 => generated 373 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:21.700252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8183c-7bce-40a9-a82b-ac2fbe8f4582 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:21.700543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8183c-7bce-40a9-a82b-ac2fbe8f4582 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:21.700851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8183c-7bce-40a9-a82b-ac2fbe8f4582 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:21.702767 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1597/3219] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:21.710891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:21.713553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:21.733561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:21.749101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534c75-1b68-48d9-a9ac-5fc70ce46259 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:21.756967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2faa0-5400-4375-9066-5310a26978cc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:21.757662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2faa0-5400-4375-9066-5310a26978cc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:21.758052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2faa0-5400-4375-9066-5310a26978cc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:21.758484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2faa0-5400-4375-9066-5310a26978cc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:21.759846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2faa0-5400-4375-9066-5310a26978cc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=68515a7e0aa74f09ac726f0a27dbdc02)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:21.762212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2faa0-5400-4375-9066-5310a26978cc tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:21.774063 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1623/3220] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:21 2022] GET /identity/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02 => generated 373 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:21.827380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8183c-7bce-40a9-a82b-ac2fbe8f4582 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:21.831042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8af8183c-7bce-40a9-a82b-ac2fbe8f4582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:21.972760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8183c-7bce-40a9-a82b-ac2fbe8f4582 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:21.978366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:21.979033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:21.979340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:21.979622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] PATH_INFO: `/v3/users/cdea18bdbdad41babeb869506d9e602f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:21.980901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdea18bdbdad41babeb869506d9e602f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:21.983182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:22.074869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdea18bdbdad41babeb869506d9e602f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.081660 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=3,keystone:SELECT=79,keystone:DELETE=18 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:22.102432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdea18bdbdad41babeb869506d9e602f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.118818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdea18bdbdad41babeb869506d9e602f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.128352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdea18bdbdad41babeb869506d9e602f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.129300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdea18bdbdad41babeb869506d9e602f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.135812 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1598/3221] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:21 2022] DELETE /identity/v3/users/cdea18bdbdad41babeb869506d9e602f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:22.283245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126db48-6ff8-4364-8993-6fd7e3c9d3b2 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:22.283842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126db48-6ff8-4364-8993-6fd7e3c9d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:22.283842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126db48-6ff8-4364-8993-6fd7e3c9d3b2 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:22.284994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1624/3222] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:56:22.299073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:56:22.301400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:22.464433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:22.468496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:22.564124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126db48-6ff8-4364-8993-6fd7e3c9d3b2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:22.566081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5126db48-6ff8-4364-8993-6fd7e3c9d3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:22.632226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864faa97-165a-4462-9719-a06546a653c0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:22.651159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8ae39-77ce-484d-a9ac-b49ef77e0e3b tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4f4d3f85124b7684912282f0da43e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '315d33239f584565aeec6da5879cb48b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:22.651819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8ae39-77ce-484d-a9ac-b49ef77e0e3b tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:22.652102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8ae39-77ce-484d-a9ac-b49ef77e0e3b tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:22.652382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8ae39-77ce-484d-a9ac-b49ef77e0e3b tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] PATH_INFO: `/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:22.653576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8ae39-77ce-484d-a9ac-b49ef77e0e3b tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorizing `identity:get_project(project_id=68515a7e0aa74f09ac726f0a27dbdc02)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:22.657006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8ae39-77ce-484d-a9ac-b49ef77e0e3b tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:22.668945 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1599/3223] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:56:22 2022] GET /identity/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02 => generated 373 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:22.718030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126db48-6ff8-4364-8993-6fd7e3c9d3b2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:22.730137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:22.730837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:22.731151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:22.731436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] PATH_INFO: `/v3/projects/9c2fa98925ac4de19cd7cba6ef8b3b2c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:22.733474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2fa98925ac4de19cd7cba6ef8b3b2c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:22.735048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:22.845931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'request_id': 'req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.864953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'request_id': 'req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.894167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'request_id': 'req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.916299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] The token cache is being invalidate because project 9c2fa98925ac4de19cd7cba6ef8b3b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:22.917257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.917972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae216e95-dcbf-4cfe-b804-6b1094c48ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:22.919956 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1625/3224] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:22 2022] DELETE /identity/v3/projects/9c2fa98925ac4de19cd7cba6ef8b3b2c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:22.926057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29a66-0c99-4956-aeae-c792f750c56c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:22.926576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29a66-0c99-4956-aeae-c792f750c56c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:22.926576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29a66-0c99-4956-aeae-c792f750c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:22.971060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dac29a66-0c99-4956-aeae-c792f750c56c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:22.972296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dac29a66-0c99-4956-aeae-c792f750c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:23.158923 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1600/3225] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:23.170176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24d7f-0511-428e-97ba-ae9f911164f7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.171077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24d7f-0511-428e-97ba-ae9f911164f7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.171460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24d7f-0511-428e-97ba-ae9f911164f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.204347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29a66-0c99-4956-aeae-c792f750c56c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:23.206072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dac29a66-0c99-4956-aeae-c792f750c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:23.231115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fba24d7f-0511-428e-97ba-ae9f911164f7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:23.233331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29a66-0c99-4956-aeae-c792f750c56c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:23.234665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fba24d7f-0511-428e-97ba-ae9f911164f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:23.246159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:23.246809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.247091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.247876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] PATH_INFO: `/v3/users/54eec14382964c31809208b579dc63f0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.252061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54eec14382964c31809208b579dc63f0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:23.259453 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1626/3226] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:23.259962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:23.264103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24d7f-0511-428e-97ba-ae9f911164f7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:23.270208 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:23.319288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24d7f-0511-428e-97ba-ae9f911164f7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:23.341507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edfb07-7a4c-4454-beaf-df47bbfaa367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:23.345407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edfb07-7a4c-4454-beaf-df47bbfaa367 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.345729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edfb07-7a4c-4454-beaf-df47bbfaa367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.346474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edfb07-7a4c-4454-beaf-df47bbfaa367 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.349426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edfb07-7a4c-4454-beaf-df47bbfaa367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:23.351612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edfb07-7a4c-4454-beaf-df47bbfaa367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:23.359947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edfb07-7a4c-4454-beaf-df47bbfaa367 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:23.430502 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1627/3227] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:56:23.432698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edfb07-7a4c-4454-beaf-df47bbfaa367 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:23.454944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edfb07-7a4c-4454-beaf-df47bbfaa367 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:23.456400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54eec14382964c31809208b579dc63f0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:23.472843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce9cc1-8b4e-44b4-b8a5-e6df96173103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:23.473733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce9cc1-8b4e-44b4-b8a5-e6df96173103 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.476091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce9cc1-8b4e-44b4-b8a5-e6df96173103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.476741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce9cc1-8b4e-44b4-b8a5-e6df96173103 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.477499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce9cc1-8b4e-44b4-b8a5-e6df96173103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:23.482330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce9cc1-8b4e-44b4-b8a5-e6df96173103 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:23.505820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54eec14382964c31809208b579dc63f0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:23.531493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54eec14382964c31809208b579dc63f0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:23.549715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54eec14382964c31809208b579dc63f0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:23.551102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-93742cb3-a3a2-434b-b2ff-97cc38da1b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54eec14382964c31809208b579dc63f0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:23.569845 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1601/3228] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:23 2022] DELETE /identity/v3/users/54eec14382964c31809208b579dc63f0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:23.574473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c503-cc6b-4c7c-8c7d-f96599480b36 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.575157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c503-cc6b-4c7c-8c7d-f96599480b36 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.577090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c503-cc6b-4c7c-8c7d-f96599480b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.580283 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1628/3229] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:23 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:23.582353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce9cc1-8b4e-44b4-b8a5-e6df96173103 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:23.584563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4fce9cc1-8b4e-44b4-b8a5-e6df96173103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:23.615561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f463c503-cc6b-4c7c-8c7d-f96599480b36 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:23.618982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f463c503-cc6b-4c7c-8c7d-f96599480b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:23.637097 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:23.713107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce9cc1-8b4e-44b4-b8a5-e6df96173103 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:23.724642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410628be-73cc-4b63-a0df-87018ea66010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:23.726416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410628be-73cc-4b63-a0df-87018ea66010 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.726903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410628be-73cc-4b63-a0df-87018ea66010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.728657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410628be-73cc-4b63-a0df-87018ea66010 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.729933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410628be-73cc-4b63-a0df-87018ea66010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:23.732672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410628be-73cc-4b63-a0df-87018ea66010 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:23.751546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1602/3230] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:23.769226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c503-cc6b-4c7c-8c7d-f96599480b36 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:23.770903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f463c503-cc6b-4c7c-8c7d-f96599480b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:23.784266 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1629/3231] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:23 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:23.786675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410628be-73cc-4b63-a0df-87018ea66010 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:23.818685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410628be-73cc-4b63-a0df-87018ea66010 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:23.824959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae47f0f-01c6-4de1-8e1b-dc9b7bae55bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:23.826736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae47f0f-01c6-4de1-8e1b-dc9b7bae55bd admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.827281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae47f0f-01c6-4de1-8e1b-dc9b7bae55bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.827821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae47f0f-01c6-4de1-8e1b-dc9b7bae55bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.828767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae47f0f-01c6-4de1-8e1b-dc9b7bae55bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:23.830861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae47f0f-01c6-4de1-8e1b-dc9b7bae55bd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:23.845249 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1630/3232] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:56:23.850834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae47f0f-01c6-4de1-8e1b-dc9b7bae55bd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:23.868092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae47f0f-01c6-4de1-8e1b-dc9b7bae55bd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:23.874343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a7e57-03d6-49f6-a996-8375db3cd1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:23.875250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7e57-03d6-49f6-a996-8375db3cd1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.875658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7e57-03d6-49f6-a996-8375db3cd1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.878062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7e57-03d6-49f6-a996-8375db3cd1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.878746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c503-cc6b-4c7c-8c7d-f96599480b36 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:23.878942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a7e57-03d6-49f6-a996-8375db3cd1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:23.880696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a7e57-03d6-49f6-a996-8375db3cd1a6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:23.883332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ee94a-f7cc-457e-9dd1-ea09b1f82f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:23.884273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee94a-f7cc-457e-9dd1-ea09b1f82f35 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.884878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee94a-f7cc-457e-9dd1-ea09b1f82f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.885338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee94a-f7cc-457e-9dd1-ea09b1f82f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.899977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ee94a-f7cc-457e-9dd1-ea09b1f82f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:23.902772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ee94a-f7cc-457e-9dd1-ea09b1f82f35 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:23.912036 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1631/3233] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:23.916012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1603/3234] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:23.916495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a7e57-03d6-49f6-a996-8375db3cd1a6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:23.933283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a7e57-03d6-49f6-a996-8375db3cd1a6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:23.940731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d5a9f-11ca-4ec1-8008-885dd1f62415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:23.941797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d5a9f-11ca-4ec1-8008-885dd1f62415 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:23.942341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d5a9f-11ca-4ec1-8008-885dd1f62415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:23.942885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d5a9f-11ca-4ec1-8008-885dd1f62415 admin admin] PATH_INFO: `/v3/projects/01f3f08dd5ca42488a2c22e7f1ebf71f/users/73c91ca45a0a4b3c9499a85bde9e8bb1/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:23.967854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d5a9f-11ca-4ec1-8008-885dd1f62415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f3f08dd5ca42488a2c22e7f1ebf71f, user_id=73c91ca45a0a4b3c9499a85bde9e8bb1, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:23.971883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d5a9f-11ca-4ec1-8008-885dd1f62415 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:23.994318 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1632/3235] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:23 2022] PUT /identity/v3/projects/01f3f08dd5ca42488a2c22e7f1ebf71f/users/73c91ca45a0a4b3c9499a85bde9e8bb1/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:23.999619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919a472-76bb-4bb6-b2c4-e33ec3800ce0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:24.001280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919a472-76bb-4bb6-b2c4-e33ec3800ce0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:24.001962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919a472-76bb-4bb6-b2c4-e33ec3800ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:24.063667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2919a472-76bb-4bb6-b2c4-e33ec3800ce0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:24.065270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2919a472-76bb-4bb6-b2c4-e33ec3800ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:24.118985 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:24.185271 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1604/3236] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:24.198634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d5a9f-11ca-4ec1-8008-885dd1f62415 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:24.298684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d5a9f-11ca-4ec1-8008-885dd1f62415 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:24.304967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919a472-76bb-4bb6-b2c4-e33ec3800ce0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:24.306566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2919a472-76bb-4bb6-b2c4-e33ec3800ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:24.332448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ab362-d5f6-4887-9d5a-e9a7161d5614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:24.333840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ab362-d5f6-4887-9d5a-e9a7161d5614 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:24.334354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ab362-d5f6-4887-9d5a-e9a7161d5614 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:24.334832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ab362-d5f6-4887-9d5a-e9a7161d5614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:24.347943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ab362-d5f6-4887-9d5a-e9a7161d5614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:24.350668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ab362-d5f6-4887-9d5a-e9a7161d5614 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:24.357257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919a472-76bb-4bb6-b2c4-e33ec3800ce0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:24.365500 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1633/3237] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:24.367117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:24.367924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:24.368382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:24.368697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] PATH_INFO: `/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:24.370491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=68515a7e0aa74f09ac726f0a27dbdc02)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:24.374075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:24.503025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68515a7e0aa74f09ac726f0a27dbdc02', 'request_id': 'req-2b7fd977-880b-4b97-bbc8-4c2776836ced'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:24.523963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68515a7e0aa74f09ac726f0a27dbdc02', 'request_id': 'req-2b7fd977-880b-4b97-bbc8-4c2776836ced'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:24.546638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68515a7e0aa74f09ac726f0a27dbdc02', 'request_id': 'req-2b7fd977-880b-4b97-bbc8-4c2776836ced'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:24.569873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] The token cache is being invalidate because project 68515a7e0aa74f09ac726f0a27dbdc02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:24.570090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:24.573296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:24.586454 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1605/3238] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:24 2022] DELETE /identity/v3/projects/68515a7e0aa74f09ac726f0a27dbdc02 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:24.590715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ab362-d5f6-4887-9d5a-e9a7161d5614 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:24.611450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ab362-d5f6-4887-9d5a-e9a7161d5614 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:24.767294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:24.767955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:24.768233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:24.769571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] PATH_INFO: `/v3/users/aa4f4d3f85124b7684912282f0da43e7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:24.772083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4f4d3f85124b7684912282f0da43e7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:24.777183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:24.839561 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:24.895352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4f4d3f85124b7684912282f0da43e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:24.978001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4f4d3f85124b7684912282f0da43e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:24.999895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4f4d3f85124b7684912282f0da43e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.026785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4f4d3f85124b7684912282f0da43e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.028547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ecc12796-3026-4d27-94a2-3ecac5cbcf62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4f4d3f85124b7684912282f0da43e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.054277 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1634/3239] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:24 2022] DELETE /identity/v3/users/aa4f4d3f85124b7684912282f0da43e7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:25.430790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:25.432499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:25.445823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fd977-880b-4b97-bbc8-4c2776836ced admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:25.516650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:25.517314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:25.517597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:25.518335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] PATH_INFO: `/v3/projects/315d33239f584565aeec6da5879cb48b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:25.519300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=315d33239f584565aeec6da5879cb48b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:25.521825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:25.586875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315d33239f584565aeec6da5879cb48b', 'request_id': 'req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.588995 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:25.601383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315d33239f584565aeec6da5879cb48b', 'request_id': 'req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.611687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315d33239f584565aeec6da5879cb48b', 'request_id': 'req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.629104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] The token cache is being invalidate because project 315d33239f584565aeec6da5879cb48b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:25.629416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.630307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.632143 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1606/3240] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:25 2022] DELETE /identity/v3/projects/315d33239f584565aeec6da5879cb48b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:25.645972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511053-23b6-48e0-99ad-6c523d8c849f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:25.646402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511053-23b6-48e0-99ad-6c523d8c849f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:25.646791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511053-23b6-48e0-99ad-6c523d8c849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:25.679188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-76511053-23b6-48e0-99ad-6c523d8c849f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:25.681277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-76511053-23b6-48e0-99ad-6c523d8c849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:25.692996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:25.692996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:25.790466 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1635/3241] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:56:25.792494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c781-7f08-437e-90f5-f1ddf7887633 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:25.794132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c781-7f08-437e-90f5-f1ddf7887633 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:25.794423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c781-7f08-437e-90f5-f1ddf7887633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:25.803656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd2827-6fe4-4369-bfc7-22d7f75452b2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:25.811418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:25.812744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:25.812744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:25.813724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] PATH_INFO: `/v3/users/ac3b9c0afb184415b4dfd1d0a62f7418` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:25.815661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3b9c0afb184415b4dfd1d0a62f7418)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:25.822092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:25.822918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c246c781-7f08-437e-90f5-f1ddf7887633 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:25.824608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c246c781-7f08-437e-90f5-f1ddf7887633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:25.836902 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1636/3242] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:25.841211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c781-7f08-437e-90f5-f1ddf7887633 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:25.856072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c781-7f08-437e-90f5-f1ddf7887633 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:25.878088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55712d-533b-4917-a0ce-114c7293417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:25.878855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55712d-533b-4917-a0ce-114c7293417d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:25.879151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55712d-533b-4917-a0ce-114c7293417d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:25.879429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55712d-533b-4917-a0ce-114c7293417d admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:25.880124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55712d-533b-4917-a0ce-114c7293417d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:25.880430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55712d-533b-4917-a0ce-114c7293417d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:25.882086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55712d-533b-4917-a0ce-114c7293417d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:25.916435 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1637/3243] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:56:25.924858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55712d-533b-4917-a0ce-114c7293417d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:25.943562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55712d-533b-4917-a0ce-114c7293417d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:25.950096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3b9c0afb184415b4dfd1d0a62f7418'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.974338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3b9c0afb184415b4dfd1d0a62f7418'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.988144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3b9c0afb184415b4dfd1d0a62f7418'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:25.995789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef415c65-0421-4b50-9377-04624e09ee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:25.997722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415c65-0421-4b50-9377-04624e09ee7c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:25.998828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415c65-0421-4b50-9377-04624e09ee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:25.999259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415c65-0421-4b50-9377-04624e09ee7c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:26.001509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef415c65-0421-4b50-9377-04624e09ee7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:26.003842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3b9c0afb184415b4dfd1d0a62f7418'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:26.004920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef415c65-0421-4b50-9377-04624e09ee7c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:26.005821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-195dbf0a-f1dd-4bea-845a-7319aa802c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3b9c0afb184415b4dfd1d0a62f7418'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:26.024682 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1607/3244] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:25 2022] DELETE /identity/v3/users/ac3b9c0afb184415b4dfd1d0a62f7418 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:26.031328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a477af-2025-417c-8acd-17a2f2e63e06 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:26.031791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a477af-2025-417c-8acd-17a2f2e63e06 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:26.032169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a477af-2025-417c-8acd-17a2f2e63e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:26.082783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e5a477af-2025-417c-8acd-17a2f2e63e06 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:26.087885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e5a477af-2025-417c-8acd-17a2f2e63e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:26.089847 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1638/3245] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:25 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:26.097258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef415c65-0421-4b50-9377-04624e09ee7c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:26.105489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ef415c65-0421-4b50-9377-04624e09ee7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:26.229688 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:26.252847 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1608/3246] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:26.268852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a477af-2025-417c-8acd-17a2f2e63e06 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:26.270931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e5a477af-2025-417c-8acd-17a2f2e63e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:26.331979 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:26.348268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef415c65-0421-4b50-9377-04624e09ee7c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:26.359379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8986a1-8b76-4dac-bb6e-0350485597fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:26.360124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8986a1-8b76-4dac-bb6e-0350485597fa admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:26.360402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8986a1-8b76-4dac-bb6e-0350485597fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:26.362385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8986a1-8b76-4dac-bb6e-0350485597fa admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:26.363472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8986a1-8b76-4dac-bb6e-0350485597fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:26.368232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8986a1-8b76-4dac-bb6e-0350485597fa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:26.417301 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1639/3247] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:26 2022] POST /identity/v3/users => generated 295 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:26.430497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8986a1-8b76-4dac-bb6e-0350485597fa admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:26.440074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a477af-2025-417c-8acd-17a2f2e63e06 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:26.451734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe671feb-abe4-4a8f-8cc4-4a2b516a95f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:26.452919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe671feb-abe4-4a8f-8cc4-4a2b516a95f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:26.455411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe671feb-abe4-4a8f-8cc4-4a2b516a95f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:26.455771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe671feb-abe4-4a8f-8cc4-4a2b516a95f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:26.457707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8986a1-8b76-4dac-bb6e-0350485597fa admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:26.481507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2ea6-eccc-4ca3-8c6d-09c435d6e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:26.482903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2ea6-eccc-4ca3-8c6d-09c435d6e734 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:26.484319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2ea6-eccc-4ca3-8c6d-09c435d6e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:26.484635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2ea6-eccc-4ca3-8c6d-09c435d6e734 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:26.486716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c2ea6-eccc-4ca3-8c6d-09c435d6e734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:26.490031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe671feb-abe4-4a8f-8cc4-4a2b516a95f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:26.491546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe671feb-abe4-4a8f-8cc4-4a2b516a95f8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:26.492668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c2ea6-eccc-4ca3-8c6d-09c435d6e734 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:26.522437 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1640/3248] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:26.523412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2ea6-eccc-4ca3-8c6d-09c435d6e734 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:26.524117 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1609/3249] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:26.534879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2ea6-eccc-4ca3-8c6d-09c435d6e734 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:26.540146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a001af-4e5c-4050-ad94-b3417e1bebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:26.540788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a001af-4e5c-4050-ad94-b3417e1bebe6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:26.541068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a001af-4e5c-4050-ad94-b3417e1bebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:26.541339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a001af-4e5c-4050-ad94-b3417e1bebe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:26.541975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a001af-4e5c-4050-ad94-b3417e1bebe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:26.543778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a001af-4e5c-4050-ad94-b3417e1bebe6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:26.566202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe671feb-abe4-4a8f-8cc4-4a2b516a95f8 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:26.573135 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1641/3250] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:26.580160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe671feb-abe4-4a8f-8cc4-4a2b516a95f8 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:26.590903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed78b2e-03b5-4d3e-91c4-e25c921c2200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:26.592145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed78b2e-03b5-4d3e-91c4-e25c921c2200 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:26.592428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed78b2e-03b5-4d3e-91c4-e25c921c2200 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:26.592763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed78b2e-03b5-4d3e-91c4-e25c921c2200 admin admin] PATH_INFO: `/v3/projects/9f5e23e3363e4fa6a4e47f88bd5e52e0/users/80a900323a8f43db94d748bb7d0174b8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:26.630644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed78b2e-03b5-4d3e-91c4-e25c921c2200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5e23e3363e4fa6a4e47f88bd5e52e0, user_id=80a900323a8f43db94d748bb7d0174b8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:26.639117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed78b2e-03b5-4d3e-91c4-e25c921c2200 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:26.672263 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1610/3251] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:26 2022] PUT /identity/v3/projects/9f5e23e3363e4fa6a4e47f88bd5e52e0/users/80a900323a8f43db94d748bb7d0174b8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:26.687937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85802e9-5ca0-4c5f-ac15-37a6abcafac6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:26.688476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85802e9-5ca0-4c5f-ac15-37a6abcafac6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:26.688476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85802e9-5ca0-4c5f-ac15-37a6abcafac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:26.750491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d85802e9-5ca0-4c5f-ac15-37a6abcafac6 None None] MFA Rules not processed for user `80a900323a8f43db94d748bb7d0174b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:26.752949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d85802e9-5ca0-4c5f-ac15-37a6abcafac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:26.902954 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1642/3252] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:26.908433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed78b2e-03b5-4d3e-91c4-e25c921c2200 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:27.058428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed78b2e-03b5-4d3e-91c4-e25c921c2200 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:27.066457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfde7e4-2469-4b6e-a26f-2456feaed915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:27.067087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfde7e4-2469-4b6e-a26f-2456feaed915 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:27.067363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfde7e4-2469-4b6e-a26f-2456feaed915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:27.067631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfde7e4-2469-4b6e-a26f-2456feaed915 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:27.068903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfde7e4-2469-4b6e-a26f-2456feaed915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:27.070831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfde7e4-2469-4b6e-a26f-2456feaed915 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:27.127938 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1611/3253] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:26 2022] POST /identity/v3/projects => generated 391 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:27.128501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85802e9-5ca0-4c5f-ac15-37a6abcafac6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:27.146402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85802e9-5ca0-4c5f-ac15-37a6abcafac6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:27.298129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228950db-13e0-441d-9811-1df22c9da440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:27.298845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228950db-13e0-441d-9811-1df22c9da440 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:27.299479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228950db-13e0-441d-9811-1df22c9da440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:27.299479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228950db-13e0-441d-9811-1df22c9da440 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:27.300223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228950db-13e0-441d-9811-1df22c9da440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:27.302282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228950db-13e0-441d-9811-1df22c9da440 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:27.336745 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1643/3254] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:27 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:27.340713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfde7e4-2469-4b6e-a26f-2456feaed915 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:27.354250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfde7e4-2469-4b6e-a26f-2456feaed915 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:27.367273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a8d0e-aa29-4dde-baf9-65cd124b3d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:27.367946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8d0e-aa29-4dde-baf9-65cd124b3d67 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:27.368228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8d0e-aa29-4dde-baf9-65cd124b3d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:27.368737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8d0e-aa29-4dde-baf9-65cd124b3d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:27.369302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a8d0e-aa29-4dde-baf9-65cd124b3d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:27.371156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a8d0e-aa29-4dde-baf9-65cd124b3d67 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:27.391358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228950db-13e0-441d-9811-1df22c9da440 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:27.396437 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1612/3255] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:27.417205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228950db-13e0-441d-9811-1df22c9da440 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:27.433374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc728f-80e0-4657-b25e-2ae8d7278598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:27.434443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc728f-80e0-4657-b25e-2ae8d7278598 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:27.435181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc728f-80e0-4657-b25e-2ae8d7278598 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:27.435848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc728f-80e0-4657-b25e-2ae8d7278598 admin admin] PATH_INFO: `/v3/projects/b009eb34372f4ce28a74d49122121b62/users/1d9bb1aeb8cd43d4b7c48f7f93ed922b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:27.457395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc728f-80e0-4657-b25e-2ae8d7278598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b009eb34372f4ce28a74d49122121b62, user_id=1d9bb1aeb8cd43d4b7c48f7f93ed922b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:27.460947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc728f-80e0-4657-b25e-2ae8d7278598 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:27.501444 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1644/3256] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:27 2022] PUT /identity/v3/projects/b009eb34372f4ce28a74d49122121b62/users/1d9bb1aeb8cd43d4b7c48f7f93ed922b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:27.505669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a8d0e-aa29-4dde-baf9-65cd124b3d67 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:27.520481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a8d0e-aa29-4dde-baf9-65cd124b3d67 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:27.603061 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:27.625939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6664c3f-13bb-40be-9a2f-7b5ebe07842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:27.626948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664c3f-13bb-40be-9a2f-7b5ebe07842a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:27.626948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664c3f-13bb-40be-9a2f-7b5ebe07842a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:27.627163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664c3f-13bb-40be-9a2f-7b5ebe07842a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:27.627726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6664c3f-13bb-40be-9a2f-7b5ebe07842a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:27.629399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6664c3f-13bb-40be-9a2f-7b5ebe07842a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:27.645593 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1613/3257] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:27.650169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc728f-80e0-4657-b25e-2ae8d7278598 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:27.665005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc728f-80e0-4657-b25e-2ae8d7278598 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:27.670808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ca0a2-df13-46a4-bac0-1deb2768a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:27.671791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ca0a2-df13-46a4-bac0-1deb2768a728 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:27.672079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ca0a2-df13-46a4-bac0-1deb2768a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:27.672357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ca0a2-df13-46a4-bac0-1deb2768a728 admin admin] PATH_INFO: `/v3/projects/b009eb34372f4ce28a74d49122121b62/users/1d9bb1aeb8cd43d4b7c48f7f93ed922b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:27.674572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ca0a2-df13-46a4-bac0-1deb2768a728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b009eb34372f4ce28a74d49122121b62, user_id=1d9bb1aeb8cd43d4b7c48f7f93ed922b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:27.677356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ca0a2-df13-46a4-bac0-1deb2768a728 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:27.719820 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1645/3258] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:27 2022] PUT /identity/v3/projects/b009eb34372f4ce28a74d49122121b62/users/1d9bb1aeb8cd43d4b7c48f7f93ed922b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:27.732268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52b7d4-27cb-4160-a670-f701f3ee5a7d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:27.732912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52b7d4-27cb-4160-a670-f701f3ee5a7d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:27.733512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52b7d4-27cb-4160-a670-f701f3ee5a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:27.747277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ca0a2-df13-46a4-bac0-1deb2768a728 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:27.749132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ac3ca0a2-df13-46a4-bac0-1deb2768a728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:27.759023 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:27.802537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dc52b7d4-27cb-4160-a670-f701f3ee5a7d None None] MFA Rules not processed for user `1d9bb1aeb8cd43d4b7c48f7f93ed922b`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:27.804402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dc52b7d4-27cb-4160-a670-f701f3ee5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:27.881986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ca0a2-df13-46a4-bac0-1deb2768a728 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:27.889090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:27.890539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:27.890896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:27.891515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] PATH_INFO: `/v3/projects/0614a520da8b41d4870535149cca5e6c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:27.893328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0614a520da8b41d4870535149cca5e6c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:27.897200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:27.994727 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1614/3259] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:28.015794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52b7d4-27cb-4160-a670-f701f3ee5a7d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:28.017418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dc52b7d4-27cb-4160-a670-f701f3ee5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:28.019355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0614a520da8b41d4870535149cca5e6c', 'request_id': 'req-5f37aac2-20ad-4348-9f7e-90fc7676b103'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:28.032096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0614a520da8b41d4870535149cca5e6c', 'request_id': 'req-5f37aac2-20ad-4348-9f7e-90fc7676b103'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:28.039272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0614a520da8b41d4870535149cca5e6c', 'request_id': 'req-5f37aac2-20ad-4348-9f7e-90fc7676b103'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:28.062303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] The token cache is being invalidate because project 0614a520da8b41d4870535149cca5e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:28.062679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:28.063290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f37aac2-20ad-4348-9f7e-90fc7676b103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:28.066100 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1646/3260] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:27 2022] DELETE /identity/v3/projects/0614a520da8b41d4870535149cca5e6c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:28.075277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290778a3-81a2-4fd3-8df5-3d2de6577d21 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.075923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290778a3-81a2-4fd3-8df5-3d2de6577d21 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.076434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290778a3-81a2-4fd3-8df5-3d2de6577d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.103435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-290778a3-81a2-4fd3-8df5-3d2de6577d21 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:28.104846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-290778a3-81a2-4fd3-8df5-3d2de6577d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:28.124108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52b7d4-27cb-4160-a670-f701f3ee5a7d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:28.208163 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1647/3261] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:28.217639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918af02-e9ac-4ef2-bc87-2f95ded67f67 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.217947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918af02-e9ac-4ef2-bc87-2f95ded67f67 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.218210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918af02-e9ac-4ef2-bc87-2f95ded67f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.245046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5918af02-e9ac-4ef2-bc87-2f95ded67f67 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:28.246563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5918af02-e9ac-4ef2-bc87-2f95ded67f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:28.259209 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1648/3262] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:56:28.260040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8bcf0-c94f-42b3-a9c8-81925184057e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:28.260176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918af02-e9ac-4ef2-bc87-2f95ded67f67 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:28.260928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bcf0-c94f-42b3-a9c8-81925184057e service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.261350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bcf0-c94f-42b3-a9c8-81925184057e service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.261632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bcf0-c94f-42b3-a9c8-81925184057e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.266471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-94b8bcf0-c94f-42b3-a9c8-81925184057e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:28.277293 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:28.285690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918af02-e9ac-4ef2-bc87-2f95ded67f67 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:28.293551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565ed5-dd4a-45a0-9990-842a8dafbbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:28.296724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565ed5-dd4a-45a0-9990-842a8dafbbef admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.297417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565ed5-dd4a-45a0-9990-842a8dafbbef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.298055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565ed5-dd4a-45a0-9990-842a8dafbbef admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.298968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565ed5-dd4a-45a0-9990-842a8dafbbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:28.299539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565ed5-dd4a-45a0-9990-842a8dafbbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:28.301580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565ed5-dd4a-45a0-9990-842a8dafbbef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:28.322114 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1649/3263] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:28.332647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565ed5-dd4a-45a0-9990-842a8dafbbef admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:28.349870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565ed5-dd4a-45a0-9990-842a8dafbbef admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:28.356939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64198f5-7989-4452-bcca-0459fd39c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:28.357900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64198f5-7989-4452-bcca-0459fd39c1eb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.358304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64198f5-7989-4452-bcca-0459fd39c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.358580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64198f5-7989-4452-bcca-0459fd39c1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.359218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64198f5-7989-4452-bcca-0459fd39c1eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:28.362275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64198f5-7989-4452-bcca-0459fd39c1eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:28.382293 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:28.388905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8bcf0-c94f-42b3-a9c8-81925184057e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:28.391407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8bcf0-c94f-42b3-a9c8-81925184057e service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:28.403320 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1650/3264] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:28 2022] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:28.413535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64198f5-7989-4452-bcca-0459fd39c1eb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:28.427938 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1615/3265] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:56:28.512439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64198f5-7989-4452-bcca-0459fd39c1eb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:28.516038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa545-0a0f-4858-af2d-6b301b1e25c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:28.517111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa545-0a0f-4858-af2d-6b301b1e25c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.517484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa545-0a0f-4858-af2d-6b301b1e25c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.517825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa545-0a0f-4858-af2d-6b301b1e25c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.518549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fa545-0a0f-4858-af2d-6b301b1e25c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:28.520837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fa545-0a0f-4858-af2d-6b301b1e25c7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:28.557298 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1651/3266] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:28 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:28.558879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8bcf0-c94f-42b3-a9c8-81925184057e service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:28.576366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8bcf0-c94f-42b3-a9c8-81925184057e service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:28.590837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c89f5-3df3-4e36-bacc-42505b552f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:28.591793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c89f5-3df3-4e36-bacc-42505b552f4c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.592069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c89f5-3df3-4e36-bacc-42505b552f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.593242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c89f5-3df3-4e36-bacc-42505b552f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.593501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c89f5-3df3-4e36-bacc-42505b552f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:28.595000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c89f5-3df3-4e36-bacc-42505b552f4c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:28.620976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa545-0a0f-4858-af2d-6b301b1e25c7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:28.630260 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1616/3267] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:28.635183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa545-0a0f-4858-af2d-6b301b1e25c7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:28.641328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cf8ec-7fb1-46c7-9e11-9dde1a221dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:28.642165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf8ec-7fb1-46c7-9e11-9dde1a221dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.642520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf8ec-7fb1-46c7-9e11-9dde1a221dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.642977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf8ec-7fb1-46c7-9e11-9dde1a221dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.643747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cf8ec-7fb1-46c7-9e11-9dde1a221dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:28.645951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cf8ec-7fb1-46c7-9e11-9dde1a221dd9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:28.664565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c89f5-3df3-4e36-bacc-42505b552f4c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:28.677262 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1652/3268] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:28.679720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c89f5-3df3-4e36-bacc-42505b552f4c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:28.686356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ecd9a-4207-45b6-9644-24cf342be888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:28.687986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ecd9a-4207-45b6-9644-24cf342be888 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.688352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ecd9a-4207-45b6-9644-24cf342be888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.688726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ecd9a-4207-45b6-9644-24cf342be888 admin admin] PATH_INFO: `/v3/projects/6650b66d5a4e4fc0acc8483e13dfe50d/users/a896d5a6fe2b49d0847ce414ee9f0f4f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.711460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ecd9a-4207-45b6-9644-24cf342be888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6650b66d5a4e4fc0acc8483e13dfe50d, user_id=a896d5a6fe2b49d0847ce414ee9f0f4f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:28.714546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ecd9a-4207-45b6-9644-24cf342be888 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:28.742375 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1617/3269] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:28 2022] PUT /identity/v3/projects/6650b66d5a4e4fc0acc8483e13dfe50d/users/a896d5a6fe2b49d0847ce414ee9f0f4f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:28.753285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e52f4-c0a7-4d44-af5e-0a714dfdecba None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:28.753820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e52f4-c0a7-4d44-af5e-0a714dfdecba None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:28.753936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e52f4-c0a7-4d44-af5e-0a714dfdecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:28.798833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-af1e52f4-c0a7-4d44-af5e-0a714dfdecba None None] MFA Rules not processed for user `a896d5a6fe2b49d0847ce414ee9f0f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:28.801100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-af1e52f4-c0a7-4d44-af5e-0a714dfdecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:28.953516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ecd9a-4207-45b6-9644-24cf342be888 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:28.957068 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1653/3270] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:29.079629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ecd9a-4207-45b6-9644-24cf342be888 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:29.097366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0cf4c-a2cf-420b-9e73-a46eec2b2678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:29.098010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0cf4c-a2cf-420b-9e73-a46eec2b2678 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:29.098287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0cf4c-a2cf-420b-9e73-a46eec2b2678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:29.099365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0cf4c-a2cf-420b-9e73-a46eec2b2678 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:29.100049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0cf4c-a2cf-420b-9e73-a46eec2b2678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:29.108729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0cf4c-a2cf-420b-9e73-a46eec2b2678 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:29.191574 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1618/3271] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:28 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:29.195564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e52f4-c0a7-4d44-af5e-0a714dfdecba None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:29.207660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e52f4-c0a7-4d44-af5e-0a714dfdecba None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:29.326600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ed517-d6fd-4508-a023-805fb593e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:29.327332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ed517-d6fd-4508-a023-805fb593e300 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:29.327680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ed517-d6fd-4508-a023-805fb593e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:29.328026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ed517-d6fd-4508-a023-805fb593e300 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:29.328768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ed517-d6fd-4508-a023-805fb593e300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:29.330917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ed517-d6fd-4508-a023-805fb593e300 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:29.341632 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:29.359673 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1654/3272] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:29 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:29.364468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0cf4c-a2cf-420b-9e73-a46eec2b2678 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:29.379566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0cf4c-a2cf-420b-9e73-a46eec2b2678 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:29.386861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f886c-e831-4569-8acd-b04876bb7ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:29.387812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f886c-e831-4569-8acd-b04876bb7ccf admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:29.388502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f886c-e831-4569-8acd-b04876bb7ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:29.389025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f886c-e831-4569-8acd-b04876bb7ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:29.390037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f886c-e831-4569-8acd-b04876bb7ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:29.392491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f886c-e831-4569-8acd-b04876bb7ccf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:29.410246 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1619/3273] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:29.414167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ed517-d6fd-4508-a023-805fb593e300 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:29.430620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ed517-d6fd-4508-a023-805fb593e300 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:29.437461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2d6db-9ed5-4a89-bf72-68a8fce57c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:29.438266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2d6db-9ed5-4a89-bf72-68a8fce57c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:29.438459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2d6db-9ed5-4a89-bf72-68a8fce57c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:29.438671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2d6db-9ed5-4a89-bf72-68a8fce57c13 admin admin] PATH_INFO: `/v3/projects/7b9be12585ee4e328d70bf8e29072e67/users/227a593774d24c9c835a61a2b73d3f53/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:29.473683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2d6db-9ed5-4a89-bf72-68a8fce57c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9be12585ee4e328d70bf8e29072e67, user_id=227a593774d24c9c835a61a2b73d3f53, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:29.480329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2d6db-9ed5-4a89-bf72-68a8fce57c13 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:29.554045 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1655/3274] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:29 2022] PUT /identity/v3/projects/7b9be12585ee4e328d70bf8e29072e67/users/227a593774d24c9c835a61a2b73d3f53/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:29.558612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f886c-e831-4569-8acd-b04876bb7ccf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:29.584752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f886c-e831-4569-8acd-b04876bb7ccf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:29.617392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2d6db-9ed5-4a89-bf72-68a8fce57c13 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:29.619321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-02c2d6db-9ed5-4a89-bf72-68a8fce57c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:29.687967 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:29.714080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063009c9-3947-48e4-85ac-a3d81861c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:29.714651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063009c9-3947-48e4-85ac-a3d81861c838 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:29.714999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063009c9-3947-48e4-85ac-a3d81861c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:29.715275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063009c9-3947-48e4-85ac-a3d81861c838 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:29.715933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063009c9-3947-48e4-85ac-a3d81861c838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:29.721206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063009c9-3947-48e4-85ac-a3d81861c838 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:29.737227 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1620/3275] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:29.739187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2d6db-9ed5-4a89-bf72-68a8fce57c13 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:29.739310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063009c9-3947-48e4-85ac-a3d81861c838 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:29.745155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c45a8-385d-4961-849a-dbb407704eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:29.745790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c45a8-385d-4961-849a-dbb407704eb1 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:29.746070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c45a8-385d-4961-849a-dbb407704eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:29.746346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c45a8-385d-4961-849a-dbb407704eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:29.749005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-749c45a8-385d-4961-849a-dbb407704eb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:29.753531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063009c9-3947-48e4-85ac-a3d81861c838 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:29.761280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03e8d5-80ad-4332-9303-78712ada6e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:29.762114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e8d5-80ad-4332-9303-78712ada6e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:29.762543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e8d5-80ad-4332-9303-78712ada6e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:29.762827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e8d5-80ad-4332-9303-78712ada6e17 admin admin] PATH_INFO: `/v3/projects/7b9be12585ee4e328d70bf8e29072e67/users/227a593774d24c9c835a61a2b73d3f53/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:29.765892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03e8d5-80ad-4332-9303-78712ada6e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9be12585ee4e328d70bf8e29072e67, user_id=227a593774d24c9c835a61a2b73d3f53, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:29.768953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03e8d5-80ad-4332-9303-78712ada6e17 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:29.798534 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1621/3276] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:29 2022] PUT /identity/v3/projects/7b9be12585ee4e328d70bf8e29072e67/users/227a593774d24c9c835a61a2b73d3f53/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:29.803912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2658-a10c-405f-b29e-d664d9551d70 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:29.804286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2658-a10c-405f-b29e-d664d9551d70 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:29.804639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2658-a10c-405f-b29e-d664d9551d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:29.865731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-858f2658-a10c-405f-b29e-d664d9551d70 None None] MFA Rules not processed for user `227a593774d24c9c835a61a2b73d3f53`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:29.869088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-858f2658-a10c-405f-b29e-d664d9551d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:29.879223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c45a8-385d-4961-849a-dbb407704eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:29.883963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c45a8-385d-4961-849a-dbb407704eb1 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:29.916176 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1656/3277] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:30.046223 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1622/3278] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:56:30.049498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c45a8-385d-4961-849a-dbb407704eb1 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:30.159569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c45a8-385d-4961-849a-dbb407704eb1 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:30.164608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2bab1-66df-42ba-b2cf-c4a23e43a429 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:30.165271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2bab1-66df-42ba-b2cf-c4a23e43a429 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:30.165998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2bab1-66df-42ba-b2cf-c4a23e43a429 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:30.166347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2bab1-66df-42ba-b2cf-c4a23e43a429 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:30.167051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2bab1-66df-42ba-b2cf-c4a23e43a429 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:30.168213 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-92d2bab1-66df-42ba-b2cf-c4a23e43a429 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:56:30.168213 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:56:30.168213 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:56:30.169019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2bab1-66df-42ba-b2cf-c4a23e43a429 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:30.175299 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:30.206237 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1657/3279] 10.222.0.27 () {60 vars in 1150 bytes} [Wed Oct 19 00:56:30 2022] POST /identity/v3/domains => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:30.211961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2658-a10c-405f-b29e-d664d9551d70 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:30.235045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2658-a10c-405f-b29e-d664d9551d70 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:30.337889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1c173-e6c8-4acb-a157-91a59d2934d8 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:30.340082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1c173-e6c8-4acb-a157-91a59d2934d8 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:30.340486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1c173-e6c8-4acb-a157-91a59d2934d8 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:30.340975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1c173-e6c8-4acb-a157-91a59d2934d8 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:30.342496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1c173-e6c8-4acb-a157-91a59d2934d8 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:30.343650 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-13a1c173-e6c8-4acb-a157-91a59d2934d8 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:56:30.343650 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:56:30.343650 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:56:30.345142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1c173-e6c8-4acb-a157-91a59d2934d8 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:30.377321 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1623/3280] 10.222.0.27 () {60 vars in 1150 bytes} [Wed Oct 19 00:56:30 2022] POST /identity/v3/domains => generated 276 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:30.379018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2bab1-66df-42ba-b2cf-c4a23e43a429 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:30.406103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2bab1-66df-42ba-b2cf-c4a23e43a429 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:30.531902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579140-d289-4716-b737-00a6528614f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:30.532894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579140-d289-4716-b737-00a6528614f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:30.533358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579140-d289-4716-b737-00a6528614f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:30.535062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579140-d289-4716-b737-00a6528614f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:30.535961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c579140-d289-4716-b737-00a6528614f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:30.538007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c579140-d289-4716-b737-00a6528614f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:30.568614 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1658/3281] 10.222.0.27 () {60 vars in 1150 bytes} [Wed Oct 19 00:56:30 2022] POST /identity/v3/domains => generated 278 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:30.573978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1c173-e6c8-4acb-a157-91a59d2934d8 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:30.589791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1c173-e6c8-4acb-a157-91a59d2934d8 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:30.692836 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:30.713857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e908e1-49c2-40d2-8b56-6ed60cc5d482 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:30.715527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e908e1-49c2-40d2-8b56-6ed60cc5d482 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:30.715972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e908e1-49c2-40d2-8b56-6ed60cc5d482 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:30.716454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e908e1-49c2-40d2-8b56-6ed60cc5d482 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:30.717354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e908e1-49c2-40d2-8b56-6ed60cc5d482 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:30.719425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e908e1-49c2-40d2-8b56-6ed60cc5d482 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:30.751368 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1624/3282] 10.222.0.27 () {60 vars in 1150 bytes} [Wed Oct 19 00:56:30 2022] POST /identity/v3/domains => generated 279 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:30.768655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579140-d289-4716-b737-00a6528614f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:30.781000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579140-d289-4716-b737-00a6528614f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:30.915648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:30.916784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:30.917153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:30.917510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/954651d23120444a89513963e31ebb17` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:30.937336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=954651d23120444a89513963e31ebb17)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:30.938503 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:56:30.938503 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:56:30.938503 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:56:30.940823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:30.983748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '954651d23120444a89513963e31ebb17'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.028036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '954651d23120444a89513963e31ebb17'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.147554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954651d23120444a89513963e31ebb17', 'request_id': 'req-74a9562e-f6a3-42c7-a412-7c116dbf640e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.169882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954651d23120444a89513963e31ebb17', 'request_id': 'req-74a9562e-f6a3-42c7-a412-7c116dbf640e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.171491 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:31.207543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954651d23120444a89513963e31ebb17', 'request_id': 'req-74a9562e-f6a3-42c7-a412-7c116dbf640e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.237512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] The token cache is being invalidate because project 954651d23120444a89513963e31ebb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:31.237809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.238685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.257473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '954651d23120444a89513963e31ebb17', 'request_id': 'req-74a9562e-f6a3-42c7-a412-7c116dbf640e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.262858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '954651d23120444a89513963e31ebb17', 'request_id': 'req-74a9562e-f6a3-42c7-a412-7c116dbf640e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.264380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '954651d23120444a89513963e31ebb17', 'request_id': 'req-74a9562e-f6a3-42c7-a412-7c116dbf640e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.280645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e908e1-49c2-40d2-8b56-6ed60cc5d482 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:31.282836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-80e908e1-49c2-40d2-8b56-6ed60cc5d482 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:31.288466 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1659/3283] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:56:30 2022] DELETE /identity/v3/domains/954651d23120444a89513963e31ebb17 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:31.307595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e908e1-49c2-40d2-8b56-6ed60cc5d482 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:31.472819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da19e40-c1b6-4ba7-bc34-9838ea884570 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:31.473451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da19e40-c1b6-4ba7-bc34-9838ea884570 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:31.473732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da19e40-c1b6-4ba7-bc34-9838ea884570 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:31.474008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da19e40-c1b6-4ba7-bc34-9838ea884570 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:31.474677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da19e40-c1b6-4ba7-bc34-9838ea884570 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:31.476309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da19e40-c1b6-4ba7-bc34-9838ea884570 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:31.512584 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1625/3284] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 00:56:31 2022] POST /identity/v3/domains => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:31.517597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:31.534421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9562e-f6a3-42c7-a412-7c116dbf640e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:31.678167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:31.679047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:31.679539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:31.679871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/c831dee07a8348c8ba33e146420db530` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:31.707762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c831dee07a8348c8ba33e146420db530)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:31.708866 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:56:31.708866 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:56:31.708866 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:56:31.719839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:31.775352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c831dee07a8348c8ba33e146420db530'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.776129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c831dee07a8348c8ba33e146420db530'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.846770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c831dee07a8348c8ba33e146420db530'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.848420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c831dee07a8348c8ba33e146420db530'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:31.867376 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1660/3285] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:56:31 2022] PATCH /identity/v3/domains/c831dee07a8348c8ba33e146420db530 => generated 249 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:31.870981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da19e40-c1b6-4ba7-bc34-9838ea884570 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:31.873404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5da19e40-c1b6-4ba7-bc34-9838ea884570 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:31.901898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da19e40-c1b6-4ba7-bc34-9838ea884570 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:32.082732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:32.097455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:32.097914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:32.101453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/c831dee07a8348c8ba33e146420db530` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:32.143041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c831dee07a8348c8ba33e146420db530)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:32.149277 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:56:32.149277 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:56:32.149277 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:56:32.150221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:32.213810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c831dee07a8348c8ba33e146420db530'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.259041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c831dee07a8348c8ba33e146420db530'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.382654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c831dee07a8348c8ba33e146420db530', 'request_id': 'req-a85cd828-672b-4995-8375-b2815df5d728'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.384464 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:32.401184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c831dee07a8348c8ba33e146420db530', 'request_id': 'req-a85cd828-672b-4995-8375-b2815df5d728'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.419015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c831dee07a8348c8ba33e146420db530', 'request_id': 'req-a85cd828-672b-4995-8375-b2815df5d728'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.442341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] The token cache is being invalidate because project c831dee07a8348c8ba33e146420db530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:32.442850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.443649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.467145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c831dee07a8348c8ba33e146420db530', 'request_id': 'req-a85cd828-672b-4995-8375-b2815df5d728'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.469238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c831dee07a8348c8ba33e146420db530', 'request_id': 'req-a85cd828-672b-4995-8375-b2815df5d728'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.469786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c831dee07a8348c8ba33e146420db530', 'request_id': 'req-a85cd828-672b-4995-8375-b2815df5d728'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.502140 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1626/3286] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:56:31 2022] DELETE /identity/v3/domains/c831dee07a8348c8ba33e146420db530 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:32.510017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:32.529498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4885645-3194-4dcd-891e-a2c1796ff768 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:32.681432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb635-64f3-43c8-ad49-fb0d60c29cf7 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:32.682500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb635-64f3-43c8-ad49-fb0d60c29cf7 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:32.683018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb635-64f3-43c8-ad49-fb0d60c29cf7 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:32.683390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb635-64f3-43c8-ad49-fb0d60c29cf7 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:32.684461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebb635-64f3-43c8-ad49-fb0d60c29cf7 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:32.687504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebb635-64f3-43c8-ad49-fb0d60c29cf7 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:32.719390 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1661/3287] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 00:56:32 2022] POST /identity/v3/domains => generated 278 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:32.724114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:32.726064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:32.752956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cd828-672b-4995-8375-b2815df5d728 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:32.869161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:32.871181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:32.871181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:32.871181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/5accda21908347df90813785ad702014` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:32.887150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5accda21908347df90813785ad702014)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:32.888875 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:56:32.888875 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:56:32.888875 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:56:32.889845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:32.923495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5accda21908347df90813785ad702014'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.927143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5accda21908347df90813785ad702014'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.970538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5accda21908347df90813785ad702014'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.971438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5accda21908347df90813785ad702014'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:32.974089 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1627/3288] 10.222.0.27 () {60 vars in 1250 bytes} [Wed Oct 19 00:56:32 2022] PATCH /identity/v3/domains/5accda21908347df90813785ad702014 => generated 279 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:32.978327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb635-64f3-43c8-ad49-fb0d60c29cf7 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:32.980318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9aebb635-64f3-43c8-ad49-fb0d60c29cf7 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:32.997526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb635-64f3-43c8-ad49-fb0d60c29cf7 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:33.039664 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:33.126264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590709e-5f0d-4428-8560-260303ea258e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:33.153063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590709e-5f0d-4428-8560-260303ea258e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:33.153478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590709e-5f0d-4428-8560-260303ea258e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:33.155097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590709e-5f0d-4428-8560-260303ea258e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/5accda21908347df90813785ad702014` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:33.204596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590709e-5f0d-4428-8560-260303ea258e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=5accda21908347df90813785ad702014)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:33.210612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590709e-5f0d-4428-8560-260303ea258e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:33.219684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:33.228747 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1662/3289] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 00:56:32 2022] GET /identity/v3/domains/5accda21908347df90813785ad702014 => generated 279 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:33.235322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa0c0-a1b2-4959-9c9a-806ea26abe68 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:33.246861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:33.249018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:33.249303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:33.251794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/5accda21908347df90813785ad702014` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:33.254138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5accda21908347df90813785ad702014)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:33.257226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:33.336143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5accda21908347df90813785ad702014'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.362412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5accda21908347df90813785ad702014'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.455958 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:33.473240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5accda21908347df90813785ad702014', 'request_id': 'req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.492473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5accda21908347df90813785ad702014', 'request_id': 'req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.515811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5accda21908347df90813785ad702014', 'request_id': 'req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.537604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] The token cache is being invalidate because project 5accda21908347df90813785ad702014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:33.538164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.539541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.555322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5accda21908347df90813785ad702014', 'request_id': 'req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.558699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5accda21908347df90813785ad702014', 'request_id': 'req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.561031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5accda21908347df90813785ad702014', 'request_id': 'req-3bfe6650-5ea1-4e13-85f2-1438b24d9fa6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:33.583446 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1628/3290] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:56:33 2022] DELETE /identity/v3/domains/5accda21908347df90813785ad702014 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:33.587203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590709e-5f0d-4428-8560-260303ea258e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:33.589135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a590709e-5f0d-4428-8560-260303ea258e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:33.609256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590709e-5f0d-4428-8560-260303ea258e tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:33.620231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17da5f-23dd-45f1-9809-b24fbae70c7b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:33.620533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17da5f-23dd-45f1-9809-b24fbae70c7b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:33.620832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17da5f-23dd-45f1-9809-b24fbae70c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:33.673210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7a17da5f-23dd-45f1-9809-b24fbae70c7b None None] MFA Rules not processed for user `73c91ca45a0a4b3c9499a85bde9e8bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:33.674442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7a17da5f-23dd-45f1-9809-b24fbae70c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:33.683577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64db4e-4d01-4b47-82e6-272d1d0a96f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:33.684797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64db4e-4d01-4b47-82e6-272d1d0a96f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:33.685854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64db4e-4d01-4b47-82e6-272d1d0a96f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:33.686866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64db4e-4d01-4b47-82e6-272d1d0a96f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:33.688097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64db4e-4d01-4b47-82e6-272d1d0a96f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:33.690194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64db4e-4d01-4b47-82e6-272d1d0a96f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:33.717818 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1663/3291] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 00:56:33 2022] GET /identity/v3/domains => generated 1347 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:33.719063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64db4e-4d01-4b47-82e6-272d1d0a96f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:33.731788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64db4e-4d01-4b47-82e6-272d1d0a96f4 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:33.738883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f964bcb-2a77-4b17-9007-4d4c556f407d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:33.739807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f964bcb-2a77-4b17-9007-4d4c556f407d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:33.742460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f964bcb-2a77-4b17-9007-4d4c556f407d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:33.742971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f964bcb-2a77-4b17-9007-4d4c556f407d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/5accda21908347df90813785ad702014` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:33.752992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f964bcb-2a77-4b17-9007-4d4c556f407d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-8f964bcb-2a77-4b17-9007-4d4c556f407d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Could not find domain: 5accda21908347df90813785ad702014.: keystone.exception.DomainNotFound: Could not find domain: 5accda21908347df90813785ad702014. Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5accda21908347df90813785ad702014. Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:33.758556 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:33.759655 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5accda21908347df90813785ad702014. Oct 19 00:56:33.760604 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:33.762194 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1629/3292] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:56:33.768813 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1664/3293] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:56:33 2022] PATCH /identity/v3/domains/5accda21908347df90813785ad702014 => generated 112 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:56:33.771500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17da5f-23dd-45f1-9809-b24fbae70c7b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:33.784545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17da5f-23dd-45f1-9809-b24fbae70c7b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:33.789620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175af6c-5fad-4564-8741-77c8f3689928 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:33.790248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175af6c-5fad-4564-8741-77c8f3689928 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:33.790532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175af6c-5fad-4564-8741-77c8f3689928 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:33.790806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175af6c-5fad-4564-8741-77c8f3689928 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:33.791525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175af6c-5fad-4564-8741-77c8f3689928 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:33.793504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175af6c-5fad-4564-8741-77c8f3689928 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:33.828068 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1630/3294] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 00:56:33 2022] POST /identity/v3/domains => generated 276 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:33.829963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f964bcb-2a77-4b17-9007-4d4c556f407d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:33.849936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f964bcb-2a77-4b17-9007-4d4c556f407d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:33.941028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f9906-a5f7-4522-b635-e8699a9ff3df tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:33.941715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f9906-a5f7-4522-b635-e8699a9ff3df tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:33.942317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f9906-a5f7-4522-b635-e8699a9ff3df tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:33.942697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f9906-a5f7-4522-b635-e8699a9ff3df tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:33.943653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f9906-a5f7-4522-b635-e8699a9ff3df tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:33.945972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f9906-a5f7-4522-b635-e8699a9ff3df tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:33.992557 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1665/3295] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:33 2022] POST /identity/v3/users => generated 342 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:33.997249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175af6c-5fad-4564-8741-77c8f3689928 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:34.012070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175af6c-5fad-4564-8741-77c8f3689928 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:34.026978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:34.026978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:34.026978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:34.027337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:34.027781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:34.028867 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:56:34.028867 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:56:34.028867 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:56:34.032824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:34.064597 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1631/3296] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:56:33 2022] POST /identity/v3/groups => generated 323 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:34.065561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f9906-a5f7-4522-b635-e8699a9ff3df tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:34.082267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f9906-a5f7-4522-b635-e8699a9ff3df tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:34.101216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:34.101996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:34.104302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:34.104686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/8afc79e3b24440ffa66556f5db64b1f9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:34.116698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8afc79e3b24440ffa66556f5db64b1f9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:34.118568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:34.142233 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:34.155032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.155909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.192802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.193455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.196300 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1666/3297] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:56:34 2022] PATCH /identity/v3/domains/8afc79e3b24440ffa66556f5db64b1f9 => generated 277 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:34.200717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:34.203051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:34.218142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bb82d-8afd-43e9-a6bd-6b44646b010d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:34.309276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:34.309682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:34.310506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:34.310786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/8afc79e3b24440ffa66556f5db64b1f9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:34.334445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8afc79e3b24440ffa66556f5db64b1f9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:34.336826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:34.349227 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:34.367831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.551909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc97ff63b2a42fb88567f39011b1ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.584432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc97ff63b2a42fb88567f39011b1ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.593004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc97ff63b2a42fb88567f39011b1ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.600964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc97ff63b2a42fb88567f39011b1ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.601797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc97ff63b2a42fb88567f39011b1ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.608597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.661218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9', 'request_id': 'req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.669655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9', 'request_id': 'req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.674593 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:34.676799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9', 'request_id': 'req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.694100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] The token cache is being invalidate because project 8afc79e3b24440ffa66556f5db64b1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:34.694100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.695638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.706758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9', 'request_id': 'req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.707942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9', 'request_id': 'req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.708397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8afc79e3b24440ffa66556f5db64b1f9', 'request_id': 'req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:34.721151 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1632/3298] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:56:34 2022] DELETE /identity/v3/domains/8afc79e3b24440ffa66556f5db64b1f9 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:34.725342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:34.738782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813652-2138-4cf2-ac88-aacc61609290 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:34.810590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0f3e2-7c60-4c65-ad04-4f726d4bb044 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:34.811322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f3e2-7c60-4c65-ad04-4f726d4bb044 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:34.811602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f3e2-7c60-4c65-ad04-4f726d4bb044 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:34.811923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f3e2-7c60-4c65-ad04-4f726d4bb044 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/8afc79e3b24440ffa66556f5db64b1f9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:34.819790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0f3e2-7c60-4c65-ad04-4f726d4bb044 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=8afc79e3b24440ffa66556f5db64b1f9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:34.821692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0f3e2-7c60-4c65-ad04-4f726d4bb044 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-5fe0f3e2-7c60-4c65-ad04-4f726d4bb044 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Could not find domain: 8afc79e3b24440ffa66556f5db64b1f9.: keystone.exception.DomainNotFound: Could not find domain: 8afc79e3b24440ffa66556f5db64b1f9. Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8afc79e3b24440ffa66556f5db64b1f9. Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:34.835515 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:56:34.836603 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8afc79e3b24440ffa66556f5db64b1f9. Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:34.838806 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1667/3299] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 00:56:34 2022] GET /identity/v3/domains/8afc79e3b24440ffa66556f5db64b1f9 => generated 112 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:56:34.842026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:34.843552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:34.857120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa63e8b-a1c4-4740-a45e-2eac4194e4d0 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:34.862310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed9094-bd82-4779-89c6-abd9f2269932 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:34.863102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed9094-bd82-4779-89c6-abd9f2269932 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:34.863598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed9094-bd82-4779-89c6-abd9f2269932 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:34.864579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed9094-bd82-4779-89c6-abd9f2269932 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/users/fbc97ff63b2a42fb88567f39011b1ac4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:34.873561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed9094-bd82-4779-89c6-abd9f2269932 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:get_user(user_id=fbc97ff63b2a42fb88567f39011b1ac4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:34.875897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed9094-bd82-4779-89c6-abd9f2269932 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-22ed9094-bd82-4779-89c6-abd9f2269932 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Could not find user: fbc97ff63b2a42fb88567f39011b1ac4.: keystone.exception.UserNotFound: Could not find user: fbc97ff63b2a42fb88567f39011b1ac4. Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:56:34.889235 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:56:34.890630 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: fbc97ff63b2a42fb88567f39011b1ac4. Oct 19 00:56:34.891956 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:34.893718 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1633/3300] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 00:56:34 2022] GET /identity/v3/users/fbc97ff63b2a42fb88567f39011b1ac4 => generated 110 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 19 00:56:34.895972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0f3e2-7c60-4c65-ad04-4f726d4bb044 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:34.906827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0f3e2-7c60-4c65-ad04-4f726d4bb044 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:34.913153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327b6e0-c250-4d1c-88ba-70be4637670c tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:34.913802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327b6e0-c250-4d1c-88ba-70be4637670c tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:34.914083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327b6e0-c250-4d1c-88ba-70be4637670c tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:34.914359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327b6e0-c250-4d1c-88ba-70be4637670c tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/groups/4886bfdda8f04bb6a78c47ec4708c9eb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:34.920395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327b6e0-c250-4d1c-88ba-70be4637670c tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:get_group(group_id=4886bfdda8f04bb6a78c47ec4708c9eb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:34.922297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327b6e0-c250-4d1c-88ba-70be4637670c tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-4327b6e0-c250-4d1c-88ba-70be4637670c tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Could not find group: 4886bfdda8f04bb6a78c47ec4708c9eb.: keystone.exception.GroupNotFound: Could not find group: 4886bfdda8f04bb6a78c47ec4708c9eb. Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 19 00:56:34.945580 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:56:34.946646 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 4886bfdda8f04bb6a78c47ec4708c9eb. Oct 19 00:56:34.947619 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:34.952960 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1668/3301] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:34 2022] GET /identity/v3/groups/4886bfdda8f04bb6a78c47ec4708c9eb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:56:34.953710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed9094-bd82-4779-89c6-abd9f2269932 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:34.964757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed9094-bd82-4779-89c6-abd9f2269932 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:34.969959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863c03-b789-4a20-9de1-f1cc34712577 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:34.970720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863c03-b789-4a20-9de1-f1cc34712577 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:34.971099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863c03-b789-4a20-9de1-f1cc34712577 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:34.971444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863c03-b789-4a20-9de1-f1cc34712577 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/groups/4886bfdda8f04bb6a78c47ec4708c9eb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:34.977666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52863c03-b789-4a20-9de1-f1cc34712577 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-52863c03-b789-4a20-9de1-f1cc34712577 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Could not find group: 4886bfdda8f04bb6a78c47ec4708c9eb.: keystone.exception.GroupNotFound: Could not find group: 4886bfdda8f04bb6a78c47ec4708c9eb. Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 19 00:56:34.983598 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:56:34.985073 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 4886bfdda8f04bb6a78c47ec4708c9eb. Oct 19 00:56:34.986377 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:34.988996 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1634/3302] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 00:56:34 2022] DELETE /identity/v3/groups/4886bfdda8f04bb6a78c47ec4708c9eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 19 00:56:34.993080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327b6e0-c250-4d1c-88ba-70be4637670c tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.004837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327b6e0-c250-4d1c-88ba-70be4637670c tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.010395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837f15-2b55-447b-9eef-5b86140e7f40 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.011361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837f15-2b55-447b-9eef-5b86140e7f40 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.011754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837f15-2b55-447b-9eef-5b86140e7f40 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.012133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837f15-2b55-447b-9eef-5b86140e7f40 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/users/fbc97ff63b2a42fb88567f39011b1ac4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.021414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837f15-2b55-447b-9eef-5b86140e7f40 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fbc97ff63b2a42fb88567f39011b1ac4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:35.023400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837f15-2b55-447b-9eef-5b86140e7f40 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-3b837f15-2b55-447b-9eef-5b86140e7f40 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Could not find user: fbc97ff63b2a42fb88567f39011b1ac4.: keystone.exception.UserNotFound: Could not find user: fbc97ff63b2a42fb88567f39011b1ac4. Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 19 00:56:35.036613 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:56:35.037805 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: fbc97ff63b2a42fb88567f39011b1ac4. Oct 19 00:56:35.039149 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:35.045589 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1669/3303] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:34 2022] DELETE /identity/v3/users/fbc97ff63b2a42fb88567f39011b1ac4 => generated 110 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:56:35.047032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863c03-b789-4a20-9de1-f1cc34712577 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.059802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863c03-b789-4a20-9de1-f1cc34712577 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.067500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781d743-7344-45d4-ba3d-e0c78165f78d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.068155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781d743-7344-45d4-ba3d-e0c78165f78d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.068443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781d743-7344-45d4-ba3d-e0c78165f78d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.068765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781d743-7344-45d4-ba3d-e0c78165f78d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/8afc79e3b24440ffa66556f5db64b1f9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.079284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781d743-7344-45d4-ba3d-e0c78165f78d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-a781d743-7344-45d4-ba3d-e0c78165f78d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Could not find domain: 8afc79e3b24440ffa66556f5db64b1f9.: keystone.exception.DomainNotFound: Could not find domain: 8afc79e3b24440ffa66556f5db64b1f9. Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8afc79e3b24440ffa66556f5db64b1f9. Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:35.088755 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:35.089864 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8afc79e3b24440ffa66556f5db64b1f9. Oct 19 00:56:35.090780 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:35.091969 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1635/3304] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:56:35 2022] PATCH /identity/v3/domains/8afc79e3b24440ffa66556f5db64b1f9 => generated 112 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:56:35.095412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837f15-2b55-447b-9eef-5b86140e7f40 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.113284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837f15-2b55-447b-9eef-5b86140e7f40 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.120158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230f5e-f087-4572-8b2e-b6d7772bc375 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.121102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230f5e-f087-4572-8b2e-b6d7772bc375 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.121600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230f5e-f087-4572-8b2e-b6d7772bc375 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.122132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230f5e-f087-4572-8b2e-b6d7772bc375 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.123702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb230f5e-f087-4572-8b2e-b6d7772bc375 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:35.125617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb230f5e-f087-4572-8b2e-b6d7772bc375 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:35.140934 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1670/3305] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 00:56:35 2022] GET /identity/v3/domains => generated 1347 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:35.146125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781d743-7344-45d4-ba3d-e0c78165f78d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.157344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781d743-7344-45d4-ba3d-e0c78165f78d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.164609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b00e4-96a5-41c2-8c32-35799a93ef73 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.165308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b00e4-96a5-41c2-8c32-35799a93ef73 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.165595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b00e4-96a5-41c2-8c32-35799a93ef73 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.165872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b00e4-96a5-41c2-8c32-35799a93ef73 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.166586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b00e4-96a5-41c2-8c32-35799a93ef73 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:35.166973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b00e4-96a5-41c2-8c32-35799a93ef73 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:35.168614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b00e4-96a5-41c2-8c32-35799a93ef73 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:35.190937 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1636/3306] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:35 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:35.195983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230f5e-f087-4572-8b2e-b6d7772bc375 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.207121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230f5e-f087-4572-8b2e-b6d7772bc375 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.213587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a234f-0b32-4e0d-b14c-d6871a60466d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.214212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a234f-0b32-4e0d-b14c-d6871a60466d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.214496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a234f-0b32-4e0d-b14c-d6871a60466d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.214771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a234f-0b32-4e0d-b14c-d6871a60466d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.215432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a234f-0b32-4e0d-b14c-d6871a60466d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1467553840) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:35.215735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a234f-0b32-4e0d-b14c-d6871a60466d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:35.217855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a234f-0b32-4e0d-b14c-d6871a60466d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:35.237680 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1671/3307] 10.222.0.27 () {58 vars in 1199 bytes} [Wed Oct 19 00:56:35 2022] GET /identity/v3/domains?name=tempest-test_domain-1467553840 => generated 407 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:35.238955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b00e4-96a5-41c2-8c32-35799a93ef73 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.251909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b00e4-96a5-41c2-8c32-35799a93ef73 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.256941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776c344-9e87-4212-8089-41eee8924e46 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.257608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776c344-9e87-4212-8089-41eee8924e46 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.257892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776c344-9e87-4212-8089-41eee8924e46 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.258174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776c344-9e87-4212-8089-41eee8924e46 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/8afc79e3b24440ffa66556f5db64b1f9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.267877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776c344-9e87-4212-8089-41eee8924e46 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-b776c344-9e87-4212-8089-41eee8924e46 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Could not find domain: 8afc79e3b24440ffa66556f5db64b1f9.: keystone.exception.DomainNotFound: Could not find domain: 8afc79e3b24440ffa66556f5db64b1f9. Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8afc79e3b24440ffa66556f5db64b1f9. Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:35.272896 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:35.274047 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8afc79e3b24440ffa66556f5db64b1f9. Oct 19 00:56:35.278520 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:35.281347 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1637/3308] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:56:35 2022] PATCH /identity/v3/domains/8afc79e3b24440ffa66556f5db64b1f9 => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:56:35.281427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a234f-0b32-4e0d-b14c-d6871a60466d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.292117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a234f-0b32-4e0d-b14c-d6871a60466d tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.300218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de3fec-87a4-4948-8ac7-ab4fae43bf60 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.301917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de3fec-87a4-4948-8ac7-ab4fae43bf60 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.301917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de3fec-87a4-4948-8ac7-ab4fae43bf60 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.301917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de3fec-87a4-4948-8ac7-ab4fae43bf60 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/26db0010bdb14f43b5c0bed520f7872a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.316732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de3fec-87a4-4948-8ac7-ab4fae43bf60 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=26db0010bdb14f43b5c0bed520f7872a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:35.318411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de3fec-87a4-4948-8ac7-ab4fae43bf60 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:35.372137 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1672/3309] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:56:35 2022] PATCH /identity/v3/domains/26db0010bdb14f43b5c0bed520f7872a => generated 278 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:35.377025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776c344-9e87-4212-8089-41eee8924e46 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.388441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776c344-9e87-4212-8089-41eee8924e46 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.394075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.394770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.395323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.395608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/26db0010bdb14f43b5c0bed520f7872a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.416595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=26db0010bdb14f43b5c0bed520f7872a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:35.418755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:35.451947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '26db0010bdb14f43b5c0bed520f7872a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.464154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '26db0010bdb14f43b5c0bed520f7872a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.542160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26db0010bdb14f43b5c0bed520f7872a', 'request_id': 'req-538e17fa-a919-45d5-882a-46dd25d278da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.557387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26db0010bdb14f43b5c0bed520f7872a', 'request_id': 'req-538e17fa-a919-45d5-882a-46dd25d278da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.567171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26db0010bdb14f43b5c0bed520f7872a', 'request_id': 'req-538e17fa-a919-45d5-882a-46dd25d278da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.587167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] The token cache is being invalidate because project 26db0010bdb14f43b5c0bed520f7872a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:35.587553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.588549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.601088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '26db0010bdb14f43b5c0bed520f7872a', 'request_id': 'req-538e17fa-a919-45d5-882a-46dd25d278da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.602391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '26db0010bdb14f43b5c0bed520f7872a', 'request_id': 'req-538e17fa-a919-45d5-882a-46dd25d278da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.603270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '26db0010bdb14f43b5c0bed520f7872a', 'request_id': 'req-538e17fa-a919-45d5-882a-46dd25d278da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.613761 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1638/3310] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:56:35 2022] DELETE /identity/v3/domains/26db0010bdb14f43b5c0bed520f7872a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:35.617438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de3fec-87a4-4948-8ac7-ab4fae43bf60 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.619208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-03de3fec-87a4-4948-8ac7-ab4fae43bf60 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:35.635325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de3fec-87a4-4948-8ac7-ab4fae43bf60 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.666572 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:35.712569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.713539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.713859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.714137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/630550aed6e248a7b3940f00d26826ee` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.735796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=630550aed6e248a7b3940f00d26826ee)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:35.738194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:35.767537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '630550aed6e248a7b3940f00d26826ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.767537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '630550aed6e248a7b3940f00d26826ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.802430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '630550aed6e248a7b3940f00d26826ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.803088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '630550aed6e248a7b3940f00d26826ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:35.806879 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1673/3311] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:56:35 2022] PATCH /identity/v3/domains/630550aed6e248a7b3940f00d26826ee => generated 277 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:35.811635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:35.826696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e17fa-a919-45d5-882a-46dd25d278da tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:35.831540 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=16,keystone:SELECT=83,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:35.924396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:35.925072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:35.925358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:35.926104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/630550aed6e248a7b3940f00d26826ee` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:35.952779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=630550aed6e248a7b3940f00d26826ee)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:35.955253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:35.994697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '630550aed6e248a7b3940f00d26826ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.007643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '630550aed6e248a7b3940f00d26826ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.071157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630550aed6e248a7b3940f00d26826ee', 'request_id': 'req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.082963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630550aed6e248a7b3940f00d26826ee', 'request_id': 'req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.094265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630550aed6e248a7b3940f00d26826ee', 'request_id': 'req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.112819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] The token cache is being invalidate because project 630550aed6e248a7b3940f00d26826ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:36.113153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.113898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.137701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '630550aed6e248a7b3940f00d26826ee', 'request_id': 'req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.142702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '630550aed6e248a7b3940f00d26826ee', 'request_id': 'req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.145427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '630550aed6e248a7b3940f00d26826ee', 'request_id': 'req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.163591 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1639/3312] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:56:35 2022] DELETE /identity/v3/domains/630550aed6e248a7b3940f00d26826ee => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:36.167501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:36.169433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:36.182952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8061d6-65da-48aa-8dae-6a13d8fb2fb6 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:36.296722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:36.297536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:36.297827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:36.298137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/53d726e9373245b6a2bf6dd57b400aad` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:36.319823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=53d726e9373245b6a2bf6dd57b400aad)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:36.322095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:36.351741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.352594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.388492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.389288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.393076 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1674/3313] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:56:36 2022] PATCH /identity/v3/domains/53d726e9373245b6a2bf6dd57b400aad => generated 276 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:36.396789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:36.398259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:36.416760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a41a0-4037-42b4-abf8-dcc2f59e97c1 tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:36.479145 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:36.502151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227a593774d24c9c835a61a2b73d3f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b9be12585ee4e328d70bf8e29072e67', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:36.503064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:36.503562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:36.504045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] PATH_INFO: `/v3/domains/53d726e9373245b6a2bf6dd57b400aad` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:36.518563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=53d726e9373245b6a2bf6dd57b400aad)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:36.520810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:36.553856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.568033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.653008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad', 'request_id': 'req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.667680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad', 'request_id': 'req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.677830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad', 'request_id': 'req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.697076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] The token cache is being invalidate because project 53d726e9373245b6a2bf6dd57b400aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:36.697545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.698427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.710698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad', 'request_id': 'req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.712182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad', 'request_id': 'req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.713179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '53d726e9373245b6a2bf6dd57b400aad', 'request_id': 'req-045ef46f-b929-45cf-a1db-af3aa4f0bc3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:36.726411 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1640/3314] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:56:36 2022] DELETE /identity/v3/domains/53d726e9373245b6a2bf6dd57b400aad => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:36.730047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:36.732027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:36.804108 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:36.839964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5f2b0-e01a-43dc-9b01-5552b48b5fdb tempest-DomainsTestJSON-835276774 tempest-DomainsTestJSON-835276774-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:36.936973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:36.937543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:36.937831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:36.938161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] PATH_INFO: `/v3/users/a896d5a6fe2b49d0847ce414ee9f0f4f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:36.939400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a896d5a6fe2b49d0847ce414ee9f0f4f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:36.942202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:37.016651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a896d5a6fe2b49d0847ce414ee9f0f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:37.042757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a896d5a6fe2b49d0847ce414ee9f0f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:37.054056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a896d5a6fe2b49d0847ce414ee9f0f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:37.065119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a896d5a6fe2b49d0847ce414ee9f0f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:37.066700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a896d5a6fe2b49d0847ce414ee9f0f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:37.080378 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1675/3315] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:36 2022] DELETE /identity/v3/users/a896d5a6fe2b49d0847ce414ee9f0f4f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:37.082967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b06c-bfd1-4f9e-b1a6-1c969e953ff4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:37.083654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b06c-bfd1-4f9e-b1a6-1c969e953ff4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:37.083654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b06c-bfd1-4f9e-b1a6-1c969e953ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:37.113446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-98a5b06c-bfd1-4f9e-b1a6-1c969e953ff4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:37.114712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-98a5b06c-bfd1-4f9e-b1a6-1c969e953ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:37.201276 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1641/3316] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:37.210878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:37.212672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:37.303038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09db0a4-19f1-4d3b-9e96-482d7b691b22 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:37.318513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44db4d6-5f94-48f1-988f-f3b732c32c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:37.319155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44db4d6-5f94-48f1-988f-f3b732c32c45 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:37.319615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44db4d6-5f94-48f1-988f-f3b732c32c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:37.319893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44db4d6-5f94-48f1-988f-f3b732c32c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:37.344280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44db4d6-5f94-48f1-988f-f3b732c32c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:37.346747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44db4d6-5f94-48f1-988f-f3b732c32c45 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:37.368557 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1676/3317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:37.986598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5b06c-bfd1-4f9e-b1a6-1c969e953ff4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:37.988950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-98a5b06c-bfd1-4f9e-b1a6-1c969e953ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:38.010433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5b06c-bfd1-4f9e-b1a6-1c969e953ff4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:38.024504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:38.025930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:38.028167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:38.029419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] PATH_INFO: `/v3/projects/6650b66d5a4e4fc0acc8483e13dfe50d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:38.033263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6650b66d5a4e4fc0acc8483e13dfe50d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:38.038667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:38.089170 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:38.156838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6650b66d5a4e4fc0acc8483e13dfe50d', 'request_id': 'req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.172601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6650b66d5a4e4fc0acc8483e13dfe50d', 'request_id': 'req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.183793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6650b66d5a4e4fc0acc8483e13dfe50d', 'request_id': 'req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.216919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] The token cache is being invalidate because project 6650b66d5a4e4fc0acc8483e13dfe50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:38.217440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.218457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.221836 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1642/3318] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:37 2022] DELETE /identity/v3/projects/6650b66d5a4e4fc0acc8483e13dfe50d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:38.225552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44db4d6-5f94-48f1-988f-f3b732c32c45 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:38.241468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44db4d6-5f94-48f1-988f-f3b732c32c45 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:38.248489 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:38.384760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:38.385431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:38.385809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:38.385974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] PATH_INFO: `/v3/users/227a593774d24c9c835a61a2b73d3f53` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:38.387141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=227a593774d24c9c835a61a2b73d3f53)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:38.389530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:38.481826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227a593774d24c9c835a61a2b73d3f53'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.500834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227a593774d24c9c835a61a2b73d3f53'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.518730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227a593774d24c9c835a61a2b73d3f53'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.532924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227a593774d24c9c835a61a2b73d3f53'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.534125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227a593774d24c9c835a61a2b73d3f53'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:38.543232 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1677/3319] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:38 2022] DELETE /identity/v3/users/227a593774d24c9c835a61a2b73d3f53 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:38.987329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:38.989106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:39.004458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b6e1a-fdc8-46ed-baa0-5ffb04c4bee3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:39.064782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:39.066412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:39.097231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:39.098380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.098660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.098966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] PATH_INFO: `/v3/projects/7b9be12585ee4e328d70bf8e29072e67` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.100519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9be12585ee4e328d70bf8e29072e67)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:39.102799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:39.176540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9be12585ee4e328d70bf8e29072e67', 'request_id': 'req-055cb92e-72bf-4218-9ec2-2602e1f70068'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:39.189272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f317d-dc56-4029-aab6-e886119723ac admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:39.200867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9be12585ee4e328d70bf8e29072e67', 'request_id': 'req-055cb92e-72bf-4218-9ec2-2602e1f70068'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:39.214010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9be12585ee4e328d70bf8e29072e67', 'request_id': 'req-055cb92e-72bf-4218-9ec2-2602e1f70068'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:39.255917 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:39.264236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] The token cache is being invalidate because project 7b9be12585ee4e328d70bf8e29072e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:39.265291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:39.266454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-055cb92e-72bf-4218-9ec2-2602e1f70068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:39.269876 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1643/3320] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:38 2022] DELETE /identity/v3/projects/7b9be12585ee4e328d70bf8e29072e67 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:39.291168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764dee9-de61-4165-b07b-acef044c6c46 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.291463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764dee9-de61-4165-b07b-acef044c6c46 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.291744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764dee9-de61-4165-b07b-acef044c6c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.331225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3764dee9-de61-4165-b07b-acef044c6c46 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:39.334036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4274dbc-06ee-4ea9-9d2d-30fd8ec3c050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:39.334322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3764dee9-de61-4165-b07b-acef044c6c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:39.334749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4274dbc-06ee-4ea9-9d2d-30fd8ec3c050 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.335036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4274dbc-06ee-4ea9-9d2d-30fd8ec3c050 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.335315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4274dbc-06ee-4ea9-9d2d-30fd8ec3c050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.337285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f4274dbc-06ee-4ea9-9d2d-30fd8ec3c050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:39.414650 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:39.458444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4274dbc-06ee-4ea9-9d2d-30fd8ec3c050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:39.460395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4274dbc-06ee-4ea9-9d2d-30fd8ec3c050 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:39.476463 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1678/3321] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:39.484867 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1644/3322] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:39.494026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f37d6-b6cf-404e-b510-beef3a226f85 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.494425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f37d6-b6cf-404e-b510-beef3a226f85 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.494815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f37d6-b6cf-404e-b510-beef3a226f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.521597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e73f37d6-b6cf-404e-b510-beef3a226f85 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:39.524549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e73f37d6-b6cf-404e-b510-beef3a226f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:39.539520 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1679/3323] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:39.540315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764dee9-de61-4165-b07b-acef044c6c46 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:39.557267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764dee9-de61-4165-b07b-acef044c6c46 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:39.564076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f96863-53c4-41a6-a0cc-1af29dffdbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:39.564608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f96863-53c4-41a6-a0cc-1af29dffdbbc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.564929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f96863-53c4-41a6-a0cc-1af29dffdbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.565207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f96863-53c4-41a6-a0cc-1af29dffdbbc admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.566020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f96863-53c4-41a6-a0cc-1af29dffdbbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:39.566211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f96863-53c4-41a6-a0cc-1af29dffdbbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:39.567960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f96863-53c4-41a6-a0cc-1af29dffdbbc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:39.601144 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1645/3324] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:56:39.606388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f37d6-b6cf-404e-b510-beef3a226f85 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:39.620455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f37d6-b6cf-404e-b510-beef3a226f85 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:39.628947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49e379-2549-4956-bd60-ff030b281a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:39.630232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e379-2549-4956-bd60-ff030b281a9c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.630620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e379-2549-4956-bd60-ff030b281a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.631004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e379-2549-4956-bd60-ff030b281a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.632403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49e379-2549-4956-bd60-ff030b281a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:39.635914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49e379-2549-4956-bd60-ff030b281a9c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:39.678829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f96863-53c4-41a6-a0cc-1af29dffdbbc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:39.688607 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1680/3325] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:39 2022] POST /identity/v3/projects => generated 397 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:39.696417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f96863-53c4-41a6-a0cc-1af29dffdbbc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:39.781002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4128b9e-083a-4eb7-806e-3145f880494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:39.781640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4128b9e-083a-4eb7-806e-3145f880494c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.781927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4128b9e-083a-4eb7-806e-3145f880494c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.782205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4128b9e-083a-4eb7-806e-3145f880494c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.782845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4128b9e-083a-4eb7-806e-3145f880494c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:39.784985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4128b9e-083a-4eb7-806e-3145f880494c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:39.826494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49e379-2549-4956-bd60-ff030b281a9c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:39.837887 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1646/3326] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:39 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:39.840557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49e379-2549-4956-bd60-ff030b281a9c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:39.848080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef9e5-79a9-4498-afe8-bc8156bf1a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:39.849109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef9e5-79a9-4498-afe8-bc8156bf1a9d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.849555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef9e5-79a9-4498-afe8-bc8156bf1a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.850137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef9e5-79a9-4498-afe8-bc8156bf1a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.851344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef9e5-79a9-4498-afe8-bc8156bf1a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:39.855261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef9e5-79a9-4498-afe8-bc8156bf1a9d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:39.875519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4128b9e-083a-4eb7-806e-3145f880494c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:39.890506 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1681/3327] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:39.891904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4128b9e-083a-4eb7-806e-3145f880494c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:39.898919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9729fc1-2964-4047-91e9-8b1607315347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:39.899552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729fc1-2964-4047-91e9-8b1607315347 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.899838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729fc1-2964-4047-91e9-8b1607315347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.900783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729fc1-2964-4047-91e9-8b1607315347 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.901448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729fc1-2964-4047-91e9-8b1607315347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:39.903570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729fc1-2964-4047-91e9-8b1607315347 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:39.924340 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1647/3328] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:39.929400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef9e5-79a9-4498-afe8-bc8156bf1a9d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:39.942130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef9e5-79a9-4498-afe8-bc8156bf1a9d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:39.947634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b11b02-3e3a-4883-b30e-5a97cb64a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:39.950259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11b02-3e3a-4883-b30e-5a97cb64a273 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:39.950744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11b02-3e3a-4883-b30e-5a97cb64a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:39.951034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11b02-3e3a-4883-b30e-5a97cb64a273 admin admin] PATH_INFO: `/v3/projects/32547324afe24e34b5654a4d3aadfdd1/users/5b2df6c56c424e828d5db62c05f169cb/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:39.984934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b11b02-3e3a-4883-b30e-5a97cb64a273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32547324afe24e34b5654a4d3aadfdd1, user_id=5b2df6c56c424e828d5db62c05f169cb, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:39.989529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b11b02-3e3a-4883-b30e-5a97cb64a273 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:40.010349 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1682/3329] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:39 2022] PUT /identity/v3/projects/32547324afe24e34b5654a4d3aadfdd1/users/5b2df6c56c424e828d5db62c05f169cb/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:40.021702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d9729-2b51-4385-aef0-78be69e3d84b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:40.021931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d9729-2b51-4385-aef0-78be69e3d84b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:40.022223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d9729-2b51-4385-aef0-78be69e3d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:40.063711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c16d9729-2b51-4385-aef0-78be69e3d84b None None] MFA Rules not processed for user `5b2df6c56c424e828d5db62c05f169cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:40.064988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c16d9729-2b51-4385-aef0-78be69e3d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:40.188385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1648/3330] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:40.193458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b11b02-3e3a-4883-b30e-5a97cb64a273 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:40.371703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b11b02-3e3a-4883-b30e-5a97cb64a273 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:40.385718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921af1f-0197-42b0-a445-fc0def86c072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:40.387525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921af1f-0197-42b0-a445-fc0def86c072 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:40.387813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921af1f-0197-42b0-a445-fc0def86c072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:40.388135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921af1f-0197-42b0-a445-fc0def86c072 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:40.388907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921af1f-0197-42b0-a445-fc0def86c072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:40.391292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921af1f-0197-42b0-a445-fc0def86c072 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:40.396968 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:40.440348 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1683/3331] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:40 2022] POST /identity/v3/projects => generated 395 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:40.444108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d9729-2b51-4385-aef0-78be69e3d84b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:40.462009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d9729-2b51-4385-aef0-78be69e3d84b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:40.542539 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:40.595394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568442ae-e296-4a5a-89cd-0d66fc331d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:40.596371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568442ae-e296-4a5a-89cd-0d66fc331d4a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:40.596679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568442ae-e296-4a5a-89cd-0d66fc331d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:40.596957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568442ae-e296-4a5a-89cd-0d66fc331d4a admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:40.597604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568442ae-e296-4a5a-89cd-0d66fc331d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:40.599609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568442ae-e296-4a5a-89cd-0d66fc331d4a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:40.654802 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1649/3332] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:40 2022] POST /identity/v3/users => generated 304 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:40.658806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921af1f-0197-42b0-a445-fc0def86c072 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:40.681386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921af1f-0197-42b0-a445-fc0def86c072 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:40.691895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d3ba-fa6d-4f38-8942-7db4e01dd79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:40.694319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d3ba-fa6d-4f38-8942-7db4e01dd79a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:40.694319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d3ba-fa6d-4f38-8942-7db4e01dd79a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:40.694319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d3ba-fa6d-4f38-8942-7db4e01dd79a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:40.695268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3d3ba-fa6d-4f38-8942-7db4e01dd79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:40.697705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3d3ba-fa6d-4f38-8942-7db4e01dd79a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:40.718169 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1684/3333] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:56:40.725375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568442ae-e296-4a5a-89cd-0d66fc331d4a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:40.741204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568442ae-e296-4a5a-89cd-0d66fc331d4a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:40.747836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ac3fa-00b2-43b9-8f26-7c6bb2ca39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:40.748744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac3fa-00b2-43b9-8f26-7c6bb2ca39d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:40.749866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac3fa-00b2-43b9-8f26-7c6bb2ca39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:40.750149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac3fa-00b2-43b9-8f26-7c6bb2ca39d7 admin admin] PATH_INFO: `/v3/projects/fd8a907642624f19a2ceaaa4ebf6bfe9/users/799d5514b6fb4968a18054070a87d1f5/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:40.770693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ac3fa-00b2-43b9-8f26-7c6bb2ca39d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8a907642624f19a2ceaaa4ebf6bfe9, user_id=799d5514b6fb4968a18054070a87d1f5, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:40.773395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ac3fa-00b2-43b9-8f26-7c6bb2ca39d7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:40.802600 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1650/3334] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:40 2022] PUT /identity/v3/projects/fd8a907642624f19a2ceaaa4ebf6bfe9/users/799d5514b6fb4968a18054070a87d1f5/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:40.806464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d3ba-fa6d-4f38-8942-7db4e01dd79a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:40.821049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d3ba-fa6d-4f38-8942-7db4e01dd79a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:40.933743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f136f-385e-40be-9596-5028fb835dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:40.935410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f136f-385e-40be-9596-5028fb835dbe admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:40.935962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f136f-385e-40be-9596-5028fb835dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:40.936482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f136f-385e-40be-9596-5028fb835dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:40.937921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f136f-385e-40be-9596-5028fb835dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:40.944091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f136f-385e-40be-9596-5028fb835dbe admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:40.965749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ac3fa-00b2-43b9-8f26-7c6bb2ca39d7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:40.976836 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1685/3335] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:40.979590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ac3fa-00b2-43b9-8f26-7c6bb2ca39d7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:40.986064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714887-8753-4a16-9f91-d5c8fc4820a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:40.986896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714887-8753-4a16-9f91-d5c8fc4820a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:40.987431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714887-8753-4a16-9f91-d5c8fc4820a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:40.987830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714887-8753-4a16-9f91-d5c8fc4820a2 admin admin] PATH_INFO: `/v3/projects/fd8a907642624f19a2ceaaa4ebf6bfe9/users/799d5514b6fb4968a18054070a87d1f5/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:40.990491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714887-8753-4a16-9f91-d5c8fc4820a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8a907642624f19a2ceaaa4ebf6bfe9, user_id=799d5514b6fb4968a18054070a87d1f5, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:40.995313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714887-8753-4a16-9f91-d5c8fc4820a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:41.015056 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1651/3336] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:40 2022] PUT /identity/v3/projects/fd8a907642624f19a2ceaaa4ebf6bfe9/users/799d5514b6fb4968a18054070a87d1f5/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:41.026439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c67ea-b2c5-49b2-a7b4-12998cb1dc39 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.027066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c67ea-b2c5-49b2-a7b4-12998cb1dc39 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.027346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c67ea-b2c5-49b2-a7b4-12998cb1dc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.065294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-103c67ea-b2c5-49b2-a7b4-12998cb1dc39 None None] MFA Rules not processed for user `799d5514b6fb4968a18054070a87d1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:41.066533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-103c67ea-b2c5-49b2-a7b4-12998cb1dc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:41.220120 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1686/3337] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:41.224582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714887-8753-4a16-9f91-d5c8fc4820a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.273523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c67ea-b2c5-49b2-a7b4-12998cb1dc39 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.275444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-103c67ea-b2c5-49b2-a7b4-12998cb1dc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:41.333747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714887-8753-4a16-9f91-d5c8fc4820a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.339366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7fb9c-4697-47cc-b038-89959f4c5a7a tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2df6c56c424e828d5db62c05f169cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32547324afe24e34b5654a4d3aadfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.340110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7fb9c-4697-47cc-b038-89959f4c5a7a tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.340499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7fb9c-4697-47cc-b038-89959f4c5a7a tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.341051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7fb9c-4697-47cc-b038-89959f4c5a7a tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.342654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7fb9c-4697-47cc-b038-89959f4c5a7a tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-99e7fb9c-4697-47cc-b038-89959f4c5a7a tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 19 00:56:41.349702 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 19 00:56:41.350899 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 19 00:56:41.350899 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 19 00:56:41.350899 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 19 00:56:41.350899 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 19 00:56:41.350899 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:56:41.350899 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 19 00:56:41.350899 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 19 00:56:41.350899 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.350899 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1652/3338] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 00:56:41 2022] POST /identity/v3/projects => generated 136 bytes in 127 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:56:41.359030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7fb9c-4697-47cc-b038-89959f4c5a7a tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.360372 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:41.370304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c67ea-b2c5-49b2-a7b4-12998cb1dc39 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.373453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7fb9c-4697-47cc-b038-89959f4c5a7a tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.377307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.378768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.379250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.380279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] PATH_INFO: `/v3/users/ded977ea8c0b4e18bbef90de6a59a7d3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.380842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244063a-1729-465a-8743-5ab18c086881 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799d5514b6fb4968a18054070a87d1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8a907642624f19a2ceaaa4ebf6bfe9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.381540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244063a-1729-465a-8743-5ab18c086881 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.381696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded977ea8c0b4e18bbef90de6a59a7d3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.381955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244063a-1729-465a-8743-5ab18c086881 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.382318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244063a-1729-465a-8743-5ab18c086881 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.383047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244063a-1729-465a-8743-5ab18c086881 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.383637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:41.385553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244063a-1729-465a-8743-5ab18c086881 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-5244063a-1729-465a-8743-5ab18c086881 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Invalid input for field 'name': '' is too short Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'minLength' in schema['properties']['name']: Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: On instance['name']: Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'minLength' in schema['properties']['name']: Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: On instance['name']: Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: '' Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise error Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['name']: Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application '' Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.401521 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 19 00:56:41.403084 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 19 00:56:41.404260 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 19 00:56:41.404260 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 19 00:56:41.404260 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.404260 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 19 00:56:41.404260 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 00:56:41.404260 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.404260 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['name']: Oct 19 00:56:41.404260 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application '' Oct 19 00:56:41.404260 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.408337 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1653/3339] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 00:56:41 2022] POST /identity/v3/projects => generated 283 bytes in 50 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 19 00:56:41.410052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244063a-1729-465a-8743-5ab18c086881 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.433579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244063a-1729-465a-8743-5ab18c086881 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.442392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fccf00-ad59-420c-bd40-fadfe9b27784 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799d5514b6fb4968a18054070a87d1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8a907642624f19a2ceaaa4ebf6bfe9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.443110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fccf00-ad59-420c-bd40-fadfe9b27784 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.443462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fccf00-ad59-420c-bd40-fadfe9b27784 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.443834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fccf00-ad59-420c-bd40-fadfe9b27784 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.444608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fccf00-ad59-420c-bd40-fadfe9b27784 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.447003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fccf00-ad59-420c-bd40-fadfe9b27784 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-83fccf00-ad59-420c-bd40-fadfe9b27784 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'maxLength' in schema['properties']['name']: Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: On instance['name']: Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'maxLength' in schema['properties']['name']: Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: On instance['name']: Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise error Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 19 00:56:41.456124 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['name']: Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:41.457739 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['name']: Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 00:56:41.459182 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.461971 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1654/3340] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 00:56:41 2022] POST /identity/v3/projects => generated 412 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 00:56:41.462807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fccf00-ad59-420c-bd40-fadfe9b27784 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.469082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded977ea8c0b4e18bbef90de6a59a7d3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:41.477053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fccf00-ad59-420c-bd40-fadfe9b27784 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.482860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799d5514b6fb4968a18054070a87d1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8a907642624f19a2ceaaa4ebf6bfe9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.483651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.483945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.484312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] PATH_INFO: `/v3/projects/3e2dd1186a7d4c58a8b2092d81979c22` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.493837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded977ea8c0b4e18bbef90de6a59a7d3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:41.494096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e2dd1186a7d4c58a8b2092d81979c22)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.495889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:41.505169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded977ea8c0b4e18bbef90de6a59a7d3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:41.517523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded977ea8c0b4e18bbef90de6a59a7d3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:41.518700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded977ea8c0b4e18bbef90de6a59a7d3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Could not find project: 3e2dd1186a7d4c58a8b2092d81979c22.: keystone.exception.ProjectNotFound: Could not find project: 3e2dd1186a7d4c58a8b2092d81979c22. Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 19 00:56:41.519807 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3e2dd1186a7d4c58a8b2092d81979c22. Oct 19 00:56:41.520786 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.521477 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1655/3341] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:41 2022] DELETE /identity/v3/projects/3e2dd1186a7d4c58a8b2092d81979c22 => generated 113 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:56:41.528339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.530083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:41.534259 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1687/3342] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:41 2022] DELETE /identity/v3/users/ded977ea8c0b4e18bbef90de6a59a7d3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:41.546901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903d005-6c65-4e93-bfe3-4233ded65342 tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.626016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5aade-4e6c-450f-be87-ec41dcbfaf0c tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2df6c56c424e828d5db62c05f169cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32547324afe24e34b5654a4d3aadfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.626766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5aade-4e6c-450f-be87-ec41dcbfaf0c tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.627112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5aade-4e6c-450f-be87-ec41dcbfaf0c tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.627456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5aade-4e6c-450f-be87-ec41dcbfaf0c tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.628187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5aade-4e6c-450f-be87-ec41dcbfaf0c tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-48e5aade-4e6c-450f-be87-ec41dcbfaf0c tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 19 00:56:41.634262 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._list_projects() Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 19 00:56:41.635292 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:56:41.636820 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1656/3343] 10.222.0.27 () {58 vars in 1131 bytes} [Wed Oct 19 00:56:41 2022] GET /identity/v3/projects => generated 135 bytes in 109 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:56:41.642446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.644117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:41.727928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c38b8-25fb-4f62-b313-59ac04ab46e9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.733650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5129ce3-408e-46ee-b73d-56e53f5f016d tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799d5514b6fb4968a18054070a87d1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8a907642624f19a2ceaaa4ebf6bfe9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.734942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129ce3-408e-46ee-b73d-56e53f5f016d tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.735342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129ce3-408e-46ee-b73d-56e53f5f016d tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.735726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129ce3-408e-46ee-b73d-56e53f5f016d tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.736467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5129ce3-408e-46ee-b73d-56e53f5f016d tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.738469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5129ce3-408e-46ee-b73d-56e53f5f016d tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:41.751708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5aade-4e6c-450f-be87-ec41dcbfaf0c tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.754150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-48e5aade-4e6c-450f-be87-ec41dcbfaf0c tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:41.789577 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1688/3344] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:41 2022] POST /identity/v3/projects => generated 359 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:41.791004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5129ce3-408e-46ee-b73d-56e53f5f016d tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.801560 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:41.875054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5aade-4e6c-450f-be87-ec41dcbfaf0c tempest-ProjectsNegativeStaticTestJSON-1312828481 tempest-ProjectsNegativeStaticTestJSON-1312828481-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.877312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5129ce3-408e-46ee-b73d-56e53f5f016d tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.883796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799d5514b6fb4968a18054070a87d1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8a907642624f19a2ceaaa4ebf6bfe9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.884479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.885468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.885888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.886535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.888760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:41.894449 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:41.915871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.sql.core [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1833015607' for key 'project.ixu_project_name_domain_id'") Oct 19 00:56:41.915871 n-d-master-1 devstack@keystone.service[86425]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:56:41.915871 n-d-master-1 devstack@keystone.service[86425]: [parameters: {'id': '22d9e1b0838a45e8a2252469bd92985a', 'name': 'tempest-project-dup-1833015607', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 00:56:41.915871 n-d-master-1 devstack@keystone.service[86425]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86425) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1833015607, project id 22d9e1b0838a45e8a2252469bd92985a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1833015607, project id 22d9e1b0838a45e8a2252469bd92985a. Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:56:41.924194 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result.read() Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1833015607' for key 'project.ixu_project_name_domain_id'") Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:56:41.925297 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application yield resource Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise self.value Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:56:41.929797 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application session.commit() Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:56:41.931075 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:56:41.932293 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result.read() Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:56:41.934062 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1833015607' for key 'project.ixu_project_name_domain_id'") Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [parameters: {'id': '22d9e1b0838a45e8a2252469bd92985a', 'name': 'tempest-project-dup-1833015607', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.935926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1833015607 at domain ID default. Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:41.937039 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1833015607, project id 22d9e1b0838a45e8a2252469bd92985a. Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1689/3345] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 00:56:41 2022] POST /identity/v3/projects => generated 285 bytes in 136 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:56:41.938263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:41.942459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a0f6e-a491-4eae-978d-a866248366ed tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:41.947488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799d5514b6fb4968a18054070a87d1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8a907642624f19a2ceaaa4ebf6bfe9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.948223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.948575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.948910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] PATH_INFO: `/v3/projects/5ad39fa526e64158bb1a7ecdf38eec67` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.950306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ad39fa526e64158bb1a7ecdf38eec67)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.952524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:41.967433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:41.968436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:41.970838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:41.970838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] PATH_INFO: `/v3/projects/f527fed1e48e443785be3b655deb762b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:41.971755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f527fed1e48e443785be3b655deb762b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:41.974619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:42.022114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad39fa526e64158bb1a7ecdf38eec67', 'request_id': 'req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.035045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad39fa526e64158bb1a7ecdf38eec67', 'request_id': 'req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.042807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f527fed1e48e443785be3b655deb762b', 'request_id': 'req-3465008f-200e-4c36-88df-441580f77fc1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.042939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad39fa526e64158bb1a7ecdf38eec67', 'request_id': 'req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.056330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f527fed1e48e443785be3b655deb762b', 'request_id': 'req-3465008f-200e-4c36-88df-441580f77fc1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.069443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] The token cache is being invalidate because project 5ad39fa526e64158bb1a7ecdf38eec67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:42.070118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.071603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.076680 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1690/3346] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:41 2022] DELETE /identity/v3/projects/5ad39fa526e64158bb1a7ecdf38eec67 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:42.082945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:42.089521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f527fed1e48e443785be3b655deb762b', 'request_id': 'req-3465008f-200e-4c36-88df-441580f77fc1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.097243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:42.113806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] The token cache is being invalidate because project f527fed1e48e443785be3b655deb762b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:42.114091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.114819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3465008f-200e-4c36-88df-441580f77fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.117401 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1657/3347] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:41 2022] DELETE /identity/v3/projects/f527fed1e48e443785be3b655deb762b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:42.124354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377a084-c1b3-4002-a930-be6a9f127222 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.124753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377a084-c1b3-4002-a930-be6a9f127222 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.125102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377a084-c1b3-4002-a930-be6a9f127222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.148381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0377a084-c1b3-4002-a930-be6a9f127222 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:42.149629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0377a084-c1b3-4002-a930-be6a9f127222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:42.194076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f37e67-0738-4eb3-aa78-f9f0cc147c6c tempest-ProjectsNegativeStaticTestJSON-453189895 tempest-ProjectsNegativeStaticTestJSON-453189895-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:42.205824 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:42.225019 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1658/3348] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:42.233115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab9e77-61e4-414c-adfe-3f61930b1237 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.233379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab9e77-61e4-414c-adfe-3f61930b1237 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.233816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab9e77-61e4-414c-adfe-3f61930b1237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.255894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0eab9e77-61e4-414c-adfe-3f61930b1237 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:42.257137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0eab9e77-61e4-414c-adfe-3f61930b1237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:42.265801 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1659/3349] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:42.270014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab9e77-61e4-414c-adfe-3f61930b1237 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:42.281233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab9e77-61e4-414c-adfe-3f61930b1237 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:42.283500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:42.284401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.284852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.285298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] PATH_INFO: `/v3/users/5b2df6c56c424e828d5db62c05f169cb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.286706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2df6c56c424e828d5db62c05f169cb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:42.287761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45d53b-b48f-4dbb-b68f-3fab237aa235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:42.288445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45d53b-b48f-4dbb-b68f-3fab237aa235 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.288748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45d53b-b48f-4dbb-b68f-3fab237aa235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.289233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45d53b-b48f-4dbb-b68f-3fab237aa235 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.290104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45d53b-b48f-4dbb-b68f-3fab237aa235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:42.290232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:42.290675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45d53b-b48f-4dbb-b68f-3fab237aa235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:42.292594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45d53b-b48f-4dbb-b68f-3fab237aa235 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:42.311683 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1660/3350] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:42.317699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45d53b-b48f-4dbb-b68f-3fab237aa235 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:42.331165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45d53b-b48f-4dbb-b68f-3fab237aa235 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:42.331382 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:42.337301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507e225-305b-4140-bf66-4febef3ce1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:42.337957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507e225-305b-4140-bf66-4febef3ce1bc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.338272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507e225-305b-4140-bf66-4febef3ce1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.338552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507e225-305b-4140-bf66-4febef3ce1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.339227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507e225-305b-4140-bf66-4febef3ce1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:42.341251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507e225-305b-4140-bf66-4febef3ce1bc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:42.369523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2df6c56c424e828d5db62c05f169cb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.373624 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1661/3351] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:42 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:42.378037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507e225-305b-4140-bf66-4febef3ce1bc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:42.387915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2df6c56c424e828d5db62c05f169cb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.402857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2df6c56c424e828d5db62c05f169cb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.443342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2df6c56c424e828d5db62c05f169cb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.444335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f46f7dc-9d7c-4b95-b525-0a169c2bb308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2df6c56c424e828d5db62c05f169cb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:42.455806 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1691/3352] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:42 2022] DELETE /identity/v3/users/5b2df6c56c424e828d5db62c05f169cb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:42.460536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dc216-f30c-444f-bdff-a9f0473391fa None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.460963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dc216-f30c-444f-bdff-a9f0473391fa None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.461500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dc216-f30c-444f-bdff-a9f0473391fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.493447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507e225-305b-4140-bf66-4febef3ce1bc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:42.496593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a70dc216-f30c-444f-bdff-a9f0473391fa None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:42.498823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a70dc216-f30c-444f-bdff-a9f0473391fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:42.567745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b8352-6538-454a-86fc-127f6215b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:42.568439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b8352-6538-454a-86fc-127f6215b081 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.568849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b8352-6538-454a-86fc-127f6215b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.569226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b8352-6538-454a-86fc-127f6215b081 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.569972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b8352-6538-454a-86fc-127f6215b081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:42.573137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b8352-6538-454a-86fc-127f6215b081 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:42.582840 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1692/3353] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:42.593573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dc216-f30c-444f-bdff-a9f0473391fa None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:42.595706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a70dc216-f30c-444f-bdff-a9f0473391fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:42.605812 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1662/3354] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:42 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:42.606189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b8352-6538-454a-86fc-127f6215b081 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:42.609052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-412b8352-6538-454a-86fc-127f6215b081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:42.624059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b8352-6538-454a-86fc-127f6215b081 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:42.631301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da3b27-9321-43d3-a5df-ec2165de2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:42.632503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da3b27-9321-43d3-a5df-ec2165de2079 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.632999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da3b27-9321-43d3-a5df-ec2165de2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.634040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da3b27-9321-43d3-a5df-ec2165de2079 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.635117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da3b27-9321-43d3-a5df-ec2165de2079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:42.637639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da3b27-9321-43d3-a5df-ec2165de2079 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:42.649335 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1663/3355] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:42.653296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da3b27-9321-43d3-a5df-ec2165de2079 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:42.665372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da3b27-9321-43d3-a5df-ec2165de2079 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:42.672282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f20ed-fe05-4c14-ae96-4acff603a437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:42.673249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f20ed-fe05-4c14-ae96-4acff603a437 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.673593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f20ed-fe05-4c14-ae96-4acff603a437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.674000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f20ed-fe05-4c14-ae96-4acff603a437 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.674630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f20ed-fe05-4c14-ae96-4acff603a437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:42.676397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f20ed-fe05-4c14-ae96-4acff603a437 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:42.683099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dc216-f30c-444f-bdff-a9f0473391fa None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:42.689196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9b454-46fc-4861-ad81-b5f4c1b34f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:42.690057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9b454-46fc-4861-ad81-b5f4c1b34f93 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.690427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9b454-46fc-4861-ad81-b5f4c1b34f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.690804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9b454-46fc-4861-ad81-b5f4c1b34f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.691133 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1664/3356] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:42.695799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f20ed-fe05-4c14-ae96-4acff603a437 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:42.707624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f20ed-fe05-4c14-ae96-4acff603a437 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:42.708772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9b454-46fc-4861-ad81-b5f4c1b34f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:42.710439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9b454-46fc-4861-ad81-b5f4c1b34f93 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:42.712861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45470f-24a6-4ca0-98f5-571060bcbec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:42.713634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45470f-24a6-4ca0-98f5-571060bcbec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.713985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45470f-24a6-4ca0-98f5-571060bcbec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.714342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45470f-24a6-4ca0-98f5-571060bcbec2 admin admin] PATH_INFO: `/v3/projects/684de03dbe714d408d123be8805b08c0/users/dfc8a3dc8e024934968a4364c1d15170/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.721666 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1693/3357] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:42.736346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45470f-24a6-4ca0-98f5-571060bcbec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684de03dbe714d408d123be8805b08c0, user_id=dfc8a3dc8e024934968a4364c1d15170, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:42.739195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45470f-24a6-4ca0-98f5-571060bcbec2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:42.756220 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1665/3358] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:42 2022] PUT /identity/v3/projects/684de03dbe714d408d123be8805b08c0/users/dfc8a3dc8e024934968a4364c1d15170/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:42.767290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cec9f-5c87-4a14-8fb8-662eb502a1d2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:42.769776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cec9f-5c87-4a14-8fb8-662eb502a1d2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:42.770159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cec9f-5c87-4a14-8fb8-662eb502a1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:42.809212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-060cec9f-5c87-4a14-8fb8-662eb502a1d2 None None] MFA Rules not processed for user `dfc8a3dc8e024934968a4364c1d15170`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:42.811300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-060cec9f-5c87-4a14-8fb8-662eb502a1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:42.849013 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:42.953094 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1694/3359] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:43.573255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45470f-24a6-4ca0-98f5-571060bcbec2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:43.576275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9f45470f-24a6-4ca0-98f5-571060bcbec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:43.582570 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:43.644078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbcafd-fd12-4f0d-8175-2c6e29539223 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:43.644661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbcafd-fd12-4f0d-8175-2c6e29539223 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:43.644962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbcafd-fd12-4f0d-8175-2c6e29539223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:43.677836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-28cbcafd-fd12-4f0d-8175-2c6e29539223 None None] MFA Rules not processed for user `73c91ca45a0a4b3c9499a85bde9e8bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:43.679075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-28cbcafd-fd12-4f0d-8175-2c6e29539223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:43.696592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45470f-24a6-4ca0-98f5-571060bcbec2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:43.708085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:43.708767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:43.709051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:43.709327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] PATH_INFO: `/v3/projects/32547324afe24e34b5654a4d3aadfdd1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:43.714532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32547324afe24e34b5654a4d3aadfdd1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:43.716595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:43.818556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32547324afe24e34b5654a4d3aadfdd1', 'request_id': 'req-9d3a8485-7d1f-4555-b61a-1eb42111700a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:43.830730 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1695/3360] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:56:43.832963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32547324afe24e34b5654a4d3aadfdd1', 'request_id': 'req-9d3a8485-7d1f-4555-b61a-1eb42111700a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:43.843130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32547324afe24e34b5654a4d3aadfdd1', 'request_id': 'req-9d3a8485-7d1f-4555-b61a-1eb42111700a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:43.861552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] The token cache is being invalidate because project 32547324afe24e34b5654a4d3aadfdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:43.861913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:43.862627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:43.864520 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1666/3361] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:43 2022] DELETE /identity/v3/projects/32547324afe24e34b5654a4d3aadfdd1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:43.868714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbcafd-fd12-4f0d-8175-2c6e29539223 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:43.880486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbcafd-fd12-4f0d-8175-2c6e29539223 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:43.980760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:43.981426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:43.982461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:43.982747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] PATH_INFO: `/v3/users/799d5514b6fb4968a18054070a87d1f5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:43.984026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] RBAC: Authorizing `identity:delete_user(user_id=799d5514b6fb4968a18054070a87d1f5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:43.986482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:44.039374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:44.040849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:44.103720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799d5514b6fb4968a18054070a87d1f5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.143397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799d5514b6fb4968a18054070a87d1f5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.162169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799d5514b6fb4968a18054070a87d1f5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.169374 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:44.171907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799d5514b6fb4968a18054070a87d1f5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.172730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799d5514b6fb4968a18054070a87d1f5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.186160 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1696/3362] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:43 2022] DELETE /identity/v3/users/799d5514b6fb4968a18054070a87d1f5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:44.261840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a8485-7d1f-4555-b61a-1eb42111700a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:44.326039 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:44.410929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f17524-8c71-4cee-93f0-533144ce928f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:44.411784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f17524-8c71-4cee-93f0-533144ce928f service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:44.412479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f17524-8c71-4cee-93f0-533144ce928f service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:44.412884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f17524-8c71-4cee-93f0-533144ce928f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:44.415227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-35f17524-8c71-4cee-93f0-533144ce928f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:44.494300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f17524-8c71-4cee-93f0-533144ce928f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:44.496721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f17524-8c71-4cee-93f0-533144ce928f service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:44.509583 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1667/3363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:44.562109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:44.563795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:44.678085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f2873-85d9-4281-9ad0-06ab3d2fbbce admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:44.687131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:44.687914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:44.688292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:44.688576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] PATH_INFO: `/v3/projects/fd8a907642624f19a2ceaaa4ebf6bfe9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:44.690755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8a907642624f19a2ceaaa4ebf6bfe9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:44.694367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:44.765345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8a907642624f19a2ceaaa4ebf6bfe9', 'request_id': 'req-797ae46a-d3f6-40a8-86b8-105eb730fde5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.775962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8a907642624f19a2ceaaa4ebf6bfe9', 'request_id': 'req-797ae46a-d3f6-40a8-86b8-105eb730fde5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.784351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8a907642624f19a2ceaaa4ebf6bfe9', 'request_id': 'req-797ae46a-d3f6-40a8-86b8-105eb730fde5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.813930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] The token cache is being invalidate because project fd8a907642624f19a2ceaaa4ebf6bfe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:44.814447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.815410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-797ae46a-d3f6-40a8-86b8-105eb730fde5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:44.819155 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1697/3364] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:44 2022] DELETE /identity/v3/projects/fd8a907642624f19a2ceaaa4ebf6bfe9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:44.824693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa8adc-77ae-4f3a-b478-63c45bc8de73 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:44.825225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa8adc-77ae-4f3a-b478-63c45bc8de73 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:44.825225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa8adc-77ae-4f3a-b478-63c45bc8de73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:44.859296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1eaa8adc-77ae-4f3a-b478-63c45bc8de73 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:44.860727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1eaa8adc-77ae-4f3a-b478-63c45bc8de73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:44.965183 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1668/3365] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:44.973746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0937-89fb-45c4-ad1c-b3a394c6c032 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:44.973746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0937-89fb-45c4-ad1c-b3a394c6c032 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:44.974006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0937-89fb-45c4-ad1c-b3a394c6c032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.001908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1ddf0937-89fb-45c4-ad1c-b3a394c6c032 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:45.003355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1ddf0937-89fb-45c4-ad1c-b3a394c6c032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:45.015969 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1698/3366] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:45.020465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa8adc-77ae-4f3a-b478-63c45bc8de73 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.038440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa8adc-77ae-4f3a-b478-63c45bc8de73 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.046306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b55d3-d93d-4017-a4e3-47afedb77373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.047014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b55d3-d93d-4017-a4e3-47afedb77373 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.047373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b55d3-d93d-4017-a4e3-47afedb77373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.047779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b55d3-d93d-4017-a4e3-47afedb77373 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.048480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b55d3-d93d-4017-a4e3-47afedb77373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:45.048891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b55d3-d93d-4017-a4e3-47afedb77373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.050765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b55d3-d93d-4017-a4e3-47afedb77373 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.064422 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1669/3367] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:56:45.069182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0937-89fb-45c4-ad1c-b3a394c6c032 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.079495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0937-89fb-45c4-ad1c-b3a394c6c032 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.084884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d283a56-5095-492a-a49f-32f4fa54c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.085504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d283a56-5095-492a-a49f-32f4fa54c29c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.085790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d283a56-5095-492a-a49f-32f4fa54c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.086070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d283a56-5095-492a-a49f-32f4fa54c29c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.090329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d283a56-5095-492a-a49f-32f4fa54c29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.090329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d283a56-5095-492a-a49f-32f4fa54c29c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.150360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1699/3368] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:45 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:45.151745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b55d3-d93d-4017-a4e3-47afedb77373 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.173142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b55d3-d93d-4017-a4e3-47afedb77373 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.293693 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:45.305144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9f67b-183e-45f1-8f2c-2f18a9b2a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.306280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9f67b-183e-45f1-8f2c-2f18a9b2a45c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.306589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9f67b-183e-45f1-8f2c-2f18a9b2a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.307128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9f67b-183e-45f1-8f2c-2f18a9b2a45c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.307781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9f67b-183e-45f1-8f2c-2f18a9b2a45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.310053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9f67b-183e-45f1-8f2c-2f18a9b2a45c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.350520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d283a56-5095-492a-a49f-32f4fa54c29c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.351171 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1670/3369] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:45 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:45.367211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d283a56-5095-492a-a49f-32f4fa54c29c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.380927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa74d8-68b7-4197-85df-eeca87b4db4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.381499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa74d8-68b7-4197-85df-eeca87b4db4e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.381784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa74d8-68b7-4197-85df-eeca87b4db4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.382052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa74d8-68b7-4197-85df-eeca87b4db4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.382737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa74d8-68b7-4197-85df-eeca87b4db4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.386336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa74d8-68b7-4197-85df-eeca87b4db4e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.408412 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1700/3370] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:45.412941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9f67b-183e-45f1-8f2c-2f18a9b2a45c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.428028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9f67b-183e-45f1-8f2c-2f18a9b2a45c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.440442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36492f0-e25d-41c9-a94e-e9c4a01a18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.441096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36492f0-e25d-41c9-a94e-e9c4a01a18bc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.441511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36492f0-e25d-41c9-a94e-e9c4a01a18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.441796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36492f0-e25d-41c9-a94e-e9c4a01a18bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.442503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36492f0-e25d-41c9-a94e-e9c4a01a18bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.444451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36492f0-e25d-41c9-a94e-e9c4a01a18bc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.488186 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1671/3371] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:45.492752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa74d8-68b7-4197-85df-eeca87b4db4e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.503478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa74d8-68b7-4197-85df-eeca87b4db4e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.508413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7562a-b233-479c-a7b0-ab4f8a0cf225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.509335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7562a-b233-479c-a7b0-ab4f8a0cf225 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.509694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7562a-b233-479c-a7b0-ab4f8a0cf225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.510045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7562a-b233-479c-a7b0-ab4f8a0cf225 admin admin] PATH_INFO: `/v3/projects/e173bfe34dea466b8f85795847b1d0d3/users/72605d17a9f349839708efacbf097bf6/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.534614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7562a-b233-479c-a7b0-ab4f8a0cf225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e173bfe34dea466b8f85795847b1d0d3, user_id=72605d17a9f349839708efacbf097bf6, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.541647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7562a-b233-479c-a7b0-ab4f8a0cf225 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.573704 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1701/3372] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:45 2022] PUT /identity/v3/projects/e173bfe34dea466b8f85795847b1d0d3/users/72605d17a9f349839708efacbf097bf6/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:45.585401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2464b32-748a-4574-8dae-7663221de633 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.586692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2464b32-748a-4574-8dae-7663221de633 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.587358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2464b32-748a-4574-8dae-7663221de633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.625000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b2464b32-748a-4574-8dae-7663221de633 None None] MFA Rules not processed for user `72605d17a9f349839708efacbf097bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:45.626333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b2464b32-748a-4574-8dae-7663221de633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:45.722426 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1672/3373] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:45.727798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7562a-b233-479c-a7b0-ab4f8a0cf225 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.739249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7562a-b233-479c-a7b0-ab4f8a0cf225 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.743521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bf107-39b0-421a-92ee-b099ee3d55e7 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.744175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bf107-39b0-421a-92ee-b099ee3d55e7 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.744462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bf107-39b0-421a-92ee-b099ee3d55e7 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.744769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bf107-39b0-421a-92ee-b099ee3d55e7 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.745411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bf107-39b0-421a-92ee-b099ee3d55e7 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=72605d17a9f349839708efacbf097bf6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.746925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bf107-39b0-421a-92ee-b099ee3d55e7 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.790018 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1702/3374] 10.222.0.27 () {60 vars in 1299 bytes} [Wed Oct 19 00:56:45 2022] POST /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2 => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:45.794234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2464b32-748a-4574-8dae-7663221de633 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.811324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2464b32-748a-4574-8dae-7663221de633 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.817148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cfb9c-2773-4a79-94b3-9d7dfa99eb60 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.817843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cfb9c-2773-4a79-94b3-9d7dfa99eb60 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.818124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cfb9c-2773-4a79-94b3-9d7dfa99eb60 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.818743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cfb9c-2773-4a79-94b3-9d7dfa99eb60 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/90ea4a08a029454caefa0069c7cd50c5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.822315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cfb9c-2773-4a79-94b3-9d7dfa99eb60 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=72605d17a9f349839708efacbf097bf6, credential_id=90ea4a08a029454caefa0069c7cd50c5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.823751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cfb9c-2773-4a79-94b3-9d7dfa99eb60 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.860240 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1673/3375] 10.222.0.27 () {58 vars in 1380 bytes} [Wed Oct 19 00:56:45 2022] DELETE /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/90ea4a08a029454caefa0069c7cd50c5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:45.861933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bf107-39b0-421a-92ee-b099ee3d55e7 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.876881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bf107-39b0-421a-92ee-b099ee3d55e7 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.881839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7f685-8d4d-48ef-b98f-3be7f3b42e7c tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.882770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7f685-8d4d-48ef-b98f-3be7f3b42e7c tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.883205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7f685-8d4d-48ef-b98f-3be7f3b42e7c tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.883629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7f685-8d4d-48ef-b98f-3be7f3b42e7c tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.884419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7f685-8d4d-48ef-b98f-3be7f3b42e7c tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=72605d17a9f349839708efacbf097bf6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.886195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7f685-8d4d-48ef-b98f-3be7f3b42e7c tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.893518 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:45.915213 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1703/3376] 10.222.0.27 () {60 vars in 1299 bytes} [Wed Oct 19 00:56:45 2022] POST /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2 => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:45.916811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cfb9c-2773-4a79-94b3-9d7dfa99eb60 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.938598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cfb9c-2773-4a79-94b3-9d7dfa99eb60 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:45.943745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527bf76-0a37-455b-aff4-8dab3d820c5f tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:45.945009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527bf76-0a37-455b-aff4-8dab3d820c5f tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:45.945684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527bf76-0a37-455b-aff4-8dab3d820c5f tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:45.946210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527bf76-0a37-455b-aff4-8dab3d820c5f tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/1922df880b234d109463ac1bf90ed7bb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:45.951422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527bf76-0a37-455b-aff4-8dab3d820c5f tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=72605d17a9f349839708efacbf097bf6, credential_id=1922df880b234d109463ac1bf90ed7bb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:45.954092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527bf76-0a37-455b-aff4-8dab3d820c5f tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:45.993020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7f685-8d4d-48ef-b98f-3be7f3b42e7c tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:45.993612 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1674/3377] 10.222.0.27 () {58 vars in 1380 bytes} [Wed Oct 19 00:56:45 2022] DELETE /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/1922df880b234d109463ac1bf90ed7bb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:46.005983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7f685-8d4d-48ef-b98f-3be7f3b42e7c tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.012580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259df63-dad0-470d-84c1-c6edade3bb8e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.014638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259df63-dad0-470d-84c1-c6edade3bb8e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.014961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259df63-dad0-470d-84c1-c6edade3bb8e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.015246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259df63-dad0-470d-84c1-c6edade3bb8e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/1922df880b234d109463ac1bf90ed7bb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-2259df63-dad0-470d-84c1-c6edade3bb8e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Could not find credential: 54b61eebc72f9e348960b98f13b1965a3ee0934d8e6baf63c0da27aa18c0f7fb.: keystone.exception.CredentialNotFound: Could not find credential: 54b61eebc72f9e348960b98f13b1965a3ee0934d8e6baf63c0da27aa18c0f7fb. Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 19 00:56:46.039771 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:56:46.040906 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 54b61eebc72f9e348960b98f13b1965a3ee0934d8e6baf63c0da27aa18c0f7fb. Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:56:46.046934 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1704/3378] 10.222.0.27 () {58 vars in 1377 bytes} [Wed Oct 19 00:56:45 2022] GET /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/1922df880b234d109463ac1bf90ed7bb => generated 148 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 19 00:56:46.051634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527bf76-0a37-455b-aff4-8dab3d820c5f tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:46.077342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527bf76-0a37-455b-aff4-8dab3d820c5f tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.084949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73c92-3422-45d0-92e4-6f6bc2d47fbd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.085625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73c92-3422-45d0-92e4-6f6bc2d47fbd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.085922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73c92-3422-45d0-92e4-6f6bc2d47fbd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.086223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73c92-3422-45d0-92e4-6f6bc2d47fbd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.087940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73c92-3422-45d0-92e4-6f6bc2d47fbd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=72605d17a9f349839708efacbf097bf6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:46.089509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73c92-3422-45d0-92e4-6f6bc2d47fbd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:46.125914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259df63-dad0-470d-84c1-c6edade3bb8e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:46.126608 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1675/3379] 10.222.0.27 () {60 vars in 1299 bytes} [Wed Oct 19 00:56:46 2022] POST /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2 => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:46.143016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259df63-dad0-470d-84c1-c6edade3bb8e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.154389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea66c-a675-45e0-b337-c4a14b691cfd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.155045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea66c-a675-45e0-b337-c4a14b691cfd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.155405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea66c-a675-45e0-b337-c4a14b691cfd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.155750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea66c-a675-45e0-b337-c4a14b691cfd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.156526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea66c-a675-45e0-b337-c4a14b691cfd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=72605d17a9f349839708efacbf097bf6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:46.158146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea66c-a675-45e0-b337-c4a14b691cfd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:46.206569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73c92-3422-45d0-92e4-6f6bc2d47fbd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:46.206784 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1705/3380] 10.222.0.27 () {60 vars in 1299 bytes} [Wed Oct 19 00:56:46 2022] POST /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2 => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:46.220872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73c92-3422-45d0-92e4-6f6bc2d47fbd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.232291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad0fd-0992-48a8-91a2-2c012c9941ac tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.233078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad0fd-0992-48a8-91a2-2c012c9941ac tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.234220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad0fd-0992-48a8-91a2-2c012c9941ac tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.234506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad0fd-0992-48a8-91a2-2c012c9941ac tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.235118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ad0fd-0992-48a8-91a2-2c012c9941ac tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=72605d17a9f349839708efacbf097bf6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:46.237954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ad0fd-0992-48a8-91a2-2c012c9941ac tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:46.268479 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1676/3381] 10.222.0.27 () {58 vars in 1278 bytes} [Wed Oct 19 00:56:46 2022] GET /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2 => generated 865 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:46.272358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea66c-a675-45e0-b337-c4a14b691cfd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:46.292033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea66c-a675-45e0-b337-c4a14b691cfd tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.299365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f887b2-eed7-4f88-95f6-a6ab654c75af tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.300870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f887b2-eed7-4f88-95f6-a6ab654c75af tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.301169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f887b2-eed7-4f88-95f6-a6ab654c75af tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.301453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f887b2-eed7-4f88-95f6-a6ab654c75af tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/f9cc539cfabd4ab586fdb5fa11c58086` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.304239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f887b2-eed7-4f88-95f6-a6ab654c75af tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=72605d17a9f349839708efacbf097bf6, credential_id=f9cc539cfabd4ab586fdb5fa11c58086)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:46.305863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f887b2-eed7-4f88-95f6-a6ab654c75af tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:46.332944 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1706/3382] 10.222.0.27 () {58 vars in 1380 bytes} [Wed Oct 19 00:56:46 2022] DELETE /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/f9cc539cfabd4ab586fdb5fa11c58086 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:46.341432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad0fd-0992-48a8-91a2-2c012c9941ac tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:46.368733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad0fd-0992-48a8-91a2-2c012c9941ac tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.382851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6006c7d-2e40-4626-b263-2f366bb619d2 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.384884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6006c7d-2e40-4626-b263-2f366bb619d2 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.386332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6006c7d-2e40-4626-b263-2f366bb619d2 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.386924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6006c7d-2e40-4626-b263-2f366bb619d2 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/d3c3a2bf1765436ca23086a79fe57e26` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.393650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6006c7d-2e40-4626-b263-2f366bb619d2 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=72605d17a9f349839708efacbf097bf6, credential_id=d3c3a2bf1765436ca23086a79fe57e26)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:46.397091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6006c7d-2e40-4626-b263-2f366bb619d2 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:46.424862 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1677/3383] 10.222.0.27 () {58 vars in 1380 bytes} [Wed Oct 19 00:56:46 2022] DELETE /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/d3c3a2bf1765436ca23086a79fe57e26 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:46.426155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f887b2-eed7-4f88-95f6-a6ab654c75af tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:46.438168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f887b2-eed7-4f88-95f6-a6ab654c75af tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.442199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3ad71-ef38-4c65-904d-dd59d9eae782 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.442969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3ad71-ef38-4c65-904d-dd59d9eae782 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.443285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3ad71-ef38-4c65-904d-dd59d9eae782 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.443633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3ad71-ef38-4c65-904d-dd59d9eae782 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.444337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3ad71-ef38-4c65-904d-dd59d9eae782 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=72605d17a9f349839708efacbf097bf6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:46.445958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3ad71-ef38-4c65-904d-dd59d9eae782 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:46.470349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6006c7d-2e40-4626-b263-2f366bb619d2 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:46.477158 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1707/3384] 10.222.0.27 () {60 vars in 1299 bytes} [Wed Oct 19 00:56:46 2022] POST /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2 => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:46.482344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6006c7d-2e40-4626-b263-2f366bb619d2 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.487946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b185d-186d-400d-8804-90ea44491446 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.488644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b185d-186d-400d-8804-90ea44491446 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.489044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b185d-186d-400d-8804-90ea44491446 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.489330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b185d-186d-400d-8804-90ea44491446 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/88afd230724748b2a689dd4e61784c0c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.491470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b185d-186d-400d-8804-90ea44491446 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=72605d17a9f349839708efacbf097bf6, credential_id=88afd230724748b2a689dd4e61784c0c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:46.493213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b185d-186d-400d-8804-90ea44491446 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:46.500873 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1678/3385] 10.222.0.27 () {58 vars in 1377 bytes} [Wed Oct 19 00:56:46 2022] GET /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/88afd230724748b2a689dd4e61784c0c => generated 367 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:46.502549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3ad71-ef38-4c65-904d-dd59d9eae782 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:46.516243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3ad71-ef38-4c65-904d-dd59d9eae782 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.522255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06cab1-1b0c-4fbd-84d2-7f75e894d45e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72605d17a9f349839708efacbf097bf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bfe34dea466b8f85795847b1d0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.523192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06cab1-1b0c-4fbd-84d2-7f75e894d45e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.523321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06cab1-1b0c-4fbd-84d2-7f75e894d45e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.523508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06cab1-1b0c-4fbd-84d2-7f75e894d45e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/88afd230724748b2a689dd4e61784c0c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.525808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06cab1-1b0c-4fbd-84d2-7f75e894d45e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=72605d17a9f349839708efacbf097bf6, credential_id=88afd230724748b2a689dd4e61784c0c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:46.527496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06cab1-1b0c-4fbd-84d2-7f75e894d45e tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:46.557894 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1708/3386] 10.222.0.27 () {58 vars in 1380 bytes} [Wed Oct 19 00:56:46 2022] DELETE /identity/v3/users/72605d17a9f349839708efacbf097bf6/credentials/OS-EC2/88afd230724748b2a689dd4e61784c0c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:46.563444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b185d-186d-400d-8804-90ea44491446 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:46.632713 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:46.648518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b185d-186d-400d-8804-90ea44491446 tempest-EC2CredentialsTest-1350047389 tempest-EC2CredentialsTest-1350047389-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:46.656532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:46.657467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.658662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.659007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] PATH_INFO: `/v3/users/72605d17a9f349839708efacbf097bf6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.661203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72605d17a9f349839708efacbf097bf6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:46.672877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:46.745845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72605d17a9f349839708efacbf097bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:46.776130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72605d17a9f349839708efacbf097bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:46.788877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72605d17a9f349839708efacbf097bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:46.837644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72605d17a9f349839708efacbf097bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:46.839130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72605d17a9f349839708efacbf097bf6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:46.863710 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1679/3387] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:46 2022] DELETE /identity/v3/users/72605d17a9f349839708efacbf097bf6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:46.865408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf613b3-f69b-4f15-a4d0-0fc86bdaa07e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:46.866231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf613b3-f69b-4f15-a4d0-0fc86bdaa07e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:46.866730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf613b3-f69b-4f15-a4d0-0fc86bdaa07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:46.908604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ccf613b3-f69b-4f15-a4d0-0fc86bdaa07e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:46.913112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ccf613b3-f69b-4f15-a4d0-0fc86bdaa07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:47.027374 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1709/3388] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:47.054158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:47.055560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:47.198855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2edb2c-e6ad-4614-94be-fae436a13e11 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:47.203779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381648e8-afd8-487d-a6f6-221cf843f676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:47.204781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381648e8-afd8-487d-a6f6-221cf843f676 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:47.205002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381648e8-afd8-487d-a6f6-221cf843f676 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:47.205355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381648e8-afd8-487d-a6f6-221cf843f676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:47.223251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381648e8-afd8-487d-a6f6-221cf843f676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:47.226510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381648e8-afd8-487d-a6f6-221cf843f676 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:47.239146 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1680/3389] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:47.367949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf613b3-f69b-4f15-a4d0-0fc86bdaa07e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:47.369663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ccf613b3-f69b-4f15-a4d0-0fc86bdaa07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:47.389399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf613b3-f69b-4f15-a4d0-0fc86bdaa07e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:47.406175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:47.406425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:47.406864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:47.407190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] PATH_INFO: `/v3/users/dfc8a3dc8e024934968a4364c1d15170` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:47.409119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc8a3dc8e024934968a4364c1d15170)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:47.411237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:47.521624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc8a3dc8e024934968a4364c1d15170'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:47.555924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc8a3dc8e024934968a4364c1d15170'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:47.585666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc8a3dc8e024934968a4364c1d15170'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:47.605139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc8a3dc8e024934968a4364c1d15170'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:47.606371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc8a3dc8e024934968a4364c1d15170'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:47.644646 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1710/3390] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:47 2022] DELETE /identity/v3/users/dfc8a3dc8e024934968a4364c1d15170 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:47.655127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15afa34-4397-4f78-b147-6ce767e70276 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:47.655127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15afa34-4397-4f78-b147-6ce767e70276 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:47.655127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15afa34-4397-4f78-b147-6ce767e70276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:47.707504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c15afa34-4397-4f78-b147-6ce767e70276 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:47.713938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c15afa34-4397-4f78-b147-6ce767e70276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:47.994042 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1681/3391] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:48.006106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:48.011092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:48.022062 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:48.152689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e4d75-6e7b-4643-9bf3-9db36b6e59d2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:48.159161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a19e0-fa87-4e7f-9417-ef607b958c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:48.159923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a19e0-fa87-4e7f-9417-ef607b958c96 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:48.160318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a19e0-fa87-4e7f-9417-ef607b958c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:48.160710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a19e0-fa87-4e7f-9417-ef607b958c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:48.184877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a19e0-fa87-4e7f-9417-ef607b958c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:48.186813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a19e0-fa87-4e7f-9417-ef607b958c96 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:48.213049 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1711/3392] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:48.246956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15afa34-4397-4f78-b147-6ce767e70276 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:48.250168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c15afa34-4397-4f78-b147-6ce767e70276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:48.340072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15afa34-4397-4f78-b147-6ce767e70276 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:48.374768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:48.375495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:48.375779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:48.376064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] PATH_INFO: `/v3/users/80a900323a8f43db94d748bb7d0174b8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:48.389322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a900323a8f43db94d748bb7d0174b8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:48.393066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:48.435335 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:48.548038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a900323a8f43db94d748bb7d0174b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.560923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a19e0-fa87-4e7f-9417-ef607b958c96 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:48.564519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1e9a19e0-fa87-4e7f-9417-ef607b958c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:48.567893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a900323a8f43db94d748bb7d0174b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.580753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a900323a8f43db94d748bb7d0174b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.602068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a19e0-fa87-4e7f-9417-ef607b958c96 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:48.603064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a900323a8f43db94d748bb7d0174b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.605128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2bc10937-21e3-4585-9153-dda1bb348222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a900323a8f43db94d748bb7d0174b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.615074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:48.616004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:48.616444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:48.618325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] PATH_INFO: `/v3/projects/e173bfe34dea466b8f85795847b1d0d3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:48.620741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e173bfe34dea466b8f85795847b1d0d3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:48.621948 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1682/3393] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:48 2022] DELETE /identity/v3/users/80a900323a8f43db94d748bb7d0174b8 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:48.624259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:48.627936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba9759-1f32-49fd-b5c5-ce2b1d78389a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:48.628296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba9759-1f32-49fd-b5c5-ce2b1d78389a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:48.628655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba9759-1f32-49fd-b5c5-ce2b1d78389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:48.659263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-90ba9759-1f32-49fd-b5c5-ce2b1d78389a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:48.662247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-90ba9759-1f32-49fd-b5c5-ce2b1d78389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:48.751692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e173bfe34dea466b8f85795847b1d0d3', 'request_id': 'req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.772970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e173bfe34dea466b8f85795847b1d0d3', 'request_id': 'req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.782034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e173bfe34dea466b8f85795847b1d0d3', 'request_id': 'req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.804155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] The token cache is being invalidate because project e173bfe34dea466b8f85795847b1d0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:48.804492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.807277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20501c6-b0ee-4782-8d29-7c6c83e7c0cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:48.813571 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1712/3394] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:48 2022] DELETE /identity/v3/projects/e173bfe34dea466b8f85795847b1d0d3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:48.820859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af5153-256c-4ca8-b005-66289d0245ed None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:48.821141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af5153-256c-4ca8-b005-66289d0245ed None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:48.821413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af5153-256c-4ca8-b005-66289d0245ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:48.828157 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1683/3395] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:48.846950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba9759-1f32-49fd-b5c5-ce2b1d78389a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:48.849268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-90ba9759-1f32-49fd-b5c5-ce2b1d78389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:48.870769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-16af5153-256c-4ca8-b005-66289d0245ed None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:48.872011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-16af5153-256c-4ca8-b005-66289d0245ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:49.016064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba9759-1f32-49fd-b5c5-ce2b1d78389a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:49.114063 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1713/3396] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:56:49.119761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa495c-42a8-4455-84dc-5e8796ec7605 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:49.120576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa495c-42a8-4455-84dc-5e8796ec7605 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:49.127898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa495c-42a8-4455-84dc-5e8796ec7605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:49.169732 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:49.200075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dffa495c-42a8-4455-84dc-5e8796ec7605 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:49.204662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dffa495c-42a8-4455-84dc-5e8796ec7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:49.206416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749716ff-2aac-4389-81f0-e3169452c142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:49.207679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749716ff-2aac-4389-81f0-e3169452c142 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:49.207970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749716ff-2aac-4389-81f0-e3169452c142 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:49.208243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749716ff-2aac-4389-81f0-e3169452c142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:49.225229 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1714/3397] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:49.229729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa495c-42a8-4455-84dc-5e8796ec7605 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:49.229729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dffa495c-42a8-4455-84dc-5e8796ec7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:49.258912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa495c-42a8-4455-84dc-5e8796ec7605 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:49.271698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:49.271977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749716ff-2aac-4389-81f0-e3169452c142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:49.274956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:49.275515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:49.275660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749716ff-2aac-4389-81f0-e3169452c142 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:49.276092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] PATH_INFO: `/v3/projects/684de03dbe714d408d123be8805b08c0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:49.277993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684de03dbe714d408d123be8805b08c0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:49.282286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:49.314146 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:49.380856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684de03dbe714d408d123be8805b08c0', 'request_id': 'req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:49.383164 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1684/3398] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:56:49.386571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749716ff-2aac-4389-81f0-e3169452c142 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:49.397261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684de03dbe714d408d123be8805b08c0', 'request_id': 'req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:49.415331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684de03dbe714d408d123be8805b08c0', 'request_id': 'req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:49.458817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749716ff-2aac-4389-81f0-e3169452c142 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:49.471063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] The token cache is being invalidate because project 684de03dbe714d408d123be8805b08c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:49.471538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:49.472292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2b5e1f11-0cf2-4a85-9ab5-a963c1f1b281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:49.474438 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1715/3399] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:49 2022] DELETE /identity/v3/projects/684de03dbe714d408d123be8805b08c0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:49.480602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ca7b-5e7a-4ba3-9bdc-9a7fda9ce02b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:49.480910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ca7b-5e7a-4ba3-9bdc-9a7fda9ce02b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:49.481190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ca7b-5e7a-4ba3-9bdc-9a7fda9ce02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:49.518779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2281ca7b-5e7a-4ba3-9bdc-9a7fda9ce02b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:49.520877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2281ca7b-5e7a-4ba3-9bdc-9a7fda9ce02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:49.678345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:49.678345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:49.678345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:49.678345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:49.678781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:49.681309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:49.681309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:49.695170 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1685/3400] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:49.701196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:49.702801 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1716/3401] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:49.709817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:49.712171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd046-4b2a-44cb-9e3a-4ed424a515ea None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:49.712539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd046-4b2a-44cb-9e3a-4ed424a515ea None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:49.712958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd046-4b2a-44cb-9e3a-4ed424a515ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:49.739866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b924-0991-406b-865b-8f827e046ee5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:49.745160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-79bdd046-4b2a-44cb-9e3a-4ed424a515ea None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:49.755436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a038b-62d7-4af1-8ad1-02b4d8795cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:49.756663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a038b-62d7-4af1-8ad1-02b4d8795cca admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:49.756663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a038b-62d7-4af1-8ad1-02b4d8795cca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:49.756948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-79bdd046-4b2a-44cb-9e3a-4ed424a515ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:49.757061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a038b-62d7-4af1-8ad1-02b4d8795cca admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:49.757923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a038b-62d7-4af1-8ad1-02b4d8795cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:49.759405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a038b-62d7-4af1-8ad1-02b4d8795cca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:49.790411 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1717/3402] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:49.793519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd046-4b2a-44cb-9e3a-4ed424a515ea None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:49.812370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd046-4b2a-44cb-9e3a-4ed424a515ea None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:49.818009 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1686/3403] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:49 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:49.822101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a038b-62d7-4af1-8ad1-02b4d8795cca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:49.951794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec71e2-aacb-414e-86f3-4b6e8c829ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:49.952427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec71e2-aacb-414e-86f3-4b6e8c829ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:49.952812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec71e2-aacb-414e-86f3-4b6e8c829ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:49.953142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec71e2-aacb-414e-86f3-4b6e8c829ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:49.953823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec71e2-aacb-414e-86f3-4b6e8c829ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:49.955924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec71e2-aacb-414e-86f3-4b6e8c829ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:49.959907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec71e2-aacb-414e-86f3-4b6e8c829ce0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:49.972133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a038b-62d7-4af1-8ad1-02b4d8795cca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:49.984506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f384dbe-f660-4b6f-9074-40853c103e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:49.985369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f384dbe-f660-4b6f-9074-40853c103e2f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:49.985654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f384dbe-f660-4b6f-9074-40853c103e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:49.985928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f384dbe-f660-4b6f-9074-40853c103e2f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:49.986578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f384dbe-f660-4b6f-9074-40853c103e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.006746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f384dbe-f660-4b6f-9074-40853c103e2f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:50.009445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1718/3404] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:50.014631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec71e2-aacb-414e-86f3-4b6e8c829ce0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.059294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec71e2-aacb-414e-86f3-4b6e8c829ce0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:50.080289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e865a-ec71-41b2-852d-e9dfef333a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:50.080952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e865a-ec71-41b2-852d-e9dfef333a3c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.092732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e865a-ec71-41b2-852d-e9dfef333a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.093519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e865a-ec71-41b2-852d-e9dfef333a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.094239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e865a-ec71-41b2-852d-e9dfef333a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.096175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e865a-ec71-41b2-852d-e9dfef333a3c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:50.099238 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1687/3405] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:49 2022] POST /identity/v3/users => generated 287 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:50.104541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f384dbe-f660-4b6f-9074-40853c103e2f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.123030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f384dbe-f660-4b6f-9074-40853c103e2f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:50.154556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6287bc-4e9b-4779-ab3b-370ce3e3471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:50.155412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6287bc-4e9b-4779-ab3b-370ce3e3471f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.155696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6287bc-4e9b-4779-ab3b-370ce3e3471f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.155968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6287bc-4e9b-4779-ab3b-370ce3e3471f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.157710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6287bc-4e9b-4779-ab3b-370ce3e3471f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.159684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6287bc-4e9b-4779-ab3b-370ce3e3471f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:50.186517 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1688/3406] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:50.189254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6287bc-4e9b-4779-ab3b-370ce3e3471f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.194094 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1719/3407] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:50 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:50.218709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e865a-ec71-41b2-852d-e9dfef333a3c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.242502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6287bc-4e9b-4779-ab3b-370ce3e3471f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:50.260418 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:50.369743 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:50.394100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e865a-ec71-41b2-852d-e9dfef333a3c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:50.409896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537b2fd-c05b-47c0-9821-d2078e10bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:50.410545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b2fd-c05b-47c0-9821-d2078e10bce0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.410830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b2fd-c05b-47c0-9821-d2078e10bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.411112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b2fd-c05b-47c0-9821-d2078e10bce0 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.413779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eb34d-b0e6-4d4f-b328-c3c81b1b87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:50.414029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537b2fd-c05b-47c0-9821-d2078e10bce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.415507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eb34d-b0e6-4d4f-b328-c3c81b1b87c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.415931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eb34d-b0e6-4d4f-b328-c3c81b1b87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.416259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eb34d-b0e6-4d4f-b328-c3c81b1b87c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.417073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58eb34d-b0e6-4d4f-b328-c3c81b1b87c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.421964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58eb34d-b0e6-4d4f-b328-c3c81b1b87c6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:50.423002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537b2fd-c05b-47c0-9821-d2078e10bce0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:50.443526 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1689/3408] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:50.448122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eb34d-b0e6-4d4f-b328-c3c81b1b87c6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.468937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eb34d-b0e6-4d4f-b328-c3c81b1b87c6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:50.477419 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1720/3409] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:50 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:50.484230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537b2fd-c05b-47c0-9821-d2078e10bce0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.484539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa692754-b427-4a7a-aa5d-0521cb1dabc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:50.485140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa692754-b427-4a7a-aa5d-0521cb1dabc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.485427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa692754-b427-4a7a-aa5d-0521cb1dabc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.485717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa692754-b427-4a7a-aa5d-0521cb1dabc1 admin admin] PATH_INFO: `/v3/projects/3ea50be0aba14c06be075a46071f64af/users/68691b686e6e43048e2ab25805122ce7/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.498296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537b2fd-c05b-47c0-9821-d2078e10bce0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:50.503726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35579fa-c0fc-4d9c-be83-1bb4713ec9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:50.504366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35579fa-c0fc-4d9c-be83-1bb4713ec9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.504679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35579fa-c0fc-4d9c-be83-1bb4713ec9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.504958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35579fa-c0fc-4d9c-be83-1bb4713ec9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.505668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35579fa-c0fc-4d9c-be83-1bb4713ec9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.507799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35579fa-c0fc-4d9c-be83-1bb4713ec9d1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:50.527130 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1721/3410] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:50.530179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35579fa-c0fc-4d9c-be83-1bb4713ec9d1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.545242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa692754-b427-4a7a-aa5d-0521cb1dabc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea50be0aba14c06be075a46071f64af, user_id=68691b686e6e43048e2ab25805122ce7, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.552877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa692754-b427-4a7a-aa5d-0521cb1dabc1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:50.555018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35579fa-c0fc-4d9c-be83-1bb4713ec9d1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:50.562744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b8059-9a3f-46ff-b630-d3906c885e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:50.563196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b8059-9a3f-46ff-b630-d3906c885e5a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.563490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b8059-9a3f-46ff-b630-d3906c885e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.563870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b8059-9a3f-46ff-b630-d3906c885e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.565270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b8059-9a3f-46ff-b630-d3906c885e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.568253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b8059-9a3f-46ff-b630-d3906c885e5a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:50.589918 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1690/3411] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:50 2022] PUT /identity/v3/projects/3ea50be0aba14c06be075a46071f64af/users/68691b686e6e43048e2ab25805122ce7/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:50.594779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0939a2-f70a-48d5-b59a-6b5abd6536e5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.595072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0939a2-f70a-48d5-b59a-6b5abd6536e5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.595330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0939a2-f70a-48d5-b59a-6b5abd6536e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.610645 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1722/3412] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:50.615312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b8059-9a3f-46ff-b630-d3906c885e5a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.639979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b8059-9a3f-46ff-b630-d3906c885e5a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:50.677377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3f0939a2-f70a-48d5-b59a-6b5abd6536e5 None None] MFA Rules not processed for user `68691b686e6e43048e2ab25805122ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:50.678626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3f0939a2-f70a-48d5-b59a-6b5abd6536e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:50.733235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748ec76-0d96-486c-8882-8733c78bd15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:50.734383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748ec76-0d96-486c-8882-8733c78bd15d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.734762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748ec76-0d96-486c-8882-8733c78bd15d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.735119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748ec76-0d96-486c-8882-8733c78bd15d admin admin] PATH_INFO: `/v3/projects/e870ca3f228e4c6894cf88d40e107fdd/users/4d6594653148482885eb4434812e8929/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.777243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748ec76-0d96-486c-8882-8733c78bd15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e870ca3f228e4c6894cf88d40e107fdd, user_id=4d6594653148482885eb4434812e8929, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.782475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748ec76-0d96-486c-8882-8733c78bd15d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:50.815004 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1723/3413] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:50 2022] PUT /identity/v3/projects/e870ca3f228e4c6894cf88d40e107fdd/users/4d6594653148482885eb4434812e8929/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:50.816906 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1691/3414] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:50.822001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748ec76-0d96-486c-8882-8733c78bd15d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.825845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3748ec76-0d96-486c-8882-8733c78bd15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:50.831766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0939a2-f70a-48d5-b59a-6b5abd6536e5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:50.861516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0939a2-f70a-48d5-b59a-6b5abd6536e5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:50.981464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724026af-1477-4a84-9a4d-8a5560bbc79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:50.982360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724026af-1477-4a84-9a4d-8a5560bbc79f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:50.983274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724026af-1477-4a84-9a4d-8a5560bbc79f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:50.983274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724026af-1477-4a84-9a4d-8a5560bbc79f admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:50.983669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724026af-1477-4a84-9a4d-8a5560bbc79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:50.986157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724026af-1477-4a84-9a4d-8a5560bbc79f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:51.011479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748ec76-0d96-486c-8882-8733c78bd15d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:51.025151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:51.026446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.027468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.029215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] PATH_INFO: `/v3/projects/9f5e23e3363e4fa6a4e47f88bd5e52e0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.030731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5e23e3363e4fa6a4e47f88bd5e52e0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:51.034937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:51.038110 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1692/3415] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:50 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:51.043925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43332ff-db14-48b8-8610-c1bf9162d2f8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.044227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43332ff-db14-48b8-8610-c1bf9162d2f8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.044506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43332ff-db14-48b8-8610-c1bf9162d2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.046824 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:51.113234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c43332ff-db14-48b8-8610-c1bf9162d2f8 None None] MFA Rules not processed for user `4d6594653148482885eb4434812e8929`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:51.114705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c43332ff-db14-48b8-8610-c1bf9162d2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:51.127598 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:51.181146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5e23e3363e4fa6a4e47f88bd5e52e0', 'request_id': 'req-3c111107-1aef-479d-94dc-ab9a873fba8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.199029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5e23e3363e4fa6a4e47f88bd5e52e0', 'request_id': 'req-3c111107-1aef-479d-94dc-ab9a873fba8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.215160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5e23e3363e4fa6a4e47f88bd5e52e0', 'request_id': 'req-3c111107-1aef-479d-94dc-ab9a873fba8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.234711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] The token cache is being invalidate because project 9f5e23e3363e4fa6a4e47f88bd5e52e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:51.235528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.236837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.240512 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1724/3416] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:50 2022] DELETE /identity/v3/projects/9f5e23e3363e4fa6a4e47f88bd5e52e0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:51.241328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:51.245778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:51.256945 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1693/3417] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:51.262084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43332ff-db14-48b8-8610-c1bf9162d2f8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:51.262084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c43332ff-db14-48b8-8610-c1bf9162d2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:51.364395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111107-1aef-479d-94dc-ab9a873fba8b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:51.371983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb1b78-8eb5-4c7b-bf8a-c48665c0d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:51.373848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb1b78-8eb5-4c7b-bf8a-c48665c0d3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.374147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb1b78-8eb5-4c7b-bf8a-c48665c0d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.374428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb1b78-8eb5-4c7b-bf8a-c48665c0d3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.377527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb1b78-8eb5-4c7b-bf8a-c48665c0d3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:51.380110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb1b78-8eb5-4c7b-bf8a-c48665c0d3e5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:51.394669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43332ff-db14-48b8-8610-c1bf9162d2f8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:51.404731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:51.405567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.406549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.406912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] PATH_INFO: `/v3/users/1d9bb1aeb8cd43d4b7c48f7f93ed922b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.408712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9bb1aeb8cd43d4b7c48f7f93ed922b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:51.411133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:51.436999 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1725/3418] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:51 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:51.438027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb1b78-8eb5-4c7b-bf8a-c48665c0d3e5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:51.453406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb1b78-8eb5-4c7b-bf8a-c48665c0d3e5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:51.461092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675caf79-dc2f-41ff-aa0c-4afbb6cb5ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:51.462784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675caf79-dc2f-41ff-aa0c-4afbb6cb5ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.463367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675caf79-dc2f-41ff-aa0c-4afbb6cb5ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.463632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675caf79-dc2f-41ff-aa0c-4afbb6cb5ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.464470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675caf79-dc2f-41ff-aa0c-4afbb6cb5ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:51.468348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675caf79-dc2f-41ff-aa0c-4afbb6cb5ae1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:51.489107 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1726/3419] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:51.490082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675caf79-dc2f-41ff-aa0c-4afbb6cb5ae1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:51.516361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675caf79-dc2f-41ff-aa0c-4afbb6cb5ae1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:51.524517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9ab7-dd75-4260-a7c3-390a783c4192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:51.526085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9ab7-dd75-4260-a7c3-390a783c4192 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.526581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9ab7-dd75-4260-a7c3-390a783c4192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.527057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9ab7-dd75-4260-a7c3-390a783c4192 admin admin] PATH_INFO: `/v3/projects/b3d3f5aa1d0149658def3f6f5e036f0e/users/452aee1e55a6460bb3c97db8dd013234/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.553079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e9ab7-dd75-4260-a7c3-390a783c4192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d3f5aa1d0149658def3f6f5e036f0e, user_id=452aee1e55a6460bb3c97db8dd013234, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:51.557441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e9ab7-dd75-4260-a7c3-390a783c4192 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:51.562567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9bb1aeb8cd43d4b7c48f7f93ed922b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.583737 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1727/3420] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:51 2022] PUT /identity/v3/projects/b3d3f5aa1d0149658def3f6f5e036f0e/users/452aee1e55a6460bb3c97db8dd013234/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:51.584455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9bb1aeb8cd43d4b7c48f7f93ed922b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.585444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9ab7-dd75-4260-a7c3-390a783c4192 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:51.588652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2f2e9ab7-dd75-4260-a7c3-390a783c4192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:51.597247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9bb1aeb8cd43d4b7c48f7f93ed922b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.608288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9bb1aeb8cd43d4b7c48f7f93ed922b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.609153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9bb1aeb8cd43d4b7c48f7f93ed922b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:51.619819 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1694/3421] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:51 2022] DELETE /identity/v3/users/1d9bb1aeb8cd43d4b7c48f7f93ed922b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:51.619819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:51.621268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:51.671003 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:51.701339 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:51.728284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e183b-ded7-4179-ba44-50757b7871a4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:51.735325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1534-e6fd-4556-8663-42e88b74e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:51.736605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1534-e6fd-4556-8663-42e88b74e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.737260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1534-e6fd-4556-8663-42e88b74e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.737260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1534-e6fd-4556-8663-42e88b74e2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.738094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a1534-e6fd-4556-8663-42e88b74e2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:51.741566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a1534-e6fd-4556-8663-42e88b74e2d1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:51.744960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9ab7-dd75-4260-a7c3-390a783c4192 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:51.758000 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1695/3422] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:51.763155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1534-e6fd-4556-8663-42e88b74e2d1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:51.778114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1534-e6fd-4556-8663-42e88b74e2d1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:51.784860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ccdfe-5f51-4f0c-8d75-753dfab935ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:51.785759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ccdfe-5f51-4f0c-8d75-753dfab935ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.786145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ccdfe-5f51-4f0c-8d75-753dfab935ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.786523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ccdfe-5f51-4f0c-8d75-753dfab935ac admin admin] PATH_INFO: `/v3/projects/b3d3f5aa1d0149658def3f6f5e036f0e/users/452aee1e55a6460bb3c97db8dd013234/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.789073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ccdfe-5f51-4f0c-8d75-753dfab935ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d3f5aa1d0149658def3f6f5e036f0e, user_id=452aee1e55a6460bb3c97db8dd013234, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:51.792332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ccdfe-5f51-4f0c-8d75-753dfab935ac admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:51.817919 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1696/3423] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:51 2022] PUT /identity/v3/projects/b3d3f5aa1d0149658def3f6f5e036f0e/users/452aee1e55a6460bb3c97db8dd013234/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:51.820915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b947c-7415-4104-aba0-1e8072c448e0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.821380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b947c-7415-4104-aba0-1e8072c448e0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.821785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b947c-7415-4104-aba0-1e8072c448e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.858841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-461b947c-7415-4104-aba0-1e8072c448e0 None None] MFA Rules not processed for user `452aee1e55a6460bb3c97db8dd013234`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:51.861004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-461b947c-7415-4104-aba0-1e8072c448e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:51.869972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:51.870901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:51.871347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:51.871918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:51.876702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:52.037211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:52.040735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:52.056275 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1728/3424] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:52.076985 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1697/3425] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:52.115022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:52.117185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:52.245672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be58e9-53f2-4beb-afdd-db1130740110 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:52.283883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b947c-7415-4104-aba0-1e8072c448e0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:52.287793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-461b947c-7415-4104-aba0-1e8072c448e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:52.378039 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:52.429161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ab38a-04b9-441e-bdd6-7f08b3840951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:52.431669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b947c-7415-4104-aba0-1e8072c448e0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:52.434394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab38a-04b9-441e-bdd6-7f08b3840951 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:52.436283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab38a-04b9-441e-bdd6-7f08b3840951 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:52.436764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ab38a-04b9-441e-bdd6-7f08b3840951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:52.437599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:52.445083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:52.445445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:52.445795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] PATH_INFO: `/v3/projects/b009eb34372f4ce28a74d49122121b62` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:52.447723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b009eb34372f4ce28a74d49122121b62)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:52.450738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:52.467479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ab38a-04b9-441e-bdd6-7f08b3840951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:52.469837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ab38a-04b9-441e-bdd6-7f08b3840951 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:52.502029 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1729/3426] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:52.503028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ab38a-04b9-441e-bdd6-7f08b3840951 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:52.505175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-444ab38a-04b9-441e-bdd6-7f08b3840951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:52.532383 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:52.543804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b009eb34372f4ce28a74d49122121b62', 'request_id': 'req-71facb20-d249-4e8d-9ed6-c2a6487820b2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.564699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b009eb34372f4ce28a74d49122121b62', 'request_id': 'req-71facb20-d249-4e8d-9ed6-c2a6487820b2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.579037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b009eb34372f4ce28a74d49122121b62', 'request_id': 'req-71facb20-d249-4e8d-9ed6-c2a6487820b2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.598813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] The token cache is being invalidate because project b009eb34372f4ce28a74d49122121b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:52.599218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.600170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.607440 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1698/3427] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:52 2022] DELETE /identity/v3/projects/b009eb34372f4ce28a74d49122121b62 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:52.608983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:52.610621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:52.690492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71facb20-d249-4e8d-9ed6-c2a6487820b2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:52.695205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ab38a-04b9-441e-bdd6-7f08b3840951 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:52.696296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:52.697075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:52.697454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:52.697803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] PATH_INFO: `/v3/users/ea919891e28b42fd9c7ea98cbf2362a4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:52.699804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea919891e28b42fd9c7ea98cbf2362a4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:52.702585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:52.789805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea919891e28b42fd9c7ea98cbf2362a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.823953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea919891e28b42fd9c7ea98cbf2362a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.831963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc8d4e-e3db-4133-b6e2-ea1a3a35315e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:52.834289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc8d4e-e3db-4133-b6e2-ea1a3a35315e service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:52.835206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc8d4e-e3db-4133-b6e2-ea1a3a35315e service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:52.835496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc8d4e-e3db-4133-b6e2-ea1a3a35315e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:52.839468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2acc8d4e-e3db-4133-b6e2-ea1a3a35315e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:52.842928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea919891e28b42fd9c7ea98cbf2362a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.855992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea919891e28b42fd9c7ea98cbf2362a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.858649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc8d4e-e3db-4133-b6e2-ea1a3a35315e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:52.859152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-baf3c32f-c724-4dfa-97f1-cbcabaaa2a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea919891e28b42fd9c7ea98cbf2362a4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:52.861129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc8d4e-e3db-4133-b6e2-ea1a3a35315e service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:52.875259 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1699/3428] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:52 2022] DELETE /identity/v3/users/ea919891e28b42fd9c7ea98cbf2362a4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:52.876810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f47b24-3d9c-428b-af7f-67bf8ffd02ce None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:52.877039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f47b24-3d9c-428b-af7f-67bf8ffd02ce None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:52.883698 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1730/3429] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:52.885037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f47b24-3d9c-428b-af7f-67bf8ffd02ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:52.965659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-11f47b24-3d9c-428b-af7f-67bf8ffd02ce None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:52.970239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-11f47b24-3d9c-428b-af7f-67bf8ffd02ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:53.081101 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:53.129093 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1700/3430] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:53.131684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636656d0-19bd-4c00-bb29-f04238f18ade None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:53.131969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636656d0-19bd-4c00-bb29-f04238f18ade None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:53.132245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636656d0-19bd-4c00-bb29-f04238f18ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:53.163466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-636656d0-19bd-4c00-bb29-f04238f18ade None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:53.164919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-636656d0-19bd-4c00-bb29-f04238f18ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:53.178615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1731/3431] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:53.178909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f47b24-3d9c-428b-af7f-67bf8ffd02ce None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:53.199165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f47b24-3d9c-428b-af7f-67bf8ffd02ce None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:53.208000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e1b8e-bdb9-4409-a767-46eb9d304a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:53.208661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e1b8e-bdb9-4409-a767-46eb9d304a0c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:53.208948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e1b8e-bdb9-4409-a767-46eb9d304a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:53.209224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e1b8e-bdb9-4409-a767-46eb9d304a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:53.211355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e1b8e-bdb9-4409-a767-46eb9d304a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:53.211797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e1b8e-bdb9-4409-a767-46eb9d304a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:53.213526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e1b8e-bdb9-4409-a767-46eb9d304a0c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:53.229949 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1701/3432] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:56:53.234983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636656d0-19bd-4c00-bb29-f04238f18ade None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:53.246887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636656d0-19bd-4c00-bb29-f04238f18ade None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:53.254577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43c88f-1c2a-446c-80db-ba055e1c2047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:53.255775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43c88f-1c2a-446c-80db-ba055e1c2047 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:53.256185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43c88f-1c2a-446c-80db-ba055e1c2047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:53.256564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43c88f-1c2a-446c-80db-ba055e1c2047 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:53.257482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43c88f-1c2a-446c-80db-ba055e1c2047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:53.259537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43c88f-1c2a-446c-80db-ba055e1c2047 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:53.310146 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1732/3433] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:53 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:53.314412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e1b8e-bdb9-4409-a767-46eb9d304a0c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:53.327261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e1b8e-bdb9-4409-a767-46eb9d304a0c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:53.422911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e040-45af-4e02-b79d-71a05d4c6f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:53.424198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e040-45af-4e02-b79d-71a05d4c6f4a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:53.424679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e040-45af-4e02-b79d-71a05d4c6f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:53.425484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e040-45af-4e02-b79d-71a05d4c6f4a admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:53.426958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e040-45af-4e02-b79d-71a05d4c6f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:53.429229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e040-45af-4e02-b79d-71a05d4c6f4a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:53.459075 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1702/3434] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:53 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:53.464003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43c88f-1c2a-446c-80db-ba055e1c2047 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:53.486720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43c88f-1c2a-446c-80db-ba055e1c2047 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:53.495868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c030-3271-4940-9525-b6a5b10637b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:53.497681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c030-3271-4940-9525-b6a5b10637b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:53.497914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c030-3271-4940-9525-b6a5b10637b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:53.498196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c030-3271-4940-9525-b6a5b10637b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:53.498862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c030-3271-4940-9525-b6a5b10637b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:53.500641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c030-3271-4940-9525-b6a5b10637b7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:53.567594 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1733/3435] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:53.569830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e040-45af-4e02-b79d-71a05d4c6f4a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:53.593012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e040-45af-4e02-b79d-71a05d4c6f4a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:53.600460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48fa5e-218d-4cc9-ad72-24f5a74f3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:53.601280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48fa5e-218d-4cc9-ad72-24f5a74f3f20 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:53.601569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48fa5e-218d-4cc9-ad72-24f5a74f3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:53.601847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48fa5e-218d-4cc9-ad72-24f5a74f3f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:53.602841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48fa5e-218d-4cc9-ad72-24f5a74f3f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:53.604597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48fa5e-218d-4cc9-ad72-24f5a74f3f20 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:53.647740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c030-3271-4940-9525-b6a5b10637b7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:53.659388 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1703/3436] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:53.665228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c030-3271-4940-9525-b6a5b10637b7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:53.671609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59719e2-a69e-4654-b4a6-b56825b1b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:53.672440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59719e2-a69e-4654-b4a6-b56825b1b734 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:53.672845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59719e2-a69e-4654-b4a6-b56825b1b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:53.674590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59719e2-a69e-4654-b4a6-b56825b1b734 admin admin] PATH_INFO: `/v3/projects/fe7daea1c94340fcb98a3831cd74655f/users/5decad27fffe49b99ef87c8e388b6df1/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:53.698700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59719e2-a69e-4654-b4a6-b56825b1b734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7daea1c94340fcb98a3831cd74655f, user_id=5decad27fffe49b99ef87c8e388b6df1, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:53.704853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59719e2-a69e-4654-b4a6-b56825b1b734 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:53.736966 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1734/3437] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:53 2022] PUT /identity/v3/projects/fe7daea1c94340fcb98a3831cd74655f/users/5decad27fffe49b99ef87c8e388b6df1/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:53.746493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fec81-a175-4a6a-90c6-e0b61999e4c9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:53.746825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fec81-a175-4a6a-90c6-e0b61999e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:53.747611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fec81-a175-4a6a-90c6-e0b61999e4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:53.801150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fc4fec81-a175-4a6a-90c6-e0b61999e4c9 None None] MFA Rules not processed for user `5decad27fffe49b99ef87c8e388b6df1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:53.802766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc4fec81-a175-4a6a-90c6-e0b61999e4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:53.889144 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1704/3438] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:53.894243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59719e2-a69e-4654-b4a6-b56825b1b734 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:53.910733 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:53.982593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59719e2-a69e-4654-b4a6-b56825b1b734 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:53.989875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b10053-68b6-48df-aeef-eb9750443208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:53.990658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10053-68b6-48df-aeef-eb9750443208 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:53.990944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10053-68b6-48df-aeef-eb9750443208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:53.991220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10053-68b6-48df-aeef-eb9750443208 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:53.991913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b10053-68b6-48df-aeef-eb9750443208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:53.993884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b10053-68b6-48df-aeef-eb9750443208 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.027035 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1735/3439] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:53 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:54.031513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fec81-a175-4a6a-90c6-e0b61999e4c9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:54.043389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fec81-a175-4a6a-90c6-e0b61999e4c9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:54.114181 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:54.142606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06581d4a-8fb6-4731-a602-65dcca293ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:54.143346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06581d4a-8fb6-4731-a602-65dcca293ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.150474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06581d4a-8fb6-4731-a602-65dcca293ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.151160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06581d4a-8fb6-4731-a602-65dcca293ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.169715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06581d4a-8fb6-4731-a602-65dcca293ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:54.169715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06581d4a-8fb6-4731-a602-65dcca293ed5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.182104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b10053-68b6-48df-aeef-eb9750443208 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:54.185985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f0b10053-68b6-48df-aeef-eb9750443208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:54.209142 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1705/3440] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:54 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:54.211380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b10053-68b6-48df-aeef-eb9750443208 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:54.214186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06581d4a-8fb6-4731-a602-65dcca293ed5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:54.218671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:54.219333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.219625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.219905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] PATH_INFO: `/v3/projects/488f8fabd15e4e7c8837ccd25c842e46` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.221214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488f8fabd15e4e7c8837ccd25c842e46)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:54.223468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.258264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06581d4a-8fb6-4731-a602-65dcca293ed5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:54.266096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec0ed1-0f16-4a64-8d8d-983de891ac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:54.266716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0ed1-0f16-4a64-8d8d-983de891ac6b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.268540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0ed1-0f16-4a64-8d8d-983de891ac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.268840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0ed1-0f16-4a64-8d8d-983de891ac6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.269503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec0ed1-0f16-4a64-8d8d-983de891ac6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:54.271222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec0ed1-0f16-4a64-8d8d-983de891ac6b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.282854 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1706/3441] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:56:54.287223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec0ed1-0f16-4a64-8d8d-983de891ac6b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:54.303185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec0ed1-0f16-4a64-8d8d-983de891ac6b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:54.332889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488f8fabd15e4e7c8837ccd25c842e46', 'request_id': 'req-08dc247e-81d1-4831-8423-540bb79c6aa0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:54.363810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488f8fabd15e4e7c8837ccd25c842e46', 'request_id': 'req-08dc247e-81d1-4831-8423-540bb79c6aa0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:54.376589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee8c6a-38fc-4585-b48d-ae977b63c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:54.377360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8c6a-38fc-4585-b48d-ae977b63c91a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.377577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8c6a-38fc-4585-b48d-ae977b63c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.377849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8c6a-38fc-4585-b48d-ae977b63c91a admin admin] PATH_INFO: `/v3/projects/1b500edbf67b4bb1addd637d78d6331a/users/a5991f9a3e9846f497d42e9124ca0524/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.382688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488f8fabd15e4e7c8837ccd25c842e46', 'request_id': 'req-08dc247e-81d1-4831-8423-540bb79c6aa0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:54.398377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee8c6a-38fc-4585-b48d-ae977b63c91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b500edbf67b4bb1addd637d78d6331a, user_id=a5991f9a3e9846f497d42e9124ca0524, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:54.401488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee8c6a-38fc-4585-b48d-ae977b63c91a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.410002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] The token cache is being invalidate because project 488f8fabd15e4e7c8837ccd25c842e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:54.410628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:54.411389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-08dc247e-81d1-4831-8423-540bb79c6aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:54.416517 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1736/3442] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:54 2022] DELETE /identity/v3/projects/488f8fabd15e4e7c8837ccd25c842e46 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:54.423493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44709290-aec5-4fa3-a2a2-849c0af455ef None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.423779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44709290-aec5-4fa3-a2a2-849c0af455ef None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.424051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44709290-aec5-4fa3-a2a2-849c0af455ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.435327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1707/3443] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:54 2022] PUT /identity/v3/projects/1b500edbf67b4bb1addd637d78d6331a/users/a5991f9a3e9846f497d42e9124ca0524/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:54.439329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee8c6a-38fc-4585-b48d-ae977b63c91a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:54.446467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3bee8c6a-38fc-4585-b48d-ae977b63c91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:54.449122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-44709290-aec5-4fa3-a2a2-849c0af455ef None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:54.451476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-44709290-aec5-4fa3-a2a2-849c0af455ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:54.535151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee8c6a-38fc-4585-b48d-ae977b63c91a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:54.542063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de35af-5752-4f9d-ab53-88b7c9508bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:54.543126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de35af-5752-4f9d-ab53-88b7c9508bae admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.543667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de35af-5752-4f9d-ab53-88b7c9508bae admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.544942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de35af-5752-4f9d-ab53-88b7c9508bae admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.545974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de35af-5752-4f9d-ab53-88b7c9508bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:54.548519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de35af-5752-4f9d-ab53-88b7c9508bae admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.566060 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1737/3444] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:54.567813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9a67b-37c8-4c79-b61a-16e0302265f3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.568229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9a67b-37c8-4c79-b61a-16e0302265f3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.568513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9a67b-37c8-4c79-b61a-16e0302265f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.571582 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1708/3445] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:56:54.575696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de35af-5752-4f9d-ab53-88b7c9508bae admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:54.587432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de35af-5752-4f9d-ab53-88b7c9508bae admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:54.593815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe25f8-7279-495b-898b-92f3e9403baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:54.595104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe25f8-7279-495b-898b-92f3e9403baa admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.595366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4cf9a67b-37c8-4c79-b61a-16e0302265f3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:54.595501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe25f8-7279-495b-898b-92f3e9403baa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.595654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe25f8-7279-495b-898b-92f3e9403baa admin admin] PATH_INFO: `/v3/projects/1b500edbf67b4bb1addd637d78d6331a/users/a5991f9a3e9846f497d42e9124ca0524/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.598924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe25f8-7279-495b-898b-92f3e9403baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b500edbf67b4bb1addd637d78d6331a, user_id=a5991f9a3e9846f497d42e9124ca0524, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:54.599974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4cf9a67b-37c8-4c79-b61a-16e0302265f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:54.601019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe25f8-7279-495b-898b-92f3e9403baa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.614102 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1738/3446] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:54.615816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9a67b-37c8-4c79-b61a-16e0302265f3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:54.616066 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1709/3447] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:54 2022] PUT /identity/v3/projects/1b500edbf67b4bb1addd637d78d6331a/users/a5991f9a3e9846f497d42e9124ca0524/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:54.627089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f576-7475-41dc-9230-fa6998ea6e7a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.627293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9a67b-37c8-4c79-b61a-16e0302265f3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:54.627512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f576-7475-41dc-9230-fa6998ea6e7a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.627890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f576-7475-41dc-9230-fa6998ea6e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.640648 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:54.670026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-72d8f576-7475-41dc-9230-fa6998ea6e7a None None] MFA Rules not processed for user `a5991f9a3e9846f497d42e9124ca0524`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:54.671609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-72d8f576-7475-41dc-9230-fa6998ea6e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:54.695581 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:54.745390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8584-33d2-4ac7-b3c8-35ebf9ab34b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:54.746076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8584-33d2-4ac7-b3c8-35ebf9ab34b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.746339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8584-33d2-4ac7-b3c8-35ebf9ab34b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.746604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8584-33d2-4ac7-b3c8-35ebf9ab34b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.748056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8584-33d2-4ac7-b3c8-35ebf9ab34b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:54.748419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8584-33d2-4ac7-b3c8-35ebf9ab34b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:54.750435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8584-33d2-4ac7-b3c8-35ebf9ab34b7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.790906 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1739/3448] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:54.793306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8584-33d2-4ac7-b3c8-35ebf9ab34b7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:54.808079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8584-33d2-4ac7-b3c8-35ebf9ab34b7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:54.815235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8c43-19eb-4f73-be30-58ee463a8cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:54.815862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8c43-19eb-4f73-be30-58ee463a8cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.816146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8c43-19eb-4f73-be30-58ee463a8cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.816431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8c43-19eb-4f73-be30-58ee463a8cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.817226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8c43-19eb-4f73-be30-58ee463a8cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:54.819723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8c43-19eb-4f73-be30-58ee463a8cc1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.827942 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1710/3449] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:54.829561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913d5c-514c-46c0-b8d1-99f20ba28b39 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.829837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913d5c-514c-46c0-b8d1-99f20ba28b39 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.830108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913d5c-514c-46c0-b8d1-99f20ba28b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.855620 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1740/3450] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:54 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:54.857231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8c43-19eb-4f73-be30-58ee463a8cc1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:54.862051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b4913d5c-514c-46c0-b8d1-99f20ba28b39 None None] MFA Rules not processed for user `5decad27fffe49b99ef87c8e388b6df1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:54.863892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b4913d5c-514c-46c0-b8d1-99f20ba28b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:54.950990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8c43-19eb-4f73-be30-58ee463a8cc1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:54.957510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc68a8-f9e7-4ecc-a514-6960563e237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:54.958942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc68a8-f9e7-4ecc-a514-6960563e237e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:54.959332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc68a8-f9e7-4ecc-a514-6960563e237e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:54.959707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc68a8-f9e7-4ecc-a514-6960563e237e admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:54.960648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc68a8-f9e7-4ecc-a514-6960563e237e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:54.962970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc68a8-f9e7-4ecc-a514-6960563e237e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:54.972853 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1711/3451] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:55.035412 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1741/3452] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:54 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:55.037556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913d5c-514c-46c0-b8d1-99f20ba28b39 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:55.066322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913d5c-514c-46c0-b8d1-99f20ba28b39 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:55.110060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ef18-b292-48df-ad36-dcd26d869f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:55.112778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ef18-b292-48df-ad36-dcd26d869f10 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:55.114166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ef18-b292-48df-ad36-dcd26d869f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:55.114483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ef18-b292-48df-ad36-dcd26d869f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:55.123026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ef18-b292-48df-ad36-dcd26d869f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:55.126980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ef18-b292-48df-ad36-dcd26d869f10 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:55.151975 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1712/3453] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:55.155178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc68a8-f9e7-4ecc-a514-6960563e237e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:55.174916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ef18-b292-48df-ad36-dcd26d869f10 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:55.176868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fa79ef18-b292-48df-ad36-dcd26d869f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:55.179329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc68a8-f9e7-4ecc-a514-6960563e237e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:55.200339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a11352-5bc1-4f5a-bf68-60f69bdb7073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:55.200585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a11352-5bc1-4f5a-bf68-60f69bdb7073 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:55.200794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a11352-5bc1-4f5a-bf68-60f69bdb7073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:55.201026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a11352-5bc1-4f5a-bf68-60f69bdb7073 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:55.201652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a11352-5bc1-4f5a-bf68-60f69bdb7073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:55.207895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a11352-5bc1-4f5a-bf68-60f69bdb7073 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:55.223405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ef18-b292-48df-ad36-dcd26d869f10 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:55.238243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:55.238243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:55.238566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1742/3454] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:55.238656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:55.238656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] PATH_INFO: `/v3/users/4d6594653148482885eb4434812e8929` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:55.239113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6594653148482885eb4434812e8929)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:55.240230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a11352-5bc1-4f5a-bf68-60f69bdb7073 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:55.241497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:55.275388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a11352-5bc1-4f5a-bf68-60f69bdb7073 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:55.290561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009254b0-8475-4a7a-8472-b27b5f4c375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:55.291258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009254b0-8475-4a7a-8472-b27b5f4c375b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:55.291541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009254b0-8475-4a7a-8472-b27b5f4c375b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:55.291817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009254b0-8475-4a7a-8472-b27b5f4c375b admin admin] PATH_INFO: `/v3/projects/7da1bd05d0434eb09dc23bf327d9f1c1/users/37c7f5d1bc3a431eacef3cf113e958d7/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:55.314943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009254b0-8475-4a7a-8472-b27b5f4c375b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da1bd05d0434eb09dc23bf327d9f1c1, user_id=37c7f5d1bc3a431eacef3cf113e958d7, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:55.317992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009254b0-8475-4a7a-8472-b27b5f4c375b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:55.326618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6594653148482885eb4434812e8929'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:55.337869 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1743/3455] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:55 2022] PUT /identity/v3/projects/7da1bd05d0434eb09dc23bf327d9f1c1/users/37c7f5d1bc3a431eacef3cf113e958d7/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:55.342998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009254b0-8475-4a7a-8472-b27b5f4c375b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:55.349282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-009254b0-8475-4a7a-8472-b27b5f4c375b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:55.350048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6594653148482885eb4434812e8929'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:55.366822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6594653148482885eb4434812e8929'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:55.382941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6594653148482885eb4434812e8929'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:55.383850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a4d158-d58c-4e3c-9743-d0fb8c106731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6594653148482885eb4434812e8929'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:55.395981 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1713/3456] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:55 2022] DELETE /identity/v3/users/4d6594653148482885eb4434812e8929 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:55.398330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338d5a1-f7ff-4459-b1bd-b9e1e653bd2d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:55.399670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338d5a1-f7ff-4459-b1bd-b9e1e653bd2d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:55.399955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338d5a1-f7ff-4459-b1bd-b9e1e653bd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:55.408251 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:55.445295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1338d5a1-f7ff-4459-b1bd-b9e1e653bd2d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:55.446531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1338d5a1-f7ff-4459-b1bd-b9e1e653bd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:55.461276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009254b0-8475-4a7a-8472-b27b5f4c375b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:55.470655 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:55.542354 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1714/3457] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:55.544235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947aa84-313f-4b6d-a09a-ff5d94283fec None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:55.544745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947aa84-313f-4b6d-a09a-ff5d94283fec None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:55.545113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947aa84-313f-4b6d-a09a-ff5d94283fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:55.568740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283ef8f-9650-430c-85ad-acf8c4d0408e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:55.570270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ef8f-9650-430c-85ad-acf8c4d0408e service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:55.570768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ef8f-9650-430c-85ad-acf8c4d0408e service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:55.571228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ef8f-9650-430c-85ad-acf8c4d0408e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:55.573242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5947aa84-313f-4b6d-a09a-ff5d94283fec None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:55.573387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b283ef8f-9650-430c-85ad-acf8c4d0408e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:55.576021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5947aa84-313f-4b6d-a09a-ff5d94283fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:55.586649 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1715/3458] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:55.588256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947aa84-313f-4b6d-a09a-ff5d94283fec None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:55.591742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5947aa84-313f-4b6d-a09a-ff5d94283fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:55.663812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283ef8f-9650-430c-85ad-acf8c4d0408e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:55.666649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283ef8f-9650-430c-85ad-acf8c4d0408e service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:55.692603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947aa84-313f-4b6d-a09a-ff5d94283fec None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:55.693123 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1744/3459] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:55.695712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283ef8f-9650-430c-85ad-acf8c4d0408e service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:55.698362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd41321-ee57-4344-b35e-a954ef8e20d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:55.698986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd41321-ee57-4344-b35e-a954ef8e20d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:55.699524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd41321-ee57-4344-b35e-a954ef8e20d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:55.699799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd41321-ee57-4344-b35e-a954ef8e20d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:55.718709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd41321-ee57-4344-b35e-a954ef8e20d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:55.720393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd41321-ee57-4344-b35e-a954ef8e20d6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:55.722225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283ef8f-9650-430c-85ad-acf8c4d0408e service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:55.734085 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1716/3460] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:55.736537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af707d-5ccb-4a46-9d5d-6ea7f76df0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:55.737525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af707d-5ccb-4a46-9d5d-6ea7f76df0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:55.737886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af707d-5ccb-4a46-9d5d-6ea7f76df0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:55.738235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af707d-5ccb-4a46-9d5d-6ea7f76df0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:55.752053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af707d-5ccb-4a46-9d5d-6ea7f76df0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:55.754417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af707d-5ccb-4a46-9d5d-6ea7f76df0f2 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:55.766388 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1745/3461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:56.750713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd41321-ee57-4344-b35e-a954ef8e20d6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:56.753450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0fd41321-ee57-4344-b35e-a954ef8e20d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:56.788149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd41321-ee57-4344-b35e-a954ef8e20d6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:56.803704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:56.806548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:56.807036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:56.808242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] PATH_INFO: `/v3/users/68691b686e6e43048e2ab25805122ce7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:56.811211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=68691b686e6e43048e2ab25805122ce7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:56.815847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:56.983724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68691b686e6e43048e2ab25805122ce7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.021616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68691b686e6e43048e2ab25805122ce7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.037561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68691b686e6e43048e2ab25805122ce7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.052920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68691b686e6e43048e2ab25805122ce7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.053687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68691b686e6e43048e2ab25805122ce7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.068658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecbcde-3c59-4a7c-b08a-2a3d925a452e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:57.069255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecbcde-3c59-4a7c-b08a-2a3d925a452e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:57.070256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecbcde-3c59-4a7c-b08a-2a3d925a452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:57.076364 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1717/3462] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:56 2022] DELETE /identity/v3/users/68691b686e6e43048e2ab25805122ce7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:57.114865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b0ecbcde-3c59-4a7c-b08a-2a3d925a452e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:57.117369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b0ecbcde-3c59-4a7c-b08a-2a3d925a452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:57.219062 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:57.245037 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1746/3463] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:57.358247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:57.360604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:57.407665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b7a2e-645f-42ed-8c8e-5dada17ae9fb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:57.428339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:57.429286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:57.429637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:57.430009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] PATH_INFO: `/v3/projects/e870ca3f228e4c6894cf88d40e107fdd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:57.433158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e870ca3f228e4c6894cf88d40e107fdd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:57.435299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:57.445265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72a92f-d24d-44e4-9392-739e7e45b792 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:57.445734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72a92f-d24d-44e4-9392-739e7e45b792 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:57.446170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72a92f-d24d-44e4-9392-739e7e45b792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:57.488236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2d72a92f-d24d-44e4-9392-739e7e45b792 None None] MFA Rules not processed for user `c9ac716a6af441a4bc02d8ef11f81487`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:57.492283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2d72a92f-d24d-44e4-9392-739e7e45b792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:57.506032 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:57.586384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e870ca3f228e4c6894cf88d40e107fdd', 'request_id': 'req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.604461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e870ca3f228e4c6894cf88d40e107fdd', 'request_id': 'req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.628160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e870ca3f228e4c6894cf88d40e107fdd', 'request_id': 'req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.657547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] The token cache is being invalidate because project e870ca3f228e4c6894cf88d40e107fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:57.660633 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1747/3464] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:56:57.661554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72a92f-d24d-44e4-9392-739e7e45b792 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:57.663823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2d72a92f-d24d-44e4-9392-739e7e45b792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:57.665069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.666788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca487c8f-6ba0-4661-a154-c28c7ff31fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:57.670726 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1718/3465] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:57 2022] DELETE /identity/v3/projects/e870ca3f228e4c6894cf88d40e107fdd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:57.677589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea490e5-286f-40f2-a9a3-7deceb556b7b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:57.677842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea490e5-286f-40f2-a9a3-7deceb556b7b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:57.678106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea490e5-286f-40f2-a9a3-7deceb556b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:57.739099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1ea490e5-286f-40f2-a9a3-7deceb556b7b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:57.740361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1ea490e5-286f-40f2-a9a3-7deceb556b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:57.857388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72a92f-d24d-44e4-9392-739e7e45b792 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:57.932718 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1719/3466] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:57.934301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea490e5-286f-40f2-a9a3-7deceb556b7b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:57.936697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1ea490e5-286f-40f2-a9a3-7deceb556b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:57.976102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:57.976788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:57.977074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:57.977349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:57.979434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:57.998206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.000038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.020752 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1748/3467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:58.021585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:58.023064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:58.083855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea490e5-286f-40f2-a9a3-7deceb556b7b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:58.097962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad05c8-f4b6-481b-8052-e506036df3c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:58.098727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad05c8-f4b6-481b-8052-e506036df3c2 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.099082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad05c8-f4b6-481b-8052-e506036df3c2 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.099440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad05c8-f4b6-481b-8052-e506036df3c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.102159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-47ad05c8-f4b6-481b-8052-e506036df3c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:58.132177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad05c8-f4b6-481b-8052-e506036df3c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.133542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef9d1-f341-4c09-b467-6e597c0fed29 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:58.135184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad05c8-f4b6-481b-8052-e506036df3c2 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.142300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30fe36-f47b-42e0-b949-c9c7f0f23105 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:58.143233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30fe36-f47b-42e0-b949-c9c7f0f23105 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.144123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30fe36-f47b-42e0-b949-c9c7f0f23105 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.144835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30fe36-f47b-42e0-b949-c9c7f0f23105 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.154858 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1720/3468] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:58.156683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94823b-f8f0-4f15-ade0-3ba654c08440 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.157052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94823b-f8f0-4f15-ade0-3ba654c08440 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.157984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94823b-f8f0-4f15-ade0-3ba654c08440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.166661 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:58.176264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30fe36-f47b-42e0-b949-c9c7f0f23105 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.181579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30fe36-f47b-42e0-b949-c9c7f0f23105 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.185411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1b94823b-f8f0-4f15-ade0-3ba654c08440 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:58.187182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1b94823b-f8f0-4f15-ade0-3ba654c08440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:58.202086 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1721/3469] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:58.210071 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1749/3470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:56:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:56:58.210897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94823b-f8f0-4f15-ade0-3ba654c08440 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:58.223972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94823b-f8f0-4f15-ade0-3ba654c08440 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:58.237064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb74be-6a42-481a-88fd-0a68d6db872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:58.237946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb74be-6a42-481a-88fd-0a68d6db872d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.238887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb74be-6a42-481a-88fd-0a68d6db872d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.238887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb74be-6a42-481a-88fd-0a68d6db872d admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.239671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb74be-6a42-481a-88fd-0a68d6db872d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:56:58.240409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb74be-6a42-481a-88fd-0a68d6db872d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.244018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb74be-6a42-481a-88fd-0a68d6db872d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.264982 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1722/3471] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:56:58.267067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30fe36-f47b-42e0-b949-c9c7f0f23105 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:58.291436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30fe36-f47b-42e0-b949-c9c7f0f23105 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:58.302705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f5294-4602-4b30-a7ac-f0c2031051eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:58.304149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f5294-4602-4b30-a7ac-f0c2031051eb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.304480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f5294-4602-4b30-a7ac-f0c2031051eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.304937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f5294-4602-4b30-a7ac-f0c2031051eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.306633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f5294-4602-4b30-a7ac-f0c2031051eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.308670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f5294-4602-4b30-a7ac-f0c2031051eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.396412 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1750/3472] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:58 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:58.397735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb74be-6a42-481a-88fd-0a68d6db872d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:58.416609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb74be-6a42-481a-88fd-0a68d6db872d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:58.460043 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:58.543606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659be57-d233-437a-a062-5997c36741c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:58.544748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659be57-d233-437a-a062-5997c36741c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.545240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659be57-d233-437a-a062-5997c36741c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.545896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659be57-d233-437a-a062-5997c36741c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.547145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659be57-d233-437a-a062-5997c36741c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.557249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659be57-d233-437a-a062-5997c36741c7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.624984 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1723/3473] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:58 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:56:58.629251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f5294-4602-4b30-a7ac-f0c2031051eb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:58.650661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f5294-4602-4b30-a7ac-f0c2031051eb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:58.663939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d99b-9135-4da5-8658-4a396b77ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:58.664928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d99b-9135-4da5-8658-4a396b77ca49 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.665424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d99b-9135-4da5-8658-4a396b77ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.665890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d99b-9135-4da5-8658-4a396b77ca49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.666682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150d99b-9135-4da5-8658-4a396b77ca49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.668534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150d99b-9135-4da5-8658-4a396b77ca49 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.681775 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1751/3474] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:58.685920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659be57-d233-437a-a062-5997c36741c7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:58.706622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659be57-d233-437a-a062-5997c36741c7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:58.732554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f72ff-d531-4ec0-8813-b4a44ef78c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:58.736079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f72ff-d531-4ec0-8813-b4a44ef78c77 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.738668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f72ff-d531-4ec0-8813-b4a44ef78c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.739134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f72ff-d531-4ec0-8813-b4a44ef78c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.740030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f72ff-d531-4ec0-8813-b4a44ef78c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.743931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f72ff-d531-4ec0-8813-b4a44ef78c77 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.751627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d99b-9135-4da5-8658-4a396b77ca49 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:58.753260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2150d99b-9135-4da5-8658-4a396b77ca49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:58.777286 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1724/3475] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:58.782075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f72ff-d531-4ec0-8813-b4a44ef78c77 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:58.790349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d99b-9135-4da5-8658-4a396b77ca49 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:58.796775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f72ff-d531-4ec0-8813-b4a44ef78c77 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:58.803793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889235e0-8af4-4eb8-a208-fe24cfd9b87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:58.804096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:58.804790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.805073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.805223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889235e0-8af4-4eb8-a208-fe24cfd9b87d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.805351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] PATH_INFO: `/v3/projects/3ea50be0aba14c06be075a46071f64af` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.805811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889235e0-8af4-4eb8-a208-fe24cfd9b87d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.806185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889235e0-8af4-4eb8-a208-fe24cfd9b87d admin admin] PATH_INFO: `/v3/projects/45697b712cc6458c8d13c10a1aaff974/users/87e787da239a48f2adc819a832674f3f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.811209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea50be0aba14c06be075a46071f64af)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.814079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.839579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889235e0-8af4-4eb8-a208-fe24cfd9b87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45697b712cc6458c8d13c10a1aaff974, user_id=87e787da239a48f2adc819a832674f3f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:58.847051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889235e0-8af4-4eb8-a208-fe24cfd9b87d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:58.879320 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1725/3476] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:58 2022] PUT /identity/v3/projects/45697b712cc6458c8d13c10a1aaff974/users/87e787da239a48f2adc819a832674f3f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:58.969797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea50be0aba14c06be075a46071f64af', 'request_id': 'req-7040c105-5eeb-437d-af81-b661141bf729'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:58.971488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244b1af-9c41-4507-9822-8138d594a89b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:58.971976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244b1af-9c41-4507-9822-8138d594a89b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:58.972347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244b1af-9c41-4507-9822-8138d594a89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:58.999024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea50be0aba14c06be075a46071f64af', 'request_id': 'req-7040c105-5eeb-437d-af81-b661141bf729'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:59.009163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea50be0aba14c06be075a46071f64af', 'request_id': 'req-7040c105-5eeb-437d-af81-b661141bf729'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:59.037745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] The token cache is being invalidate because project 3ea50be0aba14c06be075a46071f64af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:56:59.038024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:59.038795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1244b1af-9c41-4507-9822-8138d594a89b None None] MFA Rules not processed for user `87e787da239a48f2adc819a832674f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:56:59.040050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1244b1af-9c41-4507-9822-8138d594a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:59.040954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:59.048396 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1752/3477] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:56:58 2022] DELETE /identity/v3/projects/3ea50be0aba14c06be075a46071f64af => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:56:59.050174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:59.053256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:59.175042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040c105-5eeb-437d-af81-b661141bf729 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:59.181333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:59.181999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:59.182326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:59.182817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] PATH_INFO: `/v3/users/452aee1e55a6460bb3c97db8dd013234` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:59.184431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=452aee1e55a6460bb3c97db8dd013234)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:59.187650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:59.197544 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1726/3478] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:56:59.203126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244b1af-9c41-4507-9822-8138d594a89b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:59.205274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1244b1af-9c41-4507-9822-8138d594a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:59.225577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244b1af-9c41-4507-9822-8138d594a89b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:59.250467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b9c4-7104-4c40-a8d7-fcd8bea881cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:59.252228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b9c4-7104-4c40-a8d7-fcd8bea881cb admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:59.254718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b9c4-7104-4c40-a8d7-fcd8bea881cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:59.255136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b9c4-7104-4c40-a8d7-fcd8bea881cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:59.256989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2b9c4-7104-4c40-a8d7-fcd8bea881cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:59.262432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2b9c4-7104-4c40-a8d7-fcd8bea881cb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:59.311988 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:59.314676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452aee1e55a6460bb3c97db8dd013234'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:59.322757 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1727/3479] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:56:59 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:59.325400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b9c4-7104-4c40-a8d7-fcd8bea881cb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:59.344703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452aee1e55a6460bb3c97db8dd013234'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:59.357865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452aee1e55a6460bb3c97db8dd013234'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:59.370736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452aee1e55a6460bb3c97db8dd013234'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:59.371332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452aee1e55a6460bb3c97db8dd013234'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:56:59.381598 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1753/3480] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:56:59 2022] DELETE /identity/v3/users/452aee1e55a6460bb3c97db8dd013234 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:59.426480 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:59.448177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b9c4-7104-4c40-a8d7-fcd8bea881cb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:59.558822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c508-bdfc-40e9-a90e-2ab008f82187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:59.561344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c508-bdfc-40e9-a90e-2ab008f82187 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:59.561783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c508-bdfc-40e9-a90e-2ab008f82187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:59.562246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c508-bdfc-40e9-a90e-2ab008f82187 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:59.563594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20c508-bdfc-40e9-a90e-2ab008f82187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:59.566708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20c508-bdfc-40e9-a90e-2ab008f82187 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:59.627799 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1728/3481] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:56:59 2022] POST /identity/v3/users => generated 294 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:56:59.632235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:59.633818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:56:59.672570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568123b3-71d6-4636-9411-1063e473c11c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:59.689025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734aa22f-1d26-4fd9-b2fd-61337ebb94ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:59.691839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734aa22f-1d26-4fd9-b2fd-61337ebb94ef admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:59.692147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734aa22f-1d26-4fd9-b2fd-61337ebb94ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:59.692485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734aa22f-1d26-4fd9-b2fd-61337ebb94ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:59.693437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734aa22f-1d26-4fd9-b2fd-61337ebb94ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:59.699203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734aa22f-1d26-4fd9-b2fd-61337ebb94ef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:59.718855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c508-bdfc-40e9-a90e-2ab008f82187 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:59.719148 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1754/3482] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:59.734204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c508-bdfc-40e9-a90e-2ab008f82187 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:59.741328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343c634-ffc4-4345-a604-8346f9f52b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:59.742006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c634-ffc4-4345-a604-8346f9f52b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:59.742352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c634-ffc4-4345-a604-8346f9f52b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:59.742674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c634-ffc4-4345-a604-8346f9f52b31 admin admin] PATH_INFO: `/v3/projects/b547e7cff8dc46fb919b8de3ed4566ae/users/c5dcd07fc4f543fcb6476838abb44ebf/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:59.766649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343c634-ffc4-4345-a604-8346f9f52b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b547e7cff8dc46fb919b8de3ed4566ae, user_id=c5dcd07fc4f543fcb6476838abb44ebf, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:59.769436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343c634-ffc4-4345-a604-8346f9f52b31 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:59.797049 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1729/3483] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:59 2022] PUT /identity/v3/projects/b547e7cff8dc46fb919b8de3ed4566ae/users/c5dcd07fc4f543fcb6476838abb44ebf/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:56:59.801815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734aa22f-1d26-4fd9-b2fd-61337ebb94ef admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:59.818085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734aa22f-1d26-4fd9-b2fd-61337ebb94ef admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:59.919178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47ffa6-7282-4982-b460-3da93318650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:59.920141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47ffa6-7282-4982-b460-3da93318650f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:59.920431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47ffa6-7282-4982-b460-3da93318650f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:59.920741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47ffa6-7282-4982-b460-3da93318650f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:59.921397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47ffa6-7282-4982-b460-3da93318650f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:59.923057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47ffa6-7282-4982-b460-3da93318650f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:56:59.942336 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1755/3484] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:56:59.943353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343c634-ffc4-4345-a604-8346f9f52b31 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:56:59.959947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343c634-ffc4-4345-a604-8346f9f52b31 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:56:59.971331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0e4c1-4d1b-4152-be8e-efa9b134b5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:56:59.972096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0e4c1-4d1b-4152-be8e-efa9b134b5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:56:59.972937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0e4c1-4d1b-4152-be8e-efa9b134b5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:56:59.972937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0e4c1-4d1b-4152-be8e-efa9b134b5ba admin admin] PATH_INFO: `/v3/projects/b547e7cff8dc46fb919b8de3ed4566ae/users/c5dcd07fc4f543fcb6476838abb44ebf/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:56:59.975785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0e4c1-4d1b-4152-be8e-efa9b134b5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b547e7cff8dc46fb919b8de3ed4566ae, user_id=c5dcd07fc4f543fcb6476838abb44ebf, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:56:59.980480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0e4c1-4d1b-4152-be8e-efa9b134b5ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:00.001928 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1730/3485] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:56:59 2022] PUT /identity/v3/projects/b547e7cff8dc46fb919b8de3ed4566ae/users/c5dcd07fc4f543fcb6476838abb44ebf/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:00.013996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29b21-57cf-4aa8-9348-7e3590516414 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:00.016606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29b21-57cf-4aa8-9348-7e3590516414 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:00.016934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29b21-57cf-4aa8-9348-7e3590516414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:00.124044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-31f29b21-57cf-4aa8-9348-7e3590516414 None None] MFA Rules not processed for user `c5dcd07fc4f543fcb6476838abb44ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:00.125831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-31f29b21-57cf-4aa8-9348-7e3590516414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:00.274412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0e4c1-4d1b-4152-be8e-efa9b134b5ba admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:00.287268 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1756/3486] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:00.289154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0e4c1-4d1b-4152-be8e-efa9b134b5ba admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:00.306348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658165f5-5527-43d5-ab21-697e65b82e72 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:00.306807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658165f5-5527-43d5-ab21-697e65b82e72 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:00.307092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658165f5-5527-43d5-ab21-697e65b82e72 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:00.307492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658165f5-5527-43d5-ab21-697e65b82e72 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:00.308204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658165f5-5527-43d5-ab21-697e65b82e72 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:00.310592 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-658165f5-5527-43d5-ab21-697e65b82e72 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:00.310592 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:57:00.310592 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:57:00.311607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658165f5-5527-43d5-ab21-697e65b82e72 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:00.352467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f29b21-57cf-4aa8-9348-7e3590516414 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:00.360336 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1731/3487] 10.222.0.27 () {60 vars in 1185 bytes} [Wed Oct 19 00:57:00 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:00.368806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f29b21-57cf-4aa8-9348-7e3590516414 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:00.383616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:00.385102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:00.386646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:00.386787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4f262456ddf0489d88ec7220b60fec1f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:00.390509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=4f262456ddf0489d88ec7220b60fec1f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:00.393286 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:00.393286 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:57:00.393286 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:57:00.398641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:00.460945 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1757/3488] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:57:00 2022] GET /identity/v3/OS-OAUTH1/consumers/4f262456ddf0489d88ec7220b60fec1f => generated 221 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:00.461174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658165f5-5527-43d5-ab21-697e65b82e72 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:00.477355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658165f5-5527-43d5-ab21-697e65b82e72 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:00.501142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:00.501142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:00.501142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:00.501582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4f262456ddf0489d88ec7220b60fec1f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:00.507178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4f262456ddf0489d88ec7220b60fec1f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:00.507178 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:00.507178 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:57:00.507178 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:57:00.507178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:00.507554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invalidating token cache because consumer 4f262456ddf0489d88ec7220b60fec1f has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:00.507638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:00.513591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:00.555322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4f262456ddf0489d88ec7220b60fec1f', 'request_id': 'req-a74ff556-f05b-4de2-a406-f1ecf825426e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:00.607482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:00.609818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:00.619789 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1732/3489] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:57:00 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4f262456ddf0489d88ec7220b60fec1f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:00.626983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9f0b8-eba5-48b2-b1a8-60b6eac40ae8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:00.632332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ebabe-9fce-4a93-878c-8eb9f3f83114 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:00.632981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ebabe-9fce-4a93-878c-8eb9f3f83114 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:00.633409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ebabe-9fce-4a93-878c-8eb9f3f83114 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:00.633622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ebabe-9fce-4a93-878c-8eb9f3f83114 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:00.636598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ebabe-9fce-4a93-878c-8eb9f3f83114 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:00.638214 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-d14ebabe-9fce-4a93-878c-8eb9f3f83114 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:00.638214 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:57:00.638214 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:57:00.639856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ebabe-9fce-4a93-878c-8eb9f3f83114 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:00.667852 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1758/3490] 10.222.0.27 () {60 vars in 1185 bytes} [Wed Oct 19 00:57:00 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:00.680036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:00.701787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ff556-f05b-4de2-a406-f1ecf825426e tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:00.707787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:00.715805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:00.716103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:00.717353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/81ee2f0624d341bab45d48dffa7d02f8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:00.718018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=81ee2f0624d341bab45d48dffa7d02f8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:00.720237 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:00.720237 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:57:00.720237 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:57:00.721538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:00.736260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ebabe-9fce-4a93-878c-8eb9f3f83114 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:00.737342 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1733/3491] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:57:00 2022] GET /identity/v3/OS-OAUTH1/consumers/81ee2f0624d341bab45d48dffa7d02f8 => generated 221 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:00.748795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ebabe-9fce-4a93-878c-8eb9f3f83114 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:00.754193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:00.754836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:00.755056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:00.755398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/81ee2f0624d341bab45d48dffa7d02f8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:00.755999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=81ee2f0624d341bab45d48dffa7d02f8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:00.757048 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:00.757048 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:57:00.757048 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:57:00.757956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:00.758280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invalidating token cache because consumer 81ee2f0624d341bab45d48dffa7d02f8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:00.758567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:00.759267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:00.769861 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:00.787071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '81ee2f0624d341bab45d48dffa7d02f8', 'request_id': 'req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:00.833237 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1759/3492] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:57:00 2022] DELETE /identity/v3/OS-OAUTH1/consumers/81ee2f0624d341bab45d48dffa7d02f8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:00.837093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:00.841026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:00.869437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1fb8-e822-4def-bed3-7f6d34f99f4f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:00.875279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:00.876042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:00.876227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:00.876484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/81ee2f0624d341bab45d48dffa7d02f8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:00.877109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=81ee2f0624d341bab45d48dffa7d02f8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:00.883230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 19 00:57:00.909741 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 19 00:57:00.911093 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 19 00:57:00.911093 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 19 00:57:00.911093 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 19 00:57:00.911093 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 19 00:57:00.911093 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 19 00:57:00.911093 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 19 00:57:00.911093 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 19 00:57:00.911093 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 19 00:57:00.911093 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:00.913613 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1734/3493] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:57:00 2022] GET /identity/v3/OS-OAUTH1/consumers/81ee2f0624d341bab45d48dffa7d02f8 => generated 74 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:57:00.918406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:00.932880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9115ba-78ac-4164-81e6-b8b61b6f6f74 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:00.959318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:00.961640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:00.961640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:00.961985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/81ee2f0624d341bab45d48dffa7d02f8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:00.962604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=81ee2f0624d341bab45d48dffa7d02f8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:00.967546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:00.967861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invalidating token cache because consumer 81ee2f0624d341bab45d48dffa7d02f8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:00.968225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:00.977756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 19 00:57:01.013215 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 19 00:57:01.014422 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 00:57:01.018311 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1760/3494] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:57:00 2022] DELETE /identity/v3/OS-OAUTH1/consumers/81ee2f0624d341bab45d48dffa7d02f8 => generated 74 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:57:01.023536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.032469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:01.056664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc52e9-8478-4142-a8b4-222e9efd0530 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:01.063941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb061f2b-9ded-4e09-a5e9-faa5f7dc51ab tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:01.065605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb061f2b-9ded-4e09-a5e9-faa5f7dc51ab tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:01.066053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb061f2b-9ded-4e09-a5e9-faa5f7dc51ab tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:01.066482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb061f2b-9ded-4e09-a5e9-faa5f7dc51ab tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:01.067429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb061f2b-9ded-4e09-a5e9-faa5f7dc51ab tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:01.069946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb061f2b-9ded-4e09-a5e9-faa5f7dc51ab tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:01.104663 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1735/3495] 10.222.0.27 () {60 vars in 1185 bytes} [Wed Oct 19 00:57:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:01.109858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.124542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb4ad-1116-4162-9e72-ccdc4244cd4c tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:01.131429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fd063-64b6-4f45-b42d-f5f47ced6bd6 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:01.132417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fd063-64b6-4f45-b42d-f5f47ced6bd6 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:01.132911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fd063-64b6-4f45-b42d-f5f47ced6bd6 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:01.133362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fd063-64b6-4f45-b42d-f5f47ced6bd6 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:01.135752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fd063-64b6-4f45-b42d-f5f47ced6bd6 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:01.137906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fd063-64b6-4f45-b42d-f5f47ced6bd6 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:01.169917 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1761/3496] 10.222.0.27 () {60 vars in 1185 bytes} [Wed Oct 19 00:57:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:01.174009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb061f2b-9ded-4e09-a5e9-faa5f7dc51ab tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.190956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb061f2b-9ded-4e09-a5e9-faa5f7dc51ab tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:01.208857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:01.209718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:01.210073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:01.211187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:01.211907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:01.218095 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:01.218095 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:57:01.218095 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:57:01.219210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:01.233535 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1736/3497] 10.222.0.27 () {58 vars in 1164 bytes} [Wed Oct 19 00:57:01 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:01.237498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fd063-64b6-4f45-b42d-f5f47ced6bd6 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.286905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fd063-64b6-4f45-b42d-f5f47ced6bd6 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:01.302140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:01.302953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:01.303243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:01.305311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/eff4cd8f25ce4c3b91a573812c6470e4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:01.310381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=eff4cd8f25ce4c3b91a573812c6470e4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:01.313563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:01.317075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invalidating token cache because consumer eff4cd8f25ce4c3b91a573812c6470e4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:01.317793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.319410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.351658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'eff4cd8f25ce4c3b91a573812c6470e4', 'request_id': 'req-7846c919-0e10-419e-a65b-a323c6c875e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.386635 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1762/3498] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:57:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/eff4cd8f25ce4c3b91a573812c6470e4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:01.388811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.391654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:01.420275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e6cd1-e936-4dd5-ba8f-0d27108ba5f0 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:01.436085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:01.436782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:01.437067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:01.437529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4630e24548294b57aed9ec7fc196b05a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:01.438290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4630e24548294b57aed9ec7fc196b05a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:01.440283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:01.440462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invalidating token cache because consumer 4630e24548294b57aed9ec7fc196b05a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:01.442294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.444360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.467965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4630e24548294b57aed9ec7fc196b05a', 'request_id': 'req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.483804 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:INSERT=9,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:01.495071 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1737/3499] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:57:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4630e24548294b57aed9ec7fc196b05a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:01.497955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.555447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846c919-0e10-419e-a65b-a323c6c875e8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:01.573085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1028cc-275b-4520-a12a-46767ffca20f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:01.573885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1028cc-275b-4520-a12a-46767ffca20f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:01.574560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1028cc-275b-4520-a12a-46767ffca20f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:01.577306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1028cc-275b-4520-a12a-46767ffca20f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:01.578332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1028cc-275b-4520-a12a-46767ffca20f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:01.589189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1028cc-275b-4520-a12a-46767ffca20f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:01.663371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.665812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:01.667489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1763/3500] 10.222.0.27 () {60 vars in 1185 bytes} [Wed Oct 19 00:57:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:01.710122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177f0c-c7b0-41aa-b5e3-665f4a9930e5 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:01.727865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca04a9-428f-4ad2-aa42-dd8f3145b35f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:01.728771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca04a9-428f-4ad2-aa42-dd8f3145b35f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:01.729063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca04a9-428f-4ad2-aa42-dd8f3145b35f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:01.729370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca04a9-428f-4ad2-aa42-dd8f3145b35f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0afd241bb9ec421882ed0366940923b4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:01.730047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca04a9-428f-4ad2-aa42-dd8f3145b35f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=0afd241bb9ec421882ed0366940923b4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:01.739706 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-b5ca04a9-428f-4ad2-aa42-dd8f3145b35f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:01.739706 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:57:01.739706 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:57:01.741015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca04a9-428f-4ad2-aa42-dd8f3145b35f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:01.773920 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1738/3501] 10.222.0.27 () {60 vars in 1285 bytes} [Wed Oct 19 00:57:01 2022] PATCH /identity/v3/OS-OAUTH1/consumers/0afd241bb9ec421882ed0366940923b4 => generated 220 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:01.774976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1028cc-275b-4520-a12a-46767ffca20f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.796839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1028cc-275b-4520-a12a-46767ffca20f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:01.824561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc1715-8aff-4330-9b60-a628a530c7a8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:01.830747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc1715-8aff-4330-9b60-a628a530c7a8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:01.831715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc1715-8aff-4330-9b60-a628a530c7a8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:01.832329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc1715-8aff-4330-9b60-a628a530c7a8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0afd241bb9ec421882ed0366940923b4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:01.836932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc1715-8aff-4330-9b60-a628a530c7a8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=0afd241bb9ec421882ed0366940923b4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:01.843765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc1715-8aff-4330-9b60-a628a530c7a8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:01.856348 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1764/3502] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:57:01 2022] GET /identity/v3/OS-OAUTH1/consumers/0afd241bb9ec421882ed0366940923b4 => generated 220 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:01.861052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca04a9-428f-4ad2-aa42-dd8f3145b35f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.874209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca04a9-428f-4ad2-aa42-dd8f3145b35f tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:01.880197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dcd07fc4f543fcb6476838abb44ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b547e7cff8dc46fb919b8de3ed4566ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:01.881162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:01.881697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:01.882196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0afd241bb9ec421882ed0366940923b4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:01.883011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0afd241bb9ec421882ed0366940923b4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:01.885492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:01.886932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invalidating token cache because consumer 0afd241bb9ec421882ed0366940923b4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:01.887125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.888319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.908743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0afd241bb9ec421882ed0366940923b4', 'request_id': 'req-22815b0c-6ad6-4bb7-9ae1-2f342b43a864'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:01.932239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1739/3503] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:57:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0afd241bb9ec421882ed0366940923b4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:01.940366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc1715-8aff-4330-9b60-a628a530c7a8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:01.942791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dbfc1715-8aff-4330-9b60-a628a530c7a8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:02.067714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc1715-8aff-4330-9b60-a628a530c7a8 tempest-OAUTHConsumersV3Test-436377266 tempest-OAUTHConsumersV3Test-436377266-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:02.076367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:02.077541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:02.078154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:02.078670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] PATH_INFO: `/v3/users/87e787da239a48f2adc819a832674f3f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:02.080452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e787da239a48f2adc819a832674f3f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:02.083449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:02.188138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e787da239a48f2adc819a832674f3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.228333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e787da239a48f2adc819a832674f3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.265382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e787da239a48f2adc819a832674f3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.267338 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:02.317454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e787da239a48f2adc819a832674f3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.322005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e787da239a48f2adc819a832674f3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.362959 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1765/3504] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:01 2022] DELETE /identity/v3/users/87e787da239a48f2adc819a832674f3f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:02.369019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca121d1-f9f7-4738-8190-dbfbb28acc45 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:02.370572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca121d1-f9f7-4738-8190-dbfbb28acc45 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:02.371023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca121d1-f9f7-4738-8190-dbfbb28acc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:02.436045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-aca121d1-f9f7-4738-8190-dbfbb28acc45 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:02.444938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aca121d1-f9f7-4738-8190-dbfbb28acc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:02.474787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:02.478735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:02.711416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b0819-75a7-46fb-b3a0-3d59eed6f21c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:02.725824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:02.726571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:02.726875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:02.727149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] PATH_INFO: `/v3/projects/b3d3f5aa1d0149658def3f6f5e036f0e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:02.729435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d3f5aa1d0149658def3f6f5e036f0e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:02.731661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:02.736290 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1740/3505] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:02.839323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d3f5aa1d0149658def3f6f5e036f0e', 'request_id': 'req-d39f9e0c-8938-4344-b8b3-991e3e37207e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.854064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d3f5aa1d0149658def3f6f5e036f0e', 'request_id': 'req-d39f9e0c-8938-4344-b8b3-991e3e37207e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.864480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d3f5aa1d0149658def3f6f5e036f0e', 'request_id': 'req-d39f9e0c-8938-4344-b8b3-991e3e37207e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.883945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca121d1-f9f7-4738-8190-dbfbb28acc45 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:02.885536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aca121d1-f9f7-4738-8190-dbfbb28acc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:02.914222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] The token cache is being invalidate because project b3d3f5aa1d0149658def3f6f5e036f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:02.914533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.915300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d39f9e0c-8938-4344-b8b3-991e3e37207e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:02.920590 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1766/3506] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:02 2022] DELETE /identity/v3/projects/b3d3f5aa1d0149658def3f6f5e036f0e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:02.922232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469cf2c-15b8-44cc-87f2-8dee540680d2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:02.922523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469cf2c-15b8-44cc-87f2-8dee540680d2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:02.922807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469cf2c-15b8-44cc-87f2-8dee540680d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:02.964550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2469cf2c-15b8-44cc-87f2-8dee540680d2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:02.966354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2469cf2c-15b8-44cc-87f2-8dee540680d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:03.081784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca121d1-f9f7-4738-8190-dbfbb28acc45 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:03.126245 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1767/3507] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:03.135321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b995ce-02a6-40b4-b303-35ccf06818df None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:03.135608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b995ce-02a6-40b4-b303-35ccf06818df None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:03.136210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b995ce-02a6-40b4-b303-35ccf06818df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:03.164097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-75b995ce-02a6-40b4-b303-35ccf06818df None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:03.165719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-75b995ce-02a6-40b4-b303-35ccf06818df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:03.174615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1768/3508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:03.179042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b995ce-02a6-40b4-b303-35ccf06818df None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:03.190778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b995ce-02a6-40b4-b303-35ccf06818df None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:03.198015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eda2c7-76ee-4fd2-8f60-d2d6fdc77f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:03.199047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eda2c7-76ee-4fd2-8f60-d2d6fdc77f56 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:03.199874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eda2c7-76ee-4fd2-8f60-d2d6fdc77f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:03.200923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eda2c7-76ee-4fd2-8f60-d2d6fdc77f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:03.201904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eda2c7-76ee-4fd2-8f60-d2d6fdc77f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:03.202557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eda2c7-76ee-4fd2-8f60-d2d6fdc77f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:03.205332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eda2c7-76ee-4fd2-8f60-d2d6fdc77f56 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:03.215605 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:03.216248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747f489-4de8-4ec0-8e21-f0555e428d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:03.216974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747f489-4de8-4ec0-8e21-f0555e428d19 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:03.217260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747f489-4de8-4ec0-8e21-f0555e428d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:03.217562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747f489-4de8-4ec0-8e21-f0555e428d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:03.222000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1747f489-4de8-4ec0-8e21-f0555e428d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:03.226228 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1769/3509] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:03.229493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eda2c7-76ee-4fd2-8f60-d2d6fdc77f56 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:03.253479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747f489-4de8-4ec0-8e21-f0555e428d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:03.254101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eda2c7-76ee-4fd2-8f60-d2d6fdc77f56 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:03.254978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747f489-4de8-4ec0-8e21-f0555e428d19 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:03.267919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1000bc-1800-46e5-a5fc-fd3307a4221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:03.269478 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1741/3510] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:57:03.271054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1000bc-1800-46e5-a5fc-fd3307a4221b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:03.271493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1000bc-1800-46e5-a5fc-fd3307a4221b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:03.272213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1000bc-1800-46e5-a5fc-fd3307a4221b admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:03.273983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1000bc-1800-46e5-a5fc-fd3307a4221b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:03.276472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1000bc-1800-46e5-a5fc-fd3307a4221b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:03.356062 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1770/3511] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:03 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:03.360277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747f489-4de8-4ec0-8e21-f0555e428d19 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:03.374473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747f489-4de8-4ec0-8e21-f0555e428d19 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:03.392044 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:03.471811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50747019-00bc-403b-a07b-4fa3f4f23fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:03.472913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50747019-00bc-403b-a07b-4fa3f4f23fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:03.473474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50747019-00bc-403b-a07b-4fa3f4f23fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:03.474030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50747019-00bc-403b-a07b-4fa3f4f23fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:03.475158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50747019-00bc-403b-a07b-4fa3f4f23fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:03.479032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50747019-00bc-403b-a07b-4fa3f4f23fa7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:03.521795 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1742/3512] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:03 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:03.522702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1000bc-1800-46e5-a5fc-fd3307a4221b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:03.536128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1000bc-1800-46e5-a5fc-fd3307a4221b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:03.549352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b23ed7-edb3-4f13-bd67-78927852ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:03.550000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b23ed7-edb3-4f13-bd67-78927852ef1b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:03.550287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b23ed7-edb3-4f13-bd67-78927852ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:03.550663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b23ed7-edb3-4f13-bd67-78927852ef1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:03.551584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b23ed7-edb3-4f13-bd67-78927852ef1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:03.553562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b23ed7-edb3-4f13-bd67-78927852ef1b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:03.596566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1771/3513] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:57:03.601402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50747019-00bc-403b-a07b-4fa3f4f23fa7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:03.624547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50747019-00bc-403b-a07b-4fa3f4f23fa7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:03.639502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f849ab-4833-401f-a129-bd14ac00cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:03.641109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f849ab-4833-401f-a129-bd14ac00cfee admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:03.642045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f849ab-4833-401f-a129-bd14ac00cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:03.642326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f849ab-4833-401f-a129-bd14ac00cfee admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:03.644879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f849ab-4833-401f-a129-bd14ac00cfee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:03.645960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f849ab-4833-401f-a129-bd14ac00cfee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:03.697646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b23ed7-edb3-4f13-bd67-78927852ef1b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:03.697977 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1743/3514] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:03.717584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b23ed7-edb3-4f13-bd67-78927852ef1b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:03.736438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ed3a9-6641-44f1-928a-0f2d89f6cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:03.740854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ed3a9-6641-44f1-928a-0f2d89f6cbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:03.741228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ed3a9-6641-44f1-928a-0f2d89f6cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:03.741522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ed3a9-6641-44f1-928a-0f2d89f6cbe4 admin admin] PATH_INFO: `/v3/projects/56de6136c2d443e883e4096325884cbb/users/c1b9d3eff80b4cb3a6fd101f24a4b51e/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:03.804505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ed3a9-6641-44f1-928a-0f2d89f6cbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56de6136c2d443e883e4096325884cbb, user_id=c1b9d3eff80b4cb3a6fd101f24a4b51e, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:03.851100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ed3a9-6641-44f1-928a-0f2d89f6cbe4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:03.912831 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1772/3515] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:03 2022] PUT /identity/v3/projects/56de6136c2d443e883e4096325884cbb/users/c1b9d3eff80b4cb3a6fd101f24a4b51e/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:03.928728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813f947-9534-46ba-b76c-da1bdd68a479 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:03.929764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813f947-9534-46ba-b76c-da1bdd68a479 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:03.930304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813f947-9534-46ba-b76c-da1bdd68a479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:03.998281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3813f947-9534-46ba-b76c-da1bdd68a479 None None] MFA Rules not processed for user `c1b9d3eff80b4cb3a6fd101f24a4b51e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:03.999917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3813f947-9534-46ba-b76c-da1bdd68a479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:04.131548 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1744/3516] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:04.132220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ed3a9-6641-44f1-928a-0f2d89f6cbe4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:04.275055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ed3a9-6641-44f1-928a-0f2d89f6cbe4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:04.299162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfea446-a11e-4dd8-9d51-7f2310930f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:04.300652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfea446-a11e-4dd8-9d51-7f2310930f62 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:04.300652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfea446-a11e-4dd8-9d51-7f2310930f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:04.300652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfea446-a11e-4dd8-9d51-7f2310930f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:04.301530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfea446-a11e-4dd8-9d51-7f2310930f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:04.303788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfea446-a11e-4dd8-9d51-7f2310930f62 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:04.361271 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1773/3517] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:04 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:04.365599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813f947-9534-46ba-b76c-da1bdd68a479 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:04.381132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813f947-9534-46ba-b76c-da1bdd68a479 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:04.470926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfea446-a11e-4dd8-9d51-7f2310930f62 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:04.472996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5bfea446-a11e-4dd8-9d51-7f2310930f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:04.548574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ede482-36e0-4fde-b2df-60503ee64735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:04.549723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ede482-36e0-4fde-b2df-60503ee64735 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:04.550460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ede482-36e0-4fde-b2df-60503ee64735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:04.553121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ede482-36e0-4fde-b2df-60503ee64735 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:04.554264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ede482-36e0-4fde-b2df-60503ee64735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:04.561465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ede482-36e0-4fde-b2df-60503ee64735 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:04.612291 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1745/3518] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:04 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:04.618434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ede482-36e0-4fde-b2df-60503ee64735 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:04.635151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ede482-36e0-4fde-b2df-60503ee64735 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:04.653899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44d078-adfe-4f74-965d-f35e2fc3342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:04.655114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44d078-adfe-4f74-965d-f35e2fc3342f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:04.655403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44d078-adfe-4f74-965d-f35e2fc3342f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:04.655681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44d078-adfe-4f74-965d-f35e2fc3342f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:04.656344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44d078-adfe-4f74-965d-f35e2fc3342f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:04.658180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44d078-adfe-4f74-965d-f35e2fc3342f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:04.687982 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1746/3519] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:04.692242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44d078-adfe-4f74-965d-f35e2fc3342f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:04.702988 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:04.718781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44d078-adfe-4f74-965d-f35e2fc3342f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:04.735872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b6025-f3c4-43a4-90a0-47bcec19d35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:04.736976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b6025-f3c4-43a4-90a0-47bcec19d35e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:04.737271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b6025-f3c4-43a4-90a0-47bcec19d35e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:04.737536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b6025-f3c4-43a4-90a0-47bcec19d35e admin admin] PATH_INFO: `/v3/projects/9eff9cef2c1746ffb391b543de854efa/users/e7ed729ec6d842daa01f05ae84c965e1/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:04.743718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfea446-a11e-4dd8-9d51-7f2310930f62 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:04.779898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:04.781705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:04.782003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:04.782293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] PATH_INFO: `/v3/projects/45697b712cc6458c8d13c10a1aaff974` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:04.787727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b6025-f3c4-43a4-90a0-47bcec19d35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eff9cef2c1746ffb391b543de854efa, user_id=e7ed729ec6d842daa01f05ae84c965e1, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:04.791664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45697b712cc6458c8d13c10a1aaff974)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:04.793733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b6025-f3c4-43a4-90a0-47bcec19d35e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:04.803743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:04.833907 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1747/3520] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:04 2022] PUT /identity/v3/projects/9eff9cef2c1746ffb391b543de854efa/users/e7ed729ec6d842daa01f05ae84c965e1/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:04.837832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b6025-f3c4-43a4-90a0-47bcec19d35e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:04.976116 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:04.982661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b6025-f3c4-43a4-90a0-47bcec19d35e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:05.030250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45697b712cc6458c8d13c10a1aaff974', 'request_id': 'req-dd652888-22ea-47bf-ae5e-65dde1696fe3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.072681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45697b712cc6458c8d13c10a1aaff974', 'request_id': 'req-dd652888-22ea-47bf-ae5e-65dde1696fe3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.099151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45697b712cc6458c8d13c10a1aaff974', 'request_id': 'req-dd652888-22ea-47bf-ae5e-65dde1696fe3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.118531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] The token cache is being invalidate because project 45697b712cc6458c8d13c10a1aaff974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:05.119853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.120902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.125198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b21d8-fea6-4e10-a0dd-e608b5ac0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:05.125815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b21d8-fea6-4e10-a0dd-e608b5ac0faa admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:05.126148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b21d8-fea6-4e10-a0dd-e608b5ac0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:05.126456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b21d8-fea6-4e10-a0dd-e608b5ac0faa admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:05.127120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b21d8-fea6-4e10-a0dd-e608b5ac0faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:05.132087 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1774/3521] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:04 2022] DELETE /identity/v3/projects/45697b712cc6458c8d13c10a1aaff974 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:05.134842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:05.136846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b21d8-fea6-4e10-a0dd-e608b5ac0faa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:05.139015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:05.167928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652888-22ea-47bf-ae5e-65dde1696fe3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:05.168323 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1748/3522] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:57:05.172493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b21d8-fea6-4e10-a0dd-e608b5ac0faa admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:05.177290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:05.178092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3f9b21d8-fea6-4e10-a0dd-e608b5ac0faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:05.178490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:05.179015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:05.179767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] PATH_INFO: `/v3/users/c5dcd07fc4f543fcb6476838abb44ebf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:05.181238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5dcd07fc4f543fcb6476838abb44ebf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:05.195390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:05.207455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b21d8-fea6-4e10-a0dd-e608b5ac0faa admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:05.213100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d15c8-afcc-4507-a49b-604fc1f2430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:05.213798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d15c8-afcc-4507-a49b-604fc1f2430b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:05.214081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d15c8-afcc-4507-a49b-604fc1f2430b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:05.214359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d15c8-afcc-4507-a49b-604fc1f2430b admin admin] PATH_INFO: `/v3/projects/9eff9cef2c1746ffb391b543de854efa/users/e7ed729ec6d842daa01f05ae84c965e1/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:05.217627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d15c8-afcc-4507-a49b-604fc1f2430b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eff9cef2c1746ffb391b543de854efa, user_id=e7ed729ec6d842daa01f05ae84c965e1, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:05.220340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d15c8-afcc-4507-a49b-604fc1f2430b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:05.236380 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1749/3523] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:05 2022] PUT /identity/v3/projects/9eff9cef2c1746ffb391b543de854efa/users/e7ed729ec6d842daa01f05ae84c965e1/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:05.247669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e02d5-8cba-403c-8b77-c94e16bddfe6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:05.254148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e02d5-8cba-403c-8b77-c94e16bddfe6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:05.254640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e02d5-8cba-403c-8b77-c94e16bddfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:05.307187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5dcd07fc4f543fcb6476838abb44ebf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.322520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ea6e02d5-8cba-403c-8b77-c94e16bddfe6 None None] MFA Rules not processed for user `e7ed729ec6d842daa01f05ae84c965e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:05.324024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ea6e02d5-8cba-403c-8b77-c94e16bddfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:05.346172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5dcd07fc4f543fcb6476838abb44ebf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.362164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5dcd07fc4f543fcb6476838abb44ebf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.385710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5dcd07fc4f543fcb6476838abb44ebf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.386681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5dcd07fc4f543fcb6476838abb44ebf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:05.409833 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1775/3524] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:05 2022] DELETE /identity/v3/users/c5dcd07fc4f543fcb6476838abb44ebf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:05.436163 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:05.460192 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1750/3525] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:05.521633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:05.524160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:05.735633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7958b-5eb2-4f67-84d3-095a57bf73bb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:05.743385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43acc-9452-4b35-aed8-e05e0138ee1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:05.745307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43acc-9452-4b35-aed8-e05e0138ee1d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:05.746233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43acc-9452-4b35-aed8-e05e0138ee1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:05.747918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43acc-9452-4b35-aed8-e05e0138ee1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:05.888150 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:05.942178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43acc-9452-4b35-aed8-e05e0138ee1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:05.950832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43acc-9452-4b35-aed8-e05e0138ee1d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:05.970500 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1776/3526] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:07.408759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e02d5-8cba-403c-8b77-c94e16bddfe6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:07.410736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ea6e02d5-8cba-403c-8b77-c94e16bddfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:07.601141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e02d5-8cba-403c-8b77-c94e16bddfe6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:07.761833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:07.778554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:07.779920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:07.780276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] PATH_INFO: `/v3/projects/b547e7cff8dc46fb919b8de3ed4566ae` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:07.784250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b547e7cff8dc46fb919b8de3ed4566ae)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:07.794520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:07.884352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb32c3-5db8-4ae7-b810-ca5bce99a1ff None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:07.884852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb32c3-5db8-4ae7-b810-ca5bce99a1ff None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:07.884938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb32c3-5db8-4ae7-b810-ca5bce99a1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:07.971546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b547e7cff8dc46fb919b8de3ed4566ae', 'request_id': 'req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:07.973331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-72cb32c3-5db8-4ae7-b810-ca5bce99a1ff None None] MFA Rules not processed for user `37c7f5d1bc3a431eacef3cf113e958d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:07.974673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-72cb32c3-5db8-4ae7-b810-ca5bce99a1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:07.990338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b547e7cff8dc46fb919b8de3ed4566ae', 'request_id': 'req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:08.012521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b547e7cff8dc46fb919b8de3ed4566ae', 'request_id': 'req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:08.034516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] The token cache is being invalidate because project b547e7cff8dc46fb919b8de3ed4566ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:08.034820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:08.035531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0260c3e1-fa4a-4a65-a999-ed5e4a8922f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:08.041820 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1751/3527] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:07 2022] DELETE /identity/v3/projects/b547e7cff8dc46fb919b8de3ed4566ae => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:08.056189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05793-99a8-4fd8-a8d4-0bb7785a3767 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.056740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05793-99a8-4fd8-a8d4-0bb7785a3767 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.057063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05793-99a8-4fd8-a8d4-0bb7785a3767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.109191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9cb05793-99a8-4fd8-a8d4-0bb7785a3767 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:08.110445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9cb05793-99a8-4fd8-a8d4-0bb7785a3767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:08.175736 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1777/3528] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:08.186113 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:08.186359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5d345-4807-4b3d-ac6f-dcc6e5afedc3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.186581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5d345-4807-4b3d-ac6f-dcc6e5afedc3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.186923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5d345-4807-4b3d-ac6f-dcc6e5afedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.212653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e4c5d345-4807-4b3d-ac6f-dcc6e5afedc3 None None] MFA Rules not processed for user `37c7f5d1bc3a431eacef3cf113e958d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:08.213697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e4c5d345-4807-4b3d-ac6f-dcc6e5afedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:08.234300 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1778/3529] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:08.235552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5d345-4807-4b3d-ac6f-dcc6e5afedc3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:08.237107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e4c5d345-4807-4b3d-ac6f-dcc6e5afedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:08.254684 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1752/3530] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:08.263205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ca6f-b88d-4fdd-8819-b08b97ab2630 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.263900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ca6f-b88d-4fdd-8819-b08b97ab2630 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.264407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ca6f-b88d-4fdd-8819-b08b97ab2630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.290000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7318ca6f-b88d-4fdd-8819-b08b97ab2630 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:08.291901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7318ca6f-b88d-4fdd-8819-b08b97ab2630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:08.308507 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1753/3531] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:08.313905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318ca6f-b88d-4fdd-8819-b08b97ab2630 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:08.329464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318ca6f-b88d-4fdd-8819-b08b97ab2630 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:08.335675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c103b6f-2cbb-419a-a5c8-5ecf802be5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:08.337023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c103b6f-2cbb-419a-a5c8-5ecf802be5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.337558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c103b6f-2cbb-419a-a5c8-5ecf802be5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.338201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c103b6f-2cbb-419a-a5c8-5ecf802be5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.339384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c103b6f-2cbb-419a-a5c8-5ecf802be5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:08.340792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c103b6f-2cbb-419a-a5c8-5ecf802be5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:08.343215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c103b6f-2cbb-419a-a5c8-5ecf802be5b8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:08.343482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5d345-4807-4b3d-ac6f-dcc6e5afedc3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:08.349577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39797-e93f-41ea-bbb9-e06431b66c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:08.350212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39797-e93f-41ea-bbb9-e06431b66c11 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.350493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39797-e93f-41ea-bbb9-e06431b66c11 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.350769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39797-e93f-41ea-bbb9-e06431b66c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.362494 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1754/3532] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:08.366892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba39797-e93f-41ea-bbb9-e06431b66c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:08.367624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c103b6f-2cbb-419a-a5c8-5ecf802be5b8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:08.369234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba39797-e93f-41ea-bbb9-e06431b66c11 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:08.388887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c103b6f-2cbb-419a-a5c8-5ecf802be5b8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:08.396142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd364af0-5107-48f0-a6df-b8a76e3cfa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:08.397004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd364af0-5107-48f0-a6df-b8a76e3cfa60 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.397424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd364af0-5107-48f0-a6df-b8a76e3cfa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.397833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd364af0-5107-48f0-a6df-b8a76e3cfa60 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.398652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd364af0-5107-48f0-a6df-b8a76e3cfa60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:08.400658 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1779/3533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:08.401285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd364af0-5107-48f0-a6df-b8a76e3cfa60 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:08.436678 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1755/3534] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:08 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:08.440704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39797-e93f-41ea-bbb9-e06431b66c11 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:08.454186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39797-e93f-41ea-bbb9-e06431b66c11 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:08.527632 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:08.581881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff565f-a41d-472d-9dc6-b02825226509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:08.592926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff565f-a41d-472d-9dc6-b02825226509 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.593275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff565f-a41d-472d-9dc6-b02825226509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.593928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff565f-a41d-472d-9dc6-b02825226509 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.594222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff565f-a41d-472d-9dc6-b02825226509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:08.596925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff565f-a41d-472d-9dc6-b02825226509 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:08.658040 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1780/3535] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:08 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:08.662499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd364af0-5107-48f0-a6df-b8a76e3cfa60 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:08.677485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd364af0-5107-48f0-a6df-b8a76e3cfa60 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:08.692767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c62c31-6368-41dd-a6dc-322615928baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:08.694134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c62c31-6368-41dd-a6dc-322615928baf admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.694496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c62c31-6368-41dd-a6dc-322615928baf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.694853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c62c31-6368-41dd-a6dc-322615928baf admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.696053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c62c31-6368-41dd-a6dc-322615928baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:08.698611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c62c31-6368-41dd-a6dc-322615928baf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:08.724679 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1756/3536] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:08.730623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff565f-a41d-472d-9dc6-b02825226509 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:08.752064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff565f-a41d-472d-9dc6-b02825226509 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:08.759445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7748fd-fc15-4a1d-b730-02ec72173ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:08.760157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7748fd-fc15-4a1d-b730-02ec72173ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.761425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7748fd-fc15-4a1d-b730-02ec72173ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.761702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7748fd-fc15-4a1d-b730-02ec72173ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.763146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7748fd-fc15-4a1d-b730-02ec72173ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:08.764985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7748fd-fc15-4a1d-b730-02ec72173ed9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:08.777316 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1781/3537] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:08.781744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c62c31-6368-41dd-a6dc-322615928baf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:08.797118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c62c31-6368-41dd-a6dc-322615928baf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:08.804196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffb4f6-23c9-4d46-8d4c-201f83f59137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:08.805027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb4f6-23c9-4d46-8d4c-201f83f59137 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.805505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb4f6-23c9-4d46-8d4c-201f83f59137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.805853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb4f6-23c9-4d46-8d4c-201f83f59137 admin admin] PATH_INFO: `/v3/projects/f0fc4480ffe34af2848d28ac0009dd22/users/decba39bd65349d3871ec7e003b76d80/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.827991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffb4f6-23c9-4d46-8d4c-201f83f59137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fc4480ffe34af2848d28ac0009dd22, user_id=decba39bd65349d3871ec7e003b76d80, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:08.830802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffb4f6-23c9-4d46-8d4c-201f83f59137 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:08.857432 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1757/3538] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:08 2022] PUT /identity/v3/projects/f0fc4480ffe34af2848d28ac0009dd22/users/decba39bd65349d3871ec7e003b76d80/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:08.868995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143c75b-aeda-43a5-9840-2ac5981e7d58 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:08.869474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143c75b-aeda-43a5-9840-2ac5981e7d58 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:08.869804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143c75b-aeda-43a5-9840-2ac5981e7d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:08.913117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7143c75b-aeda-43a5-9840-2ac5981e7d58 None None] MFA Rules not processed for user `decba39bd65349d3871ec7e003b76d80`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:08.915103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7143c75b-aeda-43a5-9840-2ac5981e7d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:09.001680 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1782/3539] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:09.005945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffb4f6-23c9-4d46-8d4c-201f83f59137 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:09.109350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffb4f6-23c9-4d46-8d4c-201f83f59137 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:09.116530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8980ce-c898-4273-97ab-f3dcd12b7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:09.117619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8980ce-c898-4273-97ab-f3dcd12b7780 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:09.118226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8980ce-c898-4273-97ab-f3dcd12b7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:09.118934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8980ce-c898-4273-97ab-f3dcd12b7780 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:09.120342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8980ce-c898-4273-97ab-f3dcd12b7780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:09.125639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8980ce-c898-4273-97ab-f3dcd12b7780 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:09.174898 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1758/3540] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:09 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:09.176106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143c75b-aeda-43a5-9840-2ac5981e7d58 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:09.194101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143c75b-aeda-43a5-9840-2ac5981e7d58 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:09.267363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129f196-9fcb-4fad-b443-982d9b76cce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:09.268250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129f196-9fcb-4fad-b443-982d9b76cce5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:09.268561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129f196-9fcb-4fad-b443-982d9b76cce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:09.268983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129f196-9fcb-4fad-b443-982d9b76cce5 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:09.270034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129f196-9fcb-4fad-b443-982d9b76cce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:09.271726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129f196-9fcb-4fad-b443-982d9b76cce5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:09.308228 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1783/3541] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:09 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:09.311307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8980ce-c898-4273-97ab-f3dcd12b7780 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:09.330949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8980ce-c898-4273-97ab-f3dcd12b7780 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:09.360095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e2c88-3531-4b0b-92ff-06ed33c46f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:09.361387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2c88-3531-4b0b-92ff-06ed33c46f45 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:09.361825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2c88-3531-4b0b-92ff-06ed33c46f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:09.362795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2c88-3531-4b0b-92ff-06ed33c46f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:09.363665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e2c88-3531-4b0b-92ff-06ed33c46f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:09.365779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e2c88-3531-4b0b-92ff-06ed33c46f45 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:09.381741 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1759/3542] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:09.383332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129f196-9fcb-4fad-b443-982d9b76cce5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:09.394996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129f196-9fcb-4fad-b443-982d9b76cce5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:09.400636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aafa0-c4ea-4744-b4a0-c6bf20db8c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:09.401455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aafa0-c4ea-4744-b4a0-c6bf20db8c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:09.401977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aafa0-c4ea-4744-b4a0-c6bf20db8c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:09.402397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aafa0-c4ea-4744-b4a0-c6bf20db8c02 admin admin] PATH_INFO: `/v3/projects/27ef15ad037f476b915b1b7d0d1a2b16/users/4001b7eeb24844f6a296c78d09f93290/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:09.429157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aafa0-c4ea-4744-b4a0-c6bf20db8c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ef15ad037f476b915b1b7d0d1a2b16, user_id=4001b7eeb24844f6a296c78d09f93290, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:09.433050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aafa0-c4ea-4744-b4a0-c6bf20db8c02 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:09.487944 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1784/3543] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:09 2022] PUT /identity/v3/projects/27ef15ad037f476b915b1b7d0d1a2b16/users/4001b7eeb24844f6a296c78d09f93290/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:09.489286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e2c88-3531-4b0b-92ff-06ed33c46f45 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:09.505776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e2c88-3531-4b0b-92ff-06ed33c46f45 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:09.552850 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:09.664538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1a1a3-f714-40bf-95f5-2f717b3d633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:09.665509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a1a3-f714-40bf-95f5-2f717b3d633e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:09.667623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a1a3-f714-40bf-95f5-2f717b3d633e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:09.668392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a1a3-f714-40bf-95f5-2f717b3d633e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:09.672562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1a1a3-f714-40bf-95f5-2f717b3d633e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:09.679912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1a1a3-f714-40bf-95f5-2f717b3d633e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:09.713845 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1760/3544] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:09.718325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aafa0-c4ea-4744-b4a0-c6bf20db8c02 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:09.756958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aafa0-c4ea-4744-b4a0-c6bf20db8c02 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:09.779737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481fb3-6f7a-484c-85e4-4d8110220741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:09.781797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481fb3-6f7a-484c-85e4-4d8110220741 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:09.782857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481fb3-6f7a-484c-85e4-4d8110220741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:09.784262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481fb3-6f7a-484c-85e4-4d8110220741 admin admin] PATH_INFO: `/v3/projects/27ef15ad037f476b915b1b7d0d1a2b16/users/4001b7eeb24844f6a296c78d09f93290/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:09.796471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481fb3-6f7a-484c-85e4-4d8110220741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ef15ad037f476b915b1b7d0d1a2b16, user_id=4001b7eeb24844f6a296c78d09f93290, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:09.806033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481fb3-6f7a-484c-85e4-4d8110220741 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:09.847027 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1785/3545] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:09 2022] PUT /identity/v3/projects/27ef15ad037f476b915b1b7d0d1a2b16/users/4001b7eeb24844f6a296c78d09f93290/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:09.858296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65a52c-0030-4186-bac1-e7a0ae50c3d3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:09.858525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65a52c-0030-4186-bac1-e7a0ae50c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:09.858862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65a52c-0030-4186-bac1-e7a0ae50c3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:09.919528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bf65a52c-0030-4186-bac1-e7a0ae50c3d3 None None] MFA Rules not processed for user `4001b7eeb24844f6a296c78d09f93290`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:09.921105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bf65a52c-0030-4186-bac1-e7a0ae50c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:10.128021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481fb3-6f7a-484c-85e4-4d8110220741 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:10.141286 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1761/3546] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:10.147680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481fb3-6f7a-484c-85e4-4d8110220741 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:10.162200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94464fb-089f-4f57-b32d-5ab8ce40e80e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:10.162984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94464fb-089f-4f57-b32d-5ab8ce40e80e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:10.163404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94464fb-089f-4f57-b32d-5ab8ce40e80e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:10.163756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94464fb-089f-4f57-b32d-5ab8ce40e80e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:10.165677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94464fb-089f-4f57-b32d-5ab8ce40e80e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:10.170184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94464fb-089f-4f57-b32d-5ab8ce40e80e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:10.188295 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:10.305234 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1786/3547] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:10 2022] POST /identity/v3/projects => generated 358 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:10.307693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65a52c-0030-4186-bac1-e7a0ae50c3d3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:10.349764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65a52c-0030-4186-bac1-e7a0ae50c3d3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:10.505785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7cd6b-d539-4777-a95d-3f06353ab34e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:10.506450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7cd6b-d539-4777-a95d-3f06353ab34e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:10.506711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7cd6b-d539-4777-a95d-3f06353ab34e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:10.506943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7cd6b-d539-4777-a95d-3f06353ab34e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:10.508799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7cd6b-d539-4777-a95d-3f06353ab34e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:10.509486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7cd6b-d539-4777-a95d-3f06353ab34e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:10.566058 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1762/3548] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:10 2022] POST /identity/v3/users => generated 413 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:10.567747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94464fb-089f-4f57-b32d-5ab8ce40e80e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:10.600844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94464fb-089f-4f57-b32d-5ab8ce40e80e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:10.620419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8c255-dd5c-4058-8c86-d7747edb0468 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:10.621631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8c255-dd5c-4058-8c86-d7747edb0468 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:10.622094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8c255-dd5c-4058-8c86-d7747edb0468 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:10.622559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8c255-dd5c-4058-8c86-d7747edb0468 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/users/c4c0a77939ef43f69ff9e308bc26d25f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:10.681491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8c255-dd5c-4058-8c86-d7747edb0468 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:get_user(user_id=c4c0a77939ef43f69ff9e308bc26d25f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:10.686640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8c255-dd5c-4058-8c86-d7747edb0468 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:10.704417 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1787/3549] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 00:57:10 2022] GET /identity/v3/users/c4c0a77939ef43f69ff9e308bc26d25f => generated 413 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:10.706553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7cd6b-d539-4777-a95d-3f06353ab34e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:10.724038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7cd6b-d539-4777-a95d-3f06353ab34e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:10.754880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:10.755543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:10.755823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:10.756098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/users/c4c0a77939ef43f69ff9e308bc26d25f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:10.757644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c4c0a77939ef43f69ff9e308bc26d25f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:10.759964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:10.886491 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:10.920022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c0a77939ef43f69ff9e308bc26d25f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:10.965319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c0a77939ef43f69ff9e308bc26d25f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:10.985103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c0a77939ef43f69ff9e308bc26d25f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:10.999911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c0a77939ef43f69ff9e308bc26d25f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:11.001595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c0a77939ef43f69ff9e308bc26d25f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:11.026262 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1763/3550] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:10 2022] DELETE /identity/v3/users/c4c0a77939ef43f69ff9e308bc26d25f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:11.030794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8c255-dd5c-4058-8c86-d7747edb0468 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:11.033984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b4e8c255-dd5c-4058-8c86-d7747edb0468 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:11.090342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8c255-dd5c-4058-8c86-d7747edb0468 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:11.313718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:11.314868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:11.315331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:11.316023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/c1189787313e46bc9f62537e8d4ed832` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:11.318632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1189787313e46bc9f62537e8d4ed832)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:11.322813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:11.410560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1189787313e46bc9f62537e8d4ed832', 'request_id': 'req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:11.429298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1189787313e46bc9f62537e8d4ed832', 'request_id': 'req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:11.441324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1189787313e46bc9f62537e8d4ed832', 'request_id': 'req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:11.472550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project c1189787313e46bc9f62537e8d4ed832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:11.473018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:11.474924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:11.478013 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1788/3551] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:11 2022] DELETE /identity/v3/projects/c1189787313e46bc9f62537e8d4ed832 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:11.485002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:11.495699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5d594-4ea2-4191-8407-7c14f15a40c5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:11.645732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b48fd-fbc0-4232-904e-54774192cea9 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:11.646408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b48fd-fbc0-4232-904e-54774192cea9 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:11.646799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b48fd-fbc0-4232-904e-54774192cea9 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:11.647082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b48fd-fbc0-4232-904e-54774192cea9 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:11.647830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b48fd-fbc0-4232-904e-54774192cea9 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:11.649780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b48fd-fbc0-4232-904e-54774192cea9 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:11.691831 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1764/3552] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:11 2022] POST /identity/v3/projects => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:11.695686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:11.698719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:11.721103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd79cc-7139-4af2-bbd5-f731ad2b2fe1 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:11.876359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:11.877181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:11.877686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:11.878094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:11.879257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:11.879740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:11.881115 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:11.881115 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:57:11.881115 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:57:11.884194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:11.889238 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:11.908921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b48fd-fbc0-4232-904e-54774192cea9 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:11.928106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b48fd-fbc0-4232-904e-54774192cea9 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:11.928468 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1789/3553] 10.222.0.27 () {58 vars in 1160 bytes} [Wed Oct 19 00:57:11 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:11.956890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b489b79-f428-48e6-95b5-bcfcf0c7d74e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:11.958030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b489b79-f428-48e6-95b5-bcfcf0c7d74e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:11.958476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b489b79-f428-48e6-95b5-bcfcf0c7d74e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:11.959091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b489b79-f428-48e6-95b5-bcfcf0c7d74e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:11.959912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b489b79-f428-48e6-95b5-bcfcf0c7d74e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:11.970181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b489b79-f428-48e6-95b5-bcfcf0c7d74e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:12.051373 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1765/3554] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 00:57:11 2022] GET /identity/v3/domains => generated 828 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:12.058810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:12.070578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e9c5b-271e-4bb3-b19e-533cc33ccff3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:12.090765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:12.090765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:12.090765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:12.091167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/57240bc873554b0fb06a8d1cd6ebb5b6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:12.091167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:update_project(project_id=57240bc873554b0fb06a8d1cd6ebb5b6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:12.091864 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:12.091864 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:57:12.091864 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:57:12.100537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:12.129500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.132220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.189848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.190523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.200853 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1790/3555] 10.222.0.27 () {60 vars in 1252 bytes} [Wed Oct 19 00:57:12 2022] PATCH /identity/v3/projects/57240bc873554b0fb06a8d1cd6ebb5b6 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:12.202381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b489b79-f428-48e6-95b5-bcfcf0c7d74e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:12.204601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7b489b79-f428-48e6-95b5-bcfcf0c7d74e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:12.234500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b489b79-f428-48e6-95b5-bcfcf0c7d74e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:12.352860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:12.353979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:12.354532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:12.355063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/57240bc873554b0fb06a8d1cd6ebb5b6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:12.375231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=57240bc873554b0fb06a8d1cd6ebb5b6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:12.378748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:12.445801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.469704 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:12.485619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.589825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6', 'request_id': 'req-aef2a836-b6cc-4db6-858a-c9637bf165c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.605886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6', 'request_id': 'req-aef2a836-b6cc-4db6-858a-c9637bf165c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.617944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6', 'request_id': 'req-aef2a836-b6cc-4db6-858a-c9637bf165c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.656405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project 57240bc873554b0fb06a8d1cd6ebb5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:12.657117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.657463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.691713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6', 'request_id': 'req-aef2a836-b6cc-4db6-858a-c9637bf165c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.697420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6', 'request_id': 'req-aef2a836-b6cc-4db6-858a-c9637bf165c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.708449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '57240bc873554b0fb06a8d1cd6ebb5b6', 'request_id': 'req-aef2a836-b6cc-4db6-858a-c9637bf165c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:12.739059 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1766/3556] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:12 2022] DELETE /identity/v3/projects/57240bc873554b0fb06a8d1cd6ebb5b6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:12.743825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:12.760116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c645-8f73-4e20-82fd-9a5cb928f5ae tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:12.883993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46b0f7-cca5-496e-8f6b-da91cb372a69 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:12.884968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46b0f7-cca5-496e-8f6b-da91cb372a69 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:12.885413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46b0f7-cca5-496e-8f6b-da91cb372a69 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:12.885850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46b0f7-cca5-496e-8f6b-da91cb372a69 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:12.889366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46b0f7-cca5-496e-8f6b-da91cb372a69 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:12.895360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46b0f7-cca5-496e-8f6b-da91cb372a69 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:12.947030 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1791/3557] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:12 2022] POST /identity/v3/projects => generated 359 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:12.952032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:12.953865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:12.973401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a836-b6cc-4db6-858a-c9637bf165c4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:13.070308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a5787-56c0-4e55-96a0-fa8f7ad39bd2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:13.071174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a5787-56c0-4e55-96a0-fa8f7ad39bd2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:13.071707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a5787-56c0-4e55-96a0-fa8f7ad39bd2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:13.072104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a5787-56c0-4e55-96a0-fa8f7ad39bd2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/7ed9bef8aca04cfc9f9eec72bbb7d27f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:13.077374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a5787-56c0-4e55-96a0-fa8f7ad39bd2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:get_project(project_id=7ed9bef8aca04cfc9f9eec72bbb7d27f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:13.082952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a5787-56c0-4e55-96a0-fa8f7ad39bd2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:13.089571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46b0f7-cca5-496e-8f6b-da91cb372a69 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:13.093968 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1767/3558] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:12 2022] GET /identity/v3/projects/7ed9bef8aca04cfc9f9eec72bbb7d27f => generated 359 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:13.113141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46b0f7-cca5-496e-8f6b-da91cb372a69 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:13.124061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:13.125795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:13.126489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:13.126946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/7ed9bef8aca04cfc9f9eec72bbb7d27f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:13.128555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ed9bef8aca04cfc9f9eec72bbb7d27f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:13.130875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:13.207604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed9bef8aca04cfc9f9eec72bbb7d27f', 'request_id': 'req-01217b62-2798-4007-8327-805b22f51693'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:13.230870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed9bef8aca04cfc9f9eec72bbb7d27f', 'request_id': 'req-01217b62-2798-4007-8327-805b22f51693'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:13.239386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed9bef8aca04cfc9f9eec72bbb7d27f', 'request_id': 'req-01217b62-2798-4007-8327-805b22f51693'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:13.255716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project 7ed9bef8aca04cfc9f9eec72bbb7d27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:13.256443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:13.257477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:13.261581 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1792/3559] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:13 2022] DELETE /identity/v3/projects/7ed9bef8aca04cfc9f9eec72bbb7d27f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:13.267543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a5787-56c0-4e55-96a0-fa8f7ad39bd2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:13.271283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-146a5787-56c0-4e55-96a0-fa8f7ad39bd2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:13.291161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a5787-56c0-4e55-96a0-fa8f7ad39bd2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:13.425385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f80db0-8500-4f63-b345-0af9e0603f9e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:13.426180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80db0-8500-4f63-b345-0af9e0603f9e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:13.428393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80db0-8500-4f63-b345-0af9e0603f9e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:13.428882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80db0-8500-4f63-b345-0af9e0603f9e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:13.429661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f80db0-8500-4f63-b345-0af9e0603f9e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:13.435300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f80db0-8500-4f63-b345-0af9e0603f9e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:13.488278 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:13.564457 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1768/3560] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:13 2022] POST /identity/v3/projects => generated 359 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:13.568810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:13.585376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01217b62-2798-4007-8327-805b22f51693 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:13.662774 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:13.767223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1032a-925f-4aba-940e-cf99ff5dd688 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:13.769121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1032a-925f-4aba-940e-cf99ff5dd688 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:13.769709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1032a-925f-4aba-940e-cf99ff5dd688 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:13.769709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1032a-925f-4aba-940e-cf99ff5dd688 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/7821fc76a0244d52ac1feee9f7b10438` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:13.771426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1032a-925f-4aba-940e-cf99ff5dd688 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:get_project(project_id=7821fc76a0244d52ac1feee9f7b10438)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:13.773242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1032a-925f-4aba-940e-cf99ff5dd688 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:13.778597 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1793/3561] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:13 2022] GET /identity/v3/projects/7821fc76a0244d52ac1feee9f7b10438 => generated 359 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:13.781099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f80db0-8500-4f63-b345-0af9e0603f9e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:13.803213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f80db0-8500-4f63-b345-0af9e0603f9e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:13.822368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:13.824159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:13.824940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:13.827547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/7821fc76a0244d52ac1feee9f7b10438` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:13.829080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7821fc76a0244d52ac1feee9f7b10438)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:13.833944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:13.995668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7821fc76a0244d52ac1feee9f7b10438', 'request_id': 'req-54cb04bb-1e95-4390-ada8-5994cdcf51a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.020932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7821fc76a0244d52ac1feee9f7b10438', 'request_id': 'req-54cb04bb-1e95-4390-ada8-5994cdcf51a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.028579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7821fc76a0244d52ac1feee9f7b10438', 'request_id': 'req-54cb04bb-1e95-4390-ada8-5994cdcf51a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.061402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project 7821fc76a0244d52ac1feee9f7b10438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:14.061862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.065834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.067975 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1769/3562] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:13 2022] DELETE /identity/v3/projects/7821fc76a0244d52ac1feee9f7b10438 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:14.072992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1032a-925f-4aba-940e-cf99ff5dd688 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:14.076724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1e1032a-925f-4aba-940e-cf99ff5dd688 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:14.104550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1032a-925f-4aba-940e-cf99ff5dd688 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:14.271473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3eeb-77bb-414b-9599-4de57dc37a71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:14.272098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3eeb-77bb-414b-9599-4de57dc37a71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:14.272843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3eeb-77bb-414b-9599-4de57dc37a71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:14.273125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3eeb-77bb-414b-9599-4de57dc37a71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:14.275491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3eeb-77bb-414b-9599-4de57dc37a71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:14.281630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3eeb-77bb-414b-9599-4de57dc37a71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:14.366265 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1794/3563] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 00:57:14 2022] POST /identity/v3/projects => generated 347 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:14.367163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:14.385952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb04bb-1e95-4390-ada8-5994cdcf51a2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:14.491939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5ce35-5e47-48ea-80d7-e354b84cdd71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:14.492593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5ce35-5e47-48ea-80d7-e354b84cdd71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:14.492936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5ce35-5e47-48ea-80d7-e354b84cdd71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:14.493217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5ce35-5e47-48ea-80d7-e354b84cdd71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/3187579f3f574bfb82f66af4b268f43f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:14.494391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5ce35-5e47-48ea-80d7-e354b84cdd71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:get_project(project_id=3187579f3f574bfb82f66af4b268f43f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:14.497786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5ce35-5e47-48ea-80d7-e354b84cdd71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:14.501310 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1770/3564] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:14 2022] GET /identity/v3/projects/3187579f3f574bfb82f66af4b268f43f => generated 347 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:14.503868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3eeb-77bb-414b-9599-4de57dc37a71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:14.520460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3eeb-77bb-414b-9599-4de57dc37a71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:14.529021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:14.531573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:14.532029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:14.534667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/3187579f3f574bfb82f66af4b268f43f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:14.539239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3187579f3f574bfb82f66af4b268f43f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:14.545443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:14.689197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3187579f3f574bfb82f66af4b268f43f', 'request_id': 'req-dc1eb0cc-0212-442c-a058-666ad9d44529'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.708242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3187579f3f574bfb82f66af4b268f43f', 'request_id': 'req-dc1eb0cc-0212-442c-a058-666ad9d44529'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.715322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3187579f3f574bfb82f66af4b268f43f', 'request_id': 'req-dc1eb0cc-0212-442c-a058-666ad9d44529'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.770761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project 3187579f3f574bfb82f66af4b268f43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:14.771934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.773031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:14.781350 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1795/3565] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:14 2022] DELETE /identity/v3/projects/3187579f3f574bfb82f66af4b268f43f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:14.787902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5ce35-5e47-48ea-80d7-e354b84cdd71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:14.789994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b3a5ce35-5e47-48ea-80d7-e354b84cdd71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:14.820863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5ce35-5e47-48ea-80d7-e354b84cdd71 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:15.021629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685781-ee0a-48c5-8d4e-74abcb89f6d5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:15.026747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685781-ee0a-48c5-8d4e-74abcb89f6d5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:15.027061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685781-ee0a-48c5-8d4e-74abcb89f6d5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:15.027352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685781-ee0a-48c5-8d4e-74abcb89f6d5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:15.028334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e685781-ee0a-48c5-8d4e-74abcb89f6d5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:15.031847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e685781-ee0a-48c5-8d4e-74abcb89f6d5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:15.085722 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1771/3566] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 00:57:14 2022] POST /identity/v3/domains => generated 276 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:15.087074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:15.100345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb0cc-0212-442c-a058-666ad9d44529 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:15.163692 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:15.193098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdc274-65d7-4058-9f8c-fc2ca17c3b55 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:15.194286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdc274-65d7-4058-9f8c-fc2ca17c3b55 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:15.194811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdc274-65d7-4058-9f8c-fc2ca17c3b55 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:15.195495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdc274-65d7-4058-9f8c-fc2ca17c3b55 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:15.196377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdc274-65d7-4058-9f8c-fc2ca17c3b55 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:15.198581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdc274-65d7-4058-9f8c-fc2ca17c3b55 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:15.210191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685781-ee0a-48c5-8d4e-74abcb89f6d5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:15.213396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e685781-ee0a-48c5-8d4e-74abcb89f6d5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:15.253184 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1796/3567] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:15 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:15.257528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdc274-65d7-4058-9f8c-fc2ca17c3b55 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:15.270100 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:15.350616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685781-ee0a-48c5-8d4e-74abcb89f6d5 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:15.373911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdc274-65d7-4058-9f8c-fc2ca17c3b55 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:15.390702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a1d98-a424-4a47-a481-1de01b7dac67 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:15.392539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a1d98-a424-4a47-a481-1de01b7dac67 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:15.393563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a1d98-a424-4a47-a481-1de01b7dac67 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:15.395264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a1d98-a424-4a47-a481-1de01b7dac67 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/a97a9ff39d0e4294be56573da5430cbb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:15.400206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a1d98-a424-4a47-a481-1de01b7dac67 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:get_project(project_id=a97a9ff39d0e4294be56573da5430cbb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:15.408922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a1d98-a424-4a47-a481-1de01b7dac67 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:15.412988 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1797/3568] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:15 2022] GET /identity/v3/projects/a97a9ff39d0e4294be56573da5430cbb => generated 403 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:15.419314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a1d98-a424-4a47-a481-1de01b7dac67 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:15.444194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a1d98-a424-4a47-a481-1de01b7dac67 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:15.466752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:15.468030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:15.468323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:15.468605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/a97a9ff39d0e4294be56573da5430cbb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:15.470811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a97a9ff39d0e4294be56573da5430cbb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:15.473099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:15.529482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf74d6-b3fc-4a82-9c97-67045e98c248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:15.532010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf74d6-b3fc-4a82-9c97-67045e98c248 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:15.532299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf74d6-b3fc-4a82-9c97-67045e98c248 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:15.532577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf74d6-b3fc-4a82-9c97-67045e98c248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:15.536636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b5bf74d6-b3fc-4a82-9c97-67045e98c248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:15.587558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97a9ff39d0e4294be56573da5430cbb', 'request_id': 'req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:15.600652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97a9ff39d0e4294be56573da5430cbb', 'request_id': 'req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:15.610337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97a9ff39d0e4294be56573da5430cbb', 'request_id': 'req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:15.624646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project a97a9ff39d0e4294be56573da5430cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:15.624989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:15.625748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:15.627710 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1798/3569] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:15 2022] DELETE /identity/v3/projects/a97a9ff39d0e4294be56573da5430cbb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:15.631485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:15.633680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:15.665566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf74d6-b3fc-4a82-9c97-67045e98c248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:15.667882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf74d6-b3fc-4a82-9c97-67045e98c248 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:15.686369 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1772/3570] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:57:15.710068 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:15.732153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babb5c1-efc1-41ef-bbaa-c108336a7ff0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:15.738451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:15.739224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:15.739606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:15.739980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/domains/b04d71c2bc45478d801af60a08798d0d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:15.741659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b04d71c2bc45478d801af60a08798d0d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:15.744467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:15.774392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:15.775693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:15.811190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:15.811996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:15.815522 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1799/3571] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:57:15 2022] PATCH /identity/v3/domains/b04d71c2bc45478d801af60a08798d0d => generated 277 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:57:15.819508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf74d6-b3fc-4a82-9c97-67045e98c248 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:15.843862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf74d6-b3fc-4a82-9c97-67045e98c248 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:15.933376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:15.934573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:15.935807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:15.936243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/domains/b04d71c2bc45478d801af60a08798d0d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:15.951177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b04d71c2bc45478d801af60a08798d0d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:15.952907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:16.006238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.008352 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:16.021198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.077007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d', 'request_id': 'req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.096721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d', 'request_id': 'req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.104083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d', 'request_id': 'req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.122595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project b04d71c2bc45478d801af60a08798d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:16.123038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.123825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.135086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d', 'request_id': 'req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.136294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d', 'request_id': 'req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.137376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b04d71c2bc45478d801af60a08798d0d', 'request_id': 'req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.149720 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1773/3572] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:15 2022] DELETE /identity/v3/domains/b04d71c2bc45478d801af60a08798d0d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:16.157538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:16.159093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:16.176602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3763c-5d43-4ff3-a570-403063106ea2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:16.259852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48630d44-ca6c-4a3e-b9cd-c321fb55fd32 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:16.260462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48630d44-ca6c-4a3e-b9cd-c321fb55fd32 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:16.260808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48630d44-ca6c-4a3e-b9cd-c321fb55fd32 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:16.261090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48630d44-ca6c-4a3e-b9cd-c321fb55fd32 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:16.262083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48630d44-ca6c-4a3e-b9cd-c321fb55fd32 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:16.263999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48630d44-ca6c-4a3e-b9cd-c321fb55fd32 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:16.300857 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1800/3573] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 00:57:16 2022] POST /identity/v3/domains => generated 276 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:16.302411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:16.305630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:16.325153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531a7f0-b1e1-4c8f-8ffb-8b6479de79e3 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:16.454428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba97b6-bf12-4894-b9f7-9f09126f4f1c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:16.455671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba97b6-bf12-4894-b9f7-9f09126f4f1c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:16.456414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba97b6-bf12-4894-b9f7-9f09126f4f1c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:16.456945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba97b6-bf12-4894-b9f7-9f09126f4f1c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:16.457832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba97b6-bf12-4894-b9f7-9f09126f4f1c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:16.460279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba97b6-bf12-4894-b9f7-9f09126f4f1c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:16.512579 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1774/3574] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:16 2022] POST /identity/v3/projects => generated 408 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:16.516273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48630d44-ca6c-4a3e-b9cd-c321fb55fd32 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:16.530054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48630d44-ca6c-4a3e-b9cd-c321fb55fd32 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:16.679597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509a9e8-cebb-4506-b8f8-449cae6de41e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:16.680249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509a9e8-cebb-4506-b8f8-449cae6de41e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:16.680539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509a9e8-cebb-4506-b8f8-449cae6de41e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:16.680818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509a9e8-cebb-4506-b8f8-449cae6de41e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:16.681476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509a9e8-cebb-4506-b8f8-449cae6de41e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:16.683410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509a9e8-cebb-4506-b8f8-449cae6de41e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:16.742353 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1801/3575] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:16 2022] POST /identity/v3/projects => generated 405 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:16.744598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba97b6-bf12-4894-b9f7-9f09126f4f1c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:16.757770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba97b6-bf12-4894-b9f7-9f09126f4f1c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:16.819186 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:16.868133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:16.868771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:16.868915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:16.869204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/5ee88c384ac34edf86a00a103d7d77e2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:16.870467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ee88c384ac34edf86a00a103d7d77e2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:16.872989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:16.965696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee88c384ac34edf86a00a103d7d77e2', 'request_id': 'req-02856cf3-6661-46f1-8ff5-00e1883bd305'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:16.982257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee88c384ac34edf86a00a103d7d77e2', 'request_id': 'req-02856cf3-6661-46f1-8ff5-00e1883bd305'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.003470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee88c384ac34edf86a00a103d7d77e2', 'request_id': 'req-02856cf3-6661-46f1-8ff5-00e1883bd305'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.009160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509a9e8-cebb-4506-b8f8-449cae6de41e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:17.016520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6509a9e8-cebb-4506-b8f8-449cae6de41e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:17.048138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project 5ee88c384ac34edf86a00a103d7d77e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:17.048653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.049618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.056015 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1775/3576] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:16 2022] DELETE /identity/v3/projects/5ee88c384ac34edf86a00a103d7d77e2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:17.057360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:17.059016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:17.076978 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:17.176040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509a9e8-cebb-4506-b8f8-449cae6de41e tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:17.228199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02856cf3-6661-46f1-8ff5-00e1883bd305 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:17.241329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:17.242473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:17.242928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:17.243372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/b8aed7ed08394fc9957e9b5e1d8c9f1f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:17.245770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8aed7ed08394fc9957e9b5e1d8c9f1f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:17.248797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:17.261498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:17.263074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:17.263362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:17.263638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] PATH_INFO: `/v3/users/b8c5c0d3f9394736829782c7ac69ff05` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:17.266473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c5c0d3f9394736829782c7ac69ff05)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:17.269123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:17.345936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8aed7ed08394fc9957e9b5e1d8c9f1f', 'request_id': 'req-e1de4084-8090-4613-9755-2e056bf924ac'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.351069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c5c0d3f9394736829782c7ac69ff05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.356806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8aed7ed08394fc9957e9b5e1d8c9f1f', 'request_id': 'req-e1de4084-8090-4613-9755-2e056bf924ac'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.366562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8aed7ed08394fc9957e9b5e1d8c9f1f', 'request_id': 'req-e1de4084-8090-4613-9755-2e056bf924ac'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.377751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c5c0d3f9394736829782c7ac69ff05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.383947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project b8aed7ed08394fc9957e9b5e1d8c9f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:17.384247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.384963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.389312 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1776/3577] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:17 2022] DELETE /identity/v3/projects/b8aed7ed08394fc9957e9b5e1d8c9f1f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:17.391597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:17.393881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:17.404511 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:17.408764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c5c0d3f9394736829782c7ac69ff05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.426823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c5c0d3f9394736829782c7ac69ff05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.427751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c5c0d3f9394736829782c7ac69ff05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.437527 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1802/3578] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:17 2022] DELETE /identity/v3/users/b8c5c0d3f9394736829782c7ac69ff05 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:17.556559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4084-8090-4613-9755-2e056bf924ac tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:17.631134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:17.632745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:17.699124 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:17.710881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:17.711541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:17.711825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:17.712102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/domains/d73aea19b9644e1eb30879838239b0e6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:17.713987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d73aea19b9644e1eb30879838239b0e6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:17.717611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:17.723802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4ee3f-b275-4750-8da9-2f711a6df74e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:17.734289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:17.735192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:17.735528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:17.735814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] PATH_INFO: `/v3/users/c1b9d3eff80b4cb3a6fd101f24a4b51e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:17.737829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b9d3eff80b4cb3a6fd101f24a4b51e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:17.740309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:17.750521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.753225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.799694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.801032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.809827 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1777/3579] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:57:17 2022] PATCH /identity/v3/domains/d73aea19b9644e1eb30879838239b0e6 => generated 277 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:57:17.811780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:17.813353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:17.845315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b9d3eff80b4cb3a6fd101f24a4b51e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.882370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b9d3eff80b4cb3a6fd101f24a4b51e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.914704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b9d3eff80b4cb3a6fd101f24a4b51e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.939217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b9d3eff80b4cb3a6fd101f24a4b51e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.940229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b9d3eff80b4cb3a6fd101f24a4b51e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:17.948798 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1803/3580] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:17 2022] DELETE /identity/v3/users/c1b9d3eff80b4cb3a6fd101f24a4b51e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:17.950858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:17.965504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:18.002975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5371303-5e63-4c5a-8ec0-70f5f33df6b0 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.036615 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:18.060576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130039d1-766b-485f-8b13-0cc529ce3023 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.071612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.072267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.073800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.074176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] PATH_INFO: `/v3/projects/5017de8e297545248369595fa5db2f7d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.081800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5017de8e297545248369595fa5db2f7d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.083967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.116165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.117200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.117712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.118365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/domains/d73aea19b9644e1eb30879838239b0e6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.133996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d73aea19b9644e1eb30879838239b0e6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.136602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.158974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5017de8e297545248369595fa5db2f7d', 'request_id': 'req-58e66bae-f8d9-49a1-9466-441e129eb48d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.170798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.172015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5017de8e297545248369595fa5db2f7d', 'request_id': 'req-58e66bae-f8d9-49a1-9466-441e129eb48d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.181841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5017de8e297545248369595fa5db2f7d', 'request_id': 'req-58e66bae-f8d9-49a1-9466-441e129eb48d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.186738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.197752 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:18.205435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] The token cache is being invalidate because project 5017de8e297545248369595fa5db2f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:18.206606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.207182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58e66bae-f8d9-49a1-9466-441e129eb48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.212521 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1804/3581] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:17 2022] DELETE /identity/v3/projects/5017de8e297545248369595fa5db2f7d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:18.214415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072161d5-becb-4fff-9242-65dbd90ea993 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.214700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072161d5-becb-4fff-9242-65dbd90ea993 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.215477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072161d5-becb-4fff-9242-65dbd90ea993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.238389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-072161d5-becb-4fff-9242-65dbd90ea993 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:18.239610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-072161d5-becb-4fff-9242-65dbd90ea993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:18.261661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6', 'request_id': 'req-23e280dc-8774-4d16-a344-26af6bad24df'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.275586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6', 'request_id': 'req-23e280dc-8774-4d16-a344-26af6bad24df'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.286747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6', 'request_id': 'req-23e280dc-8774-4d16-a344-26af6bad24df'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.304466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project d73aea19b9644e1eb30879838239b0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:18.305510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.306549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.314675 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1805/3582] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:18.316009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09931689-8ade-487b-8836-36957adc2f5b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.316394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09931689-8ade-487b-8836-36957adc2f5b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.316796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09931689-8ade-487b-8836-36957adc2f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.321687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6', 'request_id': 'req-23e280dc-8774-4d16-a344-26af6bad24df'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.322679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6', 'request_id': 'req-23e280dc-8774-4d16-a344-26af6bad24df'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.323572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd73aea19b9644e1eb30879838239b0e6', 'request_id': 'req-23e280dc-8774-4d16-a344-26af6bad24df'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:18.339301 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1778/3583] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:17 2022] DELETE /identity/v3/domains/d73aea19b9644e1eb30879838239b0e6 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:18.341339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:18.346236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:18.346750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-09931689-8ade-487b-8836-36957adc2f5b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:18.348055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-09931689-8ade-487b-8836-36957adc2f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:18.368268 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1806/3584] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:18.369626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09931689-8ade-487b-8836-36957adc2f5b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:18.371296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-09931689-8ade-487b-8836-36957adc2f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:18.429754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e280dc-8774-4d16-a344-26af6bad24df tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.434589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b018ce-48ab-424c-8762-da1bcf7c2524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.435493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b018ce-48ab-424c-8762-da1bcf7c2524 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.435594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b018ce-48ab-424c-8762-da1bcf7c2524 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.435835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b018ce-48ab-424c-8762-da1bcf7c2524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.438086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f2b018ce-48ab-424c-8762-da1bcf7c2524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:18.453429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b018ce-48ab-424c-8762-da1bcf7c2524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.455411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b018ce-48ab-424c-8762-da1bcf7c2524 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.468244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09931689-8ade-487b-8836-36957adc2f5b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.480128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f90c3-fd09-4358-8cb2-196e18969d40 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.481655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f90c3-fd09-4358-8cb2-196e18969d40 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.483237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f90c3-fd09-4358-8cb2-196e18969d40 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.483851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f90c3-fd09-4358-8cb2-196e18969d40 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.486477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f90c3-fd09-4358-8cb2-196e18969d40 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.487519 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1779/3585] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:18.489159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efc13-47a7-4215-aa35-9477d200edfe None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.489453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efc13-47a7-4215-aa35-9477d200edfe None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.489734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efc13-47a7-4215-aa35-9477d200edfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.491082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f90c3-fd09-4358-8cb2-196e18969d40 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.505005 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:18.529817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-095efc13-47a7-4215-aa35-9477d200edfe None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:18.531086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-095efc13-47a7-4215-aa35-9477d200edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:18.544431 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1780/3586] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:18.549531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095efc13-47a7-4215-aa35-9477d200edfe None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:18.561746 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1807/3587] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:18 2022] POST /identity/v3/projects => generated 378 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:18.563286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f90c3-fd09-4358-8cb2-196e18969d40 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:18.567721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095efc13-47a7-4215-aa35-9477d200edfe None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.684289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ceac82-d981-4638-9e85-e80925bb12ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.685958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ceac82-d981-4638-9e85-e80925bb12ac admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.686471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ceac82-d981-4638-9e85-e80925bb12ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.687525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ceac82-d981-4638-9e85-e80925bb12ac admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.688475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ceac82-d981-4638-9e85-e80925bb12ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:18.689455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ceac82-d981-4638-9e85-e80925bb12ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.691767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ceac82-d981-4638-9e85-e80925bb12ac admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.716804 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1781/3588] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:18.717987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ceac82-d981-4638-9e85-e80925bb12ac admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:18.731153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ceac82-d981-4638-9e85-e80925bb12ac admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.733045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f90c3-fd09-4358-8cb2-196e18969d40 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.737099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd07d6-05fb-4a0d-a4cb-e02011e9b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.737739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd07d6-05fb-4a0d-a4cb-e02011e9b1ab admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.738118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd07d6-05fb-4a0d-a4cb-e02011e9b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.738449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd07d6-05fb-4a0d-a4cb-e02011e9b1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.739149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd07d6-05fb-4a0d-a4cb-e02011e9b1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.742071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd07d6-05fb-4a0d-a4cb-e02011e9b1ab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.749620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5843ba7-6f51-442a-b526-0e2e59f8e4ce tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.750537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5843ba7-6f51-442a-b526-0e2e59f8e4ce tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.750897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5843ba7-6f51-442a-b526-0e2e59f8e4ce tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.751417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5843ba7-6f51-442a-b526-0e2e59f8e4ce tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/eebe5547bd7a4d80b90923c4567e3766` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.753985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5843ba7-6f51-442a-b526-0e2e59f8e4ce tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:get_project(project_id=eebe5547bd7a4d80b90923c4567e3766)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.760008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5843ba7-6f51-442a-b526-0e2e59f8e4ce tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.767570 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1808/3589] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:18 2022] GET /identity/v3/projects/eebe5547bd7a4d80b90923c4567e3766 => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:18.769522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5843ba7-6f51-442a-b526-0e2e59f8e4ce tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:18.791000 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1782/3590] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:18 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:18.794662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5843ba7-6f51-442a-b526-0e2e59f8e4ce tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.795937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd07d6-05fb-4a0d-a4cb-e02011e9b1ab admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:18.826507 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:18.902258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f4855-3df6-4d16-809e-a55953798c20 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.905225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4855-3df6-4d16-809e-a55953798c20 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.905774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4855-3df6-4d16-809e-a55953798c20 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.906254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4855-3df6-4d16-809e-a55953798c20 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.906662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd07d6-05fb-4a0d-a4cb-e02011e9b1ab admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.907370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f4855-3df6-4d16-809e-a55953798c20 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.909758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f4855-3df6-4d16-809e-a55953798c20 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.912868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40e861-f039-4a3f-b437-c16f2973681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.913756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40e861-f039-4a3f-b437-c16f2973681e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.914246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40e861-f039-4a3f-b437-c16f2973681e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.914590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40e861-f039-4a3f-b437-c16f2973681e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.915370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40e861-f039-4a3f-b437-c16f2973681e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.917819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40e861-f039-4a3f-b437-c16f2973681e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.947248 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1809/3591] 10.222.0.27 () {58 vars in 1131 bytes} [Wed Oct 19 00:57:18 2022] GET /identity/v3/projects => generated 6874 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:18.952998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f4855-3df6-4d16-809e-a55953798c20 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:18.959162 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1783/3592] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:18 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:18.960373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40e861-f039-4a3f-b437-c16f2973681e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:18.973002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40e861-f039-4a3f-b437-c16f2973681e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.979341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f4855-3df6-4d16-809e-a55953798c20 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:18.979558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672bff-a3d0-40b3-b61e-30e3350da049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.980118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672bff-a3d0-40b3-b61e-30e3350da049 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:18.980483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672bff-a3d0-40b3-b61e-30e3350da049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:18.981114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672bff-a3d0-40b3-b61e-30e3350da049 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:18.982463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672bff-a3d0-40b3-b61e-30e3350da049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:18.984209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672bff-a3d0-40b3-b61e-30e3350da049 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:18.994906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:18.998876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.000412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.001400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/eebe5547bd7a4d80b90923c4567e3766` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.003423 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1784/3593] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:19.007832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672bff-a3d0-40b3-b61e-30e3350da049 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:19.013738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eebe5547bd7a4d80b90923c4567e3766)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.016473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:19.021071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672bff-a3d0-40b3-b61e-30e3350da049 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:19.028829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1cf5e-e2bd-4eaa-aab8-56169e2a95b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:19.030004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1cf5e-e2bd-4eaa-aab8-56169e2a95b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.030582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1cf5e-e2bd-4eaa-aab8-56169e2a95b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.031077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1cf5e-e2bd-4eaa-aab8-56169e2a95b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.031950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1cf5e-e2bd-4eaa-aab8-56169e2a95b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.034541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1cf5e-e2bd-4eaa-aab8-56169e2a95b2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:19.059589 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1785/3594] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:19.064108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1cf5e-e2bd-4eaa-aab8-56169e2a95b2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:19.084303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1cf5e-e2bd-4eaa-aab8-56169e2a95b2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:19.095514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eebe5547bd7a4d80b90923c4567e3766', 'request_id': 'req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.104898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eebe5547bd7a4d80b90923c4567e3766', 'request_id': 'req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.113089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eebe5547bd7a4d80b90923c4567e3766', 'request_id': 'req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.125973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project eebe5547bd7a4d80b90923c4567e3766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:19.126335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.127203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.133143 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1810/3595] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:18 2022] DELETE /identity/v3/projects/eebe5547bd7a4d80b90923c4567e3766 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:19.133925 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:19.134254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:19.137851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:19.169587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3bb06-1cd5-4dec-82d5-591bbdc3170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:19.170282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3bb06-1cd5-4dec-82d5-591bbdc3170d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.170566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3bb06-1cd5-4dec-82d5-591bbdc3170d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.170836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3bb06-1cd5-4dec-82d5-591bbdc3170d admin admin] PATH_INFO: `/v3/projects/f1c3d8147eb24a4ab1aa72a7b973dd51/users/2951a7c54a114bc5a778e0b3ff2e8f1e/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.189885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3bb06-1cd5-4dec-82d5-591bbdc3170d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c3d8147eb24a4ab1aa72a7b973dd51, user_id=2951a7c54a114bc5a778e0b3ff2e8f1e, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.192800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3bb06-1cd5-4dec-82d5-591bbdc3170d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:19.209557 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1786/3596] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:19 2022] PUT /identity/v3/projects/f1c3d8147eb24a4ab1aa72a7b973dd51/users/2951a7c54a114bc5a778e0b3ff2e8f1e/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:19.210366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3bb06-1cd5-4dec-82d5-591bbdc3170d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:19.212324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f5b3bb06-1cd5-4dec-82d5-591bbdc3170d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:19.226502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7f74-6b1a-4d4e-a05a-0daa0ddd6e78 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:19.271036 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:19.296783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:19.297438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.297721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.298175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] PATH_INFO: `/v3/projects/56de6136c2d443e883e4096325884cbb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.299907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56de6136c2d443e883e4096325884cbb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.303416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3bb06-1cd5-4dec-82d5-591bbdc3170d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:19.303575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:19.310778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ac5c-e53a-4cd7-ba9a-2238f2cbde4c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:19.311919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ac5c-e53a-4cd7-ba9a-2238f2cbde4c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.311919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ac5c-e53a-4cd7-ba9a-2238f2cbde4c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.312173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ac5c-e53a-4cd7-ba9a-2238f2cbde4c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.312815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ac5c-e53a-4cd7-ba9a-2238f2cbde4c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.316024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ac5c-e53a-4cd7-ba9a-2238f2cbde4c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:19.359305 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1787/3597] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 00:57:19 2022] POST /identity/v3/projects => generated 346 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:19.359305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c85819-5c77-4501-afe6-b7ccce416632 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.359305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c85819-5c77-4501-afe6-b7ccce416632 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.359305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c85819-5c77-4501-afe6-b7ccce416632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.368136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56de6136c2d443e883e4096325884cbb', 'request_id': 'req-85e16aca-a165-4845-bf2e-331e0fc353d2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.379359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56de6136c2d443e883e4096325884cbb', 'request_id': 'req-85e16aca-a165-4845-bf2e-331e0fc353d2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.393859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-63c85819-5c77-4501-afe6-b7ccce416632 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:19.396650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56de6136c2d443e883e4096325884cbb', 'request_id': 'req-85e16aca-a165-4845-bf2e-331e0fc353d2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.398074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-63c85819-5c77-4501-afe6-b7ccce416632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:19.429372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] The token cache is being invalidate because project 56de6136c2d443e883e4096325884cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:19.429956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.431009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.434629 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1811/3598] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:19 2022] DELETE /identity/v3/projects/56de6136c2d443e883e4096325884cbb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:19.436147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:19.437813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:19.518129 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1788/3599] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:19.518129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c85819-5c77-4501-afe6-b7ccce416632 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:19.518129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-63c85819-5c77-4501-afe6-b7ccce416632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:19.532971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16aca-a165-4845-bf2e-331e0fc353d2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:19.544260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c85819-5c77-4501-afe6-b7ccce416632 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:19.558406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:19.559748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.560029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.560299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] PATH_INFO: `/v3/users/e7ed729ec6d842daa01f05ae84c965e1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.562271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ed729ec6d842daa01f05ae84c965e1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.564409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:19.618322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7146cfc-1191-406d-ae54-c9488936b98f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:19.618870 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:19.619068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146cfc-1191-406d-ae54-c9488936b98f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.619356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146cfc-1191-406d-ae54-c9488936b98f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.619634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146cfc-1191-406d-ae54-c9488936b98f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/2ec23162779646f9b0f983dbee5aa273` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.621168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7146cfc-1191-406d-ae54-c9488936b98f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:update_project(project_id=2ec23162779646f9b0f983dbee5aa273)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.624482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7146cfc-1191-406d-ae54-c9488936b98f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:19.629885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ed729ec6d842daa01f05ae84c965e1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.653661 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:19.654827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ed729ec6d842daa01f05ae84c965e1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.664343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ed729ec6d842daa01f05ae84c965e1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.672993 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1812/3600] 10.222.0.27 () {60 vars in 1252 bytes} [Wed Oct 19 00:57:19 2022] PATCH /identity/v3/projects/2ec23162779646f9b0f983dbee5aa273 => generated 360 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:19.674590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7146cfc-1191-406d-ae54-c9488936b98f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:19.677332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ed729ec6d842daa01f05ae84c965e1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.678148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7146cfc-1191-406d-ae54-c9488936b98f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:19.678296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ed729ec6d842daa01f05ae84c965e1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:19.686373 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1789/3601] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:19 2022] DELETE /identity/v3/users/e7ed729ec6d842daa01f05ae84c965e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:19.697621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:19.702046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:19.790905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7146cfc-1191-406d-ae54-c9488936b98f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:19.833893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225341-7083-41a3-a095-24a26fd0c7b2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:19.842046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e06c2-b814-4d4c-9878-1b00b757818b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:19.843270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e06c2-b814-4d4c-9878-1b00b757818b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.843785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e06c2-b814-4d4c-9878-1b00b757818b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.845018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e06c2-b814-4d4c-9878-1b00b757818b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/2ec23162779646f9b0f983dbee5aa273` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.873714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:19.874832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.875224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.875970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.879369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:19.889328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e06c2-b814-4d4c-9878-1b00b757818b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:get_project(project_id=2ec23162779646f9b0f983dbee5aa273)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.892794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e06c2-b814-4d4c-9878-1b00b757818b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:19.895342 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1790/3602] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:19 2022] GET /identity/v3/projects/2ec23162779646f9b0f983dbee5aa273 => generated 347 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:19.899419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e06c2-b814-4d4c-9878-1b00b757818b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:19.913048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e06c2-b814-4d4c-9878-1b00b757818b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:19.918636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:19.919236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:19.919529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:19.919808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/2ec23162779646f9b0f983dbee5aa273` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:19.927165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2ec23162779646f9b0f983dbee5aa273)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.929895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:19.990953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:19.992566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.008470 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1813/3603] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:20.045009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec23162779646f9b0f983dbee5aa273', 'request_id': 'req-89923dde-2f78-4189-8cac-4b1f4a547794'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.056256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec23162779646f9b0f983dbee5aa273', 'request_id': 'req-89923dde-2f78-4189-8cac-4b1f4a547794'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.065011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec23162779646f9b0f983dbee5aa273', 'request_id': 'req-89923dde-2f78-4189-8cac-4b1f4a547794'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.081047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.082996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:20.095789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project 2ec23162779646f9b0f983dbee5aa273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:20.096138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.096816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.100657 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1791/3604] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:19 2022] DELETE /identity/v3/projects/2ec23162779646f9b0f983dbee5aa273 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:20.111555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865491b-adb8-4159-aa46-dac6040b1e17 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.116258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.119143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:20.195372 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:20.235652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.236434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.236766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.237030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] PATH_INFO: `/v3/projects/9eff9cef2c1746ffb391b543de854efa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.238350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eff9cef2c1746ffb391b543de854efa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.240320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.240939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923dde-2f78-4189-8cac-4b1f4a547794 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.243119 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:20.248952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e12dfe-933e-41b0-afee-55dd8943ac87 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.250867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e12dfe-933e-41b0-afee-55dd8943ac87 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.251152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e12dfe-933e-41b0-afee-55dd8943ac87 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.251431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e12dfe-933e-41b0-afee-55dd8943ac87 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.252191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e12dfe-933e-41b0-afee-55dd8943ac87 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.254149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e12dfe-933e-41b0-afee-55dd8943ac87 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.294661 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1792/3605] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:20 2022] POST /identity/v3/projects => generated 359 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:20.297244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e12dfe-933e-41b0-afee-55dd8943ac87 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.321054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eff9cef2c1746ffb391b543de854efa', 'request_id': 'req-a4727dd8-7963-420d-870b-16d2bfff4d03'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.336604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eff9cef2c1746ffb391b543de854efa', 'request_id': 'req-a4727dd8-7963-420d-870b-16d2bfff4d03'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.351610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eff9cef2c1746ffb391b543de854efa', 'request_id': 'req-a4727dd8-7963-420d-870b-16d2bfff4d03'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.369792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] The token cache is being invalidate because project 9eff9cef2c1746ffb391b543de854efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:20.370304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.371144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4727dd8-7963-420d-870b-16d2bfff4d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.374260 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1814/3606] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:20 2022] DELETE /identity/v3/projects/9eff9cef2c1746ffb391b543de854efa => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:20.379118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20871f9b-88d8-4f45-86a2-f8f32292ca1b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.379709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20871f9b-88d8-4f45-86a2-f8f32292ca1b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.379942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20871f9b-88d8-4f45-86a2-f8f32292ca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.394449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e12dfe-933e-41b0-afee-55dd8943ac87 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.407075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-20871f9b-88d8-4f45-86a2-f8f32292ca1b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:20.411097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-20871f9b-88d8-4f45-86a2-f8f32292ca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:20.497134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.497787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.498099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.498376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/27a11752317d41a797b224a7e19493d2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.499710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:update_project(project_id=27a11752317d41a797b224a7e19493d2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.501556 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:20.501556 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:57:20.501556 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:57:20.503067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.514823 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1815/3607] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:20.523074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37826929-5e15-452a-8343-8d7d81a33631 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.523359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37826929-5e15-452a-8343-8d7d81a33631 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.523639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37826929-5e15-452a-8343-8d7d81a33631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.543723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-37826929-5e15-452a-8343-8d7d81a33631 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:20.544975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-37826929-5e15-452a-8343-8d7d81a33631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:20.553965 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1816/3608] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:20.558271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37826929-5e15-452a-8343-8d7d81a33631 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.569311 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1793/3609] 10.222.0.27 () {60 vars in 1252 bytes} [Wed Oct 19 00:57:20 2022] PATCH /identity/v3/projects/27a11752317d41a797b224a7e19493d2 => generated 371 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:57:20.572345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.574060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37826929-5e15-452a-8343-8d7d81a33631 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.574753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:20.580802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c39159-ec07-4fc2-ab08-e428f5357544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.581715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c39159-ec07-4fc2-ab08-e428f5357544 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.582182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c39159-ec07-4fc2-ab08-e428f5357544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.582626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c39159-ec07-4fc2-ab08-e428f5357544 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.583514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c39159-ec07-4fc2-ab08-e428f5357544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:20.583971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c39159-ec07-4fc2-ab08-e428f5357544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.585809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c39159-ec07-4fc2-ab08-e428f5357544 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.589505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331ecd8-1eea-4f4a-a4e9-81ad74eff419 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.594874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a144b4e-5f3a-4d77-8bab-4400059301b2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.595518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a144b4e-5f3a-4d77-8bab-4400059301b2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.595795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a144b4e-5f3a-4d77-8bab-4400059301b2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.596068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a144b4e-5f3a-4d77-8bab-4400059301b2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/27a11752317d41a797b224a7e19493d2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.600003 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1817/3610] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:20.604262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c39159-ec07-4fc2-ab08-e428f5357544 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.614480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a144b4e-5f3a-4d77-8bab-4400059301b2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:get_project(project_id=27a11752317d41a797b224a7e19493d2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.615955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c39159-ec07-4fc2-ab08-e428f5357544 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.618296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a144b4e-5f3a-4d77-8bab-4400059301b2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.620993 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1794/3611] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:20 2022] GET /identity/v3/projects/27a11752317d41a797b224a7e19493d2 => generated 358 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:20.621127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf539e-af23-4195-8feb-401c6c682c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.622439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf539e-af23-4195-8feb-401c6c682c58 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.622695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf539e-af23-4195-8feb-401c6c682c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.622964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf539e-af23-4195-8feb-401c6c682c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.623593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf539e-af23-4195-8feb-401c6c682c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.625388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a144b4e-5f3a-4d77-8bab-4400059301b2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.625673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf539e-af23-4195-8feb-401c6c682c58 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.642191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a144b4e-5f3a-4d77-8bab-4400059301b2 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.650036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.651540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.652408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.654128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/27a11752317d41a797b224a7e19493d2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.655626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27a11752317d41a797b224a7e19493d2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.657069 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1818/3612] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:20 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:20.658060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.661102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf539e-af23-4195-8feb-401c6c682c58 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.675184 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:20.725558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a11752317d41a797b224a7e19493d2', 'request_id': 'req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.735516 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:20.738528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a11752317d41a797b224a7e19493d2', 'request_id': 'req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.752360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a11752317d41a797b224a7e19493d2', 'request_id': 'req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.758684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf539e-af23-4195-8feb-401c6c682c58 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.771143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project 27a11752317d41a797b224a7e19493d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:20.771708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.772640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:20.778536 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1795/3613] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:20 2022] DELETE /identity/v3/projects/27a11752317d41a797b224a7e19493d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:20.790776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.796406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:20.852716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6b294-b483-4d61-81b4-3a94f3869e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.853362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6b294-b483-4d61-81b4-3a94f3869e6b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.853664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6b294-b483-4d61-81b4-3a94f3869e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.853941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6b294-b483-4d61-81b4-3a94f3869e6b admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.854574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6b294-b483-4d61-81b4-3a94f3869e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.857977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6b294-b483-4d61-81b4-3a94f3869e6b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.896547 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1819/3614] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:20 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:20.898317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6b294-b483-4d61-81b4-3a94f3869e6b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.900319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b5a6b294-b483-4d61-81b4-3a94f3869e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:20.902106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05a88f-3cf8-4d46-bc56-0232f724bc8b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.909657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f79af-95d4-4a27-9eee-832b8be9c56c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.910772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f79af-95d4-4a27-9eee-832b8be9c56c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.911164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f79af-95d4-4a27-9eee-832b8be9c56c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.911565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f79af-95d4-4a27-9eee-832b8be9c56c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.912671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f79af-95d4-4a27-9eee-832b8be9c56c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.914640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f79af-95d4-4a27-9eee-832b8be9c56c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.928200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6b294-b483-4d61-81b4-3a94f3869e6b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:20.939537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99097-0ac0-4417-a8b6-4a3278e4de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:20.940667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99097-0ac0-4417-a8b6-4a3278e4de17 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:20.941116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99097-0ac0-4417-a8b6-4a3278e4de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:20.941669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99097-0ac0-4417-a8b6-4a3278e4de17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:20.942890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd99097-0ac0-4417-a8b6-4a3278e4de17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:20.950660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd99097-0ac0-4417-a8b6-4a3278e4de17 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:20.961406 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1796/3615] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:20 2022] POST /identity/v3/projects => generated 353 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:20.962940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f79af-95d4-4a27-9eee-832b8be9c56c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:20.995690 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1820/3616] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:20.999427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99097-0ac0-4417-a8b6-4a3278e4de17 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:21.021441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99097-0ac0-4417-a8b6-4a3278e4de17 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:21.112471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f79af-95d4-4a27-9eee-832b8be9c56c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:21.122244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97dd0-a38d-46c7-8dfe-f022ac8cc36b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:21.123179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97dd0-a38d-46c7-8dfe-f022ac8cc36b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:21.123571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97dd0-a38d-46c7-8dfe-f022ac8cc36b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:21.123849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97dd0-a38d-46c7-8dfe-f022ac8cc36b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/1d75a05099fe4b26a04d0af5b7f64089` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:21.125225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d97dd0-a38d-46c7-8dfe-f022ac8cc36b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:update_project(project_id=1d75a05099fe4b26a04d0af5b7f64089)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:21.127379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d97dd0-a38d-46c7-8dfe-f022ac8cc36b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:21.172439 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1797/3617] 10.222.0.27 () {60 vars in 1252 bytes} [Wed Oct 19 00:57:20 2022] PATCH /identity/v3/projects/1d75a05099fe4b26a04d0af5b7f64089 => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:21.176301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97dd0-a38d-46c7-8dfe-f022ac8cc36b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:21.176758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85851c6d-990e-4d6d-94b2-622eb94a0263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:21.177398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85851c6d-990e-4d6d-94b2-622eb94a0263 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:21.177682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85851c6d-990e-4d6d-94b2-622eb94a0263 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:21.177959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85851c6d-990e-4d6d-94b2-622eb94a0263 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:21.178609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85851c6d-990e-4d6d-94b2-622eb94a0263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:21.180517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85851c6d-990e-4d6d-94b2-622eb94a0263 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:21.185614 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:21.196935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97dd0-a38d-46c7-8dfe-f022ac8cc36b tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:21.207441 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1821/3618] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:21.209388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85851c6d-990e-4d6d-94b2-622eb94a0263 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:21.214674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31c1f9-8f90-41cb-a832-c982e9286d3c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:21.216190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31c1f9-8f90-41cb-a832-c982e9286d3c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:21.216793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31c1f9-8f90-41cb-a832-c982e9286d3c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:21.217306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31c1f9-8f90-41cb-a832-c982e9286d3c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/1d75a05099fe4b26a04d0af5b7f64089` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:21.221863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85851c6d-990e-4d6d-94b2-622eb94a0263 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:21.230205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341b8af-b0dc-4580-bc4a-3cb7879144ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:21.230844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341b8af-b0dc-4580-bc4a-3cb7879144ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:21.231644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341b8af-b0dc-4580-bc4a-3cb7879144ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:21.231930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341b8af-b0dc-4580-bc4a-3cb7879144ff admin admin] PATH_INFO: `/v3/projects/b27a360801e243b4aa743868e8958fb6/users/5ef2d0e41b4f47ad9358485236b86df1/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:21.238844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31c1f9-8f90-41cb-a832-c982e9286d3c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:get_project(project_id=1d75a05099fe4b26a04d0af5b7f64089)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:21.241439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31c1f9-8f90-41cb-a832-c982e9286d3c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:21.243909 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1798/3619] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:57:21 2022] GET /identity/v3/projects/1d75a05099fe4b26a04d0af5b7f64089 => generated 354 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:21.250054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31c1f9-8f90-41cb-a832-c982e9286d3c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:21.257155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341b8af-b0dc-4580-bc4a-3cb7879144ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27a360801e243b4aa743868e8958fb6, user_id=5ef2d0e41b4f47ad9358485236b86df1, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:21.264229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341b8af-b0dc-4580-bc4a-3cb7879144ff admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:21.269454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31c1f9-8f90-41cb-a832-c982e9286d3c tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:21.277344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:21.279123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:21.279429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:21.279702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/projects/1d75a05099fe4b26a04d0af5b7f64089` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:21.281312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1d75a05099fe4b26a04d0af5b7f64089)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:21.283396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:21.310675 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1822/3620] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:21 2022] PUT /identity/v3/projects/b27a360801e243b4aa743868e8958fb6/users/5ef2d0e41b4f47ad9358485236b86df1/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:21.313994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914446ff-f065-42a0-90d1-6bc0980b14f7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:21.314329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914446ff-f065-42a0-90d1-6bc0980b14f7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:21.314658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914446ff-f065-42a0-90d1-6bc0980b14f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:21.352336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-914446ff-f065-42a0-90d1-6bc0980b14f7 None None] MFA Rules not processed for user `5ef2d0e41b4f47ad9358485236b86df1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:21.353647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-914446ff-f065-42a0-90d1-6bc0980b14f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:21.440540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d75a05099fe4b26a04d0af5b7f64089', 'request_id': 'req-17a477f4-334c-4f37-9eca-b6862c647e7f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:21.454450 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:21.461697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d75a05099fe4b26a04d0af5b7f64089', 'request_id': 'req-17a477f4-334c-4f37-9eca-b6862c647e7f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:21.471369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d75a05099fe4b26a04d0af5b7f64089', 'request_id': 'req-17a477f4-334c-4f37-9eca-b6862c647e7f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:21.497148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] The token cache is being invalidate because project 1d75a05099fe4b26a04d0af5b7f64089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:21.498824 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1823/3621] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:21.499199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:21.502334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:21.504848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914446ff-f065-42a0-90d1-6bc0980b14f7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:21.506424 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1799/3622] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:21 2022] DELETE /identity/v3/projects/1d75a05099fe4b26a04d0af5b7f64089 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:21.516672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:21.519207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:21.645438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a477f4-334c-4f37-9eca-b6862c647e7f tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:21.649082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914446ff-f065-42a0-90d1-6bc0980b14f7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:21.663813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca70a-302b-4a46-9591-8b82c75819f4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:21.676938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca70a-302b-4a46-9591-8b82c75819f4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:21.677825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca70a-302b-4a46-9591-8b82c75819f4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:21.678853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca70a-302b-4a46-9591-8b82c75819f4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/domains/d73aea19b9644e1eb30879838239b0e6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:21.692486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ca70a-302b-4a46-9591-8b82c75819f4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-488ca70a-302b-4a46-9591-8b82c75819f4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Could not find domain: d73aea19b9644e1eb30879838239b0e6.: keystone.exception.DomainNotFound: Could not find domain: d73aea19b9644e1eb30879838239b0e6. Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d73aea19b9644e1eb30879838239b0e6. Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:57:21.713184 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:57:21.714369 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d73aea19b9644e1eb30879838239b0e6. Oct 19 00:57:21.716049 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:21.722556 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1800/3623] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:57:21 2022] PATCH /identity/v3/domains/d73aea19b9644e1eb30879838239b0e6 => generated 112 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:57:21.726345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca70a-302b-4a46-9591-8b82c75819f4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:21.745824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca70a-302b-4a46-9591-8b82c75819f4 tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:21.753225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294f69a-53fa-4de5-afab-60c1584317ff tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4001b7eeb24844f6a296c78d09f93290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ef15ad037f476b915b1b7d0d1a2b16', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:21.754254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294f69a-53fa-4de5-afab-60c1584317ff tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:21.755027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294f69a-53fa-4de5-afab-60c1584317ff tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:21.755635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294f69a-53fa-4de5-afab-60c1584317ff tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] PATH_INFO: `/v3/domains/b04d71c2bc45478d801af60a08798d0d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:21.766284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294f69a-53fa-4de5-afab-60c1584317ff tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-5294f69a-53fa-4de5-afab-60c1584317ff tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Could not find domain: b04d71c2bc45478d801af60a08798d0d.: keystone.exception.DomainNotFound: Could not find domain: b04d71c2bc45478d801af60a08798d0d. Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b04d71c2bc45478d801af60a08798d0d. Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:57:21.773918 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:57:21.775046 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b04d71c2bc45478d801af60a08798d0d. Oct 19 00:57:21.776061 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:21.781283 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1801/3624] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 00:57:21 2022] PATCH /identity/v3/domains/b04d71c2bc45478d801af60a08798d0d => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:57:21.785245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294f69a-53fa-4de5-afab-60c1584317ff tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:21.788103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5294f69a-53fa-4de5-afab-60c1584317ff tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:21.834314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fb24e-fb8b-4246-babb-07aad487c4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:21.836793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fb24e-fb8b-4246-babb-07aad487c4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:21.837194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fb24e-fb8b-4246-babb-07aad487c4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:21.838157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fb24e-fb8b-4246-babb-07aad487c4e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:21.838966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fb24e-fb8b-4246-babb-07aad487c4e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:21.843359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fb24e-fb8b-4246-babb-07aad487c4e6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:21.925126 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1824/3625] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:21 2022] POST /identity/v3/projects => generated 391 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:21.929533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fb24e-fb8b-4246-babb-07aad487c4e6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:21.935851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-da1fb24e-fb8b-4246-babb-07aad487c4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:21.969684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294f69a-53fa-4de5-afab-60c1584317ff tempest-ProjectsTestJSON-1684390168 tempest-ProjectsTestJSON-1684390168-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:21.988570 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:22.150104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:22.150990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:22.151334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:22.151672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] PATH_INFO: `/v3/users/decba39bd65349d3871ec7e003b76d80` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:22.156100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=decba39bd65349d3871ec7e003b76d80)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:22.159393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:22.168137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fb24e-fb8b-4246-babb-07aad487c4e6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:22.178288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4685d-b547-485e-a13e-3e26e8096cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:22.179016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4685d-b547-485e-a13e-3e26e8096cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:22.179372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4685d-b547-485e-a13e-3e26e8096cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:22.179712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4685d-b547-485e-a13e-3e26e8096cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:22.180614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4685d-b547-485e-a13e-3e26e8096cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:22.191448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4685d-b547-485e-a13e-3e26e8096cc1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:22.237850 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:22.252076 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1825/3626] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:21 2022] POST /identity/v3/users => generated 302 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:22.253393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4685d-b547-485e-a13e-3e26e8096cc1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:22.281393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4685d-b547-485e-a13e-3e26e8096cc1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:22.299133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde34f-5e32-42a4-af6a-14e2f4de5823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:22.300086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde34f-5e32-42a4-af6a-14e2f4de5823 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:22.300576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde34f-5e32-42a4-af6a-14e2f4de5823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:22.301841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde34f-5e32-42a4-af6a-14e2f4de5823 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:22.302839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde34f-5e32-42a4-af6a-14e2f4de5823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:22.313080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'decba39bd65349d3871ec7e003b76d80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:22.313821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde34f-5e32-42a4-af6a-14e2f4de5823 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:22.336539 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1826/3627] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:22.338544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde34f-5e32-42a4-af6a-14e2f4de5823 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:22.343935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'decba39bd65349d3871ec7e003b76d80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:22.354569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde34f-5e32-42a4-af6a-14e2f4de5823 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:22.358542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'decba39bd65349d3871ec7e003b76d80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:22.365868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1998b-ef3a-460c-b90b-36dbfddc5e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:22.369046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1998b-ef3a-460c-b90b-36dbfddc5e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:22.369888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1998b-ef3a-460c-b90b-36dbfddc5e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:22.370478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1998b-ef3a-460c-b90b-36dbfddc5e8a admin admin] PATH_INFO: `/v3/projects/cdc667ff9c8b4275ab24bf63907c9245/users/9ab3596a315a428f8e500220fe2958de/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:22.372411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'decba39bd65349d3871ec7e003b76d80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:22.373211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2e205a20-df05-4b70-abd2-b8638ac4dbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'decba39bd65349d3871ec7e003b76d80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:22.388263 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1802/3628] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:21 2022] DELETE /identity/v3/users/decba39bd65349d3871ec7e003b76d80 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:22.394260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d633c80-6f58-4823-8635-aa30c71fee4e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:22.394804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d633c80-6f58-4823-8635-aa30c71fee4e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:22.395238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d633c80-6f58-4823-8635-aa30c71fee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:22.435941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1998b-ef3a-460c-b90b-36dbfddc5e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc667ff9c8b4275ab24bf63907c9245, user_id=9ab3596a315a428f8e500220fe2958de, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:22.436164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0d633c80-6f58-4823-8635-aa30c71fee4e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:22.438521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0d633c80-6f58-4823-8635-aa30c71fee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:22.442302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1998b-ef3a-460c-b90b-36dbfddc5e8a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:22.474552 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1827/3629] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:22 2022] PUT /identity/v3/projects/cdc667ff9c8b4275ab24bf63907c9245/users/9ab3596a315a428f8e500220fe2958de/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:22.475917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1998b-ef3a-460c-b90b-36dbfddc5e8a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:22.484985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-78b1998b-ef3a-460c-b90b-36dbfddc5e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:22.656615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1803/3630] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:22.678121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d633c80-6f58-4823-8635-aa30c71fee4e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:22.679910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0d633c80-6f58-4823-8635-aa30c71fee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:22.687902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1998b-ef3a-460c-b90b-36dbfddc5e8a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:22.697240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87503941-7c6d-4a2d-a364-fb89493c4ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:22.698862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87503941-7c6d-4a2d-a364-fb89493c4ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:22.700339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87503941-7c6d-4a2d-a364-fb89493c4ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:22.700735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87503941-7c6d-4a2d-a364-fb89493c4ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:22.701862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87503941-7c6d-4a2d-a364-fb89493c4ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:22.704037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87503941-7c6d-4a2d-a364-fb89493c4ce3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:22.720229 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:22.749034 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1828/3631] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:22.751654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87503941-7c6d-4a2d-a364-fb89493c4ce3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:22.771175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d633c80-6f58-4823-8635-aa30c71fee4e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:22.771549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87503941-7c6d-4a2d-a364-fb89493c4ce3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:22.780121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d4370-6a39-4f4b-a24d-d25385b65ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:22.781719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d4370-6a39-4f4b-a24d-d25385b65ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:22.782098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d4370-6a39-4f4b-a24d-d25385b65ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:22.782445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d4370-6a39-4f4b-a24d-d25385b65ae4 admin admin] PATH_INFO: `/v3/projects/cdc667ff9c8b4275ab24bf63907c9245/users/9ab3596a315a428f8e500220fe2958de/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:22.784804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d4370-6a39-4f4b-a24d-d25385b65ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc667ff9c8b4275ab24bf63907c9245, user_id=9ab3596a315a428f8e500220fe2958de, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:22.794472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d4370-6a39-4f4b-a24d-d25385b65ae4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:22.812674 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1829/3632] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:22 2022] PUT /identity/v3/projects/cdc667ff9c8b4275ab24bf63907c9245/users/9ab3596a315a428f8e500220fe2958de/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:22.826187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd112c-7b1f-4e3e-bf8b-9d23df0736ca None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:22.826562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd112c-7b1f-4e3e-bf8b-9d23df0736ca None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:22.826910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd112c-7b1f-4e3e-bf8b-9d23df0736ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:22.858400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7010e-72cd-4f4b-9ce9-6186ef467573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:22.859458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7010e-72cd-4f4b-9ce9-6186ef467573 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:22.860157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7010e-72cd-4f4b-9ce9-6186ef467573 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:22.860649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7010e-72cd-4f4b-9ce9-6186ef467573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:22.880711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d4dd112c-7b1f-4e3e-bf8b-9d23df0736ca None None] MFA Rules not processed for user `9ab3596a315a428f8e500220fe2958de`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:22.882328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d4dd112c-7b1f-4e3e-bf8b-9d23df0736ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:22.887154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7010e-72cd-4f4b-9ce9-6186ef467573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:22.889086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7010e-72cd-4f4b-9ce9-6186ef467573 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:22.904497 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1804/3633] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:22.970583 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1830/3634] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:23.016346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7010e-72cd-4f4b-9ce9-6186ef467573 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:23.018054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f4e7010e-72cd-4f4b-9ce9-6186ef467573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:23.075880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7010e-72cd-4f4b-9ce9-6186ef467573 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:23.180678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44c4f7-a2a4-46d4-bf5a-63221946be53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:23.181578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44c4f7-a2a4-46d4-bf5a-63221946be53 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:23.181952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44c4f7-a2a4-46d4-bf5a-63221946be53 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:23.182564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44c4f7-a2a4-46d4-bf5a-63221946be53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:23.197111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44c4f7-a2a4-46d4-bf5a-63221946be53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:23.198699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44c4f7-a2a4-46d4-bf5a-63221946be53 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:23.211626 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1805/3635] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:24.021734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd112c-7b1f-4e3e-bf8b-9d23df0736ca None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:24.023812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d4dd112c-7b1f-4e3e-bf8b-9d23df0736ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:24.108688 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:24.180289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd112c-7b1f-4e3e-bf8b-9d23df0736ca None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:24.191054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:24.191819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:24.192195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:24.192567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] PATH_INFO: `/v3/projects/f0fc4480ffe34af2848d28ac0009dd22` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:24.194029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0fc4480ffe34af2848d28ac0009dd22)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:24.199043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:24.304836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0fc4480ffe34af2848d28ac0009dd22', 'request_id': 'req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.317581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0fc4480ffe34af2848d28ac0009dd22', 'request_id': 'req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.328355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0fc4480ffe34af2848d28ac0009dd22', 'request_id': 'req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.348104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] The token cache is being invalidate because project f0fc4480ffe34af2848d28ac0009dd22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:24.348564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.350740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.355129 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1831/3636] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:24 2022] DELETE /identity/v3/projects/f0fc4480ffe34af2848d28ac0009dd22 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:24.360335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44c4f7-a2a4-46d4-bf5a-63221946be53 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:24.381221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44c4f7-a2a4-46d4-bf5a-63221946be53 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:24.461365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:24.461957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:24.462249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:24.462526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] PATH_INFO: `/v3/users/4001b7eeb24844f6a296c78d09f93290` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:24.463716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4001b7eeb24844f6a296c78d09f93290)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:24.466542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:24.519745 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:24.537640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4001b7eeb24844f6a296c78d09f93290'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.557306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4001b7eeb24844f6a296c78d09f93290'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.567626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4001b7eeb24844f6a296c78d09f93290'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.582097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4001b7eeb24844f6a296c78d09f93290'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.582956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-50a92591-d575-4bf9-a934-b20587f19642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4001b7eeb24844f6a296c78d09f93290'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:24.593496 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1806/3637] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:24 2022] DELETE /identity/v3/users/4001b7eeb24844f6a296c78d09f93290 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:25.633824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:25.636780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:25.651850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27f0c2-dc29-4ef3-bf9d-ceb02be2f770 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:25.730058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:25.731798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:25.732074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:25.732344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] PATH_INFO: `/v3/projects/27ef15ad037f476b915b1b7d0d1a2b16` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:25.734067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ef15ad037f476b915b1b7d0d1a2b16)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:25.735817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:25.819137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ef15ad037f476b915b1b7d0d1a2b16', 'request_id': 'req-9ac32d60-17ad-4fd1-8eac-59d1cd685069'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:25.833726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ef15ad037f476b915b1b7d0d1a2b16', 'request_id': 'req-9ac32d60-17ad-4fd1-8eac-59d1cd685069'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:25.844927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ef15ad037f476b915b1b7d0d1a2b16', 'request_id': 'req-9ac32d60-17ad-4fd1-8eac-59d1cd685069'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:25.847999 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:25.875686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] The token cache is being invalidate because project 27ef15ad037f476b915b1b7d0d1a2b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:25.876084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:25.877028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ac32d60-17ad-4fd1-8eac-59d1cd685069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:25.879552 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1832/3638] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:25 2022] DELETE /identity/v3/projects/27ef15ad037f476b915b1b7d0d1a2b16 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:25.886995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36107-fa87-4a47-9dcd-fb75d62d2a6c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:25.888298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36107-fa87-4a47-9dcd-fb75d62d2a6c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:25.888804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36107-fa87-4a47-9dcd-fb75d62d2a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:25.926983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-eca36107-fa87-4a47-9dcd-fb75d62d2a6c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:25.938586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eca36107-fa87-4a47-9dcd-fb75d62d2a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:26.025901 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1807/3639] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:26.039901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91502ec-2963-43fc-9e44-66a55dff2e0d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.041076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91502ec-2963-43fc-9e44-66a55dff2e0d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.041500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91502ec-2963-43fc-9e44-66a55dff2e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.073020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e91502ec-2963-43fc-9e44-66a55dff2e0d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:26.076121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e91502ec-2963-43fc-9e44-66a55dff2e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:26.097885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca36107-fa87-4a47-9dcd-fb75d62d2a6c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:26.098930 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1833/3640] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:26.119565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca36107-fa87-4a47-9dcd-fb75d62d2a6c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:26.129679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713e6d5-a8a6-4464-aba9-58b9ab9c4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:26.130555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713e6d5-a8a6-4464-aba9-58b9ab9c4585 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.133023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713e6d5-a8a6-4464-aba9-58b9ab9c4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.133023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713e6d5-a8a6-4464-aba9-58b9ab9c4585 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.133866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713e6d5-a8a6-4464-aba9-58b9ab9c4585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:26.134202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713e6d5-a8a6-4464-aba9-58b9ab9c4585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:26.147165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713e6d5-a8a6-4464-aba9-58b9ab9c4585 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:26.175317 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1808/3641] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:26.176448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91502ec-2963-43fc-9e44-66a55dff2e0d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:26.188701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91502ec-2963-43fc-9e44-66a55dff2e0d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:26.199945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d281e0-b15c-4731-a782-e090149f8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:26.201158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d281e0-b15c-4731-a782-e090149f8e42 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.202291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d281e0-b15c-4731-a782-e090149f8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.202794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d281e0-b15c-4731-a782-e090149f8e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.203943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d281e0-b15c-4731-a782-e090149f8e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:26.206687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d281e0-b15c-4731-a782-e090149f8e42 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:26.254290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713e6d5-a8a6-4464-aba9-58b9ab9c4585 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:26.256899 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1834/3642] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:26 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:26.273843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713e6d5-a8a6-4464-aba9-58b9ab9c4585 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:26.419199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c06f4-421a-4e1f-b54a-2044810245db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:26.420027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c06f4-421a-4e1f-b54a-2044810245db admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.420541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c06f4-421a-4e1f-b54a-2044810245db admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.420968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c06f4-421a-4e1f-b54a-2044810245db admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.421831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c06f4-421a-4e1f-b54a-2044810245db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:26.423916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c06f4-421a-4e1f-b54a-2044810245db admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:26.457735 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1809/3643] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:26 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:26.458965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d281e0-b15c-4731-a782-e090149f8e42 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:26.473277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d281e0-b15c-4731-a782-e090149f8e42 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:26.482687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8334-82f4-4585-ad56-07d54c754458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:26.483772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8334-82f4-4585-ad56-07d54c754458 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.484341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8334-82f4-4585-ad56-07d54c754458 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.484919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8334-82f4-4585-ad56-07d54c754458 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.485832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe8334-82f4-4585-ad56-07d54c754458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:26.489907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe8334-82f4-4585-ad56-07d54c754458 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:26.507118 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1835/3644] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:26.511153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c06f4-421a-4e1f-b54a-2044810245db admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:26.526746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c06f4-421a-4e1f-b54a-2044810245db admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:26.537523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7615b-cb6a-4749-b5be-47cdc89abb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:26.538365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7615b-cb6a-4749-b5be-47cdc89abb08 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.538914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7615b-cb6a-4749-b5be-47cdc89abb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.539474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7615b-cb6a-4749-b5be-47cdc89abb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.540430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7615b-cb6a-4749-b5be-47cdc89abb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:26.542249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7615b-cb6a-4749-b5be-47cdc89abb08 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:26.566847 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1810/3645] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:26.571403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8334-82f4-4585-ad56-07d54c754458 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:26.587047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8334-82f4-4585-ad56-07d54c754458 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:26.598557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11579590-3d9e-4e42-8dc6-5bc34707fe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:26.599261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11579590-3d9e-4e42-8dc6-5bc34707fe2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.599549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11579590-3d9e-4e42-8dc6-5bc34707fe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.599829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11579590-3d9e-4e42-8dc6-5bc34707fe2e admin admin] PATH_INFO: `/v3/projects/32cbcbfac821496380ecc6e4d4a6de68/users/dbb6e92facae4c5ba200c0c7635cc650/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.639687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3759b-6484-4aa0-a231-147a90d074b7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.640091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3759b-6484-4aa0-a231-147a90d074b7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.640467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3759b-6484-4aa0-a231-147a90d074b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.643605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11579590-3d9e-4e42-8dc6-5bc34707fe2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32cbcbfac821496380ecc6e4d4a6de68, user_id=dbb6e92facae4c5ba200c0c7635cc650, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:26.648298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11579590-3d9e-4e42-8dc6-5bc34707fe2e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:26.665845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-91d3759b-6484-4aa0-a231-147a90d074b7 None None] MFA Rules not processed for user `c9ac716a6af441a4bc02d8ef11f81487`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:26.667430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-91d3759b-6484-4aa0-a231-147a90d074b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:26.689239 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1836/3646] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:26 2022] PUT /identity/v3/projects/32cbcbfac821496380ecc6e4d4a6de68/users/dbb6e92facae4c5ba200c0c7635cc650/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:26.694642 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:26.695189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385b713-2bcf-4ea6-80a0-ce73ac5f8ddb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.695752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385b713-2bcf-4ea6-80a0-ce73ac5f8ddb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.696181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385b713-2bcf-4ea6-80a0-ce73ac5f8ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.750507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b385b713-2bcf-4ea6-80a0-ce73ac5f8ddb None None] MFA Rules not processed for user `dbb6e92facae4c5ba200c0c7635cc650`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:26.752317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b385b713-2bcf-4ea6-80a0-ce73ac5f8ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:26.784418 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1811/3647] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:26.867995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3759b-6484-4aa0-a231-147a90d074b7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:26.874587 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1837/3648] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:26.880840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3759b-6484-4aa0-a231-147a90d074b7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:26.955947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331af82-9403-4b6f-89c3-fbca9785aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:26.956746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331af82-9403-4b6f-89c3-fbca9785aa02 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:26.957035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331af82-9403-4b6f-89c3-fbca9785aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:26.957307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331af82-9403-4b6f-89c3-fbca9785aa02 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:26.957969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331af82-9403-4b6f-89c3-fbca9785aa02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:26.964902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331af82-9403-4b6f-89c3-fbca9785aa02 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:27.005746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385b713-2bcf-4ea6-80a0-ce73ac5f8ddb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:27.015043 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1812/3649] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:26 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:27.020134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385b713-2bcf-4ea6-80a0-ce73ac5f8ddb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:27.125931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee29ed-3cdf-4b41-b415-160af1674a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:27.127114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee29ed-3cdf-4b41-b415-160af1674a94 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:27.127431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee29ed-3cdf-4b41-b415-160af1674a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:27.127735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee29ed-3cdf-4b41-b415-160af1674a94 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:27.128953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee29ed-3cdf-4b41-b415-160af1674a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:27.132567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee29ed-3cdf-4b41-b415-160af1674a94 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:27.170786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331af82-9403-4b6f-89c3-fbca9785aa02 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:27.171241 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1838/3650] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:27 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:27.185787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331af82-9403-4b6f-89c3-fbca9785aa02 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:27.190995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b14a4-3ce1-4345-815c-39e775d1829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:27.192477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b14a4-3ce1-4345-815c-39e775d1829d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:27.192847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b14a4-3ce1-4345-815c-39e775d1829d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:27.193398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b14a4-3ce1-4345-815c-39e775d1829d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:27.194158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b14a4-3ce1-4345-815c-39e775d1829d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:27.196185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b14a4-3ce1-4345-815c-39e775d1829d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:27.213977 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1813/3651] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:27.214281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee29ed-3cdf-4b41-b415-160af1674a94 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:27.228334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee29ed-3cdf-4b41-b415-160af1674a94 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:27.234128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53d552-3368-4912-b163-3cc16374f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:27.234892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53d552-3368-4912-b163-3cc16374f92d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:27.235528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53d552-3368-4912-b163-3cc16374f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:27.235992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53d552-3368-4912-b163-3cc16374f92d admin admin] PATH_INFO: `/v3/projects/7ff66a1ff345420ea1d09aca783b1edd/users/8bcbba4984174650a2511933476d6f4f/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:27.241293 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:27.267633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53d552-3368-4912-b163-3cc16374f92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff66a1ff345420ea1d09aca783b1edd, user_id=8bcbba4984174650a2511933476d6f4f, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:27.271412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53d552-3368-4912-b163-3cc16374f92d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:27.314655 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1839/3652] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:27 2022] PUT /identity/v3/projects/7ff66a1ff345420ea1d09aca783b1edd/users/8bcbba4984174650a2511933476d6f4f/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:27.318522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b14a4-3ce1-4345-815c-39e775d1829d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:27.340705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b14a4-3ce1-4345-815c-39e775d1829d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:27.477680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd61ed-5c3e-4a40-8581-294629c42db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:27.478840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd61ed-5c3e-4a40-8581-294629c42db1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:27.479320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd61ed-5c3e-4a40-8581-294629c42db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:27.479788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd61ed-5c3e-4a40-8581-294629c42db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:27.481494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd61ed-5c3e-4a40-8581-294629c42db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:27.483485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd61ed-5c3e-4a40-8581-294629c42db1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:27.503593 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1814/3653] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:27.508282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53d552-3368-4912-b163-3cc16374f92d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:27.530101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53d552-3368-4912-b163-3cc16374f92d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:27.535502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e0f60-d0b3-497c-b615-3d06a4251be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:27.536193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e0f60-d0b3-497c-b615-3d06a4251be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:27.536476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e0f60-d0b3-497c-b615-3d06a4251be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:27.536789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e0f60-d0b3-497c-b615-3d06a4251be5 admin admin] PATH_INFO: `/v3/projects/7ff66a1ff345420ea1d09aca783b1edd/users/8bcbba4984174650a2511933476d6f4f/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:27.539592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e0f60-d0b3-497c-b615-3d06a4251be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff66a1ff345420ea1d09aca783b1edd, user_id=8bcbba4984174650a2511933476d6f4f, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:27.541875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e0f60-d0b3-497c-b615-3d06a4251be5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:27.576801 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1840/3654] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:27 2022] PUT /identity/v3/projects/7ff66a1ff345420ea1d09aca783b1edd/users/8bcbba4984174650a2511933476d6f4f/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:27.593411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b307b-0e2a-405a-ac70-0aca766771b3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:27.593839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b307b-0e2a-405a-ac70-0aca766771b3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:27.594910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b307b-0e2a-405a-ac70-0aca766771b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:27.653868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cb6b307b-0e2a-405a-ac70-0aca766771b3 None None] MFA Rules not processed for user `8bcbba4984174650a2511933476d6f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:27.656524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cb6b307b-0e2a-405a-ac70-0aca766771b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:27.687463 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:27.789466 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1815/3655] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:27.795944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e0f60-d0b3-497c-b615-3d06a4251be5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:27.809533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e0f60-d0b3-497c-b615-3d06a4251be5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:27.821279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dc019-9845-4526-ab9a-cfdba5d46dda tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bcbba4984174650a2511933476d6f4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff66a1ff345420ea1d09aca783b1edd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:27.821279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dc019-9845-4526-ab9a-cfdba5d46dda tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:27.821279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dc019-9845-4526-ab9a-cfdba5d46dda tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:27.821541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dc019-9845-4526-ab9a-cfdba5d46dda tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:27.821541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dc019-9845-4526-ab9a-cfdba5d46dda tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:27.823098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dc019-9845-4526-ab9a-cfdba5d46dda tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:27.880515 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1841/3656] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:27 2022] POST /identity/v3/projects => generated 359 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:27.884578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b307b-0e2a-405a-ac70-0aca766771b3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:27.898377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b307b-0e2a-405a-ac70-0aca766771b3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:28.101978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200990-bec0-4a79-a0aa-393b1a68a9a1 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bcbba4984174650a2511933476d6f4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff66a1ff345420ea1d09aca783b1edd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:28.102682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200990-bec0-4a79-a0aa-393b1a68a9a1 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:28.102931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200990-bec0-4a79-a0aa-393b1a68a9a1 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:28.103209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200990-bec0-4a79-a0aa-393b1a68a9a1 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:28.103881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40200990-bec0-4a79-a0aa-393b1a68a9a1 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:28.106097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40200990-bec0-4a79-a0aa-393b1a68a9a1 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:28.166759 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1816/3657] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:27 2022] POST /identity/v3/users => generated 371 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:28.171263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dc019-9845-4526-ab9a-cfdba5d46dda tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:28.206941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dc019-9845-4526-ab9a-cfdba5d46dda tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:28.229034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b720a3-4f30-4caf-806d-cfeb133a1df4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bcbba4984174650a2511933476d6f4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff66a1ff345420ea1d09aca783b1edd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:28.229753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b720a3-4f30-4caf-806d-cfeb133a1df4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:28.230334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b720a3-4f30-4caf-806d-cfeb133a1df4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:28.230674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b720a3-4f30-4caf-806d-cfeb133a1df4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:28.231598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b720a3-4f30-4caf-806d-cfeb133a1df4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:28.231913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b720a3-4f30-4caf-806d-cfeb133a1df4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:28.233186 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-85b720a3-4f30-4caf-806d-cfeb133a1df4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:28.233186 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 00:57:28.233186 n-d-master-1 devstack@keystone.service[86425]: Oct 19 00:57:28.234392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b720a3-4f30-4caf-806d-cfeb133a1df4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:28.325886 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1842/3658] 10.222.0.27 () {58 vars in 1157 bytes} [Wed Oct 19 00:57:28 2022] GET /identity/v3/users?domain_id=default => generated 8293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:28.330331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200990-bec0-4a79-a0aa-393b1a68a9a1 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:28.343349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200990-bec0-4a79-a0aa-393b1a68a9a1 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:28.348954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bcbba4984174650a2511933476d6f4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff66a1ff345420ea1d09aca783b1edd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:28.349718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:28.350147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:28.350448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] PATH_INFO: `/v3/users/c381c9aa8ae1496fb979a049d07e9115` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:28.383567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorizing `identity:update_user(user_id=c381c9aa8ae1496fb979a049d07e9115)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:28.391748 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:57:28.391748 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 00:57:28.391748 n-d-master-1 devstack@keystone.service[86424]: Oct 19 00:57:28.395680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:28.486217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c381c9aa8ae1496fb979a049d07e9115'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:28.499913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invalidating the token cache because user c381c9aa8ae1496fb979a049d07e9115 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:28.500203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:28.501100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:28.508151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5ae9b-9487-4553-b780-9b7c43ae36d7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:28.508480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5ae9b-9487-4553-b780-9b7c43ae36d7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:28.508872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5ae9b-9487-4553-b780-9b7c43ae36d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:28.515268 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1817/3659] 10.222.0.27 () {60 vars in 1244 bytes} [Wed Oct 19 00:57:28 2022] PATCH /identity/v3/users/c381c9aa8ae1496fb979a049d07e9115 => generated 485 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:28.536877 n-d-master-1 devstack@keystone.service[86425]: WARNING keystone.auth.plugins.core [None req-24d5ae9b-9487-4553-b780-9b7c43ae36d7 None None] User is disabled: c381c9aa8ae1496fb979a049d07e9115: AssertionError: User is disabled: c381c9aa8ae1496fb979a049d07e9115 Oct 19 00:57:28.564323 n-d-master-1 devstack@keystone.service[86425]: WARNING keystone.server.flask.application [None req-24d5ae9b-9487-4553-b780-9b7c43ae36d7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 19 00:57:28.566180 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1843/3660] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:28 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 59 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 19 00:57:28.570472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:28.572141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:28.634907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b18038-0d38-4a09-bb85-e942b0f095b4 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:28.654642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bcbba4984174650a2511933476d6f4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff66a1ff345420ea1d09aca783b1edd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:28.656543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:28.659450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:28.661166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] PATH_INFO: `/v3/users/c381c9aa8ae1496fb979a049d07e9115` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:28.727820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c381c9aa8ae1496fb979a049d07e9115)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:28.729845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:28.814435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5ae9b-9487-4553-b780-9b7c43ae36d7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:28.816389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-24d5ae9b-9487-4553-b780-9b7c43ae36d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:28.830248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c381c9aa8ae1496fb979a049d07e9115'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:28.832615 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:28.889771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c381c9aa8ae1496fb979a049d07e9115'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:28.901599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c381c9aa8ae1496fb979a049d07e9115'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:28.913984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c381c9aa8ae1496fb979a049d07e9115'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:28.914446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c381c9aa8ae1496fb979a049d07e9115'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:28.927504 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1818/3661] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:28 2022] DELETE /identity/v3/users/c381c9aa8ae1496fb979a049d07e9115 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:28.928738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:28.930362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:29.054723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5ae9b-9487-4553-b780-9b7c43ae36d7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:29.086589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa14fa-f94b-4cec-a0fd-bb7258762242 tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:29.100283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bcbba4984174650a2511933476d6f4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff66a1ff345420ea1d09aca783b1edd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:29.101153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:29.101443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:29.101716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] PATH_INFO: `/v3/projects/8ed8dd7c71ef467e99ab3b4fa968d329` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:29.102935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ed8dd7c71ef467e99ab3b4fa968d329)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:29.104936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:29.165135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:29.165604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:29.165894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:29.166172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] PATH_INFO: `/v3/users/5ef2d0e41b4f47ad9358485236b86df1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:29.169734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef2d0e41b4f47ad9358485236b86df1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:29.175134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:29.323736 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:29.327448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed8dd7c71ef467e99ab3b4fa968d329', 'request_id': 'req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.342561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef2d0e41b4f47ad9358485236b86df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.353819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed8dd7c71ef467e99ab3b4fa968d329', 'request_id': 'req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.368842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef2d0e41b4f47ad9358485236b86df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.384019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef2d0e41b4f47ad9358485236b86df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.398935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed8dd7c71ef467e99ab3b4fa968d329', 'request_id': 'req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.403688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef2d0e41b4f47ad9358485236b86df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.405965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b04959f3-4d13-4503-941a-251deac92fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef2d0e41b4f47ad9358485236b86df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.422955 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1844/3662] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:28 2022] DELETE /identity/v3/users/5ef2d0e41b4f47ad9358485236b86df1 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:29.427219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4a1b-4247-4a6e-ab8f-5470dacba0a2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:29.429135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] The token cache is being invalidate because project 8ed8dd7c71ef467e99ab3b4fa968d329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:29.429432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.430037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4a1b-4247-4a6e-ab8f-5470dacba0a2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:29.430228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:29.430755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4a1b-4247-4a6e-ab8f-5470dacba0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:29.432455 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1819/3663] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:28 2022] DELETE /identity/v3/projects/8ed8dd7c71ef467e99ab3b4fa968d329 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:29.439475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:29.442389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:29.484051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a51c4a1b-4247-4a6e-ab8f-5470dacba0a2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:29.485685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a51c4a1b-4247-4a6e-ab8f-5470dacba0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:29.602668 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:29.608311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0ebcc-ff52-4160-ba7b-e40b0007fe7e tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:29.727296 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1845/3664] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:29.735981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4a1b-4247-4a6e-ab8f-5470dacba0a2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:29.738352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a51c4a1b-4247-4a6e-ab8f-5470dacba0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:29.797733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bcbba4984174650a2511933476d6f4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff66a1ff345420ea1d09aca783b1edd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:29.798616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:29.799001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:29.799847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:29.803038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:29.814989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Could not find domain: f5eb3046bcfd49cd9c1ea2ca4521c0fa.: keystone.exception.DomainNotFound: Could not find domain: f5eb3046bcfd49cd9c1ea2ca4521c0fa. Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f5eb3046bcfd49cd9c1ea2ca4521c0fa. Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:57:29.852094 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 19 00:57:29.853444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:57:29.854515 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 00:57:29.857754 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:57:29.857754 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f5eb3046bcfd49cd9c1ea2ca4521c0fa. Oct 19 00:57:29.857754 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 00:57:29.866753 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1820/3665] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:29 2022] POST /identity/v3/users => generated 112 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 00:57:29.868199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:29.872028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:29.909077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6412d4-f9a1-4299-af16-5865e4fd172b tempest-UsersNegativeTest-663734859 tempest-UsersNegativeTest-663734859-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:29.918502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:29.919661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:29.920158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:29.921241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] PATH_INFO: `/v3/users/dbb6e92facae4c5ba200c0c7635cc650` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:29.928657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb6e92facae4c5ba200c0c7635cc650)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:29.929258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4a1b-4247-4a6e-ab8f-5470dacba0a2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:29.935986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:29.948260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4fae-116b-4782-9a73-6acbe57757b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:29.950512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4fae-116b-4782-9a73-6acbe57757b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:29.950910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4fae-116b-4782-9a73-6acbe57757b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:29.951142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4fae-116b-4782-9a73-6acbe57757b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:29.990960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4fae-116b-4782-9a73-6acbe57757b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:29.993387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4fae-116b-4782-9a73-6acbe57757b3 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:30.018564 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1846/3666] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:57:30.055904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb6e92facae4c5ba200c0c7635cc650'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.097620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb6e92facae4c5ba200c0c7635cc650'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.112246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb6e92facae4c5ba200c0c7635cc650'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.130139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb6e92facae4c5ba200c0c7635cc650'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.131144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb6e92facae4c5ba200c0c7635cc650'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.150597 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1821/3667] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:29 2022] DELETE /identity/v3/users/dbb6e92facae4c5ba200c0c7635cc650 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:30.153265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fe1eb-fda1-4042-bcfc-7fcd0d36c5a6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:30.153623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fe1eb-fda1-4042-bcfc-7fcd0d36c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:30.154033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fe1eb-fda1-4042-bcfc-7fcd0d36c5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:30.211223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ca6fe1eb-fda1-4042-bcfc-7fcd0d36c5a6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:30.212514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ca6fe1eb-fda1-4042-bcfc-7fcd0d36c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:30.366229 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1847/3668] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:30.403568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:30.405758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:30.531567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66b51-3daa-45b2-b31e-248137617426 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:30.536055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672eb260-f689-4674-b8ce-330f716330a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:30.536847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672eb260-f689-4674-b8ce-330f716330a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:30.537232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672eb260-f689-4674-b8ce-330f716330a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:30.537610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672eb260-f689-4674-b8ce-330f716330a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:30.549963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672eb260-f689-4674-b8ce-330f716330a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:30.551672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672eb260-f689-4674-b8ce-330f716330a7 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:30.563746 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1822/3669] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:30.705280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fe1eb-fda1-4042-bcfc-7fcd0d36c5a6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:30.706764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ca6fe1eb-fda1-4042-bcfc-7fcd0d36c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:30.715890 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:30.733494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fe1eb-fda1-4042-bcfc-7fcd0d36c5a6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:30.740046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:30.740948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:30.741363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:30.741761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] PATH_INFO: `/v3/projects/b27a360801e243b4aa743868e8958fb6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:30.743271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27a360801e243b4aa743868e8958fb6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:30.747077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:30.849242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27a360801e243b4aa743868e8958fb6', 'request_id': 'req-9784c530-9df6-40fc-9328-aac72c0c89ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.862895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27a360801e243b4aa743868e8958fb6', 'request_id': 'req-9784c530-9df6-40fc-9328-aac72c0c89ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.876946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27a360801e243b4aa743868e8958fb6', 'request_id': 'req-9784c530-9df6-40fc-9328-aac72c0c89ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.894475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] The token cache is being invalidate because project b27a360801e243b4aa743868e8958fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:30.894820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.895478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9784c530-9df6-40fc-9328-aac72c0c89ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:30.901402 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1848/3670] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:30 2022] DELETE /identity/v3/projects/b27a360801e243b4aa743868e8958fb6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:30.902873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672eb260-f689-4674-b8ce-330f716330a7 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:30.919865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672eb260-f689-4674-b8ce-330f716330a7 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:30.992691 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:31.080763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:31.082085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:31.082613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:31.083338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] PATH_INFO: `/v3/users/9ab3596a315a428f8e500220fe2958de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:31.091671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab3596a315a428f8e500220fe2958de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:31.094679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:31.138614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09937285-cbe5-496f-b2f1-0dc83252b41f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:31.139177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09937285-cbe5-496f-b2f1-0dc83252b41f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:31.139177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09937285-cbe5-496f-b2f1-0dc83252b41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:31.196157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-09937285-cbe5-496f-b2f1-0dc83252b41f None None] MFA Rules not processed for user `2951a7c54a114bc5a778e0b3ff2e8f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:31.197649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-09937285-cbe5-496f-b2f1-0dc83252b41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:31.255185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab3596a315a428f8e500220fe2958de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.291645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab3596a315a428f8e500220fe2958de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.309390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab3596a315a428f8e500220fe2958de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.336780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab3596a315a428f8e500220fe2958de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.337870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab3596a315a428f8e500220fe2958de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.354054 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1823/3671] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:30 2022] DELETE /identity/v3/users/9ab3596a315a428f8e500220fe2958de => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:31.370005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:31.377090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:31.405552 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1849/3672] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:31.415738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ecad3-b7bd-44ba-823c-70076b8d1d40 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:31.416013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ecad3-b7bd-44ba-823c-70076b8d1d40 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:31.416300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ecad3-b7bd-44ba-823c-70076b8d1d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:31.453091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-659ecad3-b7bd-44ba-823c-70076b8d1d40 None None] MFA Rules not processed for user `2951a7c54a114bc5a778e0b3ff2e8f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:31.454989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-659ecad3-b7bd-44ba-823c-70076b8d1d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:31.596772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d11e5-b942-4dda-a717-89b5b66378b1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:31.607552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:31.608351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:31.608649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:31.608932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] PATH_INFO: `/v3/projects/32cbcbfac821496380ecc6e4d4a6de68` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:31.612227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32cbcbfac821496380ecc6e4d4a6de68)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:31.615049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:31.638942 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1850/3673] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:31.656231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ecad3-b7bd-44ba-823c-70076b8d1d40 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:31.661577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-659ecad3-b7bd-44ba-823c-70076b8d1d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:31.698873 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:31.728776 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:31.752473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32cbcbfac821496380ecc6e4d4a6de68', 'request_id': 'req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.776402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32cbcbfac821496380ecc6e4d4a6de68', 'request_id': 'req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.789304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32cbcbfac821496380ecc6e4d4a6de68', 'request_id': 'req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.789705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ecad3-b7bd-44ba-823c-70076b8d1d40 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:31.814563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] The token cache is being invalidate because project 32cbcbfac821496380ecc6e4d4a6de68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:31.814862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.815819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:31.823670 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1824/3674] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:31 2022] DELETE /identity/v3/projects/32cbcbfac821496380ecc6e4d4a6de68 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:31.825919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:31.830977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:31.899213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:31.899620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:31.899994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:31.904216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:31.908095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:32.010609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de31f2-510a-4ee0-9ef9-91ae69bb8865 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:32.021276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:32.023268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:32.024285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:32.025035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] PATH_INFO: `/v3/projects/cdc667ff9c8b4275ab24bf63907c9245` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:32.026676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc667ff9c8b4275ab24bf63907c9245)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:32.030708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:32.044445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:32.045422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:32.057585 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1851/3675] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:32.066498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:32.067150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:32.084300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da1107-55d4-4859-880b-6aac2bd0db65 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:32.101366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:32.105142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:32.105142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:32.105142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] PATH_INFO: `/v3/users/8bcbba4984174650a2511933476d6f4f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:32.114657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bcbba4984174650a2511933476d6f4f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:32.120108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:32.203201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc667ff9c8b4275ab24bf63907c9245', 'request_id': 'req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.216570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc667ff9c8b4275ab24bf63907c9245', 'request_id': 'req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.233583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc667ff9c8b4275ab24bf63907c9245', 'request_id': 'req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.234408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bcbba4984174650a2511933476d6f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.239929 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:32.271020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bcbba4984174650a2511933476d6f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.273257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] The token cache is being invalidate because project cdc667ff9c8b4275ab24bf63907c9245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:32.273777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.274358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ce28d6af-e1aa-4b75-a1fc-ea98c5e5f6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.276280 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1825/3676] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:31 2022] DELETE /identity/v3/projects/cdc667ff9c8b4275ab24bf63907c9245 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:32.282929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bcbba4984174650a2511933476d6f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.283948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391a303-dcd0-488a-86f6-fbc61904baa5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:32.284366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391a303-dcd0-488a-86f6-fbc61904baa5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:32.284495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391a303-dcd0-488a-86f6-fbc61904baa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:32.294745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bcbba4984174650a2511933476d6f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.296326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e011529-a4dc-455d-98e3-1368a7901535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bcbba4984174650a2511933476d6f4f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:32.321444 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1852/3677] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:32 2022] DELETE /identity/v3/users/8bcbba4984174650a2511933476d6f4f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:32.334519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e391a303-dcd0-488a-86f6-fbc61904baa5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:32.334519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e391a303-dcd0-488a-86f6-fbc61904baa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:32.434939 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:32.477514 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1826/3678] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:32.486873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cec58-30dd-4eeb-becf-1ed5f730cb51 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:32.487279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cec58-30dd-4eeb-becf-1ed5f730cb51 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:32.487929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cec58-30dd-4eeb-becf-1ed5f730cb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:32.523078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-734cec58-30dd-4eeb-becf-1ed5f730cb51 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:32.524335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-734cec58-30dd-4eeb-becf-1ed5f730cb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:32.557308 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1853/3679] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:32.561977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391a303-dcd0-488a-86f6-fbc61904baa5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:32.594356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391a303-dcd0-488a-86f6-fbc61904baa5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:32.602758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fbfb4-2722-4978-8461-74f356474828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:32.603417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fbfb4-2722-4978-8461-74f356474828 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:32.603697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fbfb4-2722-4978-8461-74f356474828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:32.603970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fbfb4-2722-4978-8461-74f356474828 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:32.605494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fbfb4-2722-4978-8461-74f356474828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:32.605806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fbfb4-2722-4978-8461-74f356474828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:32.607570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fbfb4-2722-4978-8461-74f356474828 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:32.626395 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1827/3680] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:57:32.631505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cec58-30dd-4eeb-becf-1ed5f730cb51 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:32.646367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cec58-30dd-4eeb-becf-1ed5f730cb51 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:32.655349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c9db0-b756-49ac-b794-f68aec942afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:32.655723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c9db0-b756-49ac-b794-f68aec942afc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:32.656022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c9db0-b756-49ac-b794-f68aec942afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:32.656454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c9db0-b756-49ac-b794-f68aec942afc admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:32.657090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c9db0-b756-49ac-b794-f68aec942afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:32.659275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c9db0-b756-49ac-b794-f68aec942afc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:32.722896 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1854/3681] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:32 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:32.723375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fbfb4-2722-4978-8461-74f356474828 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:32.738509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fbfb4-2722-4978-8461-74f356474828 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:32.827358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e3da0-6370-4f07-870a-a305ec265b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:32.828563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e3da0-6370-4f07-870a-a305ec265b96 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:32.828828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e3da0-6370-4f07-870a-a305ec265b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:32.829093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e3da0-6370-4f07-870a-a305ec265b96 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:32.829981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e3da0-6370-4f07-870a-a305ec265b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:32.832387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e3da0-6370-4f07-870a-a305ec265b96 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:32.865649 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1828/3682] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:32 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:32.867682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c9db0-b756-49ac-b794-f68aec942afc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:32.890286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c9db0-b756-49ac-b794-f68aec942afc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:32.901243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3efb7-6d51-4d0f-89c9-98589ace8afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:32.902748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3efb7-6d51-4d0f-89c9-98589ace8afd admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:32.903392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3efb7-6d51-4d0f-89c9-98589ace8afd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:32.903626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3efb7-6d51-4d0f-89c9-98589ace8afd admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:32.906720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3efb7-6d51-4d0f-89c9-98589ace8afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:32.909303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3efb7-6d51-4d0f-89c9-98589ace8afd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:32.933332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e3da0-6370-4f07-870a-a305ec265b96 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:32.936491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3b3e3da0-6370-4f07-870a-a305ec265b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:32.941379 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1855/3683] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:32.948463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3efb7-6d51-4d0f-89c9-98589ace8afd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:32.953313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e3da0-6370-4f07-870a-a305ec265b96 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:32.959164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:32.959984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:32.960267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:32.960539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] PATH_INFO: `/v3/projects/7ff66a1ff345420ea1d09aca783b1edd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:32.961751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff66a1ff345420ea1d09aca783b1edd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:32.964349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:32.977644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3efb7-6d51-4d0f-89c9-98589ace8afd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:33.002068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d840d05-cdb0-4455-87bf-ed30d8254649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:33.005097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d840d05-cdb0-4455-87bf-ed30d8254649 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:33.005700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d840d05-cdb0-4455-87bf-ed30d8254649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:33.006435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d840d05-cdb0-4455-87bf-ed30d8254649 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:33.008370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d840d05-cdb0-4455-87bf-ed30d8254649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:33.012362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d840d05-cdb0-4455-87bf-ed30d8254649 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:33.047393 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1856/3684] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:33.066604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d840d05-cdb0-4455-87bf-ed30d8254649 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:33.078913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff66a1ff345420ea1d09aca783b1edd', 'request_id': 'req-9e1ec498-8dde-42dc-b052-17936048a643'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:33.097125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff66a1ff345420ea1d09aca783b1edd', 'request_id': 'req-9e1ec498-8dde-42dc-b052-17936048a643'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:33.098663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d840d05-cdb0-4455-87bf-ed30d8254649 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:33.107842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff66a1ff345420ea1d09aca783b1edd', 'request_id': 'req-9e1ec498-8dde-42dc-b052-17936048a643'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:33.126366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] The token cache is being invalidate because project 7ff66a1ff345420ea1d09aca783b1edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:33.127044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:33.127794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e1ec498-8dde-42dc-b052-17936048a643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:33.130231 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1829/3685] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:32 2022] DELETE /identity/v3/projects/7ff66a1ff345420ea1d09aca783b1edd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:33.139582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121017-88c5-44e3-840a-c50f78630179 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:33.140210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121017-88c5-44e3-840a-c50f78630179 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:33.141757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121017-88c5-44e3-840a-c50f78630179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:33.184985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7f121017-88c5-44e3-840a-c50f78630179 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:33.186471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f121017-88c5-44e3-840a-c50f78630179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:33.258261 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:33.271712 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1830/3686] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:33.273044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a531181-b2b1-499d-aeaf-b517d6d350a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:33.273851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a531181-b2b1-499d-aeaf-b517d6d350a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:33.274371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a531181-b2b1-499d-aeaf-b517d6d350a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:33.274772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a531181-b2b1-499d-aeaf-b517d6d350a1 admin admin] PATH_INFO: `/v3/projects/668c51783a3d486aa6e86990e3e344bb/users/e87791ffb2e54f3d94c355a5280c179b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:33.286881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91562956-1376-41ae-8397-cb1b2162f341 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:33.287674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91562956-1376-41ae-8397-cb1b2162f341 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:33.287674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91562956-1376-41ae-8397-cb1b2162f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:33.320091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a531181-b2b1-499d-aeaf-b517d6d350a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668c51783a3d486aa6e86990e3e344bb, user_id=e87791ffb2e54f3d94c355a5280c179b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:33.322906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a531181-b2b1-499d-aeaf-b517d6d350a1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:33.328838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-91562956-1376-41ae-8397-cb1b2162f341 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:33.332267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-91562956-1376-41ae-8397-cb1b2162f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:33.339066 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1857/3687] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:33 2022] PUT /identity/v3/projects/668c51783a3d486aa6e86990e3e344bb/users/e87791ffb2e54f3d94c355a5280c179b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:33.350563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beafca-20ef-4c57-a49a-1c38de0a23b4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:33.351115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beafca-20ef-4c57-a49a-1c38de0a23b4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:33.352171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beafca-20ef-4c57-a49a-1c38de0a23b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:33.407393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-84beafca-20ef-4c57-a49a-1c38de0a23b4 None None] MFA Rules not processed for user `e87791ffb2e54f3d94c355a5280c179b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:33.410753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-84beafca-20ef-4c57-a49a-1c38de0a23b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:33.530576 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1831/3688] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:33.532320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91562956-1376-41ae-8397-cb1b2162f341 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:33.565582 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:33.574813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91562956-1376-41ae-8397-cb1b2162f341 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:33.600656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5b12a-395e-4fca-8d82-a10832697f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:33.600656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5b12a-395e-4fca-8d82-a10832697f70 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:33.600656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5b12a-395e-4fca-8d82-a10832697f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:33.600656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5b12a-395e-4fca-8d82-a10832697f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:33.601416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5b12a-395e-4fca-8d82-a10832697f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:33.601416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5b12a-395e-4fca-8d82-a10832697f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:33.601787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5b12a-395e-4fca-8d82-a10832697f70 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:33.614268 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1858/3689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:33.629175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beafca-20ef-4c57-a49a-1c38de0a23b4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:33.630821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-84beafca-20ef-4c57-a49a-1c38de0a23b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:33.650583 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1832/3690] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:33.660834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5b12a-395e-4fca-8d82-a10832697f70 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:33.685318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5b12a-395e-4fca-8d82-a10832697f70 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:33.695565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e042c-de13-4f93-bb25-7e3f98d86d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:33.697040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e042c-de13-4f93-bb25-7e3f98d86d83 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:33.697730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e042c-de13-4f93-bb25-7e3f98d86d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:33.698430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e042c-de13-4f93-bb25-7e3f98d86d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:33.701614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e042c-de13-4f93-bb25-7e3f98d86d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:33.707777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e042c-de13-4f93-bb25-7e3f98d86d83 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:33.788365 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1833/3691] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:33 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:33.789375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e042c-de13-4f93-bb25-7e3f98d86d83 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:33.853899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beafca-20ef-4c57-a49a-1c38de0a23b4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:33.992286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933921e-7115-4484-a793-b597a8b154c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:33.992930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933921e-7115-4484-a793-b597a8b154c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:33.993219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933921e-7115-4484-a793-b597a8b154c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:33.993489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933921e-7115-4484-a793-b597a8b154c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.006846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e042c-de13-4f93-bb25-7e3f98d86d83 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:34.031524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa6978-e356-4436-aba3-d81faad9589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:34.036893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa6978-e356-4436-aba3-d81faad9589d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.036893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa6978-e356-4436-aba3-d81faad9589d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.036893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa6978-e356-4436-aba3-d81faad9589d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.039887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa6978-e356-4436-aba3-d81faad9589d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:34.066901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa6978-e356-4436-aba3-d81faad9589d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:34.096745 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1834/3692] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:33 2022] POST /identity/v3/users => generated 284 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:34.099998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa6978-e356-4436-aba3-d81faad9589d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:34.124418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa6978-e356-4436-aba3-d81faad9589d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:34.132993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132b3b-023b-42b2-b3e6-d604f184be28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:34.134242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132b3b-023b-42b2-b3e6-d604f184be28 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.134932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132b3b-023b-42b2-b3e6-d604f184be28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.135505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132b3b-023b-42b2-b3e6-d604f184be28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.137157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d132b3b-023b-42b2-b3e6-d604f184be28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:34.138982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933921e-7115-4484-a793-b597a8b154c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:34.139592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d132b3b-023b-42b2-b3e6-d604f184be28 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:34.140442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933921e-7115-4484-a793-b597a8b154c2 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:34.151633 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1859/3693] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:34.161667 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1835/3694] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:34.162942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933921e-7115-4484-a793-b597a8b154c2 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:34.176579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933921e-7115-4484-a793-b597a8b154c2 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:34.181752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d36c60-25f7-4182-ac57-4eb3e92c73eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:34.182468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36c60-25f7-4182-ac57-4eb3e92c73eb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.182825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36c60-25f7-4182-ac57-4eb3e92c73eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.183167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36c60-25f7-4182-ac57-4eb3e92c73eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.184079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d36c60-25f7-4182-ac57-4eb3e92c73eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:34.186869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d36c60-25f7-4182-ac57-4eb3e92c73eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:34.202889 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1860/3695] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:34.204282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132b3b-023b-42b2-b3e6-d604f184be28 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:34.233033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132b3b-023b-42b2-b3e6-d604f184be28 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:34.247766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f88c7d-7fa4-4b1d-a410-88b851f29594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:34.248765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f88c7d-7fa4-4b1d-a410-88b851f29594 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.249055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f88c7d-7fa4-4b1d-a410-88b851f29594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.249333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f88c7d-7fa4-4b1d-a410-88b851f29594 admin admin] PATH_INFO: `/v3/projects/c25d0bc8c63a4bfe9f24314c7e21d14c/users/29a5caaa5feb4d27a1a031a467132bf3/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.310262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f88c7d-7fa4-4b1d-a410-88b851f29594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25d0bc8c63a4bfe9f24314c7e21d14c, user_id=29a5caaa5feb4d27a1a031a467132bf3, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:34.312819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f88c7d-7fa4-4b1d-a410-88b851f29594 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:34.334527 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1836/3696] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:34 2022] PUT /identity/v3/projects/c25d0bc8c63a4bfe9f24314c7e21d14c/users/29a5caaa5feb4d27a1a031a467132bf3/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:34.345227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a88962-6b29-4314-b1be-470efe342a2f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.345712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a88962-6b29-4314-b1be-470efe342a2f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.345832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a88962-6b29-4314-b1be-470efe342a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.412054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-78a88962-6b29-4314-b1be-470efe342a2f None None] MFA Rules not processed for user `29a5caaa5feb4d27a1a031a467132bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:34.413143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-78a88962-6b29-4314-b1be-470efe342a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:34.576319 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:34.643960 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1861/3697] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:34.644585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f88c7d-7fa4-4b1d-a410-88b851f29594 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:34.663925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f88c7d-7fa4-4b1d-a410-88b851f29594 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:34.704583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c7fb9-890c-4369-8265-454061020c19 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29a5caaa5feb4d27a1a031a467132bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25d0bc8c63a4bfe9f24314c7e21d14c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:34.705244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c7fb9-890c-4369-8265-454061020c19 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.705529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c7fb9-890c-4369-8265-454061020c19 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.713046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c7fb9-890c-4369-8265-454061020c19 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] PATH_INFO: `/v3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.717492 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1837/3698] 10.222.0.27 () {58 vars in 1104 bytes} [Wed Oct 19 00:57:34 2022] GET /identity/v3 => generated 255 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:57:34.722660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a88962-6b29-4314-b1be-470efe342a2f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:34.754756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a88962-6b29-4314-b1be-470efe342a2f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:34.760143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8121f-8830-4f69-a1cc-b7642e704858 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29a5caaa5feb4d27a1a031a467132bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25d0bc8c63a4bfe9f24314c7e21d14c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:34.763137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8121f-8830-4f69-a1cc-b7642e704858 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.763137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8121f-8830-4f69-a1cc-b7642e704858 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.763137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8121f-8830-4f69-a1cc-b7642e704858 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] PATH_INFO: `/v3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.763791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1862/3699] 10.222.0.27 () {58 vars in 1104 bytes} [Wed Oct 19 00:57:34 2022] GET /identity/v3 => generated 255 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:34.768931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c7fb9-890c-4369-8265-454061020c19 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:34.786030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c7fb9-890c-4369-8265-454061020c19 tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:34.793669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de78f-9cad-4c5f-92fb-313f338d60ad tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29a5caaa5feb4d27a1a031a467132bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25d0bc8c63a4bfe9f24314c7e21d14c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:34.794391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de78f-9cad-4c5f-92fb-313f338d60ad tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.794763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de78f-9cad-4c5f-92fb-313f338d60ad tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.795105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de78f-9cad-4c5f-92fb-313f338d60ad tempest-TestApiDiscovery-571746424 tempest-TestApiDiscovery-571746424-project] PATH_INFO: `/v3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.804197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d613b8-4164-42a4-a0a6-f5a3df43b6d4 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.804566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d613b8-4164-42a4-a0a6-f5a3df43b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.805161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d613b8-4164-42a4-a0a6-f5a3df43b6d4 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.811904 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1863/3700] 10.222.0.27 () {56 vars in 895 bytes} [Wed Oct 19 00:57:34 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:57:34.813413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207fc2f-a956-4807-b7cc-8a36fb9996b5 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:34.813793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207fc2f-a956-4807-b7cc-8a36fb9996b5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:34.814143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207fc2f-a956-4807-b7cc-8a36fb9996b5 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:34.819829 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1864/3701] 10.222.0.27 () {56 vars in 895 bytes} [Wed Oct 19 00:57:34 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:57:34.820892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207fc2f-a956-4807-b7cc-8a36fb9996b5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:34.822049 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1838/3702] 10.222.0.27 () {58 vars in 1104 bytes} [Wed Oct 19 00:57:34 2022] GET /identity/v3 => generated 255 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:35.063264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207fc2f-a956-4807-b7cc-8a36fb9996b5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:35.083222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:35.083915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:35.084199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:35.084482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] PATH_INFO: `/v3/users/29a5caaa5feb4d27a1a031a467132bf3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:35.093516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a5caaa5feb4d27a1a031a467132bf3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:35.095563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:35.244844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a5caaa5feb4d27a1a031a467132bf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:35.291983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a5caaa5feb4d27a1a031a467132bf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:35.316072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a5caaa5feb4d27a1a031a467132bf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:35.341362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a5caaa5feb4d27a1a031a467132bf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:35.342700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a5caaa5feb4d27a1a031a467132bf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:35.359202 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1865/3703] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:34 2022] DELETE /identity/v3/users/29a5caaa5feb4d27a1a031a467132bf3 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:35.363981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce922-061a-4bba-808e-6e38187fb4f8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:35.364946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce922-061a-4bba-808e-6e38187fb4f8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:35.365407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce922-061a-4bba-808e-6e38187fb4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:35.410700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-22bce922-061a-4bba-808e-6e38187fb4f8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:35.415306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-22bce922-061a-4bba-808e-6e38187fb4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:35.426619 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:35.633002 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1839/3704] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:35.691942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:35.693538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:35.863520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a5559-f159-46a6-a9b1-d70d495bd8b6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:35.869236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97790b85-bf77-48f7-a035-66cddd3bc9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:35.869785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97790b85-bf77-48f7-a035-66cddd3bc9bd service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:35.870222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97790b85-bf77-48f7-a035-66cddd3bc9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:35.870634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97790b85-bf77-48f7-a035-66cddd3bc9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:35.901749 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:35.908246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97790b85-bf77-48f7-a035-66cddd3bc9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:35.911257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97790b85-bf77-48f7-a035-66cddd3bc9bd service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:35.928664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bce922-061a-4bba-808e-6e38187fb4f8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:35.931155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-22bce922-061a-4bba-808e-6e38187fb4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:35.934288 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1866/3705] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:36.166210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bce922-061a-4bba-808e-6e38187fb4f8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:36.176411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:36.177211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:36.177692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:36.177820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:36.179659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:36.389399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:36.394641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:36.420969 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1840/3706] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:37.014623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97790b85-bf77-48f7-a035-66cddd3bc9bd service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:37.016295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-97790b85-bf77-48f7-a035-66cddd3bc9bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:37.044861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97790b85-bf77-48f7-a035-66cddd3bc9bd service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:37.051327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:37.052358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:37.052827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:37.053272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] PATH_INFO: `/v3/users/d76c8fd5fe0a49da9bad854cbe8c74e0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:37.054644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76c8fd5fe0a49da9bad854cbe8c74e0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:37.063116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:37.202752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76c8fd5fe0a49da9bad854cbe8c74e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:37.220780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76c8fd5fe0a49da9bad854cbe8c74e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:37.240592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76c8fd5fe0a49da9bad854cbe8c74e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:37.260207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76c8fd5fe0a49da9bad854cbe8c74e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:37.263747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-baa1faea-3f69-4a77-8790-bfc94c0d8472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76c8fd5fe0a49da9bad854cbe8c74e0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:37.285575 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1867/3707] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:37 2022] DELETE /identity/v3/users/d76c8fd5fe0a49da9bad854cbe8c74e0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:37.785162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:37.787351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:37.815615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafed5c-596e-47c3-81cf-cbbade6f6a15 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:37.896582 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:37.940043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:37.941776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:37.942495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:37.943275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] PATH_INFO: `/v3/projects/c25d0bc8c63a4bfe9f24314c7e21d14c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:37.946262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25d0bc8c63a4bfe9f24314c7e21d14c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:37.951631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:38.081534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25d0bc8c63a4bfe9f24314c7e21d14c', 'request_id': 'req-5401a124-a0e2-4843-9979-27dffdf2e9f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:38.117168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25d0bc8c63a4bfe9f24314c7e21d14c', 'request_id': 'req-5401a124-a0e2-4843-9979-27dffdf2e9f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:38.127936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25d0bc8c63a4bfe9f24314c7e21d14c', 'request_id': 'req-5401a124-a0e2-4843-9979-27dffdf2e9f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:38.145855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] The token cache is being invalidate because project c25d0bc8c63a4bfe9f24314c7e21d14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:38.146163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:38.146904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5401a124-a0e2-4843-9979-27dffdf2e9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:38.148932 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1841/3708] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:37 2022] DELETE /identity/v3/projects/c25d0bc8c63a4bfe9f24314c7e21d14c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:38.156832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d29d-5cd6-49dd-8538-82bf8e140fcc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:38.158439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d29d-5cd6-49dd-8538-82bf8e140fcc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:38.158999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d29d-5cd6-49dd-8538-82bf8e140fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:38.191287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-38f9d29d-5cd6-49dd-8538-82bf8e140fcc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:38.192711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-38f9d29d-5cd6-49dd-8538-82bf8e140fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:38.312696 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1868/3709] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:38.321112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d9b2b-2429-4f04-9c12-0c2e719c9dc7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:38.322047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d9b2b-2429-4f04-9c12-0c2e719c9dc7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:38.322715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d9b2b-2429-4f04-9c12-0c2e719c9dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:38.350799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e67d9b2b-2429-4f04-9c12-0c2e719c9dc7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:38.352377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e67d9b2b-2429-4f04-9c12-0c2e719c9dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:38.365985 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1842/3710] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:38.367569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d29d-5cd6-49dd-8538-82bf8e140fcc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:38.381756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d29d-5cd6-49dd-8538-82bf8e140fcc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:38.393422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83454-a2e0-42d2-aa7b-35b7bb8d0051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:38.394473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83454-a2e0-42d2-aa7b-35b7bb8d0051 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:38.394999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83454-a2e0-42d2-aa7b-35b7bb8d0051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:38.395513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83454-a2e0-42d2-aa7b-35b7bb8d0051 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:38.396999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d83454-a2e0-42d2-aa7b-35b7bb8d0051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:38.397646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d83454-a2e0-42d2-aa7b-35b7bb8d0051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:38.400287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d83454-a2e0-42d2-aa7b-35b7bb8d0051 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:38.424525 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1869/3711] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:38.428487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d9b2b-2429-4f04-9c12-0c2e719c9dc7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:38.443857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d9b2b-2429-4f04-9c12-0c2e719c9dc7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:38.455199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62f46b-b8a9-4387-bd5a-416568f71fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:38.455982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62f46b-b8a9-4387-bd5a-416568f71fdb admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:38.456649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62f46b-b8a9-4387-bd5a-416568f71fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:38.457075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62f46b-b8a9-4387-bd5a-416568f71fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:38.457923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62f46b-b8a9-4387-bd5a-416568f71fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:38.460672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62f46b-b8a9-4387-bd5a-416568f71fdb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:38.508484 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1843/3712] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:38 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:38.512908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83454-a2e0-42d2-aa7b-35b7bb8d0051 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:38.528079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83454-a2e0-42d2-aa7b-35b7bb8d0051 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:38.630651 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:38.651920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6915d-18c8-49c1-ab39-7a77fe9dc746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:38.653264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6915d-18c8-49c1-ab39-7a77fe9dc746 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:38.653881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6915d-18c8-49c1-ab39-7a77fe9dc746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:38.654474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6915d-18c8-49c1-ab39-7a77fe9dc746 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:38.655849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6915d-18c8-49c1-ab39-7a77fe9dc746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:38.660096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6915d-18c8-49c1-ab39-7a77fe9dc746 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:38.708043 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1870/3713] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:38 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:38.709830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62f46b-b8a9-4387-bd5a-416568f71fdb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:38.755814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62f46b-b8a9-4387-bd5a-416568f71fdb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:38.780615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43377-3ff7-46b9-8b5a-ee6f966e6bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:38.781724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43377-3ff7-46b9-8b5a-ee6f966e6bef admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:38.782262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43377-3ff7-46b9-8b5a-ee6f966e6bef admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:38.783259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43377-3ff7-46b9-8b5a-ee6f966e6bef admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:38.784496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf43377-3ff7-46b9-8b5a-ee6f966e6bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:38.791540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf43377-3ff7-46b9-8b5a-ee6f966e6bef admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:38.844654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6915d-18c8-49c1-ab39-7a77fe9dc746 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:38.864403 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1844/3714] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:38.872474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6915d-18c8-49c1-ab39-7a77fe9dc746 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:38.892515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f35b9c-aac2-4274-bafe-43036de2a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:38.894301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f35b9c-aac2-4274-bafe-43036de2a718 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:38.894301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f35b9c-aac2-4274-bafe-43036de2a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:38.894811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f35b9c-aac2-4274-bafe-43036de2a718 admin admin] PATH_INFO: `/v3/projects/f848d0d345db40129a2f06d1b3fdfacf/users/8056a546190544a9941574a3e256ebf3/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:38.955669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f35b9c-aac2-4274-bafe-43036de2a718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f848d0d345db40129a2f06d1b3fdfacf, user_id=8056a546190544a9941574a3e256ebf3, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:38.961031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f35b9c-aac2-4274-bafe-43036de2a718 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.005007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43377-3ff7-46b9-8b5a-ee6f966e6bef admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.007017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aaf43377-3ff7-46b9-8b5a-ee6f966e6bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:39.026797 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1871/3715] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:38 2022] PUT /identity/v3/projects/f848d0d345db40129a2f06d1b3fdfacf/users/8056a546190544a9941574a3e256ebf3/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:39.032473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f35b9c-aac2-4274-bafe-43036de2a718 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.033666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43377-3ff7-46b9-8b5a-ee6f966e6bef admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.128085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.129150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.129624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.130123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] PATH_INFO: `/v3/projects/072952a76c8f483d9d8b5912b2e0ecb3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.131520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072952a76c8f483d9d8b5912b2e0ecb3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.134575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.189555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f35b9c-aac2-4274-bafe-43036de2a718 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.195120 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:39.214058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072952a76c8f483d9d8b5912b2e0ecb3', 'request_id': 'req-03c4aa1e-a841-411f-b6f1-9851111734d3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:39.238437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072952a76c8f483d9d8b5912b2e0ecb3', 'request_id': 'req-03c4aa1e-a841-411f-b6f1-9851111734d3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:39.248952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072952a76c8f483d9d8b5912b2e0ecb3', 'request_id': 'req-03c4aa1e-a841-411f-b6f1-9851111734d3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:39.273843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] The token cache is being invalidate because project 072952a76c8f483d9d8b5912b2e0ecb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:39.274235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:39.275641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03c4aa1e-a841-411f-b6f1-9851111734d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:39.279537 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1845/3716] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:39 2022] DELETE /identity/v3/projects/072952a76c8f483d9d8b5912b2e0ecb3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:39.285322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ceb7d-19e5-4a63-8561-326bd7faa86f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.285599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ceb7d-19e5-4a63-8561-326bd7faa86f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.285931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ceb7d-19e5-4a63-8561-326bd7faa86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.317115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9b0ceb7d-19e5-4a63-8561-326bd7faa86f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:39.318814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9b0ceb7d-19e5-4a63-8561-326bd7faa86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:39.337519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54143c5-0a75-4c50-9aba-7f2a6623b887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.338305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54143c5-0a75-4c50-9aba-7f2a6623b887 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.338582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54143c5-0a75-4c50-9aba-7f2a6623b887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.339096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54143c5-0a75-4c50-9aba-7f2a6623b887 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.340263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54143c5-0a75-4c50-9aba-7f2a6623b887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.342863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54143c5-0a75-4c50-9aba-7f2a6623b887 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.360256 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1872/3717] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:39.361896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54143c5-0a75-4c50-9aba-7f2a6623b887 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.365621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b54143c5-0a75-4c50-9aba-7f2a6623b887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:39.386014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54143c5-0a75-4c50-9aba-7f2a6623b887 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.391626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250c75a-0e6f-4599-a998-9cb29f824d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.392555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250c75a-0e6f-4599-a998-9cb29f824d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.392872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250c75a-0e6f-4599-a998-9cb29f824d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.393158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250c75a-0e6f-4599-a998-9cb29f824d16 admin admin] PATH_INFO: `/v3/projects/f848d0d345db40129a2f06d1b3fdfacf/users/8056a546190544a9941574a3e256ebf3/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.396277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250c75a-0e6f-4599-a998-9cb29f824d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f848d0d345db40129a2f06d1b3fdfacf, user_id=8056a546190544a9941574a3e256ebf3, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.399440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250c75a-0e6f-4599-a998-9cb29f824d16 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.429743 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1873/3718] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:39 2022] PUT /identity/v3/projects/f848d0d345db40129a2f06d1b3fdfacf/users/8056a546190544a9941574a3e256ebf3/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:39.431627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8af51-afc9-4924-b158-179e91c6dc47 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.431915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8af51-afc9-4924-b158-179e91c6dc47 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.432193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8af51-afc9-4924-b158-179e91c6dc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.446646 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1846/3719] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:39.452312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ae4e3-9efa-43a8-b1bb-65025bf545e1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.453972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ae4e3-9efa-43a8-b1bb-65025bf545e1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.453972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ae4e3-9efa-43a8-b1bb-65025bf545e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.478957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c3c8af51-afc9-4924-b158-179e91c6dc47 None None] MFA Rules not processed for user `8056a546190544a9941574a3e256ebf3`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:39.481499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c3c8af51-afc9-4924-b158-179e91c6dc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:39.485970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-181ae4e3-9efa-43a8-b1bb-65025bf545e1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:39.487409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-181ae4e3-9efa-43a8-b1bb-65025bf545e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:39.583565 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:39.602223 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1847/3720] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:39.607206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ae4e3-9efa-43a8-b1bb-65025bf545e1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.618925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ae4e3-9efa-43a8-b1bb-65025bf545e1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.625049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2b2f-3550-44cd-87b6-936ab48d635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.625672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2b2f-3550-44cd-87b6-936ab48d635a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.626018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2b2f-3550-44cd-87b6-936ab48d635a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.626298 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1874/3721] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:39.626584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2b2f-3550-44cd-87b6-936ab48d635a admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.627273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2b2f-3550-44cd-87b6-936ab48d635a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:39.627576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2b2f-3550-44cd-87b6-936ab48d635a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.629228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2b2f-3550-44cd-87b6-936ab48d635a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.631531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8af51-afc9-4924-b158-179e91c6dc47 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.647226 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1848/3722] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:39.652938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2b2f-3550-44cd-87b6-936ab48d635a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.659942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8af51-afc9-4924-b158-179e91c6dc47 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.668201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2b2f-3550-44cd-87b6-936ab48d635a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.668403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b20a0-fabc-45ba-a76f-1cf1dc8b2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.669836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b20a0-fabc-45ba-a76f-1cf1dc8b2c85 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.670237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b20a0-fabc-45ba-a76f-1cf1dc8b2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.670521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b20a0-fabc-45ba-a76f-1cf1dc8b2c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.671182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b20a0-fabc-45ba-a76f-1cf1dc8b2c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.673546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b20a0-fabc-45ba-a76f-1cf1dc8b2c85 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.682035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442fdf-f983-41b4-a65f-82bc7bb3e62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.682979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442fdf-f983-41b4-a65f-82bc7bb3e62e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.684093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442fdf-f983-41b4-a65f-82bc7bb3e62e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.685131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442fdf-f983-41b4-a65f-82bc7bb3e62e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.686830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442fdf-f983-41b4-a65f-82bc7bb3e62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.689967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442fdf-f983-41b4-a65f-82bc7bb3e62e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.728236 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1875/3723] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:39 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:39.731059 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1849/3724] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:39 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:39.732554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b20a0-fabc-45ba-a76f-1cf1dc8b2c85 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.747922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442fdf-f983-41b4-a65f-82bc7bb3e62e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.787897 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:39.838501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442fdf-f983-41b4-a65f-82bc7bb3e62e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.841150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b20a0-fabc-45ba-a76f-1cf1dc8b2c85 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.844253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099652f-e5f9-46b1-b06b-956e1ed885ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.845199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099652f-e5f9-46b1-b06b-956e1ed885ce admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.845401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099652f-e5f9-46b1-b06b-956e1ed885ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.845768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099652f-e5f9-46b1-b06b-956e1ed885ce admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.846282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638bb96-6ef4-44a1-9b80-80a72cde1d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.846792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099652f-e5f9-46b1-b06b-956e1ed885ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.846907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638bb96-6ef4-44a1-9b80-80a72cde1d71 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.847165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638bb96-6ef4-44a1-9b80-80a72cde1d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.847436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638bb96-6ef4-44a1-9b80-80a72cde1d71 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.848078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638bb96-6ef4-44a1-9b80-80a72cde1d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.849059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099652f-e5f9-46b1-b06b-956e1ed885ce admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.850542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638bb96-6ef4-44a1-9b80-80a72cde1d71 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.878521 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1850/3725] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:39 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:39.882034 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1876/3726] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:39 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:39.883207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099652f-e5f9-46b1-b06b-956e1ed885ce admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.890580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638bb96-6ef4-44a1-9b80-80a72cde1d71 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.896068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099652f-e5f9-46b1-b06b-956e1ed885ce admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.918208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1a540-3c82-4dcc-8359-deede54fc48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.921770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a540-3c82-4dcc-8359-deede54fc48a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.922232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a540-3c82-4dcc-8359-deede54fc48a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.922655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a540-3c82-4dcc-8359-deede54fc48a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.923929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638bb96-6ef4-44a1-9b80-80a72cde1d71 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.924549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1a540-3c82-4dcc-8359-deede54fc48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.929986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1a540-3c82-4dcc-8359-deede54fc48a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.938928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebc2a8-b20f-459b-a92a-b6754620d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.939620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebc2a8-b20f-459b-a92a-b6754620d473 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.939909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebc2a8-b20f-459b-a92a-b6754620d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.940188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebc2a8-b20f-459b-a92a-b6754620d473 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.941874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebc2a8-b20f-459b-a92a-b6754620d473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.948093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebc2a8-b20f-459b-a92a-b6754620d473 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.955433 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1851/3727] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:39.961189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1a540-3c82-4dcc-8359-deede54fc48a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.966566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1877/3728] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:39.973314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebc2a8-b20f-459b-a92a-b6754620d473 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:39.978196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1a540-3c82-4dcc-8359-deede54fc48a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:39.984710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73041399-a301-4976-98b2-5b331f0189a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:39.985347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73041399-a301-4976-98b2-5b331f0189a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:39.985722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73041399-a301-4976-98b2-5b331f0189a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:39.986055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73041399-a301-4976-98b2-5b331f0189a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:39.986872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73041399-a301-4976-98b2-5b331f0189a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:39.988675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73041399-a301-4976-98b2-5b331f0189a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:39.997744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebc2a8-b20f-459b-a92a-b6754620d473 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:40.002875 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1852/3729] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:40.006615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73041399-a301-4976-98b2-5b331f0189a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:40.016744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ea669-d804-423d-a3c2-3a39cf28cd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:40.017402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ea669-d804-423d-a3c2-3a39cf28cd59 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:40.017682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ea669-d804-423d-a3c2-3a39cf28cd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:40.017953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ea669-d804-423d-a3c2-3a39cf28cd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:40.018936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ea669-d804-423d-a3c2-3a39cf28cd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:40.020516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ea669-d804-423d-a3c2-3a39cf28cd59 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:40.022906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73041399-a301-4976-98b2-5b331f0189a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:40.030177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b2466-4625-47da-bc4a-a5b965a6fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:40.031252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2466-4625-47da-bc4a-a5b965a6fe09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:40.031757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2466-4625-47da-bc4a-a5b965a6fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:40.032427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2466-4625-47da-bc4a-a5b965a6fe09 admin admin] PATH_INFO: `/v3/projects/1e893a2318af4b6aa66ede371d15453f/users/b32809814dd248e3b2f556ab3a2ac3ad/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:40.062063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b2466-4625-47da-bc4a-a5b965a6fe09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e893a2318af4b6aa66ede371d15453f, user_id=b32809814dd248e3b2f556ab3a2ac3ad, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:40.065355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b2466-4625-47da-bc4a-a5b965a6fe09 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:40.067018 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1878/3730] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:40.067945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ea669-d804-423d-a3c2-3a39cf28cd59 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:40.080924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ea669-d804-423d-a3c2-3a39cf28cd59 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:40.091127 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1853/3731] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:40 2022] PUT /identity/v3/projects/1e893a2318af4b6aa66ede371d15453f/users/b32809814dd248e3b2f556ab3a2ac3ad/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:40.096156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf76f-451e-4673-a0ad-c41ef8255918 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:40.096445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf76f-451e-4673-a0ad-c41ef8255918 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:40.096788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf76f-451e-4673-a0ad-c41ef8255918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:40.148600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-26cdf76f-451e-4673-a0ad-c41ef8255918 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:40.151730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-26cdf76f-451e-4673-a0ad-c41ef8255918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:40.211692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fbaeb-0003-4fd2-9090-91a2f384f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:40.213160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fbaeb-0003-4fd2-9090-91a2f384f73d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:40.213449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fbaeb-0003-4fd2-9090-91a2f384f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:40.213720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fbaeb-0003-4fd2-9090-91a2f384f73d admin admin] PATH_INFO: `/v3/projects/e8c98cf9b8754e4e88bcf40118567ce6/users/0d2e5779fb1b4676a7a7af9b7d176c2c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:40.257348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fbaeb-0003-4fd2-9090-91a2f384f73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c98cf9b8754e4e88bcf40118567ce6, user_id=0d2e5779fb1b4676a7a7af9b7d176c2c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:40.267241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fbaeb-0003-4fd2-9090-91a2f384f73d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:40.292992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1879/3732] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:40 2022] PUT /identity/v3/projects/e8c98cf9b8754e4e88bcf40118567ce6/users/0d2e5779fb1b4676a7a7af9b7d176c2c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:40.331562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39baf9-e621-489b-9d35-c1647ff913ad None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:40.331562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39baf9-e621-489b-9d35-c1647ff913ad None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:40.331562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39baf9-e621-489b-9d35-c1647ff913ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:40.332578 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1854/3733] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:40.354634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf76f-451e-4673-a0ad-c41ef8255918 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:40.356422 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:40.359002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-26cdf76f-451e-4673-a0ad-c41ef8255918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:40.405985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-af39baf9-e621-489b-9d35-c1647ff913ad None None] MFA Rules not processed for user `0d2e5779fb1b4676a7a7af9b7d176c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:40.408528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-af39baf9-e621-489b-9d35-c1647ff913ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:40.495651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf76f-451e-4673-a0ad-c41ef8255918 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:40.575676 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1880/3734] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:40.585505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39baf9-e621-489b-9d35-c1647ff913ad None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:40.587213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-af39baf9-e621-489b-9d35-c1647ff913ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:40.593316 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:40.661402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947db936-8b73-41d0-8e6d-f75de871baa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:40.663948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947db936-8b73-41d0-8e6d-f75de871baa7 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:40.664238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947db936-8b73-41d0-8e6d-f75de871baa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:40.664513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947db936-8b73-41d0-8e6d-f75de871baa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:40.798663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39baf9-e621-489b-9d35-c1647ff913ad None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:40.803373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416d352-ab01-4fba-bab6-374a6fe592a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:40.804720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416d352-ab01-4fba-bab6-374a6fe592a7 service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:40.805018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416d352-ab01-4fba-bab6-374a6fe592a7 service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:40.805299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416d352-ab01-4fba-bab6-374a6fe592a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:40.848287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947db936-8b73-41d0-8e6d-f75de871baa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:40.850593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947db936-8b73-41d0-8e6d-f75de871baa7 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:40.874067 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1855/3735] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:40.921700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416d352-ab01-4fba-bab6-374a6fe592a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:40.927104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416d352-ab01-4fba-bab6-374a6fe592a7 service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:40.945485 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1881/3736] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:42.215004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947db936-8b73-41d0-8e6d-f75de871baa7 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:42.233338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947db936-8b73-41d0-8e6d-f75de871baa7 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:42.250140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:42.250802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:42.251083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:42.251357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] PATH_INFO: `/v3/users/8056a546190544a9941574a3e256ebf3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:42.252571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8056a546190544a9941574a3e256ebf3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:42.258868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:42.376033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8056a546190544a9941574a3e256ebf3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:42.398960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8056a546190544a9941574a3e256ebf3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:42.412935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8056a546190544a9941574a3e256ebf3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:42.425428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8056a546190544a9941574a3e256ebf3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:42.425882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8056a546190544a9941574a3e256ebf3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:42.436338 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1856/3737] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:42 2022] DELETE /identity/v3/users/8056a546190544a9941574a3e256ebf3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:42.441426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9dbcd-36db-4377-935a-6eb2ba8b1b5d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:42.441979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9dbcd-36db-4377-935a-6eb2ba8b1b5d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:42.442235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9dbcd-36db-4377-935a-6eb2ba8b1b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:42.472840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5ad9dbcd-36db-4377-935a-6eb2ba8b1b5d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:42.476452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5ad9dbcd-36db-4377-935a-6eb2ba8b1b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:42.524858 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:42.587541 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1882/3738] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:42.623846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:42.627123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:42.710845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ecab7-cbef-4fef-bae9-2ec5de240316 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:42.717888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c96832-a1a8-4e7d-9247-637f734892f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:42.720006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c96832-a1a8-4e7d-9247-637f734892f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:42.720269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c96832-a1a8-4e7d-9247-637f734892f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:42.720692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c96832-a1a8-4e7d-9247-637f734892f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:42.728832 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:42.734416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c96832-a1a8-4e7d-9247-637f734892f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:42.735985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c96832-a1a8-4e7d-9247-637f734892f3 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:42.751223 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1857/3739] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:43.517621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9dbcd-36db-4377-935a-6eb2ba8b1b5d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:43.519002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5ad9dbcd-36db-4377-935a-6eb2ba8b1b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:43.538187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9dbcd-36db-4377-935a-6eb2ba8b1b5d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:43.547426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:43.552739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:43.553018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:43.555449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] PATH_INFO: `/v3/projects/f848d0d345db40129a2f06d1b3fdfacf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:43.560070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f848d0d345db40129a2f06d1b3fdfacf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:43.564513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:43.674170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f848d0d345db40129a2f06d1b3fdfacf', 'request_id': 'req-094d48cc-1189-4c15-8d24-b524bdddce88'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.695573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f848d0d345db40129a2f06d1b3fdfacf', 'request_id': 'req-094d48cc-1189-4c15-8d24-b524bdddce88'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.703464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f848d0d345db40129a2f06d1b3fdfacf', 'request_id': 'req-094d48cc-1189-4c15-8d24-b524bdddce88'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.727909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] The token cache is being invalidate because project f848d0d345db40129a2f06d1b3fdfacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:43.728430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.729381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.732063 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1883/3740] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:43 2022] DELETE /identity/v3/projects/f848d0d345db40129a2f06d1b3fdfacf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:43.736083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c96832-a1a8-4e7d-9247-637f734892f3 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:43.747711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c96832-a1a8-4e7d-9247-637f734892f3 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:43.814497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:43.815533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:43.815810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:43.816282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] PATH_INFO: `/v3/users/0d2e5779fb1b4676a7a7af9b7d176c2c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:43.817941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2e5779fb1b4676a7a7af9b7d176c2c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:43.819463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:43.900911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2e5779fb1b4676a7a7af9b7d176c2c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.921016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2e5779fb1b4676a7a7af9b7d176c2c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.932054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2e5779fb1b4676a7a7af9b7d176c2c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.950182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2e5779fb1b4676a7a7af9b7d176c2c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.951133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dba46d8b-7ebb-4b29-937a-22b9d307dea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2e5779fb1b4676a7a7af9b7d176c2c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:43.960656 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1858/3741] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:57:43 2022] DELETE /identity/v3/users/0d2e5779fb1b4676a7a7af9b7d176c2c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:57:44.268272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:44.270401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:44.285815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d48cc-1189-4c15-8d24-b524bdddce88 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:44.353950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:44.354708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:44.355493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:44.356296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] PATH_INFO: `/v3/projects/e8c98cf9b8754e4e88bcf40118567ce6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:44.357520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c98cf9b8754e4e88bcf40118567ce6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:44.359485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:44.426978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c98cf9b8754e4e88bcf40118567ce6', 'request_id': 'req-7583aa37-d769-47d4-8ece-82c67ea244a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:44.429423 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:44.437175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c98cf9b8754e4e88bcf40118567ce6', 'request_id': 'req-7583aa37-d769-47d4-8ece-82c67ea244a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:44.444073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c98cf9b8754e4e88bcf40118567ce6', 'request_id': 'req-7583aa37-d769-47d4-8ece-82c67ea244a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:44.458305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] The token cache is being invalidate because project e8c98cf9b8754e4e88bcf40118567ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:57:44.458569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:44.459256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7583aa37-d769-47d4-8ece-82c67ea244a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:57:44.475680 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1884/3742] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:57:44 2022] DELETE /identity/v3/projects/e8c98cf9b8754e4e88bcf40118567ce6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:44.481769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24400b-4dc1-4bc4-a11d-f76cbddbabc1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:44.482328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24400b-4dc1-4bc4-a11d-f76cbddbabc1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:44.482747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24400b-4dc1-4bc4-a11d-f76cbddbabc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:44.512994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9c24400b-4dc1-4bc4-a11d-f76cbddbabc1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:44.515682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9c24400b-4dc1-4bc4-a11d-f76cbddbabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:44.628787 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1859/3743] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:44.639900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71d878-bbf2-4620-9dd6-f540df3b23b1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:44.641017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71d878-bbf2-4620-9dd6-f540df3b23b1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:44.641321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71d878-bbf2-4620-9dd6-f540df3b23b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:44.677423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bc71d878-bbf2-4620-9dd6-f540df3b23b1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:44.679608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc71d878-bbf2-4620-9dd6-f540df3b23b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:44.696527 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1885/3744] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:44.701108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24400b-4dc1-4bc4-a11d-f76cbddbabc1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:44.711970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24400b-4dc1-4bc4-a11d-f76cbddbabc1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:44.717759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f945-a678-4414-8476-413f2ba10d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:44.718531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f945-a678-4414-8476-413f2ba10d18 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:44.718869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f945-a678-4414-8476-413f2ba10d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:44.719155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f945-a678-4414-8476-413f2ba10d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:44.719820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f945-a678-4414-8476-413f2ba10d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:57:44.720128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f945-a678-4414-8476-413f2ba10d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:44.721815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f945-a678-4414-8476-413f2ba10d18 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:44.735923 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:44.745296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71d878-bbf2-4620-9dd6-f540df3b23b1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:44.745576 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1860/3745] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:57:44.760549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71d878-bbf2-4620-9dd6-f540df3b23b1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:44.766079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254618dd-3915-48f1-a359-8459ba085a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:44.766948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254618dd-3915-48f1-a359-8459ba085a3c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:44.767379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254618dd-3915-48f1-a359-8459ba085a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:44.767814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254618dd-3915-48f1-a359-8459ba085a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:44.769208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254618dd-3915-48f1-a359-8459ba085a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:44.771352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254618dd-3915-48f1-a359-8459ba085a3c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:44.827032 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1886/3746] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:44 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:44.829959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f945-a678-4414-8476-413f2ba10d18 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:44.844697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f945-a678-4414-8476-413f2ba10d18 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:44.995252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ba591-d612-4681-aebf-2f5c45b87b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:44.996787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ba591-d612-4681-aebf-2f5c45b87b72 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:44.997583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ba591-d612-4681-aebf-2f5c45b87b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:44.998411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ba591-d612-4681-aebf-2f5c45b87b72 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:45.006096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ba591-d612-4681-aebf-2f5c45b87b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:45.009200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ba591-d612-4681-aebf-2f5c45b87b72 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:45.075394 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1861/3747] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:44 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:45.079085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254618dd-3915-48f1-a359-8459ba085a3c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:45.102283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254618dd-3915-48f1-a359-8459ba085a3c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:45.118427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555ba9e-1e04-4544-9871-f068a297b54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:45.122783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555ba9e-1e04-4544-9871-f068a297b54c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:45.124345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555ba9e-1e04-4544-9871-f068a297b54c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:45.129167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555ba9e-1e04-4544-9871-f068a297b54c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:45.130183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555ba9e-1e04-4544-9871-f068a297b54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:45.132607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555ba9e-1e04-4544-9871-f068a297b54c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:45.156465 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1887/3748] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:45.157722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ba591-d612-4681-aebf-2f5c45b87b72 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:45.173118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ba591-d612-4681-aebf-2f5c45b87b72 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:45.178348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490eee6-9fd4-427b-a9d8-f53bc1d72f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:45.179156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490eee6-9fd4-427b-a9d8-f53bc1d72f1c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:45.179540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490eee6-9fd4-427b-a9d8-f53bc1d72f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:45.179915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490eee6-9fd4-427b-a9d8-f53bc1d72f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:45.181037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490eee6-9fd4-427b-a9d8-f53bc1d72f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:45.182480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490eee6-9fd4-427b-a9d8-f53bc1d72f1c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:45.210075 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1862/3749] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:45.223870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555ba9e-1e04-4544-9871-f068a297b54c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:45.250019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555ba9e-1e04-4544-9871-f068a297b54c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:45.256602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5f67d-0547-4952-be99-da224e271084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:45.257326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f67d-0547-4952-be99-da224e271084 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:45.257964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f67d-0547-4952-be99-da224e271084 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:45.258253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5f67d-0547-4952-be99-da224e271084 admin admin] PATH_INFO: `/v3/projects/9b37732bca234f7bb305de1b97d3bf7f/users/5e14516b61a544fea8f934ed68e1efda/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:45.283161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5f67d-0547-4952-be99-da224e271084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b37732bca234f7bb305de1b97d3bf7f, user_id=5e14516b61a544fea8f934ed68e1efda, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:45.286736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5f67d-0547-4952-be99-da224e271084 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:45.313059 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1888/3750] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:45 2022] PUT /identity/v3/projects/9b37732bca234f7bb305de1b97d3bf7f/users/5e14516b61a544fea8f934ed68e1efda/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:45.326986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757739be-1e4f-4dce-9057-ffa0108d83bf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:45.327276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757739be-1e4f-4dce-9057-ffa0108d83bf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:45.327555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757739be-1e4f-4dce-9057-ffa0108d83bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:45.427206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-757739be-1e4f-4dce-9057-ffa0108d83bf None None] MFA Rules not processed for user `5e14516b61a544fea8f934ed68e1efda`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:45.428548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-757739be-1e4f-4dce-9057-ffa0108d83bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:45.669251 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1863/3751] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:45.674247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5f67d-0547-4952-be99-da224e271084 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:45.829237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5f67d-0547-4952-be99-da224e271084 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:45.839752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5053de9-ccbf-4049-9c72-7d25376cdd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:45.841822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5053de9-ccbf-4049-9c72-7d25376cdd45 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:45.843525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5053de9-ccbf-4049-9c72-7d25376cdd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:45.844002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5053de9-ccbf-4049-9c72-7d25376cdd45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:45.846085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5053de9-ccbf-4049-9c72-7d25376cdd45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:45.850156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5053de9-ccbf-4049-9c72-7d25376cdd45 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:45.913370 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1889/3752] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:57:45 2022] POST /identity/v3/projects => generated 389 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:57:45.917221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757739be-1e4f-4dce-9057-ffa0108d83bf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:45.953799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757739be-1e4f-4dce-9057-ffa0108d83bf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:46.144360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6633b2-ed85-47a0-a381-c8cc9b47d7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:46.147078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6633b2-ed85-47a0-a381-c8cc9b47d7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:46.147495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6633b2-ed85-47a0-a381-c8cc9b47d7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:46.147883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6633b2-ed85-47a0-a381-c8cc9b47d7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:46.149282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6633b2-ed85-47a0-a381-c8cc9b47d7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:46.154984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6633b2-ed85-47a0-a381-c8cc9b47d7a4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:46.205391 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:46.216678 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1864/3753] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:57:45 2022] POST /identity/v3/users => generated 301 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:57:46.219426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5053de9-ccbf-4049-9c72-7d25376cdd45 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:46.239247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5053de9-ccbf-4049-9c72-7d25376cdd45 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:46.252547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130ac94-73bd-4484-a0f5-8d2a09c6b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:46.253334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130ac94-73bd-4484-a0f5-8d2a09c6b71b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:46.253725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130ac94-73bd-4484-a0f5-8d2a09c6b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:46.254952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130ac94-73bd-4484-a0f5-8d2a09c6b71b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:46.254952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130ac94-73bd-4484-a0f5-8d2a09c6b71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:46.256729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130ac94-73bd-4484-a0f5-8d2a09c6b71b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:46.273753 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1890/3754] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:46.274756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6633b2-ed85-47a0-a381-c8cc9b47d7a4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:46.287767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6633b2-ed85-47a0-a381-c8cc9b47d7a4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:46.297168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68c595-b78f-40a5-817f-944f9e9529bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:46.301669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68c595-b78f-40a5-817f-944f9e9529bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:46.301669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68c595-b78f-40a5-817f-944f9e9529bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:46.301669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68c595-b78f-40a5-817f-944f9e9529bc admin admin] PATH_INFO: `/v3/projects/5e760053103546808c8042c42f1ad931/users/06aedad8dd89491ea781058c61cac407/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:46.346908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68c595-b78f-40a5-817f-944f9e9529bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e760053103546808c8042c42f1ad931, user_id=06aedad8dd89491ea781058c61cac407, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:46.350362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68c595-b78f-40a5-817f-944f9e9529bc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:46.380849 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1865/3755] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:46 2022] PUT /identity/v3/projects/5e760053103546808c8042c42f1ad931/users/06aedad8dd89491ea781058c61cac407/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:46.386511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130ac94-73bd-4484-a0f5-8d2a09c6b71b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:46.406863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130ac94-73bd-4484-a0f5-8d2a09c6b71b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:46.500788 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:46.529285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4531c3e-3b12-4590-8f8d-e930a9b5ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:46.530054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4531c3e-3b12-4590-8f8d-e930a9b5ea43 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:46.531545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4531c3e-3b12-4590-8f8d-e930a9b5ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:46.531945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4531c3e-3b12-4590-8f8d-e930a9b5ea43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:46.534276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4531c3e-3b12-4590-8f8d-e930a9b5ea43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:46.537995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4531c3e-3b12-4590-8f8d-e930a9b5ea43 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:46.578065 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1891/3756] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:57:46.582430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68c595-b78f-40a5-817f-944f9e9529bc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:46.597015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68c595-b78f-40a5-817f-944f9e9529bc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:46.612286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b50f16-faca-4658-93b3-d5d7f88cf68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:46.613054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b50f16-faca-4658-93b3-d5d7f88cf68e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:46.613342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b50f16-faca-4658-93b3-d5d7f88cf68e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:46.613782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b50f16-faca-4658-93b3-d5d7f88cf68e admin admin] PATH_INFO: `/v3/projects/5e760053103546808c8042c42f1ad931/users/06aedad8dd89491ea781058c61cac407/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:46.616555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b50f16-faca-4658-93b3-d5d7f88cf68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e760053103546808c8042c42f1ad931, user_id=06aedad8dd89491ea781058c61cac407, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:46.623218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b50f16-faca-4658-93b3-d5d7f88cf68e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:46.653556 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1866/3757] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:57:46 2022] PUT /identity/v3/projects/5e760053103546808c8042c42f1ad931/users/06aedad8dd89491ea781058c61cac407/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:57:46.654955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d1b1-2c76-49da-8ecc-082018900ec9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:46.655250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d1b1-2c76-49da-8ecc-082018900ec9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:46.655522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d1b1-2c76-49da-8ecc-082018900ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:46.690880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-faa3d1b1-2c76-49da-8ecc-082018900ec9 None None] MFA Rules not processed for user `06aedad8dd89491ea781058c61cac407`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:46.692137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-faa3d1b1-2c76-49da-8ecc-082018900ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:46.832532 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1892/3758] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:57:46.861975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b50f16-faca-4658-93b3-d5d7f88cf68e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:46.879406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-57b50f16-faca-4658-93b3-d5d7f88cf68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:47.135910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b50f16-faca-4658-93b3-d5d7f88cf68e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:47.152288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049b13d-8878-4c91-bc46-e3c953639e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:47.153146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049b13d-8878-4c91-bc46-e3c953639e36 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:47.154090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049b13d-8878-4c91-bc46-e3c953639e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:47.154479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049b13d-8878-4c91-bc46-e3c953639e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:47.252140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049b13d-8878-4c91-bc46-e3c953639e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:47.254279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049b13d-8878-4c91-bc46-e3c953639e36 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:47.268949 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1867/3759] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:49.211196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1e0dc-3482-4395-81eb-16b33f5d8479 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:49.212131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1e0dc-3482-4395-81eb-16b33f5d8479 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:49.212577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1e0dc-3482-4395-81eb-16b33f5d8479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:49.310522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3ab1e0dc-3482-4395-81eb-16b33f5d8479 None None] MFA Rules not processed for user `c9ac716a6af441a4bc02d8ef11f81487`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:49.315225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3ab1e0dc-3482-4395-81eb-16b33f5d8479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:49.490028 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1893/3760] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:54.785065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9250e8-dedb-4f00-9e84-7dbe7ffc91d2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:54.785966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9250e8-dedb-4f00-9e84-7dbe7ffc91d2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:54.786401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9250e8-dedb-4f00-9e84-7dbe7ffc91d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:54.868465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8d9250e8-dedb-4f00-9e84-7dbe7ffc91d2 None None] MFA Rules not processed for user `b32809814dd248e3b2f556ab3a2ac3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:57:54.869739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8d9250e8-dedb-4f00-9e84-7dbe7ffc91d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:55.060918 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1868/3761] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:57:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:57:55.265188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1e0dc-3482-4395-81eb-16b33f5d8479 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:55.267802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3ab1e0dc-3482-4395-81eb-16b33f5d8479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:55.530314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1e0dc-3482-4395-81eb-16b33f5d8479 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:55.548745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75514453-570b-4ce2-a4cd-9d23f5593e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:55.551566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514453-570b-4ce2-a4cd-9d23f5593e1f service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:55.552235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514453-570b-4ce2-a4cd-9d23f5593e1f service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:55.556911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514453-570b-4ce2-a4cd-9d23f5593e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:55.586278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75514453-570b-4ce2-a4cd-9d23f5593e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:55.594957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75514453-570b-4ce2-a4cd-9d23f5593e1f service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:55.607543 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:55.622580 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1894/3762] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:57:59.843966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9250e8-dedb-4f00-9e84-7dbe7ffc91d2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:57:59.845831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8d9250e8-dedb-4f00-9e84-7dbe7ffc91d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:57:59.861692 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:59.866997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9250e8-dedb-4f00-9e84-7dbe7ffc91d2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:57:59.872762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca8895-41d9-4c5d-9086-fc585fc676c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:57:59.873732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca8895-41d9-4c5d-9086-fc585fc676c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:57:59.874342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca8895-41d9-4c5d-9086-fc585fc676c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:57:59.874842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca8895-41d9-4c5d-9086-fc585fc676c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:57:59.889105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca8895-41d9-4c5d-9086-fc585fc676c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:57:59.892157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca8895-41d9-4c5d-9086-fc585fc676c1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:57:59.929319 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1869/3763] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:57:59 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:01.413150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75514453-570b-4ce2-a4cd-9d23f5593e1f service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:01.414645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-75514453-570b-4ce2-a4cd-9d23f5593e1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:01.630589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca8895-41d9-4c5d-9086-fc585fc676c1 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:01.632568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dcca8895-41d9-4c5d-9086-fc585fc676c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:01.674799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75514453-570b-4ce2-a4cd-9d23f5593e1f service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:01.684138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7025d-8e76-4fe6-b35e-7bf1e9f51e6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:01.685084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7025d-8e76-4fe6-b35e-7bf1e9f51e6d service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:01.685527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7025d-8e76-4fe6-b35e-7bf1e9f51e6d service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:01.685990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7025d-8e76-4fe6-b35e-7bf1e9f51e6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:01.689827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-53e7025d-8e76-4fe6-b35e-7bf1e9f51e6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:01.705754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7025d-8e76-4fe6-b35e-7bf1e9f51e6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:01.708160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7025d-8e76-4fe6-b35e-7bf1e9f51e6d service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:01.731590 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1895/3764] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:01.792768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca8895-41d9-4c5d-9086-fc585fc676c1 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:01.801095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:01.812276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:01.812820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:01.813321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] PATH_INFO: `/v3/users/73c91ca45a0a4b3c9499a85bde9e8bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:01.816076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c91ca45a0a4b3c9499a85bde9e8bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:01.818415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:01.855599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bedc-d735-415e-a0db-c0729e5a8df7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:01.856159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bedc-d735-415e-a0db-c0729e5a8df7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:01.856743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bedc-d735-415e-a0db-c0729e5a8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:01.894928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8da1bedc-d735-415e-a0db-c0729e5a8df7 None None] MFA Rules not processed for user `2951a7c54a114bc5a778e0b3ff2e8f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:01.896520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8da1bedc-d735-415e-a0db-c0729e5a8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:01.938481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c91ca45a0a4b3c9499a85bde9e8bb1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:01.975149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c91ca45a0a4b3c9499a85bde9e8bb1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:01.986498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c91ca45a0a4b3c9499a85bde9e8bb1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:01.996404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c91ca45a0a4b3c9499a85bde9e8bb1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:01.997660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c91ca45a0a4b3c9499a85bde9e8bb1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:01.998221 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1896/3765] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:02.007140 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1870/3766] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:01 2022] DELETE /identity/v3/users/73c91ca45a0a4b3c9499a85bde9e8bb1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:02.538693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bedc-d735-415e-a0db-c0729e5a8df7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:02.562789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bedc-d735-415e-a0db-c0729e5a8df7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:02.712895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:02.716134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:02.746398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:02.748325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:02.748931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:02.750652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] PATH_INFO: `/v3/projects/01f3f08dd5ca42488a2c22e7f1ebf71f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:02.752168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f3f08dd5ca42488a2c22e7f1ebf71f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:02.754764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:02.865853 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:02.880558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'request_id': 'req-eea4da50-a9c8-422a-b46e-7c83e19b48ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:02.907286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bca47a-86f3-4de9-9f56-8057502c125d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:02.919295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'request_id': 'req-eea4da50-a9c8-422a-b46e-7c83e19b48ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:02.945740 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:02.957026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'request_id': 'req-eea4da50-a9c8-422a-b46e-7c83e19b48ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:02.984958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] The token cache is being invalidate because project 01f3f08dd5ca42488a2c22e7f1ebf71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:02.984958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:02.985642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-eea4da50-a9c8-422a-b46e-7c83e19b48ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:02.993782 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1897/3767] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:02 2022] DELETE /identity/v3/projects/01f3f08dd5ca42488a2c22e7f1ebf71f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:02.998884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a315c2-877d-4ff9-8ec3-3f10987bd0bd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:02.999173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a315c2-877d-4ff9-8ec3-3f10987bd0bd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:02.999452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a315c2-877d-4ff9-8ec3-3f10987bd0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:03.053652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-14a315c2-877d-4ff9-8ec3-3f10987bd0bd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:03.054925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-14a315c2-877d-4ff9-8ec3-3f10987bd0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:03.138536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:03.139696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:03.140297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:03.140733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] PATH_INFO: `/v3/users/37c7f5d1bc3a431eacef3cf113e958d7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:03.142590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c7f5d1bc3a431eacef3cf113e958d7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:03.146915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:03.265495 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1898/3768] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:03.273864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240e36-e9b6-4d76-ac9c-9065601315ae None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:03.274632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240e36-e9b6-4d76-ac9c-9065601315ae None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:03.275161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240e36-e9b6-4d76-ac9c-9065601315ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:03.286205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c7f5d1bc3a431eacef3cf113e958d7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:03.314866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c7f5d1bc3a431eacef3cf113e958d7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:03.316766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-84240e36-e9b6-4d76-ac9c-9065601315ae None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:03.317967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-84240e36-e9b6-4d76-ac9c-9065601315ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:03.327328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c7f5d1bc3a431eacef3cf113e958d7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:03.336590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c7f5d1bc3a431eacef3cf113e958d7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:03.337366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c7f5d1bc3a431eacef3cf113e958d7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:03.349751 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1871/3769] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:02 2022] DELETE /identity/v3/users/37c7f5d1bc3a431eacef3cf113e958d7 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:03.378226 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1899/3770] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:03.385218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:03.412346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:03.571152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3009ef-6df5-4e1d-b361-92e07093d430 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:03.591076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff497523-5855-4769-858f-6342baee5e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:03.591076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff497523-5855-4769-858f-6342baee5e9c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:03.591076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff497523-5855-4769-858f-6342baee5e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:03.591076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff497523-5855-4769-858f-6342baee5e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:03.595059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff497523-5855-4769-858f-6342baee5e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:03.595059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff497523-5855-4769-858f-6342baee5e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:03.595386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff497523-5855-4769-858f-6342baee5e9c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:03.636824 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1872/3771] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:03.638019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240e36-e9b6-4d76-ac9c-9065601315ae None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:03.651152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240e36-e9b6-4d76-ac9c-9065601315ae None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:03.662693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba065c-5803-4f01-899a-029fd20e2bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:03.664458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba065c-5803-4f01-899a-029fd20e2bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:03.666240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba065c-5803-4f01-899a-029fd20e2bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:03.667530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba065c-5803-4f01-899a-029fd20e2bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:03.668450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba065c-5803-4f01-899a-029fd20e2bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:03.675052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba065c-5803-4f01-899a-029fd20e2bf9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:03.760551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1900/3772] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:03 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:03.764456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff497523-5855-4769-858f-6342baee5e9c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:03.784774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff497523-5855-4769-858f-6342baee5e9c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:03.847129 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:03.889962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2b5d-123f-40c5-ad11-fc27fc8fe31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:03.890725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2b5d-123f-40c5-ad11-fc27fc8fe31b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:03.891196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2b5d-123f-40c5-ad11-fc27fc8fe31b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:03.891655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2b5d-123f-40c5-ad11-fc27fc8fe31b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:03.892394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2b5d-123f-40c5-ad11-fc27fc8fe31b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:03.894542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2b5d-123f-40c5-ad11-fc27fc8fe31b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:03.951470 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1873/3773] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:03 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:03.956091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba065c-5803-4f01-899a-029fd20e2bf9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:03.982662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba065c-5803-4f01-899a-029fd20e2bf9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:03.998564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42960b-978d-4391-926c-1040e03c5a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:04.000675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42960b-978d-4391-926c-1040e03c5a68 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.002546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42960b-978d-4391-926c-1040e03c5a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.003016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42960b-978d-4391-926c-1040e03c5a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.003899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42960b-978d-4391-926c-1040e03c5a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:04.008786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42960b-978d-4391-926c-1040e03c5a68 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:04.036997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2b5d-123f-40c5-ad11-fc27fc8fe31b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:04.047194 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1901/3774] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:04.053797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42960b-978d-4391-926c-1040e03c5a68 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:04.057050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2b5d-123f-40c5-ad11-fc27fc8fe31b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:04.061494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ef42960b-978d-4391-926c-1040e03c5a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:04.075658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a799f9-5c73-4741-8be1-4ed447fcac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:04.076314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a799f9-5c73-4741-8be1-4ed447fcac69 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.076566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a799f9-5c73-4741-8be1-4ed447fcac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.076894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a799f9-5c73-4741-8be1-4ed447fcac69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.077737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a799f9-5c73-4741-8be1-4ed447fcac69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:04.079187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a799f9-5c73-4741-8be1-4ed447fcac69 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:04.091750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42960b-978d-4391-926c-1040e03c5a68 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:04.096725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:04.097621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.098069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.098504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] PATH_INFO: `/v3/projects/7da1bd05d0434eb09dc23bf327d9f1c1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.100197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da1bd05d0434eb09dc23bf327d9f1c1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:04.102645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:04.113535 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1874/3775] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:58:04.115032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a799f9-5c73-4741-8be1-4ed447fcac69 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:04.151781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a799f9-5c73-4741-8be1-4ed447fcac69 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:04.169896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa2423-2de3-4f07-805f-be532039b479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:04.170602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa2423-2de3-4f07-805f-be532039b479 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.171042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa2423-2de3-4f07-805f-be532039b479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.171166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa2423-2de3-4f07-805f-be532039b479 admin admin] PATH_INFO: `/v3/projects/4a4820802e0a4a2b9de754ee1268c060/users/2190bd30671b47048aed416f9c14a545/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.204708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da1bd05d0434eb09dc23bf327d9f1c1', 'request_id': 'req-4c2eed0f-525e-410d-a348-5352b68d785d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:04.216838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa2423-2de3-4f07-805f-be532039b479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4820802e0a4a2b9de754ee1268c060, user_id=2190bd30671b47048aed416f9c14a545, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:04.224447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa2423-2de3-4f07-805f-be532039b479 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:04.225983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da1bd05d0434eb09dc23bf327d9f1c1', 'request_id': 'req-4c2eed0f-525e-410d-a348-5352b68d785d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:04.238601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da1bd05d0434eb09dc23bf327d9f1c1', 'request_id': 'req-4c2eed0f-525e-410d-a348-5352b68d785d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:04.257202 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1875/3776] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:04 2022] PUT /identity/v3/projects/4a4820802e0a4a2b9de754ee1268c060/users/2190bd30671b47048aed416f9c14a545/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:58:04.263675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005b1f-3105-4afc-ae87-8b11cf66fabb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.263924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] The token cache is being invalidate because project 7da1bd05d0434eb09dc23bf327d9f1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:04.264037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005b1f-3105-4afc-ae87-8b11cf66fabb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.264134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:04.264229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005b1f-3105-4afc-ae87-8b11cf66fabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.266316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4c2eed0f-525e-410d-a348-5352b68d785d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:04.271322 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1902/3777] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:04 2022] DELETE /identity/v3/projects/7da1bd05d0434eb09dc23bf327d9f1c1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:04.277630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc524dd-775b-4cc5-90b0-8e8e501018a9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.278177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc524dd-775b-4cc5-90b0-8e8e501018a9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.278780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc524dd-775b-4cc5-90b0-8e8e501018a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.332434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fdc524dd-775b-4cc5-90b0-8e8e501018a9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:04.334108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fdc524dd-775b-4cc5-90b0-8e8e501018a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:04.340547 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:04.355186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-52005b1f-3105-4afc-ae87-8b11cf66fabb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:04.358955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-52005b1f-3105-4afc-ae87-8b11cf66fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:04.493628 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1903/3778] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:04.495457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea63626-575b-4a09-b865-ac9589630b55 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.495724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea63626-575b-4a09-b865-ac9589630b55 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.496003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea63626-575b-4a09-b865-ac9589630b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.527020 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1876/3779] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:04.542971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5ea63626-575b-4a09-b865-ac9589630b55 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:04.546574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5ea63626-575b-4a09-b865-ac9589630b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:04.568233 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1904/3780] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:58:04.569898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52005b1f-3105-4afc-ae87-8b11cf66fabb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:04.590925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea63626-575b-4a09-b865-ac9589630b55 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:04.592850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5ea63626-575b-4a09-b865-ac9589630b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:04.604132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52005b1f-3105-4afc-ae87-8b11cf66fabb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:04.630844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c968c-5998-4c54-a736-66d0588ba060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:04.631485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c968c-5998-4c54-a736-66d0588ba060 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.631769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c968c-5998-4c54-a736-66d0588ba060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.636468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c968c-5998-4c54-a736-66d0588ba060 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.637896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c968c-5998-4c54-a736-66d0588ba060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:04.638233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c968c-5998-4c54-a736-66d0588ba060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:04.646500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c968c-5998-4c54-a736-66d0588ba060 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:04.697070 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1877/3781] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:04.700641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c968c-5998-4c54-a736-66d0588ba060 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:04.742800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c968c-5998-4c54-a736-66d0588ba060 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:04.757980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eb341-8de9-4464-88cd-aec1556eebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:04.758618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eb341-8de9-4464-88cd-aec1556eebb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.758900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eb341-8de9-4464-88cd-aec1556eebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.759177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eb341-8de9-4464-88cd-aec1556eebb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.759827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9eb341-8de9-4464-88cd-aec1556eebb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:04.768417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9eb341-8de9-4464-88cd-aec1556eebb2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:04.798782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea63626-575b-4a09-b865-ac9589630b55 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:04.810351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbdb62-09f1-4acd-84d8-6a688c3181c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:04.812312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbdb62-09f1-4acd-84d8-6a688c3181c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:04.813372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbdb62-09f1-4acd-84d8-6a688c3181c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:04.814037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbdb62-09f1-4acd-84d8-6a688c3181c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:04.837688 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1878/3782] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:04 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:04.838673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbdb62-09f1-4acd-84d8-6a688c3181c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:04.840462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbdb62-09f1-4acd-84d8-6a688c3181c0 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:04.843882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eb341-8de9-4464-88cd-aec1556eebb2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:04.867046 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1905/3783] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:05.021931 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:05.039418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eb341-8de9-4464-88cd-aec1556eebb2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:05.057500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f82366-d5d0-43b6-b96d-c64070662b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:05.058156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f82366-d5d0-43b6-b96d-c64070662b7b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:05.058591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f82366-d5d0-43b6-b96d-c64070662b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:05.058945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f82366-d5d0-43b6-b96d-c64070662b7b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:05.059664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f82366-d5d0-43b6-b96d-c64070662b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:05.061765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f82366-d5d0-43b6-b96d-c64070662b7b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:05.115367 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1879/3784] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:04 2022] POST /identity/v3/users => generated 282 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:05.121160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbdb62-09f1-4acd-84d8-6a688c3181c0 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:05.137633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbdb62-09f1-4acd-84d8-6a688c3181c0 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:05.149679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09115a7e-5ddf-4c7c-a0fe-79b78f389d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:05.150586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09115a7e-5ddf-4c7c-a0fe-79b78f389d4d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:05.151131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09115a7e-5ddf-4c7c-a0fe-79b78f389d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:05.152145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09115a7e-5ddf-4c7c-a0fe-79b78f389d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:05.153031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09115a7e-5ddf-4c7c-a0fe-79b78f389d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:05.154836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09115a7e-5ddf-4c7c-a0fe-79b78f389d4d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:05.178461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f82366-d5d0-43b6-b96d-c64070662b7b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:05.178851 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1906/3785] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:05.203278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f82366-d5d0-43b6-b96d-c64070662b7b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:05.214878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b94a21-2a82-4a3c-8ea3-40b6f21a9edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:05.215352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b94a21-2a82-4a3c-8ea3-40b6f21a9edc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:05.215634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b94a21-2a82-4a3c-8ea3-40b6f21a9edc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:05.215916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b94a21-2a82-4a3c-8ea3-40b6f21a9edc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:05.217313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b94a21-2a82-4a3c-8ea3-40b6f21a9edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:05.219734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b94a21-2a82-4a3c-8ea3-40b6f21a9edc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:05.265769 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1880/3786] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:05.267615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09115a7e-5ddf-4c7c-a0fe-79b78f389d4d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:05.281818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09115a7e-5ddf-4c7c-a0fe-79b78f389d4d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:05.287548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71fda-61d0-454c-b308-421f56d16999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:05.288506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71fda-61d0-454c-b308-421f56d16999 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:05.289069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71fda-61d0-454c-b308-421f56d16999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:05.289439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71fda-61d0-454c-b308-421f56d16999 admin admin] PATH_INFO: `/v3/projects/a75dc7f202174a28b30b6c6746b34796/users/17e7c6fe22384d59910f169840de1af7/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:05.318668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b71fda-61d0-454c-b308-421f56d16999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75dc7f202174a28b30b6c6746b34796, user_id=17e7c6fe22384d59910f169840de1af7, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:05.324835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b71fda-61d0-454c-b308-421f56d16999 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:05.344570 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1907/3787] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:05 2022] PUT /identity/v3/projects/a75dc7f202174a28b30b6c6746b34796/users/17e7c6fe22384d59910f169840de1af7/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:58:05.355509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ac3c3-5f67-43aa-a036-b9e359c832df None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:05.355860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ac3c3-5f67-43aa-a036-b9e359c832df None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:05.356143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ac3c3-5f67-43aa-a036-b9e359c832df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:05.392608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b95ac3c3-5f67-43aa-a036-b9e359c832df None None] MFA Rules not processed for user `17e7c6fe22384d59910f169840de1af7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:05.393918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b95ac3c3-5f67-43aa-a036-b9e359c832df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:05.554549 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1881/3788] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:07.003745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71fda-61d0-454c-b308-421f56d16999 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:07.006070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-67b71fda-61d0-454c-b308-421f56d16999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:07.182887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71fda-61d0-454c-b308-421f56d16999 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:07.200708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3022312-449e-426e-ba76-4b3fe9f1f3f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:07.201734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3022312-449e-426e-ba76-4b3fe9f1f3f7 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:07.202122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3022312-449e-426e-ba76-4b3fe9f1f3f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:07.205184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3022312-449e-426e-ba76-4b3fe9f1f3f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:07.227982 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:07.240072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3022312-449e-426e-ba76-4b3fe9f1f3f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:07.245919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3022312-449e-426e-ba76-4b3fe9f1f3f7 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:07.274414 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1908/3789] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:07.293480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268907a7-9cca-4d63-9dc1-98b25b057b96 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:07.294426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268907a7-9cca-4d63-9dc1-98b25b057b96 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:07.294869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268907a7-9cca-4d63-9dc1-98b25b057b96 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:07.297166 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1882/3790] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:58:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:58:07.309927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3022312-449e-426e-ba76-4b3fe9f1f3f7 service nova] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:58:07.331756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3022312-449e-426e-ba76-4b3fe9f1f3f7 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:07.359858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3022312-449e-426e-ba76-4b3fe9f1f3f7 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:07.367085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222f889-c1e0-4f63-b2e8-6d5b4d4823e5 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e7c6fe22384d59910f169840de1af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a75dc7f202174a28b30b6c6746b34796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:07.368875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222f889-c1e0-4f63-b2e8-6d5b4d4823e5 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:07.370048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222f889-c1e0-4f63-b2e8-6d5b4d4823e5 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:07.370431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222f889-c1e0-4f63-b2e8-6d5b4d4823e5 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] PATH_INFO: `/v3/projects/a75dc7f202174a28b30b6c6746b34796` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:07.374353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222f889-c1e0-4f63-b2e8-6d5b4d4823e5 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorizing `identity:get_project(project_id=a75dc7f202174a28b30b6c6746b34796)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:07.378932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222f889-c1e0-4f63-b2e8-6d5b4d4823e5 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:07.385146 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1909/3791] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:58:07 2022] GET /identity/v3/projects/a75dc7f202174a28b30b6c6746b34796 => generated 363 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:08.375533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8f57-a210-414c-a109-ac7d10fa79a7 None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:08.376109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8f57-a210-414c-a109-ac7d10fa79a7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:08.376109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8f57-a210-414c-a109-ac7d10fa79a7 None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:08.377788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1883/3792] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:58:08.383994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222f889-c1e0-4f63-b2e8-6d5b4d4823e5 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:58:08.411881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222f889-c1e0-4f63-b2e8-6d5b4d4823e5 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:08.425336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222f889-c1e0-4f63-b2e8-6d5b4d4823e5 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:08.430463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9bd65-cb71-429e-9538-f29d69596010 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e7c6fe22384d59910f169840de1af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a75dc7f202174a28b30b6c6746b34796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:08.431601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9bd65-cb71-429e-9538-f29d69596010 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:08.432069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9bd65-cb71-429e-9538-f29d69596010 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:08.432483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9bd65-cb71-429e-9538-f29d69596010 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] PATH_INFO: `/v3/projects/a75dc7f202174a28b30b6c6746b34796` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:08.434103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9bd65-cb71-429e-9538-f29d69596010 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorizing `identity:get_project(project_id=a75dc7f202174a28b30b6c6746b34796)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:08.435981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9bd65-cb71-429e-9538-f29d69596010 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:08.442094 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1910/3793] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:58:08 2022] GET /identity/v3/projects/a75dc7f202174a28b30b6c6746b34796 => generated 363 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:08.747860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8f57-a210-414c-a109-ac7d10fa79a7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:08.749784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-27ad8f57-a210-414c-a109-ac7d10fa79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:08.847271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8f57-a210-414c-a109-ac7d10fa79a7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:08.860855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:08.861526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:08.862018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:08.862301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] PATH_INFO: `/v3/users/5e14516b61a544fea8f934ed68e1efda` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:08.863497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e14516b61a544fea8f934ed68e1efda)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:08.865612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:08.975629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3627b-f6be-42cb-9ed5-95a7fea9bb1f None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:08.975911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3627b-f6be-42cb-9ed5-95a7fea9bb1f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:08.976370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3627b-f6be-42cb-9ed5-95a7fea9bb1f None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:08.978156 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1911/3794] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:58:08.985029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3627b-f6be-42cb-9ed5-95a7fea9bb1f None None] Authenticating service token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:58:09.015788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e14516b61a544fea8f934ed68e1efda'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:09.022102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3627b-f6be-42cb-9ed5-95a7fea9bb1f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:09.050693 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:09.059610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e14516b61a544fea8f934ed68e1efda'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:09.070891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3627b-f6be-42cb-9ed5-95a7fea9bb1f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:09.077337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e14516b61a544fea8f934ed68e1efda'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:09.085570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347483dc-29f3-4d5f-9ea3-f5d0807ee35c tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e7c6fe22384d59910f169840de1af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a75dc7f202174a28b30b6c6746b34796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:09.087055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347483dc-29f3-4d5f-9ea3-f5d0807ee35c tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:09.087951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e14516b61a544fea8f934ed68e1efda'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:09.089336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347483dc-29f3-4d5f-9ea3-f5d0807ee35c tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:09.089978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347483dc-29f3-4d5f-9ea3-f5d0807ee35c tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] PATH_INFO: `/v3/projects/a75dc7f202174a28b30b6c6746b34796` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:09.090645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e14516b61a544fea8f934ed68e1efda'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:09.094087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347483dc-29f3-4d5f-9ea3-f5d0807ee35c tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorizing `identity:get_project(project_id=a75dc7f202174a28b30b6c6746b34796)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:09.098854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347483dc-29f3-4d5f-9ea3-f5d0807ee35c tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:09.100254 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1884/3795] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:08 2022] DELETE /identity/v3/users/5e14516b61a544fea8f934ed68e1efda => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:09.101390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:09.103636 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1912/3796] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:58:08 2022] GET /identity/v3/projects/a75dc7f202174a28b30b6c6746b34796 => generated 363 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:09.105052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21a469-aeb9-4d00-9038-0d3a7c71509f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:09.105846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21a469-aeb9-4d00-9038-0d3a7c71509f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:09.108472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21a469-aeb9-4d00-9038-0d3a7c71509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:09.116949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:09.194670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3e21a469-aeb9-4d00-9038-0d3a7c71509f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:09.196789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3e21a469-aeb9-4d00-9038-0d3a7c71509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:09.269042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e84f9-2a4e-4dd6-82f6-f5e51dba3353 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:09.275275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:09.275937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:09.276225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:09.276499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:09.278708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:09.296571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:09.298751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:09.327426 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1913/3797] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:09.327842 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1885/3798] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:09.328047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d662-7386-4685-903a-af7206f78589 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:09.328047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d662-7386-4685-903a-af7206f78589 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:09.328047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d662-7386-4685-903a-af7206f78589 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:09.328560 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1914/3799] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:58:09.333752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:58:09.335164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:09.386972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21d662-7386-4685-903a-af7206f78589 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:09.392605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bd21d662-7386-4685-903a-af7206f78589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:09.436424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:09.438085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:09.570651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21d662-7386-4685-903a-af7206f78589 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:09.576021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1a1b9-9786-4e16-ab58-3c47068a8790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:09.577026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1a1b9-9786-4e16-ab58-3c47068a8790 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:09.577568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1a1b9-9786-4e16-ab58-3c47068a8790 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:09.578048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1a1b9-9786-4e16-ab58-3c47068a8790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:09.593024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1a1b9-9786-4e16-ab58-3c47068a8790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:09.595143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1a1b9-9786-4e16-ab58-3c47068a8790 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:09.598210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3f6e2-1867-4bc9-a682-a694c69e7ebc service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:09.612572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac0e4-0747-4ac4-ad87-a42fe5b58300 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e7c6fe22384d59910f169840de1af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a75dc7f202174a28b30b6c6746b34796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:09.612782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac0e4-0747-4ac4-ad87-a42fe5b58300 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:09.613066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac0e4-0747-4ac4-ad87-a42fe5b58300 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:09.613339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac0e4-0747-4ac4-ad87-a42fe5b58300 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] PATH_INFO: `/v3/projects/a75dc7f202174a28b30b6c6746b34796` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:09.617786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ac0e4-0747-4ac4-ad87-a42fe5b58300 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorizing `identity:get_project(project_id=a75dc7f202174a28b30b6c6746b34796)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:09.619915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ac0e4-0747-4ac4-ad87-a42fe5b58300 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:09.621698 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1886/3800] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:58:09 2022] GET /identity/v3/projects/a75dc7f202174a28b30b6c6746b34796 => generated 363 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:58:09.630339 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1915/3801] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:10.170256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac0e4-0747-4ac4-ad87-a42fe5b58300 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:10.172944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-680ac0e4-0747-4ac4-ad87-a42fe5b58300 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:10.212013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac0e4-0747-4ac4-ad87-a42fe5b58300 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:10.220412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:10.221168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:10.221479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:10.221723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] PATH_INFO: `/v3/projects/9b37732bca234f7bb305de1b97d3bf7f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:10.222909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b37732bca234f7bb305de1b97d3bf7f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:10.225154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:10.229539 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:10.316684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b37732bca234f7bb305de1b97d3bf7f', 'request_id': 'req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.364963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b37732bca234f7bb305de1b97d3bf7f', 'request_id': 'req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.385151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b37732bca234f7bb305de1b97d3bf7f', 'request_id': 'req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.433355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] The token cache is being invalidate because project 9b37732bca234f7bb305de1b97d3bf7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:10.433653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.453874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe60b3c-9b3d-4068-b64e-a1d202c49efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.456835 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1887/3802] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:10 2022] DELETE /identity/v3/projects/9b37732bca234f7bb305de1b97d3bf7f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:10.460514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1a1b9-9786-4e16-ab58-3c47068a8790 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:10.499709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1a1b9-9786-4e16-ab58-3c47068a8790 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:10.549720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c678d-2490-4567-8b94-2bf291b6941e None None] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:10.549720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c678d-2490-4567-8b94-2bf291b6941e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:10.550041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c678d-2490-4567-8b94-2bf291b6941e None None] PATH_INFO: `/` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:10.551590 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1888/3803] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 00:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:58:10.562547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c678d-2490-4567-8b94-2bf291b6941e None None] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 00:58:10.564493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-906c678d-2490-4567-8b94-2bf291b6941e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:10.595172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:10.597329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:10.598111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:10.598590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] PATH_INFO: `/v3/users/06aedad8dd89491ea781058c61cac407` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:10.602661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=06aedad8dd89491ea781058c61cac407)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:10.605475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:10.639212 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:10.707870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06aedad8dd89491ea781058c61cac407'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.735300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06aedad8dd89491ea781058c61cac407'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.754639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06aedad8dd89491ea781058c61cac407'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.763691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c678d-2490-4567-8b94-2bf291b6941e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:10.766592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-906c678d-2490-4567-8b94-2bf291b6941e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:10.782579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06aedad8dd89491ea781058c61cac407'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.783774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06aedad8dd89491ea781058c61cac407'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:10.794823 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1916/3804] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:10 2022] DELETE /identity/v3/users/06aedad8dd89491ea781058c61cac407 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:10.865953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c678d-2490-4567-8b94-2bf291b6941e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:10.939132 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:10.989715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfd402-c3c1-4f48-939e-5030d31f1b6e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e7c6fe22384d59910f169840de1af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a75dc7f202174a28b30b6c6746b34796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:10.990370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfd402-c3c1-4f48-939e-5030d31f1b6e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:10.990658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfd402-c3c1-4f48-939e-5030d31f1b6e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:10.990928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfd402-c3c1-4f48-939e-5030d31f1b6e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] PATH_INFO: `/v3/projects/a75dc7f202174a28b30b6c6746b34796` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:10.992090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfd402-c3c1-4f48-939e-5030d31f1b6e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorizing `identity:get_project(project_id=a75dc7f202174a28b30b6c6746b34796)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:10.994001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfd402-c3c1-4f48-939e-5030d31f1b6e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:10.996889 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1889/3805] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 00:58:10 2022] GET /identity/v3/projects/a75dc7f202174a28b30b6c6746b34796 => generated 363 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:58:11.053933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:11.062268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:11.168023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184c77d-30c6-46ca-bf25-9a04d3b13aab admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:11.174444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:11.175313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:11.175656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:11.175938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] PATH_INFO: `/v3/users/17e7c6fe22384d59910f169840de1af7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:11.177223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e7c6fe22384d59910f169840de1af7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:11.179279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:11.240315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfd402-c3c1-4f48-939e-5030d31f1b6e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:11.242407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-69dfd402-c3c1-4f48-939e-5030d31f1b6e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:11.268684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfd402-c3c1-4f48-939e-5030d31f1b6e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:11.281308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:11.283052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:11.283759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:11.284330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] PATH_INFO: `/v3/users/e87791ffb2e54f3d94c355a5280c179b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:11.286330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e7c6fe22384d59910f169840de1af7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.288192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87791ffb2e54f3d94c355a5280c179b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:11.290483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:11.315328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e7c6fe22384d59910f169840de1af7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.333355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e7c6fe22384d59910f169840de1af7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.345341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e7c6fe22384d59910f169840de1af7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.346311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2aad0b33-9fd6-4664-a2a1-cd74e910f683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e7c6fe22384d59910f169840de1af7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.356177 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1917/3806] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:11 2022] DELETE /identity/v3/users/17e7c6fe22384d59910f169840de1af7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:11.361784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0885a5-d82e-458d-accb-eb480d4ae8bb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:11.362119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0885a5-d82e-458d-accb-eb480d4ae8bb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:11.362784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0885a5-d82e-458d-accb-eb480d4ae8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:11.417947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2b0885a5-d82e-458d-accb-eb480d4ae8bb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:11.419951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2b0885a5-d82e-458d-accb-eb480d4ae8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:11.421753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87791ffb2e54f3d94c355a5280c179b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.451221 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:11.473255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87791ffb2e54f3d94c355a5280c179b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.492557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87791ffb2e54f3d94c355a5280c179b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.523406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87791ffb2e54f3d94c355a5280c179b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.525334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cbce69cf-3cb3-485d-b37c-63baab39f03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87791ffb2e54f3d94c355a5280c179b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:11.566166 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1890/3807] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:11 2022] DELETE /identity/v3/users/e87791ffb2e54f3d94c355a5280c179b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:11.569871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2dd1a-546f-41a5-a01e-e6a2679b45ea None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:11.570163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2dd1a-546f-41a5-a01e-e6a2679b45ea None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:11.570444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2dd1a-546f-41a5-a01e-e6a2679b45ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:11.613480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a5d2dd1a-546f-41a5-a01e-e6a2679b45ea None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:11.615608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a5d2dd1a-546f-41a5-a01e-e6a2679b45ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:11.711559 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1918/3808] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:11.758537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0885a5-d82e-458d-accb-eb480d4ae8bb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:11.760668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2b0885a5-d82e-458d-accb-eb480d4ae8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:11.987216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0885a5-d82e-458d-accb-eb480d4ae8bb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:11.988124 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1891/3809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:12.033097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2dd1a-546f-41a5-a01e-e6a2679b45ea None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:12.132009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08b754-09e5-443d-b9fc-890063bb6506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:12.133018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08b754-09e5-443d-b9fc-890063bb6506 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:12.135521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08b754-09e5-443d-b9fc-890063bb6506 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:12.137839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08b754-09e5-443d-b9fc-890063bb6506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:12.151739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08b754-09e5-443d-b9fc-890063bb6506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:12.154623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08b754-09e5-443d-b9fc-890063bb6506 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:12.179166 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1919/3810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:58:12.180873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08b754-09e5-443d-b9fc-890063bb6506 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:12.182390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aa08b754-09e5-443d-b9fc-890063bb6506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:12.222509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2dd1a-546f-41a5-a01e-e6a2679b45ea None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:12.227814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109d69-9910-406f-b45e-6480cfb868b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:12.228502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109d69-9910-406f-b45e-6480cfb868b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:12.228820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109d69-9910-406f-b45e-6480cfb868b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:12.229641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109d69-9910-406f-b45e-6480cfb868b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:12.246492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08b754-09e5-443d-b9fc-890063bb6506 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:12.254257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:12.255338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:12.255815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:12.256284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] PATH_INFO: `/v3/projects/5e760053103546808c8042c42f1ad931` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:12.260045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e760053103546808c8042c42f1ad931)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:12.261241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109d69-9910-406f-b45e-6480cfb868b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:12.262813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109d69-9910-406f-b45e-6480cfb868b8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:12.270290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:12.278709 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:12.290093 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1892/3811] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:12.364893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e760053103546808c8042c42f1ad931', 'request_id': 'req-62df3e0e-2979-4b3f-bb12-46cf61f2a304'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:12.383739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e760053103546808c8042c42f1ad931', 'request_id': 'req-62df3e0e-2979-4b3f-bb12-46cf61f2a304'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:12.397691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e760053103546808c8042c42f1ad931', 'request_id': 'req-62df3e0e-2979-4b3f-bb12-46cf61f2a304'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:12.400215 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:12.446068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] The token cache is being invalidate because project 5e760053103546808c8042c42f1ad931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:12.447046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:12.448279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-62df3e0e-2979-4b3f-bb12-46cf61f2a304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:12.451691 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1920/3812] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:12 2022] DELETE /identity/v3/projects/5e760053103546808c8042c42f1ad931 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:12.456755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d938d6-c2ce-479e-9219-2554173b0bae None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:12.458177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d938d6-c2ce-479e-9219-2554173b0bae None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:12.458899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d938d6-c2ce-479e-9219-2554173b0bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:12.488239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-75d938d6-c2ce-479e-9219-2554173b0bae None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:12.490798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-75d938d6-c2ce-479e-9219-2554173b0bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:12.652926 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1893/3813] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:12.660559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f82b86-e70a-4ef1-ab89-07472aec48dc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:12.660932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f82b86-e70a-4ef1-ab89-07472aec48dc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:12.661167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f82b86-e70a-4ef1-ab89-07472aec48dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:12.699671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d1f82b86-e70a-4ef1-ab89-07472aec48dc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:12.701783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d1f82b86-e70a-4ef1-ab89-07472aec48dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:12.719464 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1921/3814] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:58:12.720821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d938d6-c2ce-479e-9219-2554173b0bae None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:12.735648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d938d6-c2ce-479e-9219-2554173b0bae None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:12.744324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535e21e-69b3-4cff-9e91-e9fddb0dba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:12.745349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535e21e-69b3-4cff-9e91-e9fddb0dba1a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:12.745741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535e21e-69b3-4cff-9e91-e9fddb0dba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:12.746122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535e21e-69b3-4cff-9e91-e9fddb0dba1a admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:12.747013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535e21e-69b3-4cff-9e91-e9fddb0dba1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:12.747420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535e21e-69b3-4cff-9e91-e9fddb0dba1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:12.749343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535e21e-69b3-4cff-9e91-e9fddb0dba1a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:12.770737 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1894/3815] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:12.773107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f82b86-e70a-4ef1-ab89-07472aec48dc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:12.788742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f82b86-e70a-4ef1-ab89-07472aec48dc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:12.801134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b9a48-e962-4ea9-a548-b7c6cd57df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:12.804389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b9a48-e962-4ea9-a548-b7c6cd57df4b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:12.805415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b9a48-e962-4ea9-a548-b7c6cd57df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:12.808391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b9a48-e962-4ea9-a548-b7c6cd57df4b admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:12.809526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b9a48-e962-4ea9-a548-b7c6cd57df4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:12.817430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b9a48-e962-4ea9-a548-b7c6cd57df4b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:12.882027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535e21e-69b3-4cff-9e91-e9fddb0dba1a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:12.882796 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1922/3816] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:12 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:58:12.896490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535e21e-69b3-4cff-9e91-e9fddb0dba1a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:12.986661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf2fb3-e223-4435-a0f0-ae8a74a44db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:12.987717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf2fb3-e223-4435-a0f0-ae8a74a44db3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:12.988001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf2fb3-e223-4435-a0f0-ae8a74a44db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:12.988275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf2fb3-e223-4435-a0f0-ae8a74a44db3 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:12.989172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf2fb3-e223-4435-a0f0-ae8a74a44db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:12.993081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf2fb3-e223-4435-a0f0-ae8a74a44db3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:13.025249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b9a48-e962-4ea9-a548-b7c6cd57df4b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:13.033498 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1895/3817] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:12 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:58:13.041227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b9a48-e962-4ea9-a548-b7c6cd57df4b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:13.048129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc2ca9-63f1-4c25-bd54-15efdd20ba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:13.048885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc2ca9-63f1-4c25-bd54-15efdd20ba28 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:13.049168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc2ca9-63f1-4c25-bd54-15efdd20ba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:13.049441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc2ca9-63f1-4c25-bd54-15efdd20ba28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:13.050095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc2ca9-63f1-4c25-bd54-15efdd20ba28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:13.052842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc2ca9-63f1-4c25-bd54-15efdd20ba28 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:13.066519 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1923/3818] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:13.070841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf2fb3-e223-4435-a0f0-ae8a74a44db3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:13.085534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf2fb3-e223-4435-a0f0-ae8a74a44db3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:13.092717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7184324-1138-4903-9c8a-eac74a628d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:13.093536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7184324-1138-4903-9c8a-eac74a628d90 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:13.093917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7184324-1138-4903-9c8a-eac74a628d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:13.094297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7184324-1138-4903-9c8a-eac74a628d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:13.095337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7184324-1138-4903-9c8a-eac74a628d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:13.097119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7184324-1138-4903-9c8a-eac74a628d90 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:13.111706 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1896/3819] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:13.115938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc2ca9-63f1-4c25-bd54-15efdd20ba28 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:13.127899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc2ca9-63f1-4c25-bd54-15efdd20ba28 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:13.134198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22727930-bdc0-41f5-8b60-ce07f792b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:13.136042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22727930-bdc0-41f5-8b60-ce07f792b158 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:13.136375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22727930-bdc0-41f5-8b60-ce07f792b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:13.136784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22727930-bdc0-41f5-8b60-ce07f792b158 admin admin] PATH_INFO: `/v3/projects/b8143ca9f2a4487faefef704fd401d52/users/87170f5fdb8e4032af787943f439ee24/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:13.174929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22727930-bdc0-41f5-8b60-ce07f792b158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8143ca9f2a4487faefef704fd401d52, user_id=87170f5fdb8e4032af787943f439ee24, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:13.178398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22727930-bdc0-41f5-8b60-ce07f792b158 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:13.209439 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1924/3820] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:13 2022] PUT /identity/v3/projects/b8143ca9f2a4487faefef704fd401d52/users/87170f5fdb8e4032af787943f439ee24/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:58:13.210489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861be19-2165-4141-be39-fa6e88f69233 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:13.211204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861be19-2165-4141-be39-fa6e88f69233 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:13.211489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861be19-2165-4141-be39-fa6e88f69233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:13.251303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c861be19-2165-4141-be39-fa6e88f69233 None None] MFA Rules not processed for user `87170f5fdb8e4032af787943f439ee24`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:13.253841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c861be19-2165-4141-be39-fa6e88f69233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:13.334579 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:13.355405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22727930-bdc0-41f5-8b60-ce07f792b158 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:13.367666 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1897/3821] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:58:13.443178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22727930-bdc0-41f5-8b60-ce07f792b158 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:13.457481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67480329-09f0-473d-9a87-29871187ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:13.461059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480329-09f0-473d-9a87-29871187ff29 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:13.461468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480329-09f0-473d-9a87-29871187ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:13.461869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480329-09f0-473d-9a87-29871187ff29 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:13.464221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67480329-09f0-473d-9a87-29871187ff29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:13.469625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67480329-09f0-473d-9a87-29871187ff29 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:13.523520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861be19-2165-4141-be39-fa6e88f69233 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:13.525147 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1925/3822] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:13 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:13.567084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861be19-2165-4141-be39-fa6e88f69233 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:13.676823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67480329-09f0-473d-9a87-29871187ff29 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:13.683090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-67480329-09f0-473d-9a87-29871187ff29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:13.809768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0180625-d16c-4ac9-8232-d2941c68a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:13.834362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0180625-d16c-4ac9-8232-d2941c68a2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:13.834651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0180625-d16c-4ac9-8232-d2941c68a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:13.834920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0180625-d16c-4ac9-8232-d2941c68a2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:13.835575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0180625-d16c-4ac9-8232-d2941c68a2c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:13.842071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0180625-d16c-4ac9-8232-d2941c68a2c3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:13.896207 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1898/3823] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:13 2022] POST /identity/v3/users => generated 298 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:13.899354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0180625-d16c-4ac9-8232-d2941c68a2c3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:13.903984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e0180625-d16c-4ac9-8232-d2941c68a2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:13.913816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67480329-09f0-473d-9a87-29871187ff29 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:13.925867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0180625-d16c-4ac9-8232-d2941c68a2c3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:13.932594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:13.933531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:13.933822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:13.934938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] PATH_INFO: `/v3/projects/668c51783a3d486aa6e86990e3e344bb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:13.936065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=668c51783a3d486aa6e86990e3e344bb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:13.938027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:13.939918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:13.941053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:13.941652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:13.943177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] PATH_INFO: `/v3/projects/a75dc7f202174a28b30b6c6746b34796` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:13.945641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75dc7f202174a28b30b6c6746b34796)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:13.951777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:13.969838 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:14.023633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75dc7f202174a28b30b6c6746b34796', 'request_id': 'req-703aa267-e08d-417e-9a75-8655a9d195a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.030117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668c51783a3d486aa6e86990e3e344bb', 'request_id': 'req-f2612d24-f518-46f0-8712-6dd782977134'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.033946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75dc7f202174a28b30b6c6746b34796', 'request_id': 'req-703aa267-e08d-417e-9a75-8655a9d195a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.046437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75dc7f202174a28b30b6c6746b34796', 'request_id': 'req-703aa267-e08d-417e-9a75-8655a9d195a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.053222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668c51783a3d486aa6e86990e3e344bb', 'request_id': 'req-f2612d24-f518-46f0-8712-6dd782977134'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.062277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] The token cache is being invalidate because project a75dc7f202174a28b30b6c6746b34796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:14.062923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.064234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.066562 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1899/3824] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:13 2022] DELETE /identity/v3/projects/a75dc7f202174a28b30b6c6746b34796 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:14.067559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.069962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:14.076412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668c51783a3d486aa6e86990e3e344bb', 'request_id': 'req-f2612d24-f518-46f0-8712-6dd782977134'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.102759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] The token cache is being invalidate because project 668c51783a3d486aa6e86990e3e344bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:14.103060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.104368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f2612d24-f518-46f0-8712-6dd782977134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:14.107572 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1926/3825] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:13 2022] DELETE /identity/v3/projects/668c51783a3d486aa6e86990e3e344bb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:14.112409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791faa9b-11aa-4e66-9de9-39d4d0c53cd9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.112810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791faa9b-11aa-4e66-9de9-39d4d0c53cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.113092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791faa9b-11aa-4e66-9de9-39d4d0c53cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.138944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-791faa9b-11aa-4e66-9de9-39d4d0c53cd9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:14.140506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-791faa9b-11aa-4e66-9de9-39d4d0c53cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:14.184860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703aa267-e08d-417e-9a75-8655a9d195a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.190657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93b728-6203-48da-8799-180cced4cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.191301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b728-6203-48da-8799-180cced4cbfe admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.191578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b728-6203-48da-8799-180cced4cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.191963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b728-6203-48da-8799-180cced4cbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.192652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93b728-6203-48da-8799-180cced4cbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.194475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93b728-6203-48da-8799-180cced4cbfe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.212012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1900/3826] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:14.212012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee04b2-0b6d-4943-bb74-2e7c1964cfa9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.212012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee04b2-0b6d-4943-bb74-2e7c1964cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.212012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee04b2-0b6d-4943-bb74-2e7c1964cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.223422 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:14.237496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-01ee04b2-0b6d-4943-bb74-2e7c1964cfa9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:14.237952 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1927/3827] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:14.239201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791faa9b-11aa-4e66-9de9-39d4d0c53cd9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.242306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-791faa9b-11aa-4e66-9de9-39d4d0c53cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:14.247077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-01ee04b2-0b6d-4943-bb74-2e7c1964cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:14.261044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791faa9b-11aa-4e66-9de9-39d4d0c53cd9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.268312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6ce73-935c-4aad-a790-12e0c563f1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.269593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6ce73-935c-4aad-a790-12e0c563f1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.269593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6ce73-935c-4aad-a790-12e0c563f1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.269891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6ce73-935c-4aad-a790-12e0c563f1d8 admin admin] PATH_INFO: `/v3/projects/4e1ddf6b82bd4ce28bd82ccfb83c1ab4/users/4be181d258254bfc9eb82223ed744d01/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.271928 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1901/3828] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:14.280386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505327ab-fe40-4f91-b27d-840e1907a27f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.280605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505327ab-fe40-4f91-b27d-840e1907a27f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.280882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505327ab-fe40-4f91-b27d-840e1907a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.289888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6ce73-935c-4aad-a790-12e0c563f1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1ddf6b82bd4ce28bd82ccfb83c1ab4, user_id=4be181d258254bfc9eb82223ed744d01, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.293915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6ce73-935c-4aad-a790-12e0c563f1d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.324766 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1928/3829] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:14 2022] PUT /identity/v3/projects/4e1ddf6b82bd4ce28bd82ccfb83c1ab4/users/4be181d258254bfc9eb82223ed744d01/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:14.324766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171337a-a5f6-4b0d-9d4d-f9c8e88c8cc3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.324766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171337a-a5f6-4b0d-9d4d-f9c8e88c8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.324766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171337a-a5f6-4b0d-9d4d-f9c8e88c8cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.328243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-505327ab-fe40-4f91-b27d-840e1907a27f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:14.334992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-505327ab-fe40-4f91-b27d-840e1907a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:14.355854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3171337a-a5f6-4b0d-9d4d-f9c8e88c8cc3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:14.357545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3171337a-a5f6-4b0d-9d4d-f9c8e88c8cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:14.455202 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1902/3830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:14.456116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505327ab-fe40-4f91-b27d-840e1907a27f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.458816 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1929/3831] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:14.464561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171337a-a5f6-4b0d-9d4d-f9c8e88c8cc3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.484719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505327ab-fe40-4f91-b27d-840e1907a27f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.488084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171337a-a5f6-4b0d-9d4d-f9c8e88c8cc3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.497333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6884f-1c77-428a-9695-0e16d46618a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.497972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6884f-1c77-428a-9695-0e16d46618a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.498267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6884f-1c77-428a-9695-0e16d46618a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.499427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6884f-1c77-428a-9695-0e16d46618a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.501823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6884f-1c77-428a-9695-0e16d46618a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.503056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d66ebb-63d4-4745-8da6-dd7368dce7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.504181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d66ebb-63d4-4745-8da6-dd7368dce7ff admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.504466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d66ebb-63d4-4745-8da6-dd7368dce7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.504883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d66ebb-63d4-4745-8da6-dd7368dce7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.505632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d66ebb-63d4-4745-8da6-dd7368dce7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:14.508305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6884f-1c77-428a-9695-0e16d46618a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.512923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d66ebb-63d4-4745-8da6-dd7368dce7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.512923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d66ebb-63d4-4745-8da6-dd7368dce7ff admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.539438 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1903/3832] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:14.540356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6884f-1c77-428a-9695-0e16d46618a8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.554456 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1930/3833] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:14.555425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d66ebb-63d4-4745-8da6-dd7368dce7ff admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.562844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6884f-1c77-428a-9695-0e16d46618a8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.570097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5803-9915-487d-ae10-d973e4b8f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.570974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5803-9915-487d-ae10-d973e4b8f339 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.571329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d66ebb-63d4-4745-8da6-dd7368dce7ff admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.571764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5803-9915-487d-ae10-d973e4b8f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.572383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5803-9915-487d-ae10-d973e4b8f339 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.573352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5803-9915-487d-ae10-d973e4b8f339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:14.574023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5803-9915-487d-ae10-d973e4b8f339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.576895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5803-9915-487d-ae10-d973e4b8f339 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.579763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef12c9c-26a2-4a71-9c56-1b1541b60ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.580446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef12c9c-26a2-4a71-9c56-1b1541b60ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.580765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef12c9c-26a2-4a71-9c56-1b1541b60ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.581046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef12c9c-26a2-4a71-9c56-1b1541b60ee2 admin admin] PATH_INFO: `/v3/projects/4e1ddf6b82bd4ce28bd82ccfb83c1ab4/users/4be181d258254bfc9eb82223ed744d01/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.586861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef12c9c-26a2-4a71-9c56-1b1541b60ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1ddf6b82bd4ce28bd82ccfb83c1ab4, user_id=4be181d258254bfc9eb82223ed744d01, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.590649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef12c9c-26a2-4a71-9c56-1b1541b60ee2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.594228 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:14.601136 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1904/3834] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:14.602318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5803-9915-487d-ae10-d973e4b8f339 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.616146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5803-9915-487d-ae10-d973e4b8f339 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.620666 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1931/3835] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:14 2022] PUT /identity/v3/projects/4e1ddf6b82bd4ce28bd82ccfb83c1ab4/users/4be181d258254bfc9eb82223ed744d01/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:14.621875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef12c9c-26a2-4a71-9c56-1b1541b60ee2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.689748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ad425-ed99-4956-b899-89d66889c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.690367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ad425-ed99-4956-b899-89d66889c72b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.691108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ad425-ed99-4956-b899-89d66889c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.691230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ad425-ed99-4956-b899-89d66889c72b admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.691914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ad425-ed99-4956-b899-89d66889c72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.694011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ad425-ed99-4956-b899-89d66889c72b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.703881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef12c9c-26a2-4a71-9c56-1b1541b60ee2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.709540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2e108-f71a-45c8-849b-e0b4017b3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.710302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2e108-f71a-45c8-849b-e0b4017b3ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.711020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2e108-f71a-45c8-849b-e0b4017b3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.711020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2e108-f71a-45c8-849b-e0b4017b3ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.711773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2e108-f71a-45c8-849b-e0b4017b3ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.714323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2e108-f71a-45c8-849b-e0b4017b3ba6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.733362 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1905/3836] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:14 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:14.733362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4f45-aa21-4236-af97-ae257ed17fda None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.733362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4f45-aa21-4236-af97-ae257ed17fda None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.733362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4f45-aa21-4236-af97-ae257ed17fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.751563 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1932/3837] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:14 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:14.753255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2e108-f71a-45c8-849b-e0b4017b3ba6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.764861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5c2f4f45-aa21-4236-af97-ae257ed17fda None None] MFA Rules not processed for user `4be181d258254bfc9eb82223ed744d01`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:14.767296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5c2f4f45-aa21-4236-af97-ae257ed17fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:14.832590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2e108-f71a-45c8-849b-e0b4017b3ba6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.834795 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:14.839065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3badbc-fa24-4f26-b1a4-d1004a3d04ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.839756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3badbc-fa24-4f26-b1a4-d1004a3d04ef admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.840171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3badbc-fa24-4f26-b1a4-d1004a3d04ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.840455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3badbc-fa24-4f26-b1a4-d1004a3d04ef admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.842598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3badbc-fa24-4f26-b1a4-d1004a3d04ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.843865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3badbc-fa24-4f26-b1a4-d1004a3d04ef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.874937 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1906/3838] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:14.876868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4f45-aa21-4236-af97-ae257ed17fda None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.884589 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1933/3839] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:14 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:14.884589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3badbc-fa24-4f26-b1a4-d1004a3d04ef admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.885819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7f3badbc-fa24-4f26-b1a4-d1004a3d04ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:14.892562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4f45-aa21-4236-af97-ae257ed17fda None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.899045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39acff2-7efd-4f26-8b87-472352cade80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.899673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39acff2-7efd-4f26-8b87-472352cade80 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.899949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39acff2-7efd-4f26-8b87-472352cade80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.900271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39acff2-7efd-4f26-8b87-472352cade80 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.901540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39acff2-7efd-4f26-8b87-472352cade80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.904018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39acff2-7efd-4f26-8b87-472352cade80 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.945365 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1907/3840] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:14 2022] POST /identity/v3/users => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:14.946343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39acff2-7efd-4f26-8b87-472352cade80 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:14.970622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39acff2-7efd-4f26-8b87-472352cade80 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.978186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88053f28-6675-4398-a775-ef1845827113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.980581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88053f28-6675-4398-a775-ef1845827113 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.980894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88053f28-6675-4398-a775-ef1845827113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.981281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88053f28-6675-4398-a775-ef1845827113 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:14.982107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88053f28-6675-4398-a775-ef1845827113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:14.983808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88053f28-6675-4398-a775-ef1845827113 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:14.992140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3badbc-fa24-4f26-b1a4-d1004a3d04ef admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:14.996798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb2200-e0ad-49f4-bd5a-e0e5228d87f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:14.997423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb2200-e0ad-49f4-bd5a-e0e5228d87f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:14.997708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb2200-e0ad-49f4-bd5a-e0e5228d87f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:14.997987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb2200-e0ad-49f4-bd5a-e0e5228d87f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.004607 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1908/3841] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:15.004607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88053f28-6675-4398-a775-ef1845827113 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:15.014713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb2200-e0ad-49f4-bd5a-e0e5228d87f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:15.016740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb2200-e0ad-49f4-bd5a-e0e5228d87f8 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:15.031964 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1934/3842] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:15.033087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb2200-e0ad-49f4-bd5a-e0e5228d87f8 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:15.035695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88053f28-6675-4398-a775-ef1845827113 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:15.047723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffd863-d3f3-48ad-85b1-41b013eb39e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:15.048474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffd863-d3f3-48ad-85b1-41b013eb39e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:15.048892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffd863-d3f3-48ad-85b1-41b013eb39e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:15.049254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffd863-d3f3-48ad-85b1-41b013eb39e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.050033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffd863-d3f3-48ad-85b1-41b013eb39e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:15.051896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffd863-d3f3-48ad-85b1-41b013eb39e8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:15.061081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb2200-e0ad-49f4-bd5a-e0e5228d87f8 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:15.069653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3b79-a9f6-4b61-b722-c605ab532b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:15.069936 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1909/3843] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:15.070870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3b79-a9f6-4b61-b722-c605ab532b7b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:15.073541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffd863-d3f3-48ad-85b1-41b013eb39e8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:15.075331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3b79-a9f6-4b61-b722-c605ab532b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:15.076432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3b79-a9f6-4b61-b722-c605ab532b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.077586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3b79-a9f6-4b61-b722-c605ab532b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:15.079734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3b79-a9f6-4b61-b722-c605ab532b7b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:15.096564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffd863-d3f3-48ad-85b1-41b013eb39e8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:15.099316 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1935/3844] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:15.103259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3b79-a9f6-4b61-b722-c605ab532b7b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:15.110136 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:15.116098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3b79-a9f6-4b61-b722-c605ab532b7b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:15.125550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fba227-86f1-4dd7-ab83-5021b1de2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:15.126224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fba227-86f1-4dd7-ab83-5021b1de2f6b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:15.126514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fba227-86f1-4dd7-ab83-5021b1de2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:15.126845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fba227-86f1-4dd7-ab83-5021b1de2f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.127708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7178ef-f2b0-4097-864d-3b75ee789ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:15.128819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7178ef-f2b0-4097-864d-3b75ee789ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:15.129851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7178ef-f2b0-4097-864d-3b75ee789ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:15.130024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7178ef-f2b0-4097-864d-3b75ee789ec1 admin admin] PATH_INFO: `/v3/projects/79865e2b6dee484490d79e63e371a25d/users/86d615989bfa4ef493b1f3462e6a7809/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.139078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fba227-86f1-4dd7-ab83-5021b1de2f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:15.140808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fba227-86f1-4dd7-ab83-5021b1de2f6b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:15.150070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7178ef-f2b0-4097-864d-3b75ee789ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79865e2b6dee484490d79e63e371a25d, user_id=86d615989bfa4ef493b1f3462e6a7809, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:15.154683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7178ef-f2b0-4097-864d-3b75ee789ec1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:15.164643 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1910/3845] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:15.166012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fba227-86f1-4dd7-ab83-5021b1de2f6b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:15.184089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fba227-86f1-4dd7-ab83-5021b1de2f6b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:15.201943 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1936/3846] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:15 2022] PUT /identity/v3/projects/79865e2b6dee484490d79e63e371a25d/users/86d615989bfa4ef493b1f3462e6a7809/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:58:15.207960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45aefa-8408-42c2-a62a-88572b9093b0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:15.207960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45aefa-8408-42c2-a62a-88572b9093b0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:15.208158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45aefa-8408-42c2-a62a-88572b9093b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.279806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2b45aefa-8408-42c2-a62a-88572b9093b0 None None] MFA Rules not processed for user `86d615989bfa4ef493b1f3462e6a7809`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:15.281223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2b45aefa-8408-42c2-a62a-88572b9093b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:15.305288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d824537-afcd-4782-bae9-e6de2663d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:15.306293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d824537-afcd-4782-bae9-e6de2663d9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:15.309642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d824537-afcd-4782-bae9-e6de2663d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:15.310129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d824537-afcd-4782-bae9-e6de2663d9d1 admin admin] PATH_INFO: `/v3/projects/daa2d47392564feabc36c67f7382cddf/users/098f448796ff4635ac6b4b7262bf6ff1/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.358284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d824537-afcd-4782-bae9-e6de2663d9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa2d47392564feabc36c67f7382cddf, user_id=098f448796ff4635ac6b4b7262bf6ff1, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:15.363751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d824537-afcd-4782-bae9-e6de2663d9d1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:15.398121 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1911/3847] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:15 2022] PUT /identity/v3/projects/daa2d47392564feabc36c67f7382cddf/users/098f448796ff4635ac6b4b7262bf6ff1/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:15.398507 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1937/3848] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:15.409405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0e30a-609c-4529-9804-0869decd696f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:15.409850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0e30a-609c-4529-9804-0869decd696f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:15.411945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0e30a-609c-4529-9804-0869decd696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.422204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45aefa-8408-42c2-a62a-88572b9093b0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:15.468761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7db0e30a-609c-4529-9804-0869decd696f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:15.470939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7db0e30a-609c-4529-9804-0869decd696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:15.521168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45aefa-8408-42c2-a62a-88572b9093b0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:15.572146 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1912/3849] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:15.580564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0e30a-609c-4529-9804-0869decd696f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:15.607979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549a5b2-a84f-46d1-929a-7477f620db25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:15.608348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549a5b2-a84f-46d1-929a-7477f620db25 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:15.608669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549a5b2-a84f-46d1-929a-7477f620db25 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:15.608966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549a5b2-a84f-46d1-929a-7477f620db25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.627398 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:15.675687 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:15.701084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0e30a-609c-4529-9804-0869decd696f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:15.705722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549a5b2-a84f-46d1-929a-7477f620db25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:15.706932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6b239-6f90-4b6b-ac54-5361122b6c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:15.707176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549a5b2-a84f-46d1-929a-7477f620db25 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:15.707810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6b239-6f90-4b6b-ac54-5361122b6c1e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:15.708267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6b239-6f90-4b6b-ac54-5361122b6c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:15.708565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6b239-6f90-4b6b-ac54-5361122b6c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:15.718797 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1938/3850] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:58:15.721137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6b239-6f90-4b6b-ac54-5361122b6c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:15.723046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6b239-6f90-4b6b-ac54-5361122b6c1e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:15.740048 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1913/3851] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:17.775284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549a5b2-a84f-46d1-929a-7477f620db25 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:17.777120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4549a5b2-a84f-46d1-929a-7477f620db25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:17.797651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549a5b2-a84f-46d1-929a-7477f620db25 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:17.804403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:17.805469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:17.806722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:17.808609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] PATH_INFO: `/v3/users/5decad27fffe49b99ef87c8e388b6df1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:17.810090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5decad27fffe49b99ef87c8e388b6df1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:17.812413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:17.873385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5decad27fffe49b99ef87c8e388b6df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:17.891332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5decad27fffe49b99ef87c8e388b6df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:17.901409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5decad27fffe49b99ef87c8e388b6df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:17.910588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5decad27fffe49b99ef87c8e388b6df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:17.911375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5decad27fffe49b99ef87c8e388b6df1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:17.920808 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1939/3852] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:17 2022] DELETE /identity/v3/users/5decad27fffe49b99ef87c8e388b6df1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:17.925237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebced0d-9b40-474a-9566-b70c52528b2d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:17.925755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebced0d-9b40-474a-9566-b70c52528b2d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:17.925841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebced0d-9b40-474a-9566-b70c52528b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:17.955546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9ebced0d-9b40-474a-9566-b70c52528b2d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:17.956858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9ebced0d-9b40-474a-9566-b70c52528b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:18.033709 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1914/3853] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:18.123549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:18.125175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:18.201159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd06bf-0836-4f30-8e5c-c2b65284e3c7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:18.206865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58f39f-d1ce-4212-ac42-45f166e7fea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:18.207321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58f39f-d1ce-4212-ac42-45f166e7fea0 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:18.207960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58f39f-d1ce-4212-ac42-45f166e7fea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:18.208096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58f39f-d1ce-4212-ac42-45f166e7fea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:18.221384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58f39f-d1ce-4212-ac42-45f166e7fea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:18.223023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58f39f-d1ce-4212-ac42-45f166e7fea0 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:18.235409 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1940/3854] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:19.284548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebced0d-9b40-474a-9566-b70c52528b2d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:19.287554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9ebced0d-9b40-474a-9566-b70c52528b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:19.316463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebced0d-9b40-474a-9566-b70c52528b2d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:19.338331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:19.339007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:19.339287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:19.339562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] PATH_INFO: `/v3/users/87170f5fdb8e4032af787943f439ee24` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:19.342417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87170f5fdb8e4032af787943f439ee24)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:19.345529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:19.445013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87170f5fdb8e4032af787943f439ee24'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:19.474144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87170f5fdb8e4032af787943f439ee24'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:19.495489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87170f5fdb8e4032af787943f439ee24'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:19.517755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87170f5fdb8e4032af787943f439ee24'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:19.518358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87170f5fdb8e4032af787943f439ee24'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:19.525414 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1915/3855] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:19 2022] DELETE /identity/v3/users/87170f5fdb8e4032af787943f439ee24 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:19.530172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4005c-154a-41bc-8830-270a0c9d5a29 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:19.531292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4005c-154a-41bc-8830-270a0c9d5a29 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:19.531888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4005c-154a-41bc-8830-270a0c9d5a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:19.570619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-55f4005c-154a-41bc-8830-270a0c9d5a29 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:19.571889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-55f4005c-154a-41bc-8830-270a0c9d5a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:19.676766 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:19.701090 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1941/3856] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:19.742279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:19.743828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:19.825681 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:19.875581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e38f3-94cd-4c90-9d92-8995a154ace3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:19.882425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7f128-25f5-4bf0-b498-4f10f99246ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:19.883353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7f128-25f5-4bf0-b498-4f10f99246ad service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:19.883353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7f128-25f5-4bf0-b498-4f10f99246ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:19.883659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7f128-25f5-4bf0-b498-4f10f99246ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:19.914069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7f128-25f5-4bf0-b498-4f10f99246ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:19.915621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7f128-25f5-4bf0-b498-4f10f99246ad service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:19.935833 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1916/3857] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:20.801360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4005c-154a-41bc-8830-270a0c9d5a29 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:20.803618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-55f4005c-154a-41bc-8830-270a0c9d5a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:20.828283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4005c-154a-41bc-8830-270a0c9d5a29 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:20.837909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:20.839312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:20.839588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:20.840192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] PATH_INFO: `/v3/projects/fe7daea1c94340fcb98a3831cd74655f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:20.841834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7daea1c94340fcb98a3831cd74655f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:20.843805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:21.037388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7daea1c94340fcb98a3831cd74655f', 'request_id': 'req-17afb871-a113-451f-a030-f08eecf8ecbb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.060435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7daea1c94340fcb98a3831cd74655f', 'request_id': 'req-17afb871-a113-451f-a030-f08eecf8ecbb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.078602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7f128-25f5-4bf0-b498-4f10f99246ad service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:21.094909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-46e7f128-25f5-4bf0-b498-4f10f99246ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:21.100768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7daea1c94340fcb98a3831cd74655f', 'request_id': 'req-17afb871-a113-451f-a030-f08eecf8ecbb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.136749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7f128-25f5-4bf0-b498-4f10f99246ad service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:21.141578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] The token cache is being invalidate because project fe7daea1c94340fcb98a3831cd74655f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:21.148382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.151758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.155912 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1942/3858] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:20 2022] DELETE /identity/v3/projects/fe7daea1c94340fcb98a3831cd74655f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:21.160139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:21.165392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:21.290558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:21.292420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:21.292843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:21.293253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] PATH_INFO: `/v3/projects/b8143ca9f2a4487faefef704fd401d52` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:21.294668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8143ca9f2a4487faefef704fd401d52)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:21.299663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:21.368905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afb871-a113-451f-a030-f08eecf8ecbb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:21.378156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:21.379303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:21.379760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:21.380210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] PATH_INFO: `/v3/users/a5991f9a3e9846f497d42e9124ca0524` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:21.381763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5991f9a3e9846f497d42e9124ca0524)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:21.390164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:21.447072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8143ca9f2a4487faefef704fd401d52', 'request_id': 'req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.466161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8143ca9f2a4487faefef704fd401d52', 'request_id': 'req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.488252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8143ca9f2a4487faefef704fd401d52', 'request_id': 'req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.490968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5991f9a3e9846f497d42e9124ca0524'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.527390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5991f9a3e9846f497d42e9124ca0524'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.530779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] The token cache is being invalidate because project b8143ca9f2a4487faefef704fd401d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:21.531994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.533051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.537441 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1917/3859] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:21 2022] DELETE /identity/v3/projects/b8143ca9f2a4487faefef704fd401d52 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:21.541887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:21.551751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:21.554337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5991f9a3e9846f497d42e9124ca0524'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.568839 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:21.578816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5991f9a3e9846f497d42e9124ca0524'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.581582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5991f9a3e9846f497d42e9124ca0524'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:21.596011 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1943/3860] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:21 2022] DELETE /identity/v3/users/a5991f9a3e9846f497d42e9124ca0524 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:21.700829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efcee1-6d9c-442a-bf7d-0f5f068bd83f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:21.726639 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:21.916001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:21.917029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:21.917611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:21.918063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] PATH_INFO: `/v3/users/4be181d258254bfc9eb82223ed744d01` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:21.919758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be181d258254bfc9eb82223ed744d01)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:21.922038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:22.008445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be181d258254bfc9eb82223ed744d01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:22.052854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be181d258254bfc9eb82223ed744d01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:22.065544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be181d258254bfc9eb82223ed744d01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:22.095451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be181d258254bfc9eb82223ed744d01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:22.097065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be181d258254bfc9eb82223ed744d01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:22.105984 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1918/3861] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:21 2022] DELETE /identity/v3/users/4be181d258254bfc9eb82223ed744d01 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:23.099324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:23.100856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:23.120754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3746d-138c-4bb9-92e0-e3a3b0d7483b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:23.262156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:23.264557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:23.281775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:23.282819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.283312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.285993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] PATH_INFO: `/v3/projects/4e1ddf6b82bd4ce28bd82ccfb83c1ab4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.287874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1ddf6b82bd4ce28bd82ccfb83c1ab4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:23.290457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:23.390611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1ddf6b82bd4ce28bd82ccfb83c1ab4', 'request_id': 'req-e2350a4a-bb4d-4c49-b85c-1930999da073'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.401467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1ddf6b82bd4ce28bd82ccfb83c1ab4', 'request_id': 'req-e2350a4a-bb4d-4c49-b85c-1930999da073'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.413109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1ddf6b82bd4ce28bd82ccfb83c1ab4', 'request_id': 'req-e2350a4a-bb4d-4c49-b85c-1930999da073'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.416940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f783cd-2a2f-416a-8b01-33ee53e9495f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:23.431168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] The token cache is being invalidate because project 4e1ddf6b82bd4ce28bd82ccfb83c1ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:23.432797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.433642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e2350a4a-bb4d-4c49-b85c-1930999da073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.435757 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1944/3862] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:23 2022] DELETE /identity/v3/projects/4e1ddf6b82bd4ce28bd82ccfb83c1ab4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:23.440777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ceb19-df77-4da0-a59f-9929b29bdb1c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.441597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ceb19-df77-4da0-a59f-9929b29bdb1c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.442247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ceb19-df77-4da0-a59f-9929b29bdb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.474135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1b7ceb19-df77-4da0-a59f-9929b29bdb1c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:23.475600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b7ceb19-df77-4da0-a59f-9929b29bdb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:23.504464 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:23.537809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:23.538789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.539296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.539763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] PATH_INFO: `/v3/projects/1b500edbf67b4bb1addd637d78d6331a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.542658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b500edbf67b4bb1addd637d78d6331a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:23.546861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:23.577214 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1945/3863] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:23.586932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1ecd-f2bd-4e7f-bfa4-8c2556b4fdcd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.586932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1ecd-f2bd-4e7f-bfa4-8c2556b4fdcd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.586932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1ecd-f2bd-4e7f-bfa4-8c2556b4fdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.614525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-643d1ecd-f2bd-4e7f-bfa4-8c2556b4fdcd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:23.615825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-643d1ecd-f2bd-4e7f-bfa4-8c2556b4fdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:23.644340 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:23.660243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b500edbf67b4bb1addd637d78d6331a', 'request_id': 'req-08519bad-1647-4254-ba1e-c1ae205b4f9f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.676741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b500edbf67b4bb1addd637d78d6331a', 'request_id': 'req-08519bad-1647-4254-ba1e-c1ae205b4f9f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.691599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b500edbf67b4bb1addd637d78d6331a', 'request_id': 'req-08519bad-1647-4254-ba1e-c1ae205b4f9f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.711895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] The token cache is being invalidate because project 1b500edbf67b4bb1addd637d78d6331a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:23.712256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.713635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08519bad-1647-4254-ba1e-c1ae205b4f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:23.716106 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1919/3864] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:23 2022] DELETE /identity/v3/projects/1b500edbf67b4bb1addd637d78d6331a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:23.721876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc79bed-ed33-43b6-8f14-620471c3f41a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.722451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc79bed-ed33-43b6-8f14-620471c3f41a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.722814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc79bed-ed33-43b6-8f14-620471c3f41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.747935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cdc79bed-ed33-43b6-8f14-620471c3f41a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:23.749619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cdc79bed-ed33-43b6-8f14-620471c3f41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:23.760267 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1946/3865] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:23.764868 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1920/3866] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:58:23.765933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc79bed-ed33-43b6-8f14-620471c3f41a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:23.766102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71769f3a-5e74-4bcd-a49b-c7ffe307d712 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.766397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71769f3a-5e74-4bcd-a49b-c7ffe307d712 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.767089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71769f3a-5e74-4bcd-a49b-c7ffe307d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.781401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc79bed-ed33-43b6-8f14-620471c3f41a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:23.793022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50276c-a639-4e67-bb2c-64453511e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:23.793786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50276c-a639-4e67-bb2c-64453511e6db admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.794163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50276c-a639-4e67-bb2c-64453511e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.794535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50276c-a639-4e67-bb2c-64453511e6db admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.795293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50276c-a639-4e67-bb2c-64453511e6db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:23.795854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50276c-a639-4e67-bb2c-64453511e6db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:23.796959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-71769f3a-5e74-4bcd-a49b-c7ffe307d712 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:23.798107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50276c-a639-4e67-bb2c-64453511e6db admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:23.798252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-71769f3a-5e74-4bcd-a49b-c7ffe307d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:23.817080 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1921/3867] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:23.818224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50276c-a639-4e67-bb2c-64453511e6db admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:23.831222 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1947/3868] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:23.835894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71769f3a-5e74-4bcd-a49b-c7ffe307d712 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:23.850122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50276c-a639-4e67-bb2c-64453511e6db admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:23.850875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71769f3a-5e74-4bcd-a49b-c7ffe307d712 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:23.858852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3de59b-5d17-45e3-b111-7563784fe265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:23.859690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3de59b-5d17-45e3-b111-7563784fe265 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.860236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3de59b-5d17-45e3-b111-7563784fe265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.860522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3de59b-5d17-45e3-b111-7563784fe265 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.860762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e83fb-df30-4b5c-963a-ecc70412510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:23.861596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3de59b-5d17-45e3-b111-7563784fe265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:23.861729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e83fb-df30-4b5c-963a-ecc70412510e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.861839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3de59b-5d17-45e3-b111-7563784fe265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:23.861937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e83fb-df30-4b5c-963a-ecc70412510e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.861937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e83fb-df30-4b5c-963a-ecc70412510e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.862717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e83fb-df30-4b5c-963a-ecc70412510e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:23.863109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3de59b-5d17-45e3-b111-7563784fe265 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:23.864745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e83fb-df30-4b5c-963a-ecc70412510e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:23.881263 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1948/3869] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:23.886296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3de59b-5d17-45e3-b111-7563784fe265 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:23.908667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3de59b-5d17-45e3-b111-7563784fe265 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:23.918265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cb9ff-e699-473f-8a42-c07d3c9d66c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:23.919500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cb9ff-e699-473f-8a42-c07d3c9d66c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:23.919874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cb9ff-e699-473f-8a42-c07d3c9d66c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:23.920205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cb9ff-e699-473f-8a42-c07d3c9d66c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:23.921071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cb9ff-e699-473f-8a42-c07d3c9d66c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:23.924408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cb9ff-e699-473f-8a42-c07d3c9d66c7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:23.937879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1922/3870] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:23 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:23.939735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e83fb-df30-4b5c-963a-ecc70412510e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:23.973141 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1949/3871] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:23 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:58:23.977933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cb9ff-e699-473f-8a42-c07d3c9d66c7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:24.071970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e83fb-df30-4b5c-963a-ecc70412510e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:24.073078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cb9ff-e699-473f-8a42-c07d3c9d66c7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:24.079832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7e87-050e-43a1-b901-962a261a0762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:24.080043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e48a7-b831-43f6-bdc9-43dab03a0ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:24.080484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e48a7-b831-43f6-bdc9-43dab03a0ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.080638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7e87-050e-43a1-b901-962a261a0762 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.080806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e48a7-b831-43f6-bdc9-43dab03a0ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.080937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7e87-050e-43a1-b901-962a261a0762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.081086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e48a7-b831-43f6-bdc9-43dab03a0ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.081205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7e87-050e-43a1-b901-962a261a0762 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.081729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e48a7-b831-43f6-bdc9-43dab03a0ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:24.081948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab7e87-050e-43a1-b901-962a261a0762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:24.083745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e48a7-b831-43f6-bdc9-43dab03a0ed8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:24.083982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab7e87-050e-43a1-b901-962a261a0762 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:24.114030 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1950/3872] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:23 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:24.118413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7e87-050e-43a1-b901-962a261a0762 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:24.132730 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1923/3873] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:23 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:58:24.134019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7e87-050e-43a1-b901-962a261a0762 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:24.137911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e48a7-b831-43f6-bdc9-43dab03a0ed8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:24.145810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecbc9b-a3b0-412b-ab44-2c47139739a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:24.146753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecbc9b-a3b0-412b-ab44-2c47139739a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.146877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecbc9b-a3b0-412b-ab44-2c47139739a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.148531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecbc9b-a3b0-412b-ab44-2c47139739a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.149266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecbc9b-a3b0-412b-ab44-2c47139739a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:24.158710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecbc9b-a3b0-412b-ab44-2c47139739a8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:24.175064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e48a7-b831-43f6-bdc9-43dab03a0ed8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:24.190632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491de223-ad5f-400c-9a04-26cba9921436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:24.192363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491de223-ad5f-400c-9a04-26cba9921436 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.192661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491de223-ad5f-400c-9a04-26cba9921436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.194221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491de223-ad5f-400c-9a04-26cba9921436 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.194895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491de223-ad5f-400c-9a04-26cba9921436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:24.199776 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1951/3874] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:24.199992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491de223-ad5f-400c-9a04-26cba9921436 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:24.201390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecbc9b-a3b0-412b-ab44-2c47139739a8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:24.226957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecbc9b-a3b0-412b-ab44-2c47139739a8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:24.227968 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1924/3875] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:24.234646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491de223-ad5f-400c-9a04-26cba9921436 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:24.242815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc9914-8544-4e04-b676-32e70aef6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:24.243669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc9914-8544-4e04-b676-32e70aef6df8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.245732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc9914-8544-4e04-b676-32e70aef6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.246069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc9914-8544-4e04-b676-32e70aef6df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.247621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491de223-ad5f-400c-9a04-26cba9921436 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:24.251864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc9914-8544-4e04-b676-32e70aef6df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:24.253767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e70da9-a9ed-4384-ad0a-ad45f7eaa685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:24.253952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc9914-8544-4e04-b676-32e70aef6df8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:24.254392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e70da9-a9ed-4384-ad0a-ad45f7eaa685 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.254724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e70da9-a9ed-4384-ad0a-ad45f7eaa685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.255428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e70da9-a9ed-4384-ad0a-ad45f7eaa685 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.256080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e70da9-a9ed-4384-ad0a-ad45f7eaa685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:24.257940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e70da9-a9ed-4384-ad0a-ad45f7eaa685 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:24.260776 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:24.275032 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1952/3876] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:24.279405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc9914-8544-4e04-b676-32e70aef6df8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:24.285215 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1925/3877] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:24.289565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e70da9-a9ed-4384-ad0a-ad45f7eaa685 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:24.305895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e70da9-a9ed-4384-ad0a-ad45f7eaa685 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:24.309821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc9914-8544-4e04-b676-32e70aef6df8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:24.313605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19938c23-09fa-4fe7-8fc4-32f791ba07a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:24.315022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19938c23-09fa-4fe7-8fc4-32f791ba07a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.315454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19938c23-09fa-4fe7-8fc4-32f791ba07a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.315868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19938c23-09fa-4fe7-8fc4-32f791ba07a8 admin admin] PATH_INFO: `/v3/projects/6dbd052dda60474caebf01c54c099b67/users/caf21602e8cc481fa53464cd81619bd8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.335095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19938c23-09fa-4fe7-8fc4-32f791ba07a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbd052dda60474caebf01c54c099b67, user_id=caf21602e8cc481fa53464cd81619bd8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:24.335637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde9ab-b32a-4764-bb7e-e5974334398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:24.336339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde9ab-b32a-4764-bb7e-e5974334398d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.336650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde9ab-b32a-4764-bb7e-e5974334398d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.339164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde9ab-b32a-4764-bb7e-e5974334398d admin admin] PATH_INFO: `/v3/projects/413a1c08324d4c1d8829fe25c1f15c09/users/d1f94c167c854cffb1ef9c36a278620d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.339855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19938c23-09fa-4fe7-8fc4-32f791ba07a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:24.367047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde9ab-b32a-4764-bb7e-e5974334398d admin admin] RBAC: Authorizing `identity:create_grant(project_id=413a1c08324d4c1d8829fe25c1f15c09, user_id=d1f94c167c854cffb1ef9c36a278620d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:24.371421 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1926/3878] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:24 2022] PUT /identity/v3/projects/6dbd052dda60474caebf01c54c099b67/users/caf21602e8cc481fa53464cd81619bd8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:24.385059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde9ab-b32a-4764-bb7e-e5974334398d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:24.388608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847962f8-f230-4272-872f-aebfcecc9169 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.388888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847962f8-f230-4272-872f-aebfcecc9169 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.389240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847962f8-f230-4272-872f-aebfcecc9169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.425986 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1953/3879] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:24 2022] PUT /identity/v3/projects/413a1c08324d4c1d8829fe25c1f15c09/users/d1f94c167c854cffb1ef9c36a278620d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:24.455610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e429f9b-767d-417d-83ad-5abf7bed409d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.456332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e429f9b-767d-417d-83ad-5abf7bed409d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.456756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e429f9b-767d-417d-83ad-5abf7bed409d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.476943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-847962f8-f230-4272-872f-aebfcecc9169 None None] MFA Rules not processed for user `caf21602e8cc481fa53464cd81619bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:24.480735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-847962f8-f230-4272-872f-aebfcecc9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:24.532393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9e429f9b-767d-417d-83ad-5abf7bed409d None None] MFA Rules not processed for user `d1f94c167c854cffb1ef9c36a278620d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:24.536853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9e429f9b-767d-417d-83ad-5abf7bed409d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:24.587592 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:24.668182 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1927/3880] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:24.704052 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1954/3881] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:58:24.708871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847962f8-f230-4272-872f-aebfcecc9169 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:24.849604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847962f8-f230-4272-872f-aebfcecc9169 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:24.856557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5855dc2-7664-4f04-ba3c-a33f1e20910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:24.857385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5855dc2-7664-4f04-ba3c-a33f1e20910c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:24.857816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5855dc2-7664-4f04-ba3c-a33f1e20910c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:24.858230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5855dc2-7664-4f04-ba3c-a33f1e20910c admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:24.859511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5855dc2-7664-4f04-ba3c-a33f1e20910c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:24.863839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5855dc2-7664-4f04-ba3c-a33f1e20910c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:24.932672 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1928/3882] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:24 2022] POST /identity/v3/projects => generated 393 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:24.934063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e429f9b-767d-417d-83ad-5abf7bed409d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:24.951248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e429f9b-767d-417d-83ad-5abf7bed409d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:25.095667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53092534-36d4-46ed-af93-4d649617a078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:25.096448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53092534-36d4-46ed-af93-4d649617a078 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:25.096869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53092534-36d4-46ed-af93-4d649617a078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:25.097271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53092534-36d4-46ed-af93-4d649617a078 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:25.098026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53092534-36d4-46ed-af93-4d649617a078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:25.101690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53092534-36d4-46ed-af93-4d649617a078 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:25.159767 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1955/3883] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:24 2022] POST /identity/v3/users => generated 303 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:25.163908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5855dc2-7664-4f04-ba3c-a33f1e20910c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:25.179770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5855dc2-7664-4f04-ba3c-a33f1e20910c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:25.188044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daaa97-ce60-4034-9001-397fbfcd68c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:25.189896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daaa97-ce60-4034-9001-397fbfcd68c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:25.190340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daaa97-ce60-4034-9001-397fbfcd68c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:25.190799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daaa97-ce60-4034-9001-397fbfcd68c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:25.191610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daaa97-ce60-4034-9001-397fbfcd68c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:25.193532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daaa97-ce60-4034-9001-397fbfcd68c0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:25.210115 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1929/3884] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:25.214504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53092534-36d4-46ed-af93-4d649617a078 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:25.228288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53092534-36d4-46ed-af93-4d649617a078 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:25.234904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd142539-f10e-4a89-9a19-16ed5ba78bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:25.236588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd142539-f10e-4a89-9a19-16ed5ba78bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:25.237074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd142539-f10e-4a89-9a19-16ed5ba78bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:25.237957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd142539-f10e-4a89-9a19-16ed5ba78bf0 admin admin] PATH_INFO: `/v3/projects/aeb5e6dd8d6c46fab43fa07fa48cd99c/users/59b1d506d2414984abe362472df8bcc2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:25.265884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd142539-f10e-4a89-9a19-16ed5ba78bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb5e6dd8d6c46fab43fa07fa48cd99c, user_id=59b1d506d2414984abe362472df8bcc2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:25.270529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd142539-f10e-4a89-9a19-16ed5ba78bf0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:25.290508 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1956/3885] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:25 2022] PUT /identity/v3/projects/aeb5e6dd8d6c46fab43fa07fa48cd99c/users/59b1d506d2414984abe362472df8bcc2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:25.294627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daaa97-ce60-4034-9001-397fbfcd68c0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:25.310961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daaa97-ce60-4034-9001-397fbfcd68c0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:25.371345 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:25.387689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd142539-f10e-4a89-9a19-16ed5ba78bf0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:25.390373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bd142539-f10e-4a89-9a19-16ed5ba78bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:25.460011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4ac7f-2d5b-4111-b4bc-6740e6a40fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:25.460676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4ac7f-2d5b-4111-b4bc-6740e6a40fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:25.461016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4ac7f-2d5b-4111-b4bc-6740e6a40fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:25.461884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4ac7f-2d5b-4111-b4bc-6740e6a40fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:25.462131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4ac7f-2d5b-4111-b4bc-6740e6a40fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:25.465496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4ac7f-2d5b-4111-b4bc-6740e6a40fb1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:25.482994 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1930/3886] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:25.482994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ab5d-44f0-4394-97e7-43facd63fcc3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:25.482994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ab5d-44f0-4394-97e7-43facd63fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:25.482994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ab5d-44f0-4394-97e7-43facd63fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:25.546870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bdc6ab5d-44f0-4394-97e7-43facd63fcc3 None None] MFA Rules not processed for user `2190bd30671b47048aed416f9c14a545`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:25.550265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bdc6ab5d-44f0-4394-97e7-43facd63fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:25.595914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd142539-f10e-4a89-9a19-16ed5ba78bf0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:25.612214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cfad7-16ac-444b-a861-1728e6f68a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:25.616008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cfad7-16ac-444b-a861-1728e6f68a34 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:25.616510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cfad7-16ac-444b-a861-1728e6f68a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:25.616966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cfad7-16ac-444b-a861-1728e6f68a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:25.690411 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1931/3887] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:25.691653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ab5d-44f0-4394-97e7-43facd63fcc3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:25.742449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ab5d-44f0-4394-97e7-43facd63fcc3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:25.755006 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:25.755385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3268a-2a70-4053-8572-804cc84629f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:25.758410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3268a-2a70-4053-8572-804cc84629f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:25.759599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3268a-2a70-4053-8572-804cc84629f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:25.760152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3268a-2a70-4053-8572-804cc84629f4 admin admin] PATH_INFO: `/v3/projects/aeb5e6dd8d6c46fab43fa07fa48cd99c/users/59b1d506d2414984abe362472df8bcc2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:25.765619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3268a-2a70-4053-8572-804cc84629f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb5e6dd8d6c46fab43fa07fa48cd99c, user_id=59b1d506d2414984abe362472df8bcc2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:25.772126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3268a-2a70-4053-8572-804cc84629f4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:25.800865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cfad7-16ac-444b-a861-1728e6f68a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:25.804238 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1932/3888] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:25 2022] PUT /identity/v3/projects/aeb5e6dd8d6c46fab43fa07fa48cd99c/users/59b1d506d2414984abe362472df8bcc2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:25.815374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cfad7-16ac-444b-a861-1728e6f68a34 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:25.819182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ddd6e-8dab-400b-a9ab-5c2d3f4ecfca None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:25.819465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ddd6e-8dab-400b-a9ab-5c2d3f4ecfca None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:25.819794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ddd6e-8dab-400b-a9ab-5c2d3f4ecfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:25.843208 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1957/3889] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:58:25.847286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf795b5f-f0a2-43b8-8ceb-bfd9e727184c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:25.847579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf795b5f-f0a2-43b8-8ceb-bfd9e727184c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:25.847913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf795b5f-f0a2-43b8-8ceb-bfd9e727184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:25.878029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4e8ddd6e-8dab-400b-a9ab-5c2d3f4ecfca None None] MFA Rules not processed for user `2190bd30671b47048aed416f9c14a545`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:25.879388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4e8ddd6e-8dab-400b-a9ab-5c2d3f4ecfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:25.929773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bf795b5f-f0a2-43b8-8ceb-bfd9e727184c None None] MFA Rules not processed for user `59b1d506d2414984abe362472df8bcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:25.929773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bf795b5f-f0a2-43b8-8ceb-bfd9e727184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:26.062178 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1933/3890] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:26.063361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ddd6e-8dab-400b-a9ab-5c2d3f4ecfca None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:26.133109 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1958/3891] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:26.134419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf795b5f-f0a2-43b8-8ceb-bfd9e727184c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:26.138870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bf795b5f-f0a2-43b8-8ceb-bfd9e727184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:26.198913 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:26.221741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ddd6e-8dab-400b-a9ab-5c2d3f4ecfca None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:26.229375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:26.230096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:26.230436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:26.230713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] PATH_INFO: `/v3/users/caf21602e8cc481fa53464cd81619bd8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:26.231922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf21602e8cc481fa53464cd81619bd8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:26.237936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:26.359301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf795b5f-f0a2-43b8-8ceb-bfd9e727184c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:26.360419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf21602e8cc481fa53464cd81619bd8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:26.376121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7768d-4b7a-49c5-b5d7-8ad31eb95721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:26.377918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7768d-4b7a-49c5-b5d7-8ad31eb95721 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:26.379315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7768d-4b7a-49c5-b5d7-8ad31eb95721 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:26.381929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7768d-4b7a-49c5-b5d7-8ad31eb95721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:26.395414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf21602e8cc481fa53464cd81619bd8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:26.402365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7768d-4b7a-49c5-b5d7-8ad31eb95721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:26.405387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf21602e8cc481fa53464cd81619bd8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:26.406465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7768d-4b7a-49c5-b5d7-8ad31eb95721 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:26.419883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf21602e8cc481fa53464cd81619bd8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:26.421174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bd07fa11-b316-4077-b933-0a4da9d03405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf21602e8cc481fa53464cd81619bd8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:26.431742 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1959/3892] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:26.434393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc4e20-0f39-4f0e-87aa-c18677c8d9d7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:26.438045 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1934/3893] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:26 2022] DELETE /identity/v3/users/caf21602e8cc481fa53464cd81619bd8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:26.438981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc4e20-0f39-4f0e-87aa-c18677c8d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:26.439438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc4e20-0f39-4f0e-87aa-c18677c8d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:26.442408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94078b-e9c5-443d-804b-8e489cc53a08 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:26.442697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94078b-e9c5-443d-804b-8e489cc53a08 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:26.442976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94078b-e9c5-443d-804b-8e489cc53a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:26.490319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cc94078b-e9c5-443d-804b-8e489cc53a08 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:26.499190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cc94078b-e9c5-443d-804b-8e489cc53a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:26.506379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-85bc4e20-0f39-4f0e-87aa-c18677c8d9d7 None None] MFA Rules not processed for user `d1f94c167c854cffb1ef9c36a278620d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:26.512355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85bc4e20-0f39-4f0e-87aa-c18677c8d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:26.658960 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:26.709991 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1960/3894] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:26.741402 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1935/3895] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:26.756508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc4e20-0f39-4f0e-87aa-c18677c8d9d7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:26.757994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85bc4e20-0f39-4f0e-87aa-c18677c8d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:26.889118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc4e20-0f39-4f0e-87aa-c18677c8d9d7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:26.894508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b1ce-0a56-4eff-b04f-de96515de862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:26.895420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b1ce-0a56-4eff-b04f-de96515de862 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:26.895770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b1ce-0a56-4eff-b04f-de96515de862 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:26.896157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b1ce-0a56-4eff-b04f-de96515de862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:26.910237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572b1ce-0a56-4eff-b04f-de96515de862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:26.912114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572b1ce-0a56-4eff-b04f-de96515de862 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:26.926111 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1961/3896] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:27.301479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94078b-e9c5-443d-804b-8e489cc53a08 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:27.303088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cc94078b-e9c5-443d-804b-8e489cc53a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:27.483554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94078b-e9c5-443d-804b-8e489cc53a08 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:27.498490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:27.498860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:27.499143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:27.499405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:27.507262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:27.560232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:27.562051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:27.576439 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:27.590529 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1936/3897] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:28.218699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dbd48-d063-45da-9d4a-37b3a25ffc7b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:28.219191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dbd48-d063-45da-9d4a-37b3a25ffc7b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:28.219343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dbd48-d063-45da-9d4a-37b3a25ffc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:28.266239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c85dbd48-d063-45da-9d4a-37b3a25ffc7b None None] MFA Rules not processed for user `098f448796ff4635ac6b4b7262bf6ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:28.269212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c85dbd48-d063-45da-9d4a-37b3a25ffc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:28.463831 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1962/3898] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:28.611661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:28.613960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:28.636674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f6822-998a-46f1-9a1f-ff8b1743ee2d service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:28.660398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:28.660866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:28.661300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:28.661588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] PATH_INFO: `/v3/projects/6dbd052dda60474caebf01c54c099b67` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:28.663247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbd052dda60474caebf01c54c099b67)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:28.671863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:28.804951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbd052dda60474caebf01c54c099b67', 'request_id': 'req-7ad4dc8a-b255-4ada-a366-203dd1778f0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:28.822807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbd052dda60474caebf01c54c099b67', 'request_id': 'req-7ad4dc8a-b255-4ada-a366-203dd1778f0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:28.844331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbd052dda60474caebf01c54c099b67', 'request_id': 'req-7ad4dc8a-b255-4ada-a366-203dd1778f0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:28.878147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] The token cache is being invalidate because project 6dbd052dda60474caebf01c54c099b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:28.882282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:28.886154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ad4dc8a-b255-4ada-a366-203dd1778f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:28.889345 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1937/3899] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:28 2022] DELETE /identity/v3/projects/6dbd052dda60474caebf01c54c099b67 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:28.894132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd1c7-dd4d-4bb5-a192-e25f917cad86 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:28.894568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd1c7-dd4d-4bb5-a192-e25f917cad86 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:28.895066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd1c7-dd4d-4bb5-a192-e25f917cad86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:28.953247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8b1fd1c7-dd4d-4bb5-a192-e25f917cad86 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:28.954332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8b1fd1c7-dd4d-4bb5-a192-e25f917cad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:29.159105 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1963/3900] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:29.167815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dba77-a7b6-428c-b3d5-5d6706b41866 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:29.168095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dba77-a7b6-428c-b3d5-5d6706b41866 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:29.168380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dba77-a7b6-428c-b3d5-5d6706b41866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:29.214059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f66dba77-a7b6-428c-b3d5-5d6706b41866 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:29.215591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f66dba77-a7b6-428c-b3d5-5d6706b41866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:29.249971 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1938/3901] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:29.254775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd1c7-dd4d-4bb5-a192-e25f917cad86 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:29.289434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd1c7-dd4d-4bb5-a192-e25f917cad86 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:29.299208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a55c32-cb42-49f6-bb8c-8d9f83496796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:29.300415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a55c32-cb42-49f6-bb8c-8d9f83496796 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:29.300896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a55c32-cb42-49f6-bb8c-8d9f83496796 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:29.302478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a55c32-cb42-49f6-bb8c-8d9f83496796 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:29.304697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a55c32-cb42-49f6-bb8c-8d9f83496796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:29.305206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a55c32-cb42-49f6-bb8c-8d9f83496796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:29.311285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a55c32-cb42-49f6-bb8c-8d9f83496796 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:29.342606 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1964/3902] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:29.345254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dba77-a7b6-428c-b3d5-5d6706b41866 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:29.356145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dba77-a7b6-428c-b3d5-5d6706b41866 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:29.388550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866c66-f1ac-42bc-9156-543e0c134fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:29.408920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866c66-f1ac-42bc-9156-543e0c134fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:29.409212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866c66-f1ac-42bc-9156-543e0c134fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:29.409490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866c66-f1ac-42bc-9156-543e0c134fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:29.410160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19866c66-f1ac-42bc-9156-543e0c134fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:29.419337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19866c66-f1ac-42bc-9156-543e0c134fc7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:29.496520 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1939/3903] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:29 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:29.500719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a55c32-cb42-49f6-bb8c-8d9f83496796 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:29.517759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a55c32-cb42-49f6-bb8c-8d9f83496796 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:29.542085 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:29.703651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389e63-7009-49ea-b454-770ca04bd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:29.705034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389e63-7009-49ea-b454-770ca04bd545 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:29.707379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389e63-7009-49ea-b454-770ca04bd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:29.707939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389e63-7009-49ea-b454-770ca04bd545 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:29.708806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389e63-7009-49ea-b454-770ca04bd545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:29.714199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389e63-7009-49ea-b454-770ca04bd545 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:29.793526 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1965/3904] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:29 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:29.801354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866c66-f1ac-42bc-9156-543e0c134fc7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:29.832100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866c66-f1ac-42bc-9156-543e0c134fc7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:29.855798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c74e97-6180-4528-8a8b-17733d42dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:29.856534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c74e97-6180-4528-8a8b-17733d42dd72 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:29.856944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c74e97-6180-4528-8a8b-17733d42dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:29.868672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c74e97-6180-4528-8a8b-17733d42dd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:29.869560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c74e97-6180-4528-8a8b-17733d42dd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:29.874038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c74e97-6180-4528-8a8b-17733d42dd72 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:29.892847 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1940/3905] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:29.893892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389e63-7009-49ea-b454-770ca04bd545 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:29.894391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c74e97-6180-4528-8a8b-17733d42dd72 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:29.896434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-25c74e97-6180-4528-8a8b-17733d42dd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:29.913402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389e63-7009-49ea-b454-770ca04bd545 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:29.931303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49eb7d-b26c-4fb7-839c-e5c565539aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:29.938996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49eb7d-b26c-4fb7-839c-e5c565539aec admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:29.939723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49eb7d-b26c-4fb7-839c-e5c565539aec admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:29.940834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49eb7d-b26c-4fb7-839c-e5c565539aec admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:29.941903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49eb7d-b26c-4fb7-839c-e5c565539aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:29.953491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49eb7d-b26c-4fb7-839c-e5c565539aec admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:30.038096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c74e97-6180-4528-8a8b-17733d42dd72 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:30.041973 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1966/3906] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:30.049937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49eb7d-b26c-4fb7-839c-e5c565539aec admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:30.064389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:30.066139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:30.066619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:30.067309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:30.071653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:30.101258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49eb7d-b26c-4fb7-839c-e5c565539aec admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:30.136347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a1c2a-a8bd-4021-bb57-24672b3bfa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:30.149544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1c2a-a8bd-4021-bb57-24672b3bfa85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:30.150021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1c2a-a8bd-4021-bb57-24672b3bfa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:30.151120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1c2a-a8bd-4021-bb57-24672b3bfa85 admin admin] PATH_INFO: `/v3/projects/50072501ee9243fc9231366cc4d4e126/users/9d4ace72ded34bd68a31903840689300/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:30.261469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a1c2a-a8bd-4021-bb57-24672b3bfa85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50072501ee9243fc9231366cc4d4e126, user_id=9d4ace72ded34bd68a31903840689300, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:30.264375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a1c2a-a8bd-4021-bb57-24672b3bfa85 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:30.269931 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:30.337551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1967/3907] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:30 2022] PUT /identity/v3/projects/50072501ee9243fc9231366cc4d4e126/users/9d4ace72ded34bd68a31903840689300/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:30.341159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237dad4-39d1-4a04-9c1c-299093738c9e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:30.341440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237dad4-39d1-4a04-9c1c-299093738c9e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:30.341898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237dad4-39d1-4a04-9c1c-299093738c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:30.375509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:30.377349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:30.426564 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1941/3908] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:30.443050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1237dad4-39d1-4a04-9c1c-299093738c9e None None] MFA Rules not processed for user `9d4ace72ded34bd68a31903840689300`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:30.444340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1237dad4-39d1-4a04-9c1c-299093738c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:30.668992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1968/3909] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:30.692299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:30.693853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:30.815196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e37517-5f06-4af9-9dc8-d6173465290c service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:30.923560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc618f20-e992-40e8-a425-5aafc2900ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:30.924183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc618f20-e992-40e8-a425-5aafc2900ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:30.924473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc618f20-e992-40e8-a425-5aafc2900ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:30.925305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc618f20-e992-40e8-a425-5aafc2900ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:30.953836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc618f20-e992-40e8-a425-5aafc2900ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:30.955541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc618f20-e992-40e8-a425-5aafc2900ef8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:30.975283 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1942/3910] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:31.694967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237dad4-39d1-4a04-9c1c-299093738c9e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:31.809485 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:31.847044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237dad4-39d1-4a04-9c1c-299093738c9e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:31.879278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:31.879945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:31.880228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:31.880507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] PATH_INFO: `/v3/users/9d4ace72ded34bd68a31903840689300` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:31.881739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4ace72ded34bd68a31903840689300)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:31.883685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:32.005705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4ace72ded34bd68a31903840689300'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:32.022712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4ace72ded34bd68a31903840689300'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:32.032307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4ace72ded34bd68a31903840689300'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:32.045350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4ace72ded34bd68a31903840689300'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:32.046779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4ace72ded34bd68a31903840689300'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:32.058211 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1969/3911] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:31 2022] DELETE /identity/v3/users/9d4ace72ded34bd68a31903840689300 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:32.062866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58d43-7bbe-4b07-a926-27489644f659 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:32.064709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58d43-7bbe-4b07-a926-27489644f659 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:32.065159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58d43-7bbe-4b07-a926-27489644f659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:32.111495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-46a58d43-7bbe-4b07-a926-27489644f659 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:32.113818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-46a58d43-7bbe-4b07-a926-27489644f659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:32.293147 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1943/3912] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:32.350587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:32.352162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:32.477902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56e145-6e4c-4018-befc-5bbafa9b1a0f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:32.503103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0da4d-ec58-45cf-80a6-6202effebb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:32.503873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0da4d-ec58-45cf-80a6-6202effebb0f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:32.506494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0da4d-ec58-45cf-80a6-6202effebb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:32.506805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0da4d-ec58-45cf-80a6-6202effebb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:32.533817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0da4d-ec58-45cf-80a6-6202effebb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:32.535295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0da4d-ec58-45cf-80a6-6202effebb0f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:32.602849 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1970/3913] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:33.042578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ab676-7f28-4187-bac0-e23866a27715 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:33.043057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ab676-7f28-4187-bac0-e23866a27715 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:33.043606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ab676-7f28-4187-bac0-e23866a27715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:33.105829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-250ab676-7f28-4187-bac0-e23866a27715 None None] MFA Rules not processed for user `c9ac716a6af441a4bc02d8ef11f81487`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:33.107064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-250ab676-7f28-4187-bac0-e23866a27715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:33.144375 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:33.176006 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1944/3914] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:58:33.811841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0da4d-ec58-45cf-80a6-6202effebb0f service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:33.815012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f6c0da4d-ec58-45cf-80a6-6202effebb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:33.854601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0da4d-ec58-45cf-80a6-6202effebb0f service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:33.862028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:33.862932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:33.863634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:33.864580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] PATH_INFO: `/v3/projects/50072501ee9243fc9231366cc4d4e126` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:33.867524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50072501ee9243fc9231366cc4d4e126)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:33.870464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:33.991271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50072501ee9243fc9231366cc4d4e126', 'request_id': 'req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:34.005764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50072501ee9243fc9231366cc4d4e126', 'request_id': 'req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:34.015309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50072501ee9243fc9231366cc4d4e126', 'request_id': 'req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:34.053930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] The token cache is being invalidate because project 50072501ee9243fc9231366cc4d4e126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:34.054241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:34.056302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7e66534b-0a70-4320-a7ff-ac91cd94fb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:34.066378 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1971/3915] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:33 2022] DELETE /identity/v3/projects/50072501ee9243fc9231366cc4d4e126 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:34.072721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09a756-6538-45c4-81ac-f4b9bddada0e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.073238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09a756-6538-45c4-81ac-f4b9bddada0e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.073697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09a756-6538-45c4-81ac-f4b9bddada0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.106782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4b09a756-6538-45c4-81ac-f4b9bddada0e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:34.108638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4b09a756-6538-45c4-81ac-f4b9bddada0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:34.198865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1945/3916] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:34.201986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de859-5dae-4710-845a-8b4f7ba4cefc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.202284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de859-5dae-4710-845a-8b4f7ba4cefc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.202565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de859-5dae-4710-845a-8b4f7ba4cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.211719 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:34.230847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f02de859-5dae-4710-845a-8b4f7ba4cefc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:34.232251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f02de859-5dae-4710-845a-8b4f7ba4cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:34.248610 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1972/3917] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:34.249909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09a756-6538-45c4-81ac-f4b9bddada0e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:34.268533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09a756-6538-45c4-81ac-f4b9bddada0e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:34.276269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09480fca-ecbe-4c28-a13f-56b6fbae070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:34.277467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09480fca-ecbe-4c28-a13f-56b6fbae070b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.278119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09480fca-ecbe-4c28-a13f-56b6fbae070b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.278593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09480fca-ecbe-4c28-a13f-56b6fbae070b admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.279429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09480fca-ecbe-4c28-a13f-56b6fbae070b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:34.280032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09480fca-ecbe-4c28-a13f-56b6fbae070b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:34.284870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09480fca-ecbe-4c28-a13f-56b6fbae070b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:34.305994 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1946/3918] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:34.310763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de859-5dae-4710-845a-8b4f7ba4cefc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:34.329094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de859-5dae-4710-845a-8b4f7ba4cefc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:34.335146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0311a0-a7fc-4af0-b8ef-2a278ef2b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:34.336194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0311a0-a7fc-4af0-b8ef-2a278ef2b1ac admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.336709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0311a0-a7fc-4af0-b8ef-2a278ef2b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.337164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0311a0-a7fc-4af0-b8ef-2a278ef2b1ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.338426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0311a0-a7fc-4af0-b8ef-2a278ef2b1ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:34.341209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0311a0-a7fc-4af0-b8ef-2a278ef2b1ac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:34.387839 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1973/3919] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:34 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:34.391702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09480fca-ecbe-4c28-a13f-56b6fbae070b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:34.418253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09480fca-ecbe-4c28-a13f-56b6fbae070b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:34.531918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d136-464d-4343-b139-08f9dcad8cab None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.532252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d136-464d-4343-b139-08f9dcad8cab None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.532540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d136-464d-4343-b139-08f9dcad8cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.551445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce1cc1-8a3b-4bba-8861-372c20b8abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:34.552524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce1cc1-8a3b-4bba-8861-372c20b8abca admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.553010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce1cc1-8a3b-4bba-8861-372c20b8abca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.553690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce1cc1-8a3b-4bba-8861-372c20b8abca admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.555489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce1cc1-8a3b-4bba-8861-372c20b8abca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:34.559455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce1cc1-8a3b-4bba-8861-372c20b8abca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:34.561921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e4a1d136-464d-4343-b139-08f9dcad8cab None None] MFA Rules not processed for user `098f448796ff4635ac6b4b7262bf6ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:34.563717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e4a1d136-464d-4343-b139-08f9dcad8cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:34.599551 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1947/3920] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:34 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:34.602105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce1cc1-8a3b-4bba-8861-372c20b8abca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:34.624703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce1cc1-8a3b-4bba-8861-372c20b8abca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:34.630633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96a19e-848e-46ab-84a9-7e78d6ad9462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:34.631273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96a19e-848e-46ab-84a9-7e78d6ad9462 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.631689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96a19e-848e-46ab-84a9-7e78d6ad9462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.631968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96a19e-848e-46ab-84a9-7e78d6ad9462 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.632701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96a19e-848e-46ab-84a9-7e78d6ad9462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:34.634795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96a19e-848e-46ab-84a9-7e78d6ad9462 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:34.654326 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1948/3921] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:34.658097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96a19e-848e-46ab-84a9-7e78d6ad9462 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:34.674384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96a19e-848e-46ab-84a9-7e78d6ad9462 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:34.690507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84a92-e923-4eba-b1ef-553e6b4fdbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:34.691231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84a92-e923-4eba-b1ef-553e6b4fdbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.691607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84a92-e923-4eba-b1ef-553e6b4fdbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.691972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84a92-e923-4eba-b1ef-553e6b4fdbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.693316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84a92-e923-4eba-b1ef-553e6b4fdbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:34.703393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84a92-e923-4eba-b1ef-553e6b4fdbf9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:34.709396 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1949/3922] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:34.713922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84a92-e923-4eba-b1ef-553e6b4fdbf9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:34.724131 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1974/3923] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:34.740699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84a92-e923-4eba-b1ef-553e6b4fdbf9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:34.753024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61c970-6c5f-49be-8afe-6c2cf4a2767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:34.753825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61c970-6c5f-49be-8afe-6c2cf4a2767c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.754644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61c970-6c5f-49be-8afe-6c2cf4a2767c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.754644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61c970-6c5f-49be-8afe-6c2cf4a2767c admin admin] PATH_INFO: `/v3/projects/61e32b89779a4a27a2d5f6dae3951d37/users/e66b86aa194e429d9c13840d425ae279/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.795501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61c970-6c5f-49be-8afe-6c2cf4a2767c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e32b89779a4a27a2d5f6dae3951d37, user_id=e66b86aa194e429d9c13840d425ae279, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:34.798415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61c970-6c5f-49be-8afe-6c2cf4a2767c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:34.826421 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1950/3924] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:34 2022] PUT /identity/v3/projects/61e32b89779a4a27a2d5f6dae3951d37/users/e66b86aa194e429d9c13840d425ae279/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:58:34.837818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fd4ff-f319-4d42-8352-b28678947ff5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:34.838348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fd4ff-f319-4d42-8352-b28678947ff5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:34.838667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fd4ff-f319-4d42-8352-b28678947ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:34.899505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-864fd4ff-f319-4d42-8352-b28678947ff5 None None] MFA Rules not processed for user `e66b86aa194e429d9c13840d425ae279`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:34.901348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-864fd4ff-f319-4d42-8352-b28678947ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:35.012046 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1975/3925] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:35.034663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61c970-6c5f-49be-8afe-6c2cf4a2767c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:35.036520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0f61c970-6c5f-49be-8afe-6c2cf4a2767c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:35.069261 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:35.167576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61c970-6c5f-49be-8afe-6c2cf4a2767c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:35.173154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d4631-b8b0-4c60-9e71-af88a0447ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:35.174054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d4631-b8b0-4c60-9e71-af88a0447ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:35.175030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d4631-b8b0-4c60-9e71-af88a0447ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:35.175509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d4631-b8b0-4c60-9e71-af88a0447ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:35.191583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d4631-b8b0-4c60-9e71-af88a0447ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:35.195258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d4631-b8b0-4c60-9e71-af88a0447ef1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:35.207861 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1951/3926] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:45.012843 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:45.201841 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=20 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:48.732280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fd4ff-f319-4d42-8352-b28678947ff5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:48.733913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-864fd4ff-f319-4d42-8352-b28678947ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:48.983239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d4631-b8b0-4c60-9e71-af88a0447ef1 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:48.985147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d15d4631-b8b0-4c60-9e71-af88a0447ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:49.014141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d4631-b8b0-4c60-9e71-af88a0447ef1 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:49.026241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c518b9-820d-4bcc-b2be-853d8e049aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:49.027146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c518b9-820d-4bcc-b2be-853d8e049aaa service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:49.027626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c518b9-820d-4bcc-b2be-853d8e049aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:49.028113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fd4ff-f319-4d42-8352-b28678947ff5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:49.028315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c518b9-820d-4bcc-b2be-853d8e049aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:49.035178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c1c518b9-820d-4bcc-b2be-853d8e049aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:49.041532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:49.042207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:49.042487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:49.042758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] PATH_INFO: `/v3/users/86d615989bfa4ef493b1f3462e6a7809` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:49.048146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d615989bfa4ef493b1f3462e6a7809)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:49.050132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:49.210140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d615989bfa4ef493b1f3462e6a7809'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:49.233892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c518b9-820d-4bcc-b2be-853d8e049aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:49.235864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c518b9-820d-4bcc-b2be-853d8e049aaa service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:49.237699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d615989bfa4ef493b1f3462e6a7809'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:49.260942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d615989bfa4ef493b1f3462e6a7809'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:49.264452 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1952/3927] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:58:49.272663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d615989bfa4ef493b1f3462e6a7809'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:49.274165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d615989bfa4ef493b1f3462e6a7809'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:49.287057 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1976/3928] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:58:48 2022] DELETE /identity/v3/users/86d615989bfa4ef493b1f3462e6a7809 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:49.292586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbfc35-30f3-4b4e-ac1f-e4e1a377c78b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:49.293155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbfc35-30f3-4b4e-ac1f-e4e1a377c78b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:49.293593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbfc35-30f3-4b4e-ac1f-e4e1a377c78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:49.331183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1adbfc35-30f3-4b4e-ac1f-e4e1a377c78b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:49.332736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1adbfc35-30f3-4b4e-ac1f-e4e1a377c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:49.468057 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1953/3929] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:49.495712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:49.498180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:49.663542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549493c-5358-4c50-8923-928738d3863d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:49.669051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03afd3-fb61-4af3-bb68-a7bb61397b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:49.669833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03afd3-fb61-4af3-bb68-a7bb61397b16 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:49.670240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03afd3-fb61-4af3-bb68-a7bb61397b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:49.670512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03afd3-fb61-4af3-bb68-a7bb61397b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:49.701729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03afd3-fb61-4af3-bb68-a7bb61397b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:49.703178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03afd3-fb61-4af3-bb68-a7bb61397b16 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:49.715409 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1977/3930] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:50.860008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbfc35-30f3-4b4e-ac1f-e4e1a377c78b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:50.861633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1adbfc35-30f3-4b4e-ac1f-e4e1a377c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:50.888610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbfc35-30f3-4b4e-ac1f-e4e1a377c78b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:50.896474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:50.897926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:50.898505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:50.899009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] PATH_INFO: `/v3/projects/79865e2b6dee484490d79e63e371a25d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:50.901817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79865e2b6dee484490d79e63e371a25d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:50.904006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:50.995133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79865e2b6dee484490d79e63e371a25d', 'request_id': 'req-5a3c3206-a372-4e77-861d-3dda323084b0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:51.010712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79865e2b6dee484490d79e63e371a25d', 'request_id': 'req-5a3c3206-a372-4e77-861d-3dda323084b0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:51.034701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79865e2b6dee484490d79e63e371a25d', 'request_id': 'req-5a3c3206-a372-4e77-861d-3dda323084b0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:51.067353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] The token cache is being invalidate because project 79865e2b6dee484490d79e63e371a25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:58:51.068060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:51.069020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3c3206-a372-4e77-861d-3dda323084b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:58:51.076097 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1954/3931] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:58:50 2022] DELETE /identity/v3/projects/79865e2b6dee484490d79e63e371a25d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:51.077581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3498f-2cf1-497a-95d3-4f480c71ab7e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:51.078090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3498f-2cf1-497a-95d3-4f480c71ab7e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:51.078189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3498f-2cf1-497a-95d3-4f480c71ab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:51.120927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e1d3498f-2cf1-497a-95d3-4f480c71ab7e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:51.127986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e1d3498f-2cf1-497a-95d3-4f480c71ab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:51.212228 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:51.319886 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1978/3932] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:51.328291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7d23-403f-4869-8963-b66adea5d5b2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:51.328975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7d23-403f-4869-8963-b66adea5d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:51.329422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7d23-403f-4869-8963-b66adea5d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:51.364196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-03fc7d23-403f-4869-8963-b66adea5d5b2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:51.369031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-03fc7d23-403f-4869-8963-b66adea5d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:51.402265 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1955/3933] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:58:51.406105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3498f-2cf1-497a-95d3-4f480c71ab7e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:51.421507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3498f-2cf1-497a-95d3-4f480c71ab7e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:51.433892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc64a2-1c25-4674-9444-0059bd409ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:51.436220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc64a2-1c25-4674-9444-0059bd409ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:51.437562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc64a2-1c25-4674-9444-0059bd409ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:51.443311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc64a2-1c25-4674-9444-0059bd409ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:51.446098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc64a2-1c25-4674-9444-0059bd409ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:58:51.446307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc64a2-1c25-4674-9444-0059bd409ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:51.454641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc64a2-1c25-4674-9444-0059bd409ab6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:51.495163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7d23-403f-4869-8963-b66adea5d5b2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:51.498064 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1979/3934] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:58:51.502015 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:51.517592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7d23-403f-4869-8963-b66adea5d5b2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:51.533553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea935a-0cf0-4ee6-aa08-46ce602a9e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:51.534350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea935a-0cf0-4ee6-aa08-46ce602a9e13 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:51.534750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea935a-0cf0-4ee6-aa08-46ce602a9e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:51.535131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea935a-0cf0-4ee6-aa08-46ce602a9e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:51.535890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea935a-0cf0-4ee6-aa08-46ce602a9e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:51.538161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea935a-0cf0-4ee6-aa08-46ce602a9e13 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:51.590831 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1956/3935] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:58:51 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:58:51.595739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc64a2-1c25-4674-9444-0059bd409ab6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:51.608575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc64a2-1c25-4674-9444-0059bd409ab6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:51.730634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a77e6-2f22-4ad3-a526-a65dbd273cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:51.749242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a77e6-2f22-4ad3-a526-a65dbd273cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:51.749541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a77e6-2f22-4ad3-a526-a65dbd273cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:51.749824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a77e6-2f22-4ad3-a526-a65dbd273cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:51.750517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a77e6-2f22-4ad3-a526-a65dbd273cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:51.752532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a77e6-2f22-4ad3-a526-a65dbd273cf4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:51.795140 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1980/3936] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:58:51 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:58:51.796438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea935a-0cf0-4ee6-aa08-46ce602a9e13 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:51.807867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea935a-0cf0-4ee6-aa08-46ce602a9e13 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:51.813402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544643-cb55-41bd-b001-c495f878f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:51.814318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544643-cb55-41bd-b001-c495f878f0ee admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:51.814806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544643-cb55-41bd-b001-c495f878f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:51.815276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544643-cb55-41bd-b001-c495f878f0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:51.816125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06544643-cb55-41bd-b001-c495f878f0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:51.818198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06544643-cb55-41bd-b001-c495f878f0ee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:51.831040 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1957/3937] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:51.834891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a77e6-2f22-4ad3-a526-a65dbd273cf4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:51.850907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a77e6-2f22-4ad3-a526-a65dbd273cf4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:51.863436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e31693-a285-49f9-9fff-fc46c1695beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:51.864388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31693-a285-49f9-9fff-fc46c1695beb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:51.864922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31693-a285-49f9-9fff-fc46c1695beb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:51.865375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31693-a285-49f9-9fff-fc46c1695beb admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:51.866205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e31693-a285-49f9-9fff-fc46c1695beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:51.868014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e31693-a285-49f9-9fff-fc46c1695beb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:51.897595 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1981/3938] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:58:51.903491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544643-cb55-41bd-b001-c495f878f0ee admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:51.927713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544643-cb55-41bd-b001-c495f878f0ee admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:51.945445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f335df4-cd14-45af-9fd5-055f659189b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:51.946419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f335df4-cd14-45af-9fd5-055f659189b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:51.947585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f335df4-cd14-45af-9fd5-055f659189b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:51.948039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f335df4-cd14-45af-9fd5-055f659189b4 admin admin] PATH_INFO: `/v3/projects/ae5f5f6bcf7e4ecd9975f48a7ec4ce4e/users/897e6694b0d7402f87443b69a071c4d0/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:51.984857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f335df4-cd14-45af-9fd5-055f659189b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5f5f6bcf7e4ecd9975f48a7ec4ce4e, user_id=897e6694b0d7402f87443b69a071c4d0, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:51.987969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f335df4-cd14-45af-9fd5-055f659189b4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:52.034435 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1958/3939] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:58:51 2022] PUT /identity/v3/projects/ae5f5f6bcf7e4ecd9975f48a7ec4ce4e/users/897e6694b0d7402f87443b69a071c4d0/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:58:52.044541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3326a-2f33-4747-a181-72e66724ba6e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:52.045169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3326a-2f33-4747-a181-72e66724ba6e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:52.045626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3326a-2f33-4747-a181-72e66724ba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:52.089856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a0c3326a-2f33-4747-a181-72e66724ba6e None None] MFA Rules not processed for user `897e6694b0d7402f87443b69a071c4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:52.091573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a0c3326a-2f33-4747-a181-72e66724ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:52.236400 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1982/3940] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:52.272983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f335df4-cd14-45af-9fd5-055f659189b4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:52.278362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6f335df4-cd14-45af-9fd5-055f659189b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:52.450291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f335df4-cd14-45af-9fd5-055f659189b4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:52.456080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe011255-75d8-4290-883d-6d6f9227715e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:52.457059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011255-75d8-4290-883d-6d6f9227715e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:52.457304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011255-75d8-4290-883d-6d6f9227715e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:52.458509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011255-75d8-4290-883d-6d6f9227715e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:52.496913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe011255-75d8-4290-883d-6d6f9227715e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:52.500558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe011255-75d8-4290-883d-6d6f9227715e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:52.526437 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1959/3941] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:53.882616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3326a-2f33-4747-a181-72e66724ba6e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:58:53.884905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a0c3326a-2f33-4747-a181-72e66724ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:53.911376 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:54.007301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3326a-2f33-4747-a181-72e66724ba6e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:58:54.017239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c7e30-5c93-4b54-b09e-6eaf26eb7c2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:58:54.018371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c7e30-5c93-4b54-b09e-6eaf26eb7c2a service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:54.018371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c7e30-5c93-4b54-b09e-6eaf26eb7c2a service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:54.018921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c7e30-5c93-4b54-b09e-6eaf26eb7c2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:54.021243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a26c7e30-5c93-4b54-b09e-6eaf26eb7c2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:54.122485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c7e30-5c93-4b54-b09e-6eaf26eb7c2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:58:54.124678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c7e30-5c93-4b54-b09e-6eaf26eb7c2a service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:58:54.175596 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1983/3942] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:58:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:58:54.232112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1e69-c7fe-4975-b8c0-2616b3547565 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:54.233334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1e69-c7fe-4975-b8c0-2616b3547565 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:54.233835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1e69-c7fe-4975-b8c0-2616b3547565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:54.277436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-eb2b1e69-c7fe-4975-b8c0-2616b3547565 None None] MFA Rules not processed for user `d1f94c167c854cffb1ef9c36a278620d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:54.279081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eb2b1e69-c7fe-4975-b8c0-2616b3547565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:54.438238 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1960/3943] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:58:56.480754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fba38-21c3-4e0c-aa6a-17a80880aee5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:58:56.481633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fba38-21c3-4e0c-aa6a-17a80880aee5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:58:56.482124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fba38-21c3-4e0c-aa6a-17a80880aee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:58:56.516315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-de4fba38-21c3-4e0c-aa6a-17a80880aee5 None None] MFA Rules not processed for user `2190bd30671b47048aed416f9c14a545`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:58:56.517705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de4fba38-21c3-4e0c-aa6a-17a80880aee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:58:56.630018 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1984/3944] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:58:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:00.771990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1e69-c7fe-4975-b8c0-2616b3547565 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:00.774087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eb2b1e69-c7fe-4975-b8c0-2616b3547565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:00.915632 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:00.953180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1e69-c7fe-4975-b8c0-2616b3547565 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:00.963673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:00.965618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:00.966106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:00.968451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] PATH_INFO: `/v3/users/b32809814dd248e3b2f556ab3a2ac3ad` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:00.970249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32809814dd248e3b2f556ab3a2ac3ad)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:00.972643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:01.123924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32809814dd248e3b2f556ab3a2ac3ad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.156073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32809814dd248e3b2f556ab3a2ac3ad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.175855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32809814dd248e3b2f556ab3a2ac3ad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.220878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32809814dd248e3b2f556ab3a2ac3ad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.221786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32809814dd248e3b2f556ab3a2ac3ad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.250982 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1961/3945] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:00 2022] DELETE /identity/v3/users/b32809814dd248e3b2f556ab3a2ac3ad => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:01.621088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fba38-21c3-4e0c-aa6a-17a80880aee5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:01.622723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de4fba38-21c3-4e0c-aa6a-17a80880aee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:01.651234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fba38-21c3-4e0c-aa6a-17a80880aee5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:01.730493 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:01.744108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:01.745192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:01.745649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:01.746725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] PATH_INFO: `/v3/users/2951a7c54a114bc5a778e0b3ff2e8f1e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:01.752865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2951a7c54a114bc5a778e0b3ff2e8f1e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:01.754598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:01.838252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2951a7c54a114bc5a778e0b3ff2e8f1e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.863195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2951a7c54a114bc5a778e0b3ff2e8f1e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.879411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2951a7c54a114bc5a778e0b3ff2e8f1e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.896985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2951a7c54a114bc5a778e0b3ff2e8f1e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.898239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2951a7c54a114bc5a778e0b3ff2e8f1e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:01.931538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1985/3946] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:01 2022] DELETE /identity/v3/users/2951a7c54a114bc5a778e0b3ff2e8f1e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:02.063708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:02.065604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:02.191721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b000fb-f628-467d-893c-5cad20244b5b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:02.386221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f06bd-e45f-4923-8525-ed48bdbb2cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:02.387306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f06bd-e45f-4923-8525-ed48bdbb2cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:02.388538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f06bd-e45f-4923-8525-ed48bdbb2cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:02.389080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f06bd-e45f-4923-8525-ed48bdbb2cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:02.397007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e90f06bd-e45f-4923-8525-ed48bdbb2cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:02.514046 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:02.603100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f06bd-e45f-4923-8525-ed48bdbb2cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:02.604911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f06bd-e45f-4923-8525-ed48bdbb2cc3 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:02.662958 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1962/3947] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:02.817897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:02.821787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:02.959883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac1093-e074-4a40-a606-e782a36e808b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:02.980887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:02.982459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:02.983359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:02.983726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] PATH_INFO: `/v3/projects/1e893a2318af4b6aa66ede371d15453f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:02.985734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e893a2318af4b6aa66ede371d15453f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:02.988401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:03.154989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e893a2318af4b6aa66ede371d15453f', 'request_id': 'req-42342d69-265c-4bc7-92b6-ac703b4114cd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.185168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e893a2318af4b6aa66ede371d15453f', 'request_id': 'req-42342d69-265c-4bc7-92b6-ac703b4114cd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.203562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e893a2318af4b6aa66ede371d15453f', 'request_id': 'req-42342d69-265c-4bc7-92b6-ac703b4114cd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.222012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] The token cache is being invalidate because project 1e893a2318af4b6aa66ede371d15453f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:03.222421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.223213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42342d69-265c-4bc7-92b6-ac703b4114cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.230385 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1986/3948] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:02 2022] DELETE /identity/v3/projects/1e893a2318af4b6aa66ede371d15453f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:03.233502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64c5b9-e9ac-468e-9329-ac59d2d50936 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:03.234007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64c5b9-e9ac-468e-9329-ac59d2d50936 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:03.234116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64c5b9-e9ac-468e-9329-ac59d2d50936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:03.269770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6a64c5b9-e9ac-468e-9329-ac59d2d50936 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:03.272343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6a64c5b9-e9ac-468e-9329-ac59d2d50936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:03.362759 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1963/3949] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:03.372073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48225320-092f-44d9-87f4-9d03a2e0ca39 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:03.372828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48225320-092f-44d9-87f4-9d03a2e0ca39 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:03.374466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48225320-092f-44d9-87f4-9d03a2e0ca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:03.389794 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:03.432067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-48225320-092f-44d9-87f4-9d03a2e0ca39 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:03.433363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-48225320-092f-44d9-87f4-9d03a2e0ca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:03.447419 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1987/3950] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:03.451765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64c5b9-e9ac-468e-9329-ac59d2d50936 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:03.471740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64c5b9-e9ac-468e-9329-ac59d2d50936 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:03.486672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:03.488548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:03.489258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:03.489258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:03.490946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:03.491347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:03.494247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:03.533122 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1964/3951] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:03.534783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48225320-092f-44d9-87f4-9d03a2e0ca39 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:03.550387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:03.557999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48225320-092f-44d9-87f4-9d03a2e0ca39 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:03.564293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999192-d11f-448b-965c-f8fb20e492cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:03.564994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999192-d11f-448b-965c-f8fb20e492cc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:03.565287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999192-d11f-448b-965c-f8fb20e492cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:03.565572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999192-d11f-448b-965c-f8fb20e492cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:03.567926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:03.572846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5999192-d11f-448b-965c-f8fb20e492cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:03.576235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5999192-d11f-448b-965c-f8fb20e492cc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:03.591769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bdc81-ee65-475e-aa8c-eedae7bde654 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:03.606758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:03.607794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:03.608091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:03.608435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] PATH_INFO: `/v3/projects/f1c3d8147eb24a4ab1aa72a7b973dd51` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:03.610147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c3d8147eb24a4ab1aa72a7b973dd51)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:03.634119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:03.660490 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1988/3952] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:03 2022] POST /identity/v3/projects => generated 401 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:59:03.664477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999192-d11f-448b-965c-f8fb20e492cc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:03.740841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'request_id': 'req-440295c5-9a85-4647-8d66-7dff2bd323a9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.762500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'request_id': 'req-440295c5-9a85-4647-8d66-7dff2bd323a9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.784555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999192-d11f-448b-965c-f8fb20e492cc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:03.787407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'request_id': 'req-440295c5-9a85-4647-8d66-7dff2bd323a9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.818781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] The token cache is being invalidate because project f1c3d8147eb24a4ab1aa72a7b973dd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:03.831651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.837446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-440295c5-9a85-4647-8d66-7dff2bd323a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:03.846220 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1965/3953] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:03 2022] DELETE /identity/v3/projects/f1c3d8147eb24a4ab1aa72a7b973dd51 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:03.848152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa015b-3e3d-4a57-b07c-6452b0074e4e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:03.848386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa015b-3e3d-4a57-b07c-6452b0074e4e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:03.848545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa015b-3e3d-4a57-b07c-6452b0074e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:03.902518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4caa015b-3e3d-4a57-b07c-6452b0074e4e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:03.905445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4caa015b-3e3d-4a57-b07c-6452b0074e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:03.951524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4df06-5111-4b66-be7b-87a5292c2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:03.952273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4df06-5111-4b66-be7b-87a5292c2759 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:03.955141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4df06-5111-4b66-be7b-87a5292c2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:03.955686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4df06-5111-4b66-be7b-87a5292c2759 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:03.957840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4df06-5111-4b66-be7b-87a5292c2759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:03.963393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4df06-5111-4b66-be7b-87a5292c2759 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.033911 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:04.048395 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1989/3954] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:03 2022] POST /identity/v3/users => generated 301 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:59:04.051959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4df06-5111-4b66-be7b-87a5292c2759 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.061753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f5d4df06-5111-4b66-be7b-87a5292c2759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:04.098429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4df06-5111-4b66-be7b-87a5292c2759 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.109978 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1966/3955] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:04.119825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750fc5e-ba25-4fce-a4c9-e3b39bc338c8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.120188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cf6ed-1dc5-4730-9cb6-06fde2b7c0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.120814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cf6ed-1dc5-4730-9cb6-06fde2b7c0ea admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.121065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750fc5e-ba25-4fce-a4c9-e3b39bc338c8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.121196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cf6ed-1dc5-4730-9cb6-06fde2b7c0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.121427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cf6ed-1dc5-4730-9cb6-06fde2b7c0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.122363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cf6ed-1dc5-4730-9cb6-06fde2b7c0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.123019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750fc5e-ba25-4fce-a4c9-e3b39bc338c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.123881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cf6ed-1dc5-4730-9cb6-06fde2b7c0ea admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.136266 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1990/3956] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:04.139837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cf6ed-1dc5-4730-9cb6-06fde2b7c0ea admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.152336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cf6ed-1dc5-4730-9cb6-06fde2b7c0ea admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.154403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2750fc5e-ba25-4fce-a4c9-e3b39bc338c8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:04.156765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2750fc5e-ba25-4fce-a4c9-e3b39bc338c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:04.158541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8ef5-2484-4905-bff5-d03d1d6f346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.158888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8ef5-2484-4905-bff5-d03d1d6f346c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.159289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8ef5-2484-4905-bff5-d03d1d6f346c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.159654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8ef5-2484-4905-bff5-d03d1d6f346c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.160644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c8ef5-2484-4905-bff5-d03d1d6f346c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.162506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c8ef5-2484-4905-bff5-d03d1d6f346c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.169861 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1967/3957] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:04.173851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750fc5e-ba25-4fce-a4c9-e3b39bc338c8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.181043 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1991/3958] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:04.184935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8ef5-2484-4905-bff5-d03d1d6f346c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.188318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750fc5e-ba25-4fce-a4c9-e3b39bc338c8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.194623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41c88d-f2da-4999-adcc-e1cc433102ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.195261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41c88d-f2da-4999-adcc-e1cc433102ae admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.195546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41c88d-f2da-4999-adcc-e1cc433102ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.195824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41c88d-f2da-4999-adcc-e1cc433102ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.196550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41c88d-f2da-4999-adcc-e1cc433102ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:04.196972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8ef5-2484-4905-bff5-d03d1d6f346c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.197143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41c88d-f2da-4999-adcc-e1cc433102ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.198946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41c88d-f2da-4999-adcc-e1cc433102ae admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.205068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ffcdd-9eee-4096-8c3a-46b05691e725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.206326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ffcdd-9eee-4096-8c3a-46b05691e725 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.206713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ffcdd-9eee-4096-8c3a-46b05691e725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.207085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ffcdd-9eee-4096-8c3a-46b05691e725 admin admin] PATH_INFO: `/v3/projects/52bbc99b42784505908f1f9d2f1498d8/users/ce909e8b04834269b0194db091d7a777/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.217486 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1968/3959] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:59:04.222306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41c88d-f2da-4999-adcc-e1cc433102ae admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.233536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ffcdd-9eee-4096-8c3a-46b05691e725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bbc99b42784505908f1f9d2f1498d8, user_id=ce909e8b04834269b0194db091d7a777, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.237196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ffcdd-9eee-4096-8c3a-46b05691e725 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.241585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41c88d-f2da-4999-adcc-e1cc433102ae admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.253722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee6d57-4668-4456-abc5-69c2189b95d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.253998 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1992/3960] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:04 2022] PUT /identity/v3/projects/52bbc99b42784505908f1f9d2f1498d8/users/ce909e8b04834269b0194db091d7a777/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:59:04.254807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee6d57-4668-4456-abc5-69c2189b95d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.255104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee6d57-4668-4456-abc5-69c2189b95d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.258588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee6d57-4668-4456-abc5-69c2189b95d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.259248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee6d57-4668-4456-abc5-69c2189b95d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.263143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee6d57-4668-4456-abc5-69c2189b95d7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.268905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92fd7-fea6-48a3-b369-da020f75ab51 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.269989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92fd7-fea6-48a3-b369-da020f75ab51 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.270534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92fd7-fea6-48a3-b369-da020f75ab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.327906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-03c92fd7-fea6-48a3-b369-da020f75ab51 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:04.328877 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1969/3961] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:04 2022] POST /identity/v3/projects => generated 397 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:04.330493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc3be7-df4a-4bf7-af2f-9021b254b2cb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.331018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc3be7-df4a-4bf7-af2f-9021b254b2cb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.331514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc3be7-df4a-4bf7-af2f-9021b254b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.335281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-03c92fd7-fea6-48a3-b369-da020f75ab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:04.360010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b4dc3be7-df4a-4bf7-af2f-9021b254b2cb None None] MFA Rules not processed for user `c9ac716a6af441a4bc02d8ef11f81487`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:04.361456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b4dc3be7-df4a-4bf7-af2f-9021b254b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:04.406840 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:04.487744 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1993/3962] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:04.490887 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1970/3963] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:04.491641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92fd7-fea6-48a3-b369-da020f75ab51 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.513796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92fd7-fea6-48a3-b369-da020f75ab51 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.520478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc3be7-df4a-4bf7-af2f-9021b254b2cb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.522375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b4dc3be7-df4a-4bf7-af2f-9021b254b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:04.524662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e16ebc-a8a0-41e7-9c31-95de9c1efbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.525306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16ebc-a8a0-41e7-9c31-95de9c1efbda admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.525591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16ebc-a8a0-41e7-9c31-95de9c1efbda admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.525867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16ebc-a8a0-41e7-9c31-95de9c1efbda admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.526568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e16ebc-a8a0-41e7-9c31-95de9c1efbda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.531355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e16ebc-a8a0-41e7-9c31-95de9c1efbda admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.600534 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1994/3964] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:04 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:04.601555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e16ebc-a8a0-41e7-9c31-95de9c1efbda admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.624052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc3be7-df4a-4bf7-af2f-9021b254b2cb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.625445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e16ebc-a8a0-41e7-9c31-95de9c1efbda admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.628836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3119a1b-2642-4936-86a1-84c29986e131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.629475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119a1b-2642-4936-86a1-84c29986e131 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.629758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119a1b-2642-4936-86a1-84c29986e131 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.630043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119a1b-2642-4936-86a1-84c29986e131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.640289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7edcf-b73d-4e25-8dce-d2903f52dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.640965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7edcf-b73d-4e25-8dce-d2903f52dd82 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.641237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7edcf-b73d-4e25-8dce-d2903f52dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.641515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7edcf-b73d-4e25-8dce-d2903f52dd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.642179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7edcf-b73d-4e25-8dce-d2903f52dd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.643867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7edcf-b73d-4e25-8dce-d2903f52dd82 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.662592 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1995/3965] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:59:04.667044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3119a1b-2642-4936-86a1-84c29986e131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.668564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3119a1b-2642-4936-86a1-84c29986e131 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.671297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7edcf-b73d-4e25-8dce-d2903f52dd82 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.696761 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1971/3966] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:59:04.697148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7edcf-b73d-4e25-8dce-d2903f52dd82 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.703800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72ea2-fb06-441f-91ca-dff1efd8a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.704445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72ea2-fb06-441f-91ca-dff1efd8a7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.704790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72ea2-fb06-441f-91ca-dff1efd8a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.705028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72ea2-fb06-441f-91ca-dff1efd8a7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.705681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c72ea2-fb06-441f-91ca-dff1efd8a7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.707308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c72ea2-fb06-441f-91ca-dff1efd8a7b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.729394 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1996/3967] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:04.733325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3119a1b-2642-4936-86a1-84c29986e131 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:04.744457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3119a1b-2642-4936-86a1-84c29986e131 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:04.749609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781515e3-cbbf-48bf-8fa1-78bf2be2a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:04.750286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781515e3-cbbf-48bf-8fa1-78bf2be2a941 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.750569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781515e3-cbbf-48bf-8fa1-78bf2be2a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.750892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781515e3-cbbf-48bf-8fa1-78bf2be2a941 admin admin] PATH_INFO: `/v3/projects/cef9dd5beb6746f893862247176d137b/users/d022dcfaa1e949118cd27a3a6217092d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.769943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781515e3-cbbf-48bf-8fa1-78bf2be2a941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef9dd5beb6746f893862247176d137b, user_id=d022dcfaa1e949118cd27a3a6217092d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:04.773914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781515e3-cbbf-48bf-8fa1-78bf2be2a941 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:04.808457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef938da-349d-49c2-be5f-72e07d6a6e66 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.808865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef938da-349d-49c2-be5f-72e07d6a6e66 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.809147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef938da-349d-49c2-be5f-72e07d6a6e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:04.812543 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1972/3968] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:04 2022] PUT /identity/v3/projects/cef9dd5beb6746f893862247176d137b/users/d022dcfaa1e949118cd27a3a6217092d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:04.845184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aef938da-349d-49c2-be5f-72e07d6a6e66 None None] MFA Rules not processed for user `d022dcfaa1e949118cd27a3a6217092d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:04.847804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aef938da-349d-49c2-be5f-72e07d6a6e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:04.986862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691efc23-8234-41ec-ac4a-00926be419a7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:04.987156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691efc23-8234-41ec-ac4a-00926be419a7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:04.987433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691efc23-8234-41ec-ac4a-00926be419a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:05.010103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1997/3969] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:05.032298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-691efc23-8234-41ec-ac4a-00926be419a7 None None] MFA Rules not processed for user `d022dcfaa1e949118cd27a3a6217092d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:05.034880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-691efc23-8234-41ec-ac4a-00926be419a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:05.059868 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1973/3970] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:05.904256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef938da-349d-49c2-be5f-72e07d6a6e66 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:05.911137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aef938da-349d-49c2-be5f-72e07d6a6e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:06.038143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef938da-349d-49c2-be5f-72e07d6a6e66 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:06.047749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e685fe-cac7-4db0-a19d-a4c8f7efe834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:06.048386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e685fe-cac7-4db0-a19d-a4c8f7efe834 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:06.048709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e685fe-cac7-4db0-a19d-a4c8f7efe834 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:06.049176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e685fe-cac7-4db0-a19d-a4c8f7efe834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:06.058330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e685fe-cac7-4db0-a19d-a4c8f7efe834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:06.060598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e685fe-cac7-4db0-a19d-a4c8f7efe834 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:06.072575 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1998/3971] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:05 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:06.122189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e75f8-8c72-47cc-bed1-bd2953f22a0e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:06.122647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e75f8-8c72-47cc-bed1-bd2953f22a0e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:06.122647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e75f8-8c72-47cc-bed1-bd2953f22a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:06.157300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c39e75f8-8c72-47cc-bed1-bd2953f22a0e None None] MFA Rules not processed for user `d022dcfaa1e949118cd27a3a6217092d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:06.158682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c39e75f8-8c72-47cc-bed1-bd2953f22a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:06.182657 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1974/3972] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:06.839548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066da823-38cc-4b54-9b3d-133f6584a1e6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:06.839845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066da823-38cc-4b54-9b3d-133f6584a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:06.840130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066da823-38cc-4b54-9b3d-133f6584a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:06.849558 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:06.882122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-066da823-38cc-4b54-9b3d-133f6584a1e6 None None] MFA Rules not processed for user `d022dcfaa1e949118cd27a3a6217092d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:06.884324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-066da823-38cc-4b54-9b3d-133f6584a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:06.903185 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 1999/3973] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:06.943969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07b32-6d21-4358-ac7f-aef3ab99abe4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:06.944263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07b32-6d21-4358-ac7f-aef3ab99abe4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:06.944537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07b32-6d21-4358-ac7f-aef3ab99abe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:07.001137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-12f07b32-6d21-4358-ac7f-aef3ab99abe4 None None] MFA Rules not processed for user `d022dcfaa1e949118cd27a3a6217092d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:07.007139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-12f07b32-6d21-4358-ac7f-aef3ab99abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:07.038580 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1975/3974] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:07.067073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdfb54-bbd8-4ad4-9095-8ce9aead43dc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:07.067548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdfb54-bbd8-4ad4-9095-8ce9aead43dc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:07.068050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdfb54-bbd8-4ad4-9095-8ce9aead43dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:07.109714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f9fdfb54-bbd8-4ad4-9095-8ce9aead43dc None None] MFA Rules not processed for user `d022dcfaa1e949118cd27a3a6217092d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:07.112387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f9fdfb54-bbd8-4ad4-9095-8ce9aead43dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:07.138337 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2000/3975] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:07.172862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07b32-6d21-4358-ac7f-aef3ab99abe4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:07.177227 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:07.339339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07b32-6d21-4358-ac7f-aef3ab99abe4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:07.357224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:07.358187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:07.358647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:07.359276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] PATH_INFO: `/v3/users/d022dcfaa1e949118cd27a3a6217092d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:07.361311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d022dcfaa1e949118cd27a3a6217092d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:07.363474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:07.446677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd022dcfaa1e949118cd27a3a6217092d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:07.461421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd022dcfaa1e949118cd27a3a6217092d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:07.473640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd022dcfaa1e949118cd27a3a6217092d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:07.486385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd022dcfaa1e949118cd27a3a6217092d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:07.487815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd022dcfaa1e949118cd27a3a6217092d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:07.502600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19470ae-e086-4ea3-9090-78fbd255b8ec None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:07.502785 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1976/3976] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:07 2022] DELETE /identity/v3/users/d022dcfaa1e949118cd27a3a6217092d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:07.503078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19470ae-e086-4ea3-9090-78fbd255b8ec None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:07.503457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19470ae-e086-4ea3-9090-78fbd255b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:07.539431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b19470ae-e086-4ea3-9090-78fbd255b8ec None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:07.541301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b19470ae-e086-4ea3-9090-78fbd255b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:07.672914 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2001/3977] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:07.737390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:07.740214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:07.836736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788deb8-3e3f-4a9d-8c1d-4df139478f58 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:07.843052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ec110-45c2-408e-b543-39b3199f29b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:07.843917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ec110-45c2-408e-b543-39b3199f29b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:07.845421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ec110-45c2-408e-b543-39b3199f29b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:07.846424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ec110-45c2-408e-b543-39b3199f29b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:07.865162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ec110-45c2-408e-b543-39b3199f29b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:07.867386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ec110-45c2-408e-b543-39b3199f29b0 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:07.906689 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1977/3978] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:09.914425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19470ae-e086-4ea3-9090-78fbd255b8ec None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:09.916759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b19470ae-e086-4ea3-9090-78fbd255b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:09.937763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19470ae-e086-4ea3-9090-78fbd255b8ec None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:09.948013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:09.948476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:09.948942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:09.950060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] PATH_INFO: `/v3/projects/cef9dd5beb6746f893862247176d137b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:09.952585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef9dd5beb6746f893862247176d137b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:09.958227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:10.120921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef9dd5beb6746f893862247176d137b', 'request_id': 'req-a1aaaa20-c0fb-4e04-b01a-60500b963c80'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:10.145533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef9dd5beb6746f893862247176d137b', 'request_id': 'req-a1aaaa20-c0fb-4e04-b01a-60500b963c80'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:10.162306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef9dd5beb6746f893862247176d137b', 'request_id': 'req-a1aaaa20-c0fb-4e04-b01a-60500b963c80'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:10.203211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] The token cache is being invalidate because project cef9dd5beb6746f893862247176d137b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:10.203790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:10.206131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a1aaaa20-c0fb-4e04-b01a-60500b963c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:10.213779 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2002/3979] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:09 2022] DELETE /identity/v3/projects/cef9dd5beb6746f893862247176d137b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:10.216783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615824f-09eb-429f-a4ea-d748f7245fb0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:10.219319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615824f-09eb-429f-a4ea-d748f7245fb0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:10.220055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615824f-09eb-429f-a4ea-d748f7245fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:10.271105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8615824f-09eb-429f-a4ea-d748f7245fb0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:10.273470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8615824f-09eb-429f-a4ea-d748f7245fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:10.327105 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:10.422635 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1978/3980] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:10.424322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a41739-8ed4-466c-8784-77abf93b3ea3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:10.424964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a41739-8ed4-466c-8784-77abf93b3ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:10.425367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a41739-8ed4-466c-8784-77abf93b3ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:10.502682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f5a41739-8ed4-466c-8784-77abf93b3ea3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:10.504333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f5a41739-8ed4-466c-8784-77abf93b3ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:10.525859 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2003/3981] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:10.528351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615824f-09eb-429f-a4ea-d748f7245fb0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:10.543857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615824f-09eb-429f-a4ea-d748f7245fb0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:10.560301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d6592-be9f-4ef6-b506-89b65d8503d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:10.565190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d6592-be9f-4ef6-b506-89b65d8503d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:10.565720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d6592-be9f-4ef6-b506-89b65d8503d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:10.566160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d6592-be9f-4ef6-b506-89b65d8503d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:10.567196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d6592-be9f-4ef6-b506-89b65d8503d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:10.567918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d6592-be9f-4ef6-b506-89b65d8503d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:10.580786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d6592-be9f-4ef6-b506-89b65d8503d0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:10.609271 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1979/3982] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:59:10.613187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a41739-8ed4-466c-8784-77abf93b3ea3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:10.635792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a41739-8ed4-466c-8784-77abf93b3ea3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:10.643332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887529d9-bddc-48e0-809e-4d90f31f6a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:10.643850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887529d9-bddc-48e0-809e-4d90f31f6a18 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:10.644261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887529d9-bddc-48e0-809e-4d90f31f6a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:10.644473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887529d9-bddc-48e0-809e-4d90f31f6a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:10.645207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887529d9-bddc-48e0-809e-4d90f31f6a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:10.648392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887529d9-bddc-48e0-809e-4d90f31f6a18 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:10.724422 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2004/3983] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:10 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:59:10.729138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d6592-be9f-4ef6-b506-89b65d8503d0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:10.746358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d6592-be9f-4ef6-b506-89b65d8503d0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:10.833700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7e922-159a-458c-b906-58c9885af46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:10.833700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7e922-159a-458c-b906-58c9885af46d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:10.833700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7e922-159a-458c-b906-58c9885af46d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:10.833700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7e922-159a-458c-b906-58c9885af46d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:10.834104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7e922-159a-458c-b906-58c9885af46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:10.835214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7e922-159a-458c-b906-58c9885af46d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:10.890901 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1980/3984] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:10 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:10.892263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887529d9-bddc-48e0-809e-4d90f31f6a18 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:10.906232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887529d9-bddc-48e0-809e-4d90f31f6a18 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:10.919577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7644d20-1dab-4a89-a8e1-1ac3114d375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:10.920280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7644d20-1dab-4a89-a8e1-1ac3114d375b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:10.920483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7644d20-1dab-4a89-a8e1-1ac3114d375b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:10.920825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7644d20-1dab-4a89-a8e1-1ac3114d375b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:10.921485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7644d20-1dab-4a89-a8e1-1ac3114d375b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:10.923096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7644d20-1dab-4a89-a8e1-1ac3114d375b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:10.941804 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2005/3985] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:10.942470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7e922-159a-458c-b906-58c9885af46d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:10.956613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7e922-159a-458c-b906-58c9885af46d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:10.963266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868b339-21b6-45ce-bfe7-487007ffa240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:10.964991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868b339-21b6-45ce-bfe7-487007ffa240 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:10.965439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868b339-21b6-45ce-bfe7-487007ffa240 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:10.966036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868b339-21b6-45ce-bfe7-487007ffa240 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:10.967497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868b339-21b6-45ce-bfe7-487007ffa240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:10.969365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868b339-21b6-45ce-bfe7-487007ffa240 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:10.991731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7644d20-1dab-4a89-a8e1-1ac3114d375b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:11.014919 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1981/3986] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:11.016954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7644d20-1dab-4a89-a8e1-1ac3114d375b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:11.025496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f9218-c3fe-4d76-a69c-8038669eae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:11.026407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f9218-c3fe-4d76-a69c-8038669eae87 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:11.026869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f9218-c3fe-4d76-a69c-8038669eae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:11.027298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f9218-c3fe-4d76-a69c-8038669eae87 admin admin] PATH_INFO: `/v3/projects/743f53c93e3a415494d68d463e32f83a/users/3c8c797ddeb546fd932fd1e6b392304b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:11.046909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f9218-c3fe-4d76-a69c-8038669eae87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743f53c93e3a415494d68d463e32f83a, user_id=3c8c797ddeb546fd932fd1e6b392304b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:11.050159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f9218-c3fe-4d76-a69c-8038669eae87 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:11.082029 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2006/3987] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:10 2022] PUT /identity/v3/projects/743f53c93e3a415494d68d463e32f83a/users/3c8c797ddeb546fd932fd1e6b392304b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:11.186314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3c04c-9865-4e23-8f51-ac33afae2d8a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:11.186674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3c04c-9865-4e23-8f51-ac33afae2d8a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:11.186858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3c04c-9865-4e23-8f51-ac33afae2d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:11.246442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c5b3c04c-9865-4e23-8f51-ac33afae2d8a None None] MFA Rules not processed for user `3c8c797ddeb546fd932fd1e6b392304b`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:11.248444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c5b3c04c-9865-4e23-8f51-ac33afae2d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:11.402337 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1982/3988] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:11.404898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceab1e-d824-4ddb-b31f-f2fae050c479 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:11.406014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceab1e-d824-4ddb-b31f-f2fae050c479 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:11.406431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceab1e-d824-4ddb-b31f-f2fae050c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:11.483206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2dceab1e-d824-4ddb-b31f-f2fae050c479 None None] MFA Rules not processed for user `3c8c797ddeb546fd932fd1e6b392304b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:11.484822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2dceab1e-d824-4ddb-b31f-f2fae050c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:11.498681 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2007/3989] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:11.505863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3c04c-9865-4e23-8f51-ac33afae2d8a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:11.507484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c5b3c04c-9865-4e23-8f51-ac33afae2d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:11.534178 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:11.599568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3c04c-9865-4e23-8f51-ac33afae2d8a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:11.607921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288e90c-fa69-4165-adc1-26764d65b789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:11.609571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288e90c-fa69-4165-adc1-26764d65b789 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:11.610264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288e90c-fa69-4165-adc1-26764d65b789 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:11.610727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288e90c-fa69-4165-adc1-26764d65b789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:11.620864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288e90c-fa69-4165-adc1-26764d65b789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:11.622659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288e90c-fa69-4165-adc1-26764d65b789 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:11.634901 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1983/3990] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:13.783606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c965-8983-4383-b475-4ab3a990c922 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:13.784142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c965-8983-4383-b475-4ab3a990c922 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:13.784142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c965-8983-4383-b475-4ab3a990c922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:13.791896 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:13.831234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ebd1c965-8983-4383-b475-4ab3a990c922 None None] MFA Rules not processed for user `ce909e8b04834269b0194db091d7a777`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:13.832581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ebd1c965-8983-4383-b475-4ab3a990c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:13.965052 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2008/3991] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:13.973143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288e90c-fa69-4165-adc1-26764d65b789 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:13.995126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288e90c-fa69-4165-adc1-26764d65b789 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:14.003644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25578e9e-a666-451f-9eca-81d68310456c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:14.005407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25578e9e-a666-451f-9eca-81d68310456c service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:14.006123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25578e9e-a666-451f-9eca-81d68310456c service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:14.006602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25578e9e-a666-451f-9eca-81d68310456c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:14.019865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25578e9e-a666-451f-9eca-81d68310456c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:14.023025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25578e9e-a666-451f-9eca-81d68310456c service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:14.038015 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1984/3992] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:13 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:15.562451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c965-8983-4383-b475-4ab3a990c922 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:15.563913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ebd1c965-8983-4383-b475-4ab3a990c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:15.695824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c965-8983-4383-b475-4ab3a990c922 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:15.702355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:15.703021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:15.703309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:15.703582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] PATH_INFO: `/v3/users/897e6694b0d7402f87443b69a071c4d0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:15.705414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897e6694b0d7402f87443b69a071c4d0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:15.707692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:15.801324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897e6694b0d7402f87443b69a071c4d0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:15.819786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897e6694b0d7402f87443b69a071c4d0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:15.831076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897e6694b0d7402f87443b69a071c4d0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:15.843107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897e6694b0d7402f87443b69a071c4d0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:15.843980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897e6694b0d7402f87443b69a071c4d0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:15.854636 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2009/3993] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:15 2022] DELETE /identity/v3/users/897e6694b0d7402f87443b69a071c4d0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:15.859417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f569a-5092-4379-a748-656281464c59 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:15.859965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f569a-5092-4379-a748-656281464c59 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:15.860196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f569a-5092-4379-a748-656281464c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:15.882583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-021f569a-5092-4379-a748-656281464c59 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:15.884162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-021f569a-5092-4379-a748-656281464c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:15.978544 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1985/3994] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:16.030239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:16.032400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:16.050903 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:16.140770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea348266-5ef2-4f03-8c50-84de69199149 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:16.154066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed69a-e07b-4d3d-aef0-1eaf33b55f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:16.154720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed69a-e07b-4d3d-aef0-1eaf33b55f15 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:16.156974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed69a-e07b-4d3d-aef0-1eaf33b55f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:16.157271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed69a-e07b-4d3d-aef0-1eaf33b55f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:16.188561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ed69a-e07b-4d3d-aef0-1eaf33b55f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:16.189002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ed69a-e07b-4d3d-aef0-1eaf33b55f15 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:16.218070 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2010/3995] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:17.105982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f569a-5092-4379-a748-656281464c59 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:17.107441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-021f569a-5092-4379-a748-656281464c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:17.126510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f569a-5092-4379-a748-656281464c59 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:17.137441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:17.138095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:17.138540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:17.138981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] PATH_INFO: `/v3/projects/ae5f5f6bcf7e4ecd9975f48a7ec4ce4e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:17.141306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5f5f6bcf7e4ecd9975f48a7ec4ce4e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:17.145393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:17.361151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5f5f6bcf7e4ecd9975f48a7ec4ce4e', 'request_id': 'req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:17.387632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5f5f6bcf7e4ecd9975f48a7ec4ce4e', 'request_id': 'req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:17.418598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5f5f6bcf7e4ecd9975f48a7ec4ce4e', 'request_id': 'req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:17.461872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] The token cache is being invalidate because project ae5f5f6bcf7e4ecd9975f48a7ec4ce4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:17.462654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:17.470051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d02fcb4c-8215-428e-a094-1a1b2e2c62aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:17.473294 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1986/3996] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:17 2022] DELETE /identity/v3/projects/ae5f5f6bcf7e4ecd9975f48a7ec4ce4e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:17.479352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afc92a-3394-4163-b71e-66919fde8227 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:17.480147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afc92a-3394-4163-b71e-66919fde8227 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:17.480147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afc92a-3394-4163-b71e-66919fde8227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:17.528898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e8afc92a-3394-4163-b71e-66919fde8227 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:17.534901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e8afc92a-3394-4163-b71e-66919fde8227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:17.757145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887183eb-e129-4df7-839a-5970c17484eb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:17.758694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887183eb-e129-4df7-839a-5970c17484eb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:17.759523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887183eb-e129-4df7-839a-5970c17484eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:17.764668 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2011/3997] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:17.808717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-887183eb-e129-4df7-839a-5970c17484eb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:17.809952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-887183eb-e129-4df7-839a-5970c17484eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:17.855694 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1987/3998] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:17.858788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afc92a-3394-4163-b71e-66919fde8227 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:17.874332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afc92a-3394-4163-b71e-66919fde8227 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:17.893856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d3c49-08de-4d65-96f0-7bfeef6f292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:17.894835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d3c49-08de-4d65-96f0-7bfeef6f292d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:17.895173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d3c49-08de-4d65-96f0-7bfeef6f292d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:17.895520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d3c49-08de-4d65-96f0-7bfeef6f292d admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:17.901905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d3c49-08de-4d65-96f0-7bfeef6f292d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:17.902287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d3c49-08de-4d65-96f0-7bfeef6f292d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:17.904804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d3c49-08de-4d65-96f0-7bfeef6f292d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:17.932143 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2012/3999] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:17.937308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887183eb-e129-4df7-839a-5970c17484eb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:17.957953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887183eb-e129-4df7-839a-5970c17484eb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:17.968408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60d760-ac47-4316-bf74-6c3ab2cdc09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:17.971590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60d760-ac47-4316-bf74-6c3ab2cdc09f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:17.972246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60d760-ac47-4316-bf74-6c3ab2cdc09f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:17.972604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60d760-ac47-4316-bf74-6c3ab2cdc09f admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:17.973481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60d760-ac47-4316-bf74-6c3ab2cdc09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:17.976576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60d760-ac47-4316-bf74-6c3ab2cdc09f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:17.985093 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:18.067535 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1988/4000] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:17 2022] POST /identity/v3/projects => generated 403 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:18.071466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d3c49-08de-4d65-96f0-7bfeef6f292d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:18.102290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d3c49-08de-4d65-96f0-7bfeef6f292d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:18.245345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dfed4-d2ce-4281-8270-04cfee5e4e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:18.246264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dfed4-d2ce-4281-8270-04cfee5e4e43 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:18.246706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dfed4-d2ce-4281-8270-04cfee5e4e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:18.247136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dfed4-d2ce-4281-8270-04cfee5e4e43 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:18.247931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dfed4-d2ce-4281-8270-04cfee5e4e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:18.253166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dfed4-d2ce-4281-8270-04cfee5e4e43 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:18.294454 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2013/4001] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:18 2022] POST /identity/v3/users => generated 302 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:18.298426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60d760-ac47-4316-bf74-6c3ab2cdc09f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:18.314369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60d760-ac47-4316-bf74-6c3ab2cdc09f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:18.323193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad025d0-7707-40c9-8c7f-f1b149ca3ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:18.324572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad025d0-7707-40c9-8c7f-f1b149ca3ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:18.325048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad025d0-7707-40c9-8c7f-f1b149ca3ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:18.325501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad025d0-7707-40c9-8c7f-f1b149ca3ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:18.326381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad025d0-7707-40c9-8c7f-f1b149ca3ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:18.339548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad025d0-7707-40c9-8c7f-f1b149ca3ac9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:18.355015 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1989/4002] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:18.359218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dfed4-d2ce-4281-8270-04cfee5e4e43 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:18.371243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dfed4-d2ce-4281-8270-04cfee5e4e43 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:18.377130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71a92b-9503-46c1-9035-39df19137a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:18.377769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a92b-9503-46c1-9035-39df19137a26 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:18.378045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a92b-9503-46c1-9035-39df19137a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:18.378320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a92b-9503-46c1-9035-39df19137a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:18.378974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71a92b-9503-46c1-9035-39df19137a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:18.380921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71a92b-9503-46c1-9035-39df19137a26 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:18.397906 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2014/4003] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:18.399620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad025d0-7707-40c9-8c7f-f1b149ca3ac9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:18.414993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad025d0-7707-40c9-8c7f-f1b149ca3ac9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:18.422288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb48b36-5c09-410e-b11c-7b067ae12f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:18.428398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb48b36-5c09-410e-b11c-7b067ae12f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:18.429119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb48b36-5c09-410e-b11c-7b067ae12f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:18.429619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb48b36-5c09-410e-b11c-7b067ae12f6d admin admin] PATH_INFO: `/v3/projects/4aafd4a9c70e40aea754cf6e4506f42b/users/3da9c650010548e385183a449dde866e/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:18.461942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb48b36-5c09-410e-b11c-7b067ae12f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aafd4a9c70e40aea754cf6e4506f42b, user_id=3da9c650010548e385183a449dde866e, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:18.465621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb48b36-5c09-410e-b11c-7b067ae12f6d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:18.505424 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1990/4004] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:18 2022] PUT /identity/v3/projects/4aafd4a9c70e40aea754cf6e4506f42b/users/3da9c650010548e385183a449dde866e/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:18.516428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64604c08-4787-44cc-ac56-fc195f4a9e67 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:18.517786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64604c08-4787-44cc-ac56-fc195f4a9e67 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:18.518267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64604c08-4787-44cc-ac56-fc195f4a9e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:18.609453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-64604c08-4787-44cc-ac56-fc195f4a9e67 None None] MFA Rules not processed for user `3da9c650010548e385183a449dde866e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:18.614862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-64604c08-4787-44cc-ac56-fc195f4a9e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:18.638529 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:18.746369 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2015/4005] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:18.747497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb48b36-5c09-410e-b11c-7b067ae12f6d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:18.833074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb48b36-5c09-410e-b11c-7b067ae12f6d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:18.838573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2a6f6-588c-4e26-b6df-4b624ad025a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:18.839310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2a6f6-588c-4e26-b6df-4b624ad025a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:18.839669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2a6f6-588c-4e26-b6df-4b624ad025a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:18.840020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2a6f6-588c-4e26-b6df-4b624ad025a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:18.840850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2a6f6-588c-4e26-b6df-4b624ad025a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:18.842983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2a6f6-588c-4e26-b6df-4b624ad025a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:18.890384 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1991/4006] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:18 2022] POST /identity/v3/projects => generated 405 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:18.894105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64604c08-4787-44cc-ac56-fc195f4a9e67 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:18.907073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64604c08-4787-44cc-ac56-fc195f4a9e67 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:19.000268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252e6ec-e5b0-4130-b805-0035b69f6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:19.000941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e6ec-e5b0-4130-b805-0035b69f6f4e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:19.001524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e6ec-e5b0-4130-b805-0035b69f6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:19.001811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e6ec-e5b0-4130-b805-0035b69f6f4e admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:19.002606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252e6ec-e5b0-4130-b805-0035b69f6f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:19.004802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252e6ec-e5b0-4130-b805-0035b69f6f4e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:19.042464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2a6f6-588c-4e26-b6df-4b624ad025a8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:19.042673 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2016/4007] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:18 2022] POST /identity/v3/users => generated 309 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:19.055879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2a6f6-588c-4e26-b6df-4b624ad025a8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:19.061304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d23e56-06da-44de-b787-f76e21a6bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:19.065192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d23e56-06da-44de-b787-f76e21a6bb17 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:19.067256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d23e56-06da-44de-b787-f76e21a6bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:19.068369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d23e56-06da-44de-b787-f76e21a6bb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:19.069332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d23e56-06da-44de-b787-f76e21a6bb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:19.075867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d23e56-06da-44de-b787-f76e21a6bb17 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:19.109357 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1992/4008] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:19.113692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252e6ec-e5b0-4130-b805-0035b69f6f4e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:19.130386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252e6ec-e5b0-4130-b805-0035b69f6f4e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:19.145664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c145-8bd1-43d7-b461-bec18a976d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:19.146646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c145-8bd1-43d7-b461-bec18a976d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:19.148186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c145-8bd1-43d7-b461-bec18a976d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:19.151424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c145-8bd1-43d7-b461-bec18a976d1d admin admin] PATH_INFO: `/v3/projects/919880ea12894a72bb368f270df7c523/users/5886d12457d741a085bcd23615bbe3f6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:19.182397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228c145-8bd1-43d7-b461-bec18a976d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=919880ea12894a72bb368f270df7c523, user_id=5886d12457d741a085bcd23615bbe3f6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:19.186753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228c145-8bd1-43d7-b461-bec18a976d1d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:19.229418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2017/4009] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:19 2022] PUT /identity/v3/projects/919880ea12894a72bb368f270df7c523/users/5886d12457d741a085bcd23615bbe3f6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:19.234619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d23e56-06da-44de-b787-f76e21a6bb17 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:19.255504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d23e56-06da-44de-b787-f76e21a6bb17 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:19.451104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596531d-efc6-4287-8cd5-565fffc5d8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:19.451751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596531d-efc6-4287-8cd5-565fffc5d8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:19.451995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596531d-efc6-4287-8cd5-565fffc5d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:19.452329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596531d-efc6-4287-8cd5-565fffc5d8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:19.455539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596531d-efc6-4287-8cd5-565fffc5d8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:19.459728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596531d-efc6-4287-8cd5-565fffc5d8c7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:19.479584 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1993/4010] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:19.484219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c145-8bd1-43d7-b461-bec18a976d1d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:19.521644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c145-8bd1-43d7-b461-bec18a976d1d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:19.545187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0669d-1efe-4eb3-a49b-856ad0cfec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:19.546926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0669d-1efe-4eb3-a49b-856ad0cfec2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:19.547398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0669d-1efe-4eb3-a49b-856ad0cfec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:19.547848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0669d-1efe-4eb3-a49b-856ad0cfec2e admin admin] PATH_INFO: `/v3/projects/919880ea12894a72bb368f270df7c523/users/5886d12457d741a085bcd23615bbe3f6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:19.553173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0669d-1efe-4eb3-a49b-856ad0cfec2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=919880ea12894a72bb368f270df7c523, user_id=5886d12457d741a085bcd23615bbe3f6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:19.559236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0669d-1efe-4eb3-a49b-856ad0cfec2e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:19.596709 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2018/4011] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:19 2022] PUT /identity/v3/projects/919880ea12894a72bb368f270df7c523/users/5886d12457d741a085bcd23615bbe3f6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:19.613261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e62215-c9a9-48e9-9716-67b5fbb8b618 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:19.613550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e62215-c9a9-48e9-9716-67b5fbb8b618 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:19.613824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e62215-c9a9-48e9-9716-67b5fbb8b618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:19.705277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d3e62215-c9a9-48e9-9716-67b5fbb8b618 None None] MFA Rules not processed for user `5886d12457d741a085bcd23615bbe3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:19.712687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d3e62215-c9a9-48e9-9716-67b5fbb8b618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:19.740035 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:19.903557 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1994/4012] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:19 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:19.919779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0669d-1efe-4eb3-a49b-856ad0cfec2e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:19.922224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6ed0669d-1efe-4eb3-a49b-856ad0cfec2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:20.027665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0669d-1efe-4eb3-a49b-856ad0cfec2e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:20.032533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acca7ff-4b34-4bb4-a530-92d0def9b2f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:20.033252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acca7ff-4b34-4bb4-a530-92d0def9b2f1 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:20.033751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acca7ff-4b34-4bb4-a530-92d0def9b2f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:20.034231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acca7ff-4b34-4bb4-a530-92d0def9b2f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:20.048032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acca7ff-4b34-4bb4-a530-92d0def9b2f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:20.050091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acca7ff-4b34-4bb4-a530-92d0def9b2f1 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:20.065357 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2019/4013] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:19 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:20.254445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e62215-c9a9-48e9-9716-67b5fbb8b618 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:20.392673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e62215-c9a9-48e9-9716-67b5fbb8b618 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:20.408529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:20.409533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:20.409740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:20.410097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] PATH_INFO: `/v3/users/3da9c650010548e385183a449dde866e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:20.412757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da9c650010548e385183a449dde866e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:20.416030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:20.554979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da9c650010548e385183a449dde866e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:20.632295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da9c650010548e385183a449dde866e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:20.646285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da9c650010548e385183a449dde866e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:20.662247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da9c650010548e385183a449dde866e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:20.670675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da9c650010548e385183a449dde866e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:20.683333 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1995/4014] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:20 2022] DELETE /identity/v3/users/3da9c650010548e385183a449dde866e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:20.687812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c06e9-ffb0-4675-962f-3c26b1b7638c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:20.688335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c06e9-ffb0-4675-962f-3c26b1b7638c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:20.688441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c06e9-ffb0-4675-962f-3c26b1b7638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:20.705290 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:20.748901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a77c06e9-ffb0-4675-962f-3c26b1b7638c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:20.749520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:20.750431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a77c06e9-ffb0-4675-962f-3c26b1b7638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:20.755037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:20.834399 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:20.935596 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2020/4015] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:20.949214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c06e9-ffb0-4675-962f-3c26b1b7638c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:20.952496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a77c06e9-ffb0-4675-962f-3c26b1b7638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:20.963037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181ae56-b92d-42b0-8978-81e3240ab806 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:20.979876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:20.980552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:20.980867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:20.981150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] PATH_INFO: `/v3/users/ce909e8b04834269b0194db091d7a777` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:20.985725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce909e8b04834269b0194db091d7a777)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:20.991214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:21.100391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c06e9-ffb0-4675-962f-3c26b1b7638c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:21.107101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42cb9-be51-4bc9-959f-49b210057d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:21.108381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce909e8b04834269b0194db091d7a777'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:21.109051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42cb9-be51-4bc9-959f-49b210057d4f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:21.110147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42cb9-be51-4bc9-959f-49b210057d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:21.111234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42cb9-be51-4bc9-959f-49b210057d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:21.134194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce909e8b04834269b0194db091d7a777'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:21.136606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a42cb9-be51-4bc9-959f-49b210057d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:21.138717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a42cb9-be51-4bc9-959f-49b210057d4f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:21.151998 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2021/4016] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:21.152718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce909e8b04834269b0194db091d7a777'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:21.161990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce909e8b04834269b0194db091d7a777'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:21.163059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce909e8b04834269b0194db091d7a777'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:21.178953 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1996/4017] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:20 2022] DELETE /identity/v3/users/ce909e8b04834269b0194db091d7a777 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:21.628595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42cb9-be51-4bc9-959f-49b210057d4f service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:21.639392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42cb9-be51-4bc9-959f-49b210057d4f service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:21.735732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:21.737679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:21.850664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba21659-79d6-4a3a-985b-46ca4e43bf17 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:21.868853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:21.868853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:21.868853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:21.868853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] PATH_INFO: `/v3/projects/4aafd4a9c70e40aea754cf6e4506f42b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:21.869314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aafd4a9c70e40aea754cf6e4506f42b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:21.869314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:21.893519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:21.894950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:21.895405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:21.896121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] PATH_INFO: `/v3/projects/52bbc99b42784505908f1f9d2f1498d8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:21.897847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bbc99b42784505908f1f9d2f1498d8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:21.900906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:21.942972 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:21.946770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aafd4a9c70e40aea754cf6e4506f42b', 'request_id': 'req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:21.967925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aafd4a9c70e40aea754cf6e4506f42b', 'request_id': 'req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:21.979299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aafd4a9c70e40aea754cf6e4506f42b', 'request_id': 'req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.004427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bbc99b42784505908f1f9d2f1498d8', 'request_id': 'req-bb2c5436-f3d0-449f-bbac-23196115384a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.006479 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:22.013904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] The token cache is being invalidate because project 4aafd4a9c70e40aea754cf6e4506f42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:22.014373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.015234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.021577 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1997/4018] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:21 2022] DELETE /identity/v3/projects/4aafd4a9c70e40aea754cf6e4506f42b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:59:22.023822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:22.025567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bbc99b42784505908f1f9d2f1498d8', 'request_id': 'req-bb2c5436-f3d0-449f-bbac-23196115384a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.027532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:22.031937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bbc99b42784505908f1f9d2f1498d8', 'request_id': 'req-bb2c5436-f3d0-449f-bbac-23196115384a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.056876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] The token cache is being invalidate because project 52bbc99b42784505908f1f9d2f1498d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:22.057190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.059210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.062809 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2022/4019] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:21 2022] DELETE /identity/v3/projects/52bbc99b42784505908f1f9d2f1498d8 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:22.066398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:22.078346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:22.226082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41f2e-28ff-44ef-a2cf-a6b79a7f4f44 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:22.233213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c5436-f3d0-449f-bbac-23196115384a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:22.244314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:22.245003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:22.245281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:22.245554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] PATH_INFO: `/v3/users/5886d12457d741a085bcd23615bbe3f6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:22.247768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5886d12457d741a085bcd23615bbe3f6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:22.250657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:22.356633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3924b67-395f-4941-b4f0-f4dfb167b290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:22.357637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3924b67-395f-4941-b4f0-f4dfb167b290 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:22.358128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3924b67-395f-4941-b4f0-f4dfb167b290 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:22.358519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3924b67-395f-4941-b4f0-f4dfb167b290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:22.360700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e3924b67-395f-4941-b4f0-f4dfb167b290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:22.392255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5886d12457d741a085bcd23615bbe3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.396032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3924b67-395f-4941-b4f0-f4dfb167b290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:22.402460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3924b67-395f-4941-b4f0-f4dfb167b290 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:22.426100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5886d12457d741a085bcd23615bbe3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.427831 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1998/4020] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:22.430352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5351a6f-79c2-47a3-a89e-77ffdbe12e5a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:22.430640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5351a6f-79c2-47a3-a89e-77ffdbe12e5a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:22.430942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5351a6f-79c2-47a3-a89e-77ffdbe12e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:22.442199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5886d12457d741a085bcd23615bbe3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.456117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5886d12457d741a085bcd23615bbe3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.478449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2debdf95-a9bc-4333-b518-c89e45750777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5886d12457d741a085bcd23615bbe3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:22.479915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e5351a6f-79c2-47a3-a89e-77ffdbe12e5a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:22.481397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e5351a6f-79c2-47a3-a89e-77ffdbe12e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:22.493610 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2023/4021] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:22 2022] DELETE /identity/v3/users/5886d12457d741a085bcd23615bbe3f6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:22.510160 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 1999/4022] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:22.512531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada672a-0646-4dc7-9798-955a1772515b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:22.513063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada672a-0646-4dc7-9798-955a1772515b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:22.513539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada672a-0646-4dc7-9798-955a1772515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:22.571502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cada672a-0646-4dc7-9798-955a1772515b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:22.572799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cada672a-0646-4dc7-9798-955a1772515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:22.678480 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:22.698061 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2024/4023] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:22.703161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5351a6f-79c2-47a3-a89e-77ffdbe12e5a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:22.716100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5351a6f-79c2-47a3-a89e-77ffdbe12e5a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:22.729604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab076e-3a7c-49f4-800a-a74a6d4a4aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:22.730339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab076e-3a7c-49f4-800a-a74a6d4a4aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:22.730687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab076e-3a7c-49f4-800a-a74a6d4a4aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:22.731036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab076e-3a7c-49f4-800a-a74a6d4a4aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:22.731994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab076e-3a7c-49f4-800a-a74a6d4a4aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:22.732394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab076e-3a7c-49f4-800a-a74a6d4a4aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:22.734373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab076e-3a7c-49f4-800a-a74a6d4a4aa9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:22.760214 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2000/4024] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:22.765022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada672a-0646-4dc7-9798-955a1772515b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:22.777231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada672a-0646-4dc7-9798-955a1772515b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:22.782735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9976a9-bafe-4770-a3bc-b294ad0701b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:22.783366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9976a9-bafe-4770-a3bc-b294ad0701b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:22.783647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9976a9-bafe-4770-a3bc-b294ad0701b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:22.784079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9976a9-bafe-4770-a3bc-b294ad0701b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:22.785008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9976a9-bafe-4770-a3bc-b294ad0701b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:22.787430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9976a9-bafe-4770-a3bc-b294ad0701b2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:22.839323 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2025/4025] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:22 2022] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:22.839879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab076e-3a7c-49f4-800a-a74a6d4a4aa9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:22.867783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab076e-3a7c-49f4-800a-a74a6d4a4aa9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:23.006779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f0c73-4eed-4cd7-93e8-86931e146c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:23.008849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f0c73-4eed-4cd7-93e8-86931e146c00 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:23.009448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f0c73-4eed-4cd7-93e8-86931e146c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:23.009976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f0c73-4eed-4cd7-93e8-86931e146c00 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:23.011023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f0c73-4eed-4cd7-93e8-86931e146c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:23.013816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f0c73-4eed-4cd7-93e8-86931e146c00 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:23.077689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9976a9-bafe-4770-a3bc-b294ad0701b2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:23.095333 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2001/4026] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:22 2022] POST /identity/v3/users => generated 282 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:59:23.115720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9976a9-bafe-4770-a3bc-b294ad0701b2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:23.140554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566ad0c-9342-4a06-8fdf-c116ebfeae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:23.141211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566ad0c-9342-4a06-8fdf-c116ebfeae82 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:23.141493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566ad0c-9342-4a06-8fdf-c116ebfeae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:23.141769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566ad0c-9342-4a06-8fdf-c116ebfeae82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:23.142437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566ad0c-9342-4a06-8fdf-c116ebfeae82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:23.144036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566ad0c-9342-4a06-8fdf-c116ebfeae82 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:23.162761 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2026/4027] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:23.166476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f0c73-4eed-4cd7-93e8-86931e146c00 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:23.180185 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:23.188277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f0c73-4eed-4cd7-93e8-86931e146c00 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:23.206996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ad45b-51f4-47ba-9291-7983392eaaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:23.209281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ad45b-51f4-47ba-9291-7983392eaaff admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:23.209674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ad45b-51f4-47ba-9291-7983392eaaff admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:23.210059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ad45b-51f4-47ba-9291-7983392eaaff admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:23.212114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ad45b-51f4-47ba-9291-7983392eaaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:23.218324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ad45b-51f4-47ba-9291-7983392eaaff admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:23.246164 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2002/4028] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:23.252459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566ad0c-9342-4a06-8fdf-c116ebfeae82 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:23.267960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566ad0c-9342-4a06-8fdf-c116ebfeae82 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:23.281787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57313cc1-4c27-48b2-b743-0a00fc033113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:23.282487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57313cc1-4c27-48b2-b743-0a00fc033113 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:23.282769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57313cc1-4c27-48b2-b743-0a00fc033113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:23.283042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57313cc1-4c27-48b2-b743-0a00fc033113 admin admin] PATH_INFO: `/v3/projects/d0a15ec11a0f4e33941010967cdc55f3/users/1f062f2ecc0547ae960ed98e7aeef9ee/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:23.317676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57313cc1-4c27-48b2-b743-0a00fc033113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a15ec11a0f4e33941010967cdc55f3, user_id=1f062f2ecc0547ae960ed98e7aeef9ee, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:23.320484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57313cc1-4c27-48b2-b743-0a00fc033113 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:23.342212 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2027/4029] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:23 2022] PUT /identity/v3/projects/d0a15ec11a0f4e33941010967cdc55f3/users/1f062f2ecc0547ae960ed98e7aeef9ee/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:23.348462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d1075-7d26-49de-853c-46fe0e1d4ee6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:23.349532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d1075-7d26-49de-853c-46fe0e1d4ee6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:23.350362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d1075-7d26-49de-853c-46fe0e1d4ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:23.387884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-039d1075-7d26-49de-853c-46fe0e1d4ee6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:23.394187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-039d1075-7d26-49de-853c-46fe0e1d4ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:23.526269 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2003/4030] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:23.663013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57313cc1-4c27-48b2-b743-0a00fc033113 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:23.665213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d1075-7d26-49de-853c-46fe0e1d4ee6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:23.665603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-57313cc1-4c27-48b2-b743-0a00fc033113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:23.667606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-039d1075-7d26-49de-853c-46fe0e1d4ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:23.692248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d1075-7d26-49de-853c-46fe0e1d4ee6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:23.716325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:23.717165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:23.717931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:23.718717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] PATH_INFO: `/v3/projects/919880ea12894a72bb368f270df7c523` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:23.765924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919880ea12894a72bb368f270df7c523)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:23.776910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:23.804188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57313cc1-4c27-48b2-b743-0a00fc033113 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:23.813652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0c06-2e17-4372-b088-c7bd5ee90899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:23.814561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0c06-2e17-4372-b088-c7bd5ee90899 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:23.816713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0c06-2e17-4372-b088-c7bd5ee90899 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:23.817200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0c06-2e17-4372-b088-c7bd5ee90899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:23.842300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e0c06-2e17-4372-b088-c7bd5ee90899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:23.844714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e0c06-2e17-4372-b088-c7bd5ee90899 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:23.873067 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2028/4031] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:23.917636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919880ea12894a72bb368f270df7c523', 'request_id': 'req-e4c62607-99bf-458d-b680-10ef061738c6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:23.971814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919880ea12894a72bb368f270df7c523', 'request_id': 'req-e4c62607-99bf-458d-b680-10ef061738c6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:24.010692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919880ea12894a72bb368f270df7c523', 'request_id': 'req-e4c62607-99bf-458d-b680-10ef061738c6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:24.061459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] The token cache is being invalidate because project 919880ea12894a72bb368f270df7c523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:24.062471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:24.064838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:24.074689 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2004/4032] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:23 2022] DELETE /identity/v3/projects/919880ea12894a72bb368f270df7c523 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:24.079472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66a200-6166-43f3-941f-3327a564bd73 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:24.080098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66a200-6166-43f3-941f-3327a564bd73 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:24.080098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66a200-6166-43f3-941f-3327a564bd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:24.130977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9f66a200-6166-43f3-941f-3327a564bd73 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:24.139980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9f66a200-6166-43f3-941f-3327a564bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:24.221275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:24.222923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:24.364163 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2029/4033] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:24.364163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66a200-6166-43f3-941f-3327a564bd73 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:24.364163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9f66a200-6166-43f3-941f-3327a564bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:24.384778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c62607-99bf-458d-b680-10ef061738c6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:24.402596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:24.407191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:24.409829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:24.410567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] PATH_INFO: `/v3/users/3c8c797ddeb546fd932fd1e6b392304b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:24.414986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8c797ddeb546fd932fd1e6b392304b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:24.423298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:24.481305 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:24.516384 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:24.567696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8c797ddeb546fd932fd1e6b392304b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:24.585087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66a200-6166-43f3-941f-3327a564bd73 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:24.592639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8c797ddeb546fd932fd1e6b392304b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:24.599620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478378c-a469-4604-ad33-f74a86e6a898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:24.600491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478378c-a469-4604-ad33-f74a86e6a898 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:24.600909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478378c-a469-4604-ad33-f74a86e6a898 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:24.601275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478378c-a469-4604-ad33-f74a86e6a898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:24.607841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d478378c-a469-4604-ad33-f74a86e6a898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:24.618482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8c797ddeb546fd932fd1e6b392304b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:24.630016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478378c-a469-4604-ad33-f74a86e6a898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:24.631751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478378c-a469-4604-ad33-f74a86e6a898 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:24.633064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8c797ddeb546fd932fd1e6b392304b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:24.634676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4dd0dfc5-63c3-4bc7-bd7d-101cf941981b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8c797ddeb546fd932fd1e6b392304b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:24.647746 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2005/4034] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:24 2022] DELETE /identity/v3/users/3c8c797ddeb546fd932fd1e6b392304b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:24.649890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cbb37-8f09-4aa9-b5a2-af936f524c44 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:24.650379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cbb37-8f09-4aa9-b5a2-af936f524c44 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:24.650904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cbb37-8f09-4aa9-b5a2-af936f524c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:24.653761 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2030/4035] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:24.655362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520eb7d-ac33-48a2-a796-1da2719019fd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:24.656758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520eb7d-ac33-48a2-a796-1da2719019fd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:24.657144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520eb7d-ac33-48a2-a796-1da2719019fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:24.683773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9520eb7d-ac33-48a2-a796-1da2719019fd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:24.685479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9520eb7d-ac33-48a2-a796-1da2719019fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:24.706244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-185cbb37-8f09-4aa9-b5a2-af936f524c44 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:24.707495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-185cbb37-8f09-4aa9-b5a2-af936f524c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:24.834014 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2031/4036] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:24.844815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520eb7d-ac33-48a2-a796-1da2719019fd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:24.847915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9520eb7d-ac33-48a2-a796-1da2719019fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:24.899882 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2006/4037] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:24.903815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cbb37-8f09-4aa9-b5a2-af936f524c44 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:24.913487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cbb37-8f09-4aa9-b5a2-af936f524c44 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:24.918969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5791b3-56cb-44a1-878c-0de0272c7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:24.919840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5791b3-56cb-44a1-878c-0de0272c7150 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:24.920331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5791b3-56cb-44a1-878c-0de0272c7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:24.920928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5791b3-56cb-44a1-878c-0de0272c7150 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:24.921756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5791b3-56cb-44a1-878c-0de0272c7150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:24.922211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5791b3-56cb-44a1-878c-0de0272c7150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:24.924153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5791b3-56cb-44a1-878c-0de0272c7150 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:24.942855 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2007/4038] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:59:24.944061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5791b3-56cb-44a1-878c-0de0272c7150 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:24.956496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5791b3-56cb-44a1-878c-0de0272c7150 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:24.962611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b3e0-006a-4ffc-9d9c-c7a380ff9a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:24.963722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b3e0-006a-4ffc-9d9c-c7a380ff9a35 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:24.964187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b3e0-006a-4ffc-9d9c-c7a380ff9a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:24.964679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b3e0-006a-4ffc-9d9c-c7a380ff9a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:24.965496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440b3e0-006a-4ffc-9d9c-c7a380ff9a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:24.967763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440b3e0-006a-4ffc-9d9c-c7a380ff9a35 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:25.022713 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2008/4039] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:24 2022] POST /identity/v3/projects => generated 407 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:25.024071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b3e0-006a-4ffc-9d9c-c7a380ff9a35 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:25.027622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7440b3e0-006a-4ffc-9d9c-c7a380ff9a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:25.059566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520eb7d-ac33-48a2-a796-1da2719019fd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:25.172859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc01803-9341-41d1-a61f-de21637deb63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:25.173665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc01803-9341-41d1-a61f-de21637deb63 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.173975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc01803-9341-41d1-a61f-de21637deb63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.174337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc01803-9341-41d1-a61f-de21637deb63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.185708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc01803-9341-41d1-a61f-de21637deb63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:25.187322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc01803-9341-41d1-a61f-de21637deb63 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:25.189950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b3e0-006a-4ffc-9d9c-c7a380ff9a35 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:25.199207 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2032/4040] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:59:25.200370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc01803-9341-41d1-a61f-de21637deb63 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:25.205414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:25.206118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.206406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.206688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] PATH_INFO: `/v3/users/e66b86aa194e429d9c13840d425ae279` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.208537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66b86aa194e429d9c13840d425ae279)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:25.210512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:25.213533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc01803-9341-41d1-a61f-de21637deb63 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:25.219660 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:25.227226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96b5ae-e780-46a2-a814-c7268d899f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:25.228879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96b5ae-e780-46a2-a814-c7268d899f4d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.230782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96b5ae-e780-46a2-a814-c7268d899f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.232774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96b5ae-e780-46a2-a814-c7268d899f4d admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.235962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96b5ae-e780-46a2-a814-c7268d899f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:25.240554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96b5ae-e780-46a2-a814-c7268d899f4d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:25.271644 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2033/4041] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:25 2022] POST /identity/v3/users => generated 304 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:25.276027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96b5ae-e780-46a2-a814-c7268d899f4d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:25.299537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96b5ae-e780-46a2-a814-c7268d899f4d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:25.315526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb08a9-9355-4ece-96c5-6046b120a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:25.317315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb08a9-9355-4ece-96c5-6046b120a4be admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.317838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb08a9-9355-4ece-96c5-6046b120a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.318507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb08a9-9355-4ece-96c5-6046b120a4be admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.320970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb08a9-9355-4ece-96c5-6046b120a4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:25.321892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66b86aa194e429d9c13840d425ae279'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:25.325731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb08a9-9355-4ece-96c5-6046b120a4be admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:25.341668 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:25.348551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66b86aa194e429d9c13840d425ae279'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:25.356532 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2034/4042] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:25.360757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb08a9-9355-4ece-96c5-6046b120a4be admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:25.363718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66b86aa194e429d9c13840d425ae279'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:25.377205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66b86aa194e429d9c13840d425ae279'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:25.379940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb08a9-9355-4ece-96c5-6046b120a4be admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:25.380570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8d5514e-4b88-4c4c-bedf-76e8dac38dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66b86aa194e429d9c13840d425ae279'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:25.394086 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2009/4043] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:25 2022] DELETE /identity/v3/users/e66b86aa194e429d9c13840d425ae279 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:25.395439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6147-6c0f-42f9-9486-64a4995d6ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:25.396190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6147-6c0f-42f9-9486-64a4995d6ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.396715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6147-6c0f-42f9-9486-64a4995d6ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.397339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6147-6c0f-42f9-9486-64a4995d6ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.398220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6147-6c0f-42f9-9486-64a4995d6ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:25.401548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6147-6c0f-42f9-9486-64a4995d6ee2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:25.402387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f46e5-e88b-4e52-b4db-87ea45c2f933 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.403046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f46e5-e88b-4e52-b4db-87ea45c2f933 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.403046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f46e5-e88b-4e52-b4db-87ea45c2f933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.415493 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2035/4044] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:25.420040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6147-6c0f-42f9-9486-64a4995d6ee2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:25.423061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b10d6147-6c0f-42f9-9486-64a4995d6ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:25.437712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6147-6c0f-42f9-9486-64a4995d6ee2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:25.452968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-db1f46e5-e88b-4e52-b4db-87ea45c2f933 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:25.456247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-db1f46e5-e88b-4e52-b4db-87ea45c2f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:25.568434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608e0cc-f6c9-4321-b1fe-89e8913c09dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:25.569543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e0cc-f6c9-4321-b1fe-89e8913c09dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.570022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e0cc-f6c9-4321-b1fe-89e8913c09dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.571550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e0cc-f6c9-4321-b1fe-89e8913c09dd admin admin] PATH_INFO: `/v3/projects/dabab42ac73d41a0a5e6c9aa6245b6de/users/67957cc7905241b8b1ecf9beca3928ec/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.589102 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2010/4045] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:25.598101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608e0cc-f6c9-4321-b1fe-89e8913c09dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabab42ac73d41a0a5e6c9aa6245b6de, user_id=67957cc7905241b8b1ecf9beca3928ec, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:25.601055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608e0cc-f6c9-4321-b1fe-89e8913c09dd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:25.606336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f46e5-e88b-4e52-b4db-87ea45c2f933 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:25.609222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-db1f46e5-e88b-4e52-b4db-87ea45c2f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:25.618868 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2036/4046] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:25 2022] PUT /identity/v3/projects/dabab42ac73d41a0a5e6c9aa6245b6de/users/67957cc7905241b8b1ecf9beca3928ec/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:59:25.629906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead666ad-2fb2-4f28-be6f-4dadeccb92c9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.630656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead666ad-2fb2-4f28-be6f-4dadeccb92c9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.631273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead666ad-2fb2-4f28-be6f-4dadeccb92c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.675054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ead666ad-2fb2-4f28-be6f-4dadeccb92c9 None None] MFA Rules not processed for user `67957cc7905241b8b1ecf9beca3928ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:25.677513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ead666ad-2fb2-4f28-be6f-4dadeccb92c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:25.783689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f46e5-e88b-4e52-b4db-87ea45c2f933 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:25.860319 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2037/4047] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:25 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:25.863632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead666ad-2fb2-4f28-be6f-4dadeccb92c9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:25.877323 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:25.920959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a367158-2371-46f4-b8fe-7bf1eaa917e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:25.921647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a367158-2371-46f4-b8fe-7bf1eaa917e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.921853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a367158-2371-46f4-b8fe-7bf1eaa917e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.922134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a367158-2371-46f4-b8fe-7bf1eaa917e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.977875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead666ad-2fb2-4f28-be6f-4dadeccb92c9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:25.983490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e48e27-50b7-41dd-a2bb-0001ff9e1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:25.984461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48e27-50b7-41dd-a2bb-0001ff9e1859 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:25.985895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48e27-50b7-41dd-a2bb-0001ff9e1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:25.986287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48e27-50b7-41dd-a2bb-0001ff9e1859 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:25.987042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e48e27-50b7-41dd-a2bb-0001ff9e1859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:25.989253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e48e27-50b7-41dd-a2bb-0001ff9e1859 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:25.998657 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:26.039864 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2038/4048] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:25 2022] POST /identity/v3/projects => generated 407 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:26.053934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e48e27-50b7-41dd-a2bb-0001ff9e1859 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:26.074646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a367158-2371-46f4-b8fe-7bf1eaa917e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:26.077742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a367158-2371-46f4-b8fe-7bf1eaa917e0 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:26.112242 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2011/4049] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:26.119961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a367158-2371-46f4-b8fe-7bf1eaa917e0 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:26.121511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4a367158-2371-46f4-b8fe-7bf1eaa917e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:26.145407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a367158-2371-46f4-b8fe-7bf1eaa917e0 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:26.194849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e48e27-50b7-41dd-a2bb-0001ff9e1859 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:26.209036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669ad75-60ab-49c2-94c8-ec3b459b68fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:26.209672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669ad75-60ab-49c2-94c8-ec3b459b68fe admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.209950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669ad75-60ab-49c2-94c8-ec3b459b68fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.210240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669ad75-60ab-49c2-94c8-ec3b459b68fe admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.210929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669ad75-60ab-49c2-94c8-ec3b459b68fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:26.214361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669ad75-60ab-49c2-94c8-ec3b459b68fe admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:26.283198 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2039/4050] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:26 2022] POST /identity/v3/users => generated 310 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:26.285510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669ad75-60ab-49c2-94c8-ec3b459b68fe admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:26.296672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:26.297450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.297721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.297996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] PATH_INFO: `/v3/projects/743f53c93e3a415494d68d463e32f83a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.302567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=743f53c93e3a415494d68d463e32f83a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:26.309714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:26.311338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669ad75-60ab-49c2-94c8-ec3b459b68fe admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:26.324772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8307e-216a-4d81-8d4c-ef80f57a551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:26.325831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8307e-216a-4d81-8d4c-ef80f57a551b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.325831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8307e-216a-4d81-8d4c-ef80f57a551b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.326681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8307e-216a-4d81-8d4c-ef80f57a551b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.328210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8307e-216a-4d81-8d4c-ef80f57a551b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:26.331557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8307e-216a-4d81-8d4c-ef80f57a551b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:26.357534 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2040/4051] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:26.363098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8307e-216a-4d81-8d4c-ef80f57a551b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:26.406039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8307e-216a-4d81-8d4c-ef80f57a551b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:26.418220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee60f37-1510-4b2d-96e6-354b0c86a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:26.419280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee60f37-1510-4b2d-96e6-354b0c86a22b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.419280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee60f37-1510-4b2d-96e6-354b0c86a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.419539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee60f37-1510-4b2d-96e6-354b0c86a22b admin admin] PATH_INFO: `/v3/projects/7f2b9295c9a7420ebed2b5a5138e3ebf/users/8dfb234c04a84f4fa245f4cb8370fb37/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.442455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743f53c93e3a415494d68d463e32f83a', 'request_id': 'req-58382ee0-f608-4e1d-847d-abb29298e43e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.455175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee60f37-1510-4b2d-96e6-354b0c86a22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2b9295c9a7420ebed2b5a5138e3ebf, user_id=8dfb234c04a84f4fa245f4cb8370fb37, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:26.458461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743f53c93e3a415494d68d463e32f83a', 'request_id': 'req-58382ee0-f608-4e1d-847d-abb29298e43e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.464205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee60f37-1510-4b2d-96e6-354b0c86a22b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:26.471262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743f53c93e3a415494d68d463e32f83a', 'request_id': 'req-58382ee0-f608-4e1d-847d-abb29298e43e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.497390 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2041/4052] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:26 2022] PUT /identity/v3/projects/7f2b9295c9a7420ebed2b5a5138e3ebf/users/8dfb234c04a84f4fa245f4cb8370fb37/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:26.502377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee60f37-1510-4b2d-96e6-354b0c86a22b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:26.506519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] The token cache is being invalidate because project 743f53c93e3a415494d68d463e32f83a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:26.506819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.507633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58382ee0-f608-4e1d-847d-abb29298e43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.514639 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2012/4053] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:26 2022] DELETE /identity/v3/projects/743f53c93e3a415494d68d463e32f83a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:59:26.520545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ec565-a244-4b72-ada5-9c11d090d603 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.520939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ec565-a244-4b72-ada5-9c11d090d603 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.521224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ec565-a244-4b72-ada5-9c11d090d603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.588520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cd8ec565-a244-4b72-ada5-9c11d090d603 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:26.592809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd8ec565-a244-4b72-ada5-9c11d090d603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:26.625237 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:26.668571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee60f37-1510-4b2d-96e6-354b0c86a22b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:26.681038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a85fb-7744-4e99-a37f-8d1e4fea4266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:26.681666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a85fb-7744-4e99-a37f-8d1e4fea4266 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.681943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a85fb-7744-4e99-a37f-8d1e4fea4266 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.682259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a85fb-7744-4e99-a37f-8d1e4fea4266 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.682911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a85fb-7744-4e99-a37f-8d1e4fea4266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:26.684575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a85fb-7744-4e99-a37f-8d1e4fea4266 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:26.708765 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2042/4054] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:26.709712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a85fb-7744-4e99-a37f-8d1e4fea4266 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:26.714610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f02a85fb-7744-4e99-a37f-8d1e4fea4266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:26.730334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a85fb-7744-4e99-a37f-8d1e4fea4266 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:26.732878 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2013/4055] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:26.734521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ec565-a244-4b72-ada5-9c11d090d603 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:26.737259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd8ec565-a244-4b72-ada5-9c11d090d603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:26.741276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:26.742493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.742975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.743406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] PATH_INFO: `/v3/projects/61e32b89779a4a27a2d5f6dae3951d37` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.745758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e32b89779a4a27a2d5f6dae3951d37)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:26.747849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:26.767467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ec565-a244-4b72-ada5-9c11d090d603 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:26.778740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331afd2-6a03-46ce-961a-d56ea882522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:26.781333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331afd2-6a03-46ce-961a-d56ea882522a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.783211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331afd2-6a03-46ce-961a-d56ea882522a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.783662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331afd2-6a03-46ce-961a-d56ea882522a admin admin] PATH_INFO: `/v3/projects/7f2b9295c9a7420ebed2b5a5138e3ebf/users/8dfb234c04a84f4fa245f4cb8370fb37/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.790170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331afd2-6a03-46ce-961a-d56ea882522a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2b9295c9a7420ebed2b5a5138e3ebf, user_id=8dfb234c04a84f4fa245f4cb8370fb37, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:26.792910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331afd2-6a03-46ce-961a-d56ea882522a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:26.816235 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2014/4056] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:26 2022] PUT /identity/v3/projects/7f2b9295c9a7420ebed2b5a5138e3ebf/users/8dfb234c04a84f4fa245f4cb8370fb37/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:26.829237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2ddb-8aa6-4856-877c-9e4046167a5c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.834041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2ddb-8aa6-4856-877c-9e4046167a5c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.834338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2ddb-8aa6-4856-877c-9e4046167a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.840095 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:26.864431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e32b89779a4a27a2d5f6dae3951d37', 'request_id': 'req-b6b2998d-e804-4820-9985-d6f5edaf54f5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.877120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4a5e2ddb-8aa6-4856-877c-9e4046167a5c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:26.878418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4a5e2ddb-8aa6-4856-877c-9e4046167a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:26.883243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e32b89779a4a27a2d5f6dae3951d37', 'request_id': 'req-b6b2998d-e804-4820-9985-d6f5edaf54f5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.892242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e32b89779a4a27a2d5f6dae3951d37', 'request_id': 'req-b6b2998d-e804-4820-9985-d6f5edaf54f5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.914895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] The token cache is being invalidate because project 61e32b89779a4a27a2d5f6dae3951d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:26.915183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.922144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6b2998d-e804-4820-9985-d6f5edaf54f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:26.924789 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2043/4057] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:26 2022] DELETE /identity/v3/projects/61e32b89779a4a27a2d5f6dae3951d37 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:26.928125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f0cb6-fce3-400c-96c9-2e919e170339 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:26.928413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f0cb6-fce3-400c-96c9-2e919e170339 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:26.928734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f0cb6-fce3-400c-96c9-2e919e170339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:26.990282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e96f0cb6-fce3-400c-96c9-2e919e170339 None None] MFA Rules not processed for user `8dfb234c04a84f4fa245f4cb8370fb37`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:26.991885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e96f0cb6-fce3-400c-96c9-2e919e170339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:27.025979 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2015/4058] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:27.028840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdaeaa-6402-4f84-9bfe-4e63afada535 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.029303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdaeaa-6402-4f84-9bfe-4e63afada535 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.029752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdaeaa-6402-4f84-9bfe-4e63afada535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.063728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-13fdaeaa-6402-4f84-9bfe-4e63afada535 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:27.065373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-13fdaeaa-6402-4f84-9bfe-4e63afada535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:27.093900 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2016/4059] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:27.095224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdaeaa-6402-4f84-9bfe-4e63afada535 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.107203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdaeaa-6402-4f84-9bfe-4e63afada535 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.113272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa77347-3a4c-479d-8336-48e3ead684a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.113965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa77347-3a4c-479d-8336-48e3ead684a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.114250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa77347-3a4c-479d-8336-48e3ead684a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.114528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa77347-3a4c-479d-8336-48e3ead684a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.115201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa77347-3a4c-479d-8336-48e3ead684a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:27.115510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa77347-3a4c-479d-8336-48e3ead684a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.117315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa77347-3a4c-479d-8336-48e3ead684a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.134194 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2017/4060] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:27.135306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29588b-6641-4dd9-9492-f5c6d1dcdb50 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.135595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29588b-6641-4dd9-9492-f5c6d1dcdb50 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.135880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29588b-6641-4dd9-9492-f5c6d1dcdb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.170723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-de29588b-6641-4dd9-9492-f5c6d1dcdb50 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:27.172002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-de29588b-6641-4dd9-9492-f5c6d1dcdb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:27.194671 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2044/4061] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:26 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:27.196822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f0cb6-fce3-400c-96c9-2e919e170339 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.201537 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2018/4062] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:27.205260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29588b-6641-4dd9-9492-f5c6d1dcdb50 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.217496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29588b-6641-4dd9-9492-f5c6d1dcdb50 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.219789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f0cb6-fce3-400c-96c9-2e919e170339 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.228274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.230473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.231254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ca5fa-45ba-4027-88a4-da4319ee0103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.232146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.232146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.233086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:27.233636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ca5fa-45ba-4027-88a4-da4319ee0103 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.233915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ca5fa-45ba-4027-88a4-da4319ee0103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.234208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ca5fa-45ba-4027-88a4-da4319ee0103 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.234844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ca5fa-45ba-4027-88a4-da4319ee0103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.236875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ca5fa-45ba-4027-88a4-da4319ee0103 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.237116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.238920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.263966 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2019/4063] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:27.265549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.267517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:27.295966 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2045/4064] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:27 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:27.297120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ca5fa-45ba-4027-88a4-da4319ee0103 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.399078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a700d3-99d1-4d95-8579-2b033758e637 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.431842 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:27.434533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ca5fa-45ba-4027-88a4-da4319ee0103 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.457437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63398314-bb50-40dd-8555-0dbd3677a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.458346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63398314-bb50-40dd-8555-0dbd3677a3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.458576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63398314-bb50-40dd-8555-0dbd3677a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.458959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63398314-bb50-40dd-8555-0dbd3677a3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.459736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63398314-bb50-40dd-8555-0dbd3677a3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.462379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63398314-bb50-40dd-8555-0dbd3677a3e9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.540770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a3942-2a46-4c5e-a85b-418d9640f352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.542048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a3942-2a46-4c5e-a85b-418d9640f352 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.542338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a3942-2a46-4c5e-a85b-418d9640f352 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.542621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a3942-2a46-4c5e-a85b-418d9640f352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.554714 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2046/4065] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:27 2022] POST /identity/v3/projects => generated 403 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:27.558567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63398314-bb50-40dd-8555-0dbd3677a3e9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.585246 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:27.693766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63398314-bb50-40dd-8555-0dbd3677a3e9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.723120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049928-dd20-48c0-85e8-47dc9ab2fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.725437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a3942-2a46-4c5e-a85b-418d9640f352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.727387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049928-dd20-48c0-85e8-47dc9ab2fb7e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.728319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049928-dd20-48c0-85e8-47dc9ab2fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.728606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049928-dd20-48c0-85e8-47dc9ab2fb7e admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.729309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049928-dd20-48c0-85e8-47dc9ab2fb7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.730863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a3942-2a46-4c5e-a85b-418d9640f352 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.734895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049928-dd20-48c0-85e8-47dc9ab2fb7e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.745338 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2020/4066] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:27 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:27.746810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a3942-2a46-4c5e-a85b-418d9640f352 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.763319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a3942-2a46-4c5e-a85b-418d9640f352 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.769496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e257a9c-c019-4041-8ba7-a1dc4a26eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.770724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e257a9c-c019-4041-8ba7-a1dc4a26eb05 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.771178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e257a9c-c019-4041-8ba7-a1dc4a26eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.771620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e257a9c-c019-4041-8ba7-a1dc4a26eb05 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.772105 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2047/4067] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:27 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:27.773428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e257a9c-c019-4041-8ba7-a1dc4a26eb05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.776589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e257a9c-c019-4041-8ba7-a1dc4a26eb05 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.777549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049928-dd20-48c0-85e8-47dc9ab2fb7e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.796507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049928-dd20-48c0-85e8-47dc9ab2fb7e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.806706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33627342-5eb4-4be9-af18-f2b9304c9126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.807666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33627342-5eb4-4be9-af18-f2b9304c9126 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.808162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33627342-5eb4-4be9-af18-f2b9304c9126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.808414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33627342-5eb4-4be9-af18-f2b9304c9126 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.809537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33627342-5eb4-4be9-af18-f2b9304c9126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.811793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33627342-5eb4-4be9-af18-f2b9304c9126 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.826531 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2021/4068] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:27 2022] POST /identity/v3/users => generated 302 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:27.829995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e257a9c-c019-4041-8ba7-a1dc4a26eb05 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.837522 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2048/4069] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:59:27.838866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33627342-5eb4-4be9-af18-f2b9304c9126 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.850626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e257a9c-c019-4041-8ba7-a1dc4a26eb05 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.858927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33627342-5eb4-4be9-af18-f2b9304c9126 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.864920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a671b-e749-4d99-b33b-8f80209a2baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.865907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a671b-e749-4d99-b33b-8f80209a2baa admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.866357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a671b-e749-4d99-b33b-8f80209a2baa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.866806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a671b-e749-4d99-b33b-8f80209a2baa admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.867668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a671b-e749-4d99-b33b-8f80209a2baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.869613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a671b-e749-4d99-b33b-8f80209a2baa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.870531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27c51f-3321-4452-ab5b-daa372397af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.871156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27c51f-3321-4452-ab5b-daa372397af0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.871434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27c51f-3321-4452-ab5b-daa372397af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.871719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27c51f-3321-4452-ab5b-daa372397af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.872353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27c51f-3321-4452-ab5b-daa372397af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.873966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27c51f-3321-4452-ab5b-daa372397af0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.884152 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2049/4070] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:27.888240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a671b-e749-4d99-b33b-8f80209a2baa admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.890611 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2022/4071] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:27.894443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27c51f-3321-4452-ab5b-daa372397af0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.900034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a671b-e749-4d99-b33b-8f80209a2baa admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.906309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23006d40-ba84-4197-afac-7f8eca5827ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.907071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006d40-ba84-4197-afac-7f8eca5827ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.907441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006d40-ba84-4197-afac-7f8eca5827ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.907791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006d40-ba84-4197-afac-7f8eca5827ce admin admin] PATH_INFO: `/v3/projects/d7cd9e94413f41e6aebee479e4c87705/users/77b49d34906d44819c47d0ad5f1a9bc4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.912480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27c51f-3321-4452-ab5b-daa372397af0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:27.917812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4b74-8cb2-4ea6-8745-ae087c26e3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:27.918508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4b74-8cb2-4ea6-8745-ae087c26e3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.918860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4b74-8cb2-4ea6-8745-ae087c26e3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.919204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4b74-8cb2-4ea6-8745-ae087c26e3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.919917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4b74-8cb2-4ea6-8745-ae087c26e3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.921839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4b74-8cb2-4ea6-8745-ae087c26e3e2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.937381 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2023/4072] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:27.941421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23006d40-ba84-4197-afac-7f8eca5827ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7cd9e94413f41e6aebee479e4c87705, user_id=77b49d34906d44819c47d0ad5f1a9bc4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:27.944154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23006d40-ba84-4197-afac-7f8eca5827ce admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:27.958247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4b74-8cb2-4ea6-8745-ae087c26e3e2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:27.976880 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2050/4073] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:27 2022] PUT /identity/v3/projects/d7cd9e94413f41e6aebee479e4c87705/users/77b49d34906d44819c47d0ad5f1a9bc4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:59:27.982258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d3955-0d1f-40fa-9367-4bcaed42db08 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:27.982550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d3955-0d1f-40fa-9367-4bcaed42db08 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:27.982833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d3955-0d1f-40fa-9367-4bcaed42db08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:27.986162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4b74-8cb2-4ea6-8745-ae087c26e3e2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:28.025844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c10d3955-0d1f-40fa-9367-4bcaed42db08 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:28.027069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c10d3955-0d1f-40fa-9367-4bcaed42db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:28.159082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d061c48-b972-4530-b7a9-c128ec234e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:28.159786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061c48-b972-4530-b7a9-c128ec234e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:28.160069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061c48-b972-4530-b7a9-c128ec234e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:28.160347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061c48-b972-4530-b7a9-c128ec234e24 admin admin] PATH_INFO: `/v3/projects/89e7564c2f6f47099d2e32639d05b43b/users/96179e626c3e4738bfd6712d3a622f26/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:28.184502 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2051/4074] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:28.185454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d3955-0d1f-40fa-9367-4bcaed42db08 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:28.192281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d061c48-b972-4530-b7a9-c128ec234e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e7564c2f6f47099d2e32639d05b43b, user_id=96179e626c3e4738bfd6712d3a622f26, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:28.204957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d061c48-b972-4530-b7a9-c128ec234e24 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:28.244545 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2024/4075] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:27 2022] PUT /identity/v3/projects/89e7564c2f6f47099d2e32639d05b43b/users/96179e626c3e4738bfd6712d3a622f26/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:28.245591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d061c48-b972-4530-b7a9-c128ec234e24 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:28.249556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3d061c48-b972-4530-b7a9-c128ec234e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:28.293331 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:28.328571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d3955-0d1f-40fa-9367-4bcaed42db08 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:28.340085 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:28.418683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d061c48-b972-4530-b7a9-c128ec234e24 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:28.428574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f883df-7aae-473d-a931-10076970cd10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:28.429284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f883df-7aae-473d-a931-10076970cd10 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:28.429634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f883df-7aae-473d-a931-10076970cd10 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:28.430453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f883df-7aae-473d-a931-10076970cd10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:28.431190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957aec4-0ba3-44c5-87b3-7992e7906f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:28.431825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957aec4-0ba3-44c5-87b3-7992e7906f9b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:28.432101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957aec4-0ba3-44c5-87b3-7992e7906f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:28.432593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957aec4-0ba3-44c5-87b3-7992e7906f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:28.437693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b8f883df-7aae-473d-a931-10076970cd10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:28.569434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957aec4-0ba3-44c5-87b3-7992e7906f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:28.572750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957aec4-0ba3-44c5-87b3-7992e7906f9b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:28.590956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f883df-7aae-473d-a931-10076970cd10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:28.592423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f883df-7aae-473d-a931-10076970cd10 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:28.603563 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2025/4076] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:28.625472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e3f9-35b3-40e3-9f45-19ec08a385cb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:28.625686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e3f9-35b3-40e3-9f45-19ec08a385cb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:28.631334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e3f9-35b3-40e3-9f45-19ec08a385cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:28.631820 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2052/4077] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:28 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:28.686067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c5a2e3f9-35b3-40e3-9f45-19ec08a385cb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:28.689887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c5a2e3f9-35b3-40e3-9f45-19ec08a385cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:28.709180 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2026/4078] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:28.721787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f883df-7aae-473d-a931-10076970cd10 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:28.750589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f883df-7aae-473d-a931-10076970cd10 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:28.761062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bd91d-508b-4e00-8dc9-6a1f5e6189cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:28.763095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd91d-508b-4e00-8dc9-6a1f5e6189cd service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:28.763378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd91d-508b-4e00-8dc9-6a1f5e6189cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:28.763660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd91d-508b-4e00-8dc9-6a1f5e6189cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:28.793013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bd91d-508b-4e00-8dc9-6a1f5e6189cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:28.794479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bd91d-508b-4e00-8dc9-6a1f5e6189cd service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:28.816955 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2053/4079] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:31.941288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2e3f9-35b3-40e3-9f45-19ec08a385cb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:31.949474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c5a2e3f9-35b3-40e3-9f45-19ec08a385cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:31.987380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2e3f9-35b3-40e3-9f45-19ec08a385cb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:32.002889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac9cb5-f844-49d9-b949-20a1f81eb943 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:32.003373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac9cb5-f844-49d9-b949-20a1f81eb943 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:32.003373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac9cb5-f844-49d9-b949-20a1f81eb943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:32.013034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:32.014664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:32.016477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:32.020789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] PATH_INFO: `/v3/users/d1f94c167c854cffb1ef9c36a278620d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:32.022542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f94c167c854cffb1ef9c36a278620d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:32.030406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:32.087185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1dac9cb5-f844-49d9-b949-20a1f81eb943 None None] MFA Rules not processed for user `96179e626c3e4738bfd6712d3a622f26`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:32.088857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1dac9cb5-f844-49d9-b949-20a1f81eb943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:32.182664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f94c167c854cffb1ef9c36a278620d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:32.238093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f94c167c854cffb1ef9c36a278620d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:32.257200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f94c167c854cffb1ef9c36a278620d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:32.281300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f94c167c854cffb1ef9c36a278620d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:32.282368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d266c598-cd16-495a-9c80-ee733fef82f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f94c167c854cffb1ef9c36a278620d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:32.298565 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2054/4080] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:32.303667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac9cb5-f844-49d9-b949-20a1f81eb943 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:32.309327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2027/4081] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:31 2022] DELETE /identity/v3/users/d1f94c167c854cffb1ef9c36a278620d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:32.310924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13962499-7247-48ab-a850-069d7bd45e95 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:32.311213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13962499-7247-48ab-a850-069d7bd45e95 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:32.311487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13962499-7247-48ab-a850-069d7bd45e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:32.349448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac9cb5-f844-49d9-b949-20a1f81eb943 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:32.355889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-13962499-7247-48ab-a850-069d7bd45e95 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:32.358014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-13962499-7247-48ab-a850-069d7bd45e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:32.413688 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:32.502672 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2028/4082] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:32.515456 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:32.529754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13962499-7247-48ab-a850-069d7bd45e95 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:32.531223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-13962499-7247-48ab-a850-069d7bd45e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:32.557733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355f713-a8d6-416a-b51e-c03ad195641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:32.564246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355f713-a8d6-416a-b51e-c03ad195641f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:32.564657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355f713-a8d6-416a-b51e-c03ad195641f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:32.565048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355f713-a8d6-416a-b51e-c03ad195641f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:32.571623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355f713-a8d6-416a-b51e-c03ad195641f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:32.574120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355f713-a8d6-416a-b51e-c03ad195641f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:32.643388 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2055/4083] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:32 2022] POST /identity/v3/projects => generated 403 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:59:32.647308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355f713-a8d6-416a-b51e-c03ad195641f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:32.649369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3355f713-a8d6-416a-b51e-c03ad195641f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:32.681964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13962499-7247-48ab-a850-069d7bd45e95 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:32.863851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355f713-a8d6-416a-b51e-c03ad195641f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:32.868876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949a48e-b303-4202-ba11-baf66ab0da88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:32.869525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949a48e-b303-4202-ba11-baf66ab0da88 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:32.873741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949a48e-b303-4202-ba11-baf66ab0da88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:32.874042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949a48e-b303-4202-ba11-baf66ab0da88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:32.885281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f0e96-793e-4156-a326-8a19ef8b7ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:32.885978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f0e96-793e-4156-a326-8a19ef8b7ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:32.886738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f0e96-793e-4156-a326-8a19ef8b7ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:32.886738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f0e96-793e-4156-a326-8a19ef8b7ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:32.887283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f0e96-793e-4156-a326-8a19ef8b7ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:32.889353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f0e96-793e-4156-a326-8a19ef8b7ff5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:32.902783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949a48e-b303-4202-ba11-baf66ab0da88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:32.904382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949a48e-b303-4202-ba11-baf66ab0da88 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:32.936946 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2029/4084] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:59:32.948366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949a48e-b303-4202-ba11-baf66ab0da88 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:32.951619 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2056/4085] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:32 2022] POST /identity/v3/users => generated 308 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:32.961090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949a48e-b303-4202-ba11-baf66ab0da88 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:32.968248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1c0cd-499c-4c0e-8495-8f8579c9b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:32.969348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1c0cd-499c-4c0e-8495-8f8579c9b95c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:32.970090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1c0cd-499c-4c0e-8495-8f8579c9b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:32.970534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1c0cd-499c-4c0e-8495-8f8579c9b95c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:32.972455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1c0cd-499c-4c0e-8495-8f8579c9b95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:32.974536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1c0cd-499c-4c0e-8495-8f8579c9b95c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:32.994098 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2030/4086] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:59:32.997417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f0e96-793e-4156-a326-8a19ef8b7ff5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:33.011080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f0e96-793e-4156-a326-8a19ef8b7ff5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:33.021376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d3d6-dd43-4be8-b723-bbe5e682feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:33.022334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d3d6-dd43-4be8-b723-bbe5e682feb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:33.022921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d3d6-dd43-4be8-b723-bbe5e682feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:33.023411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d3d6-dd43-4be8-b723-bbe5e682feb0 admin admin] PATH_INFO: `/v3/projects/5abdce90e81043d7adc5f063e5a46e92/users/0f876732e7574a089385ebade0f020e7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:33.068116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d3d6-dd43-4be8-b723-bbe5e682feb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abdce90e81043d7adc5f063e5a46e92, user_id=0f876732e7574a089385ebade0f020e7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:33.071581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d3d6-dd43-4be8-b723-bbe5e682feb0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:33.125346 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2057/4087] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:32 2022] PUT /identity/v3/projects/5abdce90e81043d7adc5f063e5a46e92/users/0f876732e7574a089385ebade0f020e7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:33.129245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1c0cd-499c-4c0e-8495-8f8579c9b95c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:33.141109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1c0cd-499c-4c0e-8495-8f8579c9b95c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:33.243598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c680f-965d-49f9-9678-f50ab57a778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:33.244569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c680f-965d-49f9-9678-f50ab57a778b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:33.244899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c680f-965d-49f9-9678-f50ab57a778b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:33.245175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c680f-965d-49f9-9678-f50ab57a778b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:33.245839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c680f-965d-49f9-9678-f50ab57a778b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:33.253507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c680f-965d-49f9-9678-f50ab57a778b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:33.281059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d3d6-dd43-4be8-b723-bbe5e682feb0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:33.294279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d3d6-dd43-4be8-b723-bbe5e682feb0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:33.294491 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2031/4088] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:33.301030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fab86c-5274-4c99-b808-297271dea6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:33.306648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fab86c-5274-4c99-b808-297271dea6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:33.306975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fab86c-5274-4c99-b808-297271dea6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:33.307227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fab86c-5274-4c99-b808-297271dea6f5 admin admin] PATH_INFO: `/v3/projects/5abdce90e81043d7adc5f063e5a46e92/users/0f876732e7574a089385ebade0f020e7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:33.309503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fab86c-5274-4c99-b808-297271dea6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abdce90e81043d7adc5f063e5a46e92, user_id=0f876732e7574a089385ebade0f020e7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:33.312205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fab86c-5274-4c99-b808-297271dea6f5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:33.340481 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2058/4089] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:33 2022] PUT /identity/v3/projects/5abdce90e81043d7adc5f063e5a46e92/users/0f876732e7574a089385ebade0f020e7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:33.708082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c680f-965d-49f9-9678-f50ab57a778b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:33.710246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-861c680f-965d-49f9-9678-f50ab57a778b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:33.747107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c680f-965d-49f9-9678-f50ab57a778b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:33.803145 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:33.952466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:33.953967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:33.954417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:33.954862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] PATH_INFO: `/v3/projects/413a1c08324d4c1d8829fe25c1f15c09` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:33.956408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=413a1c08324d4c1d8829fe25c1f15c09)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:33.959053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:34.111637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413a1c08324d4c1d8829fe25c1f15c09', 'request_id': 'req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.123747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413a1c08324d4c1d8829fe25c1f15c09', 'request_id': 'req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.141387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413a1c08324d4c1d8829fe25c1f15c09', 'request_id': 'req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.175151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] The token cache is being invalidate because project 413a1c08324d4c1d8829fe25c1f15c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:34.175474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.178953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fd11ba2-60ab-424f-8e57-3f015f5bdb8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.187438 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2032/4090] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:33 2022] DELETE /identity/v3/projects/413a1c08324d4c1d8829fe25c1f15c09 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:34.188715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fab86c-5274-4c99-b808-297271dea6f5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:34.193028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a1fab86c-5274-4c99-b808-297271dea6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:34.223635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fab86c-5274-4c99-b808-297271dea6f5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:34.340748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebb45-32ea-43ea-a813-9ba6633dd4d3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:34.341108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebb45-32ea-43ea-a813-9ba6633dd4d3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:34.341514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebb45-32ea-43ea-a813-9ba6633dd4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:34.397234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:34.397918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:34.398846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:34.399208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] PATH_INFO: `/v3/users/59b1d506d2414984abe362472df8bcc2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:34.400319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-727ebb45-32ea-43ea-a813-9ba6633dd4d3 None None] MFA Rules not processed for user `1f062f2ecc0547ae960ed98e7aeef9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:34.401927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b1d506d2414984abe362472df8bcc2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:34.404553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-727ebb45-32ea-43ea-a813-9ba6633dd4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:34.404785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:34.456979 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:34.512802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b1d506d2414984abe362472df8bcc2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.549248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b1d506d2414984abe362472df8bcc2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.566060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b1d506d2414984abe362472df8bcc2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.577907 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2033/4091] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:34.585741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b1d506d2414984abe362472df8bcc2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.588426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b1d506d2414984abe362472df8bcc2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:34.592337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8091-7891-4f81-8ffd-27f6ede7d681 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:34.592523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8091-7891-4f81-8ffd-27f6ede7d681 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:34.592914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8091-7891-4f81-8ffd-27f6ede7d681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:34.604286 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2059/4092] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:34 2022] DELETE /identity/v3/users/59b1d506d2414984abe362472df8bcc2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:34.636784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-eadf8091-7891-4f81-8ffd-27f6ede7d681 None None] MFA Rules not processed for user `1f062f2ecc0547ae960ed98e7aeef9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:34.638773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eadf8091-7891-4f81-8ffd-27f6ede7d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:34.717561 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:34.755012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2034/4093] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:34.776090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:34.778580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:35.082068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612bcb0-5ee5-44a1-83b7-d523664c0d5b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:35.102988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d179d-d202-42ef-b665-7a85c50cfc63 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:35.104474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d179d-d202-42ef-b665-7a85c50cfc63 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:35.105112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d179d-d202-42ef-b665-7a85c50cfc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:35.110895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:35.114564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:35.114564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:35.114564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:35.119057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:35.167695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:35.169507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:35.174738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-933d179d-d202-42ef-b665-7a85c50cfc63 None None] MFA Rules not processed for user `0f876732e7574a089385ebade0f020e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:35.178530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-933d179d-d202-42ef-b665-7a85c50cfc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:35.182437 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2060/4094] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:35.183513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:35.184887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:35.351686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f63da1-c8f6-4411-8baf-0c4c0481fb29 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:35.381549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:35.382222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:35.382564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:35.382845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] PATH_INFO: `/v3/projects/aeb5e6dd8d6c46fab43fa07fa48cd99c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:35.389366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb5e6dd8d6c46fab43fa07fa48cd99c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:35.389615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2035/4095] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:35.394351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:35.437079 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:35.487620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb5e6dd8d6c46fab43fa07fa48cd99c', 'request_id': 'req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:35.505387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb5e6dd8d6c46fab43fa07fa48cd99c', 'request_id': 'req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:35.526008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb5e6dd8d6c46fab43fa07fa48cd99c', 'request_id': 'req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:35.545336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] The token cache is being invalidate because project aeb5e6dd8d6c46fab43fa07fa48cd99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:35.546174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:35.547016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13a3de1a-7bf4-43ea-bf3d-f7ab544fb9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:35.551233 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2061/4096] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:35 2022] DELETE /identity/v3/projects/aeb5e6dd8d6c46fab43fa07fa48cd99c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:35.557133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08f15d-b008-425a-a433-39ae95ce17e6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:35.557505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08f15d-b008-425a-a433-39ae95ce17e6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:35.557766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08f15d-b008-425a-a433-39ae95ce17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:35.602634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4a08f15d-b008-425a-a433-39ae95ce17e6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:35.604477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4a08f15d-b008-425a-a433-39ae95ce17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:35.694065 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2036/4097] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:35.703090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb7dc-1a3a-4ab7-a883-cb6fabdbbf56 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:35.703395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb7dc-1a3a-4ab7-a883-cb6fabdbbf56 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:35.703641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb7dc-1a3a-4ab7-a883-cb6fabdbbf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:35.737879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-feecb7dc-1a3a-4ab7-a883-cb6fabdbbf56 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:35.739514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-feecb7dc-1a3a-4ab7-a883-cb6fabdbbf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:35.778801 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2062/4098] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:35.782749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08f15d-b008-425a-a433-39ae95ce17e6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:35.793980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08f15d-b008-425a-a433-39ae95ce17e6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:35.800735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:35.801334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:35.801618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:35.802231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:35.802538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:35.803217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:35.807712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:35.832847 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2037/4099] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:35.837255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecb7dc-1a3a-4ab7-a883-cb6fabdbbf56 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:35.865022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecb7dc-1a3a-4ab7-a883-cb6fabdbbf56 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:35.873034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcaf32-07ac-4164-94bc-9d318881094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:35.875119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcaf32-07ac-4164-94bc-9d318881094d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:35.875619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcaf32-07ac-4164-94bc-9d318881094d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:35.877037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcaf32-07ac-4164-94bc-9d318881094d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:35.877879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcaf32-07ac-4164-94bc-9d318881094d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:35.883152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcaf32-07ac-4164-94bc-9d318881094d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:35.940449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:35.942641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:35.943277 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2063/4100] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:35 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:59:35.947010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcaf32-07ac-4164-94bc-9d318881094d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:36.062474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3343d35-f27b-45f2-bd98-52ddac739abb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:36.072806 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:36.121248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcaf32-07ac-4164-94bc-9d318881094d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:36.133941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d2d3a-8d0b-45bf-ada2-92e9246c2610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:36.134683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d2d3a-8d0b-45bf-ada2-92e9246c2610 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:36.135119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d2d3a-8d0b-45bf-ada2-92e9246c2610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:36.135408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d2d3a-8d0b-45bf-ada2-92e9246c2610 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:36.136057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d2d3a-8d0b-45bf-ada2-92e9246c2610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:36.138696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d2d3a-8d0b-45bf-ada2-92e9246c2610 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:36.173916 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2064/4101] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:35 2022] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:36.175336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d2d3a-8d0b-45bf-ada2-92e9246c2610 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:36.180755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6e092-6e8e-4a6b-b414-2bae645eafcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:36.181588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6e092-6e8e-4a6b-b414-2bae645eafcb service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:36.181947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6e092-6e8e-4a6b-b414-2bae645eafcb service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:36.182403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6e092-6e8e-4a6b-b414-2bae645eafcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:36.184298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85f6e092-6e8e-4a6b-b414-2bae645eafcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:36.200699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6e092-6e8e-4a6b-b414-2bae645eafcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:36.202421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6e092-6e8e-4a6b-b414-2bae645eafcb service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:36.204063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d2d3a-8d0b-45bf-ada2-92e9246c2610 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:36.218058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47ba08-1084-4fb9-8eab-68d8522e808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:36.218907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47ba08-1084-4fb9-8eab-68d8522e808d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:36.219435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47ba08-1084-4fb9-8eab-68d8522e808d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:36.219818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47ba08-1084-4fb9-8eab-68d8522e808d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:36.220450 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2038/4102] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:59:36.220791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47ba08-1084-4fb9-8eab-68d8522e808d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:36.223487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47ba08-1084-4fb9-8eab-68d8522e808d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:36.243538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6e092-6e8e-4a6b-b414-2bae645eafcb service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:36.250513 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2065/4103] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:36.258241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6e092-6e8e-4a6b-b414-2bae645eafcb service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:36.264318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487f22d-c164-452c-a8ca-ee72e935cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:36.265472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f22d-c164-452c-a8ca-ee72e935cbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:36.266079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f22d-c164-452c-a8ca-ee72e935cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:36.266521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f22d-c164-452c-a8ca-ee72e935cbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:36.267337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487f22d-c164-452c-a8ca-ee72e935cbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:36.270221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487f22d-c164-452c-a8ca-ee72e935cbf8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:36.285269 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2039/4104] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:36.289129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47ba08-1084-4fb9-8eab-68d8522e808d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:36.301294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47ba08-1084-4fb9-8eab-68d8522e808d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:36.308401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b424c41-39ee-40da-8a29-991e775fb587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:36.309391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b424c41-39ee-40da-8a29-991e775fb587 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:36.309683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b424c41-39ee-40da-8a29-991e775fb587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:36.309967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b424c41-39ee-40da-8a29-991e775fb587 admin admin] PATH_INFO: `/v3/projects/5880f2c0a82f4fefa0248df171ec3160/users/8cb94ba0f09b4a2897e551ee8b0d4727/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:36.337793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b424c41-39ee-40da-8a29-991e775fb587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5880f2c0a82f4fefa0248df171ec3160, user_id=8cb94ba0f09b4a2897e551ee8b0d4727, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:36.343460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b424c41-39ee-40da-8a29-991e775fb587 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:36.387730 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2066/4105] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:36 2022] PUT /identity/v3/projects/5880f2c0a82f4fefa0248df171ec3160/users/8cb94ba0f09b4a2897e551ee8b0d4727/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:36.399657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2ea71-c821-4a8f-b0fe-c1bd0423c6c0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:36.399940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2ea71-c821-4a8f-b0fe-c1bd0423c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:36.400217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2ea71-c821-4a8f-b0fe-c1bd0423c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:36.467114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-14e2ea71-c821-4a8f-b0fe-c1bd0423c6c0 None None] MFA Rules not processed for user `8cb94ba0f09b4a2897e551ee8b0d4727`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:36.468437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-14e2ea71-c821-4a8f-b0fe-c1bd0423c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:36.608841 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2040/4106] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:36.615881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b424c41-39ee-40da-8a29-991e775fb587 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:36.618461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5b424c41-39ee-40da-8a29-991e775fb587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:36.709907 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:36.782623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b424c41-39ee-40da-8a29-991e775fb587 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:36.799148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e04aa-cbb4-4f69-9d5b-736db2f622b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:36.799366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e04aa-cbb4-4f69-9d5b-736db2f622b9 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:36.799757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e04aa-cbb4-4f69-9d5b-736db2f622b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:36.799887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e04aa-cbb4-4f69-9d5b-736db2f622b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:36.818957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e04aa-cbb4-4f69-9d5b-736db2f622b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:36.821201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e04aa-cbb4-4f69-9d5b-736db2f622b9 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:36.871532 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2067/4107] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:37.114557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2ea71-c821-4a8f-b0fe-c1bd0423c6c0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:37.116355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-14e2ea71-c821-4a8f-b0fe-c1bd0423c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:37.288423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2ea71-c821-4a8f-b0fe-c1bd0423c6c0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:37.295569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22801382-7b8c-4e5b-b87f-1d532006bed3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:37.296439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801382-7b8c-4e5b-b87f-1d532006bed3 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:37.296915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801382-7b8c-4e5b-b87f-1d532006bed3 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:37.297382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801382-7b8c-4e5b-b87f-1d532006bed3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:37.299318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-22801382-7b8c-4e5b-b87f-1d532006bed3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:37.314228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22801382-7b8c-4e5b-b87f-1d532006bed3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:37.316438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22801382-7b8c-4e5b-b87f-1d532006bed3 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:37.331652 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2041/4108] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:38.309755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e04aa-cbb4-4f69-9d5b-736db2f622b9 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:38.311569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-336e04aa-cbb4-4f69-9d5b-736db2f622b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:38.520741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e04aa-cbb4-4f69-9d5b-736db2f622b9 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:38.546900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:38.547565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:38.547849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:38.548125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] PATH_INFO: `/v3/users/96179e626c3e4738bfd6712d3a622f26` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:38.551416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] RBAC: Authorizing `identity:delete_user(user_id=96179e626c3e4738bfd6712d3a622f26)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:38.555483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:38.757376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96179e626c3e4738bfd6712d3a622f26'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:38.780544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96179e626c3e4738bfd6712d3a622f26'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:38.807522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96179e626c3e4738bfd6712d3a622f26'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:38.826808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96179e626c3e4738bfd6712d3a622f26'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:38.830244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8a41e20-64a4-4e7e-9b84-47d7037036df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96179e626c3e4738bfd6712d3a622f26'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:38.854035 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2068/4109] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:38 2022] DELETE /identity/v3/users/96179e626c3e4738bfd6712d3a622f26 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:39.309803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22801382-7b8c-4e5b-b87f-1d532006bed3 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:39.332147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22801382-7b8c-4e5b-b87f-1d532006bed3 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:39.384910 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:39.569400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:39.570962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:39.571415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:39.571885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] PATH_INFO: `/v3/users/8cb94ba0f09b4a2897e551ee8b0d4727` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:39.573302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb94ba0f09b4a2897e551ee8b0d4727)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:39.594994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:39.755136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb94ba0f09b4a2897e551ee8b0d4727'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:39.807332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb94ba0f09b4a2897e551ee8b0d4727'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:39.828086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb94ba0f09b4a2897e551ee8b0d4727'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:39.850529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb94ba0f09b4a2897e551ee8b0d4727'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:39.853322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb94ba0f09b4a2897e551ee8b0d4727'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:39.881175 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2042/4110] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:39 2022] DELETE /identity/v3/users/8cb94ba0f09b4a2897e551ee8b0d4727 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:39.886235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482b0c7-a890-4190-beb6-5c4f5a07ab03 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:39.886747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482b0c7-a890-4190-beb6-5c4f5a07ab03 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:39.886923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482b0c7-a890-4190-beb6-5c4f5a07ab03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:39.930502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e482b0c7-a890-4190-beb6-5c4f5a07ab03 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:39.954214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e482b0c7-a890-4190-beb6-5c4f5a07ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:40.119145 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:40.186516 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2069/4111] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:40.200585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:40.202109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:40.366515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e950-ffa2-4a3f-9638-d4a423611010 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:40.407655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec66d3-e6b3-48f1-afe4-d2eb955b9eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:40.410428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec66d3-e6b3-48f1-afe4-d2eb955b9eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:40.410709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec66d3-e6b3-48f1-afe4-d2eb955b9eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:40.412923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec66d3-e6b3-48f1-afe4-d2eb955b9eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:40.425332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482b0c7-a890-4190-beb6-5c4f5a07ab03 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:40.427587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e482b0c7-a890-4190-beb6-5c4f5a07ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:40.433279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec66d3-e6b3-48f1-afe4-d2eb955b9eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:40.435098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec66d3-e6b3-48f1-afe4-d2eb955b9eb6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:40.455855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482b0c7-a890-4190-beb6-5c4f5a07ab03 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:40.457473 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2043/4112] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:40.481070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:40.481657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:40.481936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:40.482208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] PATH_INFO: `/v3/projects/89e7564c2f6f47099d2e32639d05b43b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:40.486668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e7564c2f6f47099d2e32639d05b43b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:40.488829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:40.636276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e7564c2f6f47099d2e32639d05b43b', 'request_id': 'req-2d30518b-6360-480a-aefa-93875a9442fe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:40.648753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e7564c2f6f47099d2e32639d05b43b', 'request_id': 'req-2d30518b-6360-480a-aefa-93875a9442fe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:40.663099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e7564c2f6f47099d2e32639d05b43b', 'request_id': 'req-2d30518b-6360-480a-aefa-93875a9442fe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:40.691093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] The token cache is being invalidate because project 89e7564c2f6f47099d2e32639d05b43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:40.691461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:40.692559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:40.694074 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2070/4113] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:40 2022] DELETE /identity/v3/projects/89e7564c2f6f47099d2e32639d05b43b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:40.699774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec66d3-e6b3-48f1-afe4-d2eb955b9eb6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:40.718691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec66d3-e6b3-48f1-afe4-d2eb955b9eb6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:40.824460 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:40.867028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:40.868186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:40.868569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:40.869169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] PATH_INFO: `/v3/users/0f876732e7574a089385ebade0f020e7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:40.874672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f876732e7574a089385ebade0f020e7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:40.876832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:41.011789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f876732e7574a089385ebade0f020e7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:41.067325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f876732e7574a089385ebade0f020e7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:41.082714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f876732e7574a089385ebade0f020e7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:41.134162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f876732e7574a089385ebade0f020e7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:41.138233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f876732e7574a089385ebade0f020e7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:41.180236 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2044/4114] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:40 2022] DELETE /identity/v3/users/0f876732e7574a089385ebade0f020e7 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:42.163946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:42.166236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:42.214886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30518b-6360-480a-aefa-93875a9442fe admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:42.280091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:42.282155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:42.432565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:42.441345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:42.441639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:42.441921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] PATH_INFO: `/v3/projects/5880f2c0a82f4fefa0248df171ec3160` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:42.446518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5880f2c0a82f4fefa0248df171ec3160)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:42.454629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:42.509175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bb03e-c800-4d62-b068-ba7fbd687335 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:42.526977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:42.527646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:42.527930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:42.528207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] PATH_INFO: `/v3/projects/5abdce90e81043d7adc5f063e5a46e92` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:42.535940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abdce90e81043d7adc5f063e5a46e92)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:42.538280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:42.654161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5880f2c0a82f4fefa0248df171ec3160', 'request_id': 'req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.676557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5880f2c0a82f4fefa0248df171ec3160', 'request_id': 'req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.698547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5880f2c0a82f4fefa0248df171ec3160', 'request_id': 'req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.703763 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:42.729236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abdce90e81043d7adc5f063e5a46e92', 'request_id': 'req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.734005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] The token cache is being invalidate because project 5880f2c0a82f4fefa0248df171ec3160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:42.734313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.736146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16c6f4b0-6e14-47c9-bad4-154b0367d9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.740338 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2071/4115] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:42 2022] DELETE /identity/v3/projects/5880f2c0a82f4fefa0248df171ec3160 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:42.742960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae8aa-05ba-435b-9736-2d0fff456c7f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:42.743507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae8aa-05ba-435b-9736-2d0fff456c7f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:42.745641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abdce90e81043d7adc5f063e5a46e92', 'request_id': 'req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.749341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae8aa-05ba-435b-9736-2d0fff456c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:42.758513 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:42.763860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abdce90e81043d7adc5f063e5a46e92', 'request_id': 'req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.798630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] The token cache is being invalidate because project 5abdce90e81043d7adc5f063e5a46e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:42.799488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.801439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ac8cae35-2a8e-4a5b-847b-cb8cb519cf03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:42.804704 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2045/4116] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:42 2022] DELETE /identity/v3/projects/5abdce90e81043d7adc5f063e5a46e92 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:42.812882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dc980-5485-44e8-9717-0eaa90af52fb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:42.813173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dc980-5485-44e8-9717-0eaa90af52fb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:42.813452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dc980-5485-44e8-9717-0eaa90af52fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:42.836475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-decae8aa-05ba-435b-9736-2d0fff456c7f None None] MFA Rules not processed for user `77b49d34906d44819c47d0ad5f1a9bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:42.842124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-decae8aa-05ba-435b-9736-2d0fff456c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:42.866469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0c5dc980-5485-44e8-9717-0eaa90af52fb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:42.868204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0c5dc980-5485-44e8-9717-0eaa90af52fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:43.061050 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2072/4117] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:43.063626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3819bcc-6ad2-41f4-8cf3-7bb84b7a56ed None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.064461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3819bcc-6ad2-41f4-8cf3-7bb84b7a56ed None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.066018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3819bcc-6ad2-41f4-8cf3-7bb84b7a56ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.130908 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2046/4118] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:43.137349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9628808-deec-4c3f-954b-7de36aebf1f8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.137588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9628808-deec-4c3f-954b-7de36aebf1f8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.137685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9628808-deec-4c3f-954b-7de36aebf1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.146681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b3819bcc-6ad2-41f4-8cf3-7bb84b7a56ed None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:43.148107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b3819bcc-6ad2-41f4-8cf3-7bb84b7a56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:43.172507 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2073/4119] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:43.178042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f9628808-deec-4c3f-954b-7de36aebf1f8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:43.180787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c691c37-ea8b-403a-964d-8dd70bb5182c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.181071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c691c37-ea8b-403a-964d-8dd70bb5182c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.181349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c691c37-ea8b-403a-964d-8dd70bb5182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.186643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f9628808-deec-4c3f-954b-7de36aebf1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:43.200570 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2047/4120] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:43.204745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9628808-deec-4c3f-954b-7de36aebf1f8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:43.222054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9628808-deec-4c3f-954b-7de36aebf1f8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:43.222295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6c691c37-ea8b-403a-964d-8dd70bb5182c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:43.226548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6c691c37-ea8b-403a-964d-8dd70bb5182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:43.235564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89049f7e-a0e2-4590-a731-dd46ed0b7d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:43.236430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89049f7e-a0e2-4590-a731-dd46ed0b7d71 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.237022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89049f7e-a0e2-4590-a731-dd46ed0b7d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.237506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89049f7e-a0e2-4590-a731-dd46ed0b7d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.238404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89049f7e-a0e2-4590-a731-dd46ed0b7d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:43.238804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89049f7e-a0e2-4590-a731-dd46ed0b7d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:43.241055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89049f7e-a0e2-4590-a731-dd46ed0b7d71 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:43.264855 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2048/4121] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:59:43.265709 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2074/4122] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:43.276842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89049f7e-a0e2-4590-a731-dd46ed0b7d71 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:43.289730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c691c37-ea8b-403a-964d-8dd70bb5182c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:43.296312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89049f7e-a0e2-4590-a731-dd46ed0b7d71 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:43.312418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e868-14d5-4c6a-a11d-8b53725ba4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:43.313212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e868-14d5-4c6a-a11d-8b53725ba4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.313519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e868-14d5-4c6a-a11d-8b53725ba4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.313805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e868-14d5-4c6a-a11d-8b53725ba4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.314433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0e868-14d5-4c6a-a11d-8b53725ba4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:43.316352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0e868-14d5-4c6a-a11d-8b53725ba4a0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:43.322480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c691c37-ea8b-403a-964d-8dd70bb5182c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:43.353147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1a116-b1fe-49e4-8c0e-ae3c7852b218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:43.354066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a116-b1fe-49e4-8c0e-ae3c7852b218 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.354545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a116-b1fe-49e4-8c0e-ae3c7852b218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.354986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a116-b1fe-49e4-8c0e-ae3c7852b218 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.365369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1a116-b1fe-49e4-8c0e-ae3c7852b218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:43.365964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1a116-b1fe-49e4-8c0e-ae3c7852b218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:43.372433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1a116-b1fe-49e4-8c0e-ae3c7852b218 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:43.394517 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2049/4123] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:43 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:43.397248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e868-14d5-4c6a-a11d-8b53725ba4a0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:43.404292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-87f0e868-14d5-4c6a-a11d-8b53725ba4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:43.433119 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2075/4124] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:43.441434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1a116-b1fe-49e4-8c0e-ae3c7852b218 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:43.491099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1a116-b1fe-49e4-8c0e-ae3c7852b218 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:43.532912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e868-14d5-4c6a-a11d-8b53725ba4a0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:43.546061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00558bc-c76d-460a-9f5f-cfaf00c9cd0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:43.546672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00558bc-c76d-460a-9f5f-cfaf00c9cd0d service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.546965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00558bc-c76d-460a-9f5f-cfaf00c9cd0d service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.547294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00558bc-c76d-460a-9f5f-cfaf00c9cd0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.680404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f6991-acd5-4004-8365-fafa4ce7e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:43.681387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f6991-acd5-4004-8365-fafa4ce7e34a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.681525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f6991-acd5-4004-8365-fafa4ce7e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.682134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f6991-acd5-4004-8365-fafa4ce7e34a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.684912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f6991-acd5-4004-8365-fafa4ce7e34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:43.696271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f6991-acd5-4004-8365-fafa4ce7e34a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:43.713148 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:43.753496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00558bc-c76d-460a-9f5f-cfaf00c9cd0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:43.758226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00558bc-c76d-460a-9f5f-cfaf00c9cd0d service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:43.764585 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2076/4125] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:43 2022] POST /identity/v3/users => generated 290 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:43.769026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f6991-acd5-4004-8365-fafa4ce7e34a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:43.788025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f6991-acd5-4004-8365-fafa4ce7e34a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:43.802044 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2050/4126] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:43.803047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00558bc-c76d-460a-9f5f-cfaf00c9cd0d service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:43.822889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569c127-083b-4f9e-84e2-1b8b6d2aa6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:43.823517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c127-083b-4f9e-84e2-1b8b6d2aa6eb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.823797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c127-083b-4f9e-84e2-1b8b6d2aa6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.824074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c127-083b-4f9e-84e2-1b8b6d2aa6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.826194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569c127-083b-4f9e-84e2-1b8b6d2aa6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:43.828136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569c127-083b-4f9e-84e2-1b8b6d2aa6eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:43.834047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00558bc-c76d-460a-9f5f-cfaf00c9cd0d service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:43.846207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec6bf-4825-4b3f-930a-96fa0c781d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:43.846830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec6bf-4825-4b3f-930a-96fa0c781d4f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:43.847112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec6bf-4825-4b3f-930a-96fa0c781d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:43.847386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec6bf-4825-4b3f-930a-96fa0c781d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:43.848041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fec6bf-4825-4b3f-930a-96fa0c781d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:43.849925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fec6bf-4825-4b3f-930a-96fa0c781d4f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:43.867164 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2051/4127] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:43.871595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec6bf-4825-4b3f-930a-96fa0c781d4f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:43.889025 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2077/4128] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:43 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:43.892955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569c127-083b-4f9e-84e2-1b8b6d2aa6eb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:43.898485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec6bf-4825-4b3f-930a-96fa0c781d4f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:43.987848 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:44.111721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569c127-083b-4f9e-84e2-1b8b6d2aa6eb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:44.117946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655b9be-e295-4ad9-9359-dafa1bc381f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:44.119272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655b9be-e295-4ad9-9359-dafa1bc381f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:44.119564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655b9be-e295-4ad9-9359-dafa1bc381f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:44.119841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655b9be-e295-4ad9-9359-dafa1bc381f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:44.120498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655b9be-e295-4ad9-9359-dafa1bc381f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:44.122420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655b9be-e295-4ad9-9359-dafa1bc381f3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:44.138244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbecae4-9fb9-47ae-87ba-e39b0058c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:44.138872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbecae4-9fb9-47ae-87ba-e39b0058c0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:44.139811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbecae4-9fb9-47ae-87ba-e39b0058c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:44.140097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbecae4-9fb9-47ae-87ba-e39b0058c0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:44.140771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbecae4-9fb9-47ae-87ba-e39b0058c0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:44.145951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbecae4-9fb9-47ae-87ba-e39b0058c0d4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:44.160579 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2052/4129] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:44.161588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655b9be-e295-4ad9-9359-dafa1bc381f3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:44.166981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f655b9be-e295-4ad9-9359-dafa1bc381f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:44.227292 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2078/4130] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:43 2022] POST /identity/v3/users => generated 294 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:44.229092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbecae4-9fb9-47ae-87ba-e39b0058c0d4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:44.249099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbecae4-9fb9-47ae-87ba-e39b0058c0d4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:44.263754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efd1f0-2432-435e-9a08-dbfafdad8081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:44.264751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efd1f0-2432-435e-9a08-dbfafdad8081 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:44.265221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efd1f0-2432-435e-9a08-dbfafdad8081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:44.265858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efd1f0-2432-435e-9a08-dbfafdad8081 admin admin] PATH_INFO: `/v3/projects/ffd06d4e7c51407298329292acc58529/users/2e2de00d2682446689b3bf7d1a7d391f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:44.312751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efd1f0-2432-435e-9a08-dbfafdad8081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd06d4e7c51407298329292acc58529, user_id=2e2de00d2682446689b3bf7d1a7d391f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:44.315817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efd1f0-2432-435e-9a08-dbfafdad8081 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:44.359246 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2079/4131] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:44 2022] PUT /identity/v3/projects/ffd06d4e7c51407298329292acc58529/users/2e2de00d2682446689b3bf7d1a7d391f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:44.372682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efd1f0-2432-435e-9a08-dbfafdad8081 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:44.442273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655b9be-e295-4ad9-9359-dafa1bc381f3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:44.603596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efd1f0-2432-435e-9a08-dbfafdad8081 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:44.621040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ff54d-634c-462c-88ac-59d0db3786f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:44.622895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ff54d-634c-462c-88ac-59d0db3786f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:44.623227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ff54d-634c-462c-88ac-59d0db3786f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:44.624325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ff54d-634c-462c-88ac-59d0db3786f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:44.625016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ff54d-634c-462c-88ac-59d0db3786f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:44.631673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ff54d-634c-462c-88ac-59d0db3786f5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:44.659101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382135a-c943-429a-b75a-53ab148dfeca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:44.659697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382135a-c943-429a-b75a-53ab148dfeca service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:44.659986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382135a-c943-429a-b75a-53ab148dfeca service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:44.660262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382135a-c943-429a-b75a-53ab148dfeca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:44.674042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8382135a-c943-429a-b75a-53ab148dfeca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:44.675798 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2080/4132] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:44.677272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091f42-208c-425a-a02f-834379680b17 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:44.677557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091f42-208c-425a-a02f-834379680b17 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:44.677834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091f42-208c-425a-a02f-834379680b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:44.697073 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:44.721602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382135a-c943-429a-b75a-53ab148dfeca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:44.723246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382135a-c943-429a-b75a-53ab148dfeca service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:44.755983 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2053/4133] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:44.756922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382135a-c943-429a-b75a-53ab148dfeca service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:44.760361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c3091f42-208c-425a-a02f-834379680b17 None None] MFA Rules not processed for user `2e2de00d2682446689b3bf7d1a7d391f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:44.761602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c3091f42-208c-425a-a02f-834379680b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:44.780083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382135a-c943-429a-b75a-53ab148dfeca service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:44.793800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b46ada-24ab-4628-9929-835b07c138c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:44.794609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b46ada-24ab-4628-9929-835b07c138c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:44.794893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b46ada-24ab-4628-9929-835b07c138c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:44.795477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b46ada-24ab-4628-9929-835b07c138c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:44.796158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b46ada-24ab-4628-9929-835b07c138c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:44.802388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b46ada-24ab-4628-9929-835b07c138c9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:44.826487 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2054/4134] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:44.831601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b46ada-24ab-4628-9929-835b07c138c9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:44.867682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b46ada-24ab-4628-9929-835b07c138c9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:44.895988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b09c1-b1a2-42c5-b36d-b0163cea942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:44.899766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b09c1-b1a2-42c5-b36d-b0163cea942c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:44.900133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b09c1-b1a2-42c5-b36d-b0163cea942c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:44.900477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b09c1-b1a2-42c5-b36d-b0163cea942c admin admin] PATH_INFO: `/v3/projects/6699cfc9239d4980985d0b39e81b6acb/users/05b26d3762c14099a294c8fc2dacae57/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:44.949705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b09c1-b1a2-42c5-b36d-b0163cea942c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6699cfc9239d4980985d0b39e81b6acb, user_id=05b26d3762c14099a294c8fc2dacae57, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:44.955123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b09c1-b1a2-42c5-b36d-b0163cea942c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:44.970329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2081/4135] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:44.983627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3091f42-208c-425a-a02f-834379680b17 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:44.985309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c3091f42-208c-425a-a02f-834379680b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:45.009841 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2055/4136] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:44 2022] PUT /identity/v3/projects/6699cfc9239d4980985d0b39e81b6acb/users/05b26d3762c14099a294c8fc2dacae57/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:59:45.013484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9d265-145d-4dcb-ba5a-377837917c34 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:45.013775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9d265-145d-4dcb-ba5a-377837917c34 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:45.014054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9d265-145d-4dcb-ba5a-377837917c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:45.078816 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:45.137657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bcb9d265-145d-4dcb-ba5a-377837917c34 None None] MFA Rules not processed for user `05b26d3762c14099a294c8fc2dacae57`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:45.143708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bcb9d265-145d-4dcb-ba5a-377837917c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:45.208896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3091f42-208c-425a-a02f-834379680b17 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:45.361166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48465e4-1fbe-49be-9410-0d20ff1e55ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:45.361871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48465e4-1fbe-49be-9410-0d20ff1e55ee service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:45.362060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48465e4-1fbe-49be-9410-0d20ff1e55ee service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:45.362336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48465e4-1fbe-49be-9410-0d20ff1e55ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:45.363959 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2056/4137] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:45.368883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9d265-145d-4dcb-ba5a-377837917c34 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:45.554705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9d265-145d-4dcb-ba5a-377837917c34 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:45.559746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48465e4-1fbe-49be-9410-0d20ff1e55ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:45.561540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48465e4-1fbe-49be-9410-0d20ff1e55ee service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:45.582957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6147c-e84d-4014-a1eb-8fdf64cc9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:45.582957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6147c-e84d-4014-a1eb-8fdf64cc9441 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:45.582957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6147c-e84d-4014-a1eb-8fdf64cc9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:45.582957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6147c-e84d-4014-a1eb-8fdf64cc9441 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:45.583501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6147c-e84d-4014-a1eb-8fdf64cc9441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:45.594332 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2082/4138] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:45.617524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6147c-e84d-4014-a1eb-8fdf64cc9441 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:45.714675 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2057/4139] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:45 2022] POST /identity/v3/projects => generated 385 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:45.718925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48465e4-1fbe-49be-9410-0d20ff1e55ee service glance] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:45.753823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48465e4-1fbe-49be-9410-0d20ff1e55ee service glance] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:45.981296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039756f-6357-41c4-a942-2e660048d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:45.981931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039756f-6357-41c4-a942-2e660048d434 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:45.982212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039756f-6357-41c4-a942-2e660048d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:45.982488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039756f-6357-41c4-a942-2e660048d434 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:45.983130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039756f-6357-41c4-a942-2e660048d434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:45.985645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039756f-6357-41c4-a942-2e660048d434 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:46.058309 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2083/4140] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:45 2022] POST /identity/v3/users => generated 299 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:46.059508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6147c-e84d-4014-a1eb-8fdf64cc9441 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:46.078610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6147c-e84d-4014-a1eb-8fdf64cc9441 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:46.089506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f8cdb-58b8-4853-a418-66dfc8095754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:46.090214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f8cdb-58b8-4853-a418-66dfc8095754 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:46.090397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f8cdb-58b8-4853-a418-66dfc8095754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:46.090743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f8cdb-58b8-4853-a418-66dfc8095754 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:46.091310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f8cdb-58b8-4853-a418-66dfc8095754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:46.092953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f8cdb-58b8-4853-a418-66dfc8095754 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:46.118470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ab67a-4496-4ca9-9870-556623ebe0c1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:46.119147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ab67a-4496-4ca9-9870-556623ebe0c1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:46.119622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ab67a-4496-4ca9-9870-556623ebe0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:46.153700 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2058/4141] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:46.154744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f8cdb-58b8-4853-a418-66dfc8095754 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:46.174027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-118ab67a-4496-4ca9-9870-556623ebe0c1 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:46.175782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-118ab67a-4496-4ca9-9870-556623ebe0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:46.178185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f8cdb-58b8-4853-a418-66dfc8095754 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:46.192482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb9531-6349-49bb-add2-c7b3a6b42e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:46.194376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb9531-6349-49bb-add2-c7b3a6b42e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:46.194376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb9531-6349-49bb-add2-c7b3a6b42e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:46.194376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb9531-6349-49bb-add2-c7b3a6b42e5e admin admin] PATH_INFO: `/v3/projects/edff602a7e6f44ffae33d0a88ecbf3ad/users/0969d2008bb044aebd3184a0017c60af/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:46.211133 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:46.234341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb9531-6349-49bb-add2-c7b3a6b42e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=edff602a7e6f44ffae33d0a88ecbf3ad, user_id=0969d2008bb044aebd3184a0017c60af, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:46.242023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb9531-6349-49bb-add2-c7b3a6b42e5e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:46.259281 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:46.269353 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2059/4142] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:46 2022] PUT /identity/v3/projects/edff602a7e6f44ffae33d0a88ecbf3ad/users/0969d2008bb044aebd3184a0017c60af/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:46.274910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb9531-6349-49bb-add2-c7b3a6b42e5e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:46.284076 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2084/4143] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 00:59:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:46.368867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ab67a-4496-4ca9-9870-556623ebe0c1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:46.370889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-118ab67a-4496-4ca9-9870-556623ebe0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:46.468460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb9531-6349-49bb-add2-c7b3a6b42e5e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:46.488405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70022eb4-ddd8-4010-9346-9f7d256a620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:46.490884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70022eb4-ddd8-4010-9346-9f7d256a620e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:46.491177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70022eb4-ddd8-4010-9346-9f7d256a620e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:46.491513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70022eb4-ddd8-4010-9346-9f7d256a620e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:46.495008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70022eb4-ddd8-4010-9346-9f7d256a620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:46.498510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70022eb4-ddd8-4010-9346-9f7d256a620e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:46.537959 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2060/4144] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:46.539504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec6ee6-8917-4153-9533-8d60d8d0af59 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:46.539796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec6ee6-8917-4153-9533-8d60d8d0af59 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:46.540765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec6ee6-8917-4153-9533-8d60d8d0af59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:46.576509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ab67a-4496-4ca9-9870-556623ebe0c1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:46.592455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-43ec6ee6-8917-4153-9533-8d60d8d0af59 None None] MFA Rules not processed for user `77b49d34906d44819c47d0ad5f1a9bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:46.595095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-43ec6ee6-8917-4153-9533-8d60d8d0af59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:46.760805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e645481-3418-4183-a997-544891921e4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:46.761441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645481-3418-4183-a997-544891921e4e service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:46.761723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645481-3418-4183-a997-544891921e4e service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:46.761999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645481-3418-4183-a997-544891921e4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:46.782558 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2061/4145] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:46.783571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec6ee6-8917-4153-9533-8d60d8d0af59 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:46.810678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec6ee6-8917-4153-9533-8d60d8d0af59 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:46.817329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29f895-7342-48d8-a986-713d546f2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:46.818154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29f895-7342-48d8-a986-713d546f2166 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:46.818441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29f895-7342-48d8-a986-713d546f2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:46.818741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29f895-7342-48d8-a986-713d546f2166 admin admin] PATH_INFO: `/v3/projects/edff602a7e6f44ffae33d0a88ecbf3ad/users/0969d2008bb044aebd3184a0017c60af/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:46.823832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29f895-7342-48d8-a986-713d546f2166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edff602a7e6f44ffae33d0a88ecbf3ad, user_id=0969d2008bb044aebd3184a0017c60af, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:46.828260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29f895-7342-48d8-a986-713d546f2166 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:46.847599 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2062/4146] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:46 2022] PUT /identity/v3/projects/edff602a7e6f44ffae33d0a88ecbf3ad/users/0969d2008bb044aebd3184a0017c60af/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:46.914282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e645481-3418-4183-a997-544891921e4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:46.918268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e645481-3418-4183-a997-544891921e4e service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:46.956284 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2085/4147] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:59:46.976340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3494-638b-4d77-992a-af42802acd81 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:46.976648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3494-638b-4d77-992a-af42802acd81 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:46.976963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3494-638b-4d77-992a-af42802acd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:47.058160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-156a3494-638b-4d77-992a-af42802acd81 None None] MFA Rules not processed for user `0969d2008bb044aebd3184a0017c60af`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:47.060539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-156a3494-638b-4d77-992a-af42802acd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:47.197446 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2063/4148] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:50.393054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e645481-3418-4183-a997-544891921e4e service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:50.404685 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:50.524324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e645481-3418-4183-a997-544891921e4e service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:50.625263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:50.625875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:50.626141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:50.626527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:50.628144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:50.643556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:50.648858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:50.664986 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2086/4149] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:51.775007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3494-638b-4d77-992a-af42802acd81 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:51.776482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-156a3494-638b-4d77-992a-af42802acd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:51.791861 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:51.862238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3494-638b-4d77-992a-af42802acd81 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:51.868732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d0862-ce6b-4169-be3c-e341cac83dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:51.869436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d0862-ce6b-4169-be3c-e341cac83dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:51.870728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d0862-ce6b-4169-be3c-e341cac83dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:51.871116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d0862-ce6b-4169-be3c-e341cac83dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:51.885186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d0862-ce6b-4169-be3c-e341cac83dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:51.886806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d0862-ce6b-4169-be3c-e341cac83dd0 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:51.901368 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2064/4150] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:52.308497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:52.310100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:52.461182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ee009-b158-4923-9366-f2c96548682f service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:52.467494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:52.469091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:52.469599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:52.470111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] PATH_INFO: `/v3/users/67957cc7905241b8b1ecf9beca3928ec` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:52.484281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67957cc7905241b8b1ecf9beca3928ec)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:52.486944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:52.576496 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:52.592089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d0862-ce6b-4169-be3c-e341cac83dd0 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:52.625533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d0862-ce6b-4169-be3c-e341cac83dd0 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:52.626591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67957cc7905241b8b1ecf9beca3928ec'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.646047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:52.646047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:52.648653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:52.648929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] PATH_INFO: `/v3/users/05b26d3762c14099a294c8fc2dacae57` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:52.654006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b26d3762c14099a294c8fc2dacae57)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:52.658693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:52.669313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67957cc7905241b8b1ecf9beca3928ec'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.691756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67957cc7905241b8b1ecf9beca3928ec'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.709096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67957cc7905241b8b1ecf9beca3928ec'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.714668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa0dd380-f4bf-4add-bd09-7f512844c0f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67957cc7905241b8b1ecf9beca3928ec'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.734888 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2087/4151] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:52 2022] DELETE /identity/v3/users/67957cc7905241b8b1ecf9beca3928ec => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:52.740457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab465f3b-61f0-4816-9c27-83715d9000ad None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:52.742268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab465f3b-61f0-4816-9c27-83715d9000ad None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:52.742598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab465f3b-61f0-4816-9c27-83715d9000ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:52.777726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ab465f3b-61f0-4816-9c27-83715d9000ad None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:52.779292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab465f3b-61f0-4816-9c27-83715d9000ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:52.828720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b26d3762c14099a294c8fc2dacae57'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.846050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b26d3762c14099a294c8fc2dacae57'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.874137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b26d3762c14099a294c8fc2dacae57'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.907647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b26d3762c14099a294c8fc2dacae57'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.910498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cd0e27c7-343e-44f3-9cf5-b037d0660074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b26d3762c14099a294c8fc2dacae57'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:52.930858 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2065/4152] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:52 2022] DELETE /identity/v3/users/05b26d3762c14099a294c8fc2dacae57 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:52.936143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589e5e6-754e-4f1a-a58b-b4cd84393731 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:52.936342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589e5e6-754e-4f1a-a58b-b4cd84393731 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:52.936537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589e5e6-754e-4f1a-a58b-b4cd84393731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:52.959048 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2088/4153] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:52.971829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab465f3b-61f0-4816-9c27-83715d9000ad None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:52.973820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab465f3b-61f0-4816-9c27-83715d9000ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:53.055345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f589e5e6-754e-4f1a-a58b-b4cd84393731 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:53.056599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f589e5e6-754e-4f1a-a58b-b4cd84393731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:53.178567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab465f3b-61f0-4816-9c27-83715d9000ad None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:53.271311 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2066/4154] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:53.313546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589e5e6-754e-4f1a-a58b-b4cd84393731 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:53.320265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f589e5e6-754e-4f1a-a58b-b4cd84393731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:53.358018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76755b66-e82d-42bf-9a55-fdd8993e7400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:53.358586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76755b66-e82d-42bf-9a55-fdd8993e7400 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:53.358873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76755b66-e82d-42bf-9a55-fdd8993e7400 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:53.359137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76755b66-e82d-42bf-9a55-fdd8993e7400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:53.381111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76755b66-e82d-42bf-9a55-fdd8993e7400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:53.384807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76755b66-e82d-42bf-9a55-fdd8993e7400 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:53.400838 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:53.416307 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2089/4155] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:59:53.418730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e339737-7498-47f8-8195-27935b04d379 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:53.420662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e339737-7498-47f8-8195-27935b04d379 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:53.421717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e339737-7498-47f8-8195-27935b04d379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:53.475485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589e5e6-754e-4f1a-a58b-b4cd84393731 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:53.476359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4e339737-7498-47f8-8195-27935b04d379 None None] MFA Rules not processed for user `2190bd30671b47048aed416f9c14a545`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:53.478109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4e339737-7498-47f8-8195-27935b04d379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:53.481678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48aaf-8b0a-4ae0-b208-a7e7337a5b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:53.482530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48aaf-8b0a-4ae0-b208-a7e7337a5b14 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:53.482977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48aaf-8b0a-4ae0-b208-a7e7337a5b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:53.483427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48aaf-8b0a-4ae0-b208-a7e7337a5b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:53.486558 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:53.509519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48aaf-8b0a-4ae0-b208-a7e7337a5b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:53.511238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48aaf-8b0a-4ae0-b208-a7e7337a5b14 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:53.534271 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2067/4156] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:53.595785 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2090/4157] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:54.131035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48aaf-8b0a-4ae0-b208-a7e7337a5b14 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:54.132571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f4a48aaf-8b0a-4ae0-b208-a7e7337a5b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:54.156475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48aaf-8b0a-4ae0-b208-a7e7337a5b14 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:54.162628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:54.164104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:54.164499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:54.164932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] PATH_INFO: `/v3/projects/dabab42ac73d41a0a5e6c9aa6245b6de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:54.166388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabab42ac73d41a0a5e6c9aa6245b6de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:54.171079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:54.174112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e339737-7498-47f8-8195-27935b04d379 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:54.191494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e339737-7498-47f8-8195-27935b04d379 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:54.200143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ac5c9-2158-45c6-9907-402a7502e636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:54.200825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ac5c9-2158-45c6-9907-402a7502e636 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:54.201066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ac5c9-2158-45c6-9907-402a7502e636 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:54.201423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ac5c9-2158-45c6-9907-402a7502e636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:54.209049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-518ac5c9-2158-45c6-9907-402a7502e636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:54.238982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ac5c9-2158-45c6-9907-402a7502e636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:54.240912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ac5c9-2158-45c6-9907-402a7502e636 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:54.257744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabab42ac73d41a0a5e6c9aa6245b6de', 'request_id': 'req-b8472061-ee52-4f39-a476-3804955ef1a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.271529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabab42ac73d41a0a5e6c9aa6245b6de', 'request_id': 'req-b8472061-ee52-4f39-a476-3804955ef1a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.281272 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2091/4158] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:54.286765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabab42ac73d41a0a5e6c9aa6245b6de', 'request_id': 'req-b8472061-ee52-4f39-a476-3804955ef1a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.307070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] The token cache is being invalidate because project dabab42ac73d41a0a5e6c9aa6245b6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:54.307377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.308224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b8472061-ee52-4f39-a476-3804955ef1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.312546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2068/4159] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:54 2022] DELETE /identity/v3/projects/dabab42ac73d41a0a5e6c9aa6245b6de => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:54.313719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ac5c9-2158-45c6-9907-402a7502e636 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:54.339564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ac5c9-2158-45c6-9907-402a7502e636 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:54.454901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:54.456336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:54.456909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:54.457533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] PATH_INFO: `/v3/users/8dfb234c04a84f4fa245f4cb8370fb37` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:54.459380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dfb234c04a84f4fa245f4cb8370fb37)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:54.463108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:54.542552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dfb234c04a84f4fa245f4cb8370fb37'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.564772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dfb234c04a84f4fa245f4cb8370fb37'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.581493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dfb234c04a84f4fa245f4cb8370fb37'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.596388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dfb234c04a84f4fa245f4cb8370fb37'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.598074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dfb234c04a84f4fa245f4cb8370fb37'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:54.610170 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2092/4160] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:54 2022] DELETE /identity/v3/users/8dfb234c04a84f4fa245f4cb8370fb37 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:55.079192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23d08c-9bfe-4a69-8407-0878924b1c01 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:55.079571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23d08c-9bfe-4a69-8407-0878924b1c01 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:55.079730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23d08c-9bfe-4a69-8407-0878924b1c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:55.112140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2a23d08c-9bfe-4a69-8407-0878924b1c01 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:55.114547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2a23d08c-9bfe-4a69-8407-0878924b1c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:55.134738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:55.136366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:55.211012 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:55.234873 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2069/4161] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 00:59:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:55.264091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23d08c-9bfe-4a69-8407-0878924b1c01 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:55.265932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2a23d08c-9bfe-4a69-8407-0878924b1c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:55.318451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942ec52-47d0-456d-9f99-585dfdd2a6d9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:55.339962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:55.340748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:55.341100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:55.341457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] PATH_INFO: `/v3/projects/6699cfc9239d4980985d0b39e81b6acb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:55.343170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6699cfc9239d4980985d0b39e81b6acb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:55.346813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:55.464726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6699cfc9239d4980985d0b39e81b6acb', 'request_id': 'req-961b9ce7-5a30-479b-856e-eb40679db575'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.483674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6699cfc9239d4980985d0b39e81b6acb', 'request_id': 'req-961b9ce7-5a30-479b-856e-eb40679db575'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.488227 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:55.497241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6699cfc9239d4980985d0b39e81b6acb', 'request_id': 'req-961b9ce7-5a30-479b-856e-eb40679db575'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.519109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23d08c-9bfe-4a69-8407-0878924b1c01 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:55.527810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] The token cache is being invalidate because project 6699cfc9239d4980985d0b39e81b6acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:55.528436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.529891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.533229 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2093/4162] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:55 2022] DELETE /identity/v3/projects/6699cfc9239d4980985d0b39e81b6acb => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:59:55.534326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:55.541655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:55.690401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b9ce7-5a30-479b-856e-eb40679db575 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:55.693255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:55.694133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:55.695367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:55.695882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:55.698364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:55.712331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:55.713079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:55.713425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:55.713765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] PATH_INFO: `/v3/projects/7f2b9295c9a7420ebed2b5a5138e3ebf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:55.715137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2b9295c9a7420ebed2b5a5138e3ebf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:55.717171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:55.782869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:55.785973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:55.802891 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2070/4163] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 00:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:59:55.805403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:55.807525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:55.817213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2b9295c9a7420ebed2b5a5138e3ebf', 'request_id': 'req-c9db272c-d688-48ad-97a2-c2d88de9cfca'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.823070 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:55.843306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2b9295c9a7420ebed2b5a5138e3ebf', 'request_id': 'req-c9db272c-d688-48ad-97a2-c2d88de9cfca'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.843502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efcf77-8241-47f2-a8dc-cca3a9399216 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:55.852754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2b9295c9a7420ebed2b5a5138e3ebf', 'request_id': 'req-c9db272c-d688-48ad-97a2-c2d88de9cfca'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.890085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] The token cache is being invalidate because project 7f2b9295c9a7420ebed2b5a5138e3ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:55.891724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.896757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c9db272c-d688-48ad-97a2-c2d88de9cfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:55.902815 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2094/4164] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:55 2022] DELETE /identity/v3/projects/7f2b9295c9a7420ebed2b5a5138e3ebf => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:55.907751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34f3d1-58c3-424b-a980-d4adc61828f7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:55.908206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34f3d1-58c3-424b-a980-d4adc61828f7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:55.908334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34f3d1-58c3-424b-a980-d4adc61828f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:55.934868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2e34f3d1-58c3-424b-a980-d4adc61828f7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:55.936717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e34f3d1-58c3-424b-a980-d4adc61828f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:56.035050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:56.036064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:56.036560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:56.037027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] PATH_INFO: `/v3/users/0969d2008bb044aebd3184a0017c60af` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:56.039379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0969d2008bb044aebd3184a0017c60af)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:56.041707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:56.128501 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2095/4165] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:56.129708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34f3d1-58c3-424b-a980-d4adc61828f7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:56.136535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e34f3d1-58c3-424b-a980-d4adc61828f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:56.175228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34f3d1-58c3-424b-a980-d4adc61828f7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:56.178671 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:56.182440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0969d2008bb044aebd3184a0017c60af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.187548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:56.188214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:56.188496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:56.188849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] PATH_INFO: `/v3/users/2e2de00d2682446689b3bf7d1a7d391f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:56.190286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2de00d2682446689b3bf7d1a7d391f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:56.192240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:56.228119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0969d2008bb044aebd3184a0017c60af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.259778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0969d2008bb044aebd3184a0017c60af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.294581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0969d2008bb044aebd3184a0017c60af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.296758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19093c03-1005-494b-aadc-ad8b2d3942c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0969d2008bb044aebd3184a0017c60af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.316713 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2071/4166] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:55 2022] DELETE /identity/v3/users/0969d2008bb044aebd3184a0017c60af => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:56.320737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c13b7-46e8-4ee6-80e6-d5d700a7b92c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:56.320737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c13b7-46e8-4ee6-80e6-d5d700a7b92c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:56.320737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c13b7-46e8-4ee6-80e6-d5d700a7b92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:56.372794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ed6c13b7-46e8-4ee6-80e6-d5d700a7b92c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:56.374436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ed6c13b7-46e8-4ee6-80e6-d5d700a7b92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:56.388236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2de00d2682446689b3bf7d1a7d391f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.435701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2de00d2682446689b3bf7d1a7d391f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.450856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2de00d2682446689b3bf7d1a7d391f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.463258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2de00d2682446689b3bf7d1a7d391f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.464564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-589c0cb4-cafd-4ab8-af9c-84b745f6026c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2de00d2682446689b3bf7d1a7d391f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:56.474237 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2096/4167] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:59:56 2022] DELETE /identity/v3/users/2e2de00d2682446689b3bf7d1a7d391f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:56.480350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49788-1074-4e6a-be31-7d193b16887a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:56.481407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49788-1074-4e6a-be31-7d193b16887a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:56.484078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49788-1074-4e6a-be31-7d193b16887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:56.551265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-86f49788-1074-4e6a-be31-7d193b16887a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:56.559148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-86f49788-1074-4e6a-be31-7d193b16887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:56.681515 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:56.705428 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2097/4168] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:56.714715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f49788-1074-4e6a-be31-7d193b16887a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:56.716346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-86f49788-1074-4e6a-be31-7d193b16887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:56.790971 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2072/4169] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:56.793149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c13b7-46e8-4ee6-80e6-d5d700a7b92c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:56.797294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ed6c13b7-46e8-4ee6-80e6-d5d700a7b92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:56.825743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f49788-1074-4e6a-be31-7d193b16887a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:56.840329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5e9f-4f7a-469b-879a-12e1c81d7c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:56.841867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5e9f-4f7a-469b-879a-12e1c81d7c46 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:56.841988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5e9f-4f7a-469b-879a-12e1c81d7c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:56.842331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5e9f-4f7a-469b-879a-12e1c81d7c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:56.865982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd5e9f-4f7a-469b-879a-12e1c81d7c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:56.870350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd5e9f-4f7a-469b-879a-12e1c81d7c46 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:56.900111 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2098/4170] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:56.901123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5e9f-4f7a-469b-879a-12e1c81d7c46 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:56.920789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5e9f-4f7a-469b-879a-12e1c81d7c46 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:56.936024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11f6ad-5d8d-457f-85b2-9b4d14efcaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:56.936917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11f6ad-5d8d-457f-85b2-9b4d14efcaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:56.937377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11f6ad-5d8d-457f-85b2-9b4d14efcaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:56.937882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11f6ad-5d8d-457f-85b2-9b4d14efcaf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:56.939427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11f6ad-5d8d-457f-85b2-9b4d14efcaf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:56.940008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11f6ad-5d8d-457f-85b2-9b4d14efcaf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:56.942127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11f6ad-5d8d-457f-85b2-9b4d14efcaf3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:56.988229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c13b7-46e8-4ee6-80e6-d5d700a7b92c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:56.990940 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2099/4171] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:56.996526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11f6ad-5d8d-457f-85b2-9b4d14efcaf3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:57.021636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11f6ad-5d8d-457f-85b2-9b4d14efcaf3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:57.031087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3be26c-8d95-46b6-8390-25d53482bde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:57.031804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3be26c-8d95-46b6-8390-25d53482bde0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.032311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3be26c-8d95-46b6-8390-25d53482bde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.032440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3be26c-8d95-46b6-8390-25d53482bde0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.033303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3be26c-8d95-46b6-8390-25d53482bde0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:57.035463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3be26c-8d95-46b6-8390-25d53482bde0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:57.082617 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2100/4172] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:56 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:59:57.086523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3be26c-8d95-46b6-8390-25d53482bde0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:57.199644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffda4d-758e-4459-9198-1eb3f2449dd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:57.201261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffda4d-758e-4459-9198-1eb3f2449dd5 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.201709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffda4d-758e-4459-9198-1eb3f2449dd5 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.203533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffda4d-758e-4459-9198-1eb3f2449dd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.209281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-48ffda4d-758e-4459-9198-1eb3f2449dd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:57.234054 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:57.242788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffda4d-758e-4459-9198-1eb3f2449dd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:57.251892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffda4d-758e-4459-9198-1eb3f2449dd5 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:57.264878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3be26c-8d95-46b6-8390-25d53482bde0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:57.271716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d867c87-7b3d-43e6-85ba-3c2c83affece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:57.273052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d867c87-7b3d-43e6-85ba-3c2c83affece admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.273395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d867c87-7b3d-43e6-85ba-3c2c83affece admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.273839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d867c87-7b3d-43e6-85ba-3c2c83affece admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.274833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d867c87-7b3d-43e6-85ba-3c2c83affece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:57.277003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d867c87-7b3d-43e6-85ba-3c2c83affece admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:57.298743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2073/4173] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:57.313539 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2101/4174] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:57 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:59:57.318192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffda4d-758e-4459-9198-1eb3f2449dd5 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:57.370229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffda4d-758e-4459-9198-1eb3f2449dd5 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:57.394196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed50c1-6f30-4233-ac09-749f50c492b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:57.398597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed50c1-6f30-4233-ac09-749f50c492b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.410409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed50c1-6f30-4233-ac09-749f50c492b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.410701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed50c1-6f30-4233-ac09-749f50c492b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.411419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed50c1-6f30-4233-ac09-749f50c492b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:57.419143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed50c1-6f30-4233-ac09-749f50c492b0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:57.437623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d867c87-7b3d-43e6-85ba-3c2c83affece admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:57.440495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9d867c87-7b3d-43e6-85ba-3c2c83affece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:57.490431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d867c87-7b3d-43e6-85ba-3c2c83affece admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:57.496661 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2074/4175] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:57.499500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed50c1-6f30-4233-ac09-749f50c492b0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:57.511824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:57.516075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.518005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.518478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] PATH_INFO: `/v3/projects/edff602a7e6f44ffae33d0a88ecbf3ad` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.520349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edff602a7e6f44ffae33d0a88ecbf3ad)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:57.524448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:57.525731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed50c1-6f30-4233-ac09-749f50c492b0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:57.541603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004775b-62f4-4a05-a33c-b3cd7048b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:57.542237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004775b-62f4-4a05-a33c-b3cd7048b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.542518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004775b-62f4-4a05-a33c-b3cd7048b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.542795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004775b-62f4-4a05-a33c-b3cd7048b9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.543725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004775b-62f4-4a05-a33c-b3cd7048b9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:57.545386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004775b-62f4-4a05-a33c-b3cd7048b9fb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:57.574900 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2075/4176] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:57.579080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004775b-62f4-4a05-a33c-b3cd7048b9fb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:57.594185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004775b-62f4-4a05-a33c-b3cd7048b9fb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:57.634398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ee59-8b2e-47a5-b0ea-aedbc15278cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:57.635086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ee59-8b2e-47a5-b0ea-aedbc15278cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.635339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ee59-8b2e-47a5-b0ea-aedbc15278cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.636941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ee59-8b2e-47a5-b0ea-aedbc15278cc admin admin] PATH_INFO: `/v3/projects/ff32aa4147574c87bb920e58a5209a8c/users/fa4f7b57444d43b5b18a24d446fed2e3/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.660153 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:57.668392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edff602a7e6f44ffae33d0a88ecbf3ad', 'request_id': 'req-d4130ba1-e48a-45e2-af57-b0cf015b0351'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:57.680438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ee59-8b2e-47a5-b0ea-aedbc15278cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff32aa4147574c87bb920e58a5209a8c, user_id=fa4f7b57444d43b5b18a24d446fed2e3, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:57.683382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ee59-8b2e-47a5-b0ea-aedbc15278cc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:57.687634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edff602a7e6f44ffae33d0a88ecbf3ad', 'request_id': 'req-d4130ba1-e48a-45e2-af57-b0cf015b0351'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:57.702490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edff602a7e6f44ffae33d0a88ecbf3ad', 'request_id': 'req-d4130ba1-e48a-45e2-af57-b0cf015b0351'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:57.712711 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2076/4177] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:57 2022] PUT /identity/v3/projects/ff32aa4147574c87bb920e58a5209a8c/users/fa4f7b57444d43b5b18a24d446fed2e3/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:57.723925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6e60-ca47-4a2c-9c1b-9463a8c8d721 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.724215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6e60-ca47-4a2c-9c1b-9463a8c8d721 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.724488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6e60-ca47-4a2c-9c1b-9463a8c8d721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.725181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] The token cache is being invalidate because project edff602a7e6f44ffae33d0a88ecbf3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:57.726334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:57.727557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d4130ba1-e48a-45e2-af57-b0cf015b0351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:57.732706 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2102/4178] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:57 2022] DELETE /identity/v3/projects/edff602a7e6f44ffae33d0a88ecbf3ad => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:59:57.738661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f9481-0c0b-49ad-a09b-c541f981f344 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.739143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f9481-0c0b-49ad-a09b-c541f981f344 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.739586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f9481-0c0b-49ad-a09b-c541f981f344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.782792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-acfc6e60-ca47-4a2c-9c1b-9463a8c8d721 None None] MFA Rules not processed for user `fa4f7b57444d43b5b18a24d446fed2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:57.786160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-acfc6e60-ca47-4a2c-9c1b-9463a8c8d721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:57.790815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-025f9481-0c0b-49ad-a09b-c541f981f344 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:57.794772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-025f9481-0c0b-49ad-a09b-c541f981f344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:57.904611 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2103/4179] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:57.906232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7378d7-5ba1-4736-9e12-3af202faa1be None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.906589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7378d7-5ba1-4736-9e12-3af202faa1be None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.906938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7378d7-5ba1-4736-9e12-3af202faa1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.911590 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2077/4180] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:59:57.913569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e1a88-f149-4a40-a3c4-24f526da1148 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.914045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e1a88-f149-4a40-a3c4-24f526da1148 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.914493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e1a88-f149-4a40-a3c4-24f526da1148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.937498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-828e1a88-f149-4a40-a3c4-24f526da1148 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:57.939017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-828e1a88-f149-4a40-a3c4-24f526da1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:57.943723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ce7378d7-5ba1-4736-9e12-3af202faa1be None None] MFA Rules not processed for user `2190bd30671b47048aed416f9c14a545`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:57.950273 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2078/4181] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:57.951494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e1a88-f149-4a40-a3c4-24f526da1148 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:57.953086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ce7378d7-5ba1-4736-9e12-3af202faa1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:57.953519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-828e1a88-f149-4a40-a3c4-24f526da1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:57.966652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e1a88-f149-4a40-a3c4-24f526da1148 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:57.972050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6dc20-722b-46e1-b476-75045a7ad1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:57.972678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6dc20-722b-46e1-b476-75045a7ad1af admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:57.972956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6dc20-722b-46e1-b476-75045a7ad1af admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:57.973226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6dc20-722b-46e1-b476-75045a7ad1af admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:57.973858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6dc20-722b-46e1-b476-75045a7ad1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:57.976358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6dc20-722b-46e1-b476-75045a7ad1af admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.023117 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2079/4182] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:57 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:58.024053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6dc20-722b-46e1-b476-75045a7ad1af admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.101895 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2104/4183] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:58.103120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7378d7-5ba1-4736-9e12-3af202faa1be None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.137901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7378d7-5ba1-4736-9e12-3af202faa1be None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.149416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6dc20-722b-46e1-b476-75045a7ad1af admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.151743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc93060-873e-4106-a25f-e3c446088923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.153021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc93060-873e-4106-a25f-e3c446088923 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.153021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc93060-873e-4106-a25f-e3c446088923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.153021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc93060-873e-4106-a25f-e3c446088923 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.153549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc93060-873e-4106-a25f-e3c446088923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.155631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc93060-873e-4106-a25f-e3c446088923 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.161656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0dd0d-8f49-4a91-b884-ea5cea933585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.161656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0dd0d-8f49-4a91-b884-ea5cea933585 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.162015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0dd0d-8f49-4a91-b884-ea5cea933585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.162015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0dd0d-8f49-4a91-b884-ea5cea933585 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.165123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0dd0d-8f49-4a91-b884-ea5cea933585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:58.165123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0dd0d-8f49-4a91-b884-ea5cea933585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.167153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0dd0d-8f49-4a91-b884-ea5cea933585 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.181021 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2080/4184] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:58.185562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0dd0d-8f49-4a91-b884-ea5cea933585 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.192501 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:58.198506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0dd0d-8f49-4a91-b884-ea5cea933585 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.211757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e280d-2085-4bae-9ce4-d9e7a5a5088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.212500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e280d-2085-4bae-9ce4-d9e7a5a5088a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.212909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e280d-2085-4bae-9ce4-d9e7a5a5088a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.213286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e280d-2085-4bae-9ce4-d9e7a5a5088a admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.223510 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2105/4185] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:58 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:58.227515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc93060-873e-4106-a25f-e3c446088923 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.236468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e280d-2085-4bae-9ce4-d9e7a5a5088a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.243499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e280d-2085-4bae-9ce4-d9e7a5a5088a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.248996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc93060-873e-4106-a25f-e3c446088923 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.254807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e2fc9-37cf-49ab-9c60-cca8e805e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.255763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e2fc9-37cf-49ab-9c60-cca8e805e2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.256329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e2fc9-37cf-49ab-9c60-cca8e805e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.257353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e2fc9-37cf-49ab-9c60-cca8e805e2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.258232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e2fc9-37cf-49ab-9c60-cca8e805e2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.260031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e2fc9-37cf-49ab-9c60-cca8e805e2e4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.276750 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2106/4186] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:58.278871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e2fc9-37cf-49ab-9c60-cca8e805e2e4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.281695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4f7e2fc9-37cf-49ab-9c60-cca8e805e2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:58.298520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e2fc9-37cf-49ab-9c60-cca8e805e2e4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.305123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.306203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.306802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.307250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] PATH_INFO: `/v3/projects/ffd06d4e7c51407298329292acc58529` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.308790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd06d4e7c51407298329292acc58529)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.311304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.320760 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2081/4187] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:58 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:58.324913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e280d-2085-4bae-9ce4-d9e7a5a5088a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.448313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e280d-2085-4bae-9ce4-d9e7a5a5088a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.458823 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:58.468342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd06d4e7c51407298329292acc58529', 'request_id': 'req-d987af13-dff0-425e-8602-4f6a0ae6be37'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:58.493692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd06d4e7c51407298329292acc58529', 'request_id': 'req-d987af13-dff0-425e-8602-4f6a0ae6be37'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:58.508833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd06d4e7c51407298329292acc58529', 'request_id': 'req-d987af13-dff0-425e-8602-4f6a0ae6be37'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:58.550634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] The token cache is being invalidate because project ffd06d4e7c51407298329292acc58529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:59:58.550926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:58.556421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f6765-2fd7-4523-8a0c-2533b3c89c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.557928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:59:58.559852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f6765-2fd7-4523-8a0c-2533b3c89c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.560137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f6765-2fd7-4523-8a0c-2533b3c89c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.560431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f6765-2fd7-4523-8a0c-2533b3c89c56 admin admin] PATH_INFO: `/v3/projects/6c81c1e5f3fa43e79acecce46367dd9d/users/dc093d8ce5c94379ac85f32d4600a9b3/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.564360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2107/4188] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:58 2022] DELETE /identity/v3/projects/ffd06d4e7c51407298329292acc58529 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:58.567884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.571514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:58.602832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f6765-2fd7-4523-8a0c-2533b3c89c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c81c1e5f3fa43e79acecce46367dd9d, user_id=dc093d8ce5c94379ac85f32d4600a9b3, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.605734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f6765-2fd7-4523-8a0c-2533b3c89c56 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.619191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987af13-dff0-425e-8602-4f6a0ae6be37 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.626851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242d715-ed35-42aa-a436-06bed661ae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.627682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242d715-ed35-42aa-a436-06bed661ae29 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.628034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242d715-ed35-42aa-a436-06bed661ae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.628378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242d715-ed35-42aa-a436-06bed661ae29 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.629409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242d715-ed35-42aa-a436-06bed661ae29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.632459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242d715-ed35-42aa-a436-06bed661ae29 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.641764 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2082/4189] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:58 2022] PUT /identity/v3/projects/6c81c1e5f3fa43e79acecce46367dd9d/users/dc093d8ce5c94379ac85f32d4600a9b3/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:58.641764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0786ee4-4803-4cf5-953e-71a352eddb1d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.641764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0786ee4-4803-4cf5-953e-71a352eddb1d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.641764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0786ee4-4803-4cf5-953e-71a352eddb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.683632 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2108/4190] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:58 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:58.684337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242d715-ed35-42aa-a436-06bed661ae29 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.688023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c0786ee4-4803-4cf5-953e-71a352eddb1d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:58.689094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a242d715-ed35-42aa-a436-06bed661ae29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:58.689329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c0786ee4-4803-4cf5-953e-71a352eddb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:58.718093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242d715-ed35-42aa-a436-06bed661ae29 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.794445 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2083/4191] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:58.795654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0786ee4-4803-4cf5-953e-71a352eddb1d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.826347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09272bd-7282-4fc1-a508-c45227014c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.826839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0786ee4-4803-4cf5-953e-71a352eddb1d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.827213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09272bd-7282-4fc1-a508-c45227014c9f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.827556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09272bd-7282-4fc1-a508-c45227014c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.827978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09272bd-7282-4fc1-a508-c45227014c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.828997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09272bd-7282-4fc1-a508-c45227014c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.831991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09272bd-7282-4fc1-a508-c45227014c9f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.840967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e2ad-51c5-4a49-a6c4-360ac1c00346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.841648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e2ad-51c5-4a49-a6c4-360ac1c00346 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.841957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e2ad-51c5-4a49-a6c4-360ac1c00346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.842249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e2ad-51c5-4a49-a6c4-360ac1c00346 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.842936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2e2ad-51c5-4a49-a6c4-360ac1c00346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.845119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2e2ad-51c5-4a49-a6c4-360ac1c00346 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.847828 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2109/4192] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:58.851310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ad643-9aad-4bb5-a6d8-bc4cc88a1c11 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.851310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ad643-9aad-4bb5-a6d8-bc4cc88a1c11 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.851310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ad643-9aad-4bb5-a6d8-bc4cc88a1c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.862624 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2084/4193] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:58.862624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e2ad-51c5-4a49-a6c4-360ac1c00346 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.869510 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:58.879200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e2ad-51c5-4a49-a6c4-360ac1c00346 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:58.894795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef35265-1604-4b2f-90c2-b5a64b0f0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:58.895549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef35265-1604-4b2f-90c2-b5a64b0f0785 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:58.895901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef35265-1604-4b2f-90c2-b5a64b0f0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:58.896246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef35265-1604-4b2f-90c2-b5a64b0f0785 admin admin] PATH_INFO: `/v3/projects/6c81c1e5f3fa43e79acecce46367dd9d/users/dc093d8ce5c94379ac85f32d4600a9b3/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:58.896733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6f1ad643-9aad-4bb5-a6d8-bc4cc88a1c11 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:58.899261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef35265-1604-4b2f-90c2-b5a64b0f0785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c81c1e5f3fa43e79acecce46367dd9d, user_id=dc093d8ce5c94379ac85f32d4600a9b3, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:58.900076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6f1ad643-9aad-4bb5-a6d8-bc4cc88a1c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:58.902388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef35265-1604-4b2f-90c2-b5a64b0f0785 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:58.913769 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2110/4194] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:58.918742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ad643-9aad-4bb5-a6d8-bc4cc88a1c11 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.924655 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2085/4195] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:58 2022] PUT /identity/v3/projects/6c81c1e5f3fa43e79acecce46367dd9d/users/dc093d8ce5c94379ac85f32d4600a9b3/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:58.924655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef35265-1604-4b2f-90c2-b5a64b0f0785 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:58.935465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ad643-9aad-4bb5-a6d8-bc4cc88a1c11 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.006477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef35265-1604-4b2f-90c2-b5a64b0f0785 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.010310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7d137-a381-4823-8f1c-e3b06ada939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.011125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d137-a381-4823-8f1c-e3b06ada939c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.011415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d137-a381-4823-8f1c-e3b06ada939c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.011737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d137-a381-4823-8f1c-e3b06ada939c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.012335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7d137-a381-4823-8f1c-e3b06ada939c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.012778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145b2ac-7266-4659-9af5-ed88e711cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.013489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145b2ac-7266-4659-9af5-ed88e711cec1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.013845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145b2ac-7266-4659-9af5-ed88e711cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.014076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7d137-a381-4823-8f1c-e3b06ada939c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.014245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145b2ac-7266-4659-9af5-ed88e711cec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.015321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145b2ac-7266-4659-9af5-ed88e711cec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:59:59.015962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145b2ac-7266-4659-9af5-ed88e711cec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.018168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145b2ac-7266-4659-9af5-ed88e711cec1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.027704 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2111/4196] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:59.029476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e0b6-9263-4b07-8399-08095a52c92e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.029837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e0b6-9263-4b07-8399-08095a52c92e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.030182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e0b6-9263-4b07-8399-08095a52c92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.041115 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2086/4197] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 00:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:59:59.043701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145b2ac-7266-4659-9af5-ed88e711cec1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.057986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145b2ac-7266-4659-9af5-ed88e711cec1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.063509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614aa7-0288-4f9d-b4d0-3adc7cca5a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.064580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614aa7-0288-4f9d-b4d0-3adc7cca5a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.065288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614aa7-0288-4f9d-b4d0-3adc7cca5a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.065977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614aa7-0288-4f9d-b4d0-3adc7cca5a51 admin admin] PATH_INFO: `/v3/projects/692dec098fa54c34957b008068480556/users/134fd5a30e554258b05f1ae9e927f13d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.072326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ea31e0b6-9263-4b07-8399-08095a52c92e None None] MFA Rules not processed for user `dc093d8ce5c94379ac85f32d4600a9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:59.073652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea31e0b6-9263-4b07-8399-08095a52c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:59.086076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88614aa7-0288-4f9d-b4d0-3adc7cca5a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=692dec098fa54c34957b008068480556, user_id=134fd5a30e554258b05f1ae9e927f13d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.089846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88614aa7-0288-4f9d-b4d0-3adc7cca5a51 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.107935 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2087/4198] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:59 2022] PUT /identity/v3/projects/692dec098fa54c34957b008068480556/users/134fd5a30e554258b05f1ae9e927f13d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:59.118326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614aa7-0288-4f9d-b4d0-3adc7cca5a51 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.132415 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:59.190983 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2112/4199] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:59.192447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74d450-bef5-4a39-87cc-b1a24fcf6d91 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.192839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74d450-bef5-4a39-87cc-b1a24fcf6d91 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.193180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74d450-bef5-4a39-87cc-b1a24fcf6d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.194245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614aa7-0288-4f9d-b4d0-3adc7cca5a51 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.200453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3382-989d-443f-bc1e-c2faa16c5bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.201502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3382-989d-443f-bc1e-c2faa16c5bab admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.202165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3382-989d-443f-bc1e-c2faa16c5bab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.202641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3382-989d-443f-bc1e-c2faa16c5bab admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.203510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a3382-989d-443f-bc1e-c2faa16c5bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.205700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a3382-989d-443f-bc1e-c2faa16c5bab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.224420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5b74d450-bef5-4a39-87cc-b1a24fcf6d91 None None] MFA Rules not processed for user `134fd5a30e554258b05f1ae9e927f13d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:59.226385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5b74d450-bef5-4a39-87cc-b1a24fcf6d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:59.238565 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2088/4200] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:59 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:59.240263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3382-989d-443f-bc1e-c2faa16c5bab admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.243236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1f2a3382-989d-443f-bc1e-c2faa16c5bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:59.297282 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:59.306014 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2113/4201] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:59.306949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74d450-bef5-4a39-87cc-b1a24fcf6d91 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.322826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74d450-bef5-4a39-87cc-b1a24fcf6d91 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.342364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3382-989d-443f-bc1e-c2faa16c5bab admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.348754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afeeba-5dde-4eb3-9476-6002b4dca130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.349029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afeeba-5dde-4eb3-9476-6002b4dca130 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.349282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afeeba-5dde-4eb3-9476-6002b4dca130 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.349959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afeeba-5dde-4eb3-9476-6002b4dca130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.399170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34128674-bfd4-4605-b246-c5d12a5a2e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.399795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34128674-bfd4-4605-b246-c5d12a5a2e98 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.400077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34128674-bfd4-4605-b246-c5d12a5a2e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.400369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34128674-bfd4-4605-b246-c5d12a5a2e98 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.401221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34128674-bfd4-4605-b246-c5d12a5a2e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.403822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34128674-bfd4-4605-b246-c5d12a5a2e98 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.425044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afeeba-5dde-4eb3-9476-6002b4dca130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.427124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afeeba-5dde-4eb3-9476-6002b4dca130 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.434535 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2114/4202] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:59 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:59.434535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34128674-bfd4-4605-b246-c5d12a5a2e98 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.446140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34128674-bfd4-4605-b246-c5d12a5a2e98 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.447191 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2089/4203] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 00:59:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:59.448219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afeeba-5dde-4eb3-9476-6002b4dca130 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.452440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77d9b-6ac8-4903-9dc9-1fa268d66ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.453391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77d9b-6ac8-4903-9dc9-1fa268d66ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.453928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77d9b-6ac8-4903-9dc9-1fa268d66ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.454200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77d9b-6ac8-4903-9dc9-1fa268d66ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.455660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f77d9b-6ac8-4903-9dc9-1fa268d66ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.458365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f77d9b-6ac8-4903-9dc9-1fa268d66ed0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.460221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afeeba-5dde-4eb3-9476-6002b4dca130 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.465550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ba967-d6cb-4be8-b8b6-79755dd70ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.466277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ba967-d6cb-4be8-b8b6-79755dd70ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.466649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ba967-d6cb-4be8-b8b6-79755dd70ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.467023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ba967-d6cb-4be8-b8b6-79755dd70ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.467802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ba967-d6cb-4be8-b8b6-79755dd70ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.469556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ba967-d6cb-4be8-b8b6-79755dd70ee8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.481266 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2090/4204] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:59.485666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ba967-d6cb-4be8-b8b6-79755dd70ee8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.500768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ba967-d6cb-4be8-b8b6-79755dd70ee8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.508646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a619a-63db-4d96-826b-61e38c20bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.509472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a619a-63db-4d96-826b-61e38c20bfde admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.510167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a619a-63db-4d96-826b-61e38c20bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.511210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a619a-63db-4d96-826b-61e38c20bfde admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.512120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a619a-63db-4d96-826b-61e38c20bfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.514647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a619a-63db-4d96-826b-61e38c20bfde admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.529286 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2115/4205] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 00:59:59 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:59.529862 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2091/4206] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:59:59.533886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a619a-63db-4d96-826b-61e38c20bfde admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.534376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77d9b-6ac8-4903-9dc9-1fa268d66ed0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.546234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a619a-63db-4d96-826b-61e38c20bfde admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.566936 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:59.653296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f430814-bdff-45e9-b3b4-a90bd7422ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.653296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f430814-bdff-45e9-b3b4-a90bd7422ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.653296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f430814-bdff-45e9-b3b4-a90bd7422ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.653816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77d9b-6ac8-4903-9dc9-1fa268d66ed0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.653913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f430814-bdff-45e9-b3b4-a90bd7422ce0 admin admin] PATH_INFO: `/v3/projects/19fba46eb5574a409d9804a21e10d7ba/users/cc36181de6f34dc6b59bbf1eb6cc383e/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.663821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6bae-7362-4b27-8b06-7dc1f8f6ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.664354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6bae-7362-4b27-8b06-7dc1f8f6ef2e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.665482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6bae-7362-4b27-8b06-7dc1f8f6ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.665836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6bae-7362-4b27-8b06-7dc1f8f6ef2e admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.666557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd6bae-7362-4b27-8b06-7dc1f8f6ef2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.672057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd6bae-7362-4b27-8b06-7dc1f8f6ef2e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.676766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f430814-bdff-45e9-b3b4-a90bd7422ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fba46eb5574a409d9804a21e10d7ba, user_id=cc36181de6f34dc6b59bbf1eb6cc383e, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.680196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f430814-bdff-45e9-b3b4-a90bd7422ce0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.704652 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2116/4207] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 00:59:59 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:59:59.714009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6bae-7362-4b27-8b06-7dc1f8f6ef2e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.721888 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2092/4208] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:59 2022] PUT /identity/v3/projects/19fba46eb5574a409d9804a21e10d7ba/users/cc36181de6f34dc6b59bbf1eb6cc383e/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:59:59.732859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b4f59-652a-405a-8e25-36ff5260deff None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.733503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b4f59-652a-405a-8e25-36ff5260deff None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.734062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b4f59-652a-405a-8e25-36ff5260deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.736649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6bae-7362-4b27-8b06-7dc1f8f6ef2e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.777980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-166b4f59-652a-405a-8e25-36ff5260deff None None] MFA Rules not processed for user `cc36181de6f34dc6b59bbf1eb6cc383e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:59:59.780478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-166b4f59-652a-405a-8e25-36ff5260deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:59:59.812975 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:59.879131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dd8d8-0780-40f1-8b64-de265f1e88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.881728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dd8d8-0780-40f1-8b64-de265f1e88bd admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.882211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dd8d8-0780-40f1-8b64-de265f1e88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.882655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dd8d8-0780-40f1-8b64-de265f1e88bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:59:59.883942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dd8d8-0780-40f1-8b64-de265f1e88bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:59:59.885970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dd8d8-0780-40f1-8b64-de265f1e88bd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:59:59.906932 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2117/4209] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:59:59.913579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dd8d8-0780-40f1-8b64-de265f1e88bd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:59:59.927870 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2093/4210] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:59:59.946853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dd8d8-0780-40f1-8b64-de265f1e88bd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:59:59.966874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d2d20-7627-4d03-9caa-8a80ab67b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:59:59.967387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d2d20-7627-4d03-9caa-8a80ab67b2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:59:59.968329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d2d20-7627-4d03-9caa-8a80ab67b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:59:59.969289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d2d20-7627-4d03-9caa-8a80ab67b2dc admin admin] PATH_INFO: `/v3/projects/1aed6c66237e4d89bcd5f09264d53256/users/e79e222c58d5468d9a01566e9e480fc2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:00.029347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b4f59-652a-405a-8e25-36ff5260deff None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:00.031089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-166b4f59-652a-405a-8e25-36ff5260deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:00.034077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d2d20-7627-4d03-9caa-8a80ab67b2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aed6c66237e4d89bcd5f09264d53256, user_id=e79e222c58d5468d9a01566e9e480fc2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:00.038432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d2d20-7627-4d03-9caa-8a80ab67b2dc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:00.071983 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2118/4211] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 00:59:59 2022] PUT /identity/v3/projects/1aed6c66237e4d89bcd5f09264d53256/users/e79e222c58d5468d9a01566e9e480fc2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:00.073288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d2d20-7627-4d03-9caa-8a80ab67b2dc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:00.169606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d2d20-7627-4d03-9caa-8a80ab67b2dc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:00.177224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00eb50-d41b-4bec-bf26-4e2a7ee812e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:00.178654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00eb50-d41b-4bec-bf26-4e2a7ee812e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:00.179143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00eb50-d41b-4bec-bf26-4e2a7ee812e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:00.179769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00eb50-d41b-4bec-bf26-4e2a7ee812e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:00.180728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00eb50-d41b-4bec-bf26-4e2a7ee812e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:00.183326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00eb50-d41b-4bec-bf26-4e2a7ee812e9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:00.197861 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2119/4212] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:00.203731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00eb50-d41b-4bec-bf26-4e2a7ee812e9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:00.244793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00eb50-d41b-4bec-bf26-4e2a7ee812e9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:00.249853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b4f59-652a-405a-8e25-36ff5260deff None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:00.251344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ecd55-6659-4ead-80eb-8ffa8fdf7721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:00.252674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ecd55-6659-4ead-80eb-8ffa8fdf7721 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:00.253133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ecd55-6659-4ead-80eb-8ffa8fdf7721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:00.253580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ecd55-6659-4ead-80eb-8ffa8fdf7721 admin admin] PATH_INFO: `/v3/projects/1aed6c66237e4d89bcd5f09264d53256/users/e79e222c58d5468d9a01566e9e480fc2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:00.256989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ecd55-6659-4ead-80eb-8ffa8fdf7721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aed6c66237e4d89bcd5f09264d53256, user_id=e79e222c58d5468d9a01566e9e480fc2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:00.260438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ecd55-6659-4ead-80eb-8ffa8fdf7721 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:00.284851 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2120/4213] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:00 2022] PUT /identity/v3/projects/1aed6c66237e4d89bcd5f09264d53256/users/e79e222c58d5468d9a01566e9e480fc2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:00.292560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3807f7-02e3-486a-adc8-09286fd3e598 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:00.294518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3807f7-02e3-486a-adc8-09286fd3e598 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:00.294518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3807f7-02e3-486a-adc8-09286fd3e598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:00.352875 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:00.379645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dc3807f7-02e3-486a-adc8-09286fd3e598 None None] MFA Rules not processed for user `e79e222c58d5468d9a01566e9e480fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:00.384661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc3807f7-02e3-486a-adc8-09286fd3e598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:00.390834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031048e-5ce6-4daa-953c-b9a8b60bd517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:00.391521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031048e-5ce6-4daa-953c-b9a8b60bd517 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:00.392926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031048e-5ce6-4daa-953c-b9a8b60bd517 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:00.393222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031048e-5ce6-4daa-953c-b9a8b60bd517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:00.564745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031048e-5ce6-4daa-953c-b9a8b60bd517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:00.566652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031048e-5ce6-4daa-953c-b9a8b60bd517 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:00.573468 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:00.601581 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2094/4214] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:00:00.618987 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2121/4215] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:00.626048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031048e-5ce6-4daa-953c-b9a8b60bd517 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:00.627576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d031048e-5ce6-4daa-953c-b9a8b60bd517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:00.740110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3807f7-02e3-486a-adc8-09286fd3e598 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:00.811837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031048e-5ce6-4daa-953c-b9a8b60bd517 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:00.936132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3807f7-02e3-486a-adc8-09286fd3e598 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:00.961144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:00.961818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:00.962100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:00.965925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] PATH_INFO: `/v3/users/fa4f7b57444d43b5b18a24d446fed2e3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:00.968789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4f7b57444d43b5b18a24d446fed2e3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:00.974738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:01.013840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87a2e5-543f-4792-874e-a7fb10250426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:01.017191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87a2e5-543f-4792-874e-a7fb10250426 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:01.017664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87a2e5-543f-4792-874e-a7fb10250426 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:01.019266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87a2e5-543f-4792-874e-a7fb10250426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:01.071014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87a2e5-543f-4792-874e-a7fb10250426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:01.072482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87a2e5-543f-4792-874e-a7fb10250426 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:01.115036 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2095/4216] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:01.146989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4f7b57444d43b5b18a24d446fed2e3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.187100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4f7b57444d43b5b18a24d446fed2e3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.205349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87a2e5-543f-4792-874e-a7fb10250426 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:01.235176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4f7b57444d43b5b18a24d446fed2e3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.237206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87a2e5-543f-4792-874e-a7fb10250426 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:01.240358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4f7b57444d43b5b18a24d446fed2e3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.243117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ed6cc950-7cfd-4d5c-a2da-6c9868eb28c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4f7b57444d43b5b18a24d446fed2e3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.246857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:01.249308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:01.249797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:01.250540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] PATH_INFO: `/v3/users/134fd5a30e554258b05f1ae9e927f13d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:01.255887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134fd5a30e554258b05f1ae9e927f13d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:01.257447 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2122/4217] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:00 2022] DELETE /identity/v3/users/fa4f7b57444d43b5b18a24d446fed2e3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:01.259322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:01.261474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38dc5-b764-49f5-913e-94dbbae3e7fa None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:01.261776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38dc5-b764-49f5-913e-94dbbae3e7fa None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:01.263252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38dc5-b764-49f5-913e-94dbbae3e7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:01.322782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3bb38dc5-b764-49f5-913e-94dbbae3e7fa None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:01.330107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3bb38dc5-b764-49f5-913e-94dbbae3e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:01.355394 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:01.362073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134fd5a30e554258b05f1ae9e927f13d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.398874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134fd5a30e554258b05f1ae9e927f13d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.414188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134fd5a30e554258b05f1ae9e927f13d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.427735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134fd5a30e554258b05f1ae9e927f13d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.429411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29f213d3-674f-4f88-be6a-687cbff22899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134fd5a30e554258b05f1ae9e927f13d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.436658 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2096/4218] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:01 2022] DELETE /identity/v3/users/134fd5a30e554258b05f1ae9e927f13d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:00:01.443396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30d00-f7c7-4fa0-885d-1fb3bd98ddc7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:01.443781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30d00-f7c7-4fa0-885d-1fb3bd98ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:01.443949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30d00-f7c7-4fa0-885d-1fb3bd98ddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:01.479200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6ae30d00-f7c7-4fa0-885d-1fb3bd98ddc7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:01.482219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6ae30d00-f7c7-4fa0-885d-1fb3bd98ddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:01.539484 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2123/4219] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:01.547730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb38dc5-b764-49f5-913e-94dbbae3e7fa None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:01.552736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3bb38dc5-b764-49f5-913e-94dbbae3e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:01.557714 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:01.675185 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2097/4220] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:01.677963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30d00-f7c7-4fa0-885d-1fb3bd98ddc7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:01.681207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6ae30d00-f7c7-4fa0-885d-1fb3bd98ddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:01.711884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30d00-f7c7-4fa0-885d-1fb3bd98ddc7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:01.717018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb38dc5-b764-49f5-913e-94dbbae3e7fa None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:01.719745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:01.721316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:01.723067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:01.723607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] PATH_INFO: `/v3/users/cc36181de6f34dc6b59bbf1eb6cc383e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:01.726901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc36181de6f34dc6b59bbf1eb6cc383e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:01.731506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:01.786042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f664f-c060-4076-b7d7-1c168698ee78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:01.787231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f664f-c060-4076-b7d7-1c168698ee78 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:01.787740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f664f-c060-4076-b7d7-1c168698ee78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:01.789450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f664f-c060-4076-b7d7-1c168698ee78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:01.802681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f664f-c060-4076-b7d7-1c168698ee78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:01.805501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f664f-c060-4076-b7d7-1c168698ee78 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:01.820401 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2124/4221] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:01.821739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f664f-c060-4076-b7d7-1c168698ee78 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:01.833492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f664f-c060-4076-b7d7-1c168698ee78 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:01.837034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc36181de6f34dc6b59bbf1eb6cc383e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.840605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36979b54-2ed0-48d0-a212-c6556e5a6d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:01.841655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36979b54-2ed0-48d0-a212-c6556e5a6d57 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:01.842151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36979b54-2ed0-48d0-a212-c6556e5a6d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:01.842769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36979b54-2ed0-48d0-a212-c6556e5a6d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:01.857666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36979b54-2ed0-48d0-a212-c6556e5a6d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:01.861739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36979b54-2ed0-48d0-a212-c6556e5a6d57 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:01.863085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc36181de6f34dc6b59bbf1eb6cc383e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.882767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc36181de6f34dc6b59bbf1eb6cc383e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.893163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc36181de6f34dc6b59bbf1eb6cc383e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.896817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc36181de6f34dc6b59bbf1eb6cc383e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:01.912709 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2125/4222] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:01.915821 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2098/4223] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:01 2022] DELETE /identity/v3/users/cc36181de6f34dc6b59bbf1eb6cc383e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:01.920534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759a18-47ec-4d05-9031-7ee7f9c647da None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:01.926650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759a18-47ec-4d05-9031-7ee7f9c647da None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:01.926990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759a18-47ec-4d05-9031-7ee7f9c647da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:01.983137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-64759a18-47ec-4d05-9031-7ee7f9c647da None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:01.984390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-64759a18-47ec-4d05-9031-7ee7f9c647da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:02.097462 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:02.110535 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2126/4224] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:02.131664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:02.133230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:02.284689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a50c2-a3f1-4db2-9b9d-b8361f8b0c5a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:02.298248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279efa-e4ba-41d6-887c-c1b7e8e126a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:02.298889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279efa-e4ba-41d6-887c-c1b7e8e126a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:02.299506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279efa-e4ba-41d6-887c-c1b7e8e126a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:02.300401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279efa-e4ba-41d6-887c-c1b7e8e126a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:02.313880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69279efa-e4ba-41d6-887c-c1b7e8e126a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:02.315887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69279efa-e4ba-41d6-887c-c1b7e8e126a6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:02.333917 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2099/4225] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:02.650371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29baed7-8aa7-416f-b9db-bcc6b30f1997 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:02.650662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29baed7-8aa7-416f-b9db-bcc6b30f1997 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:02.651008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29baed7-8aa7-416f-b9db-bcc6b30f1997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:02.654745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279efa-e4ba-41d6-887c-c1b7e8e126a6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:02.663783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-69279efa-e4ba-41d6-887c-c1b7e8e126a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:02.694239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e29baed7-8aa7-416f-b9db-bcc6b30f1997 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:02.694239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e29baed7-8aa7-416f-b9db-bcc6b30f1997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:02.698848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279efa-e4ba-41d6-887c-c1b7e8e126a6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:02.721764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:02.722603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:02.723285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:02.724049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] PATH_INFO: `/v3/projects/ff32aa4147574c87bb920e58a5209a8c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:02.726490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff32aa4147574c87bb920e58a5209a8c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:02.735287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:02.793329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2127/4226] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:02.794666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29baed7-8aa7-416f-b9db-bcc6b30f1997 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:02.796096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e29baed7-8aa7-416f-b9db-bcc6b30f1997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:02.803490 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:02.823780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff32aa4147574c87bb920e58a5209a8c', 'request_id': 'req-c40e2374-826a-4904-b29d-7237c5cfd705'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:02.841690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff32aa4147574c87bb920e58a5209a8c', 'request_id': 'req-c40e2374-826a-4904-b29d-7237c5cfd705'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:02.843661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29baed7-8aa7-416f-b9db-bcc6b30f1997 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:02.860914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff32aa4147574c87bb920e58a5209a8c', 'request_id': 'req-c40e2374-826a-4904-b29d-7237c5cfd705'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:02.876844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] The token cache is being invalidate because project ff32aa4147574c87bb920e58a5209a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:02.877115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:02.877791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:02.879653 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2100/4227] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:02 2022] DELETE /identity/v3/projects/ff32aa4147574c87bb920e58a5209a8c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:02.880435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:02.882786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:02.985657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:02.993683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:02.993683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:02.993683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] PATH_INFO: `/v3/projects/692dec098fa54c34957b008068480556` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:02.993683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=692dec098fa54c34957b008068480556)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:02.994307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:03.069198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2374-826a-4904-b29d-7237c5cfd705 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:03.077912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:03.078542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:03.078838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:03.079091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:03.081120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:03.137016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692dec098fa54c34957b008068480556', 'request_id': 'req-e138fc42-af2e-46b8-ad03-331d90143a3a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.150877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692dec098fa54c34957b008068480556', 'request_id': 'req-e138fc42-af2e-46b8-ad03-331d90143a3a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.174320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692dec098fa54c34957b008068480556', 'request_id': 'req-e138fc42-af2e-46b8-ad03-331d90143a3a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.187950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] The token cache is being invalidate because project 692dec098fa54c34957b008068480556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:03.188439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.189235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.202575 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2128/4228] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:02 2022] DELETE /identity/v3/projects/692dec098fa54c34957b008068480556 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:03.202575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:03.202575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:03.205445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:03.207859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:03.219301 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2101/4229] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:00:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:03.220556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:03.222208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:03.249788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5500ff2-a46e-48c9-9710-4d71b7794e51 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:03.278438 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:03.354372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138fc42-af2e-46b8-ad03-331d90143a3a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:03.364966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:03.367999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:03.368375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:03.368834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] PATH_INFO: `/v3/users/dc093d8ce5c94379ac85f32d4600a9b3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:03.371912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc093d8ce5c94379ac85f32d4600a9b3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:03.375110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:03.404432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:03.404432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:03.404432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:03.404432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] PATH_INFO: `/v3/projects/19fba46eb5574a409d9804a21e10d7ba` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:03.405191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fba46eb5574a409d9804a21e10d7ba)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:03.405421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:03.438341 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:03.530747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc093d8ce5c94379ac85f32d4600a9b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.541088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fba46eb5574a409d9804a21e10d7ba', 'request_id': 'req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.563669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fba46eb5574a409d9804a21e10d7ba', 'request_id': 'req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.584508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc093d8ce5c94379ac85f32d4600a9b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.595525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fba46eb5574a409d9804a21e10d7ba', 'request_id': 'req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.609937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc093d8ce5c94379ac85f32d4600a9b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.624659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] The token cache is being invalidate because project 19fba46eb5574a409d9804a21e10d7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:03.624981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.625569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc093d8ce5c94379ac85f32d4600a9b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.626225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.626828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c7cafaed-49b8-43e1-918b-c9d4339e1a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc093d8ce5c94379ac85f32d4600a9b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:03.630952 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2102/4230] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:03 2022] DELETE /identity/v3/projects/19fba46eb5574a409d9804a21e10d7ba => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:03.634119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:03.638459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:03.640399 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2129/4231] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:03 2022] DELETE /identity/v3/users/dc093d8ce5c94379ac85f32d4600a9b3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:03.644103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c15ef1-745a-48c6-884c-d1fcc0d9ea74 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:03.645027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c15ef1-745a-48c6-884c-d1fcc0d9ea74 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:03.645929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c15ef1-745a-48c6-884c-d1fcc0d9ea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:03.706831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a0c15ef1-745a-48c6-884c-d1fcc0d9ea74 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:03.708135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a0c15ef1-745a-48c6-884c-d1fcc0d9ea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:03.817627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcc394-b5ed-471c-aad0-1e5f6a32aca4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:03.883684 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2130/4232] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:03.900754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f6187-7ffb-47d4-b201-97bd7718bb65 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:03.901050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f6187-7ffb-47d4-b201-97bd7718bb65 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:03.901337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f6187-7ffb-47d4-b201-97bd7718bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:03.969251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ce5f6187-7ffb-47d4-b201-97bd7718bb65 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:03.970508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ce5f6187-7ffb-47d4-b201-97bd7718bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:04.007891 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2131/4233] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:04.014738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f6187-7ffb-47d4-b201-97bd7718bb65 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:04.028957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:04.030211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:04.031331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:04.032451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] PATH_INFO: `/v3/users/e79e222c58d5468d9a01566e9e480fc2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:04.037901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79e222c58d5468d9a01566e9e480fc2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:04.040572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f6187-7ffb-47d4-b201-97bd7718bb65 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:04.046735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:04.070388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8558209-8c6c-431d-8426-68df7541c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:04.072021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8558209-8c6c-431d-8426-68df7541c352 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:04.073915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8558209-8c6c-431d-8426-68df7541c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:04.075889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8558209-8c6c-431d-8426-68df7541c352 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:04.082026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8558209-8c6c-431d-8426-68df7541c352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:04.082470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8558209-8c6c-431d-8426-68df7541c352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:04.088981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8558209-8c6c-431d-8426-68df7541c352 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:04.151917 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2132/4234] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:04.166556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8558209-8c6c-431d-8426-68df7541c352 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:04.218042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8558209-8c6c-431d-8426-68df7541c352 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:04.231031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f3b10-d2b6-4a6a-be7a-2e844a8e99ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:04.231665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f3b10-d2b6-4a6a-be7a-2e844a8e99ec admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:04.231949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f3b10-d2b6-4a6a-be7a-2e844a8e99ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:04.235565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f3b10-d2b6-4a6a-be7a-2e844a8e99ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:04.236521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f3b10-d2b6-4a6a-be7a-2e844a8e99ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:04.239726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f3b10-d2b6-4a6a-be7a-2e844a8e99ec admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:04.250303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79e222c58d5468d9a01566e9e480fc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.255356 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:04.286694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79e222c58d5468d9a01566e9e480fc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.318065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79e222c58d5468d9a01566e9e480fc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.351452 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2133/4235] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:04 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:04.358071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f3b10-d2b6-4a6a-be7a-2e844a8e99ec admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:04.361349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79e222c58d5468d9a01566e9e480fc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.363044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79e222c58d5468d9a01566e9e480fc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.363410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9c3f3b10-d2b6-4a6a-be7a-2e844a8e99ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:04.384753 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2103/4236] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:03 2022] DELETE /identity/v3/users/e79e222c58d5468d9a01566e9e480fc2 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:04.389077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:04.392944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:04.407632 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:04.519733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f3b10-d2b6-4a6a-be7a-2e844a8e99ec admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:04.606906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2a466-1cdb-4348-aaf1-6bb993c94a07 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:04.610681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:04.611623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:04.612046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:04.612425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] PATH_INFO: `/v3/projects/6c81c1e5f3fa43e79acecce46367dd9d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:04.614741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c81c1e5f3fa43e79acecce46367dd9d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:04.617832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:04.630401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52872899-2bb7-4689-862a-5f7ff90bebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:04.631054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52872899-2bb7-4689-862a-5f7ff90bebf1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:04.631326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52872899-2bb7-4689-862a-5f7ff90bebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:04.631743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52872899-2bb7-4689-862a-5f7ff90bebf1 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:04.637250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52872899-2bb7-4689-862a-5f7ff90bebf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:04.639243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52872899-2bb7-4689-862a-5f7ff90bebf1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:04.693640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c81c1e5f3fa43e79acecce46367dd9d', 'request_id': 'req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.706593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c81c1e5f3fa43e79acecce46367dd9d', 'request_id': 'req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.715484 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2104/4237] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:04 2022] POST /identity/v3/users => generated 297 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:04.715794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c81c1e5f3fa43e79acecce46367dd9d', 'request_id': 'req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.719135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52872899-2bb7-4689-862a-5f7ff90bebf1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:04.734975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] The token cache is being invalidate because project 6c81c1e5f3fa43e79acecce46367dd9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:04.735317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.736302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a84c17a-a4e2-4647-9950-6dc87dfb15cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:04.738180 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2134/4238] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:04 2022] DELETE /identity/v3/projects/6c81c1e5f3fa43e79acecce46367dd9d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:04.738353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52872899-2bb7-4689-862a-5f7ff90bebf1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:04.743348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80c712-6650-4d34-979b-d2a1cb3b41bf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:04.743639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80c712-6650-4d34-979b-d2a1cb3b41bf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:04.743919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80c712-6650-4d34-979b-d2a1cb3b41bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:04.769329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8e80c712-6650-4d34-979b-d2a1cb3b41bf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:04.770578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8e80c712-6650-4d34-979b-d2a1cb3b41bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:04.861141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2895f-3683-46e3-bdb8-00b94c6ca7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:04.862350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2895f-3683-46e3-bdb8-00b94c6ca7be admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:04.862619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2895f-3683-46e3-bdb8-00b94c6ca7be admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:04.862897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2895f-3683-46e3-bdb8-00b94c6ca7be admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:04.870507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2895f-3683-46e3-bdb8-00b94c6ca7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:04.875275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2895f-3683-46e3-bdb8-00b94c6ca7be admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:04.903591 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:04.904078 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2105/4239] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:00:04.904909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2895f-3683-46e3-bdb8-00b94c6ca7be admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:04.908908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4eb2895f-3683-46e3-bdb8-00b94c6ca7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:04.935001 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2135/4240] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:04.941381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2895f-3683-46e3-bdb8-00b94c6ca7be admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:04.946700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4e91-bfe7-47e3-8eaa-ac719fbaa5c5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:04.946991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4e91-bfe7-47e3-8eaa-ac719fbaa5c5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:04.947271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4e91-bfe7-47e3-8eaa-ac719fbaa5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:04.968437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aa536-e219-4f39-8b7e-933c3c3886ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:04.969121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aa536-e219-4f39-8b7e-933c3c3886ee admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:04.969358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aa536-e219-4f39-8b7e-933c3c3886ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:04.969636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aa536-e219-4f39-8b7e-933c3c3886ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:04.970285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3aa536-e219-4f39-8b7e-933c3c3886ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:04.971889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3aa536-e219-4f39-8b7e-933c3c3886ee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.002115 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2106/4241] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:05.005635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aa536-e219-4f39-8b7e-933c3c3886ee admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:05.012465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-716b4e91-bfe7-47e3-8eaa-ac719fbaa5c5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:05.014851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-716b4e91-bfe7-47e3-8eaa-ac719fbaa5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:05.034740 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2136/4242] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:05.038429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aa536-e219-4f39-8b7e-933c3c3886ee admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:05.040557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b4e91-bfe7-47e3-8eaa-ac719fbaa5c5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:05.054020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ad5ec-415a-4abb-89e5-428898f81864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:05.055041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad5ec-415a-4abb-89e5-428898f81864 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.055415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad5ec-415a-4abb-89e5-428898f81864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.055653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b4e91-bfe7-47e3-8eaa-ac719fbaa5c5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:05.056131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad5ec-415a-4abb-89e5-428898f81864 admin admin] PATH_INFO: `/v3/projects/7d0aac4d8ecb47ff8ad2e666de23c1c1/users/8f138ca4a03c4459ab40866b7f2e2d94/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.064829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa44fa-eaf5-4799-953b-78eac70a30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:05.066023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa44fa-eaf5-4799-953b-78eac70a30e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.066331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa44fa-eaf5-4799-953b-78eac70a30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.067060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa44fa-eaf5-4799-953b-78eac70a30e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.067729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa44fa-eaf5-4799-953b-78eac70a30e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:05.068037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa44fa-eaf5-4799-953b-78eac70a30e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:05.070289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa44fa-eaf5-4799-953b-78eac70a30e3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.081151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ad5ec-415a-4abb-89e5-428898f81864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0aac4d8ecb47ff8ad2e666de23c1c1, user_id=8f138ca4a03c4459ab40866b7f2e2d94, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:05.095100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ad5ec-415a-4abb-89e5-428898f81864 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.099448 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2137/4243] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:05.108123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa44fa-eaf5-4799-953b-78eac70a30e3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:05.112581 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2107/4244] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:05 2022] PUT /identity/v3/projects/7d0aac4d8ecb47ff8ad2e666de23c1c1/users/8f138ca4a03c4459ab40866b7f2e2d94/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:05.123055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46b245-1b8d-454d-b057-b116e73b393c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.123568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46b245-1b8d-454d-b057-b116e73b393c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.123813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46b245-1b8d-454d-b057-b116e73b393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.126187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa44fa-eaf5-4799-953b-78eac70a30e3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:05.145391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4f46b245-1b8d-454d-b057-b116e73b393c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:05.146751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4f46b245-1b8d-454d-b057-b116e73b393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:05.166614 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:05.246798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7920aff-b798-42c1-9eab-bbf277321fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:05.250471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7920aff-b798-42c1-9eab-bbf277321fad admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.250781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7920aff-b798-42c1-9eab-bbf277321fad admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.251064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7920aff-b798-42c1-9eab-bbf277321fad admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.251855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7920aff-b798-42c1-9eab-bbf277321fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:05.253564 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2108/4245] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:05.257684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7920aff-b798-42c1-9eab-bbf277321fad admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.266928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46b245-1b8d-454d-b057-b116e73b393c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:05.268974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4f46b245-1b8d-454d-b057-b116e73b393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:05.313628 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2138/4246] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:05 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:05.326057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7920aff-b798-42c1-9eab-bbf277321fad admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:05.429980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46b245-1b8d-454d-b057-b116e73b393c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:05.468132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7920aff-b798-42c1-9eab-bbf277321fad admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:05.473574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19650-db27-44d1-8847-fd1e67ef62be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:05.474401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19650-db27-44d1-8847-fd1e67ef62be admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.474780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19650-db27-44d1-8847-fd1e67ef62be admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.475839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19650-db27-44d1-8847-fd1e67ef62be admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.477867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a19650-db27-44d1-8847-fd1e67ef62be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:05.479945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a19650-db27-44d1-8847-fd1e67ef62be admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.518634 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2139/4247] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:05 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:05.521242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19650-db27-44d1-8847-fd1e67ef62be admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:05.540305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19650-db27-44d1-8847-fd1e67ef62be admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:05.543275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f76d7b-9d96-4481-a6ef-edff38bac837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:05.544188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f76d7b-9d96-4481-a6ef-edff38bac837 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.544681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f76d7b-9d96-4481-a6ef-edff38bac837 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.545116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f76d7b-9d96-4481-a6ef-edff38bac837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.558480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f76d7b-9d96-4481-a6ef-edff38bac837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:05.558738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae8405-0c02-41fa-906b-392214f2ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:05.559594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae8405-0c02-41fa-906b-392214f2ec33 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.559887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae8405-0c02-41fa-906b-392214f2ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.560144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae8405-0c02-41fa-906b-392214f2ec33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.561536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f76d7b-9d96-4481-a6ef-edff38bac837 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.563082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae8405-0c02-41fa-906b-392214f2ec33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:05.567248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae8405-0c02-41fa-906b-392214f2ec33 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.574967 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2109/4248] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:05.576136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f76d7b-9d96-4481-a6ef-edff38bac837 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:05.577964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f9f76d7b-9d96-4481-a6ef-edff38bac837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:05.602972 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2140/4249] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:00:05.603949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae8405-0c02-41fa-906b-392214f2ec33 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:05.609094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f76d7b-9d96-4481-a6ef-edff38bac837 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:05.614717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:05.615502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.615642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.615947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] PATH_INFO: `/v3/projects/1aed6c66237e4d89bcd5f09264d53256` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.617441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aed6c66237e4d89bcd5f09264d53256)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:05.620136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.630159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae8405-0c02-41fa-906b-392214f2ec33 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:05.648628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c27c6-d44d-4074-a050-d0a43e617e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:05.649275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c27c6-d44d-4074-a050-d0a43e617e0a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.650711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c27c6-d44d-4074-a050-d0a43e617e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.650998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c27c6-d44d-4074-a050-d0a43e617e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.654234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c27c6-d44d-4074-a050-d0a43e617e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:05.659560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c27c6-d44d-4074-a050-d0a43e617e0a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.685500 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2141/4250] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:05.693121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c27c6-d44d-4074-a050-d0a43e617e0a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:05.717931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c27c6-d44d-4074-a050-d0a43e617e0a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:05.737944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc35a9e-fd86-4283-9371-26863011f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:05.738900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc35a9e-fd86-4283-9371-26863011f273 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.747234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc35a9e-fd86-4283-9371-26863011f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.747234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc35a9e-fd86-4283-9371-26863011f273 admin admin] PATH_INFO: `/v3/projects/5a6ab3aa4cbc483cbd0063df6c5730c5/users/33d4dcd4a8b64783a1dc7c200f101034/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.781873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aed6c66237e4d89bcd5f09264d53256', 'request_id': 'req-db386a7c-8060-4dca-a11b-77249b897f01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:05.789207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc35a9e-fd86-4283-9371-26863011f273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6ab3aa4cbc483cbd0063df6c5730c5, user_id=33d4dcd4a8b64783a1dc7c200f101034, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:05.792860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc35a9e-fd86-4283-9371-26863011f273 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:05.797394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aed6c66237e4d89bcd5f09264d53256', 'request_id': 'req-db386a7c-8060-4dca-a11b-77249b897f01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:05.809971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aed6c66237e4d89bcd5f09264d53256', 'request_id': 'req-db386a7c-8060-4dca-a11b-77249b897f01'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:05.825042 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:05.826090 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:05.838396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] The token cache is being invalidate because project 1aed6c66237e4d89bcd5f09264d53256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:05.838883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:05.839595 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2142/4251] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:05 2022] PUT /identity/v3/projects/5a6ab3aa4cbc483cbd0063df6c5730c5/users/33d4dcd4a8b64783a1dc7c200f101034/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:05.851657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d51f1-e465-45dd-a8bd-b5f6db26da79 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.851968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db386a7c-8060-4dca-a11b-77249b897f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:05.852209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d51f1-e465-45dd-a8bd-b5f6db26da79 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.852581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d51f1-e465-45dd-a8bd-b5f6db26da79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.856961 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2110/4252] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:05 2022] DELETE /identity/v3/projects/1aed6c66237e4d89bcd5f09264d53256 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:05.862145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a15b98-c2ea-4f48-b2f2-2b02a3473aad None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:05.862785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a15b98-c2ea-4f48-b2f2-2b02a3473aad None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:05.862785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a15b98-c2ea-4f48-b2f2-2b02a3473aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:05.918546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3e8d51f1-e465-45dd-a8bd-b5f6db26da79 None None] MFA Rules not processed for user `33d4dcd4a8b64783a1dc7c200f101034`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:05.920007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3e8d51f1-e465-45dd-a8bd-b5f6db26da79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:05.931433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d9a15b98-c2ea-4f48-b2f2-2b02a3473aad None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:05.938574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d9a15b98-c2ea-4f48-b2f2-2b02a3473aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:06.106110 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2111/4253] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:06.107799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5565f0c-250b-4472-b5c4-6ce9acbe34ad None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.108297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5565f0c-250b-4472-b5c4-6ce9acbe34ad None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.108724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5565f0c-250b-4472-b5c4-6ce9acbe34ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.110965 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2143/4254] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:06.115361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d51f1-e465-45dd-a8bd-b5f6db26da79 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.119175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3e8d51f1-e465-45dd-a8bd-b5f6db26da79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:06.142526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a5565f0c-250b-4472-b5c4-6ce9acbe34ad None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:06.144035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a5565f0c-250b-4472-b5c4-6ce9acbe34ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:06.153495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d51f1-e465-45dd-a8bd-b5f6db26da79 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.153950 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2112/4255] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:06.158914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5565f0c-250b-4472-b5c4-6ce9acbe34ad None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.164159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439ed9c-d4bb-4b72-96f0-ea03c8e349f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.164842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439ed9c-d4bb-4b72-96f0-ea03c8e349f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.165129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439ed9c-d4bb-4b72-96f0-ea03c8e349f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.165408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439ed9c-d4bb-4b72-96f0-ea03c8e349f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.166053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439ed9c-d4bb-4b72-96f0-ea03c8e349f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.170767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439ed9c-d4bb-4b72-96f0-ea03c8e349f6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.181222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5565f0c-250b-4472-b5c4-6ce9acbe34ad None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.196126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f5a7a-1475-4746-b6e3-52d15d3f027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.196789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f5a7a-1475-4746-b6e3-52d15d3f027f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.197073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f5a7a-1475-4746-b6e3-52d15d3f027f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.197347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f5a7a-1475-4746-b6e3-52d15d3f027f admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.198012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f5a7a-1475-4746-b6e3-52d15d3f027f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:06.198316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f5a7a-1475-4746-b6e3-52d15d3f027f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.200329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f5a7a-1475-4746-b6e3-52d15d3f027f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.234527 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2113/4256] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:06.235759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f5a7a-1475-4746-b6e3-52d15d3f027f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.258612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f5a7a-1475-4746-b6e3-52d15d3f027f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.274856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2144/4257] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:06 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:00:06.277002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9fe3a-a4a5-455a-be36-e85ce57d0a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.277249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439ed9c-d4bb-4b72-96f0-ea03c8e349f6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.277635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9fe3a-a4a5-455a-be36-e85ce57d0a4e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.277920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9fe3a-a4a5-455a-be36-e85ce57d0a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.278395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9fe3a-a4a5-455a-be36-e85ce57d0a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.279038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9fe3a-a4a5-455a-be36-e85ce57d0a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.281103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9fe3a-a4a5-455a-be36-e85ce57d0a4e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.352034 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2114/4258] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:06 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:06.353160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9fe3a-a4a5-455a-be36-e85ce57d0a4e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.431615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439ed9c-d4bb-4b72-96f0-ea03c8e349f6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.508822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9fe3a-a4a5-455a-be36-e85ce57d0a4e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.518004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaa620-af9d-49fd-90d4-0aa3db9b94ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.519146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaa620-af9d-49fd-90d4-0aa3db9b94ff admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.519146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaa620-af9d-49fd-90d4-0aa3db9b94ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.519146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaa620-af9d-49fd-90d4-0aa3db9b94ff admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.519803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaa620-af9d-49fd-90d4-0aa3db9b94ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.521773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaa620-af9d-49fd-90d4-0aa3db9b94ff admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.576898 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2115/4259] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:06 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:06.586041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaa620-af9d-49fd-90d4-0aa3db9b94ff admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.593588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63b829-4d0c-4b74-bb7e-117a6a0c996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.594409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b829-4d0c-4b74-bb7e-117a6a0c996f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.594694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b829-4d0c-4b74-bb7e-117a6a0c996f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.595032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b829-4d0c-4b74-bb7e-117a6a0c996f admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.595679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63b829-4d0c-4b74-bb7e-117a6a0c996f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.597820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63b829-4d0c-4b74-bb7e-117a6a0c996f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.614442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaa620-af9d-49fd-90d4-0aa3db9b94ff admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.633778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c595b-e35b-4d88-a94b-7dc88c8254a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.634666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c595b-e35b-4d88-a94b-7dc88c8254a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.634954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c595b-e35b-4d88-a94b-7dc88c8254a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.635229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c595b-e35b-4d88-a94b-7dc88c8254a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.635941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c595b-e35b-4d88-a94b-7dc88c8254a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.646038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c595b-e35b-4d88-a94b-7dc88c8254a1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.665500 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2145/4260] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:06 2022] POST /identity/v3/users => generated 298 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:06.678946 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2116/4261] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:06.683002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63b829-4d0c-4b74-bb7e-117a6a0c996f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.689972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c595b-e35b-4d88-a94b-7dc88c8254a1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.690187 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:06.706927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63b829-4d0c-4b74-bb7e-117a6a0c996f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.716136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc2072-2ab6-4819-befe-3c760ca7bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.716823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc2072-2ab6-4819-befe-3c760ca7bb95 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.717114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc2072-2ab6-4819-befe-3c760ca7bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.717394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc2072-2ab6-4819-befe-3c760ca7bb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.718052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc2072-2ab6-4819-befe-3c760ca7bb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.720408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c595b-e35b-4d88-a94b-7dc88c8254a1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.722010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc2072-2ab6-4819-befe-3c760ca7bb95 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.738989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac929c11-28e6-4557-a2f3-d56f6ff8fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.741593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac929c11-28e6-4557-a2f3-d56f6ff8fbcb admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.742240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac929c11-28e6-4557-a2f3-d56f6ff8fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.742742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac929c11-28e6-4557-a2f3-d56f6ff8fbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.743632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac929c11-28e6-4557-a2f3-d56f6ff8fbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.745517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac929c11-28e6-4557-a2f3-d56f6ff8fbcb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.748229 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2146/4262] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:06.752148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc2072-2ab6-4819-befe-3c760ca7bb95 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.766580 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2117/4263] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:06.773170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc2072-2ab6-4819-befe-3c760ca7bb95 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.773287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac929c11-28e6-4557-a2f3-d56f6ff8fbcb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.778246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5227b1-17a0-4b21-bf0d-ddb4ae6c434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.778930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5227b1-17a0-4b21-bf0d-ddb4ae6c434e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.779215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5227b1-17a0-4b21-bf0d-ddb4ae6c434e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.779493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5227b1-17a0-4b21-bf0d-ddb4ae6c434e admin admin] PATH_INFO: `/v3/projects/91c7333826e240f3aaedb062869f7236/users/bf52f403d1564e5ca8271cceb62ca632/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.800684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5227b1-17a0-4b21-bf0d-ddb4ae6c434e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c7333826e240f3aaedb062869f7236, user_id=bf52f403d1564e5ca8271cceb62ca632, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.804172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5227b1-17a0-4b21-bf0d-ddb4ae6c434e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.804567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac929c11-28e6-4557-a2f3-d56f6ff8fbcb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:06.826444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e056517-f97d-4ad6-866b-341d510e68ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:06.827283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056517-f97d-4ad6-866b-341d510e68ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.829096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056517-f97d-4ad6-866b-341d510e68ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.829496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056517-f97d-4ad6-866b-341d510e68ef admin admin] PATH_INFO: `/v3/projects/e339d9cdc4504d84af0b859e6003da8a/users/99df88f6fa7d450cadabf854530636f6/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.899641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2147/4264] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:06 2022] PUT /identity/v3/projects/91c7333826e240f3aaedb062869f7236/users/bf52f403d1564e5ca8271cceb62ca632/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:06.903811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5227b1-17a0-4b21-bf0d-ddb4ae6c434e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:06.904207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e056517-f97d-4ad6-866b-341d510e68ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e339d9cdc4504d84af0b859e6003da8a, user_id=99df88f6fa7d450cadabf854530636f6, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:06.914015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e056517-f97d-4ad6-866b-341d510e68ef admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:06.950889 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2118/4265] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:06 2022] PUT /identity/v3/projects/e339d9cdc4504d84af0b859e6003da8a/users/99df88f6fa7d450cadabf854530636f6/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:00:06.962149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1822d41-fc8f-4b7c-be39-3ec65303335a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:06.962797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1822d41-fc8f-4b7c-be39-3ec65303335a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:06.963278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1822d41-fc8f-4b7c-be39-3ec65303335a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:06.976587 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:07.023057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d1822d41-fc8f-4b7c-be39-3ec65303335a None None] MFA Rules not processed for user `99df88f6fa7d450cadabf854530636f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:07.024554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d1822d41-fc8f-4b7c-be39-3ec65303335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:07.065147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5227b1-17a0-4b21-bf0d-ddb4ae6c434e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:07.197270 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2119/4266] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:07.201236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1822d41-fc8f-4b7c-be39-3ec65303335a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:07.213355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d2c6a-458b-4deb-a40c-ba1682e2f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:07.213989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d2c6a-458b-4deb-a40c-ba1682e2f72a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:07.214272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d2c6a-458b-4deb-a40c-ba1682e2f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:07.214548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d2c6a-458b-4deb-a40c-ba1682e2f72a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:07.220724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d2c6a-458b-4deb-a40c-ba1682e2f72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:07.222744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d2c6a-458b-4deb-a40c-ba1682e2f72a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:07.226668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1822d41-fc8f-4b7c-be39-3ec65303335a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:07.258877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596d4d-4b98-454d-b6f3-ce77a3cdb385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:07.259727 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2148/4267] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:07.260002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596d4d-4b98-454d-b6f3-ce77a3cdb385 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:07.260438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596d4d-4b98-454d-b6f3-ce77a3cdb385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:07.260701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d2c6a-458b-4deb-a40c-ba1682e2f72a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:07.261088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596d4d-4b98-454d-b6f3-ce77a3cdb385 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:07.263225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596d4d-4b98-454d-b6f3-ce77a3cdb385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:07.267652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596d4d-4b98-454d-b6f3-ce77a3cdb385 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:07.277115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d2c6a-458b-4deb-a40c-ba1682e2f72a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:07.283903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400e9e-73d2-4a93-add7-5eddc03dd1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:07.286000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400e9e-73d2-4a93-add7-5eddc03dd1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:07.286334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400e9e-73d2-4a93-add7-5eddc03dd1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:07.287233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400e9e-73d2-4a93-add7-5eddc03dd1f3 admin admin] PATH_INFO: `/v3/projects/91c7333826e240f3aaedb062869f7236/users/bf52f403d1564e5ca8271cceb62ca632/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:07.293464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400e9e-73d2-4a93-add7-5eddc03dd1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c7333826e240f3aaedb062869f7236, user_id=bf52f403d1564e5ca8271cceb62ca632, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:07.298212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400e9e-73d2-4a93-add7-5eddc03dd1f3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:07.328514 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2149/4268] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:07 2022] PUT /identity/v3/projects/91c7333826e240f3aaedb062869f7236/users/bf52f403d1564e5ca8271cceb62ca632/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:07.337179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d14ef-ac5c-49be-b212-cd7bd9c34af4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:07.337466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d14ef-ac5c-49be-b212-cd7bd9c34af4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:07.337749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d14ef-ac5c-49be-b212-cd7bd9c34af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:07.371837 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2120/4269] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:07 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:07.376109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596d4d-4b98-454d-b6f3-ce77a3cdb385 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:07.410792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f45d14ef-ac5c-49be-b212-cd7bd9c34af4 None None] MFA Rules not processed for user `bf52f403d1564e5ca8271cceb62ca632`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:07.412329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f45d14ef-ac5c-49be-b212-cd7bd9c34af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:07.488854 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:07.541142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596d4d-4b98-454d-b6f3-ce77a3cdb385 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:07.548045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472ed85-fd03-4ca8-b854-ef8538c1572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:07.548688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472ed85-fd03-4ca8-b854-ef8538c1572f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:07.548971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472ed85-fd03-4ca8-b854-ef8538c1572f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:07.549249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472ed85-fd03-4ca8-b854-ef8538c1572f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:07.549891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472ed85-fd03-4ca8-b854-ef8538c1572f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:07.551264 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2150/4270] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:07.554221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472ed85-fd03-4ca8-b854-ef8538c1572f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:07.564557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d14ef-ac5c-49be-b212-cd7bd9c34af4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:07.584267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f45d14ef-ac5c-49be-b212-cd7bd9c34af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:07.604351 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2121/4271] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:07 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:07.607054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472ed85-fd03-4ca8-b854-ef8538c1572f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:07.627072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472ed85-fd03-4ca8-b854-ef8538c1572f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:07.643032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed65d-de52-4ad5-b591-0c9022d050ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:07.643968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed65d-de52-4ad5-b591-0c9022d050ea admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:07.644418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed65d-de52-4ad5-b591-0c9022d050ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:07.644892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed65d-de52-4ad5-b591-0c9022d050ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:07.645705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ed65d-de52-4ad5-b591-0c9022d050ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:07.647793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ed65d-de52-4ad5-b591-0c9022d050ea admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:07.682225 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2122/4272] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:07.683796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d14ef-ac5c-49be-b212-cd7bd9c34af4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:07.684928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed65d-de52-4ad5-b591-0c9022d050ea admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:07.688472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f58c94-66e9-45ec-8b01-372f23110b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:07.689235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f58c94-66e9-45ec-8b01-372f23110b75 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:07.689632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f58c94-66e9-45ec-8b01-372f23110b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:07.690001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f58c94-66e9-45ec-8b01-372f23110b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:07.708728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed65d-de52-4ad5-b591-0c9022d050ea admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:07.724241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b5c0d-9b28-4b9d-ab11-c60bc98a5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:07.725293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5c0d-9b28-4b9d-ab11-c60bc98a5541 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:07.725752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5c0d-9b28-4b9d-ab11-c60bc98a5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:07.726377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5c0d-9b28-4b9d-ab11-c60bc98a5541 admin admin] PATH_INFO: `/v3/projects/090c317dd1dd49febb952dd25a990d77/users/f21232d042e6410a86c24e107d901b80/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:07.766390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b5c0d-9b28-4b9d-ab11-c60bc98a5541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=090c317dd1dd49febb952dd25a990d77, user_id=f21232d042e6410a86c24e107d901b80, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:07.770171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b5c0d-9b28-4b9d-ab11-c60bc98a5541 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:07.796747 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2123/4273] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:07 2022] PUT /identity/v3/projects/090c317dd1dd49febb952dd25a990d77/users/f21232d042e6410a86c24e107d901b80/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:07.804656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b5c0d-9b28-4b9d-ab11-c60bc98a5541 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:07.807681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f58c94-66e9-45ec-8b01-372f23110b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:07.809959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f58c94-66e9-45ec-8b01-372f23110b75 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:07.823394 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2151/4274] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:00:07.891410 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:08.055518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b5c0d-9b28-4b9d-ab11-c60bc98a5541 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:08.090282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4740252-bda9-4f6b-924a-69124c01a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:08.091273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740252-bda9-4f6b-924a-69124c01a90a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:08.091796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740252-bda9-4f6b-924a-69124c01a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:08.092305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740252-bda9-4f6b-924a-69124c01a90a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:08.094424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740252-bda9-4f6b-924a-69124c01a90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:08.101293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740252-bda9-4f6b-924a-69124c01a90a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:08.134103 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2124/4275] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:08.139112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f58c94-66e9-45ec-8b01-372f23110b75 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:08.167972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f58c94-66e9-45ec-8b01-372f23110b75 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:08.180254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9eaf2-ce8f-4d18-9f11-fbcf614c3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:08.182893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9eaf2-ce8f-4d18-9f11-fbcf614c3563 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:08.183913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9eaf2-ce8f-4d18-9f11-fbcf614c3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:08.184770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9eaf2-ce8f-4d18-9f11-fbcf614c3563 admin admin] PATH_INFO: `/v3/projects/090c317dd1dd49febb952dd25a990d77/users/f21232d042e6410a86c24e107d901b80/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:08.187659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9eaf2-ce8f-4d18-9f11-fbcf614c3563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=090c317dd1dd49febb952dd25a990d77, user_id=f21232d042e6410a86c24e107d901b80, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:08.191339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9eaf2-ce8f-4d18-9f11-fbcf614c3563 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:08.236223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71b748-4729-46ff-b3f7-e109ffa27604 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:08.236895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71b748-4729-46ff-b3f7-e109ffa27604 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:08.237443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71b748-4729-46ff-b3f7-e109ffa27604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:08.242527 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2152/4276] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:08 2022] PUT /identity/v3/projects/090c317dd1dd49febb952dd25a990d77/users/f21232d042e6410a86c24e107d901b80/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:08.317541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1e71b748-4729-46ff-b3f7-e109ffa27604 None None] MFA Rules not processed for user `f21232d042e6410a86c24e107d901b80`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:08.329219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e71b748-4729-46ff-b3f7-e109ffa27604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:08.577465 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2125/4277] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:08.603414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9eaf2-ce8f-4d18-9f11-fbcf614c3563 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:08.750056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9eaf2-ce8f-4d18-9f11-fbcf614c3563 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:08.755244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a28dc5-35d8-4761-8303-d1d9d8fd0d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:08.755560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a28dc5-35d8-4761-8303-d1d9d8fd0d80 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:08.755780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a28dc5-35d8-4761-8303-d1d9d8fd0d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:08.756065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a28dc5-35d8-4761-8303-d1d9d8fd0d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:08.771502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a28dc5-35d8-4761-8303-d1d9d8fd0d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:08.774056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a28dc5-35d8-4761-8303-d1d9d8fd0d80 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:08.813783 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2153/4278] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:09.605464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71b748-4729-46ff-b3f7-e109ffa27604 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:09.628484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71b748-4729-46ff-b3f7-e109ffa27604 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:09.666773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176baad6-4e41-4c55-ad87-cd36407fb4e6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21232d042e6410a86c24e107d901b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090c317dd1dd49febb952dd25a990d77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:09.670516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176baad6-4e41-4c55-ad87-cd36407fb4e6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:09.672860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176baad6-4e41-4c55-ad87-cd36407fb4e6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:09.677215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176baad6-4e41-4c55-ad87-cd36407fb4e6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:09.683601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176baad6-4e41-4c55-ad87-cd36407fb4e6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:09.684964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176baad6-4e41-4c55-ad87-cd36407fb4e6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:09.726704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176baad6-4e41-4c55-ad87-cd36407fb4e6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:09.764515 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2126/4279] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:09.765317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a28dc5-35d8-4761-8303-d1d9d8fd0d80 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:09.780577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a28dc5-35d8-4761-8303-d1d9d8fd0d80 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:09.797320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3b37f-2f5d-4654-ba83-68e637f533c6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21232d042e6410a86c24e107d901b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090c317dd1dd49febb952dd25a990d77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:09.798171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3b37f-2f5d-4654-ba83-68e637f533c6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:09.798564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3b37f-2f5d-4654-ba83-68e637f533c6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:09.798946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3b37f-2f5d-4654-ba83-68e637f533c6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:09.799796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3b37f-2f5d-4654-ba83-68e637f533c6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:09.801951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3b37f-2f5d-4654-ba83-68e637f533c6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:09.852165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176baad6-4e41-4c55-ad87-cd36407fb4e6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:09.853464 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2154/4280] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:09 2022] POST /identity/v3/projects => generated 355 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:00:09.864640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176baad6-4e41-4c55-ad87-cd36407fb4e6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:10.024280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21232d042e6410a86c24e107d901b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090c317dd1dd49febb952dd25a990d77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:10.024896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:10.028144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:10.028309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:10.029989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:10.029989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:10.031543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:10.062795 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2127/4281] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:10.134379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3b37f-2f5d-4654-ba83-68e637f533c6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:10.146696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3b37f-2f5d-4654-ba83-68e637f533c6 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:10.163536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21232d042e6410a86c24e107d901b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '090c317dd1dd49febb952dd25a990d77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:10.168054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:10.168457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:10.169509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] PATH_INFO: `/v3/projects/da95df35e4c540da86491801de062e8b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:10.172074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da95df35e4c540da86491801de062e8b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:10.174617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:10.184767 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:10.331417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da95df35e4c540da86491801de062e8b', 'request_id': 'req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:10.359533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da95df35e4c540da86491801de062e8b', 'request_id': 'req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:10.380172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da95df35e4c540da86491801de062e8b', 'request_id': 'req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:10.426512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] The token cache is being invalidate because project da95df35e4c540da86491801de062e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:10.427020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:10.429180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fb118fdc-d22b-4b5d-83e0-006c2d5ebbe0 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:10.431182 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2155/4282] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:10 2022] DELETE /identity/v3/projects/da95df35e4c540da86491801de062e8b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:11.170807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:11.176000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:11.286266 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:11.430169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884bf38-dced-4f3f-9f21-9a3715249e02 tempest-VolumeQuotaClassesTest-1696960506 tempest-VolumeQuotaClassesTest-1696960506-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:11.563710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:11.565457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:11.565960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:11.566403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] PATH_INFO: `/v3/users/99df88f6fa7d450cadabf854530636f6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:11.567912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99df88f6fa7d450cadabf854530636f6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:11.571269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:11.661887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99df88f6fa7d450cadabf854530636f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:11.681645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99df88f6fa7d450cadabf854530636f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:11.714588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99df88f6fa7d450cadabf854530636f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:11.725247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99df88f6fa7d450cadabf854530636f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:11.726090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99df88f6fa7d450cadabf854530636f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:11.747669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee678fb8-bb5c-4b80-a651-df47d005d771 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:11.748394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee678fb8-bb5c-4b80-a651-df47d005d771 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:11.748394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee678fb8-bb5c-4b80-a651-df47d005d771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:11.751318 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2128/4283] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:11 2022] DELETE /identity/v3/users/99df88f6fa7d450cadabf854530636f6 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:11.771502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ee678fb8-bb5c-4b80-a651-df47d005d771 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:11.773023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ee678fb8-bb5c-4b80-a651-df47d005d771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:11.893035 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2156/4284] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:11.923270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:11.929753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:12.053935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dd54b-fc6f-4085-83e6-3fe074413f09 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:12.070229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec4bc4-132b-4b51-9179-ebc5d7f370e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:12.070229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec4bc4-132b-4b51-9179-ebc5d7f370e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:12.070961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec4bc4-132b-4b51-9179-ebc5d7f370e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:12.071342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec4bc4-132b-4b51-9179-ebc5d7f370e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:12.082553 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:12.091866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec4bc4-132b-4b51-9179-ebc5d7f370e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:12.094481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec4bc4-132b-4b51-9179-ebc5d7f370e6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:12.125026 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2129/4285] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:14.782248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee678fb8-bb5c-4b80-a651-df47d005d771 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:14.783867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ee678fb8-bb5c-4b80-a651-df47d005d771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:14.811257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee678fb8-bb5c-4b80-a651-df47d005d771 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:14.835125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:14.835980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:14.836216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:14.836486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] PATH_INFO: `/v3/projects/e339d9cdc4504d84af0b859e6003da8a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:14.845999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e339d9cdc4504d84af0b859e6003da8a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:14.847584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:15.055797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e339d9cdc4504d84af0b859e6003da8a', 'request_id': 'req-e1518b12-b692-481c-9d02-8d834818da34'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.094009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e339d9cdc4504d84af0b859e6003da8a', 'request_id': 'req-e1518b12-b692-481c-9d02-8d834818da34'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.104736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e339d9cdc4504d84af0b859e6003da8a', 'request_id': 'req-e1518b12-b692-481c-9d02-8d834818da34'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.170599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] The token cache is being invalidate because project e339d9cdc4504d84af0b859e6003da8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:15.171483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.174086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.179215 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2157/4286] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:14 2022] DELETE /identity/v3/projects/e339d9cdc4504d84af0b859e6003da8a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:15.182950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec4bc4-132b-4b51-9179-ebc5d7f370e6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:15.212810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec4bc4-132b-4b51-9179-ebc5d7f370e6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:15.448948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:15.451445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:15.452917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:15.453308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] PATH_INFO: `/v3/users/f21232d042e6410a86c24e107d901b80` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:15.457311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21232d042e6410a86c24e107d901b80)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:15.464680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:15.597122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21232d042e6410a86c24e107d901b80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.633936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21232d042e6410a86c24e107d901b80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.653887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21232d042e6410a86c24e107d901b80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.670139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21232d042e6410a86c24e107d901b80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.670894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e08bedcd-7785-475d-b5bf-60b734790d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21232d042e6410a86c24e107d901b80'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:15.695334 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2130/4287] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:15 2022] DELETE /identity/v3/users/f21232d042e6410a86c24e107d901b80 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:17.342204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:17.343692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:17.381687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1518b12-b692-481c-9d02-8d834818da34 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:17.411418 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:17.571660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:17.572490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:17.572897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:17.573274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] PATH_INFO: `/v3/projects/090c317dd1dd49febb952dd25a990d77` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:17.574787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=090c317dd1dd49febb952dd25a990d77)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:17.578514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:17.703314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090c317dd1dd49febb952dd25a990d77', 'request_id': 'req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:17.742538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090c317dd1dd49febb952dd25a990d77', 'request_id': 'req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:17.768496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090c317dd1dd49febb952dd25a990d77', 'request_id': 'req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:17.839813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] The token cache is being invalidate because project 090c317dd1dd49febb952dd25a990d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:17.840092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:17.841009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e7ae1ae4-c40a-4dfe-93cf-b5d9d158d51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:17.848946 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2158/4288] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:17 2022] DELETE /identity/v3/projects/090c317dd1dd49febb952dd25a990d77 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:17.854304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf4711-97b3-490f-99fc-c08f16640f5b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:17.854833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf4711-97b3-490f-99fc-c08f16640f5b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:17.854946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf4711-97b3-490f-99fc-c08f16640f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:17.935527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-beaf4711-97b3-490f-99fc-c08f16640f5b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:17.936169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-beaf4711-97b3-490f-99fc-c08f16640f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:18.091964 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2131/4289] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:18.099349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd68a-b81f-4ecc-a4a2-8008eec5c51c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:18.099647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd68a-b81f-4ecc-a4a2-8008eec5c51c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:18.100488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd68a-b81f-4ecc-a4a2-8008eec5c51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:18.155758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-67fcd68a-b81f-4ecc-a4a2-8008eec5c51c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:18.161543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-67fcd68a-b81f-4ecc-a4a2-8008eec5c51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:18.191483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2159/4290] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:18.196354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf4711-97b3-490f-99fc-c08f16640f5b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:18.210657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf4711-97b3-490f-99fc-c08f16640f5b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:18.220410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aacaa5-b374-4b14-a872-ccecd2682939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:18.221189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aacaa5-b374-4b14-a872-ccecd2682939 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:18.221480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aacaa5-b374-4b14-a872-ccecd2682939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:18.221757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aacaa5-b374-4b14-a872-ccecd2682939 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:18.222426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aacaa5-b374-4b14-a872-ccecd2682939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:18.228156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aacaa5-b374-4b14-a872-ccecd2682939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:18.229961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aacaa5-b374-4b14-a872-ccecd2682939 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:18.245986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd68a-b81f-4ecc-a4a2-8008eec5c51c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:18.247560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-67fcd68a-b81f-4ecc-a4a2-8008eec5c51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:18.267148 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2132/4291] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:18.270932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aacaa5-b374-4b14-a872-ccecd2682939 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:18.278242 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:18.298318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aacaa5-b374-4b14-a872-ccecd2682939 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:18.313353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064957b-6e73-4e17-92cd-2173b74c3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:18.313983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064957b-6e73-4e17-92cd-2173b74c3154 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:18.314261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064957b-6e73-4e17-92cd-2173b74c3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:18.314532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064957b-6e73-4e17-92cd-2173b74c3154 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:18.315191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064957b-6e73-4e17-92cd-2173b74c3154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:18.321896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064957b-6e73-4e17-92cd-2173b74c3154 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:18.414566 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2133/4292] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:18 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:00:18.416311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064957b-6e73-4e17-92cd-2173b74c3154 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:18.464942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd68a-b81f-4ecc-a4a2-8008eec5c51c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:18.609196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cef2dc-3f2a-4ec1-b6ec-5fe82ba20b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:18.611191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cef2dc-3f2a-4ec1-b6ec-5fe82ba20b40 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:18.612549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cef2dc-3f2a-4ec1-b6ec-5fe82ba20b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:18.613119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cef2dc-3f2a-4ec1-b6ec-5fe82ba20b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:18.623509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-69cef2dc-3f2a-4ec1-b6ec-5fe82ba20b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:18.655159 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:18.668843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064957b-6e73-4e17-92cd-2173b74c3154 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:18.672036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cef2dc-3f2a-4ec1-b6ec-5fe82ba20b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:18.675420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cef2dc-3f2a-4ec1-b6ec-5fe82ba20b40 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:18.683018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585447bd-b7e3-444f-878a-df70c6df0f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:18.683018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585447bd-b7e3-444f-878a-df70c6df0f3e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:18.683018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585447bd-b7e3-444f-878a-df70c6df0f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:18.683018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585447bd-b7e3-444f-878a-df70c6df0f3e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:18.693258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585447bd-b7e3-444f-878a-df70c6df0f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:18.695915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585447bd-b7e3-444f-878a-df70c6df0f3e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:18.721737 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2160/4293] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:00:18.757092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cef2dc-3f2a-4ec1-b6ec-5fe82ba20b40 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:18.763756 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2134/4294] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:18 2022] POST /identity/v3/users => generated 289 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:18.781525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cef2dc-3f2a-4ec1-b6ec-5fe82ba20b40 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:18.800332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57e4d-8732-47b5-8b44-feb83df26379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:18.801301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57e4d-8732-47b5-8b44-feb83df26379 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:18.801990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57e4d-8732-47b5-8b44-feb83df26379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:18.807161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57e4d-8732-47b5-8b44-feb83df26379 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:18.810135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57e4d-8732-47b5-8b44-feb83df26379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:18.812008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57e4d-8732-47b5-8b44-feb83df26379 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:18.870246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585447bd-b7e3-444f-878a-df70c6df0f3e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:18.880375 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2161/4295] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:00:18.895532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585447bd-b7e3-444f-878a-df70c6df0f3e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:18.922178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a589f3-fd30-4f1a-8a38-2ade7eda35df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:18.923620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a589f3-fd30-4f1a-8a38-2ade7eda35df admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:18.924145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a589f3-fd30-4f1a-8a38-2ade7eda35df admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:18.932954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a589f3-fd30-4f1a-8a38-2ade7eda35df admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:18.933380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a589f3-fd30-4f1a-8a38-2ade7eda35df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:18.935109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a589f3-fd30-4f1a-8a38-2ade7eda35df admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:18.972865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2135/4296] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:00:18.977511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57e4d-8732-47b5-8b44-feb83df26379 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:18.989853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57e4d-8732-47b5-8b44-feb83df26379 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:19.007278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fcb38-c387-4071-a99b-2c4fd065487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:19.008051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fcb38-c387-4071-a99b-2c4fd065487e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:19.008403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fcb38-c387-4071-a99b-2c4fd065487e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:19.008772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fcb38-c387-4071-a99b-2c4fd065487e admin admin] PATH_INFO: `/v3/projects/ae9b26a945ac4821831130fbaa8fab3b/users/736b981b268e4fbdb04045b7ccc8740f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:19.045709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fcb38-c387-4071-a99b-2c4fd065487e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9b26a945ac4821831130fbaa8fab3b, user_id=736b981b268e4fbdb04045b7ccc8740f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:19.048732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fcb38-c387-4071-a99b-2c4fd065487e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:19.189218 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2162/4297] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:18 2022] PUT /identity/v3/projects/ae9b26a945ac4821831130fbaa8fab3b/users/736b981b268e4fbdb04045b7ccc8740f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:19.200805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42708f1-8357-4622-b29a-936f4c648411 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:19.202761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42708f1-8357-4622-b29a-936f4c648411 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:19.203247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42708f1-8357-4622-b29a-936f4c648411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:19.286338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f42708f1-8357-4622-b29a-936f4c648411 None None] MFA Rules not processed for user `736b981b268e4fbdb04045b7ccc8740f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:19.288141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f42708f1-8357-4622-b29a-936f4c648411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:19.506022 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2136/4298] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:19.510525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fcb38-c387-4071-a99b-2c4fd065487e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:19.727189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fcb38-c387-4071-a99b-2c4fd065487e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:19.741417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181b5d3-bd56-41fc-9fb4-bd1f21e75938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:19.744127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b5d3-bd56-41fc-9fb4-bd1f21e75938 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:19.744710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b5d3-bd56-41fc-9fb4-bd1f21e75938 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:19.749730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b5d3-bd56-41fc-9fb4-bd1f21e75938 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:19.750753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181b5d3-bd56-41fc-9fb4-bd1f21e75938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:19.753905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181b5d3-bd56-41fc-9fb4-bd1f21e75938 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:19.818713 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2163/4299] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:19 2022] POST /identity/v3/projects => generated 379 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:19.822585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42708f1-8357-4622-b29a-936f4c648411 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:19.860540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42708f1-8357-4622-b29a-936f4c648411 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:20.006891 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:20.059443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15792b70-062f-4797-9e15-e7335b319e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:20.060389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15792b70-062f-4797-9e15-e7335b319e0c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:20.061219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15792b70-062f-4797-9e15-e7335b319e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:20.061673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15792b70-062f-4797-9e15-e7335b319e0c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:20.062505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15792b70-062f-4797-9e15-e7335b319e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:20.066540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15792b70-062f-4797-9e15-e7335b319e0c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:20.144177 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2137/4300] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:19 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:20.149028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181b5d3-bd56-41fc-9fb4-bd1f21e75938 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:20.169859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181b5d3-bd56-41fc-9fb4-bd1f21e75938 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:20.182071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6537b9-5873-4184-9794-f2e313b9f457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:20.184324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6537b9-5873-4184-9794-f2e313b9f457 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:20.184823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6537b9-5873-4184-9794-f2e313b9f457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:20.186182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6537b9-5873-4184-9794-f2e313b9f457 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:20.188672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6537b9-5873-4184-9794-f2e313b9f457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:20.196565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6537b9-5873-4184-9794-f2e313b9f457 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:20.224860 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2164/4301] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:20.227247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15792b70-062f-4797-9e15-e7335b319e0c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:20.242359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15792b70-062f-4797-9e15-e7335b319e0c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:20.266313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a27e1-20b6-465c-a153-5ecf3f1ef7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:20.266950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a27e1-20b6-465c-a153-5ecf3f1ef7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:20.267230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a27e1-20b6-465c-a153-5ecf3f1ef7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:20.267502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a27e1-20b6-465c-a153-5ecf3f1ef7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:20.268152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a27e1-20b6-465c-a153-5ecf3f1ef7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:20.269798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a27e1-20b6-465c-a153-5ecf3f1ef7c8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:20.321653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6537b9-5873-4184-9794-f2e313b9f457 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:20.321929 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2138/4302] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:20.370609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6537b9-5873-4184-9794-f2e313b9f457 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:20.383483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df762c-1525-420a-b3f3-a78d500229a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:20.384184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df762c-1525-420a-b3f3-a78d500229a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:20.386312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df762c-1525-420a-b3f3-a78d500229a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:20.388151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df762c-1525-420a-b3f3-a78d500229a1 admin admin] PATH_INFO: `/v3/projects/bcc3a24360f24e6cb7843f27e60016df/users/14b037dac76e43408fbfd0ed60fb6202/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:20.452178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df762c-1525-420a-b3f3-a78d500229a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc3a24360f24e6cb7843f27e60016df, user_id=14b037dac76e43408fbfd0ed60fb6202, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:20.467905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df762c-1525-420a-b3f3-a78d500229a1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:20.517770 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2165/4303] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:20 2022] PUT /identity/v3/projects/bcc3a24360f24e6cb7843f27e60016df/users/14b037dac76e43408fbfd0ed60fb6202/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:00:20.528893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45567-ec99-48ae-a56a-4fe1bf51e8d4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:20.529442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45567-ec99-48ae-a56a-4fe1bf51e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:20.529886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45567-ec99-48ae-a56a-4fe1bf51e8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:20.591507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0ac45567-ec99-48ae-a56a-4fe1bf51e8d4 None None] MFA Rules not processed for user `14b037dac76e43408fbfd0ed60fb6202`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:20.593237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0ac45567-ec99-48ae-a56a-4fe1bf51e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:20.782212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df762c-1525-420a-b3f3-a78d500229a1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:20.782730 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2139/4304] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:20.936609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45567-ec99-48ae-a56a-4fe1bf51e8d4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:20.938744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0ac45567-ec99-48ae-a56a-4fe1bf51e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:20.991466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df762c-1525-420a-b3f3-a78d500229a1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:21.009246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440e89-86c0-4236-9f15-0363613046d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:21.009626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440e89-86c0-4236-9f15-0363613046d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:21.009760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440e89-86c0-4236-9f15-0363613046d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:21.010244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440e89-86c0-4236-9f15-0363613046d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:21.012663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85440e89-86c0-4236-9f15-0363613046d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:21.012663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85440e89-86c0-4236-9f15-0363613046d6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:21.112190 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:21.140657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45567-ec99-48ae-a56a-4fe1bf51e8d4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:21.142576 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2166/4305] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:20 2022] POST /identity/v3/projects => generated 379 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:21.150260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440e89-86c0-4236-9f15-0363613046d6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:21.266874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:21.268692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:21.269143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:21.269582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] PATH_INFO: `/v3/users/c9ac716a6af441a4bc02d8ef11f81487` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:21.274534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ac716a6af441a4bc02d8ef11f81487)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:21.279813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:21.291391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440e89-86c0-4236-9f15-0363613046d6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:21.295443 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:21.299019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8a056-9217-4e84-bdbd-83ddc004f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:21.299882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8a056-9217-4e84-bdbd-83ddc004f677 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:21.300334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8a056-9217-4e84-bdbd-83ddc004f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:21.300809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8a056-9217-4e84-bdbd-83ddc004f677 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:21.301624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8a056-9217-4e84-bdbd-83ddc004f677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:21.305749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8a056-9217-4e84-bdbd-83ddc004f677 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:21.363842 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2167/4306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:21 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:00:21.365078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8a056-9217-4e84-bdbd-83ddc004f677 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:21.401337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8a056-9217-4e84-bdbd-83ddc004f677 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:21.408430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85f246-d621-4265-bace-b9af59597963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:21.409637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85f246-d621-4265-bace-b9af59597963 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:21.410092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85f246-d621-4265-bace-b9af59597963 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:21.410543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85f246-d621-4265-bace-b9af59597963 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:21.412035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85f246-d621-4265-bace-b9af59597963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:21.415084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85f246-d621-4265-bace-b9af59597963 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:21.424824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ac716a6af441a4bc02d8ef11f81487'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:21.440861 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2168/4307] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:21.442343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85f246-d621-4265-bace-b9af59597963 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:21.462539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ac716a6af441a4bc02d8ef11f81487'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:21.471241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85f246-d621-4265-bace-b9af59597963 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:21.478123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ac716a6af441a4bc02d8ef11f81487'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:21.487066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc490f9-99f3-48e8-969b-25cff8dd8a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:21.488048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc490f9-99f3-48e8-969b-25cff8dd8a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:21.489904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc490f9-99f3-48e8-969b-25cff8dd8a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:21.491151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ac716a6af441a4bc02d8ef11f81487'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:21.491838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc490f9-99f3-48e8-969b-25cff8dd8a3a admin admin] PATH_INFO: `/v3/projects/9e0ebeeff9bb4259aee997c96a3a224c/users/133ca96e99fd4c04a960bbc49a02a379/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:21.493593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ac716a6af441a4bc02d8ef11f81487'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:21.531721 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2140/4308] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:20 2022] DELETE /identity/v3/users/c9ac716a6af441a4bc02d8ef11f81487 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:21.557520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc490f9-99f3-48e8-969b-25cff8dd8a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0ebeeff9bb4259aee997c96a3a224c, user_id=133ca96e99fd4c04a960bbc49a02a379, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:21.588896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc490f9-99f3-48e8-969b-25cff8dd8a3a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:21.624265 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2169/4309] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:21 2022] PUT /identity/v3/projects/9e0ebeeff9bb4259aee997c96a3a224c/users/133ca96e99fd4c04a960bbc49a02a379/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:21.628644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:21.630198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:21.863942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c56ae8-5347-4a23-b84b-bbaedebbe700 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:22.081341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dc075-e5b8-4a28-844b-80829b5aef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:22.082156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc075-e5b8-4a28-844b-80829b5aef6e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:22.082615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc075-e5b8-4a28-844b-80829b5aef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:22.083306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc075-e5b8-4a28-844b-80829b5aef6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:22.099389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dc075-e5b8-4a28-844b-80829b5aef6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:22.102415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dc075-e5b8-4a28-844b-80829b5aef6e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:22.156683 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2141/4310] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 511 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:22.157378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc490f9-99f3-48e8-969b-25cff8dd8a3a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:22.157378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc490f9-99f3-48e8-969b-25cff8dd8a3a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:22.198182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8361d-9d50-4c30-8d6e-1eff0f3990a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:22.198890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8361d-9d50-4c30-8d6e-1eff0f3990a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:22.199523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8361d-9d50-4c30-8d6e-1eff0f3990a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:22.199798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8361d-9d50-4c30-8d6e-1eff0f3990a5 admin admin] PATH_INFO: `/v3/projects/9e0ebeeff9bb4259aee997c96a3a224c/users/133ca96e99fd4c04a960bbc49a02a379/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:22.207197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8361d-9d50-4c30-8d6e-1eff0f3990a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0ebeeff9bb4259aee997c96a3a224c, user_id=133ca96e99fd4c04a960bbc49a02a379, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:22.210718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8361d-9d50-4c30-8d6e-1eff0f3990a5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:22.246315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c1e1-6893-4633-9808-361f3e9ebff7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:22.246713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c1e1-6893-4633-9808-361f3e9ebff7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:22.246932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c1e1-6893-4633-9808-361f3e9ebff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:22.252724 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2170/4311] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:22 2022] PUT /identity/v3/projects/9e0ebeeff9bb4259aee997c96a3a224c/users/133ca96e99fd4c04a960bbc49a02a379/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:22.311588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-21b5c1e1-6893-4633-9808-361f3e9ebff7 None None] MFA Rules not processed for user `133ca96e99fd4c04a960bbc49a02a379`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:22.313437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-21b5c1e1-6893-4633-9808-361f3e9ebff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:22.338402 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:22.511119 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2142/4312] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:22.524650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8361d-9d50-4c30-8d6e-1eff0f3990a5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:22.526437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fcc8361d-9d50-4c30-8d6e-1eff0f3990a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:22.679820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8361d-9d50-4c30-8d6e-1eff0f3990a5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:22.684423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07ed27-ad8c-4dac-9d19-434c9d179850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:22.685459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07ed27-ad8c-4dac-9d19-434c9d179850 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:22.685919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07ed27-ad8c-4dac-9d19-434c9d179850 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:22.686366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07ed27-ad8c-4dac-9d19-434c9d179850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:22.711485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07ed27-ad8c-4dac-9d19-434c9d179850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:22.713237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07ed27-ad8c-4dac-9d19-434c9d179850 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:22.738852 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2171/4313] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:00:22.816560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c1e1-6893-4633-9808-361f3e9ebff7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:22.818124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-21b5c1e1-6893-4633-9808-361f3e9ebff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:22.842899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c1e1-6893-4633-9808-361f3e9ebff7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:22.856827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5e9ff-f81d-4962-b92c-3c4c5b88e873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:22.857548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e9ff-f81d-4962-b92c-3c4c5b88e873 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:22.857896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e9ff-f81d-4962-b92c-3c4c5b88e873 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:22.858252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e9ff-f81d-4962-b92c-3c4c5b88e873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:22.860218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c0e5e9ff-f81d-4962-b92c-3c4c5b88e873 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:23.002582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5e9ff-f81d-4962-b92c-3c4c5b88e873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:23.004182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5e9ff-f81d-4962-b92c-3c4c5b88e873 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:23.029801 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2143/4314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:23.282625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07ed27-ad8c-4dac-9d19-434c9d179850 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:23.284103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab07ed27-ad8c-4dac-9d19-434c9d179850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:23.413228 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:23.510412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07ed27-ad8c-4dac-9d19-434c9d179850 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:23.528067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:23.528754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:23.529071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:23.529333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] PATH_INFO: `/v3/projects/4dd9caff7d2f4782934111951d0c42fb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:23.530948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd9caff7d2f4782934111951d0c42fb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:23.541866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:23.753211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd9caff7d2f4782934111951d0c42fb', 'request_id': 'req-e4d9b2e1-74a1-4762-990a-59825b0d3227'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:23.774664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd9caff7d2f4782934111951d0c42fb', 'request_id': 'req-e4d9b2e1-74a1-4762-990a-59825b0d3227'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:23.791753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd9caff7d2f4782934111951d0c42fb', 'request_id': 'req-e4d9b2e1-74a1-4762-990a-59825b0d3227'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:23.844311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] The token cache is being invalidate because project 4dd9caff7d2f4782934111951d0c42fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:23.844540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:23.847766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e4d9b2e1-74a1-4762-990a-59825b0d3227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:23.854656 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2172/4315] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:23 2022] DELETE /identity/v3/projects/4dd9caff7d2f4782934111951d0c42fb => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:23.856360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce4df6-2cd6-4c98-9f9b-0ea1687889f3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:23.857356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce4df6-2cd6-4c98-9f9b-0ea1687889f3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:23.857829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce4df6-2cd6-4c98-9f9b-0ea1687889f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:23.905531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-17ce4df6-2cd6-4c98-9f9b-0ea1687889f3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:23.908082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-17ce4df6-2cd6-4c98-9f9b-0ea1687889f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:23.949537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22676a-68f7-4b9b-a136-b26d5d2415d0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:23.949801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22676a-68f7-4b9b-a136-b26d5d2415d0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:23.950385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22676a-68f7-4b9b-a136-b26d5d2415d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:24.025446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4d22676a-68f7-4b9b-a136-b26d5d2415d0 None None] MFA Rules not processed for user `8f138ca4a03c4459ab40866b7f2e2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:24.041697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4d22676a-68f7-4b9b-a136-b26d5d2415d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:24.104798 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2144/4316] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:24.113318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a664a4-99e2-496d-a9a4-a73adeaa98df None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:24.113621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a664a4-99e2-496d-a9a4-a73adeaa98df None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:24.113903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a664a4-99e2-496d-a9a4-a73adeaa98df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:24.226902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-50a664a4-99e2-496d-a9a4-a73adeaa98df None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:24.232206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-50a664a4-99e2-496d-a9a4-a73adeaa98df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:24.267885 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2145/4317] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:24.276191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a664a4-99e2-496d-a9a4-a73adeaa98df None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:24.329294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a664a4-99e2-496d-a9a4-a73adeaa98df None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:24.329439 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2173/4318] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:24.339287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22676a-68f7-4b9b-a136-b26d5d2415d0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:24.342249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4d22676a-68f7-4b9b-a136-b26d5d2415d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:24.345265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cb3f7-0af6-4e50-abe4-74498ac42c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:24.345896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cb3f7-0af6-4e50-abe4-74498ac42c50 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:24.346187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cb3f7-0af6-4e50-abe4-74498ac42c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:24.346460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cb3f7-0af6-4e50-abe4-74498ac42c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:24.347111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cb3f7-0af6-4e50-abe4-74498ac42c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:24.347411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cb3f7-0af6-4e50-abe4-74498ac42c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:24.365011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cb3f7-0af6-4e50-abe4-74498ac42c50 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:24.423240 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2146/4319] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:24.433475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cb3f7-0af6-4e50-abe4-74498ac42c50 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:24.461225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cb3f7-0af6-4e50-abe4-74498ac42c50 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:24.496592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb1d84-acff-472e-8b98-42323dc02dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:24.497267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb1d84-acff-472e-8b98-42323dc02dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:24.497555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb1d84-acff-472e-8b98-42323dc02dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:24.497831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb1d84-acff-472e-8b98-42323dc02dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:24.498488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb1d84-acff-472e-8b98-42323dc02dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:24.500403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb1d84-acff-472e-8b98-42323dc02dc3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:24.534064 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:24.578369 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2147/4320] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:24 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:24.579685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb1d84-acff-472e-8b98-42323dc02dc3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:24.589254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22676a-68f7-4b9b-a136-b26d5d2415d0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:24.601486 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:24.743012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb1d84-acff-472e-8b98-42323dc02dc3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:24.762036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5840ff-bc73-4ca5-b336-3367587dd2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:24.762769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5840ff-bc73-4ca5-b336-3367587dd2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:24.765612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5840ff-bc73-4ca5-b336-3367587dd2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:24.765898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5840ff-bc73-4ca5-b336-3367587dd2d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:24.766555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5840ff-bc73-4ca5-b336-3367587dd2d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:24.782268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5840ff-bc73-4ca5-b336-3367587dd2d9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:24.813668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4824c-43b7-44d8-81cf-c77e56125d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:24.814301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4824c-43b7-44d8-81cf-c77e56125d7a service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:24.818926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4824c-43b7-44d8-81cf-c77e56125d7a service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:24.820245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4824c-43b7-44d8-81cf-c77e56125d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:24.856814 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2148/4321] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:24 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:00:24.857791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5840ff-bc73-4ca5-b336-3367587dd2d9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:24.900683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5840ff-bc73-4ca5-b336-3367587dd2d9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:24.906298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ef2c6-9a43-4ada-8211-19cd5c6b394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:24.906931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ef2c6-9a43-4ada-8211-19cd5c6b394a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:24.907216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ef2c6-9a43-4ada-8211-19cd5c6b394a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:24.907492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ef2c6-9a43-4ada-8211-19cd5c6b394a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:24.908144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ef2c6-9a43-4ada-8211-19cd5c6b394a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:24.909783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ef2c6-9a43-4ada-8211-19cd5c6b394a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:24.939195 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2149/4322] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:24.940374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ef2c6-9a43-4ada-8211-19cd5c6b394a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:24.968529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ef2c6-9a43-4ada-8211-19cd5c6b394a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:24.981408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aa1d3-74b2-4a1d-9f88-a3984d513688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:24.982046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aa1d3-74b2-4a1d-9f88-a3984d513688 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:24.982327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aa1d3-74b2-4a1d-9f88-a3984d513688 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:24.982600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aa1d3-74b2-4a1d-9f88-a3984d513688 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:24.983499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aa1d3-74b2-4a1d-9f88-a3984d513688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:24.984885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aa1d3-74b2-4a1d-9f88-a3984d513688 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:25.014404 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2150/4323] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:25.019394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aa1d3-74b2-4a1d-9f88-a3984d513688 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:25.061510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4824c-43b7-44d8-81cf-c77e56125d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:25.063191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4824c-43b7-44d8-81cf-c77e56125d7a service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:25.082841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aa1d3-74b2-4a1d-9f88-a3984d513688 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:25.082999 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2174/4324] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:25.118514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281bf1f-0dce-4178-977c-e9517c4de5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:25.119222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281bf1f-0dce-4178-977c-e9517c4de5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:25.119502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281bf1f-0dce-4178-977c-e9517c4de5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:25.119778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281bf1f-0dce-4178-977c-e9517c4de5b6 admin admin] PATH_INFO: `/v3/projects/043a1ce6941348098087caa41593068b/users/e9c904876c314078b182c5574cc7ec5c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:25.198880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281bf1f-0dce-4178-977c-e9517c4de5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043a1ce6941348098087caa41593068b, user_id=e9c904876c314078b182c5574cc7ec5c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:25.210137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281bf1f-0dce-4178-977c-e9517c4de5b6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:25.229669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4824c-43b7-44d8-81cf-c77e56125d7a service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:25.231511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2ce4824c-43b7-44d8-81cf-c77e56125d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:25.255451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4824c-43b7-44d8-81cf-c77e56125d7a service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:25.266960 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2151/4325] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:25 2022] PUT /identity/v3/projects/043a1ce6941348098087caa41593068b/users/e9c904876c314078b182c5574cc7ec5c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:25.272928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2e4f9-8c29-43c8-b06c-9dfb9d44a61a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:25.273402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2e4f9-8c29-43c8-b06c-9dfb9d44a61a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:25.273684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2e4f9-8c29-43c8-b06c-9dfb9d44a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:25.334252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cbc2e4f9-8c29-43c8-b06c-9dfb9d44a61a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:25.335967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cbc2e4f9-8c29-43c8-b06c-9dfb9d44a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:25.399715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:25.400501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:25.400928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:25.401390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] PATH_INFO: `/v3/users/77b49d34906d44819c47d0ad5f1a9bc4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:25.402703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b49d34906d44819c47d0ad5f1a9bc4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:25.404807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:25.528203 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2152/4326] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:25.555409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2e4f9-8c29-43c8-b06c-9dfb9d44a61a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:25.556245 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:25.557935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cbc2e4f9-8c29-43c8-b06c-9dfb9d44a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:25.581896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b49d34906d44819c47d0ad5f1a9bc4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:25.639600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b49d34906d44819c47d0ad5f1a9bc4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:25.671496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b49d34906d44819c47d0ad5f1a9bc4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:25.704298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b49d34906d44819c47d0ad5f1a9bc4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:25.707536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b49d34906d44819c47d0ad5f1a9bc4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:25.730745 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2175/4327] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:25 2022] DELETE /identity/v3/users/77b49d34906d44819c47d0ad5f1a9bc4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:00:25.769325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2e4f9-8c29-43c8-b06c-9dfb9d44a61a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:25.784426 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:25.906681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05950177-17fd-4c56-951f-1aa5ac1dbeb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:25.908141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05950177-17fd-4c56-951f-1aa5ac1dbeb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:25.908668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05950177-17fd-4c56-951f-1aa5ac1dbeb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:25.909242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05950177-17fd-4c56-951f-1aa5ac1dbeb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:25.914083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-05950177-17fd-4c56-951f-1aa5ac1dbeb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:26.188079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05950177-17fd-4c56-951f-1aa5ac1dbeb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:26.189796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05950177-17fd-4c56-951f-1aa5ac1dbeb3 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:26.213249 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2153/4328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:26.778630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:26.780182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:26.808759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d509811-2450-46b4-8ec8-15940f2d49d2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:26.842584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:26.843861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:26.845685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:26.848314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] PATH_INFO: `/v3/projects/d7cd9e94413f41e6aebee479e4c87705` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:26.855964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7cd9e94413f41e6aebee479e4c87705)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:26.862130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:27.070415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cd9e94413f41e6aebee479e4c87705', 'request_id': 'req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:27.094449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cd9e94413f41e6aebee479e4c87705', 'request_id': 'req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:27.116461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cd9e94413f41e6aebee479e4c87705', 'request_id': 'req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:27.142393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] The token cache is being invalidate because project d7cd9e94413f41e6aebee479e4c87705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:27.142705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:27.143484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0f0ef9d4-07de-4c36-8a2d-fbde7625132a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:27.150905 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2176/4329] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:26 2022] DELETE /identity/v3/projects/d7cd9e94413f41e6aebee479e4c87705 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:27.152721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653718-de2a-45ed-b67d-2f2e82d110e1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:27.153212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653718-de2a-45ed-b67d-2f2e82d110e1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:27.153310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653718-de2a-45ed-b67d-2f2e82d110e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:27.179994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c0653718-de2a-45ed-b67d-2f2e82d110e1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:27.181612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c0653718-de2a-45ed-b67d-2f2e82d110e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:27.398778 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2154/4330] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:27.407870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ca3c8-357a-435e-af87-d2c49617e06c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:27.408266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ca3c8-357a-435e-af87-d2c49617e06c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:27.408666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ca3c8-357a-435e-af87-d2c49617e06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:27.472690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-147ca3c8-357a-435e-af87-d2c49617e06c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:27.474282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-147ca3c8-357a-435e-af87-d2c49617e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:27.489652 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2177/4331] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:27.491536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0653718-de2a-45ed-b67d-2f2e82d110e1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:27.504810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0653718-de2a-45ed-b67d-2f2e82d110e1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:27.520374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dff8b0-f4c0-4d56-a7ab-4f96cea16235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:27.521896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dff8b0-f4c0-4d56-a7ab-4f96cea16235 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:27.523946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dff8b0-f4c0-4d56-a7ab-4f96cea16235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:27.524716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dff8b0-f4c0-4d56-a7ab-4f96cea16235 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:27.525579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dff8b0-f4c0-4d56-a7ab-4f96cea16235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:27.527534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dff8b0-f4c0-4d56-a7ab-4f96cea16235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:27.532177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dff8b0-f4c0-4d56-a7ab-4f96cea16235 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:27.571264 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2155/4332] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:27.575771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ca3c8-357a-435e-af87-d2c49617e06c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:27.590138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ca3c8-357a-435e-af87-d2c49617e06c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:27.605058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9ad23-c479-4b3c-9763-40a691f86986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:27.609318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9ad23-c479-4b3c-9763-40a691f86986 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:27.609989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9ad23-c479-4b3c-9763-40a691f86986 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:27.610503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9ad23-c479-4b3c-9763-40a691f86986 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:27.611345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9ad23-c479-4b3c-9763-40a691f86986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:27.615306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9ad23-c479-4b3c-9763-40a691f86986 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:27.692514 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2178/4333] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:27 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:27.697183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dff8b0-f4c0-4d56-a7ab-4f96cea16235 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:27.710832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dff8b0-f4c0-4d56-a7ab-4f96cea16235 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:27.849226 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:27.879524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e668591-322f-4f3c-9cf5-f7478a837a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:27.880250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e668591-322f-4f3c-9cf5-f7478a837a12 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:27.880659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e668591-322f-4f3c-9cf5-f7478a837a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:27.881075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e668591-322f-4f3c-9cf5-f7478a837a12 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:27.881943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e668591-322f-4f3c-9cf5-f7478a837a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:27.884172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e668591-322f-4f3c-9cf5-f7478a837a12 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:27.936261 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2156/4334] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:27 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:27.939602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9ad23-c479-4b3c-9763-40a691f86986 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:27.957285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9ad23-c479-4b3c-9763-40a691f86986 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:27.983047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6be27f-9e76-408c-b768-6bf80da4b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:27.983820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6be27f-9e76-408c-b768-6bf80da4b424 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:27.983987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6be27f-9e76-408c-b768-6bf80da4b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:27.984533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6be27f-9e76-408c-b768-6bf80da4b424 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:27.985407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6be27f-9e76-408c-b768-6bf80da4b424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:27.987219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6be27f-9e76-408c-b768-6bf80da4b424 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:28.012448 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2179/4335] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:28.016150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e668591-322f-4f3c-9cf5-f7478a837a12 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:28.031705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e668591-322f-4f3c-9cf5-f7478a837a12 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:28.046044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53546c6-897c-4322-9531-ad2e74a0d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:28.047012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53546c6-897c-4322-9531-ad2e74a0d4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:28.047492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53546c6-897c-4322-9531-ad2e74a0d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:28.049212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53546c6-897c-4322-9531-ad2e74a0d4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:28.050163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53546c6-897c-4322-9531-ad2e74a0d4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:28.054664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53546c6-897c-4322-9531-ad2e74a0d4d8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:28.091752 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2157/4336] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:28.095959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6be27f-9e76-408c-b768-6bf80da4b424 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:28.112186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6be27f-9e76-408c-b768-6bf80da4b424 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:28.127223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855b328-56d8-48be-abe7-ba9b1a4ffb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:28.128407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b328-56d8-48be-abe7-ba9b1a4ffb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:28.129016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b328-56d8-48be-abe7-ba9b1a4ffb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:28.129550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b328-56d8-48be-abe7-ba9b1a4ffb99 admin admin] PATH_INFO: `/v3/projects/77d9e3bc97b04b3da34be56965ef38fe/users/6d8de036391d4f91865e6810c91937b3/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:28.170835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855b328-56d8-48be-abe7-ba9b1a4ffb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d9e3bc97b04b3da34be56965ef38fe, user_id=6d8de036391d4f91865e6810c91937b3, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:28.173898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855b328-56d8-48be-abe7-ba9b1a4ffb99 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:28.204742 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2180/4337] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:28 2022] PUT /identity/v3/projects/77d9e3bc97b04b3da34be56965ef38fe/users/6d8de036391d4f91865e6810c91937b3/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:28.216867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a56b-3ae4-4da2-8036-9f0bfec3d8da None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:28.217384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a56b-3ae4-4da2-8036-9f0bfec3d8da None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:28.217634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a56b-3ae4-4da2-8036-9f0bfec3d8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:28.291450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-de79a56b-3ae4-4da2-8036-9f0bfec3d8da None None] MFA Rules not processed for user `6d8de036391d4f91865e6810c91937b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:28.292838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-de79a56b-3ae4-4da2-8036-9f0bfec3d8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:28.557673 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2158/4338] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:28.569049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36265d-b93d-4ce8-97fc-3a30ec613cb6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:28.570973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36265d-b93d-4ce8-97fc-3a30ec613cb6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:28.571515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36265d-b93d-4ce8-97fc-3a30ec613cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:28.661857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9a36265d-b93d-4ce8-97fc-3a30ec613cb6 None None] MFA Rules not processed for user `6d8de036391d4f91865e6810c91937b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:28.663192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9a36265d-b93d-4ce8-97fc-3a30ec613cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:28.682783 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2181/4339] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:28.718641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa904d9-363b-4762-8386-1e78099e51ab None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:28.721381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa904d9-363b-4762-8386-1e78099e51ab None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:28.723570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa904d9-363b-4762-8386-1e78099e51ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:28.791483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ffa904d9-363b-4762-8386-1e78099e51ab None None] MFA Rules not processed for user `2190bd30671b47048aed416f9c14a545`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:28.793540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ffa904d9-363b-4762-8386-1e78099e51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:28.885235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36265d-b93d-4ce8-97fc-3a30ec613cb6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:28.887349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9a36265d-b93d-4ce8-97fc-3a30ec613cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:28.936503 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2159/4340] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:28.982452 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:29.131329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36265d-b93d-4ce8-97fc-3a30ec613cb6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:29.146071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690fa44-4513-47fc-9b83-4e8ebd03040a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:29.147031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690fa44-4513-47fc-9b83-4e8ebd03040a service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:29.147183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690fa44-4513-47fc-9b83-4e8ebd03040a service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:29.147405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690fa44-4513-47fc-9b83-4e8ebd03040a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:29.168296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690fa44-4513-47fc-9b83-4e8ebd03040a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:29.170616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690fa44-4513-47fc-9b83-4e8ebd03040a service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:29.200257 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2182/4341] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:34.331106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa904d9-363b-4762-8386-1e78099e51ab None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:34.332914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ffa904d9-363b-4762-8386-1e78099e51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:34.571433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa904d9-363b-4762-8386-1e78099e51ab None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:34.598750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:34.605501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:34.605980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:34.606279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] PATH_INFO: `/v3/users/736b981b268e4fbdb04045b7ccc8740f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:34.609493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=736b981b268e4fbdb04045b7ccc8740f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:34.614212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:34.621548 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:34.771993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736b981b268e4fbdb04045b7ccc8740f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:34.840793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736b981b268e4fbdb04045b7ccc8740f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:34.862416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736b981b268e4fbdb04045b7ccc8740f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:34.879155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736b981b268e4fbdb04045b7ccc8740f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:34.879928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736b981b268e4fbdb04045b7ccc8740f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:34.897320 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2160/4342] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:34 2022] DELETE /identity/v3/users/736b981b268e4fbdb04045b7ccc8740f => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:34.901538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c82a73-9438-4125-9b40-b263395c1296 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:34.902044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c82a73-9438-4125-9b40-b263395c1296 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:34.902149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c82a73-9438-4125-9b40-b263395c1296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:34.940474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c1c82a73-9438-4125-9b40-b263395c1296 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:34.947107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1c82a73-9438-4125-9b40-b263395c1296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:35.113094 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2183/4343] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:35.182691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:35.184169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:35.317701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c82a73-9438-4125-9b40-b263395c1296 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:35.319436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1c82a73-9438-4125-9b40-b263395c1296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:35.377556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00472c-299c-45b9-8749-8fdcd935fc0a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:35.391400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e45b-3cdc-4399-8f9c-9d843f91619d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:35.393347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e45b-3cdc-4399-8f9c-9d843f91619d service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:35.393758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e45b-3cdc-4399-8f9c-9d843f91619d service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:35.395035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e45b-3cdc-4399-8f9c-9d843f91619d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:35.461946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221e45b-3cdc-4399-8f9c-9d843f91619d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:35.468530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221e45b-3cdc-4399-8f9c-9d843f91619d service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:35.501353 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2161/4344] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:35.539386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c82a73-9438-4125-9b40-b263395c1296 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:35.551905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5f2be-0ac5-4c35-b487-99f85771919c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:35.553456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5f2be-0ac5-4c35-b487-99f85771919c service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:35.553929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5f2be-0ac5-4c35-b487-99f85771919c service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:35.554348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5f2be-0ac5-4c35-b487-99f85771919c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:35.556864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-39a5f2be-0ac5-4c35-b487-99f85771919c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:35.667968 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:35.676424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5f2be-0ac5-4c35-b487-99f85771919c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:35.678962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5f2be-0ac5-4c35-b487-99f85771919c service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:35.689975 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2184/4345] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:00:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:37.407776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e45b-3cdc-4399-8f9c-9d843f91619d service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:37.409520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a221e45b-3cdc-4399-8f9c-9d843f91619d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:37.456778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e45b-3cdc-4399-8f9c-9d843f91619d service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:37.468895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:37.472293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:37.472800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:37.473872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] PATH_INFO: `/v3/projects/ae9b26a945ac4821831130fbaa8fab3b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:37.477753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9b26a945ac4821831130fbaa8fab3b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:37.483243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:37.625873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9b26a945ac4821831130fbaa8fab3b', 'request_id': 'req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:37.641697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9b26a945ac4821831130fbaa8fab3b', 'request_id': 'req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:37.663821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9b26a945ac4821831130fbaa8fab3b', 'request_id': 'req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:37.689433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] The token cache is being invalidate because project ae9b26a945ac4821831130fbaa8fab3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:37.689731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:37.691309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dded0ae0-09af-4bf0-b12a-410e9f7d56b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:37.692462 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2162/4346] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:37 2022] DELETE /identity/v3/projects/ae9b26a945ac4821831130fbaa8fab3b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:37.696890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5f2be-0ac5-4c35-b487-99f85771919c service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:37.720815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5f2be-0ac5-4c35-b487-99f85771919c service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:37.818976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe682152-7514-4555-b3a6-0ec30d6524ac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:37.821456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe682152-7514-4555-b3a6-0ec30d6524ac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:37.821971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe682152-7514-4555-b3a6-0ec30d6524ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:37.842374 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:37.888320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fe682152-7514-4555-b3a6-0ec30d6524ac None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:37.894725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fe682152-7514-4555-b3a6-0ec30d6524ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:37.918574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:37.919248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:37.919528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:37.919804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] PATH_INFO: `/v3/users/14b037dac76e43408fbfd0ed60fb6202` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:37.923523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b037dac76e43408fbfd0ed60fb6202)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:37.925535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:38.080727 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2163/4347] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:38.096874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe682152-7514-4555-b3a6-0ec30d6524ac None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:38.099643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fe682152-7514-4555-b3a6-0ec30d6524ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:38.150646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b037dac76e43408fbfd0ed60fb6202'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:38.188133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b037dac76e43408fbfd0ed60fb6202'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:38.223536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b037dac76e43408fbfd0ed60fb6202'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:38.242961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b037dac76e43408fbfd0ed60fb6202'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:38.243923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e6e916b-28be-4161-9995-8f3721d7bdda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b037dac76e43408fbfd0ed60fb6202'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:38.259413 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2185/4348] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:37 2022] DELETE /identity/v3/users/14b037dac76e43408fbfd0ed60fb6202 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:38.344964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe682152-7514-4555-b3a6-0ec30d6524ac None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:38.517497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:38.518111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:38.518393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:38.518659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:38.524993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:38.725020 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:38.757226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:38.762303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:38.797426 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2164/4349] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:00:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:40.137779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5f2c-3f55-4808-86bc-bb2a5a65e480 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:40.138360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5f2c-3f55-4808-86bc-bb2a5a65e480 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:40.138360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5f2c-3f55-4808-86bc-bb2a5a65e480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:40.178214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-82ab5f2c-3f55-4808-86bc-bb2a5a65e480 None None] MFA Rules not processed for user `1f062f2ecc0547ae960ed98e7aeef9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:40.181723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-82ab5f2c-3f55-4808-86bc-bb2a5a65e480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:40.363487 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2186/4350] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:40.767292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:40.768863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:40.894194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b730-0701-4fa2-8f7b-67c8d9ece42d service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:40.904326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:40.906286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:40.906667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:40.907042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] PATH_INFO: `/v3/projects/bcc3a24360f24e6cb7843f27e60016df` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:40.909052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc3a24360f24e6cb7843f27e60016df)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:40.911290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:41.041372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc3a24360f24e6cb7843f27e60016df', 'request_id': 'req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.062485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc3a24360f24e6cb7843f27e60016df', 'request_id': 'req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.094905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc3a24360f24e6cb7843f27e60016df', 'request_id': 'req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.142382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0638b8-ddfb-4dda-9b63-0d65354f2225 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:41.143275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0638b8-ddfb-4dda-9b63-0d65354f2225 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:41.147793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0638b8-ddfb-4dda-9b63-0d65354f2225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:41.160728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] The token cache is being invalidate because project bcc3a24360f24e6cb7843f27e60016df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:41.161052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.162210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.164940 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2165/4351] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:40 2022] DELETE /identity/v3/projects/bcc3a24360f24e6cb7843f27e60016df => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:41.176178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:41.178432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:41.258912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3e0638b8-ddfb-4dda-9b63-0d65354f2225 None None] MFA Rules not processed for user `e9c904876c314078b182c5574cc7ec5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:41.260527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3e0638b8-ddfb-4dda-9b63-0d65354f2225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:41.275076 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:41.293226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb7a70-c117-43ee-8aab-9e9bc2c3bfb4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:41.299664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:41.300330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:41.300635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:41.301074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] PATH_INFO: `/v3/users/133ca96e99fd4c04a960bbc49a02a379` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:41.302445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=133ca96e99fd4c04a960bbc49a02a379)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:41.305312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:41.366168 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:41.418105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133ca96e99fd4c04a960bbc49a02a379'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.439314 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2187/4352] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:41.441465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133ca96e99fd4c04a960bbc49a02a379'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.442162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0638b8-ddfb-4dda-9b63-0d65354f2225 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:41.445740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3e0638b8-ddfb-4dda-9b63-0d65354f2225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:41.455198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133ca96e99fd4c04a960bbc49a02a379'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.468687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0638b8-ddfb-4dda-9b63-0d65354f2225 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:41.473717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133ca96e99fd4c04a960bbc49a02a379'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.475597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133ca96e99fd4c04a960bbc49a02a379'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.477449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:41.478155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:41.478440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:41.478745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] PATH_INFO: `/v3/users/8f138ca4a03c4459ab40866b7f2e2d94` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:41.484220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f138ca4a03c4459ab40866b7f2e2d94)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:41.489043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:41.493811 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2166/4353] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:41 2022] DELETE /identity/v3/users/133ca96e99fd4c04a960bbc49a02a379 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:41.616973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f138ca4a03c4459ab40866b7f2e2d94'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.643057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f138ca4a03c4459ab40866b7f2e2d94'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.668602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f138ca4a03c4459ab40866b7f2e2d94'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.707852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f138ca4a03c4459ab40866b7f2e2d94'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.708926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f138ca4a03c4459ab40866b7f2e2d94'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:41.736986 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2188/4354] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:41 2022] DELETE /identity/v3/users/8f138ca4a03c4459ab40866b7f2e2d94 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:42.312019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:42.314246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:42.500717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18286-d677-4fcf-8741-c5c3c08dac1b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:42.670426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:42.672824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:42.673308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:42.673760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] PATH_INFO: `/v3/projects/7d0aac4d8ecb47ff8ad2e666de23c1c1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:42.679323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0aac4d8ecb47ff8ad2e666de23c1c1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:42.683799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:42.827476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0aac4d8ecb47ff8ad2e666de23c1c1', 'request_id': 'req-ad557c36-068c-4b2e-b052-52bb44d864a6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:42.831134 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:42.857850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:42.859410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0aac4d8ecb47ff8ad2e666de23c1c1', 'request_id': 'req-ad557c36-068c-4b2e-b052-52bb44d864a6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:42.859768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:42.909271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0aac4d8ecb47ff8ad2e666de23c1c1', 'request_id': 'req-ad557c36-068c-4b2e-b052-52bb44d864a6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:42.925626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51e257-884e-440f-a438-4f5c046e2006 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:42.926415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] The token cache is being invalidate because project 7d0aac4d8ecb47ff8ad2e666de23c1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:42.933392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:42.938475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad557c36-068c-4b2e-b052-52bb44d864a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:42.941191 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2167/4355] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:42 2022] DELETE /identity/v3/projects/7d0aac4d8ecb47ff8ad2e666de23c1c1 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:42.955982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9a821-07fb-4cc4-9ec8-d9e5c1ebd998 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:42.956649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9a821-07fb-4cc4-9ec8-d9e5c1ebd998 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:42.961444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9a821-07fb-4cc4-9ec8-d9e5c1ebd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.003134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b5c9a821-07fb-4cc4-9ec8-d9e5c1ebd998 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:43.004350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b5c9a821-07fb-4cc4-9ec8-d9e5c1ebd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:43.046589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:43.049841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.050646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.051565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] PATH_INFO: `/v3/projects/9e0ebeeff9bb4259aee997c96a3a224c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.055895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0ebeeff9bb4259aee997c96a3a224c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:43.065453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:43.136109 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:43.166206 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2168/4356] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:43.178800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678278-f88d-49dd-b520-2a65cfc77884 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.179519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678278-f88d-49dd-b520-2a65cfc77884 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.180532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678278-f88d-49dd-b520-2a65cfc77884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.203296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0ebeeff9bb4259aee997c96a3a224c', 'request_id': 'req-3b887e43-3f46-4a06-93b1-69a9ad83bad5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:43.225561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0ebeeff9bb4259aee997c96a3a224c', 'request_id': 'req-3b887e43-3f46-4a06-93b1-69a9ad83bad5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:43.245148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0ebeeff9bb4259aee997c96a3a224c', 'request_id': 'req-3b887e43-3f46-4a06-93b1-69a9ad83bad5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:43.247530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-32678278-f88d-49dd-b520-2a65cfc77884 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:43.249680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-32678278-f88d-49dd-b520-2a65cfc77884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:43.280162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] The token cache is being invalidate because project 9e0ebeeff9bb4259aee997c96a3a224c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:43.280549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:43.281957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3b887e43-3f46-4a06-93b1-69a9ad83bad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:43.290711 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2189/4357] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:42 2022] DELETE /identity/v3/projects/9e0ebeeff9bb4259aee997c96a3a224c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:43.292180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05f88f-6373-45bc-b300-e3d0f4ff41b1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.292466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05f88f-6373-45bc-b300-e3d0f4ff41b1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.292912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05f88f-6373-45bc-b300-e3d0f4ff41b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.347957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2d05f88f-6373-45bc-b300-e3d0f4ff41b1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:43.349430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2d05f88f-6373-45bc-b300-e3d0f4ff41b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:43.420488 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2169/4358] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:43.424585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678278-f88d-49dd-b520-2a65cfc77884 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:43.436714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678278-f88d-49dd-b520-2a65cfc77884 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:43.443428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795757e5-78ff-45ab-83db-1c6f07c6dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:43.444582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795757e5-78ff-45ab-83db-1c6f07c6dbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.444989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795757e5-78ff-45ab-83db-1c6f07c6dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.445358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795757e5-78ff-45ab-83db-1c6f07c6dbc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.446105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795757e5-78ff-45ab-83db-1c6f07c6dbc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:43.446508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795757e5-78ff-45ab-83db-1c6f07c6dbc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:43.448514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795757e5-78ff-45ab-83db-1c6f07c6dbc0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:43.463904 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2170/4359] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:43.469240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795757e5-78ff-45ab-83db-1c6f07c6dbc0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:43.491761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795757e5-78ff-45ab-83db-1c6f07c6dbc0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:43.526987 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2190/4360] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:43.536179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2cd29-b7e5-4d9f-b6da-8aee9f2d1bc6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.537151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2cd29-b7e5-4d9f-b6da-8aee9f2d1bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.537429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2cd29-b7e5-4d9f-b6da-8aee9f2d1bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.537707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cb1d1-d94e-49ae-a9e9-a71fe5f55761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:43.538397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cb1d1-d94e-49ae-a9e9-a71fe5f55761 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.538745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cb1d1-d94e-49ae-a9e9-a71fe5f55761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.540478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cb1d1-d94e-49ae-a9e9-a71fe5f55761 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.541524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cb1d1-d94e-49ae-a9e9-a71fe5f55761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:43.544435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cb1d1-d94e-49ae-a9e9-a71fe5f55761 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:43.568787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-76b2cd29-b7e5-4d9f-b6da-8aee9f2d1bc6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:43.570194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-76b2cd29-b7e5-4d9f-b6da-8aee9f2d1bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:43.604239 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2191/4361] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:43.607163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2cd29-b7e5-4d9f-b6da-8aee9f2d1bc6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:43.625503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2cd29-b7e5-4d9f-b6da-8aee9f2d1bc6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:43.636872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a1b28-1145-49ec-ba39-dc8c97d7089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:43.637507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a1b28-1145-49ec-ba39-dc8c97d7089e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.637928 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2171/4362] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:43 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:43.639252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a1b28-1145-49ec-ba39-dc8c97d7089e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.639406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cb1d1-d94e-49ae-a9e9-a71fe5f55761 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:43.639527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a1b28-1145-49ec-ba39-dc8c97d7089e admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.639929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a1b28-1145-49ec-ba39-dc8c97d7089e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:43.640241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a1b28-1145-49ec-ba39-dc8c97d7089e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:43.645566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a1b28-1145-49ec-ba39-dc8c97d7089e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:43.688320 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2192/4363] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:00:43.693716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a1b28-1145-49ec-ba39-dc8c97d7089e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:43.718539 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:43.721721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a1b28-1145-49ec-ba39-dc8c97d7089e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:43.748509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cb1d1-d94e-49ae-a9e9-a71fe5f55761 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:43.754865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c6b36-0add-4293-88c9-7a93b1b87250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:43.755631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6b36-0add-4293-88c9-7a93b1b87250 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.755996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6b36-0add-4293-88c9-7a93b1b87250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.756294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6b36-0add-4293-88c9-7a93b1b87250 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.756976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c6b36-0add-4293-88c9-7a93b1b87250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:43.781512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c6b36-0add-4293-88c9-7a93b1b87250 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:43.833104 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2172/4364] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:43 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:43.839010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c6b36-0add-4293-88c9-7a93b1b87250 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:43.853635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c6b36-0add-4293-88c9-7a93b1b87250 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:43.864159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b15c88-34fd-44ab-80eb-29f1cd03494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:43.866026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37493a6a-d575-4a00-a3fc-b49edb807035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:43.866584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b15c88-34fd-44ab-80eb-29f1cd03494b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.866865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b15c88-34fd-44ab-80eb-29f1cd03494b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.867138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b15c88-34fd-44ab-80eb-29f1cd03494b admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.867868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37493a6a-d575-4a00-a3fc-b49edb807035 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.868146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37493a6a-d575-4a00-a3fc-b49edb807035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.868416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37493a6a-d575-4a00-a3fc-b49edb807035 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.869084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b15c88-34fd-44ab-80eb-29f1cd03494b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:43.870228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37493a6a-d575-4a00-a3fc-b49edb807035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:43.874302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b15c88-34fd-44ab-80eb-29f1cd03494b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:43.875118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37493a6a-d575-4a00-a3fc-b49edb807035 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:43.904473 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2173/4365] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:43.905773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37493a6a-d575-4a00-a3fc-b49edb807035 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:43.922744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37493a6a-d575-4a00-a3fc-b49edb807035 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:43.937158 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2193/4366] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:43 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:43.941231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b15c88-34fd-44ab-80eb-29f1cd03494b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:43.942486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7c97-a81a-41de-a5b0-76d5446b40c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:43.945477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7c97-a81a-41de-a5b0-76d5446b40c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:43.946211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7c97-a81a-41de-a5b0-76d5446b40c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:43.948757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7c97-a81a-41de-a5b0-76d5446b40c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:43.950427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7c97-a81a-41de-a5b0-76d5446b40c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:43.953287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7c97-a81a-41de-a5b0-76d5446b40c6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:44.015016 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2174/4367] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:44.018361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7c97-a81a-41de-a5b0-76d5446b40c6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:44.021016 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:44.077259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7c97-a81a-41de-a5b0-76d5446b40c6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:44.148834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b15c88-34fd-44ab-80eb-29f1cd03494b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:44.198404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2579d-b85a-4796-a3a5-bc6f1e7518b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:44.199744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2579d-b85a-4796-a3a5-bc6f1e7518b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:44.205525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2579d-b85a-4796-a3a5-bc6f1e7518b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:44.214365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2579d-b85a-4796-a3a5-bc6f1e7518b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:44.217179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2579d-b85a-4796-a3a5-bc6f1e7518b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:44.239473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c564c2-16c6-45bf-bae0-7c8b22eacf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:44.239718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2579d-b85a-4796-a3a5-bc6f1e7518b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:44.240228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c564c2-16c6-45bf-bae0-7c8b22eacf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:44.240525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c564c2-16c6-45bf-bae0-7c8b22eacf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:44.240828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c564c2-16c6-45bf-bae0-7c8b22eacf8d admin admin] PATH_INFO: `/v3/projects/18b6ea2fe5ee4fc8a9b1f143ac95fcef/users/9ddb45b2dcf14263887a3718e23eb937/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:44.289210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2194/4368] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:43 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:44.291997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2579d-b85a-4796-a3a5-bc6f1e7518b5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:44.297180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c564c2-16c6-45bf-bae0-7c8b22eacf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b6ea2fe5ee4fc8a9b1f143ac95fcef, user_id=9ddb45b2dcf14263887a3718e23eb937, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:44.300312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c564c2-16c6-45bf-bae0-7c8b22eacf8d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:44.326705 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2175/4369] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:44 2022] PUT /identity/v3/projects/18b6ea2fe5ee4fc8a9b1f143ac95fcef/users/9ddb45b2dcf14263887a3718e23eb937/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:44.332336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302582b-0b98-4b49-bcdd-98c6be71c1e0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:44.332700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302582b-0b98-4b49-bcdd-98c6be71c1e0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:44.332996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302582b-0b98-4b49-bcdd-98c6be71c1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:44.337822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2579d-b85a-4796-a3a5-bc6f1e7518b5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:44.358615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1302582b-0b98-4b49-bcdd-98c6be71c1e0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:44.360077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1302582b-0b98-4b49-bcdd-98c6be71c1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:44.440342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de1100-b20b-47f6-995a-b5db2256d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:44.452127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de1100-b20b-47f6-995a-b5db2256d731 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:44.452563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de1100-b20b-47f6-995a-b5db2256d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:44.452965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de1100-b20b-47f6-995a-b5db2256d731 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:44.453861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de1100-b20b-47f6-995a-b5db2256d731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:44.456062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de1100-b20b-47f6-995a-b5db2256d731 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:44.480508 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2195/4370] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:44.486210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de1100-b20b-47f6-995a-b5db2256d731 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:44.502116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de1100-b20b-47f6-995a-b5db2256d731 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:44.509747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a53f7-fd5f-4316-b314-dc0de87f4b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:44.510639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a53f7-fd5f-4316-b314-dc0de87f4b26 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:44.511007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a53f7-fd5f-4316-b314-dc0de87f4b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:44.511333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a53f7-fd5f-4316-b314-dc0de87f4b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:44.512339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a53f7-fd5f-4316-b314-dc0de87f4b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:44.514192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a53f7-fd5f-4316-b314-dc0de87f4b26 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:44.530387 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2196/4371] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:00:44.547863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a53f7-fd5f-4316-b314-dc0de87f4b26 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:44.553656 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2176/4372] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:44.585403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a53f7-fd5f-4316-b314-dc0de87f4b26 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:44.596116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc0bf0-8e89-4b50-9eac-e39b2cc88fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:44.599552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0bf0-8e89-4b50-9eac-e39b2cc88fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:44.600669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0bf0-8e89-4b50-9eac-e39b2cc88fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:44.600669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0bf0-8e89-4b50-9eac-e39b2cc88fd3 admin admin] PATH_INFO: `/v3/projects/c6a972e206ef4c8e975d479ff98ce287/users/2937f396ff0b4584b144bc65bc2c875c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:44.638198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc0bf0-8e89-4b50-9eac-e39b2cc88fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a972e206ef4c8e975d479ff98ce287, user_id=2937f396ff0b4584b144bc65bc2c875c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:44.661035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc0bf0-8e89-4b50-9eac-e39b2cc88fd3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:44.674038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302582b-0b98-4b49-bcdd-98c6be71c1e0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:44.676000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1302582b-0b98-4b49-bcdd-98c6be71c1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:44.700052 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2197/4373] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:44 2022] PUT /identity/v3/projects/c6a972e206ef4c8e975d479ff98ce287/users/2937f396ff0b4584b144bc65bc2c875c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:44.712671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf864-880c-4bab-b860-03957fbe3c07 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:44.713359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf864-880c-4bab-b860-03957fbe3c07 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:44.713737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf864-880c-4bab-b860-03957fbe3c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:44.820056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d2faf864-880c-4bab-b860-03957fbe3c07 None None] MFA Rules not processed for user `2937f396ff0b4584b144bc65bc2c875c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:44.821531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d2faf864-880c-4bab-b860-03957fbe3c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:44.845234 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:44.890495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302582b-0b98-4b49-bcdd-98c6be71c1e0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:44.965985 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:44.984853 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2198/4374] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:44.989167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faf864-880c-4bab-b860-03957fbe3c07 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:45.016161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41083ea7-fde0-4c97-af21-cec8f4fa23cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:45.016865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41083ea7-fde0-4c97-af21-cec8f4fa23cc service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:45.017174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41083ea7-fde0-4c97-af21-cec8f4fa23cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:45.017499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41083ea7-fde0-4c97-af21-cec8f4fa23cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:45.153677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41083ea7-fde0-4c97-af21-cec8f4fa23cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:45.155845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41083ea7-fde0-4c97-af21-cec8f4fa23cc service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:45.178167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faf864-880c-4bab-b860-03957fbe3c07 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:45.178311 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2177/4375] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:45.194857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cc618-7016-4072-9950-d96d0a6a742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:45.195509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc618-7016-4072-9950-d96d0a6a742f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:45.195793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc618-7016-4072-9950-d96d0a6a742f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:45.196069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc618-7016-4072-9950-d96d0a6a742f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:45.196848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cc618-7016-4072-9950-d96d0a6a742f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:45.198859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cc618-7016-4072-9950-d96d0a6a742f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:45.238571 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2199/4376] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:44 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:45.242916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41083ea7-fde0-4c97-af21-cec8f4fa23cc service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:45.262348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41083ea7-fde0-4c97-af21-cec8f4fa23cc service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:45.454174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b983ab4-62f6-4a21-a654-ef368140b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:45.455601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b983ab4-62f6-4a21-a654-ef368140b0de admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:45.456762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b983ab4-62f6-4a21-a654-ef368140b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:45.457244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b983ab4-62f6-4a21-a654-ef368140b0de admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:45.461323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b983ab4-62f6-4a21-a654-ef368140b0de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:45.466336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b983ab4-62f6-4a21-a654-ef368140b0de admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:45.541350 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2178/4377] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:45 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:45.545096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cc618-7016-4072-9950-d96d0a6a742f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:45.562085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cc618-7016-4072-9950-d96d0a6a742f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:45.578571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab075-e0b6-4497-8fb7-494982e58cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:45.587293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab075-e0b6-4497-8fb7-494982e58cac admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:45.587625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab075-e0b6-4497-8fb7-494982e58cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:45.587858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab075-e0b6-4497-8fb7-494982e58cac admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:45.588765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ab075-e0b6-4497-8fb7-494982e58cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:45.591028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ab075-e0b6-4497-8fb7-494982e58cac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:45.625810 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2200/4378] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:45.631056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b983ab4-62f6-4a21-a654-ef368140b0de admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:45.655117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b983ab4-62f6-4a21-a654-ef368140b0de admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:45.660738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eceafe-a06f-453c-9b8b-22a13814b7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:45.661817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eceafe-a06f-453c-9b8b-22a13814b7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:45.662175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eceafe-a06f-453c-9b8b-22a13814b7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:45.662531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eceafe-a06f-453c-9b8b-22a13814b7dd admin admin] PATH_INFO: `/v3/projects/c200473106344fd58fa6689f64012020/users/7ecc6479c01041cb984d9a27b7e4af9e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:45.686854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eceafe-a06f-453c-9b8b-22a13814b7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c200473106344fd58fa6689f64012020, user_id=7ecc6479c01041cb984d9a27b7e4af9e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:45.690045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eceafe-a06f-453c-9b8b-22a13814b7dd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:45.706900 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2179/4379] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:45 2022] PUT /identity/v3/projects/c200473106344fd58fa6689f64012020/users/7ecc6479c01041cb984d9a27b7e4af9e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:45.712091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab075-e0b6-4497-8fb7-494982e58cac admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:45.764101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab075-e0b6-4497-8fb7-494982e58cac admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:45.918664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f922f-f436-467c-9f1b-20f169f2a853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:45.919667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f922f-f436-467c-9f1b-20f169f2a853 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:45.920176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f922f-f436-467c-9f1b-20f169f2a853 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:45.920763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f922f-f436-467c-9f1b-20f169f2a853 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:45.921711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f922f-f436-467c-9f1b-20f169f2a853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:45.923516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f922f-f436-467c-9f1b-20f169f2a853 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:45.941581 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2201/4380] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:45.951949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eceafe-a06f-453c-9b8b-22a13814b7dd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:45.966891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eceafe-a06f-453c-9b8b-22a13814b7dd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:45.980542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9d02b-8923-4b27-9dbe-8d2803d975cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:45.981012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d02b-8923-4b27-9dbe-8d2803d975cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:45.981289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d02b-8923-4b27-9dbe-8d2803d975cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:45.981563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d02b-8923-4b27-9dbe-8d2803d975cc admin admin] PATH_INFO: `/v3/projects/c200473106344fd58fa6689f64012020/users/7ecc6479c01041cb984d9a27b7e4af9e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:45.991115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9d02b-8923-4b27-9dbe-8d2803d975cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c200473106344fd58fa6689f64012020, user_id=7ecc6479c01041cb984d9a27b7e4af9e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:45.994247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9d02b-8923-4b27-9dbe-8d2803d975cc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:46.000528 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:46.031293 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2180/4381] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:45 2022] PUT /identity/v3/projects/c200473106344fd58fa6689f64012020/users/7ecc6479c01041cb984d9a27b7e4af9e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:46.051493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777777-59be-42fd-b0fc-8f8a04feb8ff None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:46.054225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777777-59be-42fd-b0fc-8f8a04feb8ff None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:46.056072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777777-59be-42fd-b0fc-8f8a04feb8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:46.122259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-57777777-59be-42fd-b0fc-8f8a04feb8ff None None] MFA Rules not processed for user `7ecc6479c01041cb984d9a27b7e4af9e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:46.124206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-57777777-59be-42fd-b0fc-8f8a04feb8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:46.229935 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:46.294875 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2202/4382] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:46.318494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9d02b-8923-4b27-9dbe-8d2803d975cc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:46.321485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-31d9d02b-8923-4b27-9dbe-8d2803d975cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:46.433591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9d02b-8923-4b27-9dbe-8d2803d975cc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:46.450928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52511c6e-b015-4e15-8062-8fbc3a4413fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:46.452521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52511c6e-b015-4e15-8062-8fbc3a4413fd service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:46.453106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52511c6e-b015-4e15-8062-8fbc3a4413fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:46.453613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52511c6e-b015-4e15-8062-8fbc3a4413fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:46.527592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52511c6e-b015-4e15-8062-8fbc3a4413fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:46.530623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52511c6e-b015-4e15-8062-8fbc3a4413fd service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:46.554932 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2181/4383] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:00:54.138912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777777-59be-42fd-b0fc-8f8a04feb8ff None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:54.370417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777777-59be-42fd-b0fc-8f8a04feb8ff None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:54.380437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:54.381173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:54.381441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:54.381724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] PATH_INFO: `/v3/users/2937f396ff0b4584b144bc65bc2c875c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:54.385321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2937f396ff0b4584b144bc65bc2c875c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:54.388383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:54.503065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2937f396ff0b4584b144bc65bc2c875c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:54.536096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2937f396ff0b4584b144bc65bc2c875c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:54.564855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2937f396ff0b4584b144bc65bc2c875c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:54.570206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2937f396ff0b4584b144bc65bc2c875c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:54.572119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2937f396ff0b4584b144bc65bc2c875c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:54.607767 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2203/4384] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:54 2022] DELETE /identity/v3/users/2937f396ff0b4584b144bc65bc2c875c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:54.612457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621dbdf-369c-4691-ae14-99900a1270b1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:54.613274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621dbdf-369c-4691-ae14-99900a1270b1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:54.613831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621dbdf-369c-4691-ae14-99900a1270b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:54.647936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a621dbdf-369c-4691-ae14-99900a1270b1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:54.649893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a621dbdf-369c-4691-ae14-99900a1270b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:54.799252 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2182/4385] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:54.821996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:54.823861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:54.997252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6a896-3331-4d42-bc31-b7cd6c9c7998 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:55.005488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d474b6-3b4d-46ed-8f4c-77c8fb901001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:55.008892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d474b6-3b4d-46ed-8f4c-77c8fb901001 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:55.009243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d474b6-3b4d-46ed-8f4c-77c8fb901001 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:55.009579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d474b6-3b4d-46ed-8f4c-77c8fb901001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:55.032246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d474b6-3b4d-46ed-8f4c-77c8fb901001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:55.033871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d474b6-3b4d-46ed-8f4c-77c8fb901001 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:55.074354 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2204/4386] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:56.652761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621dbdf-369c-4691-ae14-99900a1270b1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:56.655066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a621dbdf-369c-4691-ae14-99900a1270b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:56.712171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621dbdf-369c-4691-ae14-99900a1270b1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:56.721347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:56.722913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:56.723553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:56.724530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] PATH_INFO: `/v3/projects/c6a972e206ef4c8e975d479ff98ce287` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:56.726091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a972e206ef4c8e975d479ff98ce287)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:56.728511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:56.802166 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:56.807847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a972e206ef4c8e975d479ff98ce287', 'request_id': 'req-3648c9f1-d728-4962-bd07-e36d3b4fae97'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:56.856414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d474b6-3b4d-46ed-8f4c-77c8fb901001 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:56.858103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-29d474b6-3b4d-46ed-8f4c-77c8fb901001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:56.882095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d474b6-3b4d-46ed-8f4c-77c8fb901001 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:56.886471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a972e206ef4c8e975d479ff98ce287', 'request_id': 'req-3648c9f1-d728-4962-bd07-e36d3b4fae97'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:56.899590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a972e206ef4c8e975d479ff98ce287', 'request_id': 'req-3648c9f1-d728-4962-bd07-e36d3b4fae97'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:56.921764 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:56.943544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] The token cache is being invalidate because project c6a972e206ef4c8e975d479ff98ce287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:56.943866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:56.945256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:56.950570 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2183/4387] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:56 2022] DELETE /identity/v3/projects/c6a972e206ef4c8e975d479ff98ce287 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:56.954720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:56.956177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:57.041473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:57.042538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:57.042925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:57.043296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] PATH_INFO: `/v3/users/e9c904876c314078b182c5574cc7ec5c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:57.045335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c904876c314078b182c5574cc7ec5c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:57.047417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:57.110580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648c9f1-d728-4962-bd07-e36d3b4fae97 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:57.126265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:57.127075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:57.127463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:57.127843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] PATH_INFO: `/v3/users/7ecc6479c01041cb984d9a27b7e4af9e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:57.129147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ecc6479c01041cb984d9a27b7e4af9e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:57.131339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:57.132943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c904876c314078b182c5574cc7ec5c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.164387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c904876c314078b182c5574cc7ec5c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.178231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c904876c314078b182c5574cc7ec5c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.188041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c904876c314078b182c5574cc7ec5c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.188999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-335d14c5-f3a3-4399-b889-cf1c09621eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c904876c314078b182c5574cc7ec5c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.206593 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2205/4388] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:56 2022] DELETE /identity/v3/users/e9c904876c314078b182c5574cc7ec5c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:00:57.243517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ecc6479c01041cb984d9a27b7e4af9e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.282500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ecc6479c01041cb984d9a27b7e4af9e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.302478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ecc6479c01041cb984d9a27b7e4af9e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.325773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ecc6479c01041cb984d9a27b7e4af9e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.327730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ecc6479c01041cb984d9a27b7e4af9e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:57.350349 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2184/4389] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:00:56 2022] DELETE /identity/v3/users/7ecc6479c01041cb984d9a27b7e4af9e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:00:57.914163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5638500-feee-408a-a026-ad35a3b23693 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:57.915651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5638500-feee-408a-a026-ad35a3b23693 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:57.916158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5638500-feee-408a-a026-ad35a3b23693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:57.970113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d5638500-feee-408a-a026-ad35a3b23693 None None] MFA Rules not processed for user `9ddb45b2dcf14263887a3718e23eb937`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:57.971267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d5638500-feee-408a-a026-ad35a3b23693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:57.994177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:57.997251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:58.127247 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:58.157943 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2206/4390] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:58.161694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cdc25-0e7f-453b-8f5e-359a6d20a4c3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:58.170068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5638500-feee-408a-a026-ad35a3b23693 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:58.171726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d5638500-feee-408a-a026-ad35a3b23693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:58.183914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:58.186520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:58.186928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:58.187869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] PATH_INFO: `/v3/projects/043a1ce6941348098087caa41593068b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:58.190793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043a1ce6941348098087caa41593068b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:58.193233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:58.215296 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:58.328944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043a1ce6941348098087caa41593068b', 'request_id': 'req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.359843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5638500-feee-408a-a026-ad35a3b23693 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:58.364688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043a1ce6941348098087caa41593068b', 'request_id': 'req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.384174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043a1ce6941348098087caa41593068b', 'request_id': 'req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.406712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] The token cache is being invalidate because project 043a1ce6941348098087caa41593068b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:58.407072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.407693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.409798 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2185/4391] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:57 2022] DELETE /identity/v3/projects/043a1ce6941348098087caa41593068b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:58.410687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:58.413236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:58.486502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d4225-3202-4164-87c3-bb7b476becb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:58.487326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d4225-3202-4164-87c3-bb7b476becb2 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:58.487743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d4225-3202-4164-87c3-bb7b476becb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:58.488519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d4225-3202-4164-87c3-bb7b476becb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:58.492961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7b2d4225-3202-4164-87c3-bb7b476becb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:58.571023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2c5de-ae32-4cfa-a977-43e0cbd1d7c1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:58.578161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:58.578942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:58.579305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:58.579654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] PATH_INFO: `/v3/projects/c200473106344fd58fa6689f64012020` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:58.581602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c200473106344fd58fa6689f64012020)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:58.583834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:58.638706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d4225-3202-4164-87c3-bb7b476becb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:58.644699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d4225-3202-4164-87c3-bb7b476becb2 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:58.659855 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2207/4392] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:00:58.662446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e562-7138-42cd-a437-671274c2db9e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:58.662969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e562-7138-42cd-a437-671274c2db9e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:58.663543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e562-7138-42cd-a437-671274c2db9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:58.714857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-caa8e562-7138-42cd-a437-671274c2db9e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:58.729188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-caa8e562-7138-42cd-a437-671274c2db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:58.730902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c200473106344fd58fa6689f64012020', 'request_id': 'req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.763212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c200473106344fd58fa6689f64012020', 'request_id': 'req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.772601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c200473106344fd58fa6689f64012020', 'request_id': 'req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.796980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] The token cache is being invalidate because project c200473106344fd58fa6689f64012020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:00:58.798381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.800540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6f51e3b-c415-450b-b7a4-f715c0ce9f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:00:58.804528 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2186/4393] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:58 2022] DELETE /identity/v3/projects/c200473106344fd58fa6689f64012020 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:58.809784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11c6b-d4e2-4612-8e98-a1f4c2709ce4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:58.809784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11c6b-d4e2-4612-8e98-a1f4c2709ce4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:58.810044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11c6b-d4e2-4612-8e98-a1f4c2709ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:58.843045 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2208/4394] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:58.853568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b7e16-1c60-43b6-adbf-76895d8ca8dd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:58.853885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b7e16-1c60-43b6-adbf-76895d8ca8dd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:58.854289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b7e16-1c60-43b6-adbf-76895d8ca8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:58.857372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c1c11c6b-d4e2-4612-8e98-a1f4c2709ce4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:58.858823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c1c11c6b-d4e2-4612-8e98-a1f4c2709ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:58.870172 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2187/4395] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:58.877536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004487-94f4-4b06-a15d-5551a6b563c4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:58.878116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004487-94f4-4b06-a15d-5551a6b563c4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:58.878559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004487-94f4-4b06-a15d-5551a6b563c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:58.907649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-578b7e16-1c60-43b6-adbf-76895d8ca8dd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:58.909138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-578b7e16-1c60-43b6-adbf-76895d8ca8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:58.920058 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2209/4396] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:00:58.921630 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:58.924573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b7e16-1c60-43b6-adbf-76895d8ca8dd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:58.940970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d6004487-94f4-4b06-a15d-5551a6b563c4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:58.943777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b7e16-1c60-43b6-adbf-76895d8ca8dd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:58.946904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d6004487-94f4-4b06-a15d-5551a6b563c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:58.958869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f479-b192-44cc-9c7f-9e6bd2e61a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:58.960157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f479-b192-44cc-9c7f-9e6bd2e61a2e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:58.961769 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2188/4397] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:58.962226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f479-b192-44cc-9c7f-9e6bd2e61a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:58.962742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f479-b192-44cc-9c7f-9e6bd2e61a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:58.962884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6004487-94f4-4b06-a15d-5551a6b563c4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:58.963804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f479-b192-44cc-9c7f-9e6bd2e61a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:58.965715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f479-b192-44cc-9c7f-9e6bd2e61a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:58.969755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f479-b192-44cc-9c7f-9e6bd2e61a2e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:58.974750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6004487-94f4-4b06-a15d-5551a6b563c4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:58.981430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9fb04-82f2-4c17-ab22-ac5c16d658dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:58.982047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9fb04-82f2-4c17-ab22-ac5c16d658dc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:58.982327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9fb04-82f2-4c17-ab22-ac5c16d658dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:58.982598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9fb04-82f2-4c17-ab22-ac5c16d658dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:58.983393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9fb04-82f2-4c17-ab22-ac5c16d658dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:00:58.983691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9fb04-82f2-4c17-ab22-ac5c16d658dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:58.985664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9fb04-82f2-4c17-ab22-ac5c16d658dc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.006745 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2210/4398] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:59.006978 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2189/4399] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:00:59.007961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f479-b192-44cc-9c7f-9e6bd2e61a2e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.014066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9fb04-82f2-4c17-ab22-ac5c16d658dc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.030841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f479-b192-44cc-9c7f-9e6bd2e61a2e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.037753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565185d9-d46b-4c05-aab4-16ef4ad09fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.038363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565185d9-d46b-4c05-aab4-16ef4ad09fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.038726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565185d9-d46b-4c05-aab4-16ef4ad09fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.039080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565185d9-d46b-4c05-aab4-16ef4ad09fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.040048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565185d9-d46b-4c05-aab4-16ef4ad09fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.041373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9fb04-82f2-4c17-ab22-ac5c16d658dc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.042269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565185d9-d46b-4c05-aab4-16ef4ad09fa3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.063777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ace06f-13f5-473e-91d7-c8fddd50037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.066061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace06f-13f5-473e-91d7-c8fddd50037d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.066882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace06f-13f5-473e-91d7-c8fddd50037d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.069299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace06f-13f5-473e-91d7-c8fddd50037d admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.070701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ace06f-13f5-473e-91d7-c8fddd50037d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.074184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ace06f-13f5-473e-91d7-c8fddd50037d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.075557 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:59.127994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2211/4400] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:59 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:59.130079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565185d9-d46b-4c05-aab4-16ef4ad09fa3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.149701 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2190/4401] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:00:59 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:59.153458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ace06f-13f5-473e-91d7-c8fddd50037d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.219149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565185d9-d46b-4c05-aab4-16ef4ad09fa3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.272912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ace06f-13f5-473e-91d7-c8fddd50037d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.278504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798c20-a80b-4328-8e7d-df5ea1cb4e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.279192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798c20-a80b-4328-8e7d-df5ea1cb4e68 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.280004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798c20-a80b-4328-8e7d-df5ea1cb4e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.280289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798c20-a80b-4328-8e7d-df5ea1cb4e68 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.280982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a798c20-a80b-4328-8e7d-df5ea1cb4e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.282928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a798c20-a80b-4328-8e7d-df5ea1cb4e68 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.292900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabff85d-a2b4-4749-9ab3-f15a70144d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.293779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabff85d-a2b4-4749-9ab3-f15a70144d45 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.294322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabff85d-a2b4-4749-9ab3-f15a70144d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.294759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabff85d-a2b4-4749-9ab3-f15a70144d45 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.296325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabff85d-a2b4-4749-9ab3-f15a70144d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.301302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabff85d-a2b4-4749-9ab3-f15a70144d45 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.311239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2191/4402] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:59 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:59.315045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798c20-a80b-4328-8e7d-df5ea1cb4e68 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.330719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798c20-a80b-4328-8e7d-df5ea1cb4e68 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.337891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1492da-5476-46f6-b1ae-4f99e3f9363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.339033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1492da-5476-46f6-b1ae-4f99e3f9363f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.339558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1492da-5476-46f6-b1ae-4f99e3f9363f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.340059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1492da-5476-46f6-b1ae-4f99e3f9363f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.341018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1492da-5476-46f6-b1ae-4f99e3f9363f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.343010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1492da-5476-46f6-b1ae-4f99e3f9363f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.343851 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2212/4403] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:00:59 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:00:59.348138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabff85d-a2b4-4749-9ab3-f15a70144d45 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.356565 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2192/4404] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:59.360219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1492da-5476-46f6-b1ae-4f99e3f9363f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.369655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabff85d-a2b4-4749-9ab3-f15a70144d45 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.372385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1492da-5476-46f6-b1ae-4f99e3f9363f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.378030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1021e3-661b-4876-b91b-92413ac8fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.378890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1021e3-661b-4876-b91b-92413ac8fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.379594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1021e3-661b-4876-b91b-92413ac8fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.380098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1021e3-661b-4876-b91b-92413ac8fbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.381001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1021e3-661b-4876-b91b-92413ac8fbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.381667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d784c0-775a-49c9-a2cf-471c3cf90d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.383707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d784c0-775a-49c9-a2cf-471c3cf90d39 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.384071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d784c0-775a-49c9-a2cf-471c3cf90d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.384440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d784c0-775a-49c9-a2cf-471c3cf90d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.384906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1021e3-661b-4876-b91b-92413ac8fbc7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.387008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d784c0-775a-49c9-a2cf-471c3cf90d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.389696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d784c0-775a-49c9-a2cf-471c3cf90d39 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.400994 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2193/4405] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:00:59.404884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1021e3-661b-4876-b91b-92413ac8fbc7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.418161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1021e3-661b-4876-b91b-92413ac8fbc7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.422031 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2213/4406] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:59.423958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d784c0-775a-49c9-a2cf-471c3cf90d39 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.425494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10ba1c-b5b4-4c41-93d1-a9516229f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.426223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10ba1c-b5b4-4c41-93d1-a9516229f080 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.426740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10ba1c-b5b4-4c41-93d1-a9516229f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.427200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10ba1c-b5b4-4c41-93d1-a9516229f080 admin admin] PATH_INFO: `/v3/projects/58b0d66fb5304e7ba517c2f714a7ccac/users/e3d4cc70eeca421585fabdb682af7caf/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.445067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10ba1c-b5b4-4c41-93d1-a9516229f080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b0d66fb5304e7ba517c2f714a7ccac, user_id=e3d4cc70eeca421585fabdb682af7caf, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.448223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10ba1c-b5b4-4c41-93d1-a9516229f080 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.460308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d784c0-775a-49c9-a2cf-471c3cf90d39 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.467510 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2194/4407] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:59 2022] PUT /identity/v3/projects/58b0d66fb5304e7ba517c2f714a7ccac/users/e3d4cc70eeca421585fabdb682af7caf/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:00:59.480338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c50b95-d25d-4bee-90b4-c934505a29b4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.481232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c50b95-d25d-4bee-90b4-c934505a29b4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.482282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c50b95-d25d-4bee-90b4-c934505a29b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.530260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c6c50b95-d25d-4bee-90b4-c934505a29b4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:59.531442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c6c50b95-d25d-4bee-90b4-c934505a29b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:59.588077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1539fc9-3dce-422e-8706-f1a29784f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.588854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1539fc9-3dce-422e-8706-f1a29784f5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.589164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1539fc9-3dce-422e-8706-f1a29784f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.589445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1539fc9-3dce-422e-8706-f1a29784f5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.590098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1539fc9-3dce-422e-8706-f1a29784f5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.591709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1539fc9-3dce-422e-8706-f1a29784f5a5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.621067 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2214/4408] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:00:59.622117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1539fc9-3dce-422e-8706-f1a29784f5a5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.635521 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2195/4409] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:00:59.637180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c50b95-d25d-4bee-90b4-c934505a29b4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:00:59.639200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c6c50b95-d25d-4bee-90b4-c934505a29b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:59.643722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1539fc9-3dce-422e-8706-f1a29784f5a5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.657361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093637e-9643-4b46-a768-3dbe57daecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.658482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093637e-9643-4b46-a768-3dbe57daecad admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.659360 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:59.661757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093637e-9643-4b46-a768-3dbe57daecad admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.662458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093637e-9643-4b46-a768-3dbe57daecad admin admin] PATH_INFO: `/v3/projects/f3c0dfca5fe042279ece87823a090ee4/users/630979f0452244e8a6b0073b71e5ae82/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.696355 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:59.709617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093637e-9643-4b46-a768-3dbe57daecad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c0dfca5fe042279ece87823a090ee4, user_id=630979f0452244e8a6b0073b71e5ae82, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:00:59.716861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093637e-9643-4b46-a768-3dbe57daecad admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:00:59.734368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c50b95-d25d-4bee-90b4-c934505a29b4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:00:59.745909 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2215/4410] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:00:59 2022] PUT /identity/v3/projects/f3c0dfca5fe042279ece87823a090ee4/users/630979f0452244e8a6b0073b71e5ae82/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:00:59.759513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd636-f42f-4086-bd9e-072b930f8659 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.761458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd636-f42f-4086-bd9e-072b930f8659 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.761940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd636-f42f-4086-bd9e-072b930f8659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:00:59.830187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aeffd636-f42f-4086-bd9e-072b930f8659 None None] MFA Rules not processed for user `630979f0452244e8a6b0073b71e5ae82`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:00:59.834435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aeffd636-f42f-4086-bd9e-072b930f8659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:00:59.938986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7abda2-bd8a-4f27-8474-251afd8d1b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:00:59.939773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7abda2-bd8a-4f27-8474-251afd8d1b42 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:00:59.939915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7abda2-bd8a-4f27-8474-251afd8d1b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:00:59.940161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7abda2-bd8a-4f27-8474-251afd8d1b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:00.087597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7abda2-bd8a-4f27-8474-251afd8d1b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:00.090587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7abda2-bd8a-4f27-8474-251afd8d1b42 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:00.124971 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2216/4411] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:00.135560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd636-f42f-4086-bd9e-072b930f8659 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:00.135560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aeffd636-f42f-4086-bd9e-072b930f8659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:00.135929 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2196/4412] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:01:00.204660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd636-f42f-4086-bd9e-072b930f8659 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:00.211295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b43db-4011-441f-9e82-6dcfbc15644b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:00.212942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b43db-4011-441f-9e82-6dcfbc15644b service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:00.213214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b43db-4011-441f-9e82-6dcfbc15644b service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:00.214148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b43db-4011-441f-9e82-6dcfbc15644b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:00.242829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b43db-4011-441f-9e82-6dcfbc15644b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:00.260184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b43db-4011-441f-9e82-6dcfbc15644b service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:00.277680 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2217/4413] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:01:01.602263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c0415-6696-4a88-80cb-e2eef01f498c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:01.602760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c0415-6696-4a88-80cb-e2eef01f498c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:01.602854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c0415-6696-4a88-80cb-e2eef01f498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:01.640783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-da7c0415-6696-4a88-80cb-e2eef01f498c None None] MFA Rules not processed for user `9ddb45b2dcf14263887a3718e23eb937`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:01.644293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da7c0415-6696-4a88-80cb-e2eef01f498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:01.773616 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2197/4414] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:02.267511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b43db-4011-441f-9e82-6dcfbc15644b service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:02.301004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b43db-4011-441f-9e82-6dcfbc15644b service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:02.318478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb43b0-6272-4222-81d9-2282bf3842e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:02.321910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb43b0-6272-4222-81d9-2282bf3842e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:02.322751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb43b0-6272-4222-81d9-2282bf3842e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:02.323460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb43b0-6272-4222-81d9-2282bf3842e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:02.337221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-29cb43b0-6272-4222-81d9-2282bf3842e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:02.355749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb43b0-6272-4222-81d9-2282bf3842e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:02.357836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb43b0-6272-4222-81d9-2282bf3842e9 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:02.370603 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2218/4415] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:01:11.619081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c0415-6696-4a88-80cb-e2eef01f498c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:11.637678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c0415-6696-4a88-80cb-e2eef01f498c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:11.662217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:11.663041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:11.663427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:11.663803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] PATH_INFO: `/v3/users/630979f0452244e8a6b0073b71e5ae82` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:11.665295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=630979f0452244e8a6b0073b71e5ae82)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:11.677342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:11.714159 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:11.813161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630979f0452244e8a6b0073b71e5ae82'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:11.882604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630979f0452244e8a6b0073b71e5ae82'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:11.924827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630979f0452244e8a6b0073b71e5ae82'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:11.955937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630979f0452244e8a6b0073b71e5ae82'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:11.956874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630979f0452244e8a6b0073b71e5ae82'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:11.967119 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2198/4416] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:11 2022] DELETE /identity/v3/users/630979f0452244e8a6b0073b71e5ae82 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:11.971365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a728-48e9-4079-bb7b-bb9bb8336d05 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:11.971961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a728-48e9-4079-bb7b-bb9bb8336d05 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:11.972164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a728-48e9-4079-bb7b-bb9bb8336d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:12.015101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7d70a728-48e9-4079-bb7b-bb9bb8336d05 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:12.016402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d70a728-48e9-4079-bb7b-bb9bb8336d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:12.348119 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2219/4417] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:12.394008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:12.396124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:12.637955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa80db9-df0b-4507-acc4-fbf037df7afa admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:12.659090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7621e-4e3b-4fd1-ab59-7ae033898eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:12.659927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7621e-4e3b-4fd1-ab59-7ae033898eec service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:12.660210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7621e-4e3b-4fd1-ab59-7ae033898eec service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:12.660542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7621e-4e3b-4fd1-ab59-7ae033898eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:12.694464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7621e-4e3b-4fd1-ab59-7ae033898eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:12.695988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7621e-4e3b-4fd1-ab59-7ae033898eec service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:12.733861 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2199/4418] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:01:14.349681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70a728-48e9-4079-bb7b-bb9bb8336d05 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:14.351219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d70a728-48e9-4079-bb7b-bb9bb8336d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:14.370895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70a728-48e9-4079-bb7b-bb9bb8336d05 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:14.382260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:14.382952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:14.383232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:14.383512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] PATH_INFO: `/v3/projects/f3c0dfca5fe042279ece87823a090ee4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:14.384788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c0dfca5fe042279ece87823a090ee4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:14.386737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:14.402375 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:14.532721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c0dfca5fe042279ece87823a090ee4', 'request_id': 'req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:14.551682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c0dfca5fe042279ece87823a090ee4', 'request_id': 'req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:14.567889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c0dfca5fe042279ece87823a090ee4', 'request_id': 'req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:14.616366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] The token cache is being invalidate because project f3c0dfca5fe042279ece87823a090ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:14.616791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:14.618529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9fd3d6a-ebfa-4902-9ffa-0cf689061ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:14.621905 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2220/4419] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:14 2022] DELETE /identity/v3/projects/f3c0dfca5fe042279ece87823a090ee4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:14.626806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff584e-4aca-4872-a2fc-e09d7804ecad None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:14.627322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff584e-4aca-4872-a2fc-e09d7804ecad None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:14.627436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff584e-4aca-4872-a2fc-e09d7804ecad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:14.689001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b4ff584e-4aca-4872-a2fc-e09d7804ecad None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:14.693769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b4ff584e-4aca-4872-a2fc-e09d7804ecad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:14.887033 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2200/4420] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:14.897051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c337c-85b2-4837-b501-85f70ce4e45b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:14.897572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c337c-85b2-4837-b501-85f70ce4e45b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:14.897942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c337c-85b2-4837-b501-85f70ce4e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:14.943500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-862c337c-85b2-4837-b501-85f70ce4e45b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:14.948485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-862c337c-85b2-4837-b501-85f70ce4e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:14.962997 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2221/4421] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:14.967186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff584e-4aca-4872-a2fc-e09d7804ecad None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:14.982641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff584e-4aca-4872-a2fc-e09d7804ecad None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:15.010325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1588c-b568-406b-b53b-df5142a91215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:15.011131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1588c-b568-406b-b53b-df5142a91215 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:15.012049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1588c-b568-406b-b53b-df5142a91215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:15.012721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1588c-b568-406b-b53b-df5142a91215 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:15.013611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1588c-b568-406b-b53b-df5142a91215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:15.016327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1588c-b568-406b-b53b-df5142a91215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:15.018254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1588c-b568-406b-b53b-df5142a91215 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:15.049952 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2201/4422] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:15.063462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c337c-85b2-4837-b501-85f70ce4e45b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:15.076063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c337c-85b2-4837-b501-85f70ce4e45b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:15.081356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86d7ba-7999-4974-a947-139ef9a79227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:15.082916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86d7ba-7999-4974-a947-139ef9a79227 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:15.083422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86d7ba-7999-4974-a947-139ef9a79227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:15.083921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86d7ba-7999-4974-a947-139ef9a79227 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:15.084778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86d7ba-7999-4974-a947-139ef9a79227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:15.086918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86d7ba-7999-4974-a947-139ef9a79227 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:15.123819 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2222/4423] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:15 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:15.127927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1588c-b568-406b-b53b-df5142a91215 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:15.142034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1588c-b568-406b-b53b-df5142a91215 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:15.194364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95064e83-a861-4abc-b5ee-2791ff4c57b1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:15.194649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95064e83-a861-4abc-b5ee-2791ff4c57b1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:15.194925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95064e83-a861-4abc-b5ee-2791ff4c57b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:15.221170 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:15.234099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-95064e83-a861-4abc-b5ee-2791ff4c57b1 None None] MFA Rules not processed for user `e3d4cc70eeca421585fabdb682af7caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:15.235464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-95064e83-a861-4abc-b5ee-2791ff4c57b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:15.308984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9a03f-2d2e-4f61-af9b-0a9b442dad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:15.309604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9a03f-2d2e-4f61-af9b-0a9b442dad31 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:15.310092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9a03f-2d2e-4f61-af9b-0a9b442dad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:15.310555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9a03f-2d2e-4f61-af9b-0a9b442dad31 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:15.311759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9a03f-2d2e-4f61-af9b-0a9b442dad31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:15.314753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9a03f-2d2e-4f61-af9b-0a9b442dad31 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:15.360604 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2223/4424] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:15.375734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95064e83-a861-4abc-b5ee-2791ff4c57b1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:15.377569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-95064e83-a861-4abc-b5ee-2791ff4c57b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:15.379889 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2202/4425] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:01:15 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:15.384496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9a03f-2d2e-4f61-af9b-0a9b442dad31 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:15.415892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9a03f-2d2e-4f61-af9b-0a9b442dad31 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:15.431303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e37dd9-7166-4fee-8044-0eda99b9d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:15.431948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e37dd9-7166-4fee-8044-0eda99b9d385 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:15.432228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e37dd9-7166-4fee-8044-0eda99b9d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:15.432505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e37dd9-7166-4fee-8044-0eda99b9d385 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:15.433191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e37dd9-7166-4fee-8044-0eda99b9d385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:15.437262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e37dd9-7166-4fee-8044-0eda99b9d385 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:15.515537 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2203/4426] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:15.517050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e37dd9-7166-4fee-8044-0eda99b9d385 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:15.522855 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:15.549076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e37dd9-7166-4fee-8044-0eda99b9d385 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:15.556096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95064e83-a861-4abc-b5ee-2791ff4c57b1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:15.569428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34134da-b985-4dc4-accc-03c3e9b204f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:15.570006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34134da-b985-4dc4-accc-03c3e9b204f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:15.570303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34134da-b985-4dc4-accc-03c3e9b204f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:15.570722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34134da-b985-4dc4-accc-03c3e9b204f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:15.571727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34134da-b985-4dc4-accc-03c3e9b204f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:15.575276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34134da-b985-4dc4-accc-03c3e9b204f1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:15.591583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae1bd6-528c-4190-930d-df5ad8311756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:15.594178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae1bd6-528c-4190-930d-df5ad8311756 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:15.594738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae1bd6-528c-4190-930d-df5ad8311756 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:15.596594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae1bd6-528c-4190-930d-df5ad8311756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:15.603380 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2204/4427] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:15.606859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34134da-b985-4dc4-accc-03c3e9b204f1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:15.627216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34134da-b985-4dc4-accc-03c3e9b204f1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:15.628683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae1bd6-528c-4190-930d-df5ad8311756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:15.634685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae1bd6-528c-4190-930d-df5ad8311756 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:15.642664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbcaac-70e9-477c-9369-3285c78087d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:15.643360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbcaac-70e9-477c-9369-3285c78087d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:15.643636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbcaac-70e9-477c-9369-3285c78087d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:15.643907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbcaac-70e9-477c-9369-3285c78087d9 admin admin] PATH_INFO: `/v3/projects/ac2546ccf89145aa87a9fc9231a2a7e6/users/b67c81c105654dac996312942d5f9ce5/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:15.660878 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2224/4428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:01:15.706778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbcaac-70e9-477c-9369-3285c78087d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2546ccf89145aa87a9fc9231a2a7e6, user_id=b67c81c105654dac996312942d5f9ce5, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:15.711670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbcaac-70e9-477c-9369-3285c78087d9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:15.744926 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2205/4429] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:15 2022] PUT /identity/v3/projects/ac2546ccf89145aa87a9fc9231a2a7e6/users/b67c81c105654dac996312942d5f9ce5/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:15.755335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b2e3-32c0-40ce-8ed6-0d86c6a1cfdd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:15.755785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b2e3-32c0-40ce-8ed6-0d86c6a1cfdd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:15.756174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b2e3-32c0-40ce-8ed6-0d86c6a1cfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:15.848305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2c15b2e3-32c0-40ce-8ed6-0d86c6a1cfdd None None] MFA Rules not processed for user `b67c81c105654dac996312942d5f9ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:15.863420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2c15b2e3-32c0-40ce-8ed6-0d86c6a1cfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:16.054294 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2225/4430] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:16.074338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbcaac-70e9-477c-9369-3285c78087d9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:16.076536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5fcbcaac-70e9-477c-9369-3285c78087d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:16.229410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbcaac-70e9-477c-9369-3285c78087d9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:16.241951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d560a8-5232-4e70-b637-4cc075014cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:16.242864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d560a8-5232-4e70-b637-4cc075014cec service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:16.243322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d560a8-5232-4e70-b637-4cc075014cec service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:16.244003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d560a8-5232-4e70-b637-4cc075014cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:16.264430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d560a8-5232-4e70-b637-4cc075014cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:16.267930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d560a8-5232-4e70-b637-4cc075014cec service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:16.296017 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2206/4431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:01:18.265831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15b2e3-32c0-40ce-8ed6-0d86c6a1cfdd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:18.267349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2c15b2e3-32c0-40ce-8ed6-0d86c6a1cfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:18.481327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15b2e3-32c0-40ce-8ed6-0d86c6a1cfdd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:18.492218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:18.493117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:18.493500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:18.494531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] PATH_INFO: `/v3/users/6d8de036391d4f91865e6810c91937b3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:18.498488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8de036391d4f91865e6810c91937b3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:18.500555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:18.675450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8de036391d4f91865e6810c91937b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:18.787585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8de036391d4f91865e6810c91937b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:18.794867 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:18.804601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8de036391d4f91865e6810c91937b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:18.828765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8de036391d4f91865e6810c91937b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:18.830929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8de036391d4f91865e6810c91937b3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:18.843523 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2226/4432] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:18 2022] DELETE /identity/v3/users/6d8de036391d4f91865e6810c91937b3 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:18.849814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a64488-0d47-48d8-a340-a92329d6c979 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:18.850928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a64488-0d47-48d8-a340-a92329d6c979 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:18.852034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a64488-0d47-48d8-a340-a92329d6c979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:18.902828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-55a64488-0d47-48d8-a340-a92329d6c979 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:18.904520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-55a64488-0d47-48d8-a340-a92329d6c979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:19.138428 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2207/4433] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:19.181594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:19.182948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:19.344074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3b71b-6b1a-4f0a-bb49-6e4c7141f1f9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:19.351177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa4130-fe4d-43a9-9df1-e9341478b85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:19.351812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa4130-fe4d-43a9-9df1-e9341478b85a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:19.352455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa4130-fe4d-43a9-9df1-e9341478b85a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:19.353215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa4130-fe4d-43a9-9df1-e9341478b85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:19.363846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa4130-fe4d-43a9-9df1-e9341478b85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:19.365626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa4130-fe4d-43a9-9df1-e9341478b85a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:19.379297 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2227/4434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:01:19.436509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15bc44-fb7f-4dd2-afe3-d6ff77455938 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:19.437066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15bc44-fb7f-4dd2-afe3-d6ff77455938 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:19.437501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15bc44-fb7f-4dd2-afe3-d6ff77455938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:19.487828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-da15bc44-fb7f-4dd2-afe3-d6ff77455938 None None] MFA Rules not processed for user `b67c81c105654dac996312942d5f9ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:19.489570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da15bc44-fb7f-4dd2-afe3-d6ff77455938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:19.502641 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:19.645991 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2208/4435] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:20.539751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca278c5-be4f-409c-875d-94521b382592 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:20.539751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca278c5-be4f-409c-875d-94521b382592 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:20.539751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca278c5-be4f-409c-875d-94521b382592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:20.581234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dca278c5-be4f-409c-875d-94521b382592 None None] MFA Rules not processed for user `e3d4cc70eeca421585fabdb682af7caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:20.582910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dca278c5-be4f-409c-875d-94521b382592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:20.590854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15bc44-fb7f-4dd2-afe3-d6ff77455938 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:20.592382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da15bc44-fb7f-4dd2-afe3-d6ff77455938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:20.618191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15bc44-fb7f-4dd2-afe3-d6ff77455938 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:20.633538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:20.634732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:20.635205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:20.635690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] PATH_INFO: `/v3/projects/77d9e3bc97b04b3da34be56965ef38fe` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:20.640430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d9e3bc97b04b3da34be56965ef38fe)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:20.642961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:20.736552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d9e3bc97b04b3da34be56965ef38fe', 'request_id': 'req-073650f1-3d27-4141-b32c-84e79443f774'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:20.751669 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2228/4436] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:20.757763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d9e3bc97b04b3da34be56965ef38fe', 'request_id': 'req-073650f1-3d27-4141-b32c-84e79443f774'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:20.794925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d9e3bc97b04b3da34be56965ef38fe', 'request_id': 'req-073650f1-3d27-4141-b32c-84e79443f774'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:20.820477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] The token cache is being invalidate because project 77d9e3bc97b04b3da34be56965ef38fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:20.820794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:20.825768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-073650f1-3d27-4141-b32c-84e79443f774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:20.827948 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2209/4437] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:20 2022] DELETE /identity/v3/projects/77d9e3bc97b04b3da34be56965ef38fe => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:20.836119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b51dc7-c6ea-491e-9fba-0ba7cef4411f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:20.836425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b51dc7-c6ea-491e-9fba-0ba7cef4411f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:20.836721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b51dc7-c6ea-491e-9fba-0ba7cef4411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:20.887078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-80b51dc7-c6ea-491e-9fba-0ba7cef4411f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:20.889391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-80b51dc7-c6ea-491e-9fba-0ba7cef4411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:21.011040 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2229/4438] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:21.026963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdce40e-f63b-46f8-9347-a64737538c4d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:21.027250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdce40e-f63b-46f8-9347-a64737538c4d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:21.027522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdce40e-f63b-46f8-9347-a64737538c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:21.092751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8cdce40e-f63b-46f8-9347-a64737538c4d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:21.104640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8cdce40e-f63b-46f8-9347-a64737538c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:21.133701 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2210/4439] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:21.138107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b51dc7-c6ea-491e-9fba-0ba7cef4411f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:21.151171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b51dc7-c6ea-491e-9fba-0ba7cef4411f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:21.173054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1472f-3fe6-497b-aa81-11a577c1e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:21.173696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1472f-3fe6-497b-aa81-11a577c1e475 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:21.173980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1472f-3fe6-497b-aa81-11a577c1e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:21.174256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1472f-3fe6-497b-aa81-11a577c1e475 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:21.174914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1472f-3fe6-497b-aa81-11a577c1e475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:21.177086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1472f-3fe6-497b-aa81-11a577c1e475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:21.183207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1472f-3fe6-497b-aa81-11a577c1e475 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:21.209870 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2230/4440] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:21.214517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdce40e-f63b-46f8-9347-a64737538c4d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:21.227168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdce40e-f63b-46f8-9347-a64737538c4d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:21.243505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29285ae8-66e9-4613-a94b-3e56360e5eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:21.244714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285ae8-66e9-4613-a94b-3e56360e5eea admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:21.245377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285ae8-66e9-4613-a94b-3e56360e5eea admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:21.247084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285ae8-66e9-4613-a94b-3e56360e5eea admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:21.249132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29285ae8-66e9-4613-a94b-3e56360e5eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:21.254727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29285ae8-66e9-4613-a94b-3e56360e5eea admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:21.311343 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2211/4441] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:21 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:21.315767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1472f-3fe6-497b-aa81-11a577c1e475 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:21.339010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1472f-3fe6-497b-aa81-11a577c1e475 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:21.402272 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:21.508355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3808e52-3980-490a-9186-f6ae274e5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:21.510089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3808e52-3980-490a-9186-f6ae274e5f74 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:21.510922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3808e52-3980-490a-9186-f6ae274e5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:21.511211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3808e52-3980-490a-9186-f6ae274e5f74 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:21.512759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3808e52-3980-490a-9186-f6ae274e5f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:21.518701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3808e52-3980-490a-9186-f6ae274e5f74 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:21.572830 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2231/4442] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:01:21 2022] POST /identity/v3/users => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:21.577714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29285ae8-66e9-4613-a94b-3e56360e5eea admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:21.591012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29285ae8-66e9-4613-a94b-3e56360e5eea admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:21.613910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99454c-09af-425a-8fe5-8a197a9de8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:21.617319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99454c-09af-425a-8fe5-8a197a9de8fe admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:21.618140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99454c-09af-425a-8fe5-8a197a9de8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:21.620672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99454c-09af-425a-8fe5-8a197a9de8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:21.621629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99454c-09af-425a-8fe5-8a197a9de8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:21.623457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99454c-09af-425a-8fe5-8a197a9de8fe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:21.656317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798c54-2d08-465e-98d4-f5fb4e95eec8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:21.656881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798c54-2d08-465e-98d4-f5fb4e95eec8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:21.657343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798c54-2d08-465e-98d4-f5fb4e95eec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:21.657496 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2212/4443] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:01:21.658527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99454c-09af-425a-8fe5-8a197a9de8fe admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:21.702415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-06798c54-2d08-465e-98d4-f5fb4e95eec8 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:21.702980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99454c-09af-425a-8fe5-8a197a9de8fe admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:21.703666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-06798c54-2d08-465e-98d4-f5fb4e95eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:21.716523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa4cb0-7de8-4701-8c96-a842c58a14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:21.719207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa4cb0-7de8-4701-8c96-a842c58a14a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:21.720930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa4cb0-7de8-4701-8c96-a842c58a14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:21.723411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa4cb0-7de8-4701-8c96-a842c58a14a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:21.724551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa4cb0-7de8-4701-8c96-a842c58a14a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:21.727464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa4cb0-7de8-4701-8c96-a842c58a14a4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:21.758896 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2213/4444] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:21.761085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa4cb0-7de8-4701-8c96-a842c58a14a4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:21.788128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa4cb0-7de8-4701-8c96-a842c58a14a4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:21.803811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa68cd3-a1c5-4a38-bc2b-128bfba996db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:21.804954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa68cd3-a1c5-4a38-bc2b-128bfba996db admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:21.805781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa68cd3-a1c5-4a38-bc2b-128bfba996db admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:21.806755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa68cd3-a1c5-4a38-bc2b-128bfba996db admin admin] PATH_INFO: `/v3/projects/e39f22f17fda494eb5689e0f0de0fd3f/users/0050ebab36c64b3d921d029137f9aa12/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:21.840554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa68cd3-a1c5-4a38-bc2b-128bfba996db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39f22f17fda494eb5689e0f0de0fd3f, user_id=0050ebab36c64b3d921d029137f9aa12, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:21.847005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa68cd3-a1c5-4a38-bc2b-128bfba996db admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:21.850474 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2232/4445] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:21.874755 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2214/4446] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:21 2022] PUT /identity/v3/projects/e39f22f17fda494eb5689e0f0de0fd3f/users/0050ebab36c64b3d921d029137f9aa12/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:21.884047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798c54-2d08-465e-98d4-f5fb4e95eec8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:21.884047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-06798c54-2d08-465e-98d4-f5fb4e95eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:21.891136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0801ee8-edcb-4517-9a4e-83ba1e7abc2a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:21.891422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0801ee8-edcb-4517-9a4e-83ba1e7abc2a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:21.896970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0801ee8-edcb-4517-9a4e-83ba1e7abc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:22.007041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c0801ee8-edcb-4517-9a4e-83ba1e7abc2a None None] MFA Rules not processed for user `0050ebab36c64b3d921d029137f9aa12`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:22.008597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c0801ee8-edcb-4517-9a4e-83ba1e7abc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:22.033118 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:22.132254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798c54-2d08-465e-98d4-f5fb4e95eec8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:22.243744 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2215/4447] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:21 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:22.273970 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:22.285698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba83f49-c4fb-4720-9530-a6fc60f62586 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:22.286935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba83f49-c4fb-4720-9530-a6fc60f62586 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:22.287556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba83f49-c4fb-4720-9530-a6fc60f62586 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:22.287983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba83f49-c4fb-4720-9530-a6fc60f62586 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:22.508047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba83f49-c4fb-4720-9530-a6fc60f62586 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:22.510238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba83f49-c4fb-4720-9530-a6fc60f62586 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:22.521328 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2233/4448] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:01:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:01:23.063979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0801ee8-edcb-4517-9a4e-83ba1e7abc2a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:23.227879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0801ee8-edcb-4517-9a4e-83ba1e7abc2a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:23.239277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:23.240069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:23.240357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:23.240647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] PATH_INFO: `/v3/users/0050ebab36c64b3d921d029137f9aa12` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:23.245748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0050ebab36c64b3d921d029137f9aa12)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:23.252726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:23.390391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0050ebab36c64b3d921d029137f9aa12'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:23.439738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0050ebab36c64b3d921d029137f9aa12'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:23.517655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0050ebab36c64b3d921d029137f9aa12'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:23.553655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0050ebab36c64b3d921d029137f9aa12'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:23.554497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0050ebab36c64b3d921d029137f9aa12'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:23.572907 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2216/4449] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:23 2022] DELETE /identity/v3/users/0050ebab36c64b3d921d029137f9aa12 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:23.574907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52865781-c9a3-48a0-a505-c108e8df2695 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:23.575782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52865781-c9a3-48a0-a505-c108e8df2695 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:23.576242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52865781-c9a3-48a0-a505-c108e8df2695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:23.632366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-52865781-c9a3-48a0-a505-c108e8df2695 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:23.634033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-52865781-c9a3-48a0-a505-c108e8df2695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:23.794708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2234/4450] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:23.818633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:23.820330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:23.932838 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:24.017207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53d09d-e583-4b45-82e1-787b5d40a3fe admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:24.028271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6654641-ad08-4d2c-acdf-70e66716534c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:24.029326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654641-ad08-4d2c-acdf-70e66716534c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:24.029620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654641-ad08-4d2c-acdf-70e66716534c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:24.029899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654641-ad08-4d2c-acdf-70e66716534c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:24.065698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6654641-ad08-4d2c-acdf-70e66716534c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:24.070788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6654641-ad08-4d2c-acdf-70e66716534c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:24.107246 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2217/4451] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:01:25.730809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52865781-c9a3-48a0-a505-c108e8df2695 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:25.732834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-52865781-c9a3-48a0-a505-c108e8df2695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:25.756936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52865781-c9a3-48a0-a505-c108e8df2695 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:25.773780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:25.774461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:25.774750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:25.775026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] PATH_INFO: `/v3/projects/e39f22f17fda494eb5689e0f0de0fd3f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:25.777069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39f22f17fda494eb5689e0f0de0fd3f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:25.779223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:25.935869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39f22f17fda494eb5689e0f0de0fd3f', 'request_id': 'req-f6926b4e-2468-445a-949d-76c6af101006'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:25.958395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39f22f17fda494eb5689e0f0de0fd3f', 'request_id': 'req-f6926b4e-2468-445a-949d-76c6af101006'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:25.991405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39f22f17fda494eb5689e0f0de0fd3f', 'request_id': 'req-f6926b4e-2468-445a-949d-76c6af101006'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:26.012259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] The token cache is being invalidate because project e39f22f17fda494eb5689e0f0de0fd3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:26.012862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:26.013942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6926b4e-2468-445a-949d-76c6af101006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:26.022245 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2235/4452] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:25 2022] DELETE /identity/v3/projects/e39f22f17fda494eb5689e0f0de0fd3f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:26.025375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead8d6-f24b-4003-b36c-8b8688ba6aa8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:26.025894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead8d6-f24b-4003-b36c-8b8688ba6aa8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:26.026176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead8d6-f24b-4003-b36c-8b8688ba6aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:26.060037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f3ead8d6-f24b-4003-b36c-8b8688ba6aa8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:26.062155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f3ead8d6-f24b-4003-b36c-8b8688ba6aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:26.169942 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2218/4453] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:26.178479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ccef1-1d4f-4f46-a745-b69a2071c26c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:26.178479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ccef1-1d4f-4f46-a745-b69a2071c26c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:26.178479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ccef1-1d4f-4f46-a745-b69a2071c26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:26.216970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c18ccef1-1d4f-4f46-a745-b69a2071c26c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:26.220460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c18ccef1-1d4f-4f46-a745-b69a2071c26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:26.237768 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2236/4454] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:26.243080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ead8d6-f24b-4003-b36c-8b8688ba6aa8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:26.262417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ead8d6-f24b-4003-b36c-8b8688ba6aa8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:26.267661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85403be9-add5-42ac-8794-e802b78d9745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:26.268608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85403be9-add5-42ac-8794-e802b78d9745 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:26.271415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85403be9-add5-42ac-8794-e802b78d9745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:26.271946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85403be9-add5-42ac-8794-e802b78d9745 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:26.273879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85403be9-add5-42ac-8794-e802b78d9745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:26.274410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85403be9-add5-42ac-8794-e802b78d9745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:26.277192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85403be9-add5-42ac-8794-e802b78d9745 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:26.294266 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2219/4455] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:26.298254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ccef1-1d4f-4f46-a745-b69a2071c26c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:26.320699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ccef1-1d4f-4f46-a745-b69a2071c26c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:26.336876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8c818-fb6d-4eff-bc9f-845754f11754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:26.337770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8c818-fb6d-4eff-bc9f-845754f11754 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:26.338120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8c818-fb6d-4eff-bc9f-845754f11754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:26.338462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8c818-fb6d-4eff-bc9f-845754f11754 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:26.339246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8c818-fb6d-4eff-bc9f-845754f11754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:26.341542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8c818-fb6d-4eff-bc9f-845754f11754 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:26.398501 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:26.442698 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2237/4456] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:26 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:01:26.446521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85403be9-add5-42ac-8794-e802b78d9745 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:26.460804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85403be9-add5-42ac-8794-e802b78d9745 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:26.617556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2618a7-40be-4d3e-a13d-97e4fbfd9692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:26.622428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2618a7-40be-4d3e-a13d-97e4fbfd9692 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:26.622811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2618a7-40be-4d3e-a13d-97e4fbfd9692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:26.623051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2618a7-40be-4d3e-a13d-97e4fbfd9692 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:26.623773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2618a7-40be-4d3e-a13d-97e4fbfd9692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:26.633982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2618a7-40be-4d3e-a13d-97e4fbfd9692 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:26.711966 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2220/4457] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:01:26 2022] POST /identity/v3/users => generated 295 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:26.716133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8c818-fb6d-4eff-bc9f-845754f11754 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:26.753807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8c818-fb6d-4eff-bc9f-845754f11754 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:26.759015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c41302-b831-4822-9cfe-1a383d831031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:26.759818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41302-b831-4822-9cfe-1a383d831031 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:26.760105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41302-b831-4822-9cfe-1a383d831031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:26.760382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41302-b831-4822-9cfe-1a383d831031 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:26.761374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c41302-b831-4822-9cfe-1a383d831031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:26.762978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c41302-b831-4822-9cfe-1a383d831031 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:26.784119 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2238/4458] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:26.789421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2618a7-40be-4d3e-a13d-97e4fbfd9692 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:26.803332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2618a7-40be-4d3e-a13d-97e4fbfd9692 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:26.809468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06834b2-db8f-478e-b41b-52b15833cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:26.810226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06834b2-db8f-478e-b41b-52b15833cd0f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:26.810703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06834b2-db8f-478e-b41b-52b15833cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:26.811078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06834b2-db8f-478e-b41b-52b15833cd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:26.811984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06834b2-db8f-478e-b41b-52b15833cd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:26.813839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06834b2-db8f-478e-b41b-52b15833cd0f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:26.832830 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2221/4459] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:26.839883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c41302-b831-4822-9cfe-1a383d831031 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:26.864296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c41302-b831-4822-9cfe-1a383d831031 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:26.885425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f226e-3b53-4c9b-bd9e-1fdcb8f937bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:26.886128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f226e-3b53-4c9b-bd9e-1fdcb8f937bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:26.886406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f226e-3b53-4c9b-bd9e-1fdcb8f937bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:26.886690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f226e-3b53-4c9b-bd9e-1fdcb8f937bc admin admin] PATH_INFO: `/v3/projects/fa6f2c0ec5924bc6b2d91b9f884a28fb/users/cdd6f9b5d6724755831072ffefbeca20/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:26.919914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f226e-3b53-4c9b-bd9e-1fdcb8f937bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6f2c0ec5924bc6b2d91b9f884a28fb, user_id=cdd6f9b5d6724755831072ffefbeca20, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:26.922658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f226e-3b53-4c9b-bd9e-1fdcb8f937bc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:26.949870 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2239/4460] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:26 2022] PUT /identity/v3/projects/fa6f2c0ec5924bc6b2d91b9f884a28fb/users/cdd6f9b5d6724755831072ffefbeca20/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:26.961747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca73a8a-14c1-4448-b63e-862ea1245ee1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:26.962593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca73a8a-14c1-4448-b63e-862ea1245ee1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:26.963446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca73a8a-14c1-4448-b63e-862ea1245ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:27.080547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0ca73a8a-14c1-4448-b63e-862ea1245ee1 None None] MFA Rules not processed for user `cdd6f9b5d6724755831072ffefbeca20`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:27.083065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0ca73a8a-14c1-4448-b63e-862ea1245ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:27.168141 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:27.232641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f226e-3b53-4c9b-bd9e-1fdcb8f937bc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:27.234440 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2222/4461] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:27.396710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f226e-3b53-4c9b-bd9e-1fdcb8f937bc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:27.416671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2527f-cb38-4a8d-bb8d-f6c44aff904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:27.417316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2527f-cb38-4a8d-bb8d-f6c44aff904c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:27.417598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2527f-cb38-4a8d-bb8d-f6c44aff904c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:27.417901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2527f-cb38-4a8d-bb8d-f6c44aff904c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:27.418594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2527f-cb38-4a8d-bb8d-f6c44aff904c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:27.420725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2527f-cb38-4a8d-bb8d-f6c44aff904c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:27.494015 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2240/4462] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:27 2022] POST /identity/v3/projects => generated 389 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:27.499874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca73a8a-14c1-4448-b63e-862ea1245ee1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:27.522000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca73a8a-14c1-4448-b63e-862ea1245ee1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:27.624737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cf00c-1396-41e0-87d2-15c3087fbaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:27.625720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf00c-1396-41e0-87d2-15c3087fbaca admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:27.626113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf00c-1396-41e0-87d2-15c3087fbaca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:27.626520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf00c-1396-41e0-87d2-15c3087fbaca admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:27.627279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cf00c-1396-41e0-87d2-15c3087fbaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:27.631131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cf00c-1396-41e0-87d2-15c3087fbaca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:27.712805 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2223/4463] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:01:27 2022] POST /identity/v3/users => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:27.713329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2527f-cb38-4a8d-bb8d-f6c44aff904c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:27.727640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2527f-cb38-4a8d-bb8d-f6c44aff904c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:27.735814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4840a46-b8f7-4793-9139-50776ceb072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:27.736244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4840a46-b8f7-4793-9139-50776ceb072e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:27.736600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4840a46-b8f7-4793-9139-50776ceb072e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:27.736906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4840a46-b8f7-4793-9139-50776ceb072e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:27.737600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4840a46-b8f7-4793-9139-50776ceb072e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:27.739417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4840a46-b8f7-4793-9139-50776ceb072e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:27.767811 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2241/4464] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:01:27.772901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cf00c-1396-41e0-87d2-15c3087fbaca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:27.808473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cf00c-1396-41e0-87d2-15c3087fbaca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:27.828350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7a8e-6fba-4410-86a6-70b924cdc23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:27.829121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7a8e-6fba-4410-86a6-70b924cdc23e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:27.829404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7a8e-6fba-4410-86a6-70b924cdc23e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:27.830301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7a8e-6fba-4410-86a6-70b924cdc23e admin admin] PATH_INFO: `/v3/projects/075769e958c34e8bb1524a8b6e9c273d/users/5c440c4af20d40769ff2dfa6d8852e12/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:27.872786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7a8e-6fba-4410-86a6-70b924cdc23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=075769e958c34e8bb1524a8b6e9c273d, user_id=5c440c4af20d40769ff2dfa6d8852e12, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:27.876957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7a8e-6fba-4410-86a6-70b924cdc23e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:27.920524 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2224/4465] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:27 2022] PUT /identity/v3/projects/075769e958c34e8bb1524a8b6e9c273d/users/5c440c4af20d40769ff2dfa6d8852e12/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:27.920914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4840a46-b8f7-4793-9139-50776ceb072e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:27.937146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4840a46-b8f7-4793-9139-50776ceb072e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:28.070572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944f89-247c-429a-b39a-86a14c0405b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:28.072104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944f89-247c-429a-b39a-86a14c0405b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:28.072683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944f89-247c-429a-b39a-86a14c0405b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:28.073069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944f89-247c-429a-b39a-86a14c0405b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:28.074095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944f89-247c-429a-b39a-86a14c0405b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:28.076506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944f89-247c-429a-b39a-86a14c0405b1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:28.095826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7a8e-6fba-4410-86a6-70b924cdc23e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:28.110293 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2242/4466] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:28.110722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7a8e-6fba-4410-86a6-70b924cdc23e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:28.118664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcd6fe-2b6a-43e8-a40c-74df6640758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:28.119446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcd6fe-2b6a-43e8-a40c-74df6640758c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:28.119797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcd6fe-2b6a-43e8-a40c-74df6640758c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:28.123775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcd6fe-2b6a-43e8-a40c-74df6640758c admin admin] PATH_INFO: `/v3/projects/075769e958c34e8bb1524a8b6e9c273d/users/5c440c4af20d40769ff2dfa6d8852e12/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:28.131275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcd6fe-2b6a-43e8-a40c-74df6640758c admin admin] RBAC: Authorizing `identity:create_grant(project_id=075769e958c34e8bb1524a8b6e9c273d, user_id=5c440c4af20d40769ff2dfa6d8852e12, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:28.135607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcd6fe-2b6a-43e8-a40c-74df6640758c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:28.151679 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2225/4467] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:28 2022] PUT /identity/v3/projects/075769e958c34e8bb1524a8b6e9c273d/users/5c440c4af20d40769ff2dfa6d8852e12/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:28.165074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07c15e-f6f1-4751-bb5f-a1db954b7a53 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:28.165513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07c15e-f6f1-4751-bb5f-a1db954b7a53 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:28.165856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07c15e-f6f1-4751-bb5f-a1db954b7a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:28.206356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-db07c15e-f6f1-4751-bb5f-a1db954b7a53 None None] MFA Rules not processed for user `5c440c4af20d40769ff2dfa6d8852e12`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:28.208467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db07c15e-f6f1-4751-bb5f-a1db954b7a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:28.238644 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:28.346844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcd6fe-2b6a-43e8-a40c-74df6640758c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:28.362140 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2243/4468] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:28.369943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcd6fe-2b6a-43e8-a40c-74df6640758c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:28.377260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779669c-fb29-4066-98a0-21d051f333be tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:28.379199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779669c-fb29-4066-98a0-21d051f333be tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:28.393645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779669c-fb29-4066-98a0-21d051f333be tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:28.395821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779669c-fb29-4066-98a0-21d051f333be tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:28.397585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779669c-fb29-4066-98a0-21d051f333be tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:28.402584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779669c-fb29-4066-98a0-21d051f333be tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:28.447227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07c15e-f6f1-4751-bb5f-a1db954b7a53 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:28.460145 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2226/4469] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:01:28 2022] POST /identity/v3/domains => generated 277 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:28.461592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07c15e-f6f1-4751-bb5f-a1db954b7a53 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:28.626914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fc198-2c82-442d-af6b-b20e58f76cdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:28.627797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fc198-2c82-442d-af6b-b20e58f76cdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:28.628183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fc198-2c82-442d-af6b-b20e58f76cdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:28.630190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fc198-2c82-442d-af6b-b20e58f76cdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa/config` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:28.631908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fc198-2c82-442d-af6b-b20e58f76cdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=38c5a451e72540678f6037d7f743deaa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:28.633482 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-779fc198-2c82-442d-af6b-b20e58f76cdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:28.633482 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:28.633482 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:28.634255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fc198-2c82-442d-af6b-b20e58f76cdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:28.726635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779669c-fb29-4066-98a0-21d051f333be tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:28.734073 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2244/4470] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:01:28 2022] PUT /identity/v3/domains/38c5a451e72540678f6037d7f743deaa/config => generated 138 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:28.790743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779669c-fb29-4066-98a0-21d051f333be tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:28.797657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788dd8c-6f80-4358-975d-c4f099dbb403 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:28.798845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788dd8c-6f80-4358-975d-c4f099dbb403 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:28.799138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788dd8c-6f80-4358-975d-c4f099dbb403 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:28.799506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788dd8c-6f80-4358-975d-c4f099dbb403 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa/config/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:28.804886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788dd8c-6f80-4358-975d-c4f099dbb403 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=38c5a451e72540678f6037d7f743deaa, group=identity)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:28.805944 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-d788dd8c-6f80-4358-975d-c4f099dbb403 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:28.805944 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:28.805944 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:28.806872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788dd8c-6f80-4358-975d-c4f099dbb403 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:28.838485 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2227/4471] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:01:28 2022] GET /identity/v3/domains/38c5a451e72540678f6037d7f743deaa/config/identity => generated 45 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:28.909499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fc198-2c82-442d-af6b-b20e58f76cdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:28.942210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fc198-2c82-442d-af6b-b20e58f76cdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:28.950887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c4e4-8fec-4fa3-a455-bbe7226edb9d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:28.951860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c4e4-8fec-4fa3-a455-bbe7226edb9d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:28.952010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c4e4-8fec-4fa3-a455-bbe7226edb9d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:28.952281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c4e4-8fec-4fa3-a455-bbe7226edb9d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa/config/identity/driver` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:28.958859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51c4e4-8fec-4fa3-a455-bbe7226edb9d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=38c5a451e72540678f6037d7f743deaa, group=identity, option=driver)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:28.959906 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-df51c4e4-8fec-4fa3-a455-bbe7226edb9d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:28.959906 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:28.959906 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:28.962398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51c4e4-8fec-4fa3-a455-bbe7226edb9d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:28.976691 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2245/4472] 10.222.0.27 () {58 vars in 1296 bytes} [Wed Oct 19 01:01:28 2022] GET /identity/v3/domains/38c5a451e72540678f6037d7f743deaa/config/identity/driver => generated 31 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:28.980518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788dd8c-6f80-4358-975d-c4f099dbb403 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:28.997047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788dd8c-6f80-4358-975d-c4f099dbb403 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:29.016262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d67a-b074-4797-90c8-b4e24b683338 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:29.017542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d67a-b074-4797-90c8-b4e24b683338 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:29.019352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d67a-b074-4797-90c8-b4e24b683338 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:29.019985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d67a-b074-4797-90c8-b4e24b683338 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa/config/ldap` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:29.025807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8d67a-b074-4797-90c8-b4e24b683338 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=38c5a451e72540678f6037d7f743deaa, group=ldap)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:29.028246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8d67a-b074-4797-90c8-b4e24b683338 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:29.043030 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2228/4473] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 01:01:28 2022] GET /identity/v3/domains/38c5a451e72540678f6037d7f743deaa/config/ldap => generated 106 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:29.044344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c4e4-8fec-4fa3-a455-bbe7226edb9d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:29.063270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c4e4-8fec-4fa3-a455-bbe7226edb9d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:29.080002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae87b9-f6d5-4b64-abc5-e947915050f4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:29.080571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae87b9-f6d5-4b64-abc5-e947915050f4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:29.080887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae87b9-f6d5-4b64-abc5-e947915050f4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:29.081170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae87b9-f6d5-4b64-abc5-e947915050f4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa/config/ldap/url` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:29.082416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae87b9-f6d5-4b64-abc5-e947915050f4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=38c5a451e72540678f6037d7f743deaa, group=ldap, option=url)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:29.089905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae87b9-f6d5-4b64-abc5-e947915050f4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:29.102158 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2246/4474] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:01:29 2022] GET /identity/v3/domains/38c5a451e72540678f6037d7f743deaa/config/ldap/url => generated 46 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:29.107242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d67a-b074-4797-90c8-b4e24b683338 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:29.132473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d67a-b074-4797-90c8-b4e24b683338 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:29.150176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd580e9c-3ef9-4130-8a06-2f7c5ad4af14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:29.150866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580e9c-3ef9-4130-8a06-2f7c5ad4af14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:29.151156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580e9c-3ef9-4130-8a06-2f7c5ad4af14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:29.151432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580e9c-3ef9-4130-8a06-2f7c5ad4af14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa/config/ldap/user_tree_dn` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:29.152609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd580e9c-3ef9-4130-8a06-2f7c5ad4af14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=38c5a451e72540678f6037d7f743deaa, group=ldap, option=user_tree_dn)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:29.154278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd580e9c-3ef9-4130-8a06-2f7c5ad4af14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:29.183495 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2229/4475] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:01:29 2022] GET /identity/v3/domains/38c5a451e72540678f6037d7f743deaa/config/ldap/user_tree_dn => generated 63 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:29.184874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae87b9-f6d5-4b64-abc5-e947915050f4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:29.204498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae87b9-f6d5-4b64-abc5-e947915050f4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:29.211324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:29.212067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:29.212423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:29.215878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa/config` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:29.216728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=38c5a451e72540678f6037d7f743deaa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:29.225857 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:29.225857 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:29.225857 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:29.226788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:29.246156 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2247/4476] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:01:29 2022] DELETE /identity/v3/domains/38c5a451e72540678f6037d7f743deaa/config => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:29.250368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd580e9c-3ef9-4130-8a06-2f7c5ad4af14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:29.271433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd580e9c-3ef9-4130-8a06-2f7c5ad4af14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:29.287926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:29.288849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:29.289154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:29.289418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:29.290737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=38c5a451e72540678f6037d7f743deaa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:29.292380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:29.336602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '38c5a451e72540678f6037d7f743deaa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.337487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '38c5a451e72540678f6037d7f743deaa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.387135 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:29.391817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '38c5a451e72540678f6037d7f743deaa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.404234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '38c5a451e72540678f6037d7f743deaa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.413600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:29.416895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:29.431357 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2230/4477] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:01:29 2022] PATCH /identity/v3/domains/38c5a451e72540678f6037d7f743deaa => generated 278 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:29.438729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94239a0a-74da-4e89-b5bb-72361c73685d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:29.588369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:29.589067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:29.589355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:29.589640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:29.595318 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:29.623817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=38c5a451e72540678f6037d7f743deaa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:29.625416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:29.674796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '38c5a451e72540678f6037d7f743deaa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.702176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '38c5a451e72540678f6037d7f743deaa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.791337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c5a451e72540678f6037d7f743deaa', 'request_id': 'req-26f10703-dc05-45ba-b978-4bd6775b3d14'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.829397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c5a451e72540678f6037d7f743deaa', 'request_id': 'req-26f10703-dc05-45ba-b978-4bd6775b3d14'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.840411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c5a451e72540678f6037d7f743deaa', 'request_id': 'req-26f10703-dc05-45ba-b978-4bd6775b3d14'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.863447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] The token cache is being invalidate because project 38c5a451e72540678f6037d7f743deaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:29.864235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.865179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.888089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '38c5a451e72540678f6037d7f743deaa', 'request_id': 'req-26f10703-dc05-45ba-b978-4bd6775b3d14'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.892736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '38c5a451e72540678f6037d7f743deaa', 'request_id': 'req-26f10703-dc05-45ba-b978-4bd6775b3d14'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.894833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '38c5a451e72540678f6037d7f743deaa', 'request_id': 'req-26f10703-dc05-45ba-b978-4bd6775b3d14'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:29.907504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:29.920596 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2248/4478] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:29 2022] DELETE /identity/v3/domains/38c5a451e72540678f6037d7f743deaa => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:29.930100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b97985-79d6-4ae4-a4e5-37d57fcbd085 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:30.064543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3df0b-b3da-4407-8b2a-24ed3ad09ffe tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:30.065496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3df0b-b3da-4407-8b2a-24ed3ad09ffe tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:30.066369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3df0b-b3da-4407-8b2a-24ed3ad09ffe tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:30.066920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3df0b-b3da-4407-8b2a-24ed3ad09ffe tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:30.068276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3df0b-b3da-4407-8b2a-24ed3ad09ffe tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:30.070029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3df0b-b3da-4407-8b2a-24ed3ad09ffe tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:30.102551 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2231/4479] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:01:29 2022] POST /identity/v3/domains => generated 276 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:30.106600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:30.108613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:30.126142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f10703-dc05-45ba-b978-4bd6775b3d14 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:30.248686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cd001-f3c7-4a5e-a41a-b981970fb36f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:30.249363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cd001-f3c7-4a5e-a41a-b981970fb36f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:30.249650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cd001-f3c7-4a5e-a41a-b981970fb36f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:30.249934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cd001-f3c7-4a5e-a41a-b981970fb36f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:30.250635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cd001-f3c7-4a5e-a41a-b981970fb36f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=37709bdb19ba4de897d616d7175cd6d6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:30.252402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cd001-f3c7-4a5e-a41a-b981970fb36f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:30.324763 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2249/4480] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:01:30 2022] PUT /identity/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config => generated 138 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:30.325799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3df0b-b3da-4407-8b2a-24ed3ad09ffe tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:30.340870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3df0b-b3da-4407-8b2a-24ed3ad09ffe tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:30.353440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a60fb-cc73-46f8-afbe-4bfb5194a699 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:30.354034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a60fb-cc73-46f8-afbe-4bfb5194a699 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:30.354321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a60fb-cc73-46f8-afbe-4bfb5194a699 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:30.354601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a60fb-cc73-46f8-afbe-4bfb5194a699 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:30.355424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a60fb-cc73-46f8-afbe-4bfb5194a699 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=37709bdb19ba4de897d616d7175cd6d6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:30.356476 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-9c4a60fb-cc73-46f8-afbe-4bfb5194a699 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:30.356476 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:30.356476 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:30.357511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a60fb-cc73-46f8-afbe-4bfb5194a699 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:30.421822 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2232/4481] 10.222.0.27 () {60 vars in 1271 bytes} [Wed Oct 19 01:01:30 2022] PATCH /identity/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config => generated 141 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:30.422845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cd001-f3c7-4a5e-a41a-b981970fb36f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:30.437467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cd001-f3c7-4a5e-a41a-b981970fb36f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:30.452776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd565ee-894a-474d-bb63-fa291eaaef13 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:30.454475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd565ee-894a-474d-bb63-fa291eaaef13 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:30.454740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd565ee-894a-474d-bb63-fa291eaaef13 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:30.455044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd565ee-894a-474d-bb63-fa291eaaef13 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:30.465219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd565ee-894a-474d-bb63-fa291eaaef13 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=37709bdb19ba4de897d616d7175cd6d6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:30.466991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd565ee-894a-474d-bb63-fa291eaaef13 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:30.473352 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:30.495308 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2250/4482] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:01:30 2022] GET /identity/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config => generated 141 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:30.499451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a60fb-cc73-46f8-afbe-4bfb5194a699 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:30.513859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a60fb-cc73-46f8-afbe-4bfb5194a699 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:30.520465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1a5f7-ff1a-4e8d-8fae-b408e4560ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:30.521209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a5f7-ff1a-4e8d-8fae-b408e4560ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:30.521614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a5f7-ff1a-4e8d-8fae-b408e4560ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:30.521880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a5f7-ff1a-4e8d-8fae-b408e4560ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:30.522634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1a5f7-ff1a-4e8d-8fae-b408e4560ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=37709bdb19ba4de897d616d7175cd6d6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:30.523895 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-26c1a5f7-ff1a-4e8d-8fae-b408e4560ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:30.523895 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:30.523895 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:30.525418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1a5f7-ff1a-4e8d-8fae-b408e4560ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:30.557288 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2233/4483] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:01:30 2022] DELETE /identity/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:30.561109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd565ee-894a-474d-bb63-fa291eaaef13 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:30.576372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd565ee-894a-474d-bb63-fa291eaaef13 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:30.584042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc85162-a360-48d8-904b-95d56f3edc57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:30.584984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc85162-a360-48d8-904b-95d56f3edc57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:30.585266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc85162-a360-48d8-904b-95d56f3edc57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:30.588569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc85162-a360-48d8-904b-95d56f3edc57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:30.589892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc85162-a360-48d8-904b-95d56f3edc57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=37709bdb19ba4de897d616d7175cd6d6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:30.592012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc85162-a360-48d8-904b-95d56f3edc57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-fdc85162-a360-48d8-904b-95d56f3edc57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Could not find any options in domain configuration for domain 37709bdb19ba4de897d616d7175cd6d6.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 37709bdb19ba4de897d616d7175cd6d6. Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 19 01:01:30.601441 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 19 01:01:30.602406 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 19 01:01:30.602406 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 19 01:01:30.602406 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:30.602406 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:30.602406 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 19 01:01:30.602406 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 19 01:01:30.602406 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 37709bdb19ba4de897d616d7175cd6d6. Oct 19 01:01:30.602406 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:30.602897 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2251/4484] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:01:30 2022] GET /identity/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config => generated 151 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 19 01:01:30.607386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1a5f7-ff1a-4e8d-8fae-b408e4560ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:30.621431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1a5f7-ff1a-4e8d-8fae-b408e4560ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:30.627573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b11f-a05e-4fb5-8978-f132d723501f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:30.628448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b11f-a05e-4fb5-8978-f132d723501f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:30.630733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b11f-a05e-4fb5-8978-f132d723501f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:30.631136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b11f-a05e-4fb5-8978-f132d723501f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:30.632038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8b11f-a05e-4fb5-8978-f132d723501f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=37709bdb19ba4de897d616d7175cd6d6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:30.636190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8b11f-a05e-4fb5-8978-f132d723501f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:30.656644 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2234/4485] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:01:30 2022] DELETE /identity/v3/domains/37709bdb19ba4de897d616d7175cd6d6/config => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:30.657437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc85162-a360-48d8-904b-95d56f3edc57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:30.673839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc85162-a360-48d8-904b-95d56f3edc57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:30.689912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:30.689912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:30.690278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:30.693191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/37709bdb19ba4de897d616d7175cd6d6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:30.695776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=37709bdb19ba4de897d616d7175cd6d6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:30.700577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:30.748091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:30.749259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:30.807973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:30.809391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:30.822926 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2252/4486] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:01:30 2022] PATCH /identity/v3/domains/37709bdb19ba4de897d616d7175cd6d6 => generated 277 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:30.827240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b11f-a05e-4fb5-8978-f132d723501f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:30.829285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-73a8b11f-a05e-4fb5-8978-f132d723501f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:30.856118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b11f-a05e-4fb5-8978-f132d723501f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:30.937878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:30.939627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:30.939921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:30.940400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/37709bdb19ba4de897d616d7175cd6d6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:30.957811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=37709bdb19ba4de897d616d7175cd6d6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:30.959675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:30.991262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.007474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.016520 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:31.099800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6', 'request_id': 'req-1362bdb0-f4ac-44ac-a19c-a567fb090431'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.111337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6', 'request_id': 'req-1362bdb0-f4ac-44ac-a19c-a567fb090431'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.123385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6', 'request_id': 'req-1362bdb0-f4ac-44ac-a19c-a567fb090431'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.141400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] The token cache is being invalidate because project 37709bdb19ba4de897d616d7175cd6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:31.141662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.142917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.157762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6', 'request_id': 'req-1362bdb0-f4ac-44ac-a19c-a567fb090431'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.162212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6', 'request_id': 'req-1362bdb0-f4ac-44ac-a19c-a567fb090431'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.163160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '37709bdb19ba4de897d616d7175cd6d6', 'request_id': 'req-1362bdb0-f4ac-44ac-a19c-a567fb090431'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:31.193554 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2235/4487] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:30 2022] DELETE /identity/v3/domains/37709bdb19ba4de897d616d7175cd6d6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:31.199033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:31.244700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d98b15-f449-494f-aee5-c69795eaa613 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:31.372553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac0b71-cac6-4b41-be21-3dfc73477585 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:31.373215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0b71-cac6-4b41-be21-3dfc73477585 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:31.373503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0b71-cac6-4b41-be21-3dfc73477585 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:31.373784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0b71-cac6-4b41-be21-3dfc73477585 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:31.374471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac0b71-cac6-4b41-be21-3dfc73477585 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:31.376094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac0b71-cac6-4b41-be21-3dfc73477585 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:31.419382 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2253/4488] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:01:31 2022] POST /identity/v3/domains => generated 276 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:31.420418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:31.423243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:31.458248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362bdb0-f4ac-44ac-a19c-a567fb090431 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:31.598794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cef98-6223-4764-93c3-d7ac45f69ca4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:31.600001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cef98-6223-4764-93c3-d7ac45f69ca4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:31.601288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cef98-6223-4764-93c3-d7ac45f69ca4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:31.602746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cef98-6223-4764-93c3-d7ac45f69ca4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911/config` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:31.604958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cef98-6223-4764-93c3-d7ac45f69ca4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=294fa755b7ea4c7d874b61b456035911)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:31.608756 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-163cef98-6223-4764-93c3-d7ac45f69ca4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:31.608756 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:31.608756 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:31.611870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cef98-6223-4764-93c3-d7ac45f69ca4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:31.702869 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2236/4489] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:01:31 2022] PUT /identity/v3/domains/294fa755b7ea4c7d874b61b456035911/config => generated 138 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:31.707019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac0b71-cac6-4b41-be21-3dfc73477585 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:31.718872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac0b71-cac6-4b41-be21-3dfc73477585 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:31.731444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496db0a-4dab-4f37-9c15-1a6e1e8c8a26 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:31.732203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496db0a-4dab-4f37-9c15-1a6e1e8c8a26 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:31.732482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496db0a-4dab-4f37-9c15-1a6e1e8c8a26 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:31.732803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496db0a-4dab-4f37-9c15-1a6e1e8c8a26 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:31.733766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496db0a-4dab-4f37-9c15-1a6e1e8c8a26 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=294fa755b7ea4c7d874b61b456035911, group=identity)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:31.734791 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-9496db0a-4dab-4f37-9c15-1a6e1e8c8a26 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:31.734791 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:31.734791 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:31.735697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496db0a-4dab-4f37-9c15-1a6e1e8c8a26 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:31.814660 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2254/4490] 10.222.0.27 () {60 vars in 1297 bytes} [Wed Oct 19 01:01:31 2022] PATCH /identity/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity => generated 177 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:31.816772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cef98-6223-4764-93c3-d7ac45f69ca4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:31.841982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cef98-6223-4764-93c3-d7ac45f69ca4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:31.867164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bb35f-9a18-40ce-9c74-71eb2ec9f4ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:31.868204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bb35f-9a18-40ce-9c74-71eb2ec9f4ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:31.871051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bb35f-9a18-40ce-9c74-71eb2ec9f4ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:31.871752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bb35f-9a18-40ce-9c74-71eb2ec9f4ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity/driver` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:31.874391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bb35f-9a18-40ce-9c74-71eb2ec9f4ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=294fa755b7ea4c7d874b61b456035911, group=identity, option=driver)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:31.877944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bb35f-9a18-40ce-9c74-71eb2ec9f4ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:31.918976 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2237/4491] 10.222.0.27 () {60 vars in 1318 bytes} [Wed Oct 19 01:01:31 2022] PATCH /identity/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity/driver => generated 177 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:31.922967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496db0a-4dab-4f37-9c15-1a6e1e8c8a26 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:31.937206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496db0a-4dab-4f37-9c15-1a6e1e8c8a26 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:31.951224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25549b2-12e4-40b7-a893-66592b923320 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:31.951988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25549b2-12e4-40b7-a893-66592b923320 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:31.952277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25549b2-12e4-40b7-a893-66592b923320 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:31.952801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25549b2-12e4-40b7-a893-66592b923320 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity/driver` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:31.953560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25549b2-12e4-40b7-a893-66592b923320 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=294fa755b7ea4c7d874b61b456035911, group=identity, option=driver)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:31.955111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25549b2-12e4-40b7-a893-66592b923320 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:32.000239 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2255/4492] 10.222.0.27 () {58 vars in 1299 bytes} [Wed Oct 19 01:01:31 2022] DELETE /identity/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity/driver => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:32.002761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bb35f-9a18-40ce-9c74-71eb2ec9f4ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:32.020329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bb35f-9a18-40ce-9c74-71eb2ec9f4ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:32.059268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07f98b-5a73-4ffd-aeb0-68d89d01d88e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:32.064741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07f98b-5a73-4ffd-aeb0-68d89d01d88e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:32.065342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07f98b-5a73-4ffd-aeb0-68d89d01d88e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:32.066446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07f98b-5a73-4ffd-aeb0-68d89d01d88e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity/driver` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:32.071785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07f98b-5a73-4ffd-aeb0-68d89d01d88e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=294fa755b7ea4c7d874b61b456035911, group=identity, option=driver)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:32.073667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07f98b-5a73-4ffd-aeb0-68d89d01d88e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-7d07f98b-5a73-4ffd-aeb0-68d89d01d88e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Could not find option driver in group identity in domain configuration for domain 294fa755b7ea4c7d874b61b456035911.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 294fa755b7ea4c7d874b61b456035911. Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:32.138381 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 19 01:01:32.139485 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 19 01:01:32.139485 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 19 01:01:32.139485 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 19 01:01:32.139485 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:32.139485 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:32.139485 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 19 01:01:32.139485 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 19 01:01:32.139485 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 294fa755b7ea4c7d874b61b456035911. Oct 19 01:01:32.139485 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:32.141668 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2238/4493] 10.222.0.27 () {58 vars in 1296 bytes} [Wed Oct 19 01:01:32 2022] GET /identity/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity/driver => generated 171 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:01:32.147275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25549b2-12e4-40b7-a893-66592b923320 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:32.163332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25549b2-12e4-40b7-a893-66592b923320 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:32.181546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043dd70-2e61-410c-8404-0f3c1ecbf792 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:32.182222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043dd70-2e61-410c-8404-0f3c1ecbf792 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:32.182509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043dd70-2e61-410c-8404-0f3c1ecbf792 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:32.182791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043dd70-2e61-410c-8404-0f3c1ecbf792 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:32.183396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043dd70-2e61-410c-8404-0f3c1ecbf792 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=294fa755b7ea4c7d874b61b456035911, group=identity)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:32.185051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043dd70-2e61-410c-8404-0f3c1ecbf792 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:32.221393 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2256/4494] 10.222.0.27 () {58 vars in 1278 bytes} [Wed Oct 19 01:01:32 2022] DELETE /identity/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:32.222746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07f98b-5a73-4ffd-aeb0-68d89d01d88e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:32.247445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07f98b-5a73-4ffd-aeb0-68d89d01d88e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:32.270692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06bc16-877a-46e2-aa2c-97d57c711889 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:32.275783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06bc16-877a-46e2-aa2c-97d57c711889 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:32.277899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06bc16-877a-46e2-aa2c-97d57c711889 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:32.277899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06bc16-877a-46e2-aa2c-97d57c711889 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:32.281724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06bc16-877a-46e2-aa2c-97d57c711889 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=294fa755b7ea4c7d874b61b456035911, group=identity)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:32.288750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06bc16-877a-46e2-aa2c-97d57c711889 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-dd06bc16-877a-46e2-aa2c-97d57c711889 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Could not find group identity in domain configuration for domain 294fa755b7ea4c7d874b61b456035911.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 294fa755b7ea4c7d874b61b456035911. Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:32.335284 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 19 01:01:32.336230 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 19 01:01:32.336230 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 19 01:01:32.336230 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 19 01:01:32.336230 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:32.336230 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:32.336230 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 19 01:01:32.336230 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 19 01:01:32.336230 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 294fa755b7ea4c7d874b61b456035911. Oct 19 01:01:32.336230 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:32.341050 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2239/4495] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:01:32 2022] GET /identity/v3/domains/294fa755b7ea4c7d874b61b456035911/config/identity => generated 154 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 19 01:01:32.345039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043dd70-2e61-410c-8404-0f3c1ecbf792 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:32.369022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043dd70-2e61-410c-8404-0f3c1ecbf792 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:32.378160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acc538-782f-4f62-acb5-c3e01ab421a9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:32.379850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc538-782f-4f62-acb5-c3e01ab421a9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:32.379850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc538-782f-4f62-acb5-c3e01ab421a9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:32.380136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc538-782f-4f62-acb5-c3e01ab421a9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911/config` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:32.380766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acc538-782f-4f62-acb5-c3e01ab421a9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=294fa755b7ea4c7d874b61b456035911)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:32.382414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acc538-782f-4f62-acb5-c3e01ab421a9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:32.425779 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2257/4496] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:01:32 2022] DELETE /identity/v3/domains/294fa755b7ea4c7d874b61b456035911/config => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:32.427182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06bc16-877a-46e2-aa2c-97d57c711889 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:32.444420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06bc16-877a-46e2-aa2c-97d57c711889 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:32.465011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:32.465672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:32.465957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:32.466236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:32.469851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=294fa755b7ea4c7d874b61b456035911)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:32.471499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:32.485529 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:32.543786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '294fa755b7ea4c7d874b61b456035911'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:32.544786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '294fa755b7ea4c7d874b61b456035911'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:32.643083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '294fa755b7ea4c7d874b61b456035911'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:32.644399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '294fa755b7ea4c7d874b61b456035911'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:32.658615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2240/4497] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:01:32 2022] PATCH /identity/v3/domains/294fa755b7ea4c7d874b61b456035911 => generated 277 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:32.658823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acc538-782f-4f62-acb5-c3e01ab421a9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:32.660653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c4acc538-782f-4f62-acb5-c3e01ab421a9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:32.686699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acc538-782f-4f62-acb5-c3e01ab421a9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:32.713756 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:32.785226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:32.786879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:32.787174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:32.787459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:32.806136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=294fa755b7ea4c7d874b61b456035911)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:32.808000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:32.876688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '294fa755b7ea4c7d874b61b456035911'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:32.900056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '294fa755b7ea4c7d874b61b456035911'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:32.987158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294fa755b7ea4c7d874b61b456035911', 'request_id': 'req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:32.999981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294fa755b7ea4c7d874b61b456035911', 'request_id': 'req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:33.012649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294fa755b7ea4c7d874b61b456035911', 'request_id': 'req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:33.036477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] The token cache is being invalidate because project 294fa755b7ea4c7d874b61b456035911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:33.037252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:33.038067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:33.054321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '294fa755b7ea4c7d874b61b456035911', 'request_id': 'req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:33.064726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '294fa755b7ea4c7d874b61b456035911', 'request_id': 'req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:33.065657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '294fa755b7ea4c7d874b61b456035911', 'request_id': 'req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:33.079008 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2258/4498] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:32 2022] DELETE /identity/v3/domains/294fa755b7ea4c7d874b61b456035911 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:33.082523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.103905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aaafe-8497-41b1-94af-763ce3e4ba07 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.270719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57657004-23c6-4b2f-a5d5-46d4343664a8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.271358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657004-23c6-4b2f-a5d5-46d4343664a8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.271637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657004-23c6-4b2f-a5d5-46d4343664a8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.271909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657004-23c6-4b2f-a5d5-46d4343664a8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.272493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57657004-23c6-4b2f-a5d5-46d4343664a8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.273563 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-57657004-23c6-4b2f-a5d5-46d4343664a8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:33.273563 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:33.273563 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:33.274457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57657004-23c6-4b2f-a5d5-46d4343664a8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.278846 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2241/4499] 10.222.0.27 () {58 vars in 1173 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:33.284102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.286720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:33.300801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1115ab-9761-4ffd-b4d3-fa7f5617a3f6 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.305938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782977f1-030b-40fc-8e16-349b13120dbd tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.306704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782977f1-030b-40fc-8e16-349b13120dbd tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.307082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782977f1-030b-40fc-8e16-349b13120dbd tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.307450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782977f1-030b-40fc-8e16-349b13120dbd tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.308135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782977f1-030b-40fc-8e16-349b13120dbd tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.309283 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-782977f1-030b-40fc-8e16-349b13120dbd tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:33.309283 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:33.309283 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:33.310404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782977f1-030b-40fc-8e16-349b13120dbd tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.312201 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2259/4500] 10.222.0.27 () {58 vars in 1200 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.318150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57657004-23c6-4b2f-a5d5-46d4343664a8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.331048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57657004-23c6-4b2f-a5d5-46d4343664a8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.337441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d5d81-a629-4322-a353-4fd2ff6f57e1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.338244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5d81-a629-4322-a353-4fd2ff6f57e1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.338626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5d81-a629-4322-a353-4fd2ff6f57e1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.338995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5d81-a629-4322-a353-4fd2ff6f57e1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.339704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d5d81-a629-4322-a353-4fd2ff6f57e1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.341762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d5d81-a629-4322-a353-4fd2ff6f57e1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.343274 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2242/4501] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.347833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782977f1-030b-40fc-8e16-349b13120dbd tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.359427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782977f1-030b-40fc-8e16-349b13120dbd tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.367669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c36353-f78a-489b-8ed0-89e6ef9597f0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.368567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c36353-f78a-489b-8ed0-89e6ef9597f0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.368979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c36353-f78a-489b-8ed0-89e6ef9597f0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.369352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c36353-f78a-489b-8ed0-89e6ef9597f0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.370051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c36353-f78a-489b-8ed0-89e6ef9597f0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.371742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c36353-f78a-489b-8ed0-89e6ef9597f0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.376003 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2260/4502] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.377817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d5d81-a629-4322-a353-4fd2ff6f57e1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.390528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d5d81-a629-4322-a353-4fd2ff6f57e1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.396426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0afdb-3eb7-4396-b6b7-8541c0743157 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.397558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0afdb-3eb7-4396-b6b7-8541c0743157 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.398026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0afdb-3eb7-4396-b6b7-8541c0743157 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.398384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0afdb-3eb7-4396-b6b7-8541c0743157 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.399069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0afdb-3eb7-4396-b6b7-8541c0743157 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.400885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0afdb-3eb7-4396-b6b7-8541c0743157 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.405441 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2243/4503] 10.222.0.27 () {58 vars in 1188 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:33.407459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c36353-f78a-489b-8ed0-89e6ef9597f0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.428894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c36353-f78a-489b-8ed0-89e6ef9597f0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.433919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007e5a1-bec4-425b-8d02-6c637c3b3888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.434716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007e5a1-bec4-425b-8d02-6c637c3b3888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.435093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007e5a1-bec4-425b-8d02-6c637c3b3888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.435796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007e5a1-bec4-425b-8d02-6c637c3b3888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.436831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007e5a1-bec4-425b-8d02-6c637c3b3888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.438625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007e5a1-bec4-425b-8d02-6c637c3b3888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.443208 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2261/4504] 10.222.0.27 () {58 vars in 1200 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.444434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0afdb-3eb7-4396-b6b7-8541c0743157 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.460577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0afdb-3eb7-4396-b6b7-8541c0743157 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.473207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e152346-08fc-45ec-a0b4-acd52a71a727 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.473885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e152346-08fc-45ec-a0b4-acd52a71a727 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.474174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e152346-08fc-45ec-a0b4-acd52a71a727 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.474448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e152346-08fc-45ec-a0b4-acd52a71a727 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.475048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e152346-08fc-45ec-a0b4-acd52a71a727 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.484439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e152346-08fc-45ec-a0b4-acd52a71a727 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.489461 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2244/4505] 10.222.0.27 () {58 vars in 1203 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.490882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007e5a1-bec4-425b-8d02-6c637c3b3888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.514125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007e5a1-bec4-425b-8d02-6c637c3b3888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.524745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25aa4c-85c1-4596-9390-3d4097341c33 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.526256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25aa4c-85c1-4596-9390-3d4097341c33 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.526687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25aa4c-85c1-4596-9390-3d4097341c33 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.527249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25aa4c-85c1-4596-9390-3d4097341c33 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.528013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25aa4c-85c1-4596-9390-3d4097341c33 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.531160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25aa4c-85c1-4596-9390-3d4097341c33 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.536950 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2262/4506] 10.222.0.27 () {58 vars in 1209 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.538403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e152346-08fc-45ec-a0b4-acd52a71a727 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.555947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e152346-08fc-45ec-a0b4-acd52a71a727 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.563009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471e3a0-0f61-4011-b1d2-69c61760a86d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.563901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471e3a0-0f61-4011-b1d2-69c61760a86d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.564331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471e3a0-0f61-4011-b1d2-69c61760a86d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.564782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471e3a0-0f61-4011-b1d2-69c61760a86d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.565948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471e3a0-0f61-4011-b1d2-69c61760a86d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.568279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471e3a0-0f61-4011-b1d2-69c61760a86d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.572555 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2245/4507] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.574053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25aa4c-85c1-4596-9390-3d4097341c33 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.597879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25aa4c-85c1-4596-9390-3d4097341c33 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.603713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc5d2d-7ae7-4cec-a361-b3afec78307a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.604888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5d2d-7ae7-4cec-a361-b3afec78307a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.605346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5d2d-7ae7-4cec-a361-b3afec78307a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.605837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5d2d-7ae7-4cec-a361-b3afec78307a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.607275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc5d2d-7ae7-4cec-a361-b3afec78307a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.609648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc5d2d-7ae7-4cec-a361-b3afec78307a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.615165 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2263/4508] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.617683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471e3a0-0f61-4011-b1d2-69c61760a86d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.639426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471e3a0-0f61-4011-b1d2-69c61760a86d tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.646222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751259-9314-4f1d-8a78-cd833cf87d56 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.646905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751259-9314-4f1d-8a78-cd833cf87d56 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.647618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751259-9314-4f1d-8a78-cd833cf87d56 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.647909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751259-9314-4f1d-8a78-cd833cf87d56 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.648514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5751259-9314-4f1d-8a78-cd833cf87d56 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.650766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5751259-9314-4f1d-8a78-cd833cf87d56 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.656101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc5d2d-7ae7-4cec-a361-b3afec78307a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.667709 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2246/4509] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.668476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc5d2d-7ae7-4cec-a361-b3afec78307a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.674585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab7a30-7a0a-45b4-ace7-6f6e79637f57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.675245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7a30-7a0a-45b4-ace7-6f6e79637f57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.675799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7a30-7a0a-45b4-ace7-6f6e79637f57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.676091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7a30-7a0a-45b4-ace7-6f6e79637f57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.676724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab7a30-7a0a-45b4-ace7-6f6e79637f57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.678567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab7a30-7a0a-45b4-ace7-6f6e79637f57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.685622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751259-9314-4f1d-8a78-cd833cf87d56 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.694937 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2264/4510] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.699599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751259-9314-4f1d-8a78-cd833cf87d56 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.705886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145d2dd-c61c-438d-a160-8e20f5ee80de tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.707294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145d2dd-c61c-438d-a160-8e20f5ee80de tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.707799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145d2dd-c61c-438d-a160-8e20f5ee80de tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.708189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145d2dd-c61c-438d-a160-8e20f5ee80de tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.708908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145d2dd-c61c-438d-a160-8e20f5ee80de tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.710888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145d2dd-c61c-438d-a160-8e20f5ee80de tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.712444 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2247/4511] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 19 01:01:33.716596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab7a30-7a0a-45b4-ace7-6f6e79637f57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.741906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab7a30-7a0a-45b4-ace7-6f6e79637f57 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.756788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59efa4-957f-4e02-881c-e776acd3c888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.757554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59efa4-957f-4e02-881c-e776acd3c888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.757795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59efa4-957f-4e02-881c-e776acd3c888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.758081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59efa4-957f-4e02-881c-e776acd3c888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.758681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59efa4-957f-4e02-881c-e776acd3c888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.760295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59efa4-957f-4e02-881c-e776acd3c888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.764011 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2265/4512] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.768178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145d2dd-c61c-438d-a160-8e20f5ee80de tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.785873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145d2dd-c61c-438d-a160-8e20f5ee80de tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.796281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666ea6-f7c6-456c-aaaa-7705e0522ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.796998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666ea6-f7c6-456c-aaaa-7705e0522ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.797292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666ea6-f7c6-456c-aaaa-7705e0522ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.797577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666ea6-f7c6-456c-aaaa-7705e0522ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.798184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666ea6-f7c6-456c-aaaa-7705e0522ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.799849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666ea6-f7c6-456c-aaaa-7705e0522ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.810288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59efa4-957f-4e02-881c-e776acd3c888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.824745 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2248/4513] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.826743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59efa4-957f-4e02-881c-e776acd3c888 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.842134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7167b-c94d-41f6-b39e-356e4d1a0cb9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.842810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7167b-c94d-41f6-b39e-356e4d1a0cb9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.843097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7167b-c94d-41f6-b39e-356e4d1a0cb9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.843515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7167b-c94d-41f6-b39e-356e4d1a0cb9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.844127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7167b-c94d-41f6-b39e-356e4d1a0cb9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.848825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7167b-c94d-41f6-b39e-356e4d1a0cb9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.855971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666ea6-f7c6-456c-aaaa-7705e0522ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.858914 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2266/4514] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 19 01:01:33.873000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666ea6-f7c6-456c-aaaa-7705e0522ff8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.896698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b40d-dae6-45db-9bbb-47844da638e2 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.897873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b40d-dae6-45db-9bbb-47844da638e2 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.898173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b40d-dae6-45db-9bbb-47844da638e2 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.899984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b40d-dae6-45db-9bbb-47844da638e2 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.900646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b40d-dae6-45db-9bbb-47844da638e2 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.902736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b40d-dae6-45db-9bbb-47844da638e2 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.904263 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2249/4515] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.909221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7167b-c94d-41f6-b39e-356e4d1a0cb9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:33.939853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7167b-c94d-41f6-b39e-356e4d1a0cb9 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:33.961010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbfc7d-75bc-49b3-b6f2-6ffb3e27dbcc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:33.961689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbfc7d-75bc-49b3-b6f2-6ffb3e27dbcc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:33.962049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbfc7d-75bc-49b3-b6f2-6ffb3e27dbcc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:33.962320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbfc7d-75bc-49b3-b6f2-6ffb3e27dbcc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:33.962958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbfc7d-75bc-49b3-b6f2-6ffb3e27dbcc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:33.989987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbfc7d-75bc-49b3-b6f2-6ffb3e27dbcc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:33.991507 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2267/4516] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:33.995458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b40d-dae6-45db-9bbb-47844da638e2 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.006798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b40d-dae6-45db-9bbb-47844da638e2 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.029752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2333-5a71-4a0b-aeb7-523e7fca1ce8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.030530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2333-5a71-4a0b-aeb7-523e7fca1ce8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.030923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2333-5a71-4a0b-aeb7-523e7fca1ce8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.031307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2333-5a71-4a0b-aeb7-523e7fca1ce8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.032028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b2333-5a71-4a0b-aeb7-523e7fca1ce8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.033783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b2333-5a71-4a0b-aeb7-523e7fca1ce8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.035156 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2250/4517] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:01:33 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.039271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbfc7d-75bc-49b3-b6f2-6ffb3e27dbcc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.075012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbfc7d-75bc-49b3-b6f2-6ffb3e27dbcc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.094957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b281c88-9d6f-410c-a51b-b5f5f969ddbc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.095841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b281c88-9d6f-410c-a51b-b5f5f969ddbc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.098143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b281c88-9d6f-410c-a51b-b5f5f969ddbc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.098554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b281c88-9d6f-410c-a51b-b5f5f969ddbc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.101369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b281c88-9d6f-410c-a51b-b5f5f969ddbc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.104148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b281c88-9d6f-410c-a51b-b5f5f969ddbc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.117095 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2268/4518] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.121261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2333-5a71-4a0b-aeb7-523e7fca1ce8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.134028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2333-5a71-4a0b-aeb7-523e7fca1ce8 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.142806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330cb9-9aa0-4cec-9f0f-a6df8de6398a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.143262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330cb9-9aa0-4cec-9f0f-a6df8de6398a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.144822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330cb9-9aa0-4cec-9f0f-a6df8de6398a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.145228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330cb9-9aa0-4cec-9f0f-a6df8de6398a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.145939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b330cb9-9aa0-4cec-9f0f-a6df8de6398a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.148850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b330cb9-9aa0-4cec-9f0f-a6df8de6398a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.152958 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2251/4519] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.155032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b281c88-9d6f-410c-a51b-b5f5f969ddbc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.171043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b281c88-9d6f-410c-a51b-b5f5f969ddbc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.178230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93021c05-def0-476f-8776-d501c0ad1211 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.179161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93021c05-def0-476f-8776-d501c0ad1211 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.179432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93021c05-def0-476f-8776-d501c0ad1211 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.179819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93021c05-def0-476f-8776-d501c0ad1211 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.180554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93021c05-def0-476f-8776-d501c0ad1211 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.182491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93021c05-def0-476f-8776-d501c0ad1211 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.187081 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2269/4520] 10.222.0.27 () {58 vars in 1257 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.188881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330cb9-9aa0-4cec-9f0f-a6df8de6398a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.209332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330cb9-9aa0-4cec-9f0f-a6df8de6398a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.219658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2866-6b83-4574-9ffc-7ef25c84a88a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.220544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2866-6b83-4574-9ffc-7ef25c84a88a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.221027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2866-6b83-4574-9ffc-7ef25c84a88a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.221413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2866-6b83-4574-9ffc-7ef25c84a88a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.222173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2866-6b83-4574-9ffc-7ef25c84a88a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.224074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2866-6b83-4574-9ffc-7ef25c84a88a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.228259 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2252/4521] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 19 01:01:34.230092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93021c05-def0-476f-8776-d501c0ad1211 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.245568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93021c05-def0-476f-8776-d501c0ad1211 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.255135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1e74-128d-4a2b-b43e-6901e61483eb tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.255970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1e74-128d-4a2b-b43e-6901e61483eb tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.256940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1e74-128d-4a2b-b43e-6901e61483eb tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.257330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1e74-128d-4a2b-b43e-6901e61483eb tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.258196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a1e74-128d-4a2b-b43e-6901e61483eb tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.260597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a1e74-128d-4a2b-b43e-6901e61483eb tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.264822 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2270/4522] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.267996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2866-6b83-4574-9ffc-7ef25c84a88a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.284568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2866-6b83-4574-9ffc-7ef25c84a88a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.301899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dafba-eba4-4695-bc9d-9bbf11c0cab4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.302575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dafba-eba4-4695-bc9d-9bbf11c0cab4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.302862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dafba-eba4-4695-bc9d-9bbf11c0cab4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.303142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dafba-eba4-4695-bc9d-9bbf11c0cab4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.303741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dafba-eba4-4695-bc9d-9bbf11c0cab4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.305867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dafba-eba4-4695-bc9d-9bbf11c0cab4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.309273 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2253/4523] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.314574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1e74-128d-4a2b-b43e-6901e61483eb tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.322336 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:34.339734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1e74-128d-4a2b-b43e-6901e61483eb tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.353424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2f7cd-4368-44d8-a377-24fbe4d21c72 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.355429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2f7cd-4368-44d8-a377-24fbe4d21c72 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.356864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2f7cd-4368-44d8-a377-24fbe4d21c72 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.357478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2f7cd-4368-44d8-a377-24fbe4d21c72 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.359067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2f7cd-4368-44d8-a377-24fbe4d21c72 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.361626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2f7cd-4368-44d8-a377-24fbe4d21c72 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.371777 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2271/4524] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.372894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dafba-eba4-4695-bc9d-9bbf11c0cab4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.399039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dafba-eba4-4695-bc9d-9bbf11c0cab4 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.449725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791c81b-9c28-400a-8a60-e45088607a62 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.450400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c81b-9c28-400a-8a60-e45088607a62 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.450837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c81b-9c28-400a-8a60-e45088607a62 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.451275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c81b-9c28-400a-8a60-e45088607a62 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.455680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791c81b-9c28-400a-8a60-e45088607a62 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.458216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791c81b-9c28-400a-8a60-e45088607a62 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.462605 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2254/4525] 10.222.0.27 () {58 vars in 1290 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.471083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2f7cd-4368-44d8-a377-24fbe4d21c72 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.486205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2f7cd-4368-44d8-a377-24fbe4d21c72 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.495561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0447778-413b-4df4-89d0-20ae89b5385e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.497663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0447778-413b-4df4-89d0-20ae89b5385e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.497663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0447778-413b-4df4-89d0-20ae89b5385e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.497663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0447778-413b-4df4-89d0-20ae89b5385e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.500432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0447778-413b-4df4-89d0-20ae89b5385e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.502324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0447778-413b-4df4-89d0-20ae89b5385e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.508919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791c81b-9c28-400a-8a60-e45088607a62 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.515614 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2272/4526] 10.222.0.27 () {58 vars in 1257 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.524580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791c81b-9c28-400a-8a60-e45088607a62 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.533714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb9668-443a-4ea9-a0ad-8ae91df0cfdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.535487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb9668-443a-4ea9-a0ad-8ae91df0cfdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.535806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb9668-443a-4ea9-a0ad-8ae91df0cfdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.536095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb9668-443a-4ea9-a0ad-8ae91df0cfdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.537278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb9668-443a-4ea9-a0ad-8ae91df0cfdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.539620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb9668-443a-4ea9-a0ad-8ae91df0cfdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.540776 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2255/4527] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 19 01:01:34.546616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0447778-413b-4df4-89d0-20ae89b5385e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.611339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0447778-413b-4df4-89d0-20ae89b5385e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.623005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce5c7-cd3f-4f55-aece-a95ae5edb684 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.623862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce5c7-cd3f-4f55-aece-a95ae5edb684 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.624155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce5c7-cd3f-4f55-aece-a95ae5edb684 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.624434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce5c7-cd3f-4f55-aece-a95ae5edb684 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.625084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ce5c7-cd3f-4f55-aece-a95ae5edb684 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.629720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ce5c7-cd3f-4f55-aece-a95ae5edb684 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.635165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb9668-443a-4ea9-a0ad-8ae91df0cfdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.636030 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2273/4528] 10.222.0.27 () {58 vars in 1308 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.685519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb9668-443a-4ea9-a0ad-8ae91df0cfdf tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.697981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7ef6-47cb-4d2b-8fec-1cb5440182a7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.702893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7ef6-47cb-4d2b-8fec-1cb5440182a7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.703371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7ef6-47cb-4d2b-8fec-1cb5440182a7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.704420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7ef6-47cb-4d2b-8fec-1cb5440182a7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.705995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e7ef6-47cb-4d2b-8fec-1cb5440182a7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.710920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e7ef6-47cb-4d2b-8fec-1cb5440182a7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.712325 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2256/4529] 10.222.0.27 () {58 vars in 1290 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.717978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce5c7-cd3f-4f55-aece-a95ae5edb684 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.764819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce5c7-cd3f-4f55-aece-a95ae5edb684 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.771698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892fcc6-796f-4151-a96f-cbbba035d89f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.772689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892fcc6-796f-4151-a96f-cbbba035d89f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.773123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892fcc6-796f-4151-a96f-cbbba035d89f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.773783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892fcc6-796f-4151-a96f-cbbba035d89f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.774559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892fcc6-796f-4151-a96f-cbbba035d89f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.776585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892fcc6-796f-4151-a96f-cbbba035d89f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.778239 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2274/4530] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.783364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7ef6-47cb-4d2b-8fec-1cb5440182a7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.800143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7ef6-47cb-4d2b-8fec-1cb5440182a7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.806376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdd975-b919-46a9-a678-8ee142166e08 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.807391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdd975-b919-46a9-a678-8ee142166e08 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.808086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdd975-b919-46a9-a678-8ee142166e08 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.808726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdd975-b919-46a9-a678-8ee142166e08 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.809488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdd975-b919-46a9-a678-8ee142166e08 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.813629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdd975-b919-46a9-a678-8ee142166e08 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.819495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892fcc6-796f-4151-a96f-cbbba035d89f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.833923 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2257/4531] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.849429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892fcc6-796f-4151-a96f-cbbba035d89f tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.856836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9106383-a16f-4318-b487-c68a1f0b04e0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.857668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9106383-a16f-4318-b487-c68a1f0b04e0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.858202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9106383-a16f-4318-b487-c68a1f0b04e0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.858627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9106383-a16f-4318-b487-c68a1f0b04e0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.859368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9106383-a16f-4318-b487-c68a1f0b04e0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.861480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9106383-a16f-4318-b487-c68a1f0b04e0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.867559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdd975-b919-46a9-a678-8ee142166e08 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.867798 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2275/4532] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.880355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdd975-b919-46a9-a678-8ee142166e08 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.889965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d47f8-13e3-4747-8c6c-388a492e560a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.890901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d47f8-13e3-4747-8c6c-388a492e560a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.891336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d47f8-13e3-4747-8c6c-388a492e560a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.891745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d47f8-13e3-4747-8c6c-388a492e560a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.892834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d47f8-13e3-4747-8c6c-388a492e560a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.901503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d47f8-13e3-4747-8c6c-388a492e560a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.907519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9106383-a16f-4318-b487-c68a1f0b04e0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.916838 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2258/4533] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.922023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9106383-a16f-4318-b487-c68a1f0b04e0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.940770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a07866-f95e-40cb-ab60-7b370e8218fc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.941717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a07866-f95e-40cb-ab60-7b370e8218fc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.942009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a07866-f95e-40cb-ab60-7b370e8218fc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.942644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a07866-f95e-40cb-ab60-7b370e8218fc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.943358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a07866-f95e-40cb-ab60-7b370e8218fc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.944999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a07866-f95e-40cb-ab60-7b370e8218fc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.955361 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2276/4534] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.956174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d47f8-13e3-4747-8c6c-388a492e560a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:34.968191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d47f8-13e3-4747-8c6c-388a492e560a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:34.980052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffec76d-ae24-4ab6-b604-da00e7ed6efc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:34.980764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffec76d-ae24-4ab6-b604-da00e7ed6efc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:34.981055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffec76d-ae24-4ab6-b604-da00e7ed6efc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:34.981331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffec76d-ae24-4ab6-b604-da00e7ed6efc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:34.982599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffec76d-ae24-4ab6-b604-da00e7ed6efc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:34.984788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffec76d-ae24-4ab6-b604-da00e7ed6efc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:34.986771 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2259/4535] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:34.990451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a07866-f95e-40cb-ab60-7b370e8218fc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.004742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a07866-f95e-40cb-ab60-7b370e8218fc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.010007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af6318-0465-4cec-bcc3-b706f2c3deba tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.010713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af6318-0465-4cec-bcc3-b706f2c3deba tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.010999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af6318-0465-4cec-bcc3-b706f2c3deba tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.011279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af6318-0465-4cec-bcc3-b706f2c3deba tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.011876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af6318-0465-4cec-bcc3-b706f2c3deba tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.013522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af6318-0465-4cec-bcc3-b706f2c3deba tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.019507 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2277/4536] 10.222.0.27 () {58 vars in 1257 bytes} [Wed Oct 19 01:01:34 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 19 01:01:35.020725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffec76d-ae24-4ab6-b604-da00e7ed6efc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.043374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffec76d-ae24-4ab6-b604-da00e7ed6efc tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.055775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74972d6d-9b6b-40e3-8b2a-b0ee8420d1c0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.056615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74972d6d-9b6b-40e3-8b2a-b0ee8420d1c0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.057546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74972d6d-9b6b-40e3-8b2a-b0ee8420d1c0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.057939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74972d6d-9b6b-40e3-8b2a-b0ee8420d1c0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.059651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74972d6d-9b6b-40e3-8b2a-b0ee8420d1c0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.065092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74972d6d-9b6b-40e3-8b2a-b0ee8420d1c0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.071499 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2260/4537] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.075847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af6318-0465-4cec-bcc3-b706f2c3deba tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.107021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af6318-0465-4cec-bcc3-b706f2c3deba tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.142069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b04f4-a401-4a37-943e-e72b5a8c7690 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.142823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b04f4-a401-4a37-943e-e72b5a8c7690 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.143201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b04f4-a401-4a37-943e-e72b5a8c7690 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.143426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b04f4-a401-4a37-943e-e72b5a8c7690 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.144708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b04f4-a401-4a37-943e-e72b5a8c7690 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.147116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b04f4-a401-4a37-943e-e72b5a8c7690 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.152504 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2278/4538] 10.222.0.27 () {58 vars in 1257 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.153427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74972d6d-9b6b-40e3-8b2a-b0ee8420d1c0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.171658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74972d6d-9b6b-40e3-8b2a-b0ee8420d1c0 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.179046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcc879-b714-4743-9ae6-67bfe4b31c77 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.180117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcc879-b714-4743-9ae6-67bfe4b31c77 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.180516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcc879-b714-4743-9ae6-67bfe4b31c77 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.181041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcc879-b714-4743-9ae6-67bfe4b31c77 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.181844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcc879-b714-4743-9ae6-67bfe4b31c77 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.185344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcc879-b714-4743-9ae6-67bfe4b31c77 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.189922 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2261/4539] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 19 01:01:35.192039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b04f4-a401-4a37-943e-e72b5a8c7690 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.227096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b04f4-a401-4a37-943e-e72b5a8c7690 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.233269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829aa56-cda8-4fc1-abfc-f27e7560256a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.233488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829aa56-cda8-4fc1-abfc-f27e7560256a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.233827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829aa56-cda8-4fc1-abfc-f27e7560256a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.234085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829aa56-cda8-4fc1-abfc-f27e7560256a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.234730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829aa56-cda8-4fc1-abfc-f27e7560256a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.236543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829aa56-cda8-4fc1-abfc-f27e7560256a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.240883 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2279/4540] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.242115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcc879-b714-4743-9ae6-67bfe4b31c77 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.260521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcc879-b714-4743-9ae6-67bfe4b31c77 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.265194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ea2e2-9ef1-4f7f-aa02-01d13ad2fd03 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.265865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ea2e2-9ef1-4f7f-aa02-01d13ad2fd03 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.266149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ea2e2-9ef1-4f7f-aa02-01d13ad2fd03 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.266426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ea2e2-9ef1-4f7f-aa02-01d13ad2fd03 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.267100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ea2e2-9ef1-4f7f-aa02-01d13ad2fd03 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.268756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ea2e2-9ef1-4f7f-aa02-01d13ad2fd03 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.274499 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2262/4541] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.275670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829aa56-cda8-4fc1-abfc-f27e7560256a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.291123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829aa56-cda8-4fc1-abfc-f27e7560256a tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.303297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145b53a-b668-4d7d-9be2-bf219c01d506 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.303882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145b53a-b668-4d7d-9be2-bf219c01d506 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.304162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145b53a-b668-4d7d-9be2-bf219c01d506 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.304439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145b53a-b668-4d7d-9be2-bf219c01d506 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.305056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145b53a-b668-4d7d-9be2-bf219c01d506 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.309515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145b53a-b668-4d7d-9be2-bf219c01d506 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.313545 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2280/4542] 10.222.0.27 () {58 vars in 1212 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.314738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ea2e2-9ef1-4f7f-aa02-01d13ad2fd03 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.331329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ea2e2-9ef1-4f7f-aa02-01d13ad2fd03 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.340416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50afc3-334d-41d9-8b19-ae1a0263276e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.341252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50afc3-334d-41d9-8b19-ae1a0263276e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.341532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50afc3-334d-41d9-8b19-ae1a0263276e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.341806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50afc3-334d-41d9-8b19-ae1a0263276e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.342426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50afc3-334d-41d9-8b19-ae1a0263276e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.344859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50afc3-334d-41d9-8b19-ae1a0263276e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.345957 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2263/4543] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.349882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145b53a-b668-4d7d-9be2-bf219c01d506 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.366545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145b53a-b668-4d7d-9be2-bf219c01d506 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.391931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833e1d-1c1b-4b83-9e73-7b6874d4ceab tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.392697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833e1d-1c1b-4b83-9e73-7b6874d4ceab tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.392985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833e1d-1c1b-4b83-9e73-7b6874d4ceab tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.393265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833e1d-1c1b-4b83-9e73-7b6874d4ceab tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.394675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49833e1d-1c1b-4b83-9e73-7b6874d4ceab tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.396188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49833e1d-1c1b-4b83-9e73-7b6874d4ceab tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.397752 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2281/4544] 10.222.0.27 () {58 vars in 1215 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.401393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50afc3-334d-41d9-8b19-ae1a0263276e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.412773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50afc3-334d-41d9-8b19-ae1a0263276e tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.420908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3330e-089b-4a01-bab0-d239be2c8cf7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.421578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3330e-089b-4a01-bab0-d239be2c8cf7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.421868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3330e-089b-4a01-bab0-d239be2c8cf7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.422209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3330e-089b-4a01-bab0-d239be2c8cf7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.422720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3330e-089b-4a01-bab0-d239be2c8cf7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.424311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3330e-089b-4a01-bab0-d239be2c8cf7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.426618 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2264/4545] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.431185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833e1d-1c1b-4b83-9e73-7b6874d4ceab tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.446191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833e1d-1c1b-4b83-9e73-7b6874d4ceab tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.464054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baec07-f389-489b-9b8a-3f0b4ee9f6ec tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.467520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baec07-f389-489b-9b8a-3f0b4ee9f6ec tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.469493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baec07-f389-489b-9b8a-3f0b4ee9f6ec tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.471598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baec07-f389-489b-9b8a-3f0b4ee9f6ec tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.472311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16baec07-f389-489b-9b8a-3f0b4ee9f6ec tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.481158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16baec07-f389-489b-9b8a-3f0b4ee9f6ec tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.485322 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2282/4546] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.486615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3330e-089b-4a01-bab0-d239be2c8cf7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.492806 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:35.500499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3330e-089b-4a01-bab0-d239be2c8cf7 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.529228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556248b-ce5f-4186-af75-34201c0a4ad1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.529925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556248b-ce5f-4186-af75-34201c0a4ad1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.530212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556248b-ce5f-4186-af75-34201c0a4ad1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.530495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556248b-ce5f-4186-af75-34201c0a4ad1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.531115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556248b-ce5f-4186-af75-34201c0a4ad1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.532846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556248b-ce5f-4186-af75-34201c0a4ad1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.539172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baec07-f389-489b-9b8a-3f0b4ee9f6ec tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.539369 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2265/4547] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.555928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16baec07-f389-489b-9b8a-3f0b4ee9f6ec tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.569518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd642-8c6e-4fa5-aa43-f548a1fe0910 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.570352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd642-8c6e-4fa5-aa43-f548a1fe0910 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.570648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd642-8c6e-4fa5-aa43-f548a1fe0910 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.572667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd642-8c6e-4fa5-aa43-f548a1fe0910 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.572667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bd642-8c6e-4fa5-aa43-f548a1fe0910 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.574078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bd642-8c6e-4fa5-aa43-f548a1fe0910 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.588144 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2283/4548] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 19 01:01:35.589774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556248b-ce5f-4186-af75-34201c0a4ad1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.619422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556248b-ce5f-4186-af75-34201c0a4ad1 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.633558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59c795-de17-4413-9f50-45619e8188ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.634250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c795-de17-4413-9f50-45619e8188ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.634538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c795-de17-4413-9f50-45619e8188ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.634815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c795-de17-4413-9f50-45619e8188ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.635415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59c795-de17-4413-9f50-45619e8188ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.637077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59c795-de17-4413-9f50-45619e8188ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.642752 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2266/4549] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.644546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd642-8c6e-4fa5-aa43-f548a1fe0910 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.660797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd642-8c6e-4fa5-aa43-f548a1fe0910 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.674414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62187d65-f761-4fe0-b625-f683cadf1427 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.675629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62187d65-f761-4fe0-b625-f683cadf1427 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.675956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62187d65-f761-4fe0-b625-f683cadf1427 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.676212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62187d65-f761-4fe0-b625-f683cadf1427 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.677528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62187d65-f761-4fe0-b625-f683cadf1427 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.678563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62187d65-f761-4fe0-b625-f683cadf1427 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.683034 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2284/4550] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.685789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59c795-de17-4413-9f50-45619e8188ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.705444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59c795-de17-4413-9f50-45619e8188ff tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.718065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43fece-e4d1-4972-a23b-1329dd078604 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.718915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43fece-e4d1-4972-a23b-1329dd078604 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.719340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43fece-e4d1-4972-a23b-1329dd078604 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.719780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43fece-e4d1-4972-a23b-1329dd078604 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.720527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43fece-e4d1-4972-a23b-1329dd078604 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.722413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43fece-e4d1-4972-a23b-1329dd078604 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.730274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62187d65-f761-4fe0-b625-f683cadf1427 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.730762 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2267/4551] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.778931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62187d65-f761-4fe0-b625-f683cadf1427 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.799962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c99ec5-36e1-41c2-b172-f89babbd61a5 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.815991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c99ec5-36e1-41c2-b172-f89babbd61a5 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.815991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c99ec5-36e1-41c2-b172-f89babbd61a5 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.815991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c99ec5-36e1-41c2-b172-f89babbd61a5 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.815991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c99ec5-36e1-41c2-b172-f89babbd61a5 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:35.816716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c99ec5-36e1-41c2-b172-f89babbd61a5 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:35.816802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43fece-e4d1-4972-a23b-1329dd078604 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.822924 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2285/4552] 10.222.0.27 () {58 vars in 1278 bytes} [Wed Oct 19 01:01:35 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:01:35.829651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43fece-e4d1-4972-a23b-1329dd078604 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.839519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f63e5-e9d6-457f-8306-c1abe9a1f60c tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.840929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f63e5-e9d6-457f-8306-c1abe9a1f60c tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.841448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f63e5-e9d6-457f-8306-c1abe9a1f60c tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.843665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f63e5-e9d6-457f-8306-c1abe9a1f60c tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/294fa755b7ea4c7d874b61b456035911` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.864141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f63e5-e9d6-457f-8306-c1abe9a1f60c tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-0b2f63e5-e9d6-457f-8306-c1abe9a1f60c tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Could not find domain: 294fa755b7ea4c7d874b61b456035911.: keystone.exception.DomainNotFound: Could not find domain: 294fa755b7ea4c7d874b61b456035911. Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 294fa755b7ea4c7d874b61b456035911. Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:35.878367 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:35.879291 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:01:35.884392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 294fa755b7ea4c7d874b61b456035911. Oct 19 01:01:35.885524 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:35.885524 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2268/4553] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:01:35 2022] PATCH /identity/v3/domains/294fa755b7ea4c7d874b61b456035911 => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:01:35.885651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c99ec5-36e1-41c2-b172-f89babbd61a5 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.911567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c99ec5-36e1-41c2-b172-f89babbd61a5 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.939470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154fba8-abe8-43b5-a57a-cfe9ff4d98ea tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.940216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154fba8-abe8-43b5-a57a-cfe9ff4d98ea tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.940570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154fba8-abe8-43b5-a57a-cfe9ff4d98ea tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.941003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154fba8-abe8-43b5-a57a-cfe9ff4d98ea tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/37709bdb19ba4de897d616d7175cd6d6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:35.959326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154fba8-abe8-43b5-a57a-cfe9ff4d98ea tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-1154fba8-abe8-43b5-a57a-cfe9ff4d98ea tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Could not find domain: 37709bdb19ba4de897d616d7175cd6d6.: keystone.exception.DomainNotFound: Could not find domain: 37709bdb19ba4de897d616d7175cd6d6. Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 37709bdb19ba4de897d616d7175cd6d6. Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:35.968401 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:35.969429 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:01:35.974030 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 37709bdb19ba4de897d616d7175cd6d6. Oct 19 01:01:35.974829 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:35.974829 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2286/4554] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:01:35 2022] PATCH /identity/v3/domains/37709bdb19ba4de897d616d7175cd6d6 => generated 112 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:01:35.976661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f63e5-e9d6-457f-8306-c1abe9a1f60c tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:35.988869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f63e5-e9d6-457f-8306-c1abe9a1f60c tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:35.994601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4e332-03e7-4e42-a9f5-10ea7f163505 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c440c4af20d40769ff2dfa6d8852e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '075769e958c34e8bb1524a8b6e9c273d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:35.995513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e332-03e7-4e42-a9f5-10ea7f163505 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:35.996283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e332-03e7-4e42-a9f5-10ea7f163505 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:35.996796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e332-03e7-4e42-a9f5-10ea7f163505 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] PATH_INFO: `/v3/domains/38c5a451e72540678f6037d7f743deaa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:36.007146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4e332-03e7-4e42-a9f5-10ea7f163505 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-98b4e332-03e7-4e42-a9f5-10ea7f163505 tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Could not find domain: 38c5a451e72540678f6037d7f743deaa.: keystone.exception.DomainNotFound: Could not find domain: 38c5a451e72540678f6037d7f743deaa. Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 38c5a451e72540678f6037d7f743deaa. Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:36.013044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:36.013843 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:01:36.014626 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 38c5a451e72540678f6037d7f743deaa. Oct 19 01:01:36.015437 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:36.021225 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2269/4555] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:01:35 2022] PATCH /identity/v3/domains/38c5a451e72540678f6037d7f743deaa => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:01:36.021723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154fba8-abe8-43b5-a57a-cfe9ff4d98ea tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:36.023595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1154fba8-abe8-43b5-a57a-cfe9ff4d98ea tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:36.188385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154fba8-abe8-43b5-a57a-cfe9ff4d98ea tempest-DomainConfigurationTestJSON-237388294 tempest-DomainConfigurationTestJSON-237388294-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:36.197128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:36.198504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:36.199060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:36.199320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] PATH_INFO: `/v3/users/cdd6f9b5d6724755831072ffefbeca20` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:36.200499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd6f9b5d6724755831072ffefbeca20)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:36.202503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:36.314808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd6f9b5d6724755831072ffefbeca20'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:36.348494 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:36.365284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd6f9b5d6724755831072ffefbeca20'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:36.380636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd6f9b5d6724755831072ffefbeca20'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:36.401054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd6f9b5d6724755831072ffefbeca20'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:36.401843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd6f9b5d6724755831072ffefbeca20'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:36.423088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd548e9f-e492-45f1-b6af-59d6816b4fdc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:36.423416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd548e9f-e492-45f1-b6af-59d6816b4fdc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:36.423657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd548e9f-e492-45f1-b6af-59d6816b4fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:36.427029 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2287/4556] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:36 2022] DELETE /identity/v3/users/cdd6f9b5d6724755831072ffefbeca20 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:36.474047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fd548e9f-e492-45f1-b6af-59d6816b4fdc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:36.475627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fd548e9f-e492-45f1-b6af-59d6816b4fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:36.653696 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2270/4557] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:36.664659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:36.665934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:36.858199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e82c-e2de-4b3b-ae16-3e4b221f891c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:36.862312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc610c2-f35a-4fd2-8935-7b1533248918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:36.863795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc610c2-f35a-4fd2-8935-7b1533248918 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:36.864225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc610c2-f35a-4fd2-8935-7b1533248918 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:36.864595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc610c2-f35a-4fd2-8935-7b1533248918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:36.876192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc610c2-f35a-4fd2-8935-7b1533248918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:36.877769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc610c2-f35a-4fd2-8935-7b1533248918 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:36.898552 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2288/4558] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:01:37.332508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd548e9f-e492-45f1-b6af-59d6816b4fdc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:37.334675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fd548e9f-e492-45f1-b6af-59d6816b4fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:37.376961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd548e9f-e492-45f1-b6af-59d6816b4fdc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:37.391120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:37.401229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:37.401859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:37.402776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] PATH_INFO: `/v3/projects/fa6f2c0ec5924bc6b2d91b9f884a28fb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:37.404350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6f2c0ec5924bc6b2d91b9f884a28fb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:37.411457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:37.496736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6f2c0ec5924bc6b2d91b9f884a28fb', 'request_id': 'req-b179f56c-6149-41f4-bd7f-5bcccb83894e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.509350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6f2c0ec5924bc6b2d91b9f884a28fb', 'request_id': 'req-b179f56c-6149-41f4-bd7f-5bcccb83894e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.516495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6f2c0ec5924bc6b2d91b9f884a28fb', 'request_id': 'req-b179f56c-6149-41f4-bd7f-5bcccb83894e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.532971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] The token cache is being invalidate because project fa6f2c0ec5924bc6b2d91b9f884a28fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:37.533377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.534121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.537466 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2271/4559] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:37 2022] DELETE /identity/v3/projects/fa6f2c0ec5924bc6b2d91b9f884a28fb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:37.541467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc610c2-f35a-4fd2-8935-7b1533248918 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:37.554406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc610c2-f35a-4fd2-8935-7b1533248918 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:37.694612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:37.695382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:37.695771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:37.696145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] PATH_INFO: `/v3/users/5c440c4af20d40769ff2dfa6d8852e12` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:37.697673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c440c4af20d40769ff2dfa6d8852e12)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:37.699963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:37.750479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:37.760788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:37.824006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c440c4af20d40769ff2dfa6d8852e12'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.850293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179f56c-6149-41f4-bd7f-5bcccb83894e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:37.852253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c440c4af20d40769ff2dfa6d8852e12'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.854440 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:37.855595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a8e30-c996-49aa-9fcc-2e0d26392018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:37.856466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a8e30-c996-49aa-9fcc-2e0d26392018 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:37.857124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a8e30-c996-49aa-9fcc-2e0d26392018 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:37.857632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a8e30-c996-49aa-9fcc-2e0d26392018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:37.870309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c440c4af20d40769ff2dfa6d8852e12'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.870839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4d3a8e30-c996-49aa-9fcc-2e0d26392018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:37.884417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c440c4af20d40769ff2dfa6d8852e12'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.887085 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:37.887544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c440c4af20d40769ff2dfa6d8852e12'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:37.913248 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2289/4560] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:37 2022] DELETE /identity/v3/users/5c440c4af20d40769ff2dfa6d8852e12 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:37.969440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a8e30-c996-49aa-9fcc-2e0d26392018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:37.971053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a8e30-c996-49aa-9fcc-2e0d26392018 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:37.983507 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2272/4561] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:01:39.001128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:39.004800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:39.196345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89339a6b-2ef2-41ad-a2da-167f32ec8332 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:39.202129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:39.202780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:39.203065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:39.203342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] PATH_INFO: `/v3/projects/075769e958c34e8bb1524a8b6e9c273d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:39.212997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=075769e958c34e8bb1524a8b6e9c273d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:39.224904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:39.339986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075769e958c34e8bb1524a8b6e9c273d', 'request_id': 'req-d160ed37-e783-4747-95ad-79fda7202758'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:39.354752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075769e958c34e8bb1524a8b6e9c273d', 'request_id': 'req-d160ed37-e783-4747-95ad-79fda7202758'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:39.374671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075769e958c34e8bb1524a8b6e9c273d', 'request_id': 'req-d160ed37-e783-4747-95ad-79fda7202758'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:39.414128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] The token cache is being invalidate because project 075769e958c34e8bb1524a8b6e9c273d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:39.414453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:39.417528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d160ed37-e783-4747-95ad-79fda7202758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:39.420767 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2290/4562] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:38 2022] DELETE /identity/v3/projects/075769e958c34e8bb1524a8b6e9c273d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:39.426188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf952-2f1d-4207-8ba8-f9166bcae511 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:39.426646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf952-2f1d-4207-8ba8-f9166bcae511 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:39.426731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf952-2f1d-4207-8ba8-f9166bcae511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:39.479609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3c8cf952-2f1d-4207-8ba8-f9166bcae511 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:39.502948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3c8cf952-2f1d-4207-8ba8-f9166bcae511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:39.609806 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2273/4563] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:39.611872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e394-8d52-494c-a9a4-74690747342d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:39.612478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e394-8d52-494c-a9a4-74690747342d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:39.612931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e394-8d52-494c-a9a4-74690747342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:39.657853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b999e394-8d52-494c-a9a4-74690747342d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:39.662468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b999e394-8d52-494c-a9a4-74690747342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:39.680949 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2291/4564] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:39.685345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf952-2f1d-4207-8ba8-f9166bcae511 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:39.711177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf952-2f1d-4207-8ba8-f9166bcae511 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:39.721361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619cc3a-a384-426d-ae80-30303200a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:39.722535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619cc3a-a384-426d-ae80-30303200a1ab admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:39.722927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619cc3a-a384-426d-ae80-30303200a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:39.724932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619cc3a-a384-426d-ae80-30303200a1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:39.726105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619cc3a-a384-426d-ae80-30303200a1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:39.726420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619cc3a-a384-426d-ae80-30303200a1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:39.730180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619cc3a-a384-426d-ae80-30303200a1ab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:39.762588 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2274/4565] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:39.768883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e394-8d52-494c-a9a4-74690747342d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:39.797117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e394-8d52-494c-a9a4-74690747342d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:39.811445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ebb90-b9e2-4f45-a264-cb2f69c3cb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:39.812415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ebb90-b9e2-4f45-a264-cb2f69c3cb57 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:39.812884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ebb90-b9e2-4f45-a264-cb2f69c3cb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:39.813305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ebb90-b9e2-4f45-a264-cb2f69c3cb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:39.816435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ebb90-b9e2-4f45-a264-cb2f69c3cb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:39.822619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ebb90-b9e2-4f45-a264-cb2f69c3cb57 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:39.840858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1208948-32ac-4c95-ae72-70f67e977c9c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:39.841132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1208948-32ac-4c95-ae72-70f67e977c9c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:39.841339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1208948-32ac-4c95-ae72-70f67e977c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:39.884489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c1208948-32ac-4c95-ae72-70f67e977c9c None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:39.886987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c1208948-32ac-4c95-ae72-70f67e977c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:39.900342 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2292/4566] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:39 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:39.911781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ebb90-b9e2-4f45-a264-cb2f69c3cb57 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:39.983302 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:40.012167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ebb90-b9e2-4f45-a264-cb2f69c3cb57 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:40.026236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d97e-e47d-4e17-bc60-e23772767ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:40.027133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d97e-e47d-4e17-bc60-e23772767ddc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:40.028990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d97e-e47d-4e17-bc60-e23772767ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:40.029686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d97e-e47d-4e17-bc60-e23772767ddc admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:40.031285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d97e-e47d-4e17-bc60-e23772767ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:40.034383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d97e-e47d-4e17-bc60-e23772767ddc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:40.107448 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2293/4567] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:01:39 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:40.112059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d97e-e47d-4e17-bc60-e23772767ddc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:40.126726 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2275/4568] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:01:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:40.152279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d97e-e47d-4e17-bc60-e23772767ddc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:40.154433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1208948-32ac-4c95-ae72-70f67e977c9c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:40.156080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c1208948-32ac-4c95-ae72-70f67e977c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:40.165358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349445-40ef-4fc4-a196-4264995b5838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:40.166090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349445-40ef-4fc4-a196-4264995b5838 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:40.166436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349445-40ef-4fc4-a196-4264995b5838 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:40.167257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349445-40ef-4fc4-a196-4264995b5838 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:40.170290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b349445-40ef-4fc4-a196-4264995b5838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:40.172049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b349445-40ef-4fc4-a196-4264995b5838 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:40.197634 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2294/4569] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:40.200697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349445-40ef-4fc4-a196-4264995b5838 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:40.228139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349445-40ef-4fc4-a196-4264995b5838 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:40.240799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fab9d4-5b09-430d-bf5b-a5a24dbf7311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:40.241455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fab9d4-5b09-430d-bf5b-a5a24dbf7311 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:40.241728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fab9d4-5b09-430d-bf5b-a5a24dbf7311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:40.242000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fab9d4-5b09-430d-bf5b-a5a24dbf7311 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:40.242666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fab9d4-5b09-430d-bf5b-a5a24dbf7311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:40.244285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fab9d4-5b09-430d-bf5b-a5a24dbf7311 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:40.275121 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2295/4570] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:40.276576 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:40.281471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fab9d4-5b09-430d-bf5b-a5a24dbf7311 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:40.301527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fab9d4-5b09-430d-bf5b-a5a24dbf7311 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:40.308517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4796cae-23f0-4f4c-9c24-6350e9392fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:40.309388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4796cae-23f0-4f4c-9c24-6350e9392fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:40.309663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4796cae-23f0-4f4c-9c24-6350e9392fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:40.309947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4796cae-23f0-4f4c-9c24-6350e9392fe0 admin admin] PATH_INFO: `/v3/projects/b548cc878b194612bff918f519633292/users/38d7f2f408934bfba9c260d7efad7d6b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:40.329378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4796cae-23f0-4f4c-9c24-6350e9392fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b548cc878b194612bff918f519633292, user_id=38d7f2f408934bfba9c260d7efad7d6b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:40.331741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1208948-32ac-4c95-ae72-70f67e977c9c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:40.332654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4796cae-23f0-4f4c-9c24-6350e9392fe0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:40.353747 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2296/4571] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:40 2022] PUT /identity/v3/projects/b548cc878b194612bff918f519633292/users/38d7f2f408934bfba9c260d7efad7d6b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:40.365021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8c22f-6608-4c4d-871e-bf07ee885efe None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:40.365454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8c22f-6608-4c4d-871e-bf07ee885efe None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:40.365831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8c22f-6608-4c4d-871e-bf07ee885efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:40.434045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3ff8c22f-6608-4c4d-871e-bf07ee885efe None None] MFA Rules not processed for user `38d7f2f408934bfba9c260d7efad7d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:40.436654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3ff8c22f-6608-4c4d-871e-bf07ee885efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:40.477567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f8ee3-2de3-4e96-be37-523519efe727 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:40.478757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f8ee3-2de3-4e96-be37-523519efe727 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:40.479187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f8ee3-2de3-4e96-be37-523519efe727 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:40.479606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f8ee3-2de3-4e96-be37-523519efe727 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:40.611330 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2297/4572] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:01:40.612124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8c22f-6608-4c4d-871e-bf07ee885efe None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:40.692949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f8ee3-2de3-4e96-be37-523519efe727 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:40.694587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f8ee3-2de3-4e96-be37-523519efe727 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:40.735284 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2276/4573] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:01:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:01:40.754271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8c22f-6608-4c4d-871e-bf07ee885efe None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:40.771935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da524-148f-43a8-a9c9-554ebf430a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:40.772860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da524-148f-43a8-a9c9-554ebf430a53 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:40.773242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da524-148f-43a8-a9c9-554ebf430a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:40.773617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8da524-148f-43a8-a9c9-554ebf430a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:40.774357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8da524-148f-43a8-a9c9-554ebf430a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:40.778099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8da524-148f-43a8-a9c9-554ebf430a53 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:40.833089 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2298/4574] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:40 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:40.833930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f8ee3-2de3-4e96-be37-523519efe727 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:40.848369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f8ee3-2de3-4e96-be37-523519efe727 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:41.051933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22616adf-d9f6-49de-be5d-88100241f13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:41.052606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22616adf-d9f6-49de-be5d-88100241f13f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:41.052930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22616adf-d9f6-49de-be5d-88100241f13f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:41.053209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22616adf-d9f6-49de-be5d-88100241f13f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:41.053846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22616adf-d9f6-49de-be5d-88100241f13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:41.061227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22616adf-d9f6-49de-be5d-88100241f13f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:41.127775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da524-148f-43a8-a9c9-554ebf430a53 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:41.134566 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:41.140453 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2277/4575] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:01:40 2022] POST /identity/v3/users => generated 298 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:41.145328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8da524-148f-43a8-a9c9-554ebf430a53 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:41.171095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596db88-dd4c-495a-ae5f-03d39324b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:41.172585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596db88-dd4c-495a-ae5f-03d39324b0af admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:41.173032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596db88-dd4c-495a-ae5f-03d39324b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:41.173369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596db88-dd4c-495a-ae5f-03d39324b0af admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:41.174086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596db88-dd4c-495a-ae5f-03d39324b0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:41.181340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596db88-dd4c-495a-ae5f-03d39324b0af admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:41.218050 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2299/4576] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:41.222795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22616adf-d9f6-49de-be5d-88100241f13f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:41.248341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22616adf-d9f6-49de-be5d-88100241f13f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:41.262237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db0cdf-31c5-4aee-9bbc-d69765a7c226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:41.263116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db0cdf-31c5-4aee-9bbc-d69765a7c226 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:41.263712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db0cdf-31c5-4aee-9bbc-d69765a7c226 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:41.264388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db0cdf-31c5-4aee-9bbc-d69765a7c226 admin admin] PATH_INFO: `/v3/projects/a449b879786a497598f4a61e0ed66d6f/users/a6a46e2742674aacb2493fe69b106a35/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:41.290016 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:41.303061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db0cdf-31c5-4aee-9bbc-d69765a7c226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a449b879786a497598f4a61e0ed66d6f, user_id=a6a46e2742674aacb2493fe69b106a35, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:41.306002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db0cdf-31c5-4aee-9bbc-d69765a7c226 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:41.334019 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2278/4577] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:41 2022] PUT /identity/v3/projects/a449b879786a497598f4a61e0ed66d6f/users/a6a46e2742674aacb2493fe69b106a35/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:41.338247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596db88-dd4c-495a-ae5f-03d39324b0af admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:41.357776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596db88-dd4c-495a-ae5f-03d39324b0af admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:41.544338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f700b9-038c-4ad2-b08e-f65b4453e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:41.544338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f700b9-038c-4ad2-b08e-f65b4453e307 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:41.544811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f700b9-038c-4ad2-b08e-f65b4453e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:41.544970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f700b9-038c-4ad2-b08e-f65b4453e307 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:41.545960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f700b9-038c-4ad2-b08e-f65b4453e307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:41.547827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f700b9-038c-4ad2-b08e-f65b4453e307 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:41.579699 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2300/4578] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:41.580159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db0cdf-31c5-4aee-9bbc-d69765a7c226 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:41.599015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db0cdf-31c5-4aee-9bbc-d69765a7c226 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:41.609371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c99c5-2de6-4f9a-afa4-6322d34f96bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:41.610064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c99c5-2de6-4f9a-afa4-6322d34f96bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:41.610349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c99c5-2de6-4f9a-afa4-6322d34f96bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:41.610624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c99c5-2de6-4f9a-afa4-6322d34f96bf admin admin] PATH_INFO: `/v3/projects/a449b879786a497598f4a61e0ed66d6f/users/a6a46e2742674aacb2493fe69b106a35/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:41.617324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c99c5-2de6-4f9a-afa4-6322d34f96bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a449b879786a497598f4a61e0ed66d6f, user_id=a6a46e2742674aacb2493fe69b106a35, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:41.620859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c99c5-2de6-4f9a-afa4-6322d34f96bf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:41.660297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5aba6-592d-4c06-8b96-a1c245a59b17 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:41.660297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5aba6-592d-4c06-8b96-a1c245a59b17 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:41.660297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5aba6-592d-4c06-8b96-a1c245a59b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:41.662229 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2279/4579] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:41 2022] PUT /identity/v3/projects/a449b879786a497598f4a61e0ed66d6f/users/a6a46e2742674aacb2493fe69b106a35/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:41.736938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-89b5aba6-592d-4c06-8b96-a1c245a59b17 None None] MFA Rules not processed for user `a6a46e2742674aacb2493fe69b106a35`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:41.736938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-89b5aba6-592d-4c06-8b96-a1c245a59b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:41.894950 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2301/4580] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:41.896275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c99c5-2de6-4f9a-afa4-6322d34f96bf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:41.937673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c99c5-2de6-4f9a-afa4-6322d34f96bf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:41.952037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e41d8-6c56-49a6-a3e9-c38a1f8dcd00 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:41.960730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e41d8-6c56-49a6-a3e9-c38a1f8dcd00 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:41.960730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e41d8-6c56-49a6-a3e9-c38a1f8dcd00 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:41.961015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e41d8-6c56-49a6-a3e9-c38a1f8dcd00 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:41.961652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e41d8-6c56-49a6-a3e9-c38a1f8dcd00 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:41.964096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e41d8-6c56-49a6-a3e9-c38a1f8dcd00 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-2f8e41d8-6c56-49a6-a3e9-c38a1f8dcd00 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invalid input for field 'name': '' is too short Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'minLength' in schema['properties']['name']: Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: On instance['name']: Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'minLength' in schema['properties']['name']: Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: On instance['name']: Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: '' Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise error Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['name']: Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application '' Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:42.002359 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 19 01:01:42.005547 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 19 01:01:42.006504 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 19 01:01:42.006504 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 19 01:01:42.006504 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:42.006504 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 19 01:01:42.006504 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 01:01:42.006504 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:42.006504 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['name']: Oct 19 01:01:42.006504 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application '' Oct 19 01:01:42.006504 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:42.010693 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2280/4581] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:01:41 2022] POST /identity/v3/domains => generated 283 bytes in 115 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 01:01:42.012936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5aba6-592d-4c06-8b96-a1c245a59b17 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:42.040595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5aba6-592d-4c06-8b96-a1c245a59b17 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:42.070273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff11d6-786b-4692-a406-98d509b22103 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:42.082252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff11d6-786b-4692-a406-98d509b22103 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:42.082861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff11d6-786b-4692-a406-98d509b22103 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:42.082952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff11d6-786b-4692-a406-98d509b22103 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:42.084045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff11d6-786b-4692-a406-98d509b22103 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:42.085437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff11d6-786b-4692-a406-98d509b22103 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-17ff11d6-786b-4692-a406-98d509b22103 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: Failed validating 'maxLength' in schema['properties']['name']: Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: On instance['name']: Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: Failed validating 'maxLength' in schema['properties']['name']: Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: On instance['name']: Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise error Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 01:01:42.125686 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application On instance['name']: Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 19 01:01:42.126926 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application On instance['name']: Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:42.129888 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2302/4582] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:01:42 2022] POST /identity/v3/domains => generated 412 bytes in 116 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 01:01:42.134388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e41d8-6c56-49a6-a3e9-c38a1f8dcd00 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:42.152695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e41d8-6c56-49a6-a3e9-c38a1f8dcd00 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:42.177182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd342157-b7fb-4d9c-90c3-9fa10b3d13dd tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:42.177922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd342157-b7fb-4d9c-90c3-9fa10b3d13dd tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:42.178209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd342157-b7fb-4d9c-90c3-9fa10b3d13dd tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:42.180750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd342157-b7fb-4d9c-90c3-9fa10b3d13dd tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:42.180750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd342157-b7fb-4d9c-90c3-9fa10b3d13dd tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:42.182422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd342157-b7fb-4d9c-90c3-9fa10b3d13dd tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:42.225502 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2281/4583] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:01:42 2022] POST /identity/v3/domains => generated 274 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:42.227891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff11d6-786b-4692-a406-98d509b22103 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:42.255237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff11d6-786b-4692-a406-98d509b22103 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:42.442807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:42.452525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:42.452848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:42.453832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains/a4aa658a037d40748721a235d3b7b7b6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:42.511433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a4aa658a037d40748721a235d3b7b7b6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:42.517285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:42.525754 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 19 01:01:42.574550 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 19 01:01:42.575435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:42.575435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:42.575435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 19 01:01:42.575435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 19 01:01:42.575435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 19 01:01:42.575435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 19 01:01:42.575435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 19 01:01:42.575435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:42.577404 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2303/4584] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:42 2022] DELETE /identity/v3/domains/a4aa658a037d40748721a235d3b7b7b6 => generated 120 bytes in 351 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:01:42.582779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd342157-b7fb-4d9c-90c3-9fa10b3d13dd tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:42.623028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd342157-b7fb-4d9c-90c3-9fa10b3d13dd tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:42.637458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:42.638356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:42.639291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:42.639581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains/a4aa658a037d40748721a235d3b7b7b6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:42.642621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a4aa658a037d40748721a235d3b7b7b6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:42.646063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:42.704874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:42.708905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:42.767056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:42.769720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:42.776699 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2282/4585] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:01:42 2022] PATCH /identity/v3/domains/a4aa658a037d40748721a235d3b7b7b6 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:42.778930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:42.781478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:42.799379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7a75e-44c1-4268-8d2c-9b57cd8c4aea tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:42.963022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:42.966652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:42.966939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:42.967237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains/a4aa658a037d40748721a235d3b7b7b6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:42.990424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a4aa658a037d40748721a235d3b7b7b6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:42.992059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:43.071028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.084022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.195339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6', 'request_id': 'req-486391b1-4701-447b-9f7a-11bbcc4c94db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.209682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6', 'request_id': 'req-486391b1-4701-447b-9f7a-11bbcc4c94db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.222864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6', 'request_id': 'req-486391b1-4701-447b-9f7a-11bbcc4c94db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.254685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] The token cache is being invalidate because project a4aa658a037d40748721a235d3b7b7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:43.257291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.259731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.303450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6', 'request_id': 'req-486391b1-4701-447b-9f7a-11bbcc4c94db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.314470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6', 'request_id': 'req-486391b1-4701-447b-9f7a-11bbcc4c94db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.316355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a4aa658a037d40748721a235d3b7b7b6', 'request_id': 'req-486391b1-4701-447b-9f7a-11bbcc4c94db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:43.332141 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2304/4586] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:42 2022] DELETE /identity/v3/domains/a4aa658a037d40748721a235d3b7b7b6 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:43.337710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:43.352240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7927b2a-7558-40aa-afaa-2ae482b6d600 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:43.566047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf206-66c3-458d-b6df-a1520502a9c7 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:43.566995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf206-66c3-458d-b6df-a1520502a9c7 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:43.567429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf206-66c3-458d-b6df-a1520502a9c7 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:43.567875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf206-66c3-458d-b6df-a1520502a9c7 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains/c01de9c9a2c249ed9cf28e052aa06fb6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:43.577052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdf206-66c3-458d-b6df-a1520502a9c7 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-cdcdf206-66c3-458d-b6df-a1520502a9c7 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Could not find domain: c01de9c9a2c249ed9cf28e052aa06fb6.: keystone.exception.DomainNotFound: Could not find domain: c01de9c9a2c249ed9cf28e052aa06fb6. Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c01de9c9a2c249ed9cf28e052aa06fb6. Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:43.583394 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:43.584750 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:01:43.585510 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c01de9c9a2c249ed9cf28e052aa06fb6. Oct 19 01:01:43.586383 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:43.589041 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2283/4587] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:43 2022] DELETE /identity/v3/domains/c01de9c9a2c249ed9cf28e052aa06fb6 => generated 112 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:01:43.594101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:43.599870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:43.622327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486391b1-4701-447b-9f7a-11bbcc4c94db tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:43.635112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed50be-c3fd-412a-8742-fdf1d36be36d tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:43.636089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed50be-c3fd-412a-8742-fdf1d36be36d tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:43.636565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed50be-c3fd-412a-8742-fdf1d36be36d tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:43.637036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed50be-c3fd-412a-8742-fdf1d36be36d tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:43.638010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed50be-c3fd-412a-8742-fdf1d36be36d tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:43.643334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed50be-c3fd-412a-8742-fdf1d36be36d tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:43.684552 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2305/4588] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:01:43 2022] POST /identity/v3/domains => generated 252 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:43.689692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf206-66c3-458d-b6df-a1520502a9c7 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:43.711959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf206-66c3-458d-b6df-a1520502a9c7 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:43.978277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:43.979276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:43.979276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:43.979541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:43.980181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:43.982124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:44.008737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.sql.core [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-723151056' for key 'project.ixu_project_name_domain_id'") Oct 19 01:01:44.008737 n-d-master-1 devstack@keystone.service[86424]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 01:01:44.008737 n-d-master-1 devstack@keystone.service[86424]: [parameters: {'id': 'fe27173708034cee9574ce914f794840', 'name': 'tempest-domain-dup-723151056', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 01:01:44.008737 n-d-master-1 devstack@keystone.service[86424]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86424) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-723151056.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-723151056. Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application conn.query(q) Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 01:01:44.032380 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result.read() Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-723151056' for key 'project.ixu_project_name_domain_id'") Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 01:01:44.033283 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application next(self.gen) Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application yield resource Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application next(self.gen) Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise self.value Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application session.commit() Oct 19 01:01:44.034799 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.session.flush() Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application compat.raise_( Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 01:01:44.035730 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 01:01:44.036861 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application conn.query(q) Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application result.read() Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 01:01:44.037632 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-723151056' for key 'project.ixu_project_name_domain_id'") Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [parameters: {'id': 'fe27173708034cee9574ce914f794840', 'name': 'tempest-domain-dup-723151056', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:44.038444 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-723151056. Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:44.039131 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-723151056. Oct 19 01:01:44.039995 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:01:44.051044 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2284/4589] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:01:43 2022] POST /identity/v3/domains => generated 211 bytes in 362 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 01:01:44.052358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed50be-c3fd-412a-8742-fdf1d36be36d tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:44.069604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed50be-c3fd-412a-8742-fdf1d36be36d tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:44.106399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:44.109017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:44.111789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:44.113167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains/e7325cdb8cb14f59aad64823a2cd6e22` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:44.185873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e7325cdb8cb14f59aad64823a2cd6e22)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:44.188195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:44.205383 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:44.285861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.286674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.350205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.351319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.356729 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2306/4590] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:01:44 2022] PATCH /identity/v3/domains/e7325cdb8cb14f59aad64823a2cd6e22 => generated 253 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:01:44.360660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:44.363171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:44.419348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afce03f-36bb-4c14-af01-115f67ed4c4f tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:44.442101 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:44.624001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:44.624827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:44.626182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:44.626607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains/e7325cdb8cb14f59aad64823a2cd6e22` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:44.665713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e7325cdb8cb14f59aad64823a2cd6e22)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:44.668265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:44.705292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.723594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.810675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22', 'request_id': 'req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.831056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22', 'request_id': 'req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.842939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22', 'request_id': 'req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.887901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] The token cache is being invalidate because project e7325cdb8cb14f59aad64823a2cd6e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:44.888427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.889375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.907906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22', 'request_id': 'req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.909442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22', 'request_id': 'req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.912089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e7325cdb8cb14f59aad64823a2cd6e22', 'request_id': 'req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:44.959834 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2285/4591] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:01:44 2022] DELETE /identity/v3/domains/e7325cdb8cb14f59aad64823a2cd6e22 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:44.965266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:44.979794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af0c54-d436-4574-b8e3-3a619f6ad8a8 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:45.119458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02741f8-e314-49b6-8518-19528a9b6328 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a46e2742674aacb2493fe69b106a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a449b879786a497598f4a61e0ed66d6f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:45.121314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02741f8-e314-49b6-8518-19528a9b6328 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:45.121604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02741f8-e314-49b6-8518-19528a9b6328 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:45.121886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02741f8-e314-49b6-8518-19528a9b6328 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] PATH_INFO: `/v3/domains/a4aa658a037d40748721a235d3b7b7b6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:45.148815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02741f8-e314-49b6-8518-19528a9b6328 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-c02741f8-e314-49b6-8518-19528a9b6328 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Could not find domain: a4aa658a037d40748721a235d3b7b7b6.: keystone.exception.DomainNotFound: Could not find domain: a4aa658a037d40748721a235d3b7b7b6. Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a4aa658a037d40748721a235d3b7b7b6. Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:01:45.168097 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:01:45.169697 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:01:45.170885 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a4aa658a037d40748721a235d3b7b7b6. Oct 19 01:01:45.171963 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:01:45.176380 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2307/4592] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:01:44 2022] PATCH /identity/v3/domains/a4aa658a037d40748721a235d3b7b7b6 => generated 112 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:01:45.181213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:45.182956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:45.307653 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:45.328942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcfe11-7e17-4d98-a36e-4efd0174f3a5 tempest-DomainsNegativeTestJSON-1053529164 tempest-DomainsNegativeTestJSON-1053529164-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:45.338136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:45.339635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:45.340064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:45.340506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] PATH_INFO: `/v3/users/38d7f2f408934bfba9c260d7efad7d6b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:45.342076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d7f2f408934bfba9c260d7efad7d6b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:45.344419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:45.454784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d7f2f408934bfba9c260d7efad7d6b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:45.487019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d7f2f408934bfba9c260d7efad7d6b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:45.516064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d7f2f408934bfba9c260d7efad7d6b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:45.546005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d7f2f408934bfba9c260d7efad7d6b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:45.547048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d7f2f408934bfba9c260d7efad7d6b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:45.562732 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2286/4593] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:45 2022] DELETE /identity/v3/users/38d7f2f408934bfba9c260d7efad7d6b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:45.568054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9498-cdd6-4f9e-826e-7d1c8ff24cef None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:45.568543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9498-cdd6-4f9e-826e-7d1c8ff24cef None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:45.569533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9498-cdd6-4f9e-826e-7d1c8ff24cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:45.617865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a88f9498-cdd6-4f9e-826e-7d1c8ff24cef None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:45.621562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a88f9498-cdd6-4f9e-826e-7d1c8ff24cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:45.792295 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2308/4594] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:45.803698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:45.809820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:45.953571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7360738-2efa-450d-9137-3c539a57df80 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:45.958077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df8e0-f201-47c7-b90b-302f43e80aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:45.959003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df8e0-f201-47c7-b90b-302f43e80aea service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:45.959290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df8e0-f201-47c7-b90b-302f43e80aea service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:45.959563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df8e0-f201-47c7-b90b-302f43e80aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:45.976474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3df8e0-f201-47c7-b90b-302f43e80aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:45.978063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3df8e0-f201-47c7-b90b-302f43e80aea service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:45.992879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2287/4595] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:01:46.631060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9498-cdd6-4f9e-826e-7d1c8ff24cef None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:46.632605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a88f9498-cdd6-4f9e-826e-7d1c8ff24cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:46.687441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9498-cdd6-4f9e-826e-7d1c8ff24cef None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:46.723465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:46.724124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:46.727408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:46.727695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] PATH_INFO: `/v3/projects/b548cc878b194612bff918f519633292` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:46.741053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b548cc878b194612bff918f519633292)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:46.743009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:46.877305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b548cc878b194612bff918f519633292', 'request_id': 'req-60eec046-8194-42d0-ae0c-c390e7e87265'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:46.887386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b548cc878b194612bff918f519633292', 'request_id': 'req-60eec046-8194-42d0-ae0c-c390e7e87265'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:46.893474 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:46.898396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b548cc878b194612bff918f519633292', 'request_id': 'req-60eec046-8194-42d0-ae0c-c390e7e87265'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:46.941362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] The token cache is being invalidate because project b548cc878b194612bff918f519633292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:46.942439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:46.943239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:46.947027 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2309/4596] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:46 2022] DELETE /identity/v3/projects/b548cc878b194612bff918f519633292 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:46.951160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df8e0-f201-47c7-b90b-302f43e80aea service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:46.965012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df8e0-f201-47c7-b90b-302f43e80aea service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:47.103048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:47.103718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:47.103991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:47.104374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] PATH_INFO: `/v3/users/a6a46e2742674aacb2493fe69b106a35` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:47.105809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a46e2742674aacb2493fe69b106a35)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:47.107720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:47.165179 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:47.272239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a46e2742674aacb2493fe69b106a35'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:47.313868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a46e2742674aacb2493fe69b106a35'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:47.331383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a46e2742674aacb2493fe69b106a35'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:47.345887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a46e2742674aacb2493fe69b106a35'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:47.348794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e9bb1d3e-8c75-4a96-ba38-93b3542b4a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a46e2742674aacb2493fe69b106a35'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:47.374612 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2288/4597] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:46 2022] DELETE /identity/v3/users/a6a46e2742674aacb2493fe69b106a35 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:48.235665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:48.238636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:48.271365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eec046-8194-42d0-ae0c-c390e7e87265 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:48.430042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:48.430937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:48.431328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:48.431714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] PATH_INFO: `/v3/projects/a449b879786a497598f4a61e0ed66d6f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:48.433463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a449b879786a497598f4a61e0ed66d6f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:48.440831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:48.568965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a449b879786a497598f4a61e0ed66d6f', 'request_id': 'req-e3437d4e-021e-49a2-87f6-537e28fce26b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:48.590171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a449b879786a497598f4a61e0ed66d6f', 'request_id': 'req-e3437d4e-021e-49a2-87f6-537e28fce26b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:48.602040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a449b879786a497598f4a61e0ed66d6f', 'request_id': 'req-e3437d4e-021e-49a2-87f6-537e28fce26b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:48.626757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] The token cache is being invalidate because project a449b879786a497598f4a61e0ed66d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:48.627417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:48.628976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e3437d4e-021e-49a2-87f6-537e28fce26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:48.633055 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2310/4598] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:48 2022] DELETE /identity/v3/projects/a449b879786a497598f4a61e0ed66d6f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:48.638707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f5a1-ea04-4e0e-8d40-903b69e7ad0e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:48.639190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f5a1-ea04-4e0e-8d40-903b69e7ad0e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:48.639263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f5a1-ea04-4e0e-8d40-903b69e7ad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:48.714600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bed4f5a1-ea04-4e0e-8d40-903b69e7ad0e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:48.717650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bed4f5a1-ea04-4e0e-8d40-903b69e7ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:48.730474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bd72b-c732-4dcd-b99b-4e328e65b0e1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:48.730474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bd72b-c732-4dcd-b99b-4e328e65b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:48.730474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bd72b-c732-4dcd-b99b-4e328e65b0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:48.768790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-379bd72b-c732-4dcd-b99b-4e328e65b0e1 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:48.771568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-379bd72b-c732-4dcd-b99b-4e328e65b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:48.909615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2311/4599] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:01:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:01:48.926618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bd72b-c732-4dcd-b99b-4e328e65b0e1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:48.928374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-379bd72b-c732-4dcd-b99b-4e328e65b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:48.972457 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2289/4600] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:48.976073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545358c-4c92-4854-a5c8-3fcd503e09fe None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:48.976378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545358c-4c92-4854-a5c8-3fcd503e09fe None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:48.976676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545358c-4c92-4854-a5c8-3fcd503e09fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:49.017701 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:49.058784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7545358c-4c92-4854-a5c8-3fcd503e09fe None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:49.067226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7545358c-4c92-4854-a5c8-3fcd503e09fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:49.088446 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2290/4601] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:49.091686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545358c-4c92-4854-a5c8-3fcd503e09fe None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:49.122492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545358c-4c92-4854-a5c8-3fcd503e09fe None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:49.146333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c59f-6ef3-4dd5-97e4-6acad4502964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:49.149030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bd72b-c732-4dcd-b99b-4e328e65b0e1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:49.149269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c59f-6ef3-4dd5-97e4-6acad4502964 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:49.149573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c59f-6ef3-4dd5-97e4-6acad4502964 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:49.149859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c59f-6ef3-4dd5-97e4-6acad4502964 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:49.150531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6c59f-6ef3-4dd5-97e4-6acad4502964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:49.150842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6c59f-6ef3-4dd5-97e4-6acad4502964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:49.161534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6c59f-6ef3-4dd5-97e4-6acad4502964 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:49.163289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371c8eb-2710-4c51-b1aa-3c121993e629 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:49.166051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371c8eb-2710-4c51-b1aa-3c121993e629 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:49.166373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371c8eb-2710-4c51-b1aa-3c121993e629 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:49.166655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371c8eb-2710-4c51-b1aa-3c121993e629 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:49.189905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371c8eb-2710-4c51-b1aa-3c121993e629 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:49.193588 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2291/4602] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:49.193676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371c8eb-2710-4c51-b1aa-3c121993e629 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:49.194612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c59f-6ef3-4dd5-97e4-6acad4502964 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:49.215904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c59f-6ef3-4dd5-97e4-6acad4502964 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:49.230537 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2312/4603] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:01:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:01:49.233255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c8fb8-8ec8-4469-9a40-752f7d17fd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:49.233902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c8fb8-8ec8-4469-9a40-752f7d17fd7f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:49.234268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c8fb8-8ec8-4469-9a40-752f7d17fd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:49.234442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c8fb8-8ec8-4469-9a40-752f7d17fd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:49.235163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c8fb8-8ec8-4469-9a40-752f7d17fd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:49.237312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c8fb8-8ec8-4469-9a40-752f7d17fd7f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:49.293260 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2292/4604] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:49 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:49.297518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371c8eb-2710-4c51-b1aa-3c121993e629 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:49.316459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371c8eb-2710-4c51-b1aa-3c121993e629 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:49.507917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3b84-cf61-471c-bdd2-81ce952f1e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:49.508868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3b84-cf61-471c-bdd2-81ce952f1e48 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:49.508868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3b84-cf61-471c-bdd2-81ce952f1e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:49.510245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3b84-cf61-471c-bdd2-81ce952f1e48 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:49.513201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3b84-cf61-471c-bdd2-81ce952f1e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:49.522487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3b84-cf61-471c-bdd2-81ce952f1e48 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:49.575992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2313/4605] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:01:49 2022] POST /identity/v3/users => generated 286 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:49.580846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c8fb8-8ec8-4469-9a40-752f7d17fd7f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:49.596843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c8fb8-8ec8-4469-9a40-752f7d17fd7f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:49.609525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25524c6-6e3d-4df2-b744-1f22728376ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:49.610158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25524c6-6e3d-4df2-b744-1f22728376ef admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:49.610526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25524c6-6e3d-4df2-b744-1f22728376ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:49.610812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25524c6-6e3d-4df2-b744-1f22728376ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:49.611476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25524c6-6e3d-4df2-b744-1f22728376ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:49.613303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25524c6-6e3d-4df2-b744-1f22728376ef admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:49.647706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3b84-cf61-471c-bdd2-81ce952f1e48 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:49.652944 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2293/4606] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:49.666815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3b84-cf61-471c-bdd2-81ce952f1e48 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:49.673199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5898c7-fa9b-49e0-9600-6899811d8e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:49.673970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5898c7-fa9b-49e0-9600-6899811d8e21 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:49.675259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5898c7-fa9b-49e0-9600-6899811d8e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:49.675610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5898c7-fa9b-49e0-9600-6899811d8e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:49.676454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5898c7-fa9b-49e0-9600-6899811d8e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:49.688908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5898c7-fa9b-49e0-9600-6899811d8e21 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:49.714541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25524c6-6e3d-4df2-b744-1f22728376ef admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:49.725255 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2314/4607] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:49.727949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25524c6-6e3d-4df2-b744-1f22728376ef admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:49.743393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89258322-07d2-45d5-8abd-6c87f06fbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:49.744074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89258322-07d2-45d5-8abd-6c87f06fbcfe admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:49.744367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89258322-07d2-45d5-8abd-6c87f06fbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:49.744670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89258322-07d2-45d5-8abd-6c87f06fbcfe admin admin] PATH_INFO: `/v3/projects/4b7eaab0a99f4ec9a7e3db1fb9354bf3/users/fd57ed22b7164919b7822dad4b785c73/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:49.780531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89258322-07d2-45d5-8abd-6c87f06fbcfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7eaab0a99f4ec9a7e3db1fb9354bf3, user_id=fd57ed22b7164919b7822dad4b785c73, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:49.783523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89258322-07d2-45d5-8abd-6c87f06fbcfe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:49.810817 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2294/4608] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:49 2022] PUT /identity/v3/projects/4b7eaab0a99f4ec9a7e3db1fb9354bf3/users/fd57ed22b7164919b7822dad4b785c73/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:49.823157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421edec0-6bf8-4fd3-bcf2-b54d805499f2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:49.823913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421edec0-6bf8-4fd3-bcf2-b54d805499f2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:49.824361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421edec0-6bf8-4fd3-bcf2-b54d805499f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:49.903543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-421edec0-6bf8-4fd3-bcf2-b54d805499f2 None None] MFA Rules not processed for user `fd57ed22b7164919b7822dad4b785c73`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:49.904824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-421edec0-6bf8-4fd3-bcf2-b54d805499f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:50.106121 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2315/4609] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:50.110331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89258322-07d2-45d5-8abd-6c87f06fbcfe admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:50.135225 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:50.259526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89258322-07d2-45d5-8abd-6c87f06fbcfe admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:50.267192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e784da-c9c7-4daa-95af-807778a39f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:50.268637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e784da-c9c7-4daa-95af-807778a39f37 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:50.268927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e784da-c9c7-4daa-95af-807778a39f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:50.269202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e784da-c9c7-4daa-95af-807778a39f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:50.270495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e784da-c9c7-4daa-95af-807778a39f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:50.274034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e784da-c9c7-4daa-95af-807778a39f37 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:50.330080 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2295/4610] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:50 2022] POST /identity/v3/projects => generated 371 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:50.338365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421edec0-6bf8-4fd3-bcf2-b54d805499f2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:50.356362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421edec0-6bf8-4fd3-bcf2-b54d805499f2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:50.393955 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:50.459107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462fe31-6c51-456d-8b4f-d1e3fc76c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:50.459785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462fe31-6c51-456d-8b4f-d1e3fc76c8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:50.460068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462fe31-6c51-456d-8b4f-d1e3fc76c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:50.460342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462fe31-6c51-456d-8b4f-d1e3fc76c8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:50.461071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462fe31-6c51-456d-8b4f-d1e3fc76c8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:50.463388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462fe31-6c51-456d-8b4f-d1e3fc76c8f1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:50.501075 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2316/4611] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:01:50 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:50.506121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e784da-c9c7-4daa-95af-807778a39f37 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:50.538460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e784da-c9c7-4daa-95af-807778a39f37 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:50.553550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023fd70-1b76-474f-84b3-1cf0d5a2910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:50.554201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023fd70-1b76-474f-84b3-1cf0d5a2910c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:50.554481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023fd70-1b76-474f-84b3-1cf0d5a2910c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:50.554756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023fd70-1b76-474f-84b3-1cf0d5a2910c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:50.555840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023fd70-1b76-474f-84b3-1cf0d5a2910c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:50.557485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023fd70-1b76-474f-84b3-1cf0d5a2910c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:50.577985 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2296/4612] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:50.586143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462fe31-6c51-456d-8b4f-d1e3fc76c8f1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:50.610418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462fe31-6c51-456d-8b4f-d1e3fc76c8f1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:50.628578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b69fa5-abac-44a8-8964-9f606478288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:50.630458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b69fa5-abac-44a8-8964-9f606478288d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:50.630738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b69fa5-abac-44a8-8964-9f606478288d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:50.633898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b69fa5-abac-44a8-8964-9f606478288d admin admin] PATH_INFO: `/v3/projects/0d6be5534a7a40928b865d350fd6a0c7/users/0dce5824f518419ba79de021da0ac137/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:50.671929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b69fa5-abac-44a8-8964-9f606478288d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6be5534a7a40928b865d350fd6a0c7, user_id=0dce5824f518419ba79de021da0ac137, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:50.679549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b69fa5-abac-44a8-8964-9f606478288d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:50.712415 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2317/4613] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:50 2022] PUT /identity/v3/projects/0d6be5534a7a40928b865d350fd6a0c7/users/0dce5824f518419ba79de021da0ac137/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:50.714079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023fd70-1b76-474f-84b3-1cf0d5a2910c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:50.732325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023fd70-1b76-474f-84b3-1cf0d5a2910c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:50.903483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b8174-8407-454a-a286-dfe946678e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:50.906238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8174-8407-454a-a286-dfe946678e5d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:50.906238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8174-8407-454a-a286-dfe946678e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:50.906238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8174-8407-454a-a286-dfe946678e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:50.906904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b8174-8407-454a-a286-dfe946678e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:50.921042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b8174-8407-454a-a286-dfe946678e5d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:50.943486 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2297/4614] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:01:50.945093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b69fa5-abac-44a8-8964-9f606478288d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:50.957853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b69fa5-abac-44a8-8964-9f606478288d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:50.989809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fad28-3be5-4c38-b535-269f466f42dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:50.992607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fad28-3be5-4c38-b535-269f466f42dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:50.993618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fad28-3be5-4c38-b535-269f466f42dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:50.995092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fad28-3be5-4c38-b535-269f466f42dc admin admin] PATH_INFO: `/v3/projects/0d6be5534a7a40928b865d350fd6a0c7/users/0dce5824f518419ba79de021da0ac137/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:51.000144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fad28-3be5-4c38-b535-269f466f42dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6be5534a7a40928b865d350fd6a0c7, user_id=0dce5824f518419ba79de021da0ac137, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:51.008835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fad28-3be5-4c38-b535-269f466f42dc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:51.036656 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2318/4615] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:01:50 2022] PUT /identity/v3/projects/0d6be5534a7a40928b865d350fd6a0c7/users/0dce5824f518419ba79de021da0ac137/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:51.054349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feb17c-d597-4c1a-ad26-a9b78416f5f8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:51.054871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feb17c-d597-4c1a-ad26-a9b78416f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:51.055339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feb17c-d597-4c1a-ad26-a9b78416f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:51.126347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f7feb17c-d597-4c1a-ad26-a9b78416f5f8 None None] MFA Rules not processed for user `0dce5824f518419ba79de021da0ac137`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:51.127967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f7feb17c-d597-4c1a-ad26-a9b78416f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:51.222636 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2298/4616] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:51.226973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fad28-3be5-4c38-b535-269f466f42dc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:51.245826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fad28-3be5-4c38-b535-269f466f42dc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:51.256446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c57f67-2bcf-43f3-92ec-654322ef9657 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:51.257206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57f67-2bcf-43f3-92ec-654322ef9657 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:51.257476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57f67-2bcf-43f3-92ec-654322ef9657 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:51.257750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57f67-2bcf-43f3-92ec-654322ef9657 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:51.258572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c57f67-2bcf-43f3-92ec-654322ef9657 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:51.263066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c57f67-2bcf-43f3-92ec-654322ef9657 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:51.305815 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2319/4617] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:01:51 2022] POST /identity/v3/domains => generated 276 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:01:51.307020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feb17c-d597-4c1a-ad26-a9b78416f5f8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:51.318753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feb17c-d597-4c1a-ad26-a9b78416f5f8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:51.329485 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:51.446221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdccc2a-01b7-46b0-bdb0-4b7e8a2683f1 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:51.451055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdccc2a-01b7-46b0-bdb0-4b7e8a2683f1 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:51.453542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdccc2a-01b7-46b0-bdb0-4b7e8a2683f1 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:51.455313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdccc2a-01b7-46b0-bdb0-4b7e8a2683f1 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:51.456765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdccc2a-01b7-46b0-bdb0-4b7e8a2683f1 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:51.467078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdccc2a-01b7-46b0-bdb0-4b7e8a2683f1 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:51.660277 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2299/4618] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:51 2022] POST /identity/v3/projects => generated 401 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:51.664142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c57f67-2bcf-43f3-92ec-654322ef9657 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:51.682512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c57f67-2bcf-43f3-92ec-654322ef9657 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:51.844528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803653f-2d67-4bb4-ba37-534cc5f5b4db tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:51.845235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803653f-2d67-4bb4-ba37-534cc5f5b4db tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:51.845522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803653f-2d67-4bb4-ba37-534cc5f5b4db tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:51.845800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803653f-2d67-4bb4-ba37-534cc5f5b4db tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:51.846828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803653f-2d67-4bb4-ba37-534cc5f5b4db tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:51.847874 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-9803653f-2d67-4bb4-ba37-534cc5f5b4db tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:51.847874 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:51.847874 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:51.849897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803653f-2d67-4bb4-ba37-534cc5f5b4db tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:51.893580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdccc2a-01b7-46b0-bdb0-4b7e8a2683f1 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:51.895179 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2320/4619] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:01:51 2022] POST /identity/v3/groups => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:51.909911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdccc2a-01b7-46b0-bdb0-4b7e8a2683f1 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:51.917235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1906f8b-dda1-4ae6-978b-be73295543c5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:51.918187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1906f8b-dda1-4ae6-978b-be73295543c5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:51.918484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1906f8b-dda1-4ae6-978b-be73295543c5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:51.918921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1906f8b-dda1-4ae6-978b-be73295543c5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:51.919605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1906f8b-dda1-4ae6-978b-be73295543c5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:51.921746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1906f8b-dda1-4ae6-978b-be73295543c5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:51.958785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803653f-2d67-4bb4-ba37-534cc5f5b4db tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:51.972715 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2300/4620] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:01:51 2022] POST /identity/v3/users => generated 442 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:01:51.973298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803653f-2d67-4bb4-ba37-534cc5f5b4db tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:51.988614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3dd98-40d5-4eeb-8486-87ea111f04df tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:51.989279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3dd98-40d5-4eeb-8486-87ea111f04df tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:51.989694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3dd98-40d5-4eeb-8486-87ea111f04df tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:51.990118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3dd98-40d5-4eeb-8486-87ea111f04df tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:51.990826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3dd98-40d5-4eeb-8486-87ea111f04df tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:51.991892 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-58b3dd98-40d5-4eeb-8486-87ea111f04df tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:51.991892 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:51.991892 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:51.992840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3dd98-40d5-4eeb-8486-87ea111f04df tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:52.032225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1906f8b-dda1-4ae6-978b-be73295543c5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:52.041721 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2321/4621] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:01:51 2022] POST /identity/v3/roles => generated 240 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:52.056697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1906f8b-dda1-4ae6-978b-be73295543c5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:52.064600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017dfdf-bb98-4890-a6e1-aa6d1b582f7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:52.065837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90abcc4-e0f2-467a-9834-18269afbbc8d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:52.065980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017dfdf-bb98-4890-a6e1-aa6d1b582f7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:52.066148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017dfdf-bb98-4890-a6e1-aa6d1b582f7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:52.066468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017dfdf-bb98-4890-a6e1-aa6d1b582f7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/4eb80762875b4d969c433671296e8f18/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:52.066880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90abcc4-e0f2-467a-9834-18269afbbc8d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:52.067427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90abcc4-e0f2-467a-9834-18269afbbc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:52.077540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017dfdf-bb98-4890-a6e1-aa6d1b582f7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_grant(project_id=faf41c7338774f2cbf3de5bce1634587, group_id=3b2c518f9f4d4445a4ffc588534fbd21, role_id=4eb80762875b4d969c433671296e8f18)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:52.083857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017dfdf-bb98-4890-a6e1-aa6d1b582f7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:52.100911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f90abcc4-e0f2-467a-9834-18269afbbc8d None None] MFA Rules not processed for user `2190bd30671b47048aed416f9c14a545`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:52.108152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f90abcc4-e0f2-467a-9834-18269afbbc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:52.114840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2301/4622] 10.222.0.27 () {60 vars in 1585 bytes} [Wed Oct 19 01:01:52 2022] PUT /identity/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/4eb80762875b4d969c433671296e8f18/inherited_to_projects => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:52.120121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017dfdf-bb98-4890-a6e1-aa6d1b582f7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:52.199866 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:52.255585 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2322/4623] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:01:52.264462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017dfdf-bb98-4890-a6e1-aa6d1b582f7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:52.271156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:52.272023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:52.272449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:52.272926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/4eb80762875b4d969c433671296e8f18/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:52.276461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:check_grant(project_id=faf41c7338774f2cbf3de5bce1634587, group_id=3b2c518f9f4d4445a4ffc588534fbd21, role_id=4eb80762875b4d969c433671296e8f18)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:52.278865 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:52.278865 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:52.278865 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:52.282265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:52.294323 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2302/4624] 10.222.0.27 () {58 vars in 1567 bytes} [Wed Oct 19 01:01:52 2022] HEAD /identity/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/4eb80762875b4d969c433671296e8f18/inherited_to_projects => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:52.299452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90abcc4-e0f2-467a-9834-18269afbbc8d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:52.329680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90abcc4-e0f2-467a-9834-18269afbbc8d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:52.338282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:52.339101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:52.339378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:52.339744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/4eb80762875b4d969c433671296e8f18/inherited_to_projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:52.343317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=faf41c7338774f2cbf3de5bce1634587, group_id=3b2c518f9f4d4445a4ffc588534fbd21, role_id=4eb80762875b4d969c433671296e8f18)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:52.345908 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:52.345908 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:52.345908 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:52.349208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:52.369378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 4eb80762875b4d969c433671296e8f18 was removed from group 3b2c518f9f4d4445a4ffc588534fbd21 on project faf41c7338774f2cbf3de5bce1634587. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:52.369681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:52.370440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:52.418500 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2323/4625] 10.222.0.27 () {58 vars in 1569 bytes} [Wed Oct 19 01:01:52 2022] DELETE /identity/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/4eb80762875b4d969c433671296e8f18/inherited_to_projects => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:52.419697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:52.421662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:52.475812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ee12c-141f-409d-b630-9cd611c402aa tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:52.537732 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:52.562074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:52.562767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:52.564247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:52.564539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles/4eb80762875b4d969c433671296e8f18` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:52.567109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4eb80762875b4d969c433671296e8f18)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:52.571344 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:52.571344 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:52.571344 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:52.572288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:52.682218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 4eb80762875b4d969c433671296e8f18 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:52.682575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:52.683286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:52.689743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2303/4626] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:52 2022] DELETE /identity/v3/roles/4eb80762875b4d969c433671296e8f18 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:52.692547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:52.704051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1b6c-c595-4f97-87d5-02c779898b7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:52.797887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb446e-7385-462c-8f7e-40e99ea55e7e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:52.798501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb446e-7385-462c-8f7e-40e99ea55e7e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:52.798791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb446e-7385-462c-8f7e-40e99ea55e7e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:52.799067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb446e-7385-462c-8f7e-40e99ea55e7e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:52.800645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb446e-7385-462c-8f7e-40e99ea55e7e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:52.814640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb446e-7385-462c-8f7e-40e99ea55e7e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:52.858748 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2324/4627] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:01:52 2022] POST /identity/v3/roles => generated 240 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:52.861520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:52.863683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:52.879901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3550f-b51a-4274-95da-a2a069055934 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:52.891841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c1ed-2797-4975-9bad-92d35e360d64 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:52.893014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c1ed-2797-4975-9bad-92d35e360d64 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:52.895225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c1ed-2797-4975-9bad-92d35e360d64 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:52.896316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c1ed-2797-4975-9bad-92d35e360d64 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/cb2a5e5d8f574410b6e340ac46d55d9d/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:52.932402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905c1ed-2797-4975-9bad-92d35e360d64 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_grant(project_id=faf41c7338774f2cbf3de5bce1634587, user_id=7602efba72ac42e899faf1a738165dc5, role_id=cb2a5e5d8f574410b6e340ac46d55d9d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:52.936291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905c1ed-2797-4975-9bad-92d35e360d64 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:52.969612 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2304/4628] 10.222.0.27 () {60 vars in 1582 bytes} [Wed Oct 19 01:01:52 2022] PUT /identity/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/cb2a5e5d8f574410b6e340ac46d55d9d/inherited_to_projects => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:52.971129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb446e-7385-462c-8f7e-40e99ea55e7e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:53.013688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb446e-7385-462c-8f7e-40e99ea55e7e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:53.195199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:53.196651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:53.197064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:53.197600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/cb2a5e5d8f574410b6e340ac46d55d9d/inherited_to_projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:53.202503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:check_grant(project_id=faf41c7338774f2cbf3de5bce1634587, user_id=7602efba72ac42e899faf1a738165dc5, role_id=cb2a5e5d8f574410b6e340ac46d55d9d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:53.205718 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:53.205718 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:53.205718 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:53.208548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:53.240152 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2325/4629] 10.222.0.27 () {58 vars in 1564 bytes} [Wed Oct 19 01:01:52 2022] HEAD /identity/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/cb2a5e5d8f574410b6e340ac46d55d9d/inherited_to_projects => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:53.243524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c1ed-2797-4975-9bad-92d35e360d64 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:53.261175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c1ed-2797-4975-9bad-92d35e360d64 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:53.280342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:53.281053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:53.281336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:53.281617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/cb2a5e5d8f574410b6e340ac46d55d9d/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:53.310606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=faf41c7338774f2cbf3de5bce1634587, user_id=7602efba72ac42e899faf1a738165dc5, role_id=cb2a5e5d8f574410b6e340ac46d55d9d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:53.311671 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:53.311671 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:53.311671 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:53.313887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:53.335505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role cb2a5e5d8f574410b6e340ac46d55d9d was removed from user 7602efba72ac42e899faf1a738165dc5 on project faf41c7338774f2cbf3de5bce1634587. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:53.335846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:53.341058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:53.385083 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2305/4630] 10.222.0.27 () {58 vars in 1566 bytes} [Wed Oct 19 01:01:53 2022] DELETE /identity/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/cb2a5e5d8f574410b6e340ac46d55d9d/inherited_to_projects => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:53.388910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:53.390892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:53.411924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0d71-5c9e-4fff-b2ea-9edeb7056903 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:53.517474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:53.519039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:53.519369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:53.520145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles/cb2a5e5d8f574410b6e340ac46d55d9d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:53.522487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cb2a5e5d8f574410b6e340ac46d55d9d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:53.523674 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:53.523674 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:53.523674 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:53.524973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:53.528497 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:53.681501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role cb2a5e5d8f574410b6e340ac46d55d9d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:53.683023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:53.684097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:53.696968 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2326/4631] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:53 2022] DELETE /identity/v3/roles/cb2a5e5d8f574410b6e340ac46d55d9d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:53.701869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:53.718927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fcdf1-9940-44d1-9770-9f0bc5dd1011 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:53.906226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d0e1a-123a-4832-a842-295361a45feb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:53.907649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d0e1a-123a-4832-a842-295361a45feb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:53.909759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d0e1a-123a-4832-a842-295361a45feb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:53.910269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d0e1a-123a-4832-a842-295361a45feb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:53.913072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d0e1a-123a-4832-a842-295361a45feb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:53.914326 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-4b5d0e1a-123a-4832-a842-295361a45feb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:53.914326 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:53.914326 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:53.917968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d0e1a-123a-4832-a842-295361a45feb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:53.952289 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2306/4632] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:01:53 2022] POST /identity/v3/roles => generated 239 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:53.956918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:53.958714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:53.998217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faead8-8987-4df1-83ae-16a5043e622a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:54.011279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cec18-e742-4fc0-9768-fc530a5b8bfb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:54.012273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cec18-e742-4fc0-9768-fc530a5b8bfb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:54.012828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cec18-e742-4fc0-9768-fc530a5b8bfb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:54.013355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cec18-e742-4fc0-9768-fc530a5b8bfb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/8206e3cced144adbad75d78c9083160c/inherited_to_projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:54.018828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cec18-e742-4fc0-9768-fc530a5b8bfb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, group_id=3b2c518f9f4d4445a4ffc588534fbd21, role_id=8206e3cced144adbad75d78c9083160c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:54.024110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cec18-e742-4fc0-9768-fc530a5b8bfb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:54.076419 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2327/4633] 10.222.0.27 () {60 vars in 1582 bytes} [Wed Oct 19 01:01:53 2022] PUT /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/8206e3cced144adbad75d78c9083160c/inherited_to_projects => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:54.080282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d0e1a-123a-4832-a842-295361a45feb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:54.098365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d0e1a-123a-4832-a842-295361a45feb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:54.215164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8410f8-866e-4b94-a111-4393c39bc4b7 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:54.216045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8410f8-866e-4b94-a111-4393c39bc4b7 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:54.216739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8410f8-866e-4b94-a111-4393c39bc4b7 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:54.216993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8410f8-866e-4b94-a111-4393c39bc4b7 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:54.220071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8410f8-866e-4b94-a111-4393c39bc4b7 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, group_id=3b2c518f9f4d4445a4ffc588534fbd21)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:54.224340 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-4a8410f8-866e-4b94-a111-4393c39bc4b7 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:54.224340 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:54.224340 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:54.233323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8410f8-866e-4b94-a111-4393c39bc4b7 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:54.248080 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:54.275406 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2307/4634] 10.222.0.27 () {58 vars in 1464 bytes} [Wed Oct 19 01:01:54 2022] GET /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/inherited_to_projects => generated 447 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:54.276324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cec18-e742-4fc0-9768-fc530a5b8bfb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:54.301337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cec18-e742-4fc0-9768-fc530a5b8bfb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:54.314882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc1ffe-b673-45a9-a623-afc7e0e88a8d tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:54.315783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc1ffe-b673-45a9-a623-afc7e0e88a8d tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:54.317002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc1ffe-b673-45a9-a623-afc7e0e88a8d tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:54.319859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc1ffe-b673-45a9-a623-afc7e0e88a8d tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/8206e3cced144adbad75d78c9083160c/inherited_to_projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:54.335517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc1ffe-b673-45a9-a623-afc7e0e88a8d tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, group_id=3b2c518f9f4d4445a4ffc588534fbd21, role_id=8206e3cced144adbad75d78c9083160c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:54.340903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc1ffe-b673-45a9-a623-afc7e0e88a8d tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:54.362970 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2328/4635] 10.222.0.27 () {58 vars in 1564 bytes} [Wed Oct 19 01:01:54 2022] HEAD /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/8206e3cced144adbad75d78c9083160c/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:01:54.367709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8410f8-866e-4b94-a111-4393c39bc4b7 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:54.385330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8410f8-866e-4b94-a111-4393c39bc4b7 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:54.398257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:54.400046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:54.400474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:54.400959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/8206e3cced144adbad75d78c9083160c/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:54.403911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, group_id=3b2c518f9f4d4445a4ffc588534fbd21, role_id=8206e3cced144adbad75d78c9083160c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:54.407282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:54.430714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 8206e3cced144adbad75d78c9083160c was removed from group 3b2c518f9f4d4445a4ffc588534fbd21 on domain 9bfaa453cb8f4299b2175169b89dc6b7. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:54.431028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:54.434346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:54.492333 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2308/4636] 10.222.0.27 () {58 vars in 1566 bytes} [Wed Oct 19 01:01:54 2022] DELETE /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/groups/3b2c518f9f4d4445a4ffc588534fbd21/roles/8206e3cced144adbad75d78c9083160c/inherited_to_projects => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:54.497128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc1ffe-b673-45a9-a623-afc7e0e88a8d tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:54.500015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eedc1ffe-b673-45a9-a623-afc7e0e88a8d tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:54.537012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc1ffe-b673-45a9-a623-afc7e0e88a8d tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:54.674459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:54.677745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:54.677745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:54.677745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles/8206e3cced144adbad75d78c9083160c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:54.680877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8206e3cced144adbad75d78c9083160c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:54.685747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:54.763216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 8206e3cced144adbad75d78c9083160c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:54.763889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:54.764397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:54.766958 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2329/4637] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:54 2022] DELETE /identity/v3/roles/8206e3cced144adbad75d78c9083160c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:54.772553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:54.793285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e722663-6566-4e7e-b44e-b12f5b2a0490 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:54.979848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea6522-4cc7-42f1-a29c-2ad6df422def tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:54.983493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea6522-4cc7-42f1-a29c-2ad6df422def tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:54.984145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea6522-4cc7-42f1-a29c-2ad6df422def tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:54.984682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea6522-4cc7-42f1-a29c-2ad6df422def tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:54.987188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea6522-4cc7-42f1-a29c-2ad6df422def tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:54.989376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea6522-4cc7-42f1-a29c-2ad6df422def tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:55.026708 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2309/4638] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:01:54 2022] POST /identity/v3/roles => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:55.030487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:55.032637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:55.054038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926525-6d86-4087-9b06-bc9feee68085 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:55.068278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e49ec-9973-4aed-bc6b-c9e797390fa9 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:55.069297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e49ec-9973-4aed-bc6b-c9e797390fa9 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:55.070816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e49ec-9973-4aed-bc6b-c9e797390fa9 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:55.072495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e49ec-9973-4aed-bc6b-c9e797390fa9 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/59a6400301e24620b8e7d12d98a74d8d/inherited_to_projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:55.080127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e49ec-9973-4aed-bc6b-c9e797390fa9 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, user_id=7602efba72ac42e899faf1a738165dc5, role_id=59a6400301e24620b8e7d12d98a74d8d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:55.089538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e49ec-9973-4aed-bc6b-c9e797390fa9 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:55.125075 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2330/4639] 10.222.0.27 () {60 vars in 1579 bytes} [Wed Oct 19 01:01:55 2022] PUT /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/59a6400301e24620b8e7d12d98a74d8d/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:55.126065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea6522-4cc7-42f1-a29c-2ad6df422def tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:55.139304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea6522-4cc7-42f1-a29c-2ad6df422def tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:55.279283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd7a76-65c8-4544-bb6d-d8ac5550a336 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:55.279929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd7a76-65c8-4544-bb6d-d8ac5550a336 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:55.280226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd7a76-65c8-4544-bb6d-d8ac5550a336 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:55.280499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd7a76-65c8-4544-bb6d-d8ac5550a336 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:55.285321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd7a76-65c8-4544-bb6d-d8ac5550a336 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, user_id=7602efba72ac42e899faf1a738165dc5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:55.288001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd7a76-65c8-4544-bb6d-d8ac5550a336 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:55.327575 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2310/4640] 10.222.0.27 () {58 vars in 1461 bytes} [Wed Oct 19 01:01:55 2022] GET /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/inherited_to_projects => generated 447 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:01:55.334171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e49ec-9973-4aed-bc6b-c9e797390fa9 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:55.368757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e49ec-9973-4aed-bc6b-c9e797390fa9 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:55.388952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fc3e9-311b-4ab6-8170-c4e151d1a3b8 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:55.392059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fc3e9-311b-4ab6-8170-c4e151d1a3b8 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:55.392425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fc3e9-311b-4ab6-8170-c4e151d1a3b8 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:55.392806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fc3e9-311b-4ab6-8170-c4e151d1a3b8 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/59a6400301e24620b8e7d12d98a74d8d/inherited_to_projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:55.402982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fc3e9-311b-4ab6-8170-c4e151d1a3b8 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, user_id=7602efba72ac42e899faf1a738165dc5, role_id=59a6400301e24620b8e7d12d98a74d8d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:55.416707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fc3e9-311b-4ab6-8170-c4e151d1a3b8 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:55.443513 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2331/4641] 10.222.0.27 () {58 vars in 1561 bytes} [Wed Oct 19 01:01:55 2022] HEAD /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/59a6400301e24620b8e7d12d98a74d8d/inherited_to_projects => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:55.448395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd7a76-65c8-4544-bb6d-d8ac5550a336 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:55.466058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd7a76-65c8-4544-bb6d-d8ac5550a336 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:55.482698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:55.483446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:55.483733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:55.484017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/59a6400301e24620b8e7d12d98a74d8d/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:55.493163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, user_id=7602efba72ac42e899faf1a738165dc5, role_id=59a6400301e24620b8e7d12d98a74d8d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:55.496081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:55.514558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 59a6400301e24620b8e7d12d98a74d8d was removed from user 7602efba72ac42e899faf1a738165dc5 on domain 9bfaa453cb8f4299b2175169b89dc6b7. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:55.514862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:55.517058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:55.542874 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2311/4642] 10.222.0.27 () {58 vars in 1563 bytes} [Wed Oct 19 01:01:55 2022] DELETE /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/59a6400301e24620b8e7d12d98a74d8d/inherited_to_projects => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:55.546988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fc3e9-311b-4ab6-8170-c4e151d1a3b8 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:55.548819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-590fc3e9-311b-4ab6-8170-c4e151d1a3b8 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:55.576408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fc3e9-311b-4ab6-8170-c4e151d1a3b8 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:55.718410 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:55.802626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:55.804540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:55.807878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:55.811387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles/59a6400301e24620b8e7d12d98a74d8d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:55.817641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_role(role_id=59a6400301e24620b8e7d12d98a74d8d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:55.826307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:55.986359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 59a6400301e24620b8e7d12d98a74d8d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:55.988140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:55.988926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:55.991892 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2332/4643] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:55 2022] DELETE /identity/v3/roles/59a6400301e24620b8e7d12d98a74d8d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:55.999552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:56.015635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7b839-5458-45b9-ad2b-747dd99e7785 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:56.262932 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:56.317027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d8bee-b717-4296-8e42-fbfb9f8048d5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:56.317630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d8bee-b717-4296-8e42-fbfb9f8048d5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:56.317916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d8bee-b717-4296-8e42-fbfb9f8048d5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:56.318201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d8bee-b717-4296-8e42-fbfb9f8048d5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:56.318950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d8bee-b717-4296-8e42-fbfb9f8048d5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:56.336659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d8bee-b717-4296-8e42-fbfb9f8048d5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:56.399745 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2312/4644] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:01:55 2022] POST /identity/v3/roles => generated 239 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:56.404066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:56.405390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:56.439169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef0a8-5f98-4a11-8bbe-b973f4b39561 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:56.469055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcddb2a-cd58-4614-a542-856a633686dc tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:56.469706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcddb2a-cd58-4614-a542-856a633686dc tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:56.469999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcddb2a-cd58-4614-a542-856a633686dc tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:56.470281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcddb2a-cd58-4614-a542-856a633686dc tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:56.470956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcddb2a-cd58-4614-a542-856a633686dc tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:56.473518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcddb2a-cd58-4614-a542-856a633686dc tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:56.665937 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2333/4645] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:56 2022] POST /identity/v3/projects => generated 408 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:56.680531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d8bee-b717-4296-8e42-fbfb9f8048d5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:56.685839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780cc33-16d8-4ab3-9b3e-e659fec56b30 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:56.686128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780cc33-16d8-4ab3-9b3e-e659fec56b30 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:56.686406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780cc33-16d8-4ab3-9b3e-e659fec56b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:56.695749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d8bee-b717-4296-8e42-fbfb9f8048d5 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:56.747366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d780cc33-16d8-4ab3-9b3e-e659fec56b30 None None] MFA Rules not processed for user `9ddb45b2dcf14263887a3718e23eb937`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:01:56.748716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d780cc33-16d8-4ab3-9b3e-e659fec56b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:56.914858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaae34b-5ace-4d11-9556-2512e4a8c497 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:56.917767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaae34b-5ace-4d11-9556-2512e4a8c497 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:56.918339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaae34b-5ace-4d11-9556-2512e4a8c497 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:56.918456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaae34b-5ace-4d11-9556-2512e4a8c497 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/7ed3836b022a4b8e99c58a92700bfe7d/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:56.931917 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2334/4646] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:01:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:01:56.942289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaae34b-5ace-4d11-9556-2512e4a8c497 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, user_id=7602efba72ac42e899faf1a738165dc5, role_id=7ed3836b022a4b8e99c58a92700bfe7d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:56.945024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaae34b-5ace-4d11-9556-2512e4a8c497 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:57.014882 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2313/4647] 10.222.0.27 () {60 vars in 1579 bytes} [Wed Oct 19 01:01:56 2022] PUT /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/7ed3836b022a4b8e99c58a92700bfe7d/inherited_to_projects => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:57.019113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780cc33-16d8-4ab3-9b3e-e659fec56b30 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:57.050303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780cc33-16d8-4ab3-9b3e-e659fec56b30 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:57.200958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:57.201992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:57.201992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:57.202189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:57.202851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Adding query filter params (scope.project.id=faf41c7338774f2cbf3de5bce1634587, user.id=7602efba72ac42e899faf1a738165dc5) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:57.205901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:57.207007 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:57.207007 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:01:57.207007 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:01:57.208196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:57.285321 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:57.318214 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2335/4648] 10.222.0.27 () {58 vars in 1356 bytes} [Wed Oct 19 01:01:57 2022] GET /identity/v3/role_assignments?scope.project.id=faf41c7338774f2cbf3de5bce1634587&user.id=7602efba72ac42e899faf1a738165dc5&effective => generated 648 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:01:57.320260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaae34b-5ace-4d11-9556-2512e4a8c497 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:57.340653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaae34b-5ace-4d11-9556-2512e4a8c497 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:57.358609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:57.359289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:57.359619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:57.364663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:57.367579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Adding query filter params (scope.project.id=c44e400ee8b943228d82e3bc560de6e6, user.id=7602efba72ac42e899faf1a738165dc5) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:57.369034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:57.424873 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:01:57.424873 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:01:57.424873 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:01:57.424873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:57.598379 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2314/4649] 10.222.0.27 () {58 vars in 1356 bytes} [Wed Oct 19 01:01:57 2022] GET /identity/v3/role_assignments?scope.project.id=c44e400ee8b943228d82e3bc560de6e6&user.id=7602efba72ac42e899faf1a738165dc5&effective => generated 648 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:57.599709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:57.618242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd4cc-6d32-466c-84aa-42760156b659 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:57.627061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:57.629136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:57.629758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:57.630438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/7ed3836b022a4b8e99c58a92700bfe7d/inherited_to_projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:57.634071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9bfaa453cb8f4299b2175169b89dc6b7, user_id=7602efba72ac42e899faf1a738165dc5, role_id=7ed3836b022a4b8e99c58a92700bfe7d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:57.639075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:57.648409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 7ed3836b022a4b8e99c58a92700bfe7d was removed from user 7602efba72ac42e899faf1a738165dc5 on domain 9bfaa453cb8f4299b2175169b89dc6b7. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:57.649932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:57.651295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:57.673695 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2336/4650] 10.222.0.27 () {58 vars in 1563 bytes} [Wed Oct 19 01:01:57 2022] DELETE /identity/v3/OS-INHERIT/domains/9bfaa453cb8f4299b2175169b89dc6b7/users/7602efba72ac42e899faf1a738165dc5/roles/7ed3836b022a4b8e99c58a92700bfe7d/inherited_to_projects => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:57.674427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:57.676218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:57.711649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4a1fa-a5b4-4a1c-bba9-ec233bdda575 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:57.823926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07da60-4ec9-4929-8558-34256f1c7bab tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:57.824552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07da60-4ec9-4929-8558-34256f1c7bab tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:57.824901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07da60-4ec9-4929-8558-34256f1c7bab tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:57.825180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07da60-4ec9-4929-8558-34256f1c7bab tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:57.825982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07da60-4ec9-4929-8558-34256f1c7bab tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Adding query filter params (scope.project.id=faf41c7338774f2cbf3de5bce1634587, user.id=7602efba72ac42e899faf1a738165dc5) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:57.826290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07da60-4ec9-4929-8558-34256f1c7bab tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:57.828521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07da60-4ec9-4929-8558-34256f1c7bab tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:57.879166 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:57.923305 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2315/4651] 10.222.0.27 () {58 vars in 1356 bytes} [Wed Oct 19 01:01:57 2022] GET /identity/v3/role_assignments?scope.project.id=faf41c7338774f2cbf3de5bce1634587&user.id=7602efba72ac42e899faf1a738165dc5&effective => generated 228 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:01:57.928609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:57.951231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea271eaa-b57a-4ccb-b2d4-fb9194195e44 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:57.981993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:57.982638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:57.982930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:57.983222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:57.983971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Adding query filter params (scope.project.id=c44e400ee8b943228d82e3bc560de6e6, user.id=7602efba72ac42e899faf1a738165dc5) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:57.984285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:58.002090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:58.181395 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2337/4652] 10.222.0.27 () {58 vars in 1356 bytes} [Wed Oct 19 01:01:57 2022] GET /identity/v3/role_assignments?scope.project.id=c44e400ee8b943228d82e3bc560de6e6&user.id=7602efba72ac42e899faf1a738165dc5&effective => generated 228 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:58.182786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07da60-4ec9-4929-8558-34256f1c7bab tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:58.200077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07da60-4ec9-4929-8558-34256f1c7bab tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:58.212001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:58.213029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:58.214610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:58.215054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/projects/c44e400ee8b943228d82e3bc560de6e6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:58.224190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c44e400ee8b943228d82e3bc560de6e6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:58.230756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:58.371374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44e400ee8b943228d82e3bc560de6e6', 'request_id': 'req-57b59242-715d-40a0-a626-50585732d8b0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:58.396297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44e400ee8b943228d82e3bc560de6e6', 'request_id': 'req-57b59242-715d-40a0-a626-50585732d8b0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:58.405589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44e400ee8b943228d82e3bc560de6e6', 'request_id': 'req-57b59242-715d-40a0-a626-50585732d8b0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:58.475379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] The token cache is being invalidate because project c44e400ee8b943228d82e3bc560de6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:58.475683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:58.481690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:58.488609 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2316/4653] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:58 2022] DELETE /identity/v3/projects/c44e400ee8b943228d82e3bc560de6e6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:58.492772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:58.494732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:58.528976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf52d32-0760-4c4b-a5b4-2ca97cd9f23e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:58.715435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:58.716408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:58.716828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:58.717201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles/7ed3836b022a4b8e99c58a92700bfe7d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:58.726619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7ed3836b022a4b8e99c58a92700bfe7d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:58.728501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:58.827051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 7ed3836b022a4b8e99c58a92700bfe7d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:01:58.827488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:58.828785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:01:58.840149 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2338/4654] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:01:58 2022] DELETE /identity/v3/roles/7ed3836b022a4b8e99c58a92700bfe7d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:58.841810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:58.857144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b59242-715d-40a0-a626-50585732d8b0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:59.072546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f5f2d-6120-4c44-a70f-22b6b1ad574a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:59.075266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f5f2d-6120-4c44-a70f-22b6b1ad574a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:59.075745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f5f2d-6120-4c44-a70f-22b6b1ad574a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:59.076036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f5f2d-6120-4c44-a70f-22b6b1ad574a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:59.079050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f5f2d-6120-4c44-a70f-22b6b1ad574a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:59.081715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f5f2d-6120-4c44-a70f-22b6b1ad574a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:59.137474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:59.138886 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2317/4655] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:01:58 2022] POST /identity/v3/roles => generated 239 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:59.139979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:01:59.169581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c7506-ea41-4b61-b726-9f59647eaa3e tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:59.191811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8565dd-159d-4a17-bc16-d0f7b0ebca7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:59.192658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8565dd-159d-4a17-bc16-d0f7b0ebca7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:59.194610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8565dd-159d-4a17-bc16-d0f7b0ebca7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:59.196834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8565dd-159d-4a17-bc16-d0f7b0ebca7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:59.197624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8565dd-159d-4a17-bc16-d0f7b0ebca7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:59.205698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8565dd-159d-4a17-bc16-d0f7b0ebca7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:59.316977 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2339/4656] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:01:59 2022] POST /identity/v3/projects => generated 409 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:01:59.320544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f5f2d-6120-4c44-a70f-22b6b1ad574a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:59.338264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f5f2d-6120-4c44-a70f-22b6b1ad574a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:59.460509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19183642-534a-484f-b184-7bf9345b70fb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:59.461238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19183642-534a-484f-b184-7bf9345b70fb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:59.461503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19183642-534a-484f-b184-7bf9345b70fb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:59.461789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19183642-534a-484f-b184-7bf9345b70fb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/6cf62f48d41844db834614ca2ace5cd6/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:59.464218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19183642-534a-484f-b184-7bf9345b70fb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:create_grant(project_id=faf41c7338774f2cbf3de5bce1634587, user_id=7602efba72ac42e899faf1a738165dc5, role_id=6cf62f48d41844db834614ca2ace5cd6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:59.476079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19183642-534a-484f-b184-7bf9345b70fb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:59.490686 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:59.509075 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2318/4657] 10.222.0.27 () {60 vars in 1582 bytes} [Wed Oct 19 01:01:59 2022] PUT /identity/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/6cf62f48d41844db834614ca2ace5cd6/inherited_to_projects => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:01:59.511035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8565dd-159d-4a17-bc16-d0f7b0ebca7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:59.528138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8565dd-159d-4a17-bc16-d0f7b0ebca7b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:59.563633 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:59.720199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:59.720960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:01:59.722353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:01:59.722638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:01:59.724895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Adding query filter params (scope.project.id=5e9df6727ed140d89b451bebb7c19ff9, user.id=7602efba72ac42e899faf1a738165dc5) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:01:59.725223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:01:59.730637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:01:59.953236 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2340/4658] 10.222.0.27 () {58 vars in 1356 bytes} [Wed Oct 19 01:01:59 2022] GET /identity/v3/role_assignments?scope.project.id=5e9df6727ed140d89b451bebb7c19ff9&user.id=7602efba72ac42e899faf1a738165dc5&effective => generated 649 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:01:59.957847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19183642-534a-484f-b184-7bf9345b70fb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:01:59.976848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19183642-534a-484f-b184-7bf9345b70fb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:01:59.997863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:01:59.998720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:00.001644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:00.002076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/6cf62f48d41844db834614ca2ace5cd6/inherited_to_projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:00.008251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=faf41c7338774f2cbf3de5bce1634587, user_id=7602efba72ac42e899faf1a738165dc5, role_id=6cf62f48d41844db834614ca2ace5cd6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:00.015879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:00.043803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 6cf62f48d41844db834614ca2ace5cd6 was removed from user 7602efba72ac42e899faf1a738165dc5 on project faf41c7338774f2cbf3de5bce1634587. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:00.044258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:00.048596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:00.073205 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2319/4659] 10.222.0.27 () {58 vars in 1566 bytes} [Wed Oct 19 01:01:59 2022] DELETE /identity/v3/OS-INHERIT/projects/faf41c7338774f2cbf3de5bce1634587/users/7602efba72ac42e899faf1a738165dc5/roles/6cf62f48d41844db834614ca2ace5cd6/inherited_to_projects => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:00.074680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:00.077077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:00.133176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fd1d-e23a-4f03-81ad-fc8b3eedf9bf tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:00.369457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:00.373257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:00.376489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:00.376830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:00.381655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Adding query filter params (scope.project.id=5e9df6727ed140d89b451bebb7c19ff9, user.id=7602efba72ac42e899faf1a738165dc5) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:02:00.381994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:00.397962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:00.593965 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2341/4660] 10.222.0.27 () {58 vars in 1356 bytes} [Wed Oct 19 01:02:00 2022] GET /identity/v3/role_assignments?scope.project.id=5e9df6727ed140d89b451bebb7c19ff9&user.id=7602efba72ac42e899faf1a738165dc5&effective => generated 228 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:02:00.598551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:00.616154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038b76-40d2-459a-ab63-0f6cb6fb15f0 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:00.636507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:00.641225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:00.641712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:00.642137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/projects/5e9df6727ed140d89b451bebb7c19ff9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:00.655066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e9df6727ed140d89b451bebb7c19ff9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:00.657369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:00.919264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9df6727ed140d89b451bebb7c19ff9', 'request_id': 'req-5485af35-8b26-41f4-b8aa-48f7c80e4118'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:00.946834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9df6727ed140d89b451bebb7c19ff9', 'request_id': 'req-5485af35-8b26-41f4-b8aa-48f7c80e4118'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:00.966233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9df6727ed140d89b451bebb7c19ff9', 'request_id': 'req-5485af35-8b26-41f4-b8aa-48f7c80e4118'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:01.012653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] The token cache is being invalidate because project 5e9df6727ed140d89b451bebb7c19ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:01.013299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:01.014347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:01.028181 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2320/4661] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:00 2022] DELETE /identity/v3/projects/5e9df6727ed140d89b451bebb7c19ff9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:01.028409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:01.030273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:01.072381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc778-8bef-4154-bb97-58ad1088b007 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:01.213505 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:01.365263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:01.367224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:01.368794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:01.369134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/roles/6cf62f48d41844db834614ca2ace5cd6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:01.373767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6cf62f48d41844db834614ca2ace5cd6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:01.380347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:01.467677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invalidating the token cache because role 6cf62f48d41844db834614ca2ace5cd6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:01.467975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:01.469766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:01.479985 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2342/4662] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:01 2022] DELETE /identity/v3/roles/6cf62f48d41844db834614ca2ace5cd6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:01.486154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:01.531334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485af35-8b26-41f4-b8aa-48f7c80e4118 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:01.823124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:01.825828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:01.827155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:01.828350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/users/7602efba72ac42e899faf1a738165dc5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:01.833197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7602efba72ac42e899faf1a738165dc5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:01.842424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:01.999916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7602efba72ac42e899faf1a738165dc5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:02.039058 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:02.045755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7602efba72ac42e899faf1a738165dc5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:02.060355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7602efba72ac42e899faf1a738165dc5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:02.082057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7602efba72ac42e899faf1a738165dc5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:02.084596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7602efba72ac42e899faf1a738165dc5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:02.109327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:02.110997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:02.113379 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2321/4663] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:01 2022] DELETE /identity/v3/users/7602efba72ac42e899faf1a738165dc5 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:02.121413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:02.123164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:02.363793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80285d53-fe59-40da-bc05-1185d33b3942 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:02.381518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:02.382313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:02.382711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:02.383133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/groups/3b2c518f9f4d4445a4ffc588534fbd21` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:02.387282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3b2c518f9f4d4445a4ffc588534fbd21)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:02.388468 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:02:02.388468 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:02:02.388468 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:02:02.390564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:02.456412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc3c08-e0c9-465d-bc68-b8a2d06a2f14 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:02.492783 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2322/4664] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:02:02 2022] DELETE /identity/v3/groups/3b2c518f9f4d4445a4ffc588534fbd21 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:02.493937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:02.497842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:02.687487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a040-a92c-48b3-bd13-ef4fa1afebb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:02.689092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a040-a92c-48b3-bd13-ef4fa1afebb2 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:02.689917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a040-a92c-48b3-bd13-ef4fa1afebb2 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:02.691672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a040-a92c-48b3-bd13-ef4fa1afebb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:02.695388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c319a040-a92c-48b3-bd13-ef4fa1afebb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:02.695987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4e96-cae7-4383-86e6-dabac785896a tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:02.714054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cfcd6-9f4d-4d81-9e11-6a745c195a04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:02.714054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cfcd6-9f4d-4d81-9e11-6a745c195a04 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:02.714054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cfcd6-9f4d-4d81-9e11-6a745c195a04 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:02.714405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cfcd6-9f4d-4d81-9e11-6a745c195a04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:02.719028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4a3cfcd6-9f4d-4d81-9e11-6a745c195a04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:02.734834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319a040-a92c-48b3-bd13-ef4fa1afebb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:02.737317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319a040-a92c-48b3-bd13-ef4fa1afebb2 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:02.767383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cfcd6-9f4d-4d81-9e11-6a745c195a04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:02.767703 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2343/4665] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:02.770388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a040-a92c-48b3-bd13-ef4fa1afebb2 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:02.777900 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:02.786271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cfcd6-9f4d-4d81-9e11-6a745c195a04 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:02.786473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a040-a92c-48b3-bd13-ef4fa1afebb2 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:02.828714 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2323/4666] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:02.961317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:02.962258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:02.967584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:02.968111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/projects/faf41c7338774f2cbf3de5bce1634587` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:02.994079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_project(project_id=faf41c7338774f2cbf3de5bce1634587)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:02.996573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:03.130572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf41c7338774f2cbf3de5bce1634587', 'request_id': 'req-5a2586ac-97cd-40be-87a8-af6a793e3acb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:03.153146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf41c7338774f2cbf3de5bce1634587', 'request_id': 'req-5a2586ac-97cd-40be-87a8-af6a793e3acb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:03.168318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf41c7338774f2cbf3de5bce1634587', 'request_id': 'req-5a2586ac-97cd-40be-87a8-af6a793e3acb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:03.192001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] The token cache is being invalidate because project faf41c7338774f2cbf3de5bce1634587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:03.194334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:03.195815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:03.200710 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2344/4667] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:02 2022] DELETE /identity/v3/projects/faf41c7338774f2cbf3de5bce1634587 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:03.204948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cfcd6-9f4d-4d81-9e11-6a745c195a04 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:03.247632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cfcd6-9f4d-4d81-9e11-6a745c195a04 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:03.389044 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:03.598544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:03.600743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:03.601026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:03.601246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/domains/9bfaa453cb8f4299b2175169b89dc6b7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:03.604426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9bfaa453cb8f4299b2175169b89dc6b7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:03.610169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:03.719427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:03.736915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:03.863479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:03.865378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:03.873106 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2324/4668] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:02:03 2022] PATCH /identity/v3/domains/9bfaa453cb8f4299b2175169b89dc6b7 => generated 277 bytes in 669 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:02:03.877937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:03.879524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:03.914714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2586ac-97cd-40be-87a8-af6a793e3acb tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:04.074587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dce5824f518419ba79de021da0ac137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d6be5534a7a40928b865d350fd6a0c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:04.075513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:04.077781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:04.078551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] PATH_INFO: `/v3/domains/9bfaa453cb8f4299b2175169b89dc6b7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:04.108549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9bfaa453cb8f4299b2175169b89dc6b7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:04.112214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:04.149011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.156135 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:04.181827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.297091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7', 'request_id': 'req-61d9f88a-adb9-45d8-917c-e6240201b123'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.314999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7', 'request_id': 'req-61d9f88a-adb9-45d8-917c-e6240201b123'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.322224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7', 'request_id': 'req-61d9f88a-adb9-45d8-917c-e6240201b123'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.340775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] The token cache is being invalidate because project 9bfaa453cb8f4299b2175169b89dc6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:04.341173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.341799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.351904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7', 'request_id': 'req-61d9f88a-adb9-45d8-917c-e6240201b123'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.356362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7', 'request_id': 'req-61d9f88a-adb9-45d8-917c-e6240201b123'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.358407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-61d9f88a-adb9-45d8-917c-e6240201b123 tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9bfaa453cb8f4299b2175169b89dc6b7', 'request_id': 'req-61d9f88a-adb9-45d8-917c-e6240201b123'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.367074 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2345/4669] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:02:03 2022] DELETE /identity/v3/domains/9bfaa453cb8f4299b2175169b89dc6b7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:04.371306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:04.373065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:04.486428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c0573-379f-48eb-9070-5ed48c2a537b tempest-InheritsV3TestJSON-119576126 tempest-InheritsV3TestJSON-119576126-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:04.618218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:04.619098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:04.619786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:04.620434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] PATH_INFO: `/v3/users/fd57ed22b7164919b7822dad4b785c73` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:04.622862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd57ed22b7164919b7822dad4b785c73)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:04.625095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:04.695836 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:04.700599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd57ed22b7164919b7822dad4b785c73'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.763443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd57ed22b7164919b7822dad4b785c73'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.786734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd57ed22b7164919b7822dad4b785c73'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.805198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd57ed22b7164919b7822dad4b785c73'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.807557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd57ed22b7164919b7822dad4b785c73'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:04.823167 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2325/4670] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:04 2022] DELETE /identity/v3/users/fd57ed22b7164919b7822dad4b785c73 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:04.828582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7420cf-6864-4365-b495-d566fcee7663 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:04.828582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7420cf-6864-4365-b495-d566fcee7663 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:04.828582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7420cf-6864-4365-b495-d566fcee7663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:04.895622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5a7420cf-6864-4365-b495-d566fcee7663 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:04.898048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5a7420cf-6864-4365-b495-d566fcee7663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:05.162928 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2346/4671] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:05.182506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:05.184081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:05.289566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fffd6-90aa-4e22-9d22-6b18556703ce admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:05.294087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd6551-08f2-4ba8-964b-6c38c40b5635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:05.294712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6551-08f2-4ba8-964b-6c38c40b5635 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:05.294998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6551-08f2-4ba8-964b-6c38c40b5635 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:05.295276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6551-08f2-4ba8-964b-6c38c40b5635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:05.305838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6551-08f2-4ba8-964b-6c38c40b5635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:05.307385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6551-08f2-4ba8-964b-6c38c40b5635 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:05.325777 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2326/4672] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:05.794906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7420cf-6864-4365-b495-d566fcee7663 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:05.797517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5a7420cf-6864-4365-b495-d566fcee7663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:05.821889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7420cf-6864-4365-b495-d566fcee7663 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:05.828763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:05.829767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:05.830257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:05.831044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] PATH_INFO: `/v3/projects/4b7eaab0a99f4ec9a7e3db1fb9354bf3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:05.832507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7eaab0a99f4ec9a7e3db1fb9354bf3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:05.844879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:05.958265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7eaab0a99f4ec9a7e3db1fb9354bf3', 'request_id': 'req-cc5047ca-92c8-4e03-948a-e23e089a0eea'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:05.984368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7eaab0a99f4ec9a7e3db1fb9354bf3', 'request_id': 'req-cc5047ca-92c8-4e03-948a-e23e089a0eea'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:06.004958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7eaab0a99f4ec9a7e3db1fb9354bf3', 'request_id': 'req-cc5047ca-92c8-4e03-948a-e23e089a0eea'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:06.009524 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:06.036104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] The token cache is being invalidate because project 4b7eaab0a99f4ec9a7e3db1fb9354bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:06.036563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:06.037375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:06.040707 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2347/4673] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:05 2022] DELETE /identity/v3/projects/4b7eaab0a99f4ec9a7e3db1fb9354bf3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:06.043651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd6551-08f2-4ba8-964b-6c38c40b5635 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:06.073242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd6551-08f2-4ba8-964b-6c38c40b5635 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:06.233419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:06.234152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:06.234508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:06.234863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] PATH_INFO: `/v3/users/0dce5824f518419ba79de021da0ac137` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:06.236976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dce5824f518419ba79de021da0ac137)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:06.241296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:06.367775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dce5824f518419ba79de021da0ac137'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:06.403275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dce5824f518419ba79de021da0ac137'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:06.406276 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:06.418249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dce5824f518419ba79de021da0ac137'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:06.446479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dce5824f518419ba79de021da0ac137'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:06.448130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0107e416-2d2c-4d07-a1c5-7fff50691ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dce5824f518419ba79de021da0ac137'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:06.487644 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2327/4674] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:06 2022] DELETE /identity/v3/users/0dce5824f518419ba79de021da0ac137 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:07.213708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:07.221875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:07.252324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5047ca-92c8-4e03-948a-e23e089a0eea admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:07.418607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:07.419520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:07.419954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:07.420378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] PATH_INFO: `/v3/projects/0d6be5534a7a40928b865d350fd6a0c7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:07.422000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6be5534a7a40928b865d350fd6a0c7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:07.424180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:07.542185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6be5534a7a40928b865d350fd6a0c7', 'request_id': 'req-4a16aefa-4c10-430f-9348-f33fc5155c96'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:07.555123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6be5534a7a40928b865d350fd6a0c7', 'request_id': 'req-4a16aefa-4c10-430f-9348-f33fc5155c96'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:07.561976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6be5534a7a40928b865d350fd6a0c7', 'request_id': 'req-4a16aefa-4c10-430f-9348-f33fc5155c96'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:07.585872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] The token cache is being invalidate because project 0d6be5534a7a40928b865d350fd6a0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:07.586167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:07.587155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a16aefa-4c10-430f-9348-f33fc5155c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:07.592031 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2348/4675] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:07 2022] DELETE /identity/v3/projects/0d6be5534a7a40928b865d350fd6a0c7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:07.593756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf87dd-0149-4e8f-b979-013ffbe61fee None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:07.594221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf87dd-0149-4e8f-b979-013ffbe61fee None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:07.594298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf87dd-0149-4e8f-b979-013ffbe61fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:07.647806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ebcf87dd-0149-4e8f-b979-013ffbe61fee None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:07.649819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ebcf87dd-0149-4e8f-b979-013ffbe61fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:07.807560 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2328/4676] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:07.816432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6c375-5fa1-4a72-b64f-b1e0de51e245 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:07.817166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6c375-5fa1-4a72-b64f-b1e0de51e245 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:07.817597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6c375-5fa1-4a72-b64f-b1e0de51e245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:07.873503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ecf6c375-5fa1-4a72-b64f-b1e0de51e245 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:07.874733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ecf6c375-5fa1-4a72-b64f-b1e0de51e245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:07.900147 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2349/4677] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:07.902474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf87dd-0149-4e8f-b979-013ffbe61fee None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:07.938057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf87dd-0149-4e8f-b979-013ffbe61fee None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:07.960692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350a44-2409-4b7c-bdb8-7f19c6a19a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:07.961496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350a44-2409-4b7c-bdb8-7f19c6a19a3c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:07.961780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350a44-2409-4b7c-bdb8-7f19c6a19a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:07.962056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350a44-2409-4b7c-bdb8-7f19c6a19a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:07.963360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6350a44-2409-4b7c-bdb8-7f19c6a19a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:02:07.963657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6350a44-2409-4b7c-bdb8-7f19c6a19a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:07.965335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6350a44-2409-4b7c-bdb8-7f19c6a19a3c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:08.080870 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2329/4678] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:02:08.081016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6c375-5fa1-4a72-b64f-b1e0de51e245 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:08.110349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6c375-5fa1-4a72-b64f-b1e0de51e245 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:08.122062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3d9b-045c-475d-97a3-0479f6b49de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:08.122697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3d9b-045c-475d-97a3-0479f6b49de8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:08.122984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3d9b-045c-475d-97a3-0479f6b49de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:08.123262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3d9b-045c-475d-97a3-0479f6b49de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:08.123909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b3d9b-045c-475d-97a3-0479f6b49de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:08.125903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b3d9b-045c-475d-97a3-0479f6b49de8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:08.188829 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2350/4679] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:08 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:08.190459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350a44-2409-4b7c-bdb8-7f19c6a19a3c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:08.202375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350a44-2409-4b7c-bdb8-7f19c6a19a3c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:08.333497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5d715-f284-4478-b4a6-321c6580b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:08.334287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5d715-f284-4478-b4a6-321c6580b3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:08.334573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5d715-f284-4478-b4a6-321c6580b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:08.334852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5d715-f284-4478-b4a6-321c6580b3a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:08.335703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5d715-f284-4478-b4a6-321c6580b3a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:08.337661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5d715-f284-4478-b4a6-321c6580b3a4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:08.383124 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2330/4680] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:08 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:08.387015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3d9b-045c-475d-97a3-0479f6b49de8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:08.406159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3d9b-045c-475d-97a3-0479f6b49de8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:08.415870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d539b66-9d9b-4c46-a74e-9e540f8b7cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:08.415870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539b66-9d9b-4c46-a74e-9e540f8b7cbc admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:08.416053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539b66-9d9b-4c46-a74e-9e540f8b7cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:08.416400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539b66-9d9b-4c46-a74e-9e540f8b7cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:08.417203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d539b66-9d9b-4c46-a74e-9e540f8b7cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:08.421009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d539b66-9d9b-4c46-a74e-9e540f8b7cbc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:08.446708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2351/4681] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:02:08.451099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5d715-f284-4478-b4a6-321c6580b3a4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:08.466431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5d715-f284-4478-b4a6-321c6580b3a4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:08.474349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e8a55-c1bf-4ac0-9ce0-9b31f0f51e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:08.475316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e8a55-c1bf-4ac0-9ce0-9b31f0f51e76 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:08.480070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e8a55-c1bf-4ac0-9ce0-9b31f0f51e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:08.480588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e8a55-c1bf-4ac0-9ce0-9b31f0f51e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:08.481593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e8a55-c1bf-4ac0-9ce0-9b31f0f51e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:08.483562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e8a55-c1bf-4ac0-9ce0-9b31f0f51e76 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:08.505263 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2331/4682] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:08.509786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d539b66-9d9b-4c46-a74e-9e540f8b7cbc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:08.524342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d539b66-9d9b-4c46-a74e-9e540f8b7cbc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:08.529579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2cbe7-2934-4e27-ab63-e9aeecaab8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:08.530272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2cbe7-2934-4e27-ab63-e9aeecaab8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:08.530607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2cbe7-2934-4e27-ab63-e9aeecaab8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:08.531021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2cbe7-2934-4e27-ab63-e9aeecaab8c7 admin admin] PATH_INFO: `/v3/projects/031d0f88bb154a94aab5ca2eae9ede40/users/3444e88fe8d94dc1bb9c79bb6127a8fc/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:08.557462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2cbe7-2934-4e27-ab63-e9aeecaab8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031d0f88bb154a94aab5ca2eae9ede40, user_id=3444e88fe8d94dc1bb9c79bb6127a8fc, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:08.560353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2cbe7-2934-4e27-ab63-e9aeecaab8c7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:08.591031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594301-470f-4552-a242-7f087e27d963 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:08.591359 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2352/4683] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:08 2022] PUT /identity/v3/projects/031d0f88bb154a94aab5ca2eae9ede40/users/3444e88fe8d94dc1bb9c79bb6127a8fc/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:02:08.591629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594301-470f-4552-a242-7f087e27d963 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:08.592129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594301-470f-4552-a242-7f087e27d963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:08.629528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e2594301-470f-4552-a242-7f087e27d963 None None] MFA Rules not processed for user `3444e88fe8d94dc1bb9c79bb6127a8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:08.631058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e2594301-470f-4552-a242-7f087e27d963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:08.667474 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:08.716199 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2332/4684] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:02:08.721039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2cbe7-2934-4e27-ab63-e9aeecaab8c7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:08.750077 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:08.812530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2cbe7-2934-4e27-ab63-e9aeecaab8c7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:08.817945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983985be-0c3c-4fad-9f94-be2bcca97f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:08.818565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983985be-0c3c-4fad-9f94-be2bcca97f83 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:08.819505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983985be-0c3c-4fad-9f94-be2bcca97f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:08.819793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983985be-0c3c-4fad-9f94-be2bcca97f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:08.820436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983985be-0c3c-4fad-9f94-be2bcca97f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:08.823333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983985be-0c3c-4fad-9f94-be2bcca97f83 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:08.860814 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2353/4685] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:08 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:08.862773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2594301-470f-4552-a242-7f087e27d963 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:08.885957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2594301-470f-4552-a242-7f087e27d963 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:08.957189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e03f76-50a9-4457-ac7e-c21bf2c3d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:08.957820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e03f76-50a9-4457-ac7e-c21bf2c3d6ab admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:08.958087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e03f76-50a9-4457-ac7e-c21bf2c3d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:08.958363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e03f76-50a9-4457-ac7e-c21bf2c3d6ab admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:08.959283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e03f76-50a9-4457-ac7e-c21bf2c3d6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:08.961425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e03f76-50a9-4457-ac7e-c21bf2c3d6ab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:09.008441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983985be-0c3c-4fad-9f94-be2bcca97f83 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:09.016711 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2333/4686] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:08 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:09.021662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983985be-0c3c-4fad-9f94-be2bcca97f83 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:09.028814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131247a-a419-45c3-aeb7-d65969fc655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:09.029452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131247a-a419-45c3-aeb7-d65969fc655a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:09.029739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131247a-a419-45c3-aeb7-d65969fc655a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:09.030019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131247a-a419-45c3-aeb7-d65969fc655a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:09.031218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131247a-a419-45c3-aeb7-d65969fc655a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:09.034545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131247a-a419-45c3-aeb7-d65969fc655a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:09.062566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2354/4687] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:09.066818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e03f76-50a9-4457-ac7e-c21bf2c3d6ab admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:09.088707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e03f76-50a9-4457-ac7e-c21bf2c3d6ab admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:09.095318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555aef-3c71-4e62-a603-d4d8e3455576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:09.098895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555aef-3c71-4e62-a603-d4d8e3455576 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:09.099189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555aef-3c71-4e62-a603-d4d8e3455576 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:09.099471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555aef-3c71-4e62-a603-d4d8e3455576 admin admin] PATH_INFO: `/v3/projects/05d451b38f6d47f99d1a1d0c39d6f0d2/users/36313876d51e4d3e939ac0e84f571d8f/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:09.158127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00555aef-3c71-4e62-a603-d4d8e3455576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d451b38f6d47f99d1a1d0c39d6f0d2, user_id=36313876d51e4d3e939ac0e84f571d8f, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:09.167676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00555aef-3c71-4e62-a603-d4d8e3455576 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:09.212756 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2334/4688] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:09 2022] PUT /identity/v3/projects/05d451b38f6d47f99d1a1d0c39d6f0d2/users/36313876d51e4d3e939ac0e84f571d8f/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:09.214570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131247a-a419-45c3-aeb7-d65969fc655a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:09.227471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131247a-a419-45c3-aeb7-d65969fc655a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:09.314603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715217c2-250f-4c04-81b1-d1bcf9e84a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:09.316660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715217c2-250f-4c04-81b1-d1bcf9e84a81 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:09.317518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715217c2-250f-4c04-81b1-d1bcf9e84a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:09.317728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715217c2-250f-4c04-81b1-d1bcf9e84a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:09.318438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715217c2-250f-4c04-81b1-d1bcf9e84a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:09.320195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715217c2-250f-4c04-81b1-d1bcf9e84a81 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:09.334842 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2355/4689] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:09.339441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555aef-3c71-4e62-a603-d4d8e3455576 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:09.352143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555aef-3c71-4e62-a603-d4d8e3455576 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:09.358325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc708e-42e2-4b24-9378-ececceb40029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:09.359148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc708e-42e2-4b24-9378-ececceb40029 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:09.359381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc708e-42e2-4b24-9378-ececceb40029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:09.359845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc708e-42e2-4b24-9378-ececceb40029 admin admin] PATH_INFO: `/v3/projects/05d451b38f6d47f99d1a1d0c39d6f0d2/users/36313876d51e4d3e939ac0e84f571d8f/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:09.362978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc708e-42e2-4b24-9378-ececceb40029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d451b38f6d47f99d1a1d0c39d6f0d2, user_id=36313876d51e4d3e939ac0e84f571d8f, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:09.366276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc708e-42e2-4b24-9378-ececceb40029 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:09.384699 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2335/4690] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:09 2022] PUT /identity/v3/projects/05d451b38f6d47f99d1a1d0c39d6f0d2/users/36313876d51e4d3e939ac0e84f571d8f/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:09.397540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36472a6-a6af-440f-91d8-947581b9df08 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:09.398442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36472a6-a6af-440f-91d8-947581b9df08 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:09.398900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36472a6-a6af-440f-91d8-947581b9df08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:09.450874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b36472a6-a6af-440f-91d8-947581b9df08 None None] MFA Rules not processed for user `36313876d51e4d3e939ac0e84f571d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:09.452393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b36472a6-a6af-440f-91d8-947581b9df08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:09.588466 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2356/4691] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:09.593951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc708e-42e2-4b24-9378-ececceb40029 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:09.789325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc708e-42e2-4b24-9378-ececceb40029 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:09.794926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f77df6-7210-44f6-9fdf-d84d4ed58142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:09.795540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f77df6-7210-44f6-9fdf-d84d4ed58142 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:09.795820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f77df6-7210-44f6-9fdf-d84d4ed58142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:09.796091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f77df6-7210-44f6-9fdf-d84d4ed58142 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:09.796756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f77df6-7210-44f6-9fdf-d84d4ed58142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:09.798669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f77df6-7210-44f6-9fdf-d84d4ed58142 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:09.840660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36472a6-a6af-440f-91d8-947581b9df08 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:09.847431 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2336/4692] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:09 2022] POST /identity/v3/projects => generated 369 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:09.855832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36472a6-a6af-440f-91d8-947581b9df08 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:09.872945 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:09.988118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d08b27-fc48-4779-bfb3-73e54840b93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:09.988864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d08b27-fc48-4779-bfb3-73e54840b93e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:09.989171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d08b27-fc48-4779-bfb3-73e54840b93e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:09.989563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d08b27-fc48-4779-bfb3-73e54840b93e admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:09.990455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d08b27-fc48-4779-bfb3-73e54840b93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:09.992507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401237-d939-4761-8dcc-40703def4124 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:09.992683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401237-d939-4761-8dcc-40703def4124 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:09.992882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401237-d939-4761-8dcc-40703def4124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:10.000597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d08b27-fc48-4779-bfb3-73e54840b93e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:10.013565 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:10.050257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-37401237-d939-4761-8dcc-40703def4124 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:10.052656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-37401237-d939-4761-8dcc-40703def4124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:10.066251 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2357/4693] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:09 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:02:10.067453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d08b27-fc48-4779-bfb3-73e54840b93e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:10.099758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d08b27-fc48-4779-bfb3-73e54840b93e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:10.106364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a499a3-d035-4625-9054-ed83cd9e3fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:10.107245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a499a3-d035-4625-9054-ed83cd9e3fcf admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:10.107765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a499a3-d035-4625-9054-ed83cd9e3fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:10.108189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a499a3-d035-4625-9054-ed83cd9e3fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:10.109493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a499a3-d035-4625-9054-ed83cd9e3fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:10.112480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a499a3-d035-4625-9054-ed83cd9e3fcf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:10.127721 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2358/4694] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:10.129564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a499a3-d035-4625-9054-ed83cd9e3fcf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:10.148342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a499a3-d035-4625-9054-ed83cd9e3fcf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:10.177738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fd3df-cded-4a3e-bc5a-bfd0d86e67e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:10.179667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd3df-cded-4a3e-bc5a-bfd0d86e67e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:10.180035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd3df-cded-4a3e-bc5a-bfd0d86e67e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:10.180372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd3df-cded-4a3e-bc5a-bfd0d86e67e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:10.181207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fd3df-cded-4a3e-bc5a-bfd0d86e67e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:10.191631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fd3df-cded-4a3e-bc5a-bfd0d86e67e1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:10.207677 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2337/4695] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:02:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:10.213085 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2359/4696] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:10.213889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37401237-d939-4761-8dcc-40703def4124 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:10.226210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37401237-d939-4761-8dcc-40703def4124 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:10.231014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f657656-e0fc-404b-8a72-cacb2428c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:10.231716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f657656-e0fc-404b-8a72-cacb2428c8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:10.231872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f657656-e0fc-404b-8a72-cacb2428c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:10.232174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f657656-e0fc-404b-8a72-cacb2428c8f1 admin admin] PATH_INFO: `/v3/projects/1aaab6aab6d94fa3b1732d18bfd68c58/users/34bdda27e8934694b67f89dd28c269ff/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:10.235502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fd3df-cded-4a3e-bc5a-bfd0d86e67e1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:10.245317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e4fd3df-cded-4a3e-bc5a-bfd0d86e67e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:10.256252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f657656-e0fc-404b-8a72-cacb2428c8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aaab6aab6d94fa3b1732d18bfd68c58, user_id=34bdda27e8934694b67f89dd28c269ff, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:10.259103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f657656-e0fc-404b-8a72-cacb2428c8f1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:10.277884 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2338/4697] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:10 2022] PUT /identity/v3/projects/1aaab6aab6d94fa3b1732d18bfd68c58/users/34bdda27e8934694b67f89dd28c269ff/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:10.289438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519ff50-12e4-4c1d-aa71-b95a6dc92a1c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:10.289740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519ff50-12e4-4c1d-aa71-b95a6dc92a1c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:10.289982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519ff50-12e4-4c1d-aa71-b95a6dc92a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:10.332367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4519ff50-12e4-4c1d-aa71-b95a6dc92a1c None None] MFA Rules not processed for user `34bdda27e8934694b67f89dd28c269ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:10.334446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4519ff50-12e4-4c1d-aa71-b95a6dc92a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:10.374326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fd3df-cded-4a3e-bc5a-bfd0d86e67e1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:10.503498 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2339/4698] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:10.509485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519ff50-12e4-4c1d-aa71-b95a6dc92a1c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:10.531469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223a84c-b351-4895-949b-25cc16b84d5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:10.532243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223a84c-b351-4895-949b-25cc16b84d5e service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:10.532670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223a84c-b351-4895-949b-25cc16b84d5e service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:10.533006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223a84c-b351-4895-949b-25cc16b84d5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:10.573090 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:10.628846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519ff50-12e4-4c1d-aa71-b95a6dc92a1c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:10.633834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aa146-a8fc-4978-a535-a775ae44ed3c tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:10.633834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aa146-a8fc-4978-a535-a775ae44ed3c tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:10.633834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aa146-a8fc-4978-a535-a775ae44ed3c tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:10.634093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aa146-a8fc-4978-a535-a775ae44ed3c tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:10.634093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888aa146-a8fc-4978-a535-a775ae44ed3c tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:10.634253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223a84c-b351-4895-949b-25cc16b84d5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:10.634328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888aa146-a8fc-4978-a535-a775ae44ed3c tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:10.634396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223a84c-b351-4895-949b-25cc16b84d5e service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:10.649372 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2360/4699] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:02:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:02:10.656663 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2340/4700] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:02:10 2022] POST /identity/v3/domains => generated 277 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:10.660818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223a84c-b351-4895-949b-25cc16b84d5e service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:10.675426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223a84c-b351-4895-949b-25cc16b84d5e service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:10.749093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad508b87-986e-40a9-b8dc-1c52a2fa81f5 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:10.749780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad508b87-986e-40a9-b8dc-1c52a2fa81f5 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:10.750116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad508b87-986e-40a9-b8dc-1c52a2fa81f5 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:10.750462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad508b87-986e-40a9-b8dc-1c52a2fa81f5 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:10.751208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad508b87-986e-40a9-b8dc-1c52a2fa81f5 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:10.753793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad508b87-986e-40a9-b8dc-1c52a2fa81f5 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:10.771869 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2361/4701] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:02:10 2022] POST /identity/v3/roles => generated 240 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:02:10.776208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aa146-a8fc-4978-a535-a775ae44ed3c tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:10.784505 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:10.788575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aa146-a8fc-4978-a535-a775ae44ed3c tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:10.797439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e013e7-7742-499a-8483-8bfe581b73ba tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:10.798125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e013e7-7742-499a-8483-8bfe581b73ba tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:10.798417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e013e7-7742-499a-8483-8bfe581b73ba tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:10.798722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e013e7-7742-499a-8483-8bfe581b73ba tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/24906f1fa49841ada2c332911bead004/users/34bdda27e8934694b67f89dd28c269ff/roles/dfd435f7a1e045d691f58fa57963d76d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:10.821975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e013e7-7742-499a-8483-8bfe581b73ba tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=24906f1fa49841ada2c332911bead004, user_id=34bdda27e8934694b67f89dd28c269ff, role_id=dfd435f7a1e045d691f58fa57963d76d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:10.826064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e013e7-7742-499a-8483-8bfe581b73ba tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:10.858632 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2341/4702] 10.222.0.27 () {60 vars in 1480 bytes} [Wed Oct 19 01:02:10 2022] PUT /identity/v3/domains/24906f1fa49841ada2c332911bead004/users/34bdda27e8934694b67f89dd28c269ff/roles/dfd435f7a1e045d691f58fa57963d76d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:10.871393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad508b87-986e-40a9-b8dc-1c52a2fa81f5 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:10.891846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad508b87-986e-40a9-b8dc-1c52a2fa81f5 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:11.032399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58ae41-5a41-4db8-837b-0789d6b341a8 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:11.035046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58ae41-5a41-4db8-837b-0789d6b341a8 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:11.035529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58ae41-5a41-4db8-837b-0789d6b341a8 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:11.036152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58ae41-5a41-4db8-837b-0789d6b341a8 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:11.037017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58ae41-5a41-4db8-837b-0789d6b341a8 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:11.039479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58ae41-5a41-4db8-837b-0789d6b341a8 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:11.078827 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2362/4703] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:02:10 2022] POST /identity/v3/domains => generated 276 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:11.084459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e013e7-7742-499a-8483-8bfe581b73ba tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:11.107258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e013e7-7742-499a-8483-8bfe581b73ba tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:11.199279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873163d-d8a6-4f1f-87b6-1446cc9311b6 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:11.200114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873163d-d8a6-4f1f-87b6-1446cc9311b6 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:11.200490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873163d-d8a6-4f1f-87b6-1446cc9311b6 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:11.201594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873163d-d8a6-4f1f-87b6-1446cc9311b6 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:11.201594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873163d-d8a6-4f1f-87b6-1446cc9311b6 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:11.203500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873163d-d8a6-4f1f-87b6-1446cc9311b6 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:11.227945 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2342/4704] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:02:11 2022] POST /identity/v3/roles => generated 240 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:11.228536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58ae41-5a41-4db8-837b-0789d6b341a8 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:11.243426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58ae41-5a41-4db8-837b-0789d6b341a8 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:11.249618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b59e8-6baf-4dd2-8d66-385826f29e53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:11.250770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b59e8-6baf-4dd2-8d66-385826f29e53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:11.250770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b59e8-6baf-4dd2-8d66-385826f29e53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:11.251150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b59e8-6baf-4dd2-8d66-385826f29e53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:11.252138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b59e8-6baf-4dd2-8d66-385826f29e53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:11.254108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b59e8-6baf-4dd2-8d66-385826f29e53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:11.293468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873163d-d8a6-4f1f-87b6-1446cc9311b6 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:11.300876 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2363/4705] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:02:11 2022] POST /identity/v3/groups => generated 325 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:02:11.305440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873163d-d8a6-4f1f-87b6-1446cc9311b6 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:11.310885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20337f50-af39-4659-ba50-e44736cd35ad tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:11.312366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20337f50-af39-4659-ba50-e44736cd35ad tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:11.312366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20337f50-af39-4659-ba50-e44736cd35ad tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:11.312366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20337f50-af39-4659-ba50-e44736cd35ad tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/groups/de5100a95ecd4f85a2d4338ae3610963/users/34bdda27e8934694b67f89dd28c269ff` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:11.325747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20337f50-af39-4659-ba50-e44736cd35ad tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=de5100a95ecd4f85a2d4338ae3610963, user_id=34bdda27e8934694b67f89dd28c269ff)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:11.326866 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-20337f50-af39-4659-ba50-e44736cd35ad tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:02:11.326866 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:02:11.326866 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:02:11.328339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20337f50-af39-4659-ba50-e44736cd35ad tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:11.389246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fcc46-8ea8-4227-8ab3-eb0b86108c23 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:11.392381 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2343/4706] 10.222.0.27 () {60 vars in 1360 bytes} [Wed Oct 19 01:02:11 2022] PUT /identity/v3/groups/de5100a95ecd4f85a2d4338ae3610963/users/34bdda27e8934694b67f89dd28c269ff => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:11.393706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fcc46-8ea8-4227-8ab3-eb0b86108c23 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:11.393999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fcc46-8ea8-4227-8ab3-eb0b86108c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:11.395521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20337f50-af39-4659-ba50-e44736cd35ad tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:11.418851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ad0fcc46-8ea8-4227-8ab3-eb0b86108c23 None None] MFA Rules not processed for user `1f062f2ecc0547ae960ed98e7aeef9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:11.420690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ad0fcc46-8ea8-4227-8ab3-eb0b86108c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:11.481976 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:11.544832 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2364/4707] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:02:11.555283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20337f50-af39-4659-ba50-e44736cd35ad tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:11.567022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c0cc3-0cae-44fe-83f1-f82459de23f9 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:11.567719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c0cc3-0cae-44fe-83f1-f82459de23f9 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:11.568009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c0cc3-0cae-44fe-83f1-f82459de23f9 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:11.568291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c0cc3-0cae-44fe-83f1-f82459de23f9 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/af6623dc3bdd42e58d32c73610363730/groups/de5100a95ecd4f85a2d4338ae3610963/roles/0f49e673d57b47d0895774b154a1410b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:11.571436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c0cc3-0cae-44fe-83f1-f82459de23f9 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=af6623dc3bdd42e58d32c73610363730, group_id=de5100a95ecd4f85a2d4338ae3610963, role_id=0f49e673d57b47d0895774b154a1410b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:11.574627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c0cc3-0cae-44fe-83f1-f82459de23f9 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:11.604425 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2344/4708] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:11 2022] PUT /identity/v3/domains/af6623dc3bdd42e58d32c73610363730/groups/de5100a95ecd4f85a2d4338ae3610963/roles/0f49e673d57b47d0895774b154a1410b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:02:11.608953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fcc46-8ea8-4227-8ab3-eb0b86108c23 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:11.621767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fcc46-8ea8-4227-8ab3-eb0b86108c23 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:11.776689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55dc3f-50f5-47f5-a443-b6c195051e34 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:11.776689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55dc3f-50f5-47f5-a443-b6c195051e34 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:11.776689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55dc3f-50f5-47f5-a443-b6c195051e34 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:11.777078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55dc3f-50f5-47f5-a443-b6c195051e34 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:11.777078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55dc3f-50f5-47f5-a443-b6c195051e34 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:11.778054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55dc3f-50f5-47f5-a443-b6c195051e34 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:11.821982 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2365/4709] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:02:11 2022] POST /identity/v3/domains => generated 275 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:02:11.826472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c0cc3-0cae-44fe-83f1-f82459de23f9 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:11.841275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c0cc3-0cae-44fe-83f1-f82459de23f9 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:11.934273 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:11.981388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97914f30-e61d-4c1b-8cef-e5462b0402c1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:11.992162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97914f30-e61d-4c1b-8cef-e5462b0402c1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:11.992501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97914f30-e61d-4c1b-8cef-e5462b0402c1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:11.992824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97914f30-e61d-4c1b-8cef-e5462b0402c1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:11.993555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97914f30-e61d-4c1b-8cef-e5462b0402c1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:11.995206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97914f30-e61d-4c1b-8cef-e5462b0402c1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:12.066214 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2345/4710] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:02:11 2022] POST /identity/v3/roles => generated 239 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:12.067857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55dc3f-50f5-47f5-a443-b6c195051e34 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:12.097649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55dc3f-50f5-47f5-a443-b6c195051e34 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:12.104092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a7be-a044-4374-9609-38172db206ea tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:12.105818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a7be-a044-4374-9609-38172db206ea tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:12.106208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a7be-a044-4374-9609-38172db206ea tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:12.106498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a7be-a044-4374-9609-38172db206ea tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/426a296e0a6048f19501810112800147/users/34bdda27e8934694b67f89dd28c269ff/roles/e7206d8de903412497924ba33a3a1aee` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:12.124276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9a7be-a044-4374-9609-38172db206ea tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=426a296e0a6048f19501810112800147, user_id=34bdda27e8934694b67f89dd28c269ff, role_id=e7206d8de903412497924ba33a3a1aee)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:12.129265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9a7be-a044-4374-9609-38172db206ea tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:12.149139 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2366/4711] 10.222.0.27 () {60 vars in 1480 bytes} [Wed Oct 19 01:02:12 2022] PUT /identity/v3/domains/426a296e0a6048f19501810112800147/users/34bdda27e8934694b67f89dd28c269ff/roles/e7206d8de903412497924ba33a3a1aee => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:12.153547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97914f30-e61d-4c1b-8cef-e5462b0402c1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:12.174598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97914f30-e61d-4c1b-8cef-e5462b0402c1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:12.253963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c79bd7-0449-4f34-a7c5-e4c04c52ef94 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:12.254590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c79bd7-0449-4f34-a7c5-e4c04c52ef94 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:12.254878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c79bd7-0449-4f34-a7c5-e4c04c52ef94 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:12.255162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c79bd7-0449-4f34-a7c5-e4c04c52ef94 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:12.255845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c79bd7-0449-4f34-a7c5-e4c04c52ef94 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:12.257498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c79bd7-0449-4f34-a7c5-e4c04c52ef94 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:12.283375 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2346/4712] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:02:12 2022] POST /identity/v3/domains => generated 276 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:02:12.292912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a7be-a044-4374-9609-38172db206ea tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:12.302353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a7be-a044-4374-9609-38172db206ea tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:12.376444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8016f-d4bc-4371-ae28-e6f1fcff4595 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:12.378419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8016f-d4bc-4371-ae28-e6f1fcff4595 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:12.378789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8016f-d4bc-4371-ae28-e6f1fcff4595 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:12.379369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8016f-d4bc-4371-ae28-e6f1fcff4595 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:12.380367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8016f-d4bc-4371-ae28-e6f1fcff4595 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:12.382285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8016f-d4bc-4371-ae28-e6f1fcff4595 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:12.407647 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2367/4713] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:02:12 2022] POST /identity/v3/roles => generated 240 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:02:12.412289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c79bd7-0449-4f34-a7c5-e4c04c52ef94 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:12.427709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c79bd7-0449-4f34-a7c5-e4c04c52ef94 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:12.442430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bed6a-e34c-4d03-af18-a3606b33ff66 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:12.443368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bed6a-e34c-4d03-af18-a3606b33ff66 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:12.443660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bed6a-e34c-4d03-af18-a3606b33ff66 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:12.443939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bed6a-e34c-4d03-af18-a3606b33ff66 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:12.445416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bed6a-e34c-4d03-af18-a3606b33ff66 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:12.447372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bed6a-e34c-4d03-af18-a3606b33ff66 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:12.485388 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2347/4714] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:02:12 2022] POST /identity/v3/groups => generated 327 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:02:12.486023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8016f-d4bc-4371-ae28-e6f1fcff4595 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:12.497027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8016f-d4bc-4371-ae28-e6f1fcff4595 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:12.503263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf90c-d8be-4b39-aa71-4da8f7699ccf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:12.503924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf90c-d8be-4b39-aa71-4da8f7699ccf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:12.504200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf90c-d8be-4b39-aa71-4da8f7699ccf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:12.504472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf90c-d8be-4b39-aa71-4da8f7699ccf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/groups/cc73c127128e47328b61d48b88dc15b0/users/34bdda27e8934694b67f89dd28c269ff` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:12.511108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cf90c-d8be-4b39-aa71-4da8f7699ccf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=cc73c127128e47328b61d48b88dc15b0, user_id=34bdda27e8934694b67f89dd28c269ff)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:12.512263 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-f02cf90c-d8be-4b39-aa71-4da8f7699ccf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:02:12.512263 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:02:12.512263 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:02:12.513725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cf90c-d8be-4b39-aa71-4da8f7699ccf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:12.574263 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2368/4715] 10.222.0.27 () {60 vars in 1360 bytes} [Wed Oct 19 01:02:12 2022] PUT /identity/v3/groups/cc73c127128e47328b61d48b88dc15b0/users/34bdda27e8934694b67f89dd28c269ff => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:02:12.578746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bed6a-e34c-4d03-af18-a3606b33ff66 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:12.593791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bed6a-e34c-4d03-af18-a3606b33ff66 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:12.707268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec05aa-fced-4239-92d9-01cb018ca577 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:12.708270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec05aa-fced-4239-92d9-01cb018ca577 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:12.708792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec05aa-fced-4239-92d9-01cb018ca577 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:12.709116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec05aa-fced-4239-92d9-01cb018ca577 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/8184496b209d4421adff2a7b7d08e047/groups/cc73c127128e47328b61d48b88dc15b0/roles/b9d8bf9089604f4e926fd1540e135d7f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:12.711935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec05aa-fced-4239-92d9-01cb018ca577 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8184496b209d4421adff2a7b7d08e047, group_id=cc73c127128e47328b61d48b88dc15b0, role_id=b9d8bf9089604f4e926fd1540e135d7f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:12.714949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec05aa-fced-4239-92d9-01cb018ca577 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:12.731447 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2348/4716] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:12 2022] PUT /identity/v3/domains/8184496b209d4421adff2a7b7d08e047/groups/cc73c127128e47328b61d48b88dc15b0/roles/b9d8bf9089604f4e926fd1540e135d7f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:12.735794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf90c-d8be-4b39-aa71-4da8f7699ccf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:12.784662 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:12.932358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf90c-d8be-4b39-aa71-4da8f7699ccf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:13.194084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf361cf-754a-42a6-b655-d642aaf2419c tempest-TokensV3TestJSON-1196822122 tempest-TokensV3TestJSON-1196822122-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34bdda27e8934694b67f89dd28c269ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aaab6aab6d94fa3b1732d18bfd68c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:13.194728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf361cf-754a-42a6-b655-d642aaf2419c tempest-TokensV3TestJSON-1196822122 tempest-TokensV3TestJSON-1196822122-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:13.197801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf361cf-754a-42a6-b655-d642aaf2419c tempest-TokensV3TestJSON-1196822122 tempest-TokensV3TestJSON-1196822122-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:13.198115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf361cf-754a-42a6-b655-d642aaf2419c tempest-TokensV3TestJSON-1196822122 tempest-TokensV3TestJSON-1196822122-project] PATH_INFO: `/v3/auth/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:13.199884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf361cf-754a-42a6-b655-d642aaf2419c tempest-TokensV3TestJSON-1196822122 tempest-TokensV3TestJSON-1196822122-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:13.201015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf361cf-754a-42a6-b655-d642aaf2419c tempest-TokensV3TestJSON-1196822122 tempest-TokensV3TestJSON-1196822122-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:13.355062 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2369/4717] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 01:02:12 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 618 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:13.355291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec05aa-fced-4239-92d9-01cb018ca577 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:13.487554 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:13.541206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec05aa-fced-4239-92d9-01cb018ca577 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:13.549321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:13.552007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:13.552337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:13.552638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/8184496b209d4421adff2a7b7d08e047/groups/cc73c127128e47328b61d48b88dc15b0/roles/b9d8bf9089604f4e926fd1540e135d7f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:13.560655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8184496b209d4421adff2a7b7d08e047, group_id=cc73c127128e47328b61d48b88dc15b0, role_id=b9d8bf9089604f4e926fd1540e135d7f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:13.565663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:13.597139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role b9d8bf9089604f4e926fd1540e135d7f was removed from group cc73c127128e47328b61d48b88dc15b0 on domain 8184496b209d4421adff2a7b7d08e047. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:13.605685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:13.605685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:13.636600 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2349/4718] 10.222.0.27 () {58 vars in 1467 bytes} [Wed Oct 19 01:02:13 2022] DELETE /identity/v3/domains/8184496b209d4421adff2a7b7d08e047/groups/cc73c127128e47328b61d48b88dc15b0/roles/b9d8bf9089604f4e926fd1540e135d7f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:13.638366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf361cf-754a-42a6-b655-d642aaf2419c tempest-TokensV3TestJSON-1196822122 tempest-TokensV3TestJSON-1196822122-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:13.640964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bcf361cf-754a-42a6-b655-d642aaf2419c tempest-TokensV3TestJSON-1196822122 tempest-TokensV3TestJSON-1196822122-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:13.694978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf361cf-754a-42a6-b655-d642aaf2419c tempest-TokensV3TestJSON-1196822122 tempest-TokensV3TestJSON-1196822122-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:13.723852 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:13.861915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:13.862592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:13.862880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:13.863461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/groups/cc73c127128e47328b61d48b88dc15b0/users/34bdda27e8934694b67f89dd28c269ff` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:13.865680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=cc73c127128e47328b61d48b88dc15b0, user_id=34bdda27e8934694b67f89dd28c269ff)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:13.866782 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:02:13.866782 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:02:13.866782 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:02:13.868098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:13.881043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '34bdda27e8934694b67f89dd28c269ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:13.920183 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2370/4719] 10.222.0.27 () {58 vars in 1344 bytes} [Wed Oct 19 01:02:13 2022] DELETE /identity/v3/groups/cc73c127128e47328b61d48b88dc15b0/users/34bdda27e8934694b67f89dd28c269ff => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:13.924574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:13.941980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484d6f7-1276-4e18-9c52-281054b6e744 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:14.224242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8f10-472f-4707-ad40-cf7c29c24b44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:14.228110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8f10-472f-4707-ad40-cf7c29c24b44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:14.229144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8f10-472f-4707-ad40-cf7c29c24b44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:14.230717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8f10-472f-4707-ad40-cf7c29c24b44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/groups/cc73c127128e47328b61d48b88dc15b0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:14.233294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c8f10-472f-4707-ad40-cf7c29c24b44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cc73c127128e47328b61d48b88dc15b0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:14.261340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c8f10-472f-4707-ad40-cf7c29c24b44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:14.481992 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2350/4720] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:02:13 2022] DELETE /identity/v3/groups/cc73c127128e47328b61d48b88dc15b0 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:14.486535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:14.516729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835a4f4-b538-45c3-9dc5-c8cd0ca4cf5e tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:14.748169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:14.750214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:14.750701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:14.751170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles/b9d8bf9089604f4e926fd1540e135d7f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:14.760839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b9d8bf9089604f4e926fd1540e135d7f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:14.791162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:14.966222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role b9d8bf9089604f4e926fd1540e135d7f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:14.966616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:14.968076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:14.973416 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2371/4721] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:14 2022] DELETE /identity/v3/roles/b9d8bf9089604f4e926fd1540e135d7f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:02:14.977595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8f10-472f-4707-ad40-cf7c29c24b44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:14.983588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9f1c8f10-472f-4707-ad40-cf7c29c24b44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:15.004406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8f10-472f-4707-ad40-cf7c29c24b44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:15.120142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:15.120837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:15.121124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:15.121405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/8184496b209d4421adff2a7b7d08e047` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:15.122715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8184496b209d4421adff2a7b7d08e047)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:15.124345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:15.150521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8184496b209d4421adff2a7b7d08e047'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.161046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8184496b209d4421adff2a7b7d08e047'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.214905 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:15.257368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8184496b209d4421adff2a7b7d08e047'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.260952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8184496b209d4421adff2a7b7d08e047'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.264412 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2351/4722] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:02:14 2022] PATCH /identity/v3/domains/8184496b209d4421adff2a7b7d08e047 => generated 277 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:02:15.268872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:15.309761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144837c-a5e1-4505-962a-84b9cef3977b tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:15.519446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:15.522270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:15.522560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:15.522837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/8184496b209d4421adff2a7b7d08e047` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:15.568879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8184496b209d4421adff2a7b7d08e047)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:15.570956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:15.574142 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:15.632334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8184496b209d4421adff2a7b7d08e047'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.680407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8184496b209d4421adff2a7b7d08e047'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.819550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8184496b209d4421adff2a7b7d08e047', 'request_id': 'req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.854335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8184496b209d4421adff2a7b7d08e047', 'request_id': 'req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.880033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8184496b209d4421adff2a7b7d08e047', 'request_id': 'req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.904207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] The token cache is being invalidate because project 8184496b209d4421adff2a7b7d08e047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:15.904607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.908931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.926601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8184496b209d4421adff2a7b7d08e047', 'request_id': 'req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.935872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8184496b209d4421adff2a7b7d08e047', 'request_id': 'req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.936823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8184496b209d4421adff2a7b7d08e047', 'request_id': 'req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:15.954438 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2372/4723] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:02:15 2022] DELETE /identity/v3/domains/8184496b209d4421adff2a7b7d08e047 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:15.959141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:15.970110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:16.003951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995196-9c0d-4393-825d-5d52f7d9fb84 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:16.209972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:16.210799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:16.213862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:16.214270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/426a296e0a6048f19501810112800147/users/34bdda27e8934694b67f89dd28c269ff/roles/e7206d8de903412497924ba33a3a1aee` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:16.222008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=426a296e0a6048f19501810112800147, user_id=34bdda27e8934694b67f89dd28c269ff, role_id=e7206d8de903412497924ba33a3a1aee)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:16.258193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:16.277910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role e7206d8de903412497924ba33a3a1aee was removed from user 34bdda27e8934694b67f89dd28c269ff on domain 426a296e0a6048f19501810112800147. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:16.278219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:16.286444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:16.348726 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2352/4724] 10.222.0.27 () {58 vars in 1464 bytes} [Wed Oct 19 01:02:15 2022] DELETE /identity/v3/domains/426a296e0a6048f19501810112800147/users/34bdda27e8934694b67f89dd28c269ff/roles/e7206d8de903412497924ba33a3a1aee => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:16.353422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:16.355088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:16.411756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f624cc-4ddc-4d02-b480-2edf6d2afdaa tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:16.603023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:16.604475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:16.604942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:16.605393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles/e7206d8de903412497924ba33a3a1aee` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:16.607663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e7206d8de903412497924ba33a3a1aee)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:16.609734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:16.676894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role e7206d8de903412497924ba33a3a1aee has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:16.677463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:16.678423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:16.686777 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2373/4725] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:16 2022] DELETE /identity/v3/roles/e7206d8de903412497924ba33a3a1aee => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:16.687838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:16.689645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:16.709543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b65e47-eb60-42c4-bb69-8edbc5028cb1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:16.929772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:16.930911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:16.934990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:16.935321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/426a296e0a6048f19501810112800147` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:16.937651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=426a296e0a6048f19501810112800147)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:16.941584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:16.997544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '426a296e0a6048f19501810112800147'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:16.998794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '426a296e0a6048f19501810112800147'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.089229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '426a296e0a6048f19501810112800147'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.090970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '426a296e0a6048f19501810112800147'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.097452 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2353/4726] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:02:16 2022] PATCH /identity/v3/domains/426a296e0a6048f19501810112800147 => generated 276 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:02:17.101645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:17.103568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:17.136720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc856d-ada8-44bb-83cd-3d97f5abdd88 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:17.171514 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:17.274035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:17.275644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:17.277709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:17.278237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/426a296e0a6048f19501810112800147` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:17.312150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=426a296e0a6048f19501810112800147)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:17.313888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:17.383856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '426a296e0a6048f19501810112800147'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.406673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '426a296e0a6048f19501810112800147'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.513131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426a296e0a6048f19501810112800147', 'request_id': 'req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.523352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426a296e0a6048f19501810112800147', 'request_id': 'req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.533637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426a296e0a6048f19501810112800147', 'request_id': 'req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.556251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] The token cache is being invalidate because project 426a296e0a6048f19501810112800147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:17.556679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.557454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.571501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '426a296e0a6048f19501810112800147', 'request_id': 'req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.598054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '426a296e0a6048f19501810112800147', 'request_id': 'req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.598900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '426a296e0a6048f19501810112800147', 'request_id': 'req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.608787 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2374/4727] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:02:17 2022] DELETE /identity/v3/domains/426a296e0a6048f19501810112800147 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:17.609957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:17.612369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:17.641539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14de945-472c-4df8-90ee-6acc0cdecb26 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:17.758306 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:17.797019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:17.797732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:17.799221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:17.799221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/af6623dc3bdd42e58d32c73610363730/groups/de5100a95ecd4f85a2d4338ae3610963/roles/0f49e673d57b47d0895774b154a1410b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:17.801785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=af6623dc3bdd42e58d32c73610363730, group_id=de5100a95ecd4f85a2d4338ae3610963, role_id=0f49e673d57b47d0895774b154a1410b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:17.820731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:17.824211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role 0f49e673d57b47d0895774b154a1410b was removed from group de5100a95ecd4f85a2d4338ae3610963 on domain af6623dc3bdd42e58d32c73610363730. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:17.824513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.825336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:17.855971 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2354/4728] 10.222.0.27 () {58 vars in 1467 bytes} [Wed Oct 19 01:02:17 2022] DELETE /identity/v3/domains/af6623dc3bdd42e58d32c73610363730/groups/de5100a95ecd4f85a2d4338ae3610963/roles/0f49e673d57b47d0895774b154a1410b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:17.856177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:17.859750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:17.911692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49516aa-8d58-4ce4-9a6b-d91c72a86b67 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:18.082994 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:18.118648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a41c38-b0d8-4707-bfb4-83129b4b4b56 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:18.132445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a41c38-b0d8-4707-bfb4-83129b4b4b56 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:18.134804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a41c38-b0d8-4707-bfb4-83129b4b4b56 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:18.135207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a41c38-b0d8-4707-bfb4-83129b4b4b56 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/groups/de5100a95ecd4f85a2d4338ae3610963/users/34bdda27e8934694b67f89dd28c269ff` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:18.139809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a41c38-b0d8-4707-bfb4-83129b4b4b56 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=de5100a95ecd4f85a2d4338ae3610963, user_id=34bdda27e8934694b67f89dd28c269ff)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:18.143903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a41c38-b0d8-4707-bfb4-83129b4b4b56 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:18.173993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8a41c38-b0d8-4707-bfb4-83129b4b4b56 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '34bdda27e8934694b67f89dd28c269ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:18.205926 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2375/4729] 10.222.0.27 () {58 vars in 1344 bytes} [Wed Oct 19 01:02:17 2022] DELETE /identity/v3/groups/de5100a95ecd4f85a2d4338ae3610963/users/34bdda27e8934694b67f89dd28c269ff => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:18.210597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:18.212547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:18.237098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316884af-5b7e-4e17-8a61-b2b55b163a37 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:18.357333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887441c-8a84-43b0-9174-b1fbbec5988f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:18.358031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887441c-8a84-43b0-9174-b1fbbec5988f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:18.358315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887441c-8a84-43b0-9174-b1fbbec5988f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:18.358594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887441c-8a84-43b0-9174-b1fbbec5988f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/groups/de5100a95ecd4f85a2d4338ae3610963` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:18.359912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887441c-8a84-43b0-9174-b1fbbec5988f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_group(group_id=de5100a95ecd4f85a2d4338ae3610963)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:18.362305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887441c-8a84-43b0-9174-b1fbbec5988f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:18.462305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a41c38-b0d8-4707-bfb4-83129b4b4b56 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:18.462761 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2355/4730] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:02:18 2022] DELETE /identity/v3/groups/de5100a95ecd4f85a2d4338ae3610963 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:18.479055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a41c38-b0d8-4707-bfb4-83129b4b4b56 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:18.646424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:18.647633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:18.648147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:18.650413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles/0f49e673d57b47d0895774b154a1410b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:18.652429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0f49e673d57b47d0895774b154a1410b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:18.656075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:18.732303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role 0f49e673d57b47d0895774b154a1410b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:18.734277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:18.735575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:18.744957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887441c-8a84-43b0-9174-b1fbbec5988f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:18.746752 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2376/4731] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:18 2022] DELETE /identity/v3/roles/0f49e673d57b47d0895774b154a1410b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:18.747843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2887441c-8a84-43b0-9174-b1fbbec5988f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:18.779781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887441c-8a84-43b0-9174-b1fbbec5988f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:18.956296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:18.956579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:18.956897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:18.957176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/af6623dc3bdd42e58d32c73610363730` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:18.959360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=af6623dc3bdd42e58d32c73610363730)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:18.962381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:19.018360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'af6623dc3bdd42e58d32c73610363730'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.019355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'af6623dc3bdd42e58d32c73610363730'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.155043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'af6623dc3bdd42e58d32c73610363730'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.168015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'af6623dc3bdd42e58d32c73610363730'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.178404 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2356/4732] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:02:18 2022] PATCH /identity/v3/domains/af6623dc3bdd42e58d32c73610363730 => generated 277 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:02:19.182518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:19.197717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2eee2-8d8c-473a-8e11-bd8fee3a34fe tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:19.340286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:19.341512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:19.341807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:19.342089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/af6623dc3bdd42e58d32c73610363730` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:19.380164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=af6623dc3bdd42e58d32c73610363730)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:19.381467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:19.455877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'af6623dc3bdd42e58d32c73610363730'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.479988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'af6623dc3bdd42e58d32c73610363730'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.485493 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:19.594763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6623dc3bdd42e58d32c73610363730', 'request_id': 'req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.613217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6623dc3bdd42e58d32c73610363730', 'request_id': 'req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.622659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6623dc3bdd42e58d32c73610363730', 'request_id': 'req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.667854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] The token cache is being invalidate because project af6623dc3bdd42e58d32c73610363730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:19.668385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.669196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.692303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'af6623dc3bdd42e58d32c73610363730', 'request_id': 'req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.701101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'af6623dc3bdd42e58d32c73610363730', 'request_id': 'req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.701905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'af6623dc3bdd42e58d32c73610363730', 'request_id': 'req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.721336 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2377/4733] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:02:19 2022] DELETE /identity/v3/domains/af6623dc3bdd42e58d32c73610363730 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:19.722774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:19.724777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:19.747606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe9843-7762-4e3a-b365-a5757d8fb6a7 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:19.758085 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:19.864535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:19.865741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:19.866287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:19.866728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/24906f1fa49841ada2c332911bead004/users/34bdda27e8934694b67f89dd28c269ff/roles/dfd435f7a1e045d691f58fa57963d76d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:19.870097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=24906f1fa49841ada2c332911bead004, user_id=34bdda27e8934694b67f89dd28c269ff, role_id=dfd435f7a1e045d691f58fa57963d76d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:19.873281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:19.880502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role dfd435f7a1e045d691f58fa57963d76d was removed from user 34bdda27e8934694b67f89dd28c269ff on domain 24906f1fa49841ada2c332911bead004. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:19.880967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.881858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:19.905644 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2357/4734] 10.222.0.27 () {58 vars in 1464 bytes} [Wed Oct 19 01:02:19 2022] DELETE /identity/v3/domains/24906f1fa49841ada2c332911bead004/users/34bdda27e8934694b67f89dd28c269ff/roles/dfd435f7a1e045d691f58fa57963d76d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:19.910139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:19.911677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:19.926024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9676a-72bc-4473-abe0-0dd4fb17d0ae tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:20.024610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:20.025894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:20.028966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:20.029690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles/dfd435f7a1e045d691f58fa57963d76d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:20.032015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dfd435f7a1e045d691f58fa57963d76d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:20.034844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:20.084509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role dfd435f7a1e045d691f58fa57963d76d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:20.092028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.092028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.092028 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2378/4735] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:19 2022] DELETE /identity/v3/roles/dfd435f7a1e045d691f58fa57963d76d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:20.093515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:20.096515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:20.114142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ecb92-a653-47c3-b53d-cfa45347c95f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:20.222024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:20.222785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:20.223143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:20.223802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/24906f1fa49841ada2c332911bead004` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:20.229776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=24906f1fa49841ada2c332911bead004)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:20.231735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:20.282265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '24906f1fa49841ada2c332911bead004'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.285873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '24906f1fa49841ada2c332911bead004'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.335040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '24906f1fa49841ada2c332911bead004'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.336486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '24906f1fa49841ada2c332911bead004'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.342686 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2358/4736] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:02:20 2022] PATCH /identity/v3/domains/24906f1fa49841ada2c332911bead004 => generated 278 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:02:20.344021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:20.346468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:20.366870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814c1fc-f53a-4a70-a980-e3599e4701ac tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:20.452017 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:20.523259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:20.523982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:20.524414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:20.524699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/24906f1fa49841ada2c332911bead004` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:20.539401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=24906f1fa49841ada2c332911bead004)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:20.545636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:20.591324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '24906f1fa49841ada2c332911bead004'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.618646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '24906f1fa49841ada2c332911bead004'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.738613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24906f1fa49841ada2c332911bead004', 'request_id': 'req-dfd759aa-9150-4d9c-83af-192bf77dd91f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.754740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24906f1fa49841ada2c332911bead004', 'request_id': 'req-dfd759aa-9150-4d9c-83af-192bf77dd91f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.762405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24906f1fa49841ada2c332911bead004', 'request_id': 'req-dfd759aa-9150-4d9c-83af-192bf77dd91f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.783243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] The token cache is being invalidate because project 24906f1fa49841ada2c332911bead004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:20.784373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.785326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.814908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '24906f1fa49841ada2c332911bead004', 'request_id': 'req-dfd759aa-9150-4d9c-83af-192bf77dd91f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.823224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '24906f1fa49841ada2c332911bead004', 'request_id': 'req-dfd759aa-9150-4d9c-83af-192bf77dd91f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.824564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '24906f1fa49841ada2c332911bead004', 'request_id': 'req-dfd759aa-9150-4d9c-83af-192bf77dd91f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:20.837102 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2379/4737] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:02:20 2022] DELETE /identity/v3/domains/24906f1fa49841ada2c332911bead004 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:20.856051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:20.863161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:20.920604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37076a-ed68-4a3d-bc3c-45e481117513 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:21.072750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60fc47-f603-4813-9f25-556c5bd80731 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:21.073801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60fc47-f603-4813-9f25-556c5bd80731 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:21.074183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60fc47-f603-4813-9f25-556c5bd80731 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:21.074461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60fc47-f603-4813-9f25-556c5bd80731 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:21.076047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60fc47-f603-4813-9f25-556c5bd80731 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:21.077852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60fc47-f603-4813-9f25-556c5bd80731 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:21.081862 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:21.108025 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2359/4738] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:21.109279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:21.110751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:21.127781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd759aa-9150-4d9c-83af-192bf77dd91f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:21.158635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc92ad8-ec1f-4518-be8a-cae5d7644fce tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:21.159443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc92ad8-ec1f-4518-be8a-cae5d7644fce tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:21.159820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc92ad8-ec1f-4518-be8a-cae5d7644fce tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:21.160156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc92ad8-ec1f-4518-be8a-cae5d7644fce tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/projects/031d0f88bb154a94aab5ca2eae9ede40/users/36313876d51e4d3e939ac0e84f571d8f/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:21.162659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc92ad8-ec1f-4518-be8a-cae5d7644fce tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_grant(project_id=031d0f88bb154a94aab5ca2eae9ede40, user_id=36313876d51e4d3e939ac0e84f571d8f, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:21.168845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc92ad8-ec1f-4518-be8a-cae5d7644fce tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:21.193409 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2380/4739] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:21 2022] PUT /identity/v3/projects/031d0f88bb154a94aab5ca2eae9ede40/users/36313876d51e4d3e939ac0e84f571d8f/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:21.194494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60fc47-f603-4813-9f25-556c5bd80731 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:21.215284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60fc47-f603-4813-9f25-556c5bd80731 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:21.378574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074f8d-a3d2-4dee-a53a-6b1c38ed3a18 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:21.380146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074f8d-a3d2-4dee-a53a-6b1c38ed3a18 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:21.380904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074f8d-a3d2-4dee-a53a-6b1c38ed3a18 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:21.382595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074f8d-a3d2-4dee-a53a-6b1c38ed3a18 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:21.383358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074f8d-a3d2-4dee-a53a-6b1c38ed3a18 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:21.388745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074f8d-a3d2-4dee-a53a-6b1c38ed3a18 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:21.497013 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2360/4740] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 01:02:21 2022] GET /identity/v3/auth/projects => generated 824 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:02:21.501206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc92ad8-ec1f-4518-be8a-cae5d7644fce tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:21.527704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc92ad8-ec1f-4518-be8a-cae5d7644fce tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:21.539537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:21.543032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:21.543771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:21.544050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/projects/031d0f88bb154a94aab5ca2eae9ede40/users/36313876d51e4d3e939ac0e84f571d8f/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:21.550115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=031d0f88bb154a94aab5ca2eae9ede40, user_id=36313876d51e4d3e939ac0e84f571d8f, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:21.552552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:21.570152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role 3c676188d9f646ba8509d3eef1e196de was removed from user 36313876d51e4d3e939ac0e84f571d8f on project 031d0f88bb154a94aab5ca2eae9ede40. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:21.570391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:21.573477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:21.616544 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2381/4741] 10.222.0.27 () {58 vars in 1467 bytes} [Wed Oct 19 01:02:21 2022] DELETE /identity/v3/projects/031d0f88bb154a94aab5ca2eae9ede40/users/36313876d51e4d3e939ac0e84f571d8f/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:21.622875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074f8d-a3d2-4dee-a53a-6b1c38ed3a18 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:21.625187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7d074f8d-a3d2-4dee-a53a-6b1c38ed3a18 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:21.673120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074f8d-a3d2-4dee-a53a-6b1c38ed3a18 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:21.842565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd4842-3687-4a3d-8edd-711f1c1bca44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:21.843914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd4842-3687-4a3d-8edd-711f1c1bca44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:21.848229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd4842-3687-4a3d-8edd-711f1c1bca44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:21.848229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd4842-3687-4a3d-8edd-711f1c1bca44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:21.852926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd4842-3687-4a3d-8edd-711f1c1bca44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:21.854899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd4842-3687-4a3d-8edd-711f1c1bca44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:21.917826 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2361/4742] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:21 2022] POST /identity/v3/users => generated 321 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:21.924429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:21.935036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355970c6-5d29-4510-968f-eb6a158961db tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:21.956927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303d50f-6fb3-4756-bfb3-a1112b00eebc tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:21.958429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303d50f-6fb3-4756-bfb3-a1112b00eebc tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:21.958730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303d50f-6fb3-4756-bfb3-a1112b00eebc tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:21.960293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303d50f-6fb3-4756-bfb3-a1112b00eebc tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:21.961792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303d50f-6fb3-4756-bfb3-a1112b00eebc tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:21.969282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303d50f-6fb3-4756-bfb3-a1112b00eebc tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:22.067550 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2382/4743] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:21 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:22.068988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd4842-3687-4a3d-8edd-711f1c1bca44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:22.103476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd4842-3687-4a3d-8edd-711f1c1bca44 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:22.212006 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:22.235657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67412f5a-c8cc-4f5d-be22-e26d91a394d1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:22.237542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67412f5a-c8cc-4f5d-be22-e26d91a394d1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:22.237894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67412f5a-c8cc-4f5d-be22-e26d91a394d1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:22.238182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67412f5a-c8cc-4f5d-be22-e26d91a394d1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:22.243667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67412f5a-c8cc-4f5d-be22-e26d91a394d1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:22.256588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67412f5a-c8cc-4f5d-be22-e26d91a394d1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:22.373396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303d50f-6fb3-4756-bfb3-a1112b00eebc tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:22.373575 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2362/4744] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:22 2022] POST /identity/v3/projects => generated 363 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:22.414016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303d50f-6fb3-4756-bfb3-a1112b00eebc tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:22.480945 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:22.615097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1051b-6f30-40fa-9985-d07d57b35ecf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:22.615890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1051b-6f30-40fa-9985-d07d57b35ecf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:22.616433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1051b-6f30-40fa-9985-d07d57b35ecf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:22.616717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1051b-6f30-40fa-9985-d07d57b35ecf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:22.617342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1051b-6f30-40fa-9985-d07d57b35ecf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:22.619294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1051b-6f30-40fa-9985-d07d57b35ecf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:22.647842 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2383/4745] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:02:22 2022] POST /identity/v3/roles => generated 240 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:02:22.652434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67412f5a-c8cc-4f5d-be22-e26d91a394d1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:22.673433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67412f5a-c8cc-4f5d-be22-e26d91a394d1 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:22.684895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35b1d5-89b0-4d8e-aa34-eeb3d3395a23 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:22.685364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b1d5-89b0-4d8e-aa34-eeb3d3395a23 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:22.685655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b1d5-89b0-4d8e-aa34-eeb3d3395a23 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:22.685940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b1d5-89b0-4d8e-aa34-eeb3d3395a23 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/projects/29c0370962c043728db8455df1a5f2d7/users/1b88c3c4c6ff49efb6e0797ff8b6ebd1/roles/6cad84f4d2014395a90047dde6021a8f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:22.719187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35b1d5-89b0-4d8e-aa34-eeb3d3395a23 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_grant(project_id=29c0370962c043728db8455df1a5f2d7, user_id=1b88c3c4c6ff49efb6e0797ff8b6ebd1, role_id=6cad84f4d2014395a90047dde6021a8f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:22.724000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35b1d5-89b0-4d8e-aa34-eeb3d3395a23 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:22.745838 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2363/4746] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:22 2022] PUT /identity/v3/projects/29c0370962c043728db8455df1a5f2d7/users/1b88c3c4c6ff49efb6e0797ff8b6ebd1/roles/6cad84f4d2014395a90047dde6021a8f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:22.750086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1051b-6f30-40fa-9985-d07d57b35ecf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:22.764424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1051b-6f30-40fa-9985-d07d57b35ecf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:22.903480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d03743-a7b7-4177-a984-6097877c7f30 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:22.904290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d03743-a7b7-4177-a984-6097877c7f30 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:22.905271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d03743-a7b7-4177-a984-6097877c7f30 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:22.906341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d03743-a7b7-4177-a984-6097877c7f30 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/projects/8cc776c87aec4c1b96ce36601ef1c989/users/1b88c3c4c6ff49efb6e0797ff8b6ebd1/roles/6cad84f4d2014395a90047dde6021a8f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:22.908817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d03743-a7b7-4177-a984-6097877c7f30 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8cc776c87aec4c1b96ce36601ef1c989, user_id=1b88c3c4c6ff49efb6e0797ff8b6ebd1, role_id=6cad84f4d2014395a90047dde6021a8f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:22.911269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d03743-a7b7-4177-a984-6097877c7f30 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:22.933103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2384/4747] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:22 2022] PUT /identity/v3/projects/8cc776c87aec4c1b96ce36601ef1c989/users/1b88c3c4c6ff49efb6e0797ff8b6ebd1/roles/6cad84f4d2014395a90047dde6021a8f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:02:22.937826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876549d6-d9aa-44c5-887b-d5de0f179cfd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:22.938296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876549d6-d9aa-44c5-887b-d5de0f179cfd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:22.938296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876549d6-d9aa-44c5-887b-d5de0f179cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:22.974674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-876549d6-d9aa-44c5-887b-d5de0f179cfd None None] MFA Rules not processed for user `1b88c3c4c6ff49efb6e0797ff8b6ebd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:22.976036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-876549d6-d9aa-44c5-887b-d5de0f179cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:22.980556 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2364/4748] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:22 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:02:22.984598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01bc12-9ad6-49a7-8395-b919060a2963 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:22.984925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01bc12-9ad6-49a7-8395-b919060a2963 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:22.985571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01bc12-9ad6-49a7-8395-b919060a2963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:22.999661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ff01bc12-9ad6-49a7-8395-b919060a2963 None None] MFA Rules not processed for user `1b88c3c4c6ff49efb6e0797ff8b6ebd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:23.001038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ff01bc12-9ad6-49a7-8395-b919060a2963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:23.204353 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2385/4749] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:22 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 19 01:02:23.217733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876549d6-d9aa-44c5-887b-d5de0f179cfd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:23.434355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876549d6-d9aa-44c5-887b-d5de0f179cfd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:23.443332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c687a2d-4d6f-4060-a78d-9b54a8d54453 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:23.443900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687a2d-4d6f-4060-a78d-9b54a8d54453 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:23.444184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687a2d-4d6f-4060-a78d-9b54a8d54453 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:23.444472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687a2d-4d6f-4060-a78d-9b54a8d54453 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:23.474332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c687a2d-4d6f-4060-a78d-9b54a8d54453 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:23.478054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c687a2d-4d6f-4060-a78d-9b54a8d54453 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:23.515131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8874ff-c11e-45e7-a4bc-d9955f1b9b02 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:23.516371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8874ff-c11e-45e7-a4bc-d9955f1b9b02 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:23.516371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8874ff-c11e-45e7-a4bc-d9955f1b9b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:23.528658 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2365/4750] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Oct 19 01:02:23 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:23.556350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5c8874ff-c11e-45e7-a4bc-d9955f1b9b02 None None] MFA Rules not processed for user `1b88c3c4c6ff49efb6e0797ff8b6ebd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:23.561589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5c8874ff-c11e-45e7-a4bc-d9955f1b9b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:23.727351 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:23.740338 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2386/4751] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 19 01:02:23.741152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c687a2d-4d6f-4060-a78d-9b54a8d54453 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:23.752576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c687a2d-4d6f-4060-a78d-9b54a8d54453 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:23.781660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea9692-4476-4f61-b51b-a8e3fb76d375 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:23.783762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea9692-4476-4f61-b51b-a8e3fb76d375 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:23.784065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea9692-4476-4f61-b51b-a8e3fb76d375 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:23.784335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea9692-4476-4f61-b51b-a8e3fb76d375 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/roles/6cad84f4d2014395a90047dde6021a8f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:23.789191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea9692-4476-4f61-b51b-a8e3fb76d375 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6cad84f4d2014395a90047dde6021a8f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:23.790960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea9692-4476-4f61-b51b-a8e3fb76d375 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:23.864600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9ea9692-4476-4f61-b51b-a8e3fb76d375 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invalidating the token cache because role 6cad84f4d2014395a90047dde6021a8f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:23.864941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9ea9692-4476-4f61-b51b-a8e3fb76d375 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:23.865785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9ea9692-4476-4f61-b51b-a8e3fb76d375 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:23.867883 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2366/4752] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:23 2022] DELETE /identity/v3/roles/6cad84f4d2014395a90047dde6021a8f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:02:23.872378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8874ff-c11e-45e7-a4bc-d9955f1b9b02 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:23.885986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8874ff-c11e-45e7-a4bc-d9955f1b9b02 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:23.969475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:23.970885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:23.972419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:23.972419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/projects/8cc776c87aec4c1b96ce36601ef1c989` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:23.978052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8cc776c87aec4c1b96ce36601ef1c989)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:23.980280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:24.167215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc776c87aec4c1b96ce36601ef1c989', 'request_id': 'req-22202f34-a6e6-4dc1-8d68-e6a990329f01'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.171657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69647139-86bb-4ada-81a8-76bc85556602 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:24.172139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69647139-86bb-4ada-81a8-76bc85556602 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:24.172216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69647139-86bb-4ada-81a8-76bc85556602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:24.180283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc776c87aec4c1b96ce36601ef1c989', 'request_id': 'req-22202f34-a6e6-4dc1-8d68-e6a990329f01'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.196069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-69647139-86bb-4ada-81a8-76bc85556602 None None] MFA Rules not processed for user `098f448796ff4635ac6b4b7262bf6ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:24.197344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-69647139-86bb-4ada-81a8-76bc85556602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:24.205229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc776c87aec4c1b96ce36601ef1c989', 'request_id': 'req-22202f34-a6e6-4dc1-8d68-e6a990329f01'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.255622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] The token cache is being invalidate because project 8cc776c87aec4c1b96ce36601ef1c989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:24.255934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.256641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.261889 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2387/4753] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:23 2022] DELETE /identity/v3/projects/8cc776c87aec4c1b96ce36601ef1c989 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:24.263121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:24.265999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:24.279430 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:24.322095 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2367/4754] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:02:24.436804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202f34-a6e6-4dc1-8d68-e6a990329f01 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:24.447671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:24.449138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:24.450974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:24.452593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/projects/8cc776c87aec4c1b96ce36601ef1c989` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:24.491614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8cc776c87aec4c1b96ce36601ef1c989)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:24.493763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Could not find project: 8cc776c87aec4c1b96ce36601ef1c989.: keystone.exception.ProjectNotFound: Could not find project: 8cc776c87aec4c1b96ce36601ef1c989. Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 19 01:02:24.514066 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8cc776c87aec4c1b96ce36601ef1c989. Oct 19 01:02:24.514993 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:02:24.518891 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2388/4755] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:24 2022] DELETE /identity/v3/projects/8cc776c87aec4c1b96ce36601ef1c989 => generated 113 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:02:24.524078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69647139-86bb-4ada-81a8-76bc85556602 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:24.541514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69647139-86bb-4ada-81a8-76bc85556602 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:24.561474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:24.562142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:24.562431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:24.562697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/projects/29c0370962c043728db8455df1a5f2d7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:24.567461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_project(project_id=29c0370962c043728db8455df1a5f2d7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:24.569428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:24.734391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c0370962c043728db8455df1a5f2d7', 'request_id': 'req-3c1ca861-6346-4cd3-9445-37e74361ce53'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.755662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c0370962c043728db8455df1a5f2d7', 'request_id': 'req-3c1ca861-6346-4cd3-9445-37e74361ce53'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.777293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c0370962c043728db8455df1a5f2d7', 'request_id': 'req-3c1ca861-6346-4cd3-9445-37e74361ce53'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.813495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] The token cache is being invalidate because project 29c0370962c043728db8455df1a5f2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:24.818171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.823193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:24.829644 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2368/4756] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:24 2022] DELETE /identity/v3/projects/29c0370962c043728db8455df1a5f2d7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:24.836584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:24.843617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:24.884456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d0e6b-b9f8-43f8-960d-452ce639b852 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:24.944523 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:25.082677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:25.083334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:25.083619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:25.083901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/users/1b88c3c4c6ff49efb6e0797ff8b6ebd1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:25.086630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1b88c3c4c6ff49efb6e0797ff8b6ebd1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:25.088771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:25.193099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b88c3c4c6ff49efb6e0797ff8b6ebd1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:25.225854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b88c3c4c6ff49efb6e0797ff8b6ebd1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:25.245870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b88c3c4c6ff49efb6e0797ff8b6ebd1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:25.255773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b88c3c4c6ff49efb6e0797ff8b6ebd1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:25.256591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b88c3c4c6ff49efb6e0797ff8b6ebd1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:25.269318 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2389/4757] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:24 2022] DELETE /identity/v3/users/1b88c3c4c6ff49efb6e0797ff8b6ebd1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:25.277696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:25.299549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ca861-6346-4cd3-9445-37e74361ce53 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:25.524437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578a98f-92cf-4dd5-b514-466560f52e93 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:25.525375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a98f-92cf-4dd5-b514-466560f52e93 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:25.527497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a98f-92cf-4dd5-b514-466560f52e93 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:25.527898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a98f-92cf-4dd5-b514-466560f52e93 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/8184496b209d4421adff2a7b7d08e047` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:25.553469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578a98f-92cf-4dd5-b514-466560f52e93 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-f578a98f-92cf-4dd5-b514-466560f52e93 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Could not find domain: 8184496b209d4421adff2a7b7d08e047.: keystone.exception.DomainNotFound: Could not find domain: 8184496b209d4421adff2a7b7d08e047. Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8184496b209d4421adff2a7b7d08e047. Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:02:25.567969 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:02:25.569132 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8184496b209d4421adff2a7b7d08e047. Oct 19 01:02:25.570004 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:02:25.571036 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2369/4758] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:02:25 2022] PATCH /identity/v3/domains/8184496b209d4421adff2a7b7d08e047 => generated 112 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:02:25.576765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:25.578254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:25.601910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388564d-4dcf-48e7-87e3-d7d7ab52c6eb tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:25.614850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3282d-d2d0-4b8d-9496-578411926e8f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:25.615519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3282d-d2d0-4b8d-9496-578411926e8f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:25.615808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3282d-d2d0-4b8d-9496-578411926e8f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:25.616091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3282d-d2d0-4b8d-9496-578411926e8f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/426a296e0a6048f19501810112800147` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:25.634024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3282d-d2d0-4b8d-9496-578411926e8f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-39b3282d-d2d0-4b8d-9496-578411926e8f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Could not find domain: 426a296e0a6048f19501810112800147.: keystone.exception.DomainNotFound: Could not find domain: 426a296e0a6048f19501810112800147. Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 426a296e0a6048f19501810112800147. Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:02:25.641071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:02:25.642238 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 426a296e0a6048f19501810112800147. Oct 19 01:02:25.643111 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:02:25.644002 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2390/4759] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:02:25 2022] PATCH /identity/v3/domains/426a296e0a6048f19501810112800147 => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:02:25.647467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578a98f-92cf-4dd5-b514-466560f52e93 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:25.663435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578a98f-92cf-4dd5-b514-466560f52e93 tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:25.682968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973bb2a-48ac-4498-984c-2f25db720d6f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:25.683665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973bb2a-48ac-4498-984c-2f25db720d6f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:25.683950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973bb2a-48ac-4498-984c-2f25db720d6f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:25.684229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973bb2a-48ac-4498-984c-2f25db720d6f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/af6623dc3bdd42e58d32c73610363730` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:25.712960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973bb2a-48ac-4498-984c-2f25db720d6f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-1973bb2a-48ac-4498-984c-2f25db720d6f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Could not find domain: af6623dc3bdd42e58d32c73610363730.: keystone.exception.DomainNotFound: Could not find domain: af6623dc3bdd42e58d32c73610363730. Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: af6623dc3bdd42e58d32c73610363730. Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:02:25.735280 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:02:25.737225 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: af6623dc3bdd42e58d32c73610363730. Oct 19 01:02:25.738123 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:02:25.745964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3282d-d2d0-4b8d-9496-578411926e8f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:25.746155 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2370/4760] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:02:25 2022] PATCH /identity/v3/domains/af6623dc3bdd42e58d32c73610363730 => generated 112 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:02:25.758880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3282d-d2d0-4b8d-9496-578411926e8f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:25.764030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc6a28-5832-4345-93d5-a9502afa3dbf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36313876d51e4d3e939ac0e84f571d8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:25.764784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc6a28-5832-4345-93d5-a9502afa3dbf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:25.765149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc6a28-5832-4345-93d5-a9502afa3dbf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:25.765436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc6a28-5832-4345-93d5-a9502afa3dbf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] PATH_INFO: `/v3/domains/24906f1fa49841ada2c332911bead004` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:25.775145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc6a28-5832-4345-93d5-a9502afa3dbf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-e7dc6a28-5832-4345-93d5-a9502afa3dbf tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Could not find domain: 24906f1fa49841ada2c332911bead004.: keystone.exception.DomainNotFound: Could not find domain: 24906f1fa49841ada2c332911bead004. Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 24906f1fa49841ada2c332911bead004. Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:02:25.782434 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:02:25.783445 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 24906f1fa49841ada2c332911bead004. Oct 19 01:02:25.784568 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:02:25.792022 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2391/4761] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:02:25 2022] PATCH /identity/v3/domains/24906f1fa49841ada2c332911bead004 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:02:25.794139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973bb2a-48ac-4498-984c-2f25db720d6f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:25.796134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1973bb2a-48ac-4498-984c-2f25db720d6f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:25.888681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973bb2a-48ac-4498-984c-2f25db720d6f tempest-TokensV3TestJSON-52639382 tempest-TokensV3TestJSON-52639382-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:25.897092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:25.898285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:25.898749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:25.899767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] PATH_INFO: `/v3/users/3444e88fe8d94dc1bb9c79bb6127a8fc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:25.901420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3444e88fe8d94dc1bb9c79bb6127a8fc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:25.903774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:25.906206 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:26.005222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3444e88fe8d94dc1bb9c79bb6127a8fc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:26.058819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3444e88fe8d94dc1bb9c79bb6127a8fc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:26.079087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3444e88fe8d94dc1bb9c79bb6127a8fc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:26.114045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3444e88fe8d94dc1bb9c79bb6127a8fc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:26.117659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3444e88fe8d94dc1bb9c79bb6127a8fc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:26.190115 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2371/4762] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:25 2022] DELETE /identity/v3/users/3444e88fe8d94dc1bb9c79bb6127a8fc => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:02:26.194511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b79f6e-6c66-4456-b9e1-7ac9999fce84 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:26.194999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b79f6e-6c66-4456-b9e1-7ac9999fce84 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:26.195090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b79f6e-6c66-4456-b9e1-7ac9999fce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:26.288650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-45b79f6e-6c66-4456-b9e1-7ac9999fce84 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:26.294512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-45b79f6e-6c66-4456-b9e1-7ac9999fce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:26.540649 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2392/4763] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:26.587262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:26.588824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:26.910360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb381e9-b7a1-4bd4-9215-12411ebca954 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:26.929962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08e4cc-665e-499c-8bb2-fa77cb2699a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:26.930776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08e4cc-665e-499c-8bb2-fa77cb2699a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:26.931226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08e4cc-665e-499c-8bb2-fa77cb2699a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:26.931646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08e4cc-665e-499c-8bb2-fa77cb2699a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:26.968652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08e4cc-665e-499c-8bb2-fa77cb2699a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:26.971586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08e4cc-665e-499c-8bb2-fa77cb2699a2 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:27.025454 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2372/4764] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:27.739871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b79f6e-6c66-4456-b9e1-7ac9999fce84 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:27.741438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-45b79f6e-6c66-4456-b9e1-7ac9999fce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:27.788313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b79f6e-6c66-4456-b9e1-7ac9999fce84 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:27.829677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:27.830614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:27.833104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:27.833600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] PATH_INFO: `/v3/projects/031d0f88bb154a94aab5ca2eae9ede40` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:27.836994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] RBAC: Authorizing `identity:delete_project(project_id=031d0f88bb154a94aab5ca2eae9ede40)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:27.839109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:27.915206 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:27.967352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031d0f88bb154a94aab5ca2eae9ede40', 'request_id': 'req-d81b3067-75e2-4464-8b25-ba7f40d5926a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:27.980789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031d0f88bb154a94aab5ca2eae9ede40', 'request_id': 'req-d81b3067-75e2-4464-8b25-ba7f40d5926a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:28.009406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031d0f88bb154a94aab5ca2eae9ede40', 'request_id': 'req-d81b3067-75e2-4464-8b25-ba7f40d5926a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:28.042793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] The token cache is being invalidate because project 031d0f88bb154a94aab5ca2eae9ede40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:28.043256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:28.044376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:28.049849 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2393/4765] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:27 2022] DELETE /identity/v3/projects/031d0f88bb154a94aab5ca2eae9ede40 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:28.056767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08e4cc-665e-499c-8bb2-fa77cb2699a2 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:28.078534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08e4cc-665e-499c-8bb2-fa77cb2699a2 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:28.247741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:28.248405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:28.248717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:28.249648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] PATH_INFO: `/v3/users/36313876d51e4d3e939ac0e84f571d8f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:28.250468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36313876d51e4d3e939ac0e84f571d8f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:28.253465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:28.301237 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:28.363078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36313876d51e4d3e939ac0e84f571d8f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:28.378382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36313876d51e4d3e939ac0e84f571d8f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:28.388186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36313876d51e4d3e939ac0e84f571d8f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:28.412270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36313876d51e4d3e939ac0e84f571d8f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:28.413598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36313876d51e4d3e939ac0e84f571d8f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:28.420404 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2373/4766] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:28 2022] DELETE /identity/v3/users/36313876d51e4d3e939ac0e84f571d8f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:28.878461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:28.882080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:28.916469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b3067-75e2-4464-8b25-ba7f40d5926a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:29.094844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:29.096484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:29.096968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:29.097399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] PATH_INFO: `/v3/projects/05d451b38f6d47f99d1a1d0c39d6f0d2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:29.102465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d451b38f6d47f99d1a1d0c39d6f0d2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:29.104687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:29.226300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'request_id': 'req-b31127f5-6f5f-4c59-91bf-51c02c998839'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.255541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'request_id': 'req-b31127f5-6f5f-4c59-91bf-51c02c998839'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.265560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d451b38f6d47f99d1a1d0c39d6f0d2', 'request_id': 'req-b31127f5-6f5f-4c59-91bf-51c02c998839'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.290009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] The token cache is being invalidate because project 05d451b38f6d47f99d1a1d0c39d6f0d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:29.290475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.293979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.297055 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2394/4767] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:28 2022] DELETE /identity/v3/projects/05d451b38f6d47f99d1a1d0c39d6f0d2 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:29.301903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:29.303473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:29.326014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfa9ac-3fbd-4aa8-97e6-ee3ab68d5892 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:29.487344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:29.488470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:29.489150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:29.489692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] PATH_INFO: `/v3/users/34bdda27e8934694b67f89dd28c269ff` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:29.491347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34bdda27e8934694b67f89dd28c269ff)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:29.493617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:29.613717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34bdda27e8934694b67f89dd28c269ff'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.641905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34bdda27e8934694b67f89dd28c269ff'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.658911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34bdda27e8934694b67f89dd28c269ff'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.671027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34bdda27e8934694b67f89dd28c269ff'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.671938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-96430bdf-b5ec-46e6-96ac-67e0319e5817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34bdda27e8934694b67f89dd28c269ff'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:29.681107 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2374/4768] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:29 2022] DELETE /identity/v3/users/34bdda27e8934694b67f89dd28c269ff => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:30.367390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:30.369535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:30.428375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31127f5-6f5f-4c59-91bf-51c02c998839 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:30.638183 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:30.680958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:30.682688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:30.682970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:30.683249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] PATH_INFO: `/v3/projects/1aaab6aab6d94fa3b1732d18bfd68c58` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:30.685263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aaab6aab6d94fa3b1732d18bfd68c58)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:30.690804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:30.838317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aaab6aab6d94fa3b1732d18bfd68c58', 'request_id': 'req-4dda668d-641f-41d3-8079-0417a9085e9a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:30.849229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aaab6aab6d94fa3b1732d18bfd68c58', 'request_id': 'req-4dda668d-641f-41d3-8079-0417a9085e9a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:30.858530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aaab6aab6d94fa3b1732d18bfd68c58', 'request_id': 'req-4dda668d-641f-41d3-8079-0417a9085e9a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:30.880361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] The token cache is being invalidate because project 1aaab6aab6d94fa3b1732d18bfd68c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:30.881186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:30.882142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4dda668d-641f-41d3-8079-0417a9085e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:30.885787 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2395/4769] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:30 2022] DELETE /identity/v3/projects/1aaab6aab6d94fa3b1732d18bfd68c58 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:30.894778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffd8c1-da27-4137-9875-cffb7b587424 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:30.895299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffd8c1-da27-4137-9875-cffb7b587424 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:30.895601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffd8c1-da27-4137-9875-cffb7b587424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:30.976807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fcffd8c1-da27-4137-9875-cffb7b587424 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:30.999448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fcffd8c1-da27-4137-9875-cffb7b587424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:31.068347 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:31.311283 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2375/4770] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:31.321677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff55c-f1be-4fe2-9a1c-24c9d88961d7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:31.321947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff55c-f1be-4fe2-9a1c-24c9d88961d7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:31.322120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff55c-f1be-4fe2-9a1c-24c9d88961d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:31.352707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-37cff55c-f1be-4fe2-9a1c-24c9d88961d7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:31.355133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-37cff55c-f1be-4fe2-9a1c-24c9d88961d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:31.372446 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2396/4771] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:31.375341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffd8c1-da27-4137-9875-cffb7b587424 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:31.407001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffd8c1-da27-4137-9875-cffb7b587424 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:31.429563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7d5f3-5e80-4c02-9548-31673610b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:31.432315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7d5f3-5e80-4c02-9548-31673610b3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:31.436612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7d5f3-5e80-4c02-9548-31673610b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:31.440318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7d5f3-5e80-4c02-9548-31673610b3d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:31.441902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7d5f3-5e80-4c02-9548-31673610b3d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:02:31.442876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7d5f3-5e80-4c02-9548-31673610b3d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:31.450676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7d5f3-5e80-4c02-9548-31673610b3d0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:31.537135 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2376/4772] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:02:31.539787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cff55c-f1be-4fe2-9a1c-24c9d88961d7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:31.551466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cff55c-f1be-4fe2-9a1c-24c9d88961d7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:31.577483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7428625-a37d-41ea-ae8e-c58e7b35e8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:31.577483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7428625-a37d-41ea-ae8e-c58e7b35e8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:31.578876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7428625-a37d-41ea-ae8e-c58e7b35e8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:31.578876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7428625-a37d-41ea-ae8e-c58e7b35e8f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:31.581103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7428625-a37d-41ea-ae8e-c58e7b35e8f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:31.583545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7428625-a37d-41ea-ae8e-c58e7b35e8f4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:31.653505 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2397/4773] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:31 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:31.657884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7d5f3-5e80-4c02-9548-31673610b3d0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:31.677788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7d5f3-5e80-4c02-9548-31673610b3d0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:31.868456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dc5b3-0cf1-4c8c-8a68-2a0208d9eae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:31.869586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dc5b3-0cf1-4c8c-8a68-2a0208d9eae2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:31.869872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dc5b3-0cf1-4c8c-8a68-2a0208d9eae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:31.870148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dc5b3-0cf1-4c8c-8a68-2a0208d9eae2 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:31.870795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dc5b3-0cf1-4c8c-8a68-2a0208d9eae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:31.872781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dc5b3-0cf1-4c8c-8a68-2a0208d9eae2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:31.923915 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2377/4774] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:31 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:31.927827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7428625-a37d-41ea-ae8e-c58e7b35e8f4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:31.954738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7428625-a37d-41ea-ae8e-c58e7b35e8f4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:31.979832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f39de-305e-4e40-b8e2-b468f718aec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:31.980856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f39de-305e-4e40-b8e2-b468f718aec4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:31.981344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f39de-305e-4e40-b8e2-b468f718aec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:31.981841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f39de-305e-4e40-b8e2-b468f718aec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:31.982717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f39de-305e-4e40-b8e2-b468f718aec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:31.984547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f39de-305e-4e40-b8e2-b468f718aec4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:31.997832 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2398/4775] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:32.001826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dc5b3-0cf1-4c8c-8a68-2a0208d9eae2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:32.035215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dc5b3-0cf1-4c8c-8a68-2a0208d9eae2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:32.046862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaf7e1-42cc-4c8e-82bc-a911d1284f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:32.048085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaf7e1-42cc-4c8e-82bc-a911d1284f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:32.048944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaf7e1-42cc-4c8e-82bc-a911d1284f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:32.049418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaf7e1-42cc-4c8e-82bc-a911d1284f36 admin admin] PATH_INFO: `/v3/projects/ddc7a296ccae464d8b14f46f62a8e972/users/39bdefb4fd7c4d7995c37541828a7200/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:32.077607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaf7e1-42cc-4c8e-82bc-a911d1284f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc7a296ccae464d8b14f46f62a8e972, user_id=39bdefb4fd7c4d7995c37541828a7200, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:32.086245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaf7e1-42cc-4c8e-82bc-a911d1284f36 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:32.114912 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2378/4776] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:32 2022] PUT /identity/v3/projects/ddc7a296ccae464d8b14f46f62a8e972/users/39bdefb4fd7c4d7995c37541828a7200/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:32.119037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f39de-305e-4e40-b8e2-b468f718aec4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:32.134806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f39de-305e-4e40-b8e2-b468f718aec4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:32.235360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c1d17-1d25-4024-8b6e-315d0c0e3626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:32.236237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c1d17-1d25-4024-8b6e-315d0c0e3626 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:32.236517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c1d17-1d25-4024-8b6e-315d0c0e3626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:32.236839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c1d17-1d25-4024-8b6e-315d0c0e3626 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:32.237642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c1d17-1d25-4024-8b6e-315d0c0e3626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:32.239755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c1d17-1d25-4024-8b6e-315d0c0e3626 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:32.256744 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2399/4777] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:32.257894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaf7e1-42cc-4c8e-82bc-a911d1284f36 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:32.270446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaf7e1-42cc-4c8e-82bc-a911d1284f36 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:32.275458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041a821-c101-482f-a3d9-6c6f1ea73713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:32.276196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a821-c101-482f-a3d9-6c6f1ea73713 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:32.276541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a821-c101-482f-a3d9-6c6f1ea73713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:32.276911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a821-c101-482f-a3d9-6c6f1ea73713 admin admin] PATH_INFO: `/v3/projects/ddc7a296ccae464d8b14f46f62a8e972/users/39bdefb4fd7c4d7995c37541828a7200/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:32.280696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041a821-c101-482f-a3d9-6c6f1ea73713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc7a296ccae464d8b14f46f62a8e972, user_id=39bdefb4fd7c4d7995c37541828a7200, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:32.283930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041a821-c101-482f-a3d9-6c6f1ea73713 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:32.301294 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2379/4778] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:32 2022] PUT /identity/v3/projects/ddc7a296ccae464d8b14f46f62a8e972/users/39bdefb4fd7c4d7995c37541828a7200/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:32.311822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2157a-7e36-47d6-bb24-c37a8d10c7bf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:32.312114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2157a-7e36-47d6-bb24-c37a8d10c7bf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:32.312440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2157a-7e36-47d6-bb24-c37a8d10c7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:32.347668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-97e2157a-7e36-47d6-bb24-c37a8d10c7bf None None] MFA Rules not processed for user `39bdefb4fd7c4d7995c37541828a7200`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:32.349840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-97e2157a-7e36-47d6-bb24-c37a8d10c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:32.385077 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:32.466999 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2400/4779] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:32.471654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041a821-c101-482f-a3d9-6c6f1ea73713 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:32.543050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041a821-c101-482f-a3d9-6c6f1ea73713 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:32.551586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180525e4-e660-4627-8923-dc6bcd5b4af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:32.552247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180525e4-e660-4627-8923-dc6bcd5b4af5 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:32.552528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180525e4-e660-4627-8923-dc6bcd5b4af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:32.552847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180525e4-e660-4627-8923-dc6bcd5b4af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:32.553496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180525e4-e660-4627-8923-dc6bcd5b4af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:32.555472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180525e4-e660-4627-8923-dc6bcd5b4af5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:32.560319 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:32.593240 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2380/4780] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:32 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:32.594456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2157a-7e36-47d6-bb24-c37a8d10c7bf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:32.612579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2157a-7e36-47d6-bb24-c37a8d10c7bf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:32.776312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb737491-1eee-44b6-a92d-e33baea48011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:32.776973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb737491-1eee-44b6-a92d-e33baea48011 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:32.777533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb737491-1eee-44b6-a92d-e33baea48011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:32.777817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb737491-1eee-44b6-a92d-e33baea48011 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:32.778461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb737491-1eee-44b6-a92d-e33baea48011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:32.781131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb737491-1eee-44b6-a92d-e33baea48011 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:32.818732 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2401/4781] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:32 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:32.822307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180525e4-e660-4627-8923-dc6bcd5b4af5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:32.846751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180525e4-e660-4627-8923-dc6bcd5b4af5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:32.858486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0fa6a-2570-4d9a-82a6-96a27b735b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:32.859120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0fa6a-2570-4d9a-82a6-96a27b735b79 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:32.859403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0fa6a-2570-4d9a-82a6-96a27b735b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:32.859784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0fa6a-2570-4d9a-82a6-96a27b735b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:32.860331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0fa6a-2570-4d9a-82a6-96a27b735b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:32.862007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0fa6a-2570-4d9a-82a6-96a27b735b79 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:32.883382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2381/4782] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:32.886683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb737491-1eee-44b6-a92d-e33baea48011 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:32.908090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb737491-1eee-44b6-a92d-e33baea48011 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:32.944359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883b811-b785-4e45-8bfc-50040a03a576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:32.945493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883b811-b785-4e45-8bfc-50040a03a576 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:32.947431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883b811-b785-4e45-8bfc-50040a03a576 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:32.947830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883b811-b785-4e45-8bfc-50040a03a576 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:32.950559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883b811-b785-4e45-8bfc-50040a03a576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:32.959748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883b811-b785-4e45-8bfc-50040a03a576 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:32.982930 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2402/4783] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:32.987242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0fa6a-2570-4d9a-82a6-96a27b735b79 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:33.002331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0fa6a-2570-4d9a-82a6-96a27b735b79 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:33.019184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c71fb9-001d-4e04-bfb5-f46edaf24b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:33.019863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c71fb9-001d-4e04-bfb5-f46edaf24b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:33.020148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c71fb9-001d-4e04-bfb5-f46edaf24b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:33.020430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c71fb9-001d-4e04-bfb5-f46edaf24b34 admin admin] PATH_INFO: `/v3/projects/bcb3dd2490bd4790a1e026de9ad36ea6/users/e752b7f7d110447c9aacf21fba92c4d4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:33.052959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c71fb9-001d-4e04-bfb5-f46edaf24b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb3dd2490bd4790a1e026de9ad36ea6, user_id=e752b7f7d110447c9aacf21fba92c4d4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:33.055384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c71fb9-001d-4e04-bfb5-f46edaf24b34 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:33.095170 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2382/4784] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:32 2022] PUT /identity/v3/projects/bcb3dd2490bd4790a1e026de9ad36ea6/users/e752b7f7d110447c9aacf21fba92c4d4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:33.097531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167da4c-2c85-49e0-b2b5-b0185e070651 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:33.097820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167da4c-2c85-49e0-b2b5-b0185e070651 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:33.098441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167da4c-2c85-49e0-b2b5-b0185e070651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:33.220880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c71fb9-001d-4e04-bfb5-f46edaf24b34 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:33.222683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-54c71fb9-001d-4e04-bfb5-f46edaf24b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:33.236662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6167da4c-2c85-49e0-b2b5-b0185e070651 None None] MFA Rules not processed for user `e752b7f7d110447c9aacf21fba92c4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:33.238357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6167da4c-2c85-49e0-b2b5-b0185e070651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:33.356227 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2403/4785] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:33.361906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c71fb9-001d-4e04-bfb5-f46edaf24b34 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:33.372547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167da4c-2c85-49e0-b2b5-b0185e070651 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:33.383251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6167da4c-2c85-49e0-b2b5-b0185e070651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:33.391451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f4984-3d3b-4783-8cf1-3ffd1c6d9811 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:33.392129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f4984-3d3b-4783-8cf1-3ffd1c6d9811 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:33.392409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f4984-3d3b-4783-8cf1-3ffd1c6d9811 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:33.392708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f4984-3d3b-4783-8cf1-3ffd1c6d9811 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:33.398728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-168f4984-3d3b-4783-8cf1-3ffd1c6d9811 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:33.441853 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:33.524780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167da4c-2c85-49e0-b2b5-b0185e070651 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:33.534991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f6188-44ee-4d71-848c-c9da3e20304f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:33.535628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f6188-44ee-4d71-848c-c9da3e20304f service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:33.535903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f6188-44ee-4d71-848c-c9da3e20304f service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:33.536177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f6188-44ee-4d71-848c-c9da3e20304f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:33.552018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f4984-3d3b-4783-8cf1-3ffd1c6d9811 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:33.553661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f4984-3d3b-4783-8cf1-3ffd1c6d9811 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:33.577680 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2383/4786] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:02:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:02:33.671336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f6188-44ee-4d71-848c-c9da3e20304f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:33.672414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f6188-44ee-4d71-848c-c9da3e20304f service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:33.702634 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2404/4787] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:34.161085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f4984-3d3b-4783-8cf1-3ffd1c6d9811 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:34.218776 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:34.298973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f4984-3d3b-4783-8cf1-3ffd1c6d9811 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:34.330796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:34.331476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:34.331889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:34.332206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] PATH_INFO: `/v3/users/39bdefb4fd7c4d7995c37541828a7200` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:34.333847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bdefb4fd7c4d7995c37541828a7200)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:34.338182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:34.424982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bdefb4fd7c4d7995c37541828a7200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:34.442027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bdefb4fd7c4d7995c37541828a7200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:34.454580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bdefb4fd7c4d7995c37541828a7200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:34.467196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bdefb4fd7c4d7995c37541828a7200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:34.468011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bdefb4fd7c4d7995c37541828a7200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:34.478317 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2384/4788] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:34 2022] DELETE /identity/v3/users/39bdefb4fd7c4d7995c37541828a7200 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:34.482911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bb75f-35c1-4cc1-99cc-96d5a7a96efd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:34.483436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bb75f-35c1-4cc1-99cc-96d5a7a96efd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:34.483436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bb75f-35c1-4cc1-99cc-96d5a7a96efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:34.528323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1c4bb75f-35c1-4cc1-99cc-96d5a7a96efd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:34.530002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1c4bb75f-35c1-4cc1-99cc-96d5a7a96efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:34.620783 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2405/4789] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:34.631955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:34.633532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:34.823041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4c61c-3024-4ebf-8ce0-be2f2578977d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:34.831875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5912d56-9926-4eb0-bd60-f7b73269ee89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:34.832828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5912d56-9926-4eb0-bd60-f7b73269ee89 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:34.833289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5912d56-9926-4eb0-bd60-f7b73269ee89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:34.834245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5912d56-9926-4eb0-bd60-f7b73269ee89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:34.868795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5912d56-9926-4eb0-bd60-f7b73269ee89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:34.871221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5912d56-9926-4eb0-bd60-f7b73269ee89 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:34.897422 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2385/4790] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:35.918203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bb75f-35c1-4cc1-99cc-96d5a7a96efd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:35.919983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1c4bb75f-35c1-4cc1-99cc-96d5a7a96efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:35.975133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bb75f-35c1-4cc1-99cc-96d5a7a96efd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:36.007608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:36.009208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:36.010053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:36.011226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] PATH_INFO: `/v3/projects/ddc7a296ccae464d8b14f46f62a8e972` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:36.014750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc7a296ccae464d8b14f46f62a8e972)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:36.022611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:36.106964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc7a296ccae464d8b14f46f62a8e972', 'request_id': 'req-40b0c6e4-a3a0-499e-b2c0-2f327051031b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.113370 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:36.129031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc7a296ccae464d8b14f46f62a8e972', 'request_id': 'req-40b0c6e4-a3a0-499e-b2c0-2f327051031b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.149269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc7a296ccae464d8b14f46f62a8e972', 'request_id': 'req-40b0c6e4-a3a0-499e-b2c0-2f327051031b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.164095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] The token cache is being invalidate because project ddc7a296ccae464d8b14f46f62a8e972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:36.165107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.166818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.172487 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2406/4791] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:35 2022] DELETE /identity/v3/projects/ddc7a296ccae464d8b14f46f62a8e972 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:36.177631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5912d56-9926-4eb0-bd60-f7b73269ee89 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:36.190590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5912d56-9926-4eb0-bd60-f7b73269ee89 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:36.260720 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:36.291179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:36.292105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:36.292498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:36.292816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] PATH_INFO: `/v3/users/e752b7f7d110447c9aacf21fba92c4d4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:36.294019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e752b7f7d110447c9aacf21fba92c4d4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:36.296176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:36.380846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e752b7f7d110447c9aacf21fba92c4d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.418752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e752b7f7d110447c9aacf21fba92c4d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.448056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e752b7f7d110447c9aacf21fba92c4d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.467172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e752b7f7d110447c9aacf21fba92c4d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.469482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9a2103e5-9dd0-4aae-8ec9-176dd0c69492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e752b7f7d110447c9aacf21fba92c4d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:36.479659 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2386/4792] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:36 2022] DELETE /identity/v3/users/e752b7f7d110447c9aacf21fba92c4d4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:36.988125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:36.989707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:37.010663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0c6e4-a3a0-499e-b2c0-2f327051031b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:37.102315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:37.103795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:37.104576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:37.105156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] PATH_INFO: `/v3/projects/bcb3dd2490bd4790a1e026de9ad36ea6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:37.106740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb3dd2490bd4790a1e026de9ad36ea6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:37.111591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:37.218443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb3dd2490bd4790a1e026de9ad36ea6', 'request_id': 'req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:37.228365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb3dd2490bd4790a1e026de9ad36ea6', 'request_id': 'req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:37.239816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb3dd2490bd4790a1e026de9ad36ea6', 'request_id': 'req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:37.261197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] The token cache is being invalidate because project bcb3dd2490bd4790a1e026de9ad36ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:37.261757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:37.262781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aa77ab8-5431-44e8-af42-b0be09d7ecd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:37.265831 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2407/4793] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:36 2022] DELETE /identity/v3/projects/bcb3dd2490bd4790a1e026de9ad36ea6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:37.270916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb33fe-ac22-4a1b-9f17-bedf7feb9915 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:37.271372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb33fe-ac22-4a1b-9f17-bedf7feb9915 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:37.271462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb33fe-ac22-4a1b-9f17-bedf7feb9915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:37.300289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-85cb33fe-ac22-4a1b-9f17-bedf7feb9915 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:37.301577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85cb33fe-ac22-4a1b-9f17-bedf7feb9915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:37.424553 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2387/4794] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:37.427623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7781ec-6a93-4366-9b8f-929ca72b5b8a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:37.427997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7781ec-6a93-4366-9b8f-929ca72b5b8a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:37.428341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7781ec-6a93-4366-9b8f-929ca72b5b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:37.461583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cd7781ec-6a93-4366-9b8f-929ca72b5b8a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:37.464496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cd7781ec-6a93-4366-9b8f-929ca72b5b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:37.501992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2408/4795] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:02:37.502786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb33fe-ac22-4a1b-9f17-bedf7feb9915 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:37.530200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb33fe-ac22-4a1b-9f17-bedf7feb9915 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:37.542251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c37140-7d5f-47d1-9303-a388563a88f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:37.542893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c37140-7d5f-47d1-9303-a388563a88f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:37.543171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c37140-7d5f-47d1-9303-a388563a88f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:37.546199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c37140-7d5f-47d1-9303-a388563a88f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:37.546934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c37140-7d5f-47d1-9303-a388563a88f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:02:37.547259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c37140-7d5f-47d1-9303-a388563a88f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:37.559954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c37140-7d5f-47d1-9303-a388563a88f9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:37.603492 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2388/4796] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:02:37.607849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7781ec-6a93-4366-9b8f-929ca72b5b8a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:37.632546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7781ec-6a93-4366-9b8f-929ca72b5b8a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:37.642811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1777b-86bc-4bdb-80e1-6ec76f9c511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:37.643594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1777b-86bc-4bdb-80e1-6ec76f9c511d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:37.643944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1777b-86bc-4bdb-80e1-6ec76f9c511d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:37.644803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1777b-86bc-4bdb-80e1-6ec76f9c511d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:37.645495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1777b-86bc-4bdb-80e1-6ec76f9c511d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:37.648257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1777b-86bc-4bdb-80e1-6ec76f9c511d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:37.687815 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2409/4797] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:37 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:37.692463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c37140-7d5f-47d1-9303-a388563a88f9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:37.716188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c37140-7d5f-47d1-9303-a388563a88f9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:37.921292 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:37.941085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f4596-69f5-4de9-b019-1dca711d215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:37.942248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4596-69f5-4de9-b019-1dca711d215a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:37.942684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4596-69f5-4de9-b019-1dca711d215a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:37.943134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4596-69f5-4de9-b019-1dca711d215a admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:37.943932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f4596-69f5-4de9-b019-1dca711d215a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:37.946121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f4596-69f5-4de9-b019-1dca711d215a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:37.994462 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2389/4798] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:37 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:37.994612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1777b-86bc-4bdb-80e1-6ec76f9c511d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:38.039643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1777b-86bc-4bdb-80e1-6ec76f9c511d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:38.047374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6452f-4e3a-4d14-ba7d-616331909d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:38.052712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6452f-4e3a-4d14-ba7d-616331909d39 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:38.053360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6452f-4e3a-4d14-ba7d-616331909d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:38.054464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6452f-4e3a-4d14-ba7d-616331909d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:38.055483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6452f-4e3a-4d14-ba7d-616331909d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:38.058587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6452f-4e3a-4d14-ba7d-616331909d39 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:38.075908 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2410/4799] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:02:38.080203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f4596-69f5-4de9-b019-1dca711d215a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:38.104285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f4596-69f5-4de9-b019-1dca711d215a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:38.112418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2acc82-7c11-4ea6-b49d-cc155106934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:38.113010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2acc82-7c11-4ea6-b49d-cc155106934b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:38.116769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2acc82-7c11-4ea6-b49d-cc155106934b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:38.117241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2acc82-7c11-4ea6-b49d-cc155106934b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:38.118071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2acc82-7c11-4ea6-b49d-cc155106934b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:38.122978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2acc82-7c11-4ea6-b49d-cc155106934b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:38.158569 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2390/4800] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:38.162566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6452f-4e3a-4d14-ba7d-616331909d39 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:38.181542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6452f-4e3a-4d14-ba7d-616331909d39 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:38.196196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed243a-c3b6-4d0e-98b2-f0c20fe87834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:38.196910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed243a-c3b6-4d0e-98b2-f0c20fe87834 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:38.197192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed243a-c3b6-4d0e-98b2-f0c20fe87834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:38.197467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed243a-c3b6-4d0e-98b2-f0c20fe87834 admin admin] PATH_INFO: `/v3/projects/ddf7b16884dd4f52ba957539131db26d/users/c5fc3941cb3b4576b577b8213124e280/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:38.238910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed243a-c3b6-4d0e-98b2-f0c20fe87834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf7b16884dd4f52ba957539131db26d, user_id=c5fc3941cb3b4576b577b8213124e280, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:38.252263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed243a-c3b6-4d0e-98b2-f0c20fe87834 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:38.286007 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2411/4801] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:38 2022] PUT /identity/v3/projects/ddf7b16884dd4f52ba957539131db26d/users/c5fc3941cb3b4576b577b8213124e280/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:38.297071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472621-7f78-485c-a0e2-e32e24ee4833 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:38.297725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472621-7f78-485c-a0e2-e32e24ee4833 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:38.298600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472621-7f78-485c-a0e2-e32e24ee4833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:38.392874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cd472621-7f78-485c-a0e2-e32e24ee4833 None None] MFA Rules not processed for user `c5fc3941cb3b4576b577b8213124e280`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:38.394606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd472621-7f78-485c-a0e2-e32e24ee4833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:38.585857 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2391/4802] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:38.592058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed243a-c3b6-4d0e-98b2-f0c20fe87834 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:38.634736 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:38.930536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed243a-c3b6-4d0e-98b2-f0c20fe87834 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:38.951675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51259600-b9a9-45c1-840b-4a3f81a034eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:38.956214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51259600-b9a9-45c1-840b-4a3f81a034eb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:38.956512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51259600-b9a9-45c1-840b-4a3f81a034eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:38.956934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51259600-b9a9-45c1-840b-4a3f81a034eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:38.959916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51259600-b9a9-45c1-840b-4a3f81a034eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:38.964415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51259600-b9a9-45c1-840b-4a3f81a034eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:39.123429 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2412/4803] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:38 2022] POST /identity/v3/projects => generated 381 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:39.125502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd472621-7f78-485c-a0e2-e32e24ee4833 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:39.177435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd472621-7f78-485c-a0e2-e32e24ee4833 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:39.423476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667f73-4938-49b0-8335-d3855d4611a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:39.437492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667f73-4938-49b0-8335-d3855d4611a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:39.437778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667f73-4938-49b0-8335-d3855d4611a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:39.438059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667f73-4938-49b0-8335-d3855d4611a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:39.439304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667f73-4938-49b0-8335-d3855d4611a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:39.445455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667f73-4938-49b0-8335-d3855d4611a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:39.484119 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2392/4804] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:39 2022] POST /identity/v3/users => generated 291 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:39.488597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51259600-b9a9-45c1-840b-4a3f81a034eb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:39.502726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51259600-b9a9-45c1-840b-4a3f81a034eb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:39.517017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb8382-82d6-4107-b026-541628500108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:39.520507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb8382-82d6-4107-b026-541628500108 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:39.521588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb8382-82d6-4107-b026-541628500108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:39.522091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb8382-82d6-4107-b026-541628500108 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:39.523545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb8382-82d6-4107-b026-541628500108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:39.530194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb8382-82d6-4107-b026-541628500108 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:39.558247 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2413/4805] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:39.559045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667f73-4938-49b0-8335-d3855d4611a8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:39.607532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667f73-4938-49b0-8335-d3855d4611a8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:39.652316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb1cdd-8421-4561-bf82-a403e3d30a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:39.652861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1cdd-8421-4561-bf82-a403e3d30a34 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:39.653146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1cdd-8421-4561-bf82-a403e3d30a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:39.661937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1cdd-8421-4561-bf82-a403e3d30a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:39.664894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb1cdd-8421-4561-bf82-a403e3d30a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:39.672267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb1cdd-8421-4561-bf82-a403e3d30a34 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:39.711749 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2393/4806] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:02:39.713950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb8382-82d6-4107-b026-541628500108 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:39.729595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb8382-82d6-4107-b026-541628500108 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:39.743014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995a345-d71a-4b2a-a391-1a38efb90926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:39.743872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a345-d71a-4b2a-a391-1a38efb90926 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:39.744463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a345-d71a-4b2a-a391-1a38efb90926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:39.744966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a345-d71a-4b2a-a391-1a38efb90926 admin admin] PATH_INFO: `/v3/projects/92e659af2aa34576ab9f0679ef8e4008/users/1c5cb8c072244179b34e5a215ccd53af/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:39.765765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995a345-d71a-4b2a-a391-1a38efb90926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e659af2aa34576ab9f0679ef8e4008, user_id=1c5cb8c072244179b34e5a215ccd53af, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:39.769956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995a345-d71a-4b2a-a391-1a38efb90926 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:39.806032 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2414/4807] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:39 2022] PUT /identity/v3/projects/92e659af2aa34576ab9f0679ef8e4008/users/1c5cb8c072244179b34e5a215ccd53af/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:39.817910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4ea6-b94d-4b3e-88fe-84d069aa8b60 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:39.818288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4ea6-b94d-4b3e-88fe-84d069aa8b60 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:39.818855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4ea6-b94d-4b3e-88fe-84d069aa8b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:39.870915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57cef3-cd99-4b29-b5ff-efca170a2c76 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:39.871227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57cef3-cd99-4b29-b5ff-efca170a2c76 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:39.871508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57cef3-cd99-4b29-b5ff-efca170a2c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:39.886983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a18a4ea6-b94d-4b3e-88fe-84d069aa8b60 None None] MFA Rules not processed for user `1c5cb8c072244179b34e5a215ccd53af`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:39.888574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a18a4ea6-b94d-4b3e-88fe-84d069aa8b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:39.909252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6c57cef3-cd99-4b29-b5ff-efca170a2c76 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:39.913176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6c57cef3-cd99-4b29-b5ff-efca170a2c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:39.989796 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:40.148232 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2415/4808] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:40.165376 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2394/4809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:40.185852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57cef3-cd99-4b29-b5ff-efca170a2c76 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:40.191922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6c57cef3-cd99-4b29-b5ff-efca170a2c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:40.195466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a4ea6-b94d-4b3e-88fe-84d069aa8b60 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:40.197595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a18a4ea6-b94d-4b3e-88fe-84d069aa8b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:40.436077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a4ea6-b94d-4b3e-88fe-84d069aa8b60 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:40.450609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde4a9-8e3a-4445-b8c7-520bb4f52079 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:40.453717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde4a9-8e3a-4445-b8c7-520bb4f52079 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:40.457802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde4a9-8e3a-4445-b8c7-520bb4f52079 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:40.459550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde4a9-8e3a-4445-b8c7-520bb4f52079 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:40.521826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcde4a9-8e3a-4445-b8c7-520bb4f52079 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:40.528575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcde4a9-8e3a-4445-b8c7-520bb4f52079 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:40.530219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57cef3-cd99-4b29-b5ff-efca170a2c76 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:40.563978 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2395/4810] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:02:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:02:40.564965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e697d6d-fa92-4cbe-8fe6-752c69ff3c4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:40.565607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697d6d-fa92-4cbe-8fe6-752c69ff3c4a service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:40.567221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697d6d-fa92-4cbe-8fe6-752c69ff3c4a service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:40.567484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697d6d-fa92-4cbe-8fe6-752c69ff3c4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:40.675339 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:40.809264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e697d6d-fa92-4cbe-8fe6-752c69ff3c4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:40.815698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e697d6d-fa92-4cbe-8fe6-752c69ff3c4a service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:40.856479 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2416/4811] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:41.252814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde4a9-8e3a-4445-b8c7-520bb4f52079 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:41.269010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde4a9-8e3a-4445-b8c7-520bb4f52079 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:41.278822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4990a-ca17-49a4-9676-ed917d7d05e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:41.279671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4990a-ca17-49a4-9676-ed917d7d05e4 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:41.280099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4990a-ca17-49a4-9676-ed917d7d05e4 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:41.280599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4990a-ca17-49a4-9676-ed917d7d05e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:41.301683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4990a-ca17-49a4-9676-ed917d7d05e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:41.303511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4990a-ca17-49a4-9676-ed917d7d05e4 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:41.341838 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2396/4812] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:41.593646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce185da2-97bf-4a13-86fa-783fe147768d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:41.594129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce185da2-97bf-4a13-86fa-783fe147768d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:41.594362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce185da2-97bf-4a13-86fa-783fe147768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:41.623508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ce185da2-97bf-4a13-86fa-783fe147768d None None] MFA Rules not processed for user `2190bd30671b47048aed416f9c14a545`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:41.624924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ce185da2-97bf-4a13-86fa-783fe147768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:41.852303 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2417/4813] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:42.562864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4990a-ca17-49a4-9676-ed917d7d05e4 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:42.762184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4990a-ca17-49a4-9676-ed917d7d05e4 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:42.799951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:42.800955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:42.801350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:42.801812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] PATH_INFO: `/v3/users/c5fc3941cb3b4576b577b8213124e280` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:42.806305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5fc3941cb3b4576b577b8213124e280)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:42.810349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:42.952435 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:42.962483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5fc3941cb3b4576b577b8213124e280'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:42.996204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5fc3941cb3b4576b577b8213124e280'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:43.029438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5fc3941cb3b4576b577b8213124e280'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:43.052647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5fc3941cb3b4576b577b8213124e280'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:43.054209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5fc3941cb3b4576b577b8213124e280'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:43.070526 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2397/4814] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:42 2022] DELETE /identity/v3/users/c5fc3941cb3b4576b577b8213124e280 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:43.071105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5926-762e-49f8-80e7-b49564b30459 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:43.071544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5926-762e-49f8-80e7-b49564b30459 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:43.071645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5926-762e-49f8-80e7-b49564b30459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:43.138015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-222a5926-762e-49f8-80e7-b49564b30459 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:43.139680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-222a5926-762e-49f8-80e7-b49564b30459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:43.273160 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2418/4815] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:02:43.295899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:43.297660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:43.412539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5365ea-52fa-474c-93d3-15ec3f3aa981 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:43.420842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc2247-6b25-4bff-b028-7b0c3faebec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:43.421861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc2247-6b25-4bff-b028-7b0c3faebec2 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:43.422621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc2247-6b25-4bff-b028-7b0c3faebec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:43.423453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc2247-6b25-4bff-b028-7b0c3faebec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:43.445784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc2247-6b25-4bff-b028-7b0c3faebec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:43.449907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc2247-6b25-4bff-b028-7b0c3faebec2 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:43.488315 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2398/4816] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:45.003244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a5926-762e-49f8-80e7-b49564b30459 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:45.005456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-222a5926-762e-49f8-80e7-b49564b30459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:45.040081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a5926-762e-49f8-80e7-b49564b30459 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:45.067839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:45.068797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:45.069239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:45.069670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] PATH_INFO: `/v3/projects/ddf7b16884dd4f52ba957539131db26d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:45.072318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf7b16884dd4f52ba957539131db26d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:45.078117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:45.261356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf7b16884dd4f52ba957539131db26d', 'request_id': 'req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.278944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf7b16884dd4f52ba957539131db26d', 'request_id': 'req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.282814 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:45.293651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf7b16884dd4f52ba957539131db26d', 'request_id': 'req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.320899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] The token cache is being invalidate because project ddf7b16884dd4f52ba957539131db26d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:45.321472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.324713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.332610 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2419/4817] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:45 2022] DELETE /identity/v3/projects/ddf7b16884dd4f52ba957539131db26d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:45.333361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc2247-6b25-4bff-b028-7b0c3faebec2 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:45.347253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc2247-6b25-4bff-b028-7b0c3faebec2 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:45.611655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:45.612290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:45.621975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:45.621975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] PATH_INFO: `/v3/users/1c5cb8c072244179b34e5a215ccd53af` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:45.621975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5cb8c072244179b34e5a215ccd53af)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:45.621975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:45.825367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5cb8c072244179b34e5a215ccd53af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.879984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5cb8c072244179b34e5a215ccd53af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.882809 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:45.893087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:45.895458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:45.897300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5cb8c072244179b34e5a215ccd53af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.924808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5cb8c072244179b34e5a215ccd53af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.925575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5cb8c072244179b34e5a215ccd53af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:45.951862 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2399/4818] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:45 2022] DELETE /identity/v3/users/1c5cb8c072244179b34e5a215ccd53af => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:46.144651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed541c-bcae-4e50-9d2a-4e1a818f1a7b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:46.352601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:46.353273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:46.353557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:46.353838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:46.357880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:46.567044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:46.580227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:46.597390 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2420/4819] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:02:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:02:46.944242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:46.945956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:47.128242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fdb30-350a-4300-bf03-bcea6d0d0bcd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:47.135835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:47.136641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:47.136884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:47.137357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] PATH_INFO: `/v3/users/9ddb45b2dcf14263887a3718e23eb937` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:47.145730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddb45b2dcf14263887a3718e23eb937)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:47.148032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:47.159162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:47.160767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:47.197854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c85e-7f6c-42aa-a80f-6b98ddf86d00 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:47.227147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:47.231552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:47.233518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:47.237113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] PATH_INFO: `/v3/projects/92e659af2aa34576ab9f0679ef8e4008` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:47.245020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e659af2aa34576ab9f0679ef8e4008)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:47.254358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:47.275163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddb45b2dcf14263887a3718e23eb937'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.312800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddb45b2dcf14263887a3718e23eb937'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.329746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddb45b2dcf14263887a3718e23eb937'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.361567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddb45b2dcf14263887a3718e23eb937'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.367902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-336df6be-57a4-4cab-9944-833a6dc7aa4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddb45b2dcf14263887a3718e23eb937'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.379406 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2400/4820] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:46 2022] DELETE /identity/v3/users/9ddb45b2dcf14263887a3718e23eb937 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:47.383865 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:47.418421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e659af2aa34576ab9f0679ef8e4008', 'request_id': 'req-2d673c75-427d-42cd-ab21-b5ffed06ee02'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.442426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e659af2aa34576ab9f0679ef8e4008', 'request_id': 'req-2d673c75-427d-42cd-ab21-b5ffed06ee02'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.461536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e659af2aa34576ab9f0679ef8e4008', 'request_id': 'req-2d673c75-427d-42cd-ab21-b5ffed06ee02'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.496968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] The token cache is being invalidate because project 92e659af2aa34576ab9f0679ef8e4008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:47.497329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.501754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:47.503994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2421/4821] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:47 2022] DELETE /identity/v3/projects/92e659af2aa34576ab9f0679ef8e4008 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:02:47.510257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb79d9-b868-4a41-8142-6fd2b35fd583 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:47.510778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb79d9-b868-4a41-8142-6fd2b35fd583 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:47.511205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb79d9-b868-4a41-8142-6fd2b35fd583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:47.574012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a6bb79d9-b868-4a41-8142-6fd2b35fd583 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:47.591039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a6bb79d9-b868-4a41-8142-6fd2b35fd583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:47.785448 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2401/4822] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:47.820956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:47.823038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:47.883468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673c75-427d-42cd-ab21-b5ffed06ee02 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:47.907864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893f2a5-375c-4f88-9c18-b7b167fcefbf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:47.908210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893f2a5-375c-4f88-9c18-b7b167fcefbf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:47.908491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893f2a5-375c-4f88-9c18-b7b167fcefbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:47.917119 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:47.917587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:47.918497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:47.918614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:47.919181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] PATH_INFO: `/v3/projects/18b6ea2fe5ee4fc8a9b1f143ac95fcef` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:47.923989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b6ea2fe5ee4fc8a9b1f143ac95fcef)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:47.926028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:47.946962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d893f2a5-375c-4f88-9c18-b7b167fcefbf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:47.948210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d893f2a5-375c-4f88-9c18-b7b167fcefbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:47.976026 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2402/4823] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:02:47.977140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893f2a5-375c-4f88-9c18-b7b167fcefbf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:47.990311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893f2a5-375c-4f88-9c18-b7b167fcefbf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:47.997086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a4e45-e2c4-43f5-aad1-a8b95f576696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:47.998022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a4e45-e2c4-43f5-aad1-a8b95f576696 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:47.998457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a4e45-e2c4-43f5-aad1-a8b95f576696 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:47.999225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a4e45-e2c4-43f5-aad1-a8b95f576696 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.000058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a4e45-e2c4-43f5-aad1-a8b95f576696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:02:48.000686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a4e45-e2c4-43f5-aad1-a8b95f576696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:48.002518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a4e45-e2c4-43f5-aad1-a8b95f576696 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:48.020794 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2403/4824] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:02:48.022568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a4e45-e2c4-43f5-aad1-a8b95f576696 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:48.038176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a4e45-e2c4-43f5-aad1-a8b95f576696 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:48.066190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f988a0-718a-4ceb-a621-bea097c72dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:48.067643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f988a0-718a-4ceb-a621-bea097c72dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:48.068131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f988a0-718a-4ceb-a621-bea097c72dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:48.068841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f988a0-718a-4ceb-a621-bea097c72dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.069995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f988a0-718a-4ceb-a621-bea097c72dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:48.074349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f988a0-718a-4ceb-a621-bea097c72dd2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:48.107613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'request_id': 'req-4a0fa6c9-215c-468c-b845-aaf615219c58'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:48.130484 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2404/4825] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:48 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:48.131718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f988a0-718a-4ceb-a621-bea097c72dd2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:48.134302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'request_id': 'req-4a0fa6c9-215c-468c-b845-aaf615219c58'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:48.154442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'request_id': 'req-4a0fa6c9-215c-468c-b845-aaf615219c58'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:48.207077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] The token cache is being invalidate because project 18b6ea2fe5ee4fc8a9b1f143ac95fcef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:48.208065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:48.209192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a0fa6c9-215c-468c-b845-aaf615219c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:48.211419 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2422/4826] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:47 2022] DELETE /identity/v3/projects/18b6ea2fe5ee4fc8a9b1f143ac95fcef => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:48.217919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf65dcf-000d-4983-8bfc-d152b71d3a7b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:48.218607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf65dcf-000d-4983-8bfc-d152b71d3a7b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:48.219930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf65dcf-000d-4983-8bfc-d152b71d3a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.292015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-caf65dcf-000d-4983-8bfc-d152b71d3a7b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:48.294218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-caf65dcf-000d-4983-8bfc-d152b71d3a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:48.430516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f988a0-718a-4ceb-a621-bea097c72dd2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:48.447228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d23b3-f5fb-4fd5-b0b6-eba45640247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:48.448148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d23b3-f5fb-4fd5-b0b6-eba45640247e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:48.448858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d23b3-f5fb-4fd5-b0b6-eba45640247e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:48.449284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d23b3-f5fb-4fd5-b0b6-eba45640247e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.450569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d23b3-f5fb-4fd5-b0b6-eba45640247e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:48.452682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d23b3-f5fb-4fd5-b0b6-eba45640247e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:48.503978 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2405/4827] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:48 2022] POST /identity/v3/users => generated 282 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:48.505256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d23b3-f5fb-4fd5-b0b6-eba45640247e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:48.513610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8e9d23b3-f5fb-4fd5-b0b6-eba45640247e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:48.543914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d23b3-f5fb-4fd5-b0b6-eba45640247e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:48.559553 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2423/4828] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:48.567616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b397c02-0555-4100-9ba4-ee0e62b10967 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:48.568243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b397c02-0555-4100-9ba4-ee0e62b10967 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:48.568708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b397c02-0555-4100-9ba4-ee0e62b10967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.570158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bddece-eaa9-4751-83dd-643a8e23117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:48.570795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bddece-eaa9-4751-83dd-643a8e23117c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:48.571079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bddece-eaa9-4751-83dd-643a8e23117c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:48.571357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bddece-eaa9-4751-83dd-643a8e23117c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.572006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bddece-eaa9-4751-83dd-643a8e23117c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:48.573940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bddece-eaa9-4751-83dd-643a8e23117c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:48.620263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8b397c02-0555-4100-9ba4-ee0e62b10967 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:48.621788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8b397c02-0555-4100-9ba4-ee0e62b10967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:48.621943 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2406/4829] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:48.622882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bddece-eaa9-4751-83dd-643a8e23117c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:48.642520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bddece-eaa9-4751-83dd-643a8e23117c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:48.650508 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2424/4830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:02:48.654833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b397c02-0555-4100-9ba4-ee0e62b10967 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:48.659957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20baf5-b767-4341-ad26-f5d6dc718357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:48.660589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20baf5-b767-4341-ad26-f5d6dc718357 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:48.660898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20baf5-b767-4341-ad26-f5d6dc718357 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:48.661175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20baf5-b767-4341-ad26-f5d6dc718357 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.661817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20baf5-b767-4341-ad26-f5d6dc718357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:48.663452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20baf5-b767-4341-ad26-f5d6dc718357 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:48.692321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b397c02-0555-4100-9ba4-ee0e62b10967 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:48.714185 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2407/4831] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:48.714932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20baf5-b767-4341-ad26-f5d6dc718357 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:48.736224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20baf5-b767-4341-ad26-f5d6dc718357 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:48.738536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dfb26-0996-47bb-95e6-0c29ae3b65d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:48.743920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dfb26-0996-47bb-95e6-0c29ae3b65d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:48.743920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dfb26-0996-47bb-95e6-0c29ae3b65d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:48.743920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dfb26-0996-47bb-95e6-0c29ae3b65d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.749017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dfb26-0996-47bb-95e6-0c29ae3b65d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:02:48.749322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8e06a-5246-48c4-bc27-f2df0b119e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:48.750012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e06a-5246-48c4-bc27-f2df0b119e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:48.750299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e06a-5246-48c4-bc27-f2df0b119e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:48.751148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e06a-5246-48c4-bc27-f2df0b119e4f admin admin] PATH_INFO: `/v3/projects/3b749f1b6ffe43a0b066c26c7f1a391f/users/d889b781d8a24f149dae9542e4063607/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.755430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dfb26-0996-47bb-95e6-0c29ae3b65d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:48.764130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dfb26-0996-47bb-95e6-0c29ae3b65d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:48.793611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8e06a-5246-48c4-bc27-f2df0b119e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b749f1b6ffe43a0b066c26c7f1a391f, user_id=d889b781d8a24f149dae9542e4063607, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:48.796967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8e06a-5246-48c4-bc27-f2df0b119e4f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:48.824604 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2408/4832] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:48 2022] PUT /identity/v3/projects/3b749f1b6ffe43a0b066c26c7f1a391f/users/d889b781d8a24f149dae9542e4063607/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:48.836592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e10485-7605-4e0f-800d-89d3f034ce93 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:48.836911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e10485-7605-4e0f-800d-89d3f034ce93 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:48.837195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e10485-7605-4e0f-800d-89d3f034ce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:48.840163 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2425/4833] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:02:48.844051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dfb26-0996-47bb-95e6-0c29ae3b65d8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:48.872271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-28e10485-7605-4e0f-800d-89d3f034ce93 None None] MFA Rules not processed for user `d889b781d8a24f149dae9542e4063607`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:48.873534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-28e10485-7605-4e0f-800d-89d3f034ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:48.901467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dfb26-0996-47bb-95e6-0c29ae3b65d8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:48.946725 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:48.964304 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2409/4834] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:48.972980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e10485-7605-4e0f-800d-89d3f034ce93 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:48.975060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-28e10485-7605-4e0f-800d-89d3f034ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:48.978539 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:49.066035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dda39-3c22-4a50-9872-8308612ede2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:49.066773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dda39-3c22-4a50-9872-8308612ede2e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:49.068183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dda39-3c22-4a50-9872-8308612ede2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:49.069099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dda39-3c22-4a50-9872-8308612ede2e admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:49.070667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dda39-3c22-4a50-9872-8308612ede2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:49.074275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dda39-3c22-4a50-9872-8308612ede2e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:49.106763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e10485-7605-4e0f-800d-89d3f034ce93 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:49.111470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2f6e7-0665-4235-8393-83718a6ea2f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:49.126813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2f6e7-0665-4235-8393-83718a6ea2f8 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:49.127423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2f6e7-0665-4235-8393-83718a6ea2f8 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:49.127984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2f6e7-0665-4235-8393-83718a6ea2f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:49.148399 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2426/4835] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:48 2022] POST /identity/v3/projects => generated 385 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:49.153126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2f6e7-0665-4235-8393-83718a6ea2f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:49.153338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dda39-3c22-4a50-9872-8308612ede2e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:49.155096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2f6e7-0665-4235-8393-83718a6ea2f8 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:49.191924 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2410/4836] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:49.272073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dda39-3c22-4a50-9872-8308612ede2e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:49.278451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632b8ad-39f9-4e62-86db-831f55c9bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:49.279329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632b8ad-39f9-4e62-86db-831f55c9bf5d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:49.279864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632b8ad-39f9-4e62-86db-831f55c9bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:49.280252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632b8ad-39f9-4e62-86db-831f55c9bf5d admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:49.281039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632b8ad-39f9-4e62-86db-831f55c9bf5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:49.284072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632b8ad-39f9-4e62-86db-831f55c9bf5d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:49.328450 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2427/4837] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:49 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:49.331441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2f6e7-0665-4235-8393-83718a6ea2f8 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:49.346288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2f6e7-0665-4235-8393-83718a6ea2f8 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:49.366881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b99d6-00c0-45c7-8534-1f0367fd791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:49.367548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b99d6-00c0-45c7-8534-1f0367fd791e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:49.368012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b99d6-00c0-45c7-8534-1f0367fd791e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:49.368179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b99d6-00c0-45c7-8534-1f0367fd791e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:49.368942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b99d6-00c0-45c7-8534-1f0367fd791e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:49.370664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b99d6-00c0-45c7-8534-1f0367fd791e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:49.396287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632b8ad-39f9-4e62-86db-831f55c9bf5d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:49.402149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2411/4838] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:49.415434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632b8ad-39f9-4e62-86db-831f55c9bf5d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:49.424900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a88b8c-0dfc-4027-a3b5-6c75e1b19dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:49.425537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a88b8c-0dfc-4027-a3b5-6c75e1b19dac admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:49.425822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a88b8c-0dfc-4027-a3b5-6c75e1b19dac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:49.426097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a88b8c-0dfc-4027-a3b5-6c75e1b19dac admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:49.426747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a88b8c-0dfc-4027-a3b5-6c75e1b19dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:49.431309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a88b8c-0dfc-4027-a3b5-6c75e1b19dac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:49.464359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b99d6-00c0-45c7-8534-1f0367fd791e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:49.476762 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2428/4839] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:02:49.477745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b99d6-00c0-45c7-8534-1f0367fd791e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:49.485034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc421-6ed9-423c-97c4-078ddfe61c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:49.485980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc421-6ed9-423c-97c4-078ddfe61c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:49.486315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc421-6ed9-423c-97c4-078ddfe61c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:49.486647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc421-6ed9-423c-97c4-078ddfe61c3b admin admin] PATH_INFO: `/v3/projects/a42977a7c9aa4831a041b3f1472b52d0/users/f6f439f0db774d4c9691083e208cbaaa/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:49.505441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc421-6ed9-423c-97c4-078ddfe61c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42977a7c9aa4831a041b3f1472b52d0, user_id=f6f439f0db774d4c9691083e208cbaaa, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:49.508186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc421-6ed9-423c-97c4-078ddfe61c3b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:49.537384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493c09-8dd8-4b6f-ad15-e68a1d268517 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:49.537676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493c09-8dd8-4b6f-ad15-e68a1d268517 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:49.537952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493c09-8dd8-4b6f-ad15-e68a1d268517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:49.541190 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2412/4840] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:49 2022] PUT /identity/v3/projects/a42977a7c9aa4831a041b3f1472b52d0/users/f6f439f0db774d4c9691083e208cbaaa/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:49.571435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-45493c09-8dd8-4b6f-ad15-e68a1d268517 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:49.575190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-45493c09-8dd8-4b6f-ad15-e68a1d268517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:49.787331 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2429/4841] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:49.888811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc421-6ed9-423c-97c4-078ddfe61c3b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:49.890907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-027dc421-6ed9-423c-97c4-078ddfe61c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:50.060595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc421-6ed9-423c-97c4-078ddfe61c3b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:50.064580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4493e3-dd25-48fe-baf7-753d87108b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:50.065704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4493e3-dd25-48fe-baf7-753d87108b8c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:50.065987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4493e3-dd25-48fe-baf7-753d87108b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:50.066258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4493e3-dd25-48fe-baf7-753d87108b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:50.077028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4493e3-dd25-48fe-baf7-753d87108b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:50.078707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4493e3-dd25-48fe-baf7-753d87108b8c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:50.111286 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2413/4842] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:50.416772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45493c09-8dd8-4b6f-ad15-e68a1d268517 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:50.434488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45493c09-8dd8-4b6f-ad15-e68a1d268517 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:50.456981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:50.457652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:50.457948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:50.458201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] PATH_INFO: `/v3/users/d889b781d8a24f149dae9542e4063607` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:50.465605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d889b781d8a24f149dae9542e4063607)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:50.474827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:50.523703 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:50.616840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd889b781d8a24f149dae9542e4063607'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:50.673045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd889b781d8a24f149dae9542e4063607'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:50.774478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd889b781d8a24f149dae9542e4063607'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:50.784546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd889b781d8a24f149dae9542e4063607'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:50.785477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd889b781d8a24f149dae9542e4063607'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:50.809621 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2430/4843] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:02:50 2022] DELETE /identity/v3/users/d889b781d8a24f149dae9542e4063607 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:50.812686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c549bdd-eb01-4ab0-8e3d-098e603f5ecc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:50.813739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c549bdd-eb01-4ab0-8e3d-098e603f5ecc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:50.814050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c549bdd-eb01-4ab0-8e3d-098e603f5ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:50.894939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4c549bdd-eb01-4ab0-8e3d-098e603f5ecc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:50.898150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4c549bdd-eb01-4ab0-8e3d-098e603f5ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:51.034006 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2414/4844] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:51.088535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:51.090268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:51.315112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3a2e-09fe-4407-b16e-71d9a38fffd7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:51.327673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bb5a7-ab96-4614-b939-96720fc4ebbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:51.332885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bb5a7-ab96-4614-b939-96720fc4ebbc service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:51.333269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bb5a7-ab96-4614-b939-96720fc4ebbc service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:51.333465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bb5a7-ab96-4614-b939-96720fc4ebbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:51.370393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bb5a7-ab96-4614-b939-96720fc4ebbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:51.377672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bb5a7-ab96-4614-b939-96720fc4ebbc service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:51.406941 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2431/4845] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:51.500160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c2429-d5ff-42da-b15f-b90b60610b69 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:51.501269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c2429-d5ff-42da-b15f-b90b60610b69 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:51.501424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c2429-d5ff-42da-b15f-b90b60610b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:51.541246 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:51.601650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fe4c2429-d5ff-42da-b15f-b90b60610b69 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:51.602908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fe4c2429-d5ff-42da-b15f-b90b60610b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:51.806470 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2415/4846] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:51.840747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bb5a7-ab96-4614-b939-96720fc4ebbc service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:51.842173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-670bb5a7-ab96-4614-b939-96720fc4ebbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:52.079727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bb5a7-ab96-4614-b939-96720fc4ebbc service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:52.099143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a5bd-d5f8-4741-a83b-63b12fa98126 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:52.100894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a5bd-d5f8-4741-a83b-63b12fa98126 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:52.101412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a5bd-d5f8-4741-a83b-63b12fa98126 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:52.101901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a5bd-d5f8-4741-a83b-63b12fa98126 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:52.128345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01a5bd-d5f8-4741-a83b-63b12fa98126 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:52.131509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01a5bd-d5f8-4741-a83b-63b12fa98126 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:52.158413 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2432/4847] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:02:53.419504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c2429-d5ff-42da-b15f-b90b60610b69 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:53.421615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fe4c2429-d5ff-42da-b15f-b90b60610b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:53.479975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c2429-d5ff-42da-b15f-b90b60610b69 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:53.493786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:53.494767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:53.495260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:53.495745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] PATH_INFO: `/v3/projects/3b749f1b6ffe43a0b066c26c7f1a391f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:53.502891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b749f1b6ffe43a0b066c26c7f1a391f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:53.505298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:53.675382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b749f1b6ffe43a0b066c26c7f1a391f', 'request_id': 'req-1fb8d0a3-9638-4036-b81d-f284639a5098'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:53.705168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b749f1b6ffe43a0b066c26c7f1a391f', 'request_id': 'req-1fb8d0a3-9638-4036-b81d-f284639a5098'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:53.730941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b749f1b6ffe43a0b066c26c7f1a391f', 'request_id': 'req-1fb8d0a3-9638-4036-b81d-f284639a5098'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:53.767997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] The token cache is being invalidate because project 3b749f1b6ffe43a0b066c26c7f1a391f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:02:53.768734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:53.776413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1fb8d0a3-9638-4036-b81d-f284639a5098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:02:53.787633 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2416/4848] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:53 2022] DELETE /identity/v3/projects/3b749f1b6ffe43a0b066c26c7f1a391f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:53.792459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ae8db-7d15-4518-ad83-fdb902529278 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:53.793869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ae8db-7d15-4518-ad83-fdb902529278 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:53.794362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ae8db-7d15-4518-ad83-fdb902529278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:53.951584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37bdef-0a82-42f3-beab-c89c4ea40ea4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:53.952309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37bdef-0a82-42f3-beab-c89c4ea40ea4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:53.952309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37bdef-0a82-42f3-beab-c89c4ea40ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:54.007100 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:54.041629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-370ae8db-7d15-4518-ad83-fdb902529278 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:54.044761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-370ae8db-7d15-4518-ad83-fdb902529278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:54.082598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ae37bdef-0a82-42f3-beab-c89c4ea40ea4 None None] MFA Rules not processed for user `f6f439f0db774d4c9691083e208cbaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:54.085581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ae37bdef-0a82-42f3-beab-c89c4ea40ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:54.337687 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2433/4849] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:54.348775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143a078-a701-42fa-b1aa-70be2916a9a9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:54.353811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143a078-a701-42fa-b1aa-70be2916a9a9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:54.354099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143a078-a701-42fa-b1aa-70be2916a9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:54.354278 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2417/4850] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:54.446241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8143a078-a701-42fa-b1aa-70be2916a9a9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:54.450951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8143a078-a701-42fa-b1aa-70be2916a9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:54.465665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925e85e-8273-4bd2-8a8c-1d9a758f5dbb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:54.465665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925e85e-8273-4bd2-8a8c-1d9a758f5dbb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:54.465665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925e85e-8273-4bd2-8a8c-1d9a758f5dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:54.512546 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2434/4851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:54.520033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143a078-a701-42fa-b1aa-70be2916a9a9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:54.561937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7925e85e-8273-4bd2-8a8c-1d9a758f5dbb None None] MFA Rules not processed for user `f6f439f0db774d4c9691083e208cbaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:54.565619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143a078-a701-42fa-b1aa-70be2916a9a9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:54.567506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7925e85e-8273-4bd2-8a8c-1d9a758f5dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:54.589716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd16738-1431-4eed-bcd7-e3ad5fa00cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:54.592951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd16738-1431-4eed-bcd7-e3ad5fa00cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:54.593627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd16738-1431-4eed-bcd7-e3ad5fa00cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:54.596016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd16738-1431-4eed-bcd7-e3ad5fa00cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:54.605000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd16738-1431-4eed-bcd7-e3ad5fa00cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:02:54.605000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd16738-1431-4eed-bcd7-e3ad5fa00cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:54.605000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd16738-1431-4eed-bcd7-e3ad5fa00cb8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:54.605373 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2418/4852] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:02:54.607089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a31d-2c95-4b33-b0bc-5d154a28e832 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:54.607488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a31d-2c95-4b33-b0bc-5d154a28e832 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:54.607862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a31d-2c95-4b33-b0bc-5d154a28e832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:54.651503 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2435/4853] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:02:54.652483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd16738-1431-4eed-bcd7-e3ad5fa00cb8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:54.673090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-71f5a31d-2c95-4b33-b0bc-5d154a28e832 None None] MFA Rules not processed for user `f6f439f0db774d4c9691083e208cbaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:54.675652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-71f5a31d-2c95-4b33-b0bc-5d154a28e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:54.683506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd16738-1431-4eed-bcd7-e3ad5fa00cb8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:54.697554 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2419/4854] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:54.702905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1e55-52ea-42e6-9194-ddde89b77f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:54.703575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1e55-52ea-42e6-9194-ddde89b77f9d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:54.703860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1e55-52ea-42e6-9194-ddde89b77f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:54.704293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf1e55-52ea-42e6-9194-ddde89b77f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:54.705190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf1e55-52ea-42e6-9194-ddde89b77f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:54.706763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5a31d-2c95-4b33-b0bc-5d154a28e832 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:54.707630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf1e55-52ea-42e6-9194-ddde89b77f9d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:54.708442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-71f5a31d-2c95-4b33-b0bc-5d154a28e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:54.742355 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:54.795668 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2436/4855] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:54 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:54.799125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1e55-52ea-42e6-9194-ddde89b77f9d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:55.033726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf1e55-52ea-42e6-9194-ddde89b77f9d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:55.057891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2791c28-e01e-400f-8ceb-969bbdd6b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:55.058558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791c28-e01e-400f-8ceb-969bbdd6b8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:55.058849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791c28-e01e-400f-8ceb-969bbdd6b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:55.059129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791c28-e01e-400f-8ceb-969bbdd6b8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:55.073023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5a31d-2c95-4b33-b0bc-5d154a28e832 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:55.075451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2791c28-e01e-400f-8ceb-969bbdd6b8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:55.089222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2791c28-e01e-400f-8ceb-969bbdd6b8a9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:55.152789 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2437/4856] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:54 2022] POST /identity/v3/users => generated 303 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:55.158155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2791c28-e01e-400f-8ceb-969bbdd6b8a9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:55.193180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2791c28-e01e-400f-8ceb-969bbdd6b8a9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:55.209192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a2604-d078-4cf0-8598-491e86d90d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:55.209856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a2604-d078-4cf0-8598-491e86d90d0d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:55.210136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a2604-d078-4cf0-8598-491e86d90d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:55.210416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a2604-d078-4cf0-8598-491e86d90d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:55.211092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a2604-d078-4cf0-8598-491e86d90d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:55.216920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a2604-d078-4cf0-8598-491e86d90d0d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:55.250432 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2438/4857] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:55.251390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a2604-d078-4cf0-8598-491e86d90d0d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:55.263111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb9d52-ad0c-417e-ac76-5b27e7711a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:55.264149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb9d52-ad0c-417e-ac76-5b27e7711a11 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:55.264149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb9d52-ad0c-417e-ac76-5b27e7711a11 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:55.264327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb9d52-ad0c-417e-ac76-5b27e7711a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:55.273201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a2604-d078-4cf0-8598-491e86d90d0d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:55.286102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8472c86-c0f9-4b2e-8580-593b97ee39e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:55.286743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8472c86-c0f9-4b2e-8580-593b97ee39e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:55.287026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8472c86-c0f9-4b2e-8580-593b97ee39e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:55.290219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8472c86-c0f9-4b2e-8580-593b97ee39e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:55.291069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8472c86-c0f9-4b2e-8580-593b97ee39e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:55.293101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8472c86-c0f9-4b2e-8580-593b97ee39e8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:55.328234 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2439/4858] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:55.333344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8472c86-c0f9-4b2e-8580-593b97ee39e8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:55.358672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8472c86-c0f9-4b2e-8580-593b97ee39e8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:55.377231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1200d-52b9-469f-94ca-bc27729fddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:55.379942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1200d-52b9-469f-94ca-bc27729fddb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:55.380783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1200d-52b9-469f-94ca-bc27729fddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:55.383585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1200d-52b9-469f-94ca-bc27729fddb6 admin admin] PATH_INFO: `/v3/projects/4a723c2cfb394aa09b04f2e70b27fd6a/users/a487f0c1ea3c4e1584ec73f57d528630/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:55.432126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1200d-52b9-469f-94ca-bc27729fddb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a723c2cfb394aa09b04f2e70b27fd6a, user_id=a487f0c1ea3c4e1584ec73f57d528630, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:55.456076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1200d-52b9-469f-94ca-bc27729fddb6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:55.483159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb9d52-ad0c-417e-ac76-5b27e7711a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:55.488970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb9d52-ad0c-417e-ac76-5b27e7711a11 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:55.514450 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2440/4859] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:55 2022] PUT /identity/v3/projects/4a723c2cfb394aa09b04f2e70b27fd6a/users/a487f0c1ea3c4e1584ec73f57d528630/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:55.533788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681cbe1-ca30-4199-9a74-a65e4864d4d6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:55.534058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681cbe1-ca30-4199-9a74-a65e4864d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:55.534448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681cbe1-ca30-4199-9a74-a65e4864d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:55.552156 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2420/4860] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:02:55.575599 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:55.656981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9681cbe1-ca30-4199-9a74-a65e4864d4d6 None None] MFA Rules not processed for user `a487f0c1ea3c4e1584ec73f57d528630`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:55.658143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9681cbe1-ca30-4199-9a74-a65e4864d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:55.898071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb9d52-ad0c-417e-ac76-5b27e7711a11 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:55.899317 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2441/4861] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:02:55.920514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb9d52-ad0c-417e-ac76-5b27e7711a11 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:55.979983 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:56.066541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915f581-34e7-48cf-85bd-b45de9d354e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:56.067185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915f581-34e7-48cf-85bd-b45de9d354e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:56.067470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915f581-34e7-48cf-85bd-b45de9d354e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:56.067741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915f581-34e7-48cf-85bd-b45de9d354e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:56.069214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915f581-34e7-48cf-85bd-b45de9d354e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:56.084588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915f581-34e7-48cf-85bd-b45de9d354e3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:56.157403 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2421/4862] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:02:55 2022] POST /identity/v3/projects => generated 407 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:02:56.158496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681cbe1-ca30-4199-9a74-a65e4864d4d6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:56.178027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681cbe1-ca30-4199-9a74-a65e4864d4d6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:56.374574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3940b2a-6c0d-4fe6-a0fc-c0043d655990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:56.376004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3940b2a-6c0d-4fe6-a0fc-c0043d655990 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:56.376344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3940b2a-6c0d-4fe6-a0fc-c0043d655990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:56.376642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3940b2a-6c0d-4fe6-a0fc-c0043d655990 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:56.377290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3940b2a-6c0d-4fe6-a0fc-c0043d655990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:56.379257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3940b2a-6c0d-4fe6-a0fc-c0043d655990 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:56.456530 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2442/4863] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:02:56 2022] POST /identity/v3/users => generated 310 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:02:56.460459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915f581-34e7-48cf-85bd-b45de9d354e3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:56.483347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915f581-34e7-48cf-85bd-b45de9d354e3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:56.500642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5e37-ce40-4483-843c-41813f584c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:56.501424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5e37-ce40-4483-843c-41813f584c46 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:56.501709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5e37-ce40-4483-843c-41813f584c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:56.501984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5e37-ce40-4483-843c-41813f584c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:56.502652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec5e37-ce40-4483-843c-41813f584c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:56.504265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec5e37-ce40-4483-843c-41813f584c46 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:56.546352 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2422/4864] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:56.551386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3940b2a-6c0d-4fe6-a0fc-c0043d655990 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:56.571285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3940b2a-6c0d-4fe6-a0fc-c0043d655990 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:56.590962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ab3ad-345b-4429-937d-a368ab53bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:56.591656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ab3ad-345b-4429-937d-a368ab53bf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:56.591944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ab3ad-345b-4429-937d-a368ab53bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:56.592225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ab3ad-345b-4429-937d-a368ab53bf5b admin admin] PATH_INFO: `/v3/projects/edbddb6337114fbf958835e000073699/users/99c1a729af7f4ee683e767f50ee3354c/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:56.653840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ab3ad-345b-4429-937d-a368ab53bf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbddb6337114fbf958835e000073699, user_id=99c1a729af7f4ee683e767f50ee3354c, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:56.657496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ab3ad-345b-4429-937d-a368ab53bf5b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:56.682180 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2443/4865] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:56 2022] PUT /identity/v3/projects/edbddb6337114fbf958835e000073699/users/99c1a729af7f4ee683e767f50ee3354c/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:02:56.683697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5e37-ce40-4483-843c-41813f584c46 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:56.696251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5e37-ce40-4483-843c-41813f584c46 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:56.864565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540f502-0f5c-4031-9d2d-a690d4763c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:56.865215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540f502-0f5c-4031-9d2d-a690d4763c07 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:56.865555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540f502-0f5c-4031-9d2d-a690d4763c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:56.865841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540f502-0f5c-4031-9d2d-a690d4763c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:56.866497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540f502-0f5c-4031-9d2d-a690d4763c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:56.868116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540f502-0f5c-4031-9d2d-a690d4763c07 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:56.892925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ab3ad-345b-4429-937d-a368ab53bf5b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:56.905059 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2423/4866] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:02:56.911170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ab3ad-345b-4429-937d-a368ab53bf5b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:56.945507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca1b8a-5b48-4126-b9d8-c78d92a130f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:56.946319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1b8a-5b48-4126-b9d8-c78d92a130f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:56.949259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1b8a-5b48-4126-b9d8-c78d92a130f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:56.949637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1b8a-5b48-4126-b9d8-c78d92a130f3 admin admin] PATH_INFO: `/v3/projects/edbddb6337114fbf958835e000073699/users/99c1a729af7f4ee683e767f50ee3354c/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:56.967056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca1b8a-5b48-4126-b9d8-c78d92a130f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbddb6337114fbf958835e000073699, user_id=99c1a729af7f4ee683e767f50ee3354c, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:56.975508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca1b8a-5b48-4126-b9d8-c78d92a130f3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:57.032241 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2444/4867] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:02:56 2022] PUT /identity/v3/projects/edbddb6337114fbf958835e000073699/users/99c1a729af7f4ee683e767f50ee3354c/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:02:57.034929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4f9d-9b1f-4dbe-8fc1-6696023d7ae1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:57.035219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4f9d-9b1f-4dbe-8fc1-6696023d7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:57.035506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4f9d-9b1f-4dbe-8fc1-6696023d7ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:57.125884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-015e4f9d-9b1f-4dbe-8fc1-6696023d7ae1 None None] MFA Rules not processed for user `99c1a729af7f4ee683e767f50ee3354c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:02:57.127157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-015e4f9d-9b1f-4dbe-8fc1-6696023d7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:57.383943 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2424/4868] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:02:57.398427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca1b8a-5b48-4126-b9d8-c78d92a130f3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:02:57.400235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8bca1b8a-5b48-4126-b9d8-c78d92a130f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:02:57.619360 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:57.693712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca1b8a-5b48-4126-b9d8-c78d92a130f3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:02:57.708449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b40520-2b1b-4306-b9d8-7fda62c53bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:02:57.713162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b40520-2b1b-4306-b9d8-7fda62c53bda service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:02:57.713589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b40520-2b1b-4306-b9d8-7fda62c53bda service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:02:57.714109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b40520-2b1b-4306-b9d8-7fda62c53bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:02:57.892386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b40520-2b1b-4306-b9d8-7fda62c53bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:02:57.894301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b40520-2b1b-4306-b9d8-7fda62c53bda service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:02:57.923146 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2445/4869] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:02:57 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:06.138231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4f9d-9b1f-4dbe-8fc1-6696023d7ae1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:06.141281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-015e4f9d-9b1f-4dbe-8fc1-6696023d7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:06.167248 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:06.267972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4f9d-9b1f-4dbe-8fc1-6696023d7ae1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:06.287151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556e5e-0635-4e5b-9d20-442d7347548f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:06.288163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556e5e-0635-4e5b-9d20-442d7347548f service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:06.288676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556e5e-0635-4e5b-9d20-442d7347548f service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:06.289174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556e5e-0635-4e5b-9d20-442d7347548f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:06.314986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455b46b-9fa7-4a06-bd47-6f57cece359b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:06.315593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455b46b-9fa7-4a06-bd47-6f57cece359b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:06.315593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455b46b-9fa7-4a06-bd47-6f57cece359b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:06.330642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab556e5e-0635-4e5b-9d20-442d7347548f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:06.332425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab556e5e-0635-4e5b-9d20-442d7347548f service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:06.353186 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2425/4870] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:06.376394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e455b46b-9fa7-4a06-bd47-6f57cece359b None None] MFA Rules not processed for user `f6f439f0db774d4c9691083e208cbaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:06.380491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e455b46b-9fa7-4a06-bd47-6f57cece359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:06.486352 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2446/4871] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:06.489961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b722170-ca1e-48b6-b8ad-9e554a3bf65b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:06.490484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b722170-ca1e-48b6-b8ad-9e554a3bf65b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:06.490909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b722170-ca1e-48b6-b8ad-9e554a3bf65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:06.548391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5b722170-ca1e-48b6-b8ad-9e554a3bf65b None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:06.549671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5b722170-ca1e-48b6-b8ad-9e554a3bf65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:06.761227 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2426/4872] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:06.793450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455b46b-9fa7-4a06-bd47-6f57cece359b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:06.795530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e455b46b-9fa7-4a06-bd47-6f57cece359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:07.011740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455b46b-9fa7-4a06-bd47-6f57cece359b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:07.028601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97d601-5c71-43fd-9664-a8d7c2c1f262 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:07.038099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97d601-5c71-43fd-9664-a8d7c2c1f262 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:07.061986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97d601-5c71-43fd-9664-a8d7c2c1f262 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:07.063067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97d601-5c71-43fd-9664-a8d7c2c1f262 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:07.084270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97d601-5c71-43fd-9664-a8d7c2c1f262 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:07.097550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97d601-5c71-43fd-9664-a8d7c2c1f262 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:07.127478 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2447/4873] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:09.447893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acdf5f-f358-42b3-b5f4-2cfa9b05c93c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:09.448702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acdf5f-f358-42b3-b5f4-2cfa9b05c93c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:09.448887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acdf5f-f358-42b3-b5f4-2cfa9b05c93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:09.495993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d0acdf5f-f358-42b3-b5f4-2cfa9b05c93c None None] MFA Rules not processed for user `f6f439f0db774d4c9691083e208cbaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:09.504429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d0acdf5f-f358-42b3-b5f4-2cfa9b05c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:09.523659 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2427/4874] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:09.678059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50736cc-da51-4871-bf56-44c0138c8585 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:09.680799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50736cc-da51-4871-bf56-44c0138c8585 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:09.681770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50736cc-da51-4871-bf56-44c0138c8585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:09.755404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d50736cc-da51-4871-bf56-44c0138c8585 None None] MFA Rules not processed for user `1f062f2ecc0547ae960ed98e7aeef9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:09.764805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d50736cc-da51-4871-bf56-44c0138c8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:09.927238 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:10.081663 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2448/4875] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:19.481452 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=53 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:20.057320 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=13 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:20.599408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acdf5f-f358-42b3-b5f4-2cfa9b05c93c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:20.599408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d0acdf5f-f358-42b3-b5f4-2cfa9b05c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:20.848035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acdf5f-f358-42b3-b5f4-2cfa9b05c93c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:20.866071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76603761-eed9-407b-bc66-f0d68bfbab15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:20.867509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76603761-eed9-407b-bc66-f0d68bfbab15 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:20.869909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76603761-eed9-407b-bc66-f0d68bfbab15 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:20.870383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76603761-eed9-407b-bc66-f0d68bfbab15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:20.877695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-76603761-eed9-407b-bc66-f0d68bfbab15 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:20.935031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76603761-eed9-407b-bc66-f0d68bfbab15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:20.937378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76603761-eed9-407b-bc66-f0d68bfbab15 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:20.975139 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2428/4876] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:21.223770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50736cc-da51-4871-bf56-44c0138c8585 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:21.223770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d50736cc-da51-4871-bf56-44c0138c8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:21.244328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50736cc-da51-4871-bf56-44c0138c8585 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:21.256226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:21.257008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:21.259327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:21.259764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:21.264451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:21.291210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:21.295146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:21.317514 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2449/4877] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:22.510264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76603761-eed9-407b-bc66-f0d68bfbab15 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:22.539083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76603761-eed9-407b-bc66-f0d68bfbab15 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:22.551459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:22.552557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:22.553128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:22.553567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:22.556121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:22.588649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:22.590906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:22.609261 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2429/4878] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:26.507039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:26.508530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:26.648260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34591303-23c1-4920-8df0-c1b325496040 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:26.657210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00c3c-de7c-4aa6-b857-f01344f97141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:26.658098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00c3c-de7c-4aa6-b857-f01344f97141 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:26.658537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00c3c-de7c-4aa6-b857-f01344f97141 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:26.659797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00c3c-de7c-4aa6-b857-f01344f97141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:26.662832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-04a00c3c-de7c-4aa6-b857-f01344f97141 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:26.809843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a00c3c-de7c-4aa6-b857-f01344f97141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:26.813613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a00c3c-de7c-4aa6-b857-f01344f97141 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:26.844596 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2450/4879] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:28.963120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:28.965212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:29.112382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57734e-dbbf-4f3c-8fec-22c0cf77676d service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:29.128514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7e5c1-5752-43e2-966d-7cb730218922 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:29.129442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7e5c1-5752-43e2-966d-7cb730218922 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:29.129908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7e5c1-5752-43e2-966d-7cb730218922 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:29.130338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7e5c1-5752-43e2-966d-7cb730218922 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:29.132677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3ea7e5c1-5752-43e2-966d-7cb730218922 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:29.163436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7e5c1-5752-43e2-966d-7cb730218922 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:29.165178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7e5c1-5752-43e2-966d-7cb730218922 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:29.205760 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2430/4880] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:29.820583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00c3c-de7c-4aa6-b857-f01344f97141 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:29.994248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00c3c-de7c-4aa6-b857-f01344f97141 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:30.016352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:30.017431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:30.019341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:30.019838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] PATH_INFO: `/v3/users/a487f0c1ea3c4e1584ec73f57d528630` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:30.023159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a487f0c1ea3c4e1584ec73f57d528630)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:30.028854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:30.176298 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:30.189835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a487f0c1ea3c4e1584ec73f57d528630'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:30.228129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a487f0c1ea3c4e1584ec73f57d528630'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:30.240712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a487f0c1ea3c4e1584ec73f57d528630'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:30.250565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a487f0c1ea3c4e1584ec73f57d528630'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:30.251401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a487f0c1ea3c4e1584ec73f57d528630'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:30.262675 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2451/4881] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:03:29 2022] DELETE /identity/v3/users/a487f0c1ea3c4e1584ec73f57d528630 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:03:30.265129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9e582-afe2-4125-807e-1001f0be3659 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:30.266001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9e582-afe2-4125-807e-1001f0be3659 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:30.266462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9e582-afe2-4125-807e-1001f0be3659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:30.312645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5cf9e582-afe2-4125-807e-1001f0be3659 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:30.314270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cf9e582-afe2-4125-807e-1001f0be3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:30.416135 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2431/4882] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:30.423225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:30.424793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:30.512789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c78d-e4a9-427c-b21b-c794184002ca admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:30.517967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985c425-6748-4e68-823d-8375f6909195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:30.518778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985c425-6748-4e68-823d-8375f6909195 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:30.519221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985c425-6748-4e68-823d-8375f6909195 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:30.519640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985c425-6748-4e68-823d-8375f6909195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:30.531158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985c425-6748-4e68-823d-8375f6909195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:30.533695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985c425-6748-4e68-823d-8375f6909195 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:30.546216 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2452/4883] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:31.076304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9e582-afe2-4125-807e-1001f0be3659 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:31.079076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cf9e582-afe2-4125-807e-1001f0be3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:31.106533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9e582-afe2-4125-807e-1001f0be3659 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:31.121060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:31.122087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:31.122514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:31.140944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] PATH_INFO: `/v3/projects/4a723c2cfb394aa09b04f2e70b27fd6a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:31.144222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a723c2cfb394aa09b04f2e70b27fd6a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:31.149757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:31.193013 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:31.267559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a723c2cfb394aa09b04f2e70b27fd6a', 'request_id': 'req-947c6ab2-06cd-476a-8538-aa1432cf8cfb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.283279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a723c2cfb394aa09b04f2e70b27fd6a', 'request_id': 'req-947c6ab2-06cd-476a-8538-aa1432cf8cfb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.307243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a723c2cfb394aa09b04f2e70b27fd6a', 'request_id': 'req-947c6ab2-06cd-476a-8538-aa1432cf8cfb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.333835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] The token cache is being invalidate because project 4a723c2cfb394aa09b04f2e70b27fd6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:03:31.334434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.335466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.338038 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2432/4884] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:31 2022] DELETE /identity/v3/projects/4a723c2cfb394aa09b04f2e70b27fd6a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:03:31.341945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985c425-6748-4e68-823d-8375f6909195 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:31.353084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985c425-6748-4e68-823d-8375f6909195 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:31.447889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:31.449058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:31.449494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:31.450086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] PATH_INFO: `/v3/users/99c1a729af7f4ee683e767f50ee3354c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:31.451401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c1a729af7f4ee683e767f50ee3354c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:31.454469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:31.531681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c1a729af7f4ee683e767f50ee3354c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.559176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c1a729af7f4ee683e767f50ee3354c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.561073 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:31.579610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c1a729af7f4ee683e767f50ee3354c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.594278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c1a729af7f4ee683e767f50ee3354c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.595116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad196350-1a5f-4f48-bbf3-4eaefeb6cf15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c1a729af7f4ee683e767f50ee3354c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:31.614412 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2453/4885] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:03:31 2022] DELETE /identity/v3/users/99c1a729af7f4ee683e767f50ee3354c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:03:31.877288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:31.878792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:31.896875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c6ab2-06cd-476a-8538-aa1432cf8cfb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:32.021819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:32.022619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:32.023110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:32.023495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] PATH_INFO: `/v3/projects/edbddb6337114fbf958835e000073699` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:32.024791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbddb6337114fbf958835e000073699)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:32.027169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:32.119108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbddb6337114fbf958835e000073699', 'request_id': 'req-5a3169f0-0bca-4e4e-92a4-65d8a800f970'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:32.135126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbddb6337114fbf958835e000073699', 'request_id': 'req-5a3169f0-0bca-4e4e-92a4-65d8a800f970'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:32.146088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbddb6337114fbf958835e000073699', 'request_id': 'req-5a3169f0-0bca-4e4e-92a4-65d8a800f970'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:32.171822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] The token cache is being invalidate because project edbddb6337114fbf958835e000073699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:03:32.172301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:32.173464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5a3169f0-0bca-4e4e-92a4-65d8a800f970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:32.176996 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2433/4886] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:31 2022] DELETE /identity/v3/projects/edbddb6337114fbf958835e000073699 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:03:32.182136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289b52-6058-414f-a457-55ed60e73911 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:32.182738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289b52-6058-414f-a457-55ed60e73911 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:32.183189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289b52-6058-414f-a457-55ed60e73911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:32.275705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b7289b52-6058-414f-a457-55ed60e73911 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:32.277436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b7289b52-6058-414f-a457-55ed60e73911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:32.427772 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2454/4887] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:32.455498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2e94-67c6-4649-bb0a-3953c17f5087 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:32.456280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2e94-67c6-4649-bb0a-3953c17f5087 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:32.456280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2e94-67c6-4649-bb0a-3953c17f5087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:32.497014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d38f2e94-67c6-4649-bb0a-3953c17f5087 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:32.498238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d38f2e94-67c6-4649-bb0a-3953c17f5087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:32.510812 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2434/4888] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:32.514990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7289b52-6058-414f-a457-55ed60e73911 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:32.527828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7289b52-6058-414f-a457-55ed60e73911 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:32.534266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e39fdd-2217-4767-aeb5-cb4650d056a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:32.534982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e39fdd-2217-4767-aeb5-cb4650d056a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:32.535329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e39fdd-2217-4767-aeb5-cb4650d056a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:32.535672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e39fdd-2217-4767-aeb5-cb4650d056a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:32.536447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e39fdd-2217-4767-aeb5-cb4650d056a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:03:32.537425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e39fdd-2217-4767-aeb5-cb4650d056a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:32.539415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e39fdd-2217-4767-aeb5-cb4650d056a8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:32.558078 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2455/4889] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:03:32.559594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f2e94-67c6-4649-bb0a-3953c17f5087 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:32.570581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f2e94-67c6-4649-bb0a-3953c17f5087 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:32.588051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135281a9-5636-4368-85db-253ba7abc0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:32.588717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135281a9-5636-4368-85db-253ba7abc0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:32.589007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135281a9-5636-4368-85db-253ba7abc0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:32.589285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135281a9-5636-4368-85db-253ba7abc0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:32.589942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135281a9-5636-4368-85db-253ba7abc0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:32.591874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135281a9-5636-4368-85db-253ba7abc0c7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:32.654135 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2435/4890] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:03:32 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:03:32.655381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e39fdd-2217-4767-aeb5-cb4650d056a8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:32.675595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e39fdd-2217-4767-aeb5-cb4650d056a8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:32.774982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2817c-81d2-4331-82b0-f6cf8ad23a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:32.775957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2817c-81d2-4331-82b0-f6cf8ad23a7c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:32.776460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2817c-81d2-4331-82b0-f6cf8ad23a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:32.777256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2817c-81d2-4331-82b0-f6cf8ad23a7c admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:32.778185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2817c-81d2-4331-82b0-f6cf8ad23a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:32.781064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2817c-81d2-4331-82b0-f6cf8ad23a7c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:32.816818 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2456/4891] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:03:32 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:03:32.817884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135281a9-5636-4368-85db-253ba7abc0c7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:32.826210 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:32.832005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135281a9-5636-4368-85db-253ba7abc0c7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:32.845818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf1fa-0f60-4dc5-9a99-1ce0e6ba7554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:32.846732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf1fa-0f60-4dc5-9a99-1ce0e6ba7554 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:32.847084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf1fa-0f60-4dc5-9a99-1ce0e6ba7554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:32.847431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf1fa-0f60-4dc5-9a99-1ce0e6ba7554 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:32.848168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cf1fa-0f60-4dc5-9a99-1ce0e6ba7554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:32.850257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cf1fa-0f60-4dc5-9a99-1ce0e6ba7554 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:32.871374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2817c-81d2-4331-82b0-f6cf8ad23a7c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:32.872160 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2436/4892] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:03:32.888081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2817c-81d2-4331-82b0-f6cf8ad23a7c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:32.894063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa4ddf-8a2e-4b98-aa4e-f26f476ae283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:32.894834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa4ddf-8a2e-4b98-aa4e-f26f476ae283 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:32.895251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa4ddf-8a2e-4b98-aa4e-f26f476ae283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:32.895635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa4ddf-8a2e-4b98-aa4e-f26f476ae283 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:32.896400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa4ddf-8a2e-4b98-aa4e-f26f476ae283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:32.898182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa4ddf-8a2e-4b98-aa4e-f26f476ae283 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:32.914146 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2457/4893] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:03:32.915764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf1fa-0f60-4dc5-9a99-1ce0e6ba7554 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:32.926738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf1fa-0f60-4dc5-9a99-1ce0e6ba7554 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:32.931996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b842fb-7781-42d8-9892-40dbca8038f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:32.932848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b842fb-7781-42d8-9892-40dbca8038f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:32.933246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b842fb-7781-42d8-9892-40dbca8038f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:32.933844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b842fb-7781-42d8-9892-40dbca8038f5 admin admin] PATH_INFO: `/v3/projects/050e97e0463d4154a86b0c88d7bab3f5/users/0e63c50bff2f4d2ca07849ff596de7a1/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:32.989180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b842fb-7781-42d8-9892-40dbca8038f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050e97e0463d4154a86b0c88d7bab3f5, user_id=0e63c50bff2f4d2ca07849ff596de7a1, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:32.991899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b842fb-7781-42d8-9892-40dbca8038f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:33.009011 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2437/4894] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:03:32 2022] PUT /identity/v3/projects/050e97e0463d4154a86b0c88d7bab3f5/users/0e63c50bff2f4d2ca07849ff596de7a1/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:03:33.021326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f6592-041d-4b12-88e4-b6ec02ad49d2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:33.021610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f6592-041d-4b12-88e4-b6ec02ad49d2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:33.021911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f6592-041d-4b12-88e4-b6ec02ad49d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:33.081528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9b9f6592-041d-4b12-88e4-b6ec02ad49d2 None None] MFA Rules not processed for user `0e63c50bff2f4d2ca07849ff596de7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:33.083339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9b9f6592-041d-4b12-88e4-b6ec02ad49d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:33.137685 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:33.214872 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2458/4895] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:33.224979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b842fb-7781-42d8-9892-40dbca8038f5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:33.227315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8b842fb-7781-42d8-9892-40dbca8038f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:33.324320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b842fb-7781-42d8-9892-40dbca8038f5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:33.329774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70712b56-52a4-420f-a886-ec95851cf366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:33.330518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70712b56-52a4-420f-a886-ec95851cf366 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:33.330800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70712b56-52a4-420f-a886-ec95851cf366 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:33.331582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70712b56-52a4-420f-a886-ec95851cf366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:33.364175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70712b56-52a4-420f-a886-ec95851cf366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:33.365711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70712b56-52a4-420f-a886-ec95851cf366 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:33.430599 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2438/4896] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:38.338473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f6592-041d-4b12-88e4-b6ec02ad49d2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:38.340789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9b9f6592-041d-4b12-88e4-b6ec02ad49d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:38.486109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f6592-041d-4b12-88e4-b6ec02ad49d2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:38.497515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba4db0-7c4a-465b-8d8d-32fad887798d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:38.498162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4db0-7c4a-465b-8d8d-32fad887798d service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:38.498449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4db0-7c4a-465b-8d8d-32fad887798d service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:38.498785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4db0-7c4a-465b-8d8d-32fad887798d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:38.513215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-39ba4db0-7c4a-465b-8d8d-32fad887798d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:38.664918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba4db0-7c4a-465b-8d8d-32fad887798d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:38.666657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba4db0-7c4a-465b-8d8d-32fad887798d service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:38.716927 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2459/4897] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:38.721075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70712b56-52a4-420f-a886-ec95851cf366 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:38.736605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70712b56-52a4-420f-a886-ec95851cf366 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:38.764033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:38.765806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:38.766069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:38.766451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:38.773050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:39.091440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:39.093283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:39.122115 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2439/4898] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:41.138608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefd603-0efa-4a4a-bc7a-3e9ae0bd88db None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:41.139807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefd603-0efa-4a4a-bc7a-3e9ae0bd88db None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:41.139807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefd603-0efa-4a4a-bc7a-3e9ae0bd88db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:41.200608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0eefd603-0efa-4a4a-bc7a-3e9ae0bd88db None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:41.203429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0eefd603-0efa-4a4a-bc7a-3e9ae0bd88db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:41.408265 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2460/4899] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:03:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:41.437407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:41.438865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:41.652971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa80709-d694-444a-bbda-554881e82189 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:41.672400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d678260-0f88-42d6-a866-afa107fc1e4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:41.673082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d678260-0f88-42d6-a866-afa107fc1e4b service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:41.673337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d678260-0f88-42d6-a866-afa107fc1e4b service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:41.673613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d678260-0f88-42d6-a866-afa107fc1e4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:41.695545 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:41.699483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d678260-0f88-42d6-a866-afa107fc1e4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:41.703557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d678260-0f88-42d6-a866-afa107fc1e4b service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:41.724482 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2440/4900] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:03:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:43.894264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895288c-76c6-49c1-bc45-5f80c4d81db4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:43.894264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895288c-76c6-49c1-bc45-5f80c4d81db4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:43.894264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895288c-76c6-49c1-bc45-5f80c4d81db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:43.959371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f895288c-76c6-49c1-bc45-5f80c4d81db4 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:43.964521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f895288c-76c6-49c1-bc45-5f80c4d81db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:44.014803 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2461/4901] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:03:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:44.060405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d678260-0f88-42d6-a866-afa107fc1e4b service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:44.079646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d678260-0f88-42d6-a866-afa107fc1e4b service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:44.105080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613422e4-023c-4fd2-8401-b292c9b55238 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:44.105760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613422e4-023c-4fd2-8401-b292c9b55238 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:44.106053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613422e4-023c-4fd2-8401-b292c9b55238 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:44.106333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613422e4-023c-4fd2-8401-b292c9b55238 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:44.139921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613422e4-023c-4fd2-8401-b292c9b55238 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:44.141570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613422e4-023c-4fd2-8401-b292c9b55238 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:44.193802 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2441/4902] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:03:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:48.064428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895288c-76c6-49c1-bc45-5f80c4d81db4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:48.091575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895288c-76c6-49c1-bc45-5f80c4d81db4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:48.105144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55186-c9ea-4343-9baa-4dda8c308c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:48.109666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55186-c9ea-4343-9baa-4dda8c308c28 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:48.110241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55186-c9ea-4343-9baa-4dda8c308c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:48.110897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55186-c9ea-4343-9baa-4dda8c308c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:48.121668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f3d55186-c9ea-4343-9baa-4dda8c308c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:48.239201 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:48.470444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d55186-c9ea-4343-9baa-4dda8c308c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:48.480301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d55186-c9ea-4343-9baa-4dda8c308c28 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:48.559751 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2462/4903] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:03:54.167590 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=8 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:55.288815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613422e4-023c-4fd2-8401-b292c9b55238 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:55.291010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-613422e4-023c-4fd2-8401-b292c9b55238 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:55.365948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613422e4-023c-4fd2-8401-b292c9b55238 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:55.410070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:55.413799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:55.417601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:55.419630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] PATH_INFO: `/v3/users/2190bd30671b47048aed416f9c14a545` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:55.423945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2190bd30671b47048aed416f9c14a545)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:55.431469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:55.556478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2190bd30671b47048aed416f9c14a545'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:55.576715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2190bd30671b47048aed416f9c14a545'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:55.596650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2190bd30671b47048aed416f9c14a545'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:55.612639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2190bd30671b47048aed416f9c14a545'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:55.614414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b787ce1-1ffe-4a0a-bac2-ba1d9f2d67f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2190bd30671b47048aed416f9c14a545'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:55.634865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2442/4904] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:03:55 2022] DELETE /identity/v3/users/2190bd30671b47048aed416f9c14a545 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:03:56.473866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55186-c9ea-4343-9baa-4dda8c308c28 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:56.495452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55186-c9ea-4343-9baa-4dda8c308c28 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:56.709172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:56.710207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:56.710708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:56.711220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] PATH_INFO: `/v3/projects/4a4820802e0a4a2b9de754ee1268c060` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:56.716057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4820802e0a4a2b9de754ee1268c060)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:56.724526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:56.874761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4820802e0a4a2b9de754ee1268c060', 'request_id': 'req-30964837-dc96-4064-a980-f08e1476f211'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:56.894431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4820802e0a4a2b9de754ee1268c060', 'request_id': 'req-30964837-dc96-4064-a980-f08e1476f211'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:56.905630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4820802e0a4a2b9de754ee1268c060', 'request_id': 'req-30964837-dc96-4064-a980-f08e1476f211'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:56.940983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] The token cache is being invalidate because project 4a4820802e0a4a2b9de754ee1268c060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:03:56.942127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:56.944723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30964837-dc96-4064-a980-f08e1476f211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:03:56.953102 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2463/4905] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:56 2022] DELETE /identity/v3/projects/4a4820802e0a4a2b9de754ee1268c060 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:03:56.954141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3849b-cc00-4ec0-9cc1-d651d88d8cc3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:56.954621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3849b-cc00-4ec0-9cc1-d651d88d8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:56.954728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3849b-cc00-4ec0-9cc1-d651d88d8cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:57.028669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4ac3849b-cc00-4ec0-9cc1-d651d88d8cc3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:57.030628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4ac3849b-cc00-4ec0-9cc1-d651d88d8cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:57.283009 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2443/4906] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:57.294006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d8e88-715a-4896-8957-a3fe3dde55aa None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:57.294006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d8e88-715a-4896-8957-a3fe3dde55aa None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:57.294640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d8e88-715a-4896-8957-a3fe3dde55aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:57.351996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-478d8e88-715a-4896-8957-a3fe3dde55aa None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:57.355769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-478d8e88-715a-4896-8957-a3fe3dde55aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:57.383571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3849b-cc00-4ec0-9cc1-d651d88d8cc3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:57.384183 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2464/4907] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:57.395552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3849b-cc00-4ec0-9cc1-d651d88d8cc3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:57.423491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c053490-6d6a-4bf7-8f2d-0e65d8836022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:57.426639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c053490-6d6a-4bf7-8f2d-0e65d8836022 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:57.426923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c053490-6d6a-4bf7-8f2d-0e65d8836022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:57.427190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c053490-6d6a-4bf7-8f2d-0e65d8836022 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:57.433711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c053490-6d6a-4bf7-8f2d-0e65d8836022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:03:57.433920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c053490-6d6a-4bf7-8f2d-0e65d8836022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:57.436081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c053490-6d6a-4bf7-8f2d-0e65d8836022 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:57.485994 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2444/4908] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:03:57.491000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d8e88-715a-4896-8957-a3fe3dde55aa None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:57.514848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d8e88-715a-4896-8957-a3fe3dde55aa None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:57.522801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad5a8-35c3-4ed9-8eba-e4f6803784b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:57.523812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad5a8-35c3-4ed9-8eba-e4f6803784b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:57.524100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad5a8-35c3-4ed9-8eba-e4f6803784b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:57.524401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad5a8-35c3-4ed9-8eba-e4f6803784b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:57.525320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fad5a8-35c3-4ed9-8eba-e4f6803784b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:57.527988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fad5a8-35c3-4ed9-8eba-e4f6803784b6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:57.606711 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2465/4909] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:03:57 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:03:57.610908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c053490-6d6a-4bf7-8f2d-0e65d8836022 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:57.630471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c053490-6d6a-4bf7-8f2d-0e65d8836022 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:57.902792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7019be2-cd5c-475f-b706-c3ebe18cfd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:57.903410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7019be2-cd5c-475f-b706-c3ebe18cfd7e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:57.903715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7019be2-cd5c-475f-b706-c3ebe18cfd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:57.904028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7019be2-cd5c-475f-b706-c3ebe18cfd7e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:57.905083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7019be2-cd5c-475f-b706-c3ebe18cfd7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:57.907071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7019be2-cd5c-475f-b706-c3ebe18cfd7e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:57.945042 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:57.969045 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2445/4910] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:03:57 2022] POST /identity/v3/users => generated 290 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:03:57.973448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad5a8-35c3-4ed9-8eba-e4f6803784b6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:57.988156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad5a8-35c3-4ed9-8eba-e4f6803784b6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:58.000913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831a8be-e0fe-4625-aa05-75f47420b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:58.001521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831a8be-e0fe-4625-aa05-75f47420b8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:58.001800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831a8be-e0fe-4625-aa05-75f47420b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:58.002072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831a8be-e0fe-4625-aa05-75f47420b8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:58.004301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831a8be-e0fe-4625-aa05-75f47420b8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:58.009676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831a8be-e0fe-4625-aa05-75f47420b8e7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:58.018093 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:58.040223 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2466/4911] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:03:58.042871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7019be2-cd5c-475f-b706-c3ebe18cfd7e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:58.070410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7019be2-cd5c-475f-b706-c3ebe18cfd7e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:58.080503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb9814-fdb8-41d8-af84-f20323f871a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:58.081789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb9814-fdb8-41d8-af84-f20323f871a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:58.082936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb9814-fdb8-41d8-af84-f20323f871a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:58.083272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb9814-fdb8-41d8-af84-f20323f871a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:58.083940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb9814-fdb8-41d8-af84-f20323f871a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:58.101823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb9814-fdb8-41d8-af84-f20323f871a7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:58.129030 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2446/4912] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:03:58.133219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831a8be-e0fe-4625-aa05-75f47420b8e7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:58.148497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831a8be-e0fe-4625-aa05-75f47420b8e7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:58.169360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce75d-388f-4836-bdfa-8317d8a8fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:58.170595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce75d-388f-4836-bdfa-8317d8a8fe7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:58.170873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce75d-388f-4836-bdfa-8317d8a8fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:58.171148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce75d-388f-4836-bdfa-8317d8a8fe7b admin admin] PATH_INFO: `/v3/projects/39c10fa11e244a629264dd733478c21b/users/5ac399b59740442a93081bb1a78297b4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:58.249758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce75d-388f-4836-bdfa-8317d8a8fe7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c10fa11e244a629264dd733478c21b, user_id=5ac399b59740442a93081bb1a78297b4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:58.252554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce75d-388f-4836-bdfa-8317d8a8fe7b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:58.283780 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2467/4913] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:03:58 2022] PUT /identity/v3/projects/39c10fa11e244a629264dd733478c21b/users/5ac399b59740442a93081bb1a78297b4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:03:58.289356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad59a06-39b0-4afc-a5ed-aa10ec6d6a9b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:58.289638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad59a06-39b0-4afc-a5ed-aa10ec6d6a9b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:58.290003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad59a06-39b0-4afc-a5ed-aa10ec6d6a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:58.365928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9ad59a06-39b0-4afc-a5ed-aa10ec6d6a9b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:03:58.374524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9ad59a06-39b0-4afc-a5ed-aa10ec6d6a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:58.647897 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2447/4914] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:03:58.684602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce75d-388f-4836-bdfa-8317d8a8fe7b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:03:58.689432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c75ce75d-388f-4836-bdfa-8317d8a8fe7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:03:58.858157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce75d-388f-4836-bdfa-8317d8a8fe7b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:03:58.866817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d9b30-5493-417b-a5f0-dd09e7dc23e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:03:58.867514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d9b30-5493-417b-a5f0-dd09e7dc23e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:03:58.867714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d9b30-5493-417b-a5f0-dd09e7dc23e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:03:58.867993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d9b30-5493-417b-a5f0-dd09e7dc23e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:03:58.885034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d9b30-5493-417b-a5f0-dd09e7dc23e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:03:58.886498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d9b30-5493-417b-a5f0-dd09e7dc23e6 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:03:58.900800 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2468/4915] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:02.369226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad59a06-39b0-4afc-a5ed-aa10ec6d6a9b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:02.370667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9ad59a06-39b0-4afc-a5ed-aa10ec6d6a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:02.505985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad59a06-39b0-4afc-a5ed-aa10ec6d6a9b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:02.512256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc9193-dcd2-42d1-b9ba-3c26f77edca5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:02.513784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc9193-dcd2-42d1-b9ba-3c26f77edca5 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:02.514419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc9193-dcd2-42d1-b9ba-3c26f77edca5 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:02.515004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc9193-dcd2-42d1-b9ba-3c26f77edca5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:02.517360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1afc9193-dcd2-42d1-b9ba-3c26f77edca5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:02.747093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc9193-dcd2-42d1-b9ba-3c26f77edca5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:02.758652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc9193-dcd2-42d1-b9ba-3c26f77edca5 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:02.799427 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2448/4916] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:03.067092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414322d-58af-40d0-adc3-2f6e85b4d73b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:03.067634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414322d-58af-40d0-adc3-2f6e85b4d73b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:03.067634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414322d-58af-40d0-adc3-2f6e85b4d73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:03.131456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7414322d-58af-40d0-adc3-2f6e85b4d73b None None] MFA Rules not processed for user `1f062f2ecc0547ae960ed98e7aeef9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:03.132799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7414322d-58af-40d0-adc3-2f6e85b4d73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:03.367038 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2469/4917] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:09.631538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3e75c-ec65-4610-802a-faaad9d18eb1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:09.632124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3e75c-ec65-4610-802a-faaad9d18eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:09.632255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3e75c-ec65-4610-802a-faaad9d18eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:09.709460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bfb3e75c-ec65-4610-802a-faaad9d18eb1 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:09.713727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bfb3e75c-ec65-4610-802a-faaad9d18eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:09.790371 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:09.960344 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2449/4918] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:04:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:10.047263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414322d-58af-40d0-adc3-2f6e85b4d73b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:10.048831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7414322d-58af-40d0-adc3-2f6e85b4d73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:10.287090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414322d-58af-40d0-adc3-2f6e85b4d73b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:10.311637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a11df-64c1-4127-a7d4-f9f2dfcb4d2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:10.312943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a11df-64c1-4127-a7d4-f9f2dfcb4d2f service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:10.313385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a11df-64c1-4127-a7d4-f9f2dfcb4d2f service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:10.313805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a11df-64c1-4127-a7d4-f9f2dfcb4d2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:10.337947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a11df-64c1-4127-a7d4-f9f2dfcb4d2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:10.340046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a11df-64c1-4127-a7d4-f9f2dfcb4d2f service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:10.369889 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2470/4919] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:04:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:04:14.853882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3e75c-ec65-4610-802a-faaad9d18eb1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:14.855397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bfb3e75c-ec65-4610-802a-faaad9d18eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:14.896294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a11df-64c1-4127-a7d4-f9f2dfcb4d2f service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:14.904091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3f2a11df-64c1-4127-a7d4-f9f2dfcb4d2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:14.937515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a11df-64c1-4127-a7d4-f9f2dfcb4d2f service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:14.957106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:14.962452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:14.965167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:14.967103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] PATH_INFO: `/v3/users/0e63c50bff2f4d2ca07849ff596de7a1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:14.973571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e63c50bff2f4d2ca07849ff596de7a1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:14.976814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:15.006689 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:15.186206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e63c50bff2f4d2ca07849ff596de7a1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:15.190105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3e75c-ec65-4610-802a-faaad9d18eb1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:15.209849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e63c50bff2f4d2ca07849ff596de7a1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:15.211745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:15.219658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:15.220014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:15.220304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:15.221598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e63c50bff2f4d2ca07849ff596de7a1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:15.235789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:15.242031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e63c50bff2f4d2ca07849ff596de7a1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:15.243584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-92752dc1-2c7e-4bd9-a548-b6bce6bae090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e63c50bff2f4d2ca07849ff596de7a1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:15.254219 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2471/4920] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:04:14 2022] DELETE /identity/v3/users/0e63c50bff2f4d2ca07849ff596de7a1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:04:15.271334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9370b-15f6-48f0-b0f1-34e38490642c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:15.272719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9370b-15f6-48f0-b0f1-34e38490642c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:15.275438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9370b-15f6-48f0-b0f1-34e38490642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:15.314001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:15.318348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:15.422396 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2450/4921] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:15.470780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f1b9370b-15f6-48f0-b0f1-34e38490642c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:15.475934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1b9370b-15f6-48f0-b0f1-34e38490642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:15.705961 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2472/4922] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:15.848758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:15.850544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:15.902275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c74d5-d2a8-41a5-9e5e-e4c52421cd11 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:16.179806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2340e-d9c6-4523-b58a-6bc9804be50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:16.180449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2340e-d9c6-4523-b58a-6bc9804be50c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:16.189998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2340e-d9c6-4523-b58a-6bc9804be50c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:16.190371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2340e-d9c6-4523-b58a-6bc9804be50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:16.225835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2340e-d9c6-4523-b58a-6bc9804be50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:16.227316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2340e-d9c6-4523-b58a-6bc9804be50c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:16.254495 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2451/4923] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:16.729023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9370b-15f6-48f0-b0f1-34e38490642c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:16.730803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1b9370b-15f6-48f0-b0f1-34e38490642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:16.757968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9370b-15f6-48f0-b0f1-34e38490642c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:16.785943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:16.786784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:16.787086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:16.787477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] PATH_INFO: `/v3/projects/050e97e0463d4154a86b0c88d7bab3f5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:16.797864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] RBAC: Authorizing `identity:delete_project(project_id=050e97e0463d4154a86b0c88d7bab3f5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:16.806993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:16.946216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050e97e0463d4154a86b0c88d7bab3f5', 'request_id': 'req-597e3137-4efb-4e82-a768-52b71fe9922c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:16.961621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050e97e0463d4154a86b0c88d7bab3f5', 'request_id': 'req-597e3137-4efb-4e82-a768-52b71fe9922c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:16.985242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050e97e0463d4154a86b0c88d7bab3f5', 'request_id': 'req-597e3137-4efb-4e82-a768-52b71fe9922c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:17.032226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] The token cache is being invalidate because project 050e97e0463d4154a86b0c88d7bab3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:04:17.032476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:17.040426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-597e3137-4efb-4e82-a768-52b71fe9922c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:17.043148 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2473/4924] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:04:16 2022] DELETE /identity/v3/projects/050e97e0463d4154a86b0c88d7bab3f5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:04:17.049655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139fa2d-429d-4eb4-99d5-ad95c2e99248 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:17.050164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139fa2d-429d-4eb4-99d5-ad95c2e99248 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:17.050437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139fa2d-429d-4eb4-99d5-ad95c2e99248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:17.085654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c139fa2d-429d-4eb4-99d5-ad95c2e99248 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:17.087296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c139fa2d-429d-4eb4-99d5-ad95c2e99248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:17.272493 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:17.298248 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2452/4925] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:17.300406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731c22-090f-4c3e-8d6e-2f62cf098038 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:17.300827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731c22-090f-4c3e-8d6e-2f62cf098038 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:17.301117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731c22-090f-4c3e-8d6e-2f62cf098038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:17.326709 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:17.339397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0a731c22-090f-4c3e-8d6e-2f62cf098038 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:17.341300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0a731c22-090f-4c3e-8d6e-2f62cf098038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:17.372814 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2474/4926] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:17.376945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139fa2d-429d-4eb4-99d5-ad95c2e99248 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:17.388824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139fa2d-429d-4eb4-99d5-ad95c2e99248 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:17.395269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d43dad-ae08-46f5-994a-2360d01e6f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:17.396030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43dad-ae08-46f5-994a-2360d01e6f51 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:17.396794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43dad-ae08-46f5-994a-2360d01e6f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:17.397448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43dad-ae08-46f5-994a-2360d01e6f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:17.397903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d43dad-ae08-46f5-994a-2360d01e6f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:04:17.398209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d43dad-ae08-46f5-994a-2360d01e6f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:17.404231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d43dad-ae08-46f5-994a-2360d01e6f51 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:17.444210 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2453/4927] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:04:17.451202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731c22-090f-4c3e-8d6e-2f62cf098038 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:17.466130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731c22-090f-4c3e-8d6e-2f62cf098038 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:17.472284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c624b82-adfe-4837-b90a-58c4be6aa077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:17.473155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c624b82-adfe-4837-b90a-58c4be6aa077 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:17.473435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c624b82-adfe-4837-b90a-58c4be6aa077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:17.473706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c624b82-adfe-4837-b90a-58c4be6aa077 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:17.474335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c624b82-adfe-4837-b90a-58c4be6aa077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:17.476358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c624b82-adfe-4837-b90a-58c4be6aa077 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:17.523598 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2475/4928] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:04:17 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:04:17.527829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d43dad-ae08-46f5-994a-2360d01e6f51 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:17.539176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d43dad-ae08-46f5-994a-2360d01e6f51 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:17.629113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df2dab-d0c9-4207-a9f0-bab3ff212b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:17.630295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2dab-d0c9-4207-a9f0-bab3ff212b2e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:17.631123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2dab-d0c9-4207-a9f0-bab3ff212b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:17.631697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2dab-d0c9-4207-a9f0-bab3ff212b2e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:17.632649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df2dab-d0c9-4207-a9f0-bab3ff212b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:17.636083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df2dab-d0c9-4207-a9f0-bab3ff212b2e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:17.703852 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2454/4929] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:04:17 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:04:17.708190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c624b82-adfe-4837-b90a-58c4be6aa077 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:17.739061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c624b82-adfe-4837-b90a-58c4be6aa077 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:17.760468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9070c3d-d31c-4891-966d-92cf24e233a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:17.763260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9070c3d-d31c-4891-966d-92cf24e233a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:17.763694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9070c3d-d31c-4891-966d-92cf24e233a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:17.764081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9070c3d-d31c-4891-966d-92cf24e233a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:17.769501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9070c3d-d31c-4891-966d-92cf24e233a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:17.771150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9070c3d-d31c-4891-966d-92cf24e233a0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:17.793287 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2476/4930] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:04:17.797747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df2dab-d0c9-4207-a9f0-bab3ff212b2e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:17.813163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df2dab-d0c9-4207-a9f0-bab3ff212b2e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:17.878075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea146c-df78-41a7-a0df-a7f4b4cce72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:17.878717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea146c-df78-41a7-a0df-a7f4b4cce72b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:17.879001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea146c-df78-41a7-a0df-a7f4b4cce72b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:17.879277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea146c-df78-41a7-a0df-a7f4b4cce72b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:17.879941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea146c-df78-41a7-a0df-a7f4b4cce72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:17.887509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea146c-df78-41a7-a0df-a7f4b4cce72b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:17.938889 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2455/4931] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:04:17.940426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9070c3d-d31c-4891-966d-92cf24e233a0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:17.957134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9070c3d-d31c-4891-966d-92cf24e233a0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:17.968388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e144d-c2a6-498e-8d8f-12e5062b0d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:17.969108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e144d-c2a6-498e-8d8f-12e5062b0d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:17.969392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e144d-c2a6-498e-8d8f-12e5062b0d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:17.969670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e144d-c2a6-498e-8d8f-12e5062b0d70 admin admin] PATH_INFO: `/v3/projects/32b77edb99fa46368b3f8185022d94af/users/4a934a18403841b4a6c044a068285669/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:18.003497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e144d-c2a6-498e-8d8f-12e5062b0d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b77edb99fa46368b3f8185022d94af, user_id=4a934a18403841b4a6c044a068285669, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:18.006637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e144d-c2a6-498e-8d8f-12e5062b0d70 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:18.036818 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2477/4932] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:04:17 2022] PUT /identity/v3/projects/32b77edb99fa46368b3f8185022d94af/users/4a934a18403841b4a6c044a068285669/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:04:18.051774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d62fef-24d3-4c22-9108-6b12dc0eca33 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:18.052484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d62fef-24d3-4c22-9108-6b12dc0eca33 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:18.066362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d62fef-24d3-4c22-9108-6b12dc0eca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:18.178536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-63d62fef-24d3-4c22-9108-6b12dc0eca33 None None] MFA Rules not processed for user `4a934a18403841b4a6c044a068285669`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:18.179780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-63d62fef-24d3-4c22-9108-6b12dc0eca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:18.382267 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2456/4933] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:18.394772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e144d-c2a6-498e-8d8f-12e5062b0d70 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:18.396760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b54e144d-c2a6-498e-8d8f-12e5062b0d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:18.581996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e144d-c2a6-498e-8d8f-12e5062b0d70 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:18.601053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fad9d-8010-4696-9540-21e3731c368d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:18.602493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fad9d-8010-4696-9540-21e3731c368d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:18.603633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fad9d-8010-4696-9540-21e3731c368d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:18.604661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fad9d-8010-4696-9540-21e3731c368d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:18.631933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fad9d-8010-4696-9540-21e3731c368d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:18.633447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fad9d-8010-4696-9540-21e3731c368d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:18.663662 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2478/4934] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:19.768832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a23f5e-228c-4319-a0d6-50381d857e90 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:19.769598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a23f5e-228c-4319-a0d6-50381d857e90 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:19.769598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a23f5e-228c-4319-a0d6-50381d857e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:19.859167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-40a23f5e-228c-4319-a0d6-50381d857e90 None None] MFA Rules not processed for user `5ac399b59740442a93081bb1a78297b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:19.860509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-40a23f5e-228c-4319-a0d6-50381d857e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:19.994660 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:20.041872 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2457/4935] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:20.046544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fad9d-8010-4696-9540-21e3731c368d service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:20.049090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bd0fad9d-8010-4696-9540-21e3731c368d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:20.206230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fad9d-8010-4696-9540-21e3731c368d service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:20.221950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456e181-e998-4e81-bf08-6e874da5ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:20.222725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456e181-e998-4e81-bf08-6e874da5ed9f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:20.223117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456e181-e998-4e81-bf08-6e874da5ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:20.223503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456e181-e998-4e81-bf08-6e874da5ed9f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:20.224257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456e181-e998-4e81-bf08-6e874da5ed9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:20.228558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456e181-e998-4e81-bf08-6e874da5ed9f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:20.374913 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2479/4936] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:04:20 2022] POST /identity/v3/projects => generated 379 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:04:20.378913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a23f5e-228c-4319-a0d6-50381d857e90 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:20.399791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a23f5e-228c-4319-a0d6-50381d857e90 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:20.554375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8ac4c-98ca-4fdb-8524-e7bf027beb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:20.555149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8ac4c-98ca-4fdb-8524-e7bf027beb0f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:20.555557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8ac4c-98ca-4fdb-8524-e7bf027beb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:20.555949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8ac4c-98ca-4fdb-8524-e7bf027beb0f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:20.556740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8ac4c-98ca-4fdb-8524-e7bf027beb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:20.558876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8ac4c-98ca-4fdb-8524-e7bf027beb0f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:20.602722 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2458/4937] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:04:20 2022] POST /identity/v3/users => generated 296 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:04:20.607283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456e181-e998-4e81-bf08-6e874da5ed9f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:20.620298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456e181-e998-4e81-bf08-6e874da5ed9f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:20.626528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f10da2-c02b-4ea4-bd57-94c5a6316905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:20.627087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f10da2-c02b-4ea4-bd57-94c5a6316905 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:20.627736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f10da2-c02b-4ea4-bd57-94c5a6316905 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:20.628119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f10da2-c02b-4ea4-bd57-94c5a6316905 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:20.629393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f10da2-c02b-4ea4-bd57-94c5a6316905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:20.631292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f10da2-c02b-4ea4-bd57-94c5a6316905 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:20.652207 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2480/4938] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:04:20.656369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8ac4c-98ca-4fdb-8524-e7bf027beb0f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:20.674788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8ac4c-98ca-4fdb-8524-e7bf027beb0f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:20.706141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea07bc-54d1-479d-a62d-9511549c6133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:20.707222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea07bc-54d1-479d-a62d-9511549c6133 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:20.707706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea07bc-54d1-479d-a62d-9511549c6133 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:20.708177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea07bc-54d1-479d-a62d-9511549c6133 admin admin] PATH_INFO: `/v3/projects/615bbef4099a4e17a7c32d0cddaf0f45/users/edaa34227d894985aa2a8b20ae71a5a7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:20.753633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea07bc-54d1-479d-a62d-9511549c6133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615bbef4099a4e17a7c32d0cddaf0f45, user_id=edaa34227d894985aa2a8b20ae71a5a7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:20.768139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea07bc-54d1-479d-a62d-9511549c6133 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:20.810223 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2459/4939] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:04:20 2022] PUT /identity/v3/projects/615bbef4099a4e17a7c32d0cddaf0f45/users/edaa34227d894985aa2a8b20ae71a5a7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:04:20.814302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f10da2-c02b-4ea4-bd57-94c5a6316905 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:20.832033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f10da2-c02b-4ea4-bd57-94c5a6316905 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:20.890805 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:20.979314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db7686-7344-4537-b2eb-9571a863f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:20.979979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db7686-7344-4537-b2eb-9571a863f853 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:20.980264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db7686-7344-4537-b2eb-9571a863f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:20.980540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db7686-7344-4537-b2eb-9571a863f853 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:20.981276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db7686-7344-4537-b2eb-9571a863f853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:20.986245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db7686-7344-4537-b2eb-9571a863f853 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:21.012108 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2481/4940] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:04:21.017225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea07bc-54d1-479d-a62d-9511549c6133 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:21.042343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea07bc-54d1-479d-a62d-9511549c6133 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:21.056205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d35519-f9d0-437e-877d-ca1a08590bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:21.056912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d35519-f9d0-437e-877d-ca1a08590bca admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:21.057483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d35519-f9d0-437e-877d-ca1a08590bca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:21.057997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d35519-f9d0-437e-877d-ca1a08590bca admin admin] PATH_INFO: `/v3/projects/615bbef4099a4e17a7c32d0cddaf0f45/users/edaa34227d894985aa2a8b20ae71a5a7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:21.062184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d35519-f9d0-437e-877d-ca1a08590bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=615bbef4099a4e17a7c32d0cddaf0f45, user_id=edaa34227d894985aa2a8b20ae71a5a7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:21.068727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d35519-f9d0-437e-877d-ca1a08590bca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:21.100680 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2460/4941] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:04:21 2022] PUT /identity/v3/projects/615bbef4099a4e17a7c32d0cddaf0f45/users/edaa34227d894985aa2a8b20ae71a5a7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:04:28.826388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db7686-7344-4537-b2eb-9571a863f853 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:28.828833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-58db7686-7344-4537-b2eb-9571a863f853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:29.107128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db7686-7344-4537-b2eb-9571a863f853 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:29.362260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd2d31-d1cf-4b6f-9178-d060f84154d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:29.363681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd2d31-d1cf-4b6f-9178-d060f84154d5 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:29.364128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd2d31-d1cf-4b6f-9178-d060f84154d5 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:29.364719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd2d31-d1cf-4b6f-9178-d060f84154d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:29.375748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2dcd2d31-d1cf-4b6f-9178-d060f84154d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:29.409284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd2d31-d1cf-4b6f-9178-d060f84154d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:29.410888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd2d31-d1cf-4b6f-9178-d060f84154d5 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:29.454733 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2482/4942] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:31.085758 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:33.576381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d35519-f9d0-437e-877d-ca1a08590bca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:33.704866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d35519-f9d0-437e-877d-ca1a08590bca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:33.710501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eef378-29f4-48f8-b080-5181c6b0a9cb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:33.711369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eef378-29f4-48f8-b080-5181c6b0a9cb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:33.711802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eef378-29f4-48f8-b080-5181c6b0a9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:33.715994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:33.716698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:33.716986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:33.717262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:33.720773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:33.751912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:33.753421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:33.774557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e2eef378-29f4-48f8-b080-5181c6b0a9cb None None] MFA Rules not processed for user `edaa34227d894985aa2a8b20ae71a5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:33.777828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e2eef378-29f4-48f8-b080-5181c6b0a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:33.786264 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2461/4943] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:33.853177 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:33.947336 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2483/4944] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:04:34.593582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:34.595325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:34.775755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242aa2-60a5-4d04-8777-73980523cd47 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:34.795196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903370b3-08b1-42d8-bae2-c09b9e36ff5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:34.797195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903370b3-08b1-42d8-bae2-c09b9e36ff5c service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:34.797812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903370b3-08b1-42d8-bae2-c09b9e36ff5c service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:34.799315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903370b3-08b1-42d8-bae2-c09b9e36ff5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:34.981639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903370b3-08b1-42d8-bae2-c09b9e36ff5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:34.984607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903370b3-08b1-42d8-bae2-c09b9e36ff5c service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:35.002512 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2462/4945] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:35.628112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eef378-29f4-48f8-b080-5181c6b0a9cb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:35.629570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e2eef378-29f4-48f8-b080-5181c6b0a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:35.660364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eef378-29f4-48f8-b080-5181c6b0a9cb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:35.671290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:35.673609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:35.674232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:35.674931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:35.678520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:35.813805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:35.815414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:35.835484 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2484/4946] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:36.317620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fec1f-6be7-4b0c-b2f2-017739c58f02 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:36.318161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fec1f-6be7-4b0c-b2f2-017739c58f02 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:36.318500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fec1f-6be7-4b0c-b2f2-017739c58f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:36.366284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-014fec1f-6be7-4b0c-b2f2-017739c58f02 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:36.367539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-014fec1f-6be7-4b0c-b2f2-017739c58f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:36.552737 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2463/4947] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:04:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:36.565790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:36.567965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:36.802493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d24a9-204d-4978-82bd-ca067b21fc26 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:36.821480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a716-b1ed-4644-9f6d-696a2d340e75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:36.822118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a716-b1ed-4644-9f6d-696a2d340e75 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:36.822398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a716-b1ed-4644-9f6d-696a2d340e75 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:36.822924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a716-b1ed-4644-9f6d-696a2d340e75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:36.869107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a716-b1ed-4644-9f6d-696a2d340e75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:36.873459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a716-b1ed-4644-9f6d-696a2d340e75 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:36.892390 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2485/4948] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:04:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:04:45.698031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82da39-accb-48b0-ad3f-333fc0978584 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:45.698597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82da39-accb-48b0-ad3f-333fc0978584 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:45.698597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82da39-accb-48b0-ad3f-333fc0978584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:45.707381 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:45.758860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8a82da39-accb-48b0-ad3f-333fc0978584 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:45.760091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8a82da39-accb-48b0-ad3f-333fc0978584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:45.799114 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2464/4949] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:45.844420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a716-b1ed-4644-9f6d-696a2d340e75 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:45.893037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a716-b1ed-4644-9f6d-696a2d340e75 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:45.976190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d7318-62e0-4a9d-8bf2-395226f51ee2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:45.991938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d7318-62e0-4a9d-8bf2-395226f51ee2 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:45.992742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d7318-62e0-4a9d-8bf2-395226f51ee2 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:45.993256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d7318-62e0-4a9d-8bf2-395226f51ee2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:46.036909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d7318-62e0-4a9d-8bf2-395226f51ee2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:46.039132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d7318-62e0-4a9d-8bf2-395226f51ee2 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:46.061462 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2486/4950] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:04:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:04:47.017141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82da39-accb-48b0-ad3f-333fc0978584 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:47.018751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8a82da39-accb-48b0-ad3f-333fc0978584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:47.239507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82da39-accb-48b0-ad3f-333fc0978584 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:47.259887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:47.260963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:47.262023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:47.264435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] PATH_INFO: `/v3/users/f6f439f0db774d4c9691083e208cbaaa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:47.281257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f439f0db774d4c9691083e208cbaaa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:47.284561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:47.455143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f439f0db774d4c9691083e208cbaaa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:47.457633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7eac8-f614-494e-8d1a-79b5006475fc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:47.458129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7eac8-f614-494e-8d1a-79b5006475fc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:47.458589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7eac8-f614-494e-8d1a-79b5006475fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:47.476677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f439f0db774d4c9691083e208cbaaa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:47.508088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f439f0db774d4c9691083e208cbaaa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:47.513740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-eea7eac8-f614-494e-8d1a-79b5006475fc None None] MFA Rules not processed for user `1f062f2ecc0547ae960ed98e7aeef9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:47.518408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eea7eac8-f614-494e-8d1a-79b5006475fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:47.538944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f439f0db774d4c9691083e208cbaaa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:47.543569 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2487/4951] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:04:47.545164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4264e64e-3c76-4fb2-a7c6-332e055708d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f439f0db774d4c9691083e208cbaaa'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:47.569472 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2465/4952] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:04:47 2022] DELETE /identity/v3/users/f6f439f0db774d4c9691083e208cbaaa => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:04:47.970413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7eac8-f614-494e-8d1a-79b5006475fc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:47.993775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7eac8-f614-494e-8d1a-79b5006475fc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:48.120468 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:48.206968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:48.207559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:48.207842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:48.208134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] PATH_INFO: `/v3/projects/a42977a7c9aa4831a041b3f1472b52d0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:48.217274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42977a7c9aa4831a041b3f1472b52d0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:48.220762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:48.375903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42977a7c9aa4831a041b3f1472b52d0', 'request_id': 'req-2430c43e-1a22-49d7-8d99-cd47fce9b5df'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:48.391546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42977a7c9aa4831a041b3f1472b52d0', 'request_id': 'req-2430c43e-1a22-49d7-8d99-cd47fce9b5df'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:48.405775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42977a7c9aa4831a041b3f1472b52d0', 'request_id': 'req-2430c43e-1a22-49d7-8d99-cd47fce9b5df'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:48.436789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] The token cache is being invalidate because project a42977a7c9aa4831a041b3f1472b52d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:04:48.437129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:48.437807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2430c43e-1a22-49d7-8d99-cd47fce9b5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:04:48.447210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2488/4953] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:04:47 2022] DELETE /identity/v3/projects/a42977a7c9aa4831a041b3f1472b52d0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:04:48.449473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b5e0f-3acf-4c45-8fc4-4480709b2328 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:48.449919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b5e0f-3acf-4c45-8fc4-4480709b2328 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:48.450019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b5e0f-3acf-4c45-8fc4-4480709b2328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:48.502781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7b8b5e0f-3acf-4c45-8fc4-4480709b2328 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:48.503976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7b8b5e0f-3acf-4c45-8fc4-4480709b2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:48.693129 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2466/4954] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:04:48.705819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec1aec-db06-4acd-ab38-04d48d7f69ab None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:48.706345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec1aec-db06-4acd-ab38-04d48d7f69ab None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:48.706429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec1aec-db06-4acd-ab38-04d48d7f69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:48.760935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aaec1aec-db06-4acd-ab38-04d48d7f69ab None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:48.762998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aaec1aec-db06-4acd-ab38-04d48d7f69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:48.787384 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2489/4955] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:48.788654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b5e0f-3acf-4c45-8fc4-4480709b2328 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:48.826298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b5e0f-3acf-4c45-8fc4-4480709b2328 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:48.856116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7066f-429e-4aeb-b9cd-7c04c40e0de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:48.860243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7066f-429e-4aeb-b9cd-7c04c40e0de9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:48.860799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7066f-429e-4aeb-b9cd-7c04c40e0de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:48.861272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7066f-429e-4aeb-b9cd-7c04c40e0de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:48.862473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7066f-429e-4aeb-b9cd-7c04c40e0de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:04:48.862996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7066f-429e-4aeb-b9cd-7c04c40e0de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:48.876656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7066f-429e-4aeb-b9cd-7c04c40e0de9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:48.953549 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2467/4956] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:04:48.954493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec1aec-db06-4acd-ab38-04d48d7f69ab None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:48.979076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec1aec-db06-4acd-ab38-04d48d7f69ab None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:48.994894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d014f83-63f2-4152-bfe3-7351a3611372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:48.995526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d014f83-63f2-4152-bfe3-7351a3611372 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:48.996549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d014f83-63f2-4152-bfe3-7351a3611372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:48.996907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d014f83-63f2-4152-bfe3-7351a3611372 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:48.997642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d014f83-63f2-4152-bfe3-7351a3611372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:48.999693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d014f83-63f2-4152-bfe3-7351a3611372 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:49.097536 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2490/4957] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:04:48 2022] POST /identity/v3/projects => generated 399 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:04:49.110586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7066f-429e-4aeb-b9cd-7c04c40e0de9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:49.122574 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:49.139714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7066f-429e-4aeb-b9cd-7c04c40e0de9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:49.332449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6158c-76b8-4ba4-b868-95484ec0f0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:49.341616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6158c-76b8-4ba4-b868-95484ec0f0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:49.342358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6158c-76b8-4ba4-b868-95484ec0f0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:49.343109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6158c-76b8-4ba4-b868-95484ec0f0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:49.344486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6158c-76b8-4ba4-b868-95484ec0f0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:49.347193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6158c-76b8-4ba4-b868-95484ec0f0d0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:49.408321 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2468/4958] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:04:49 2022] POST /identity/v3/users => generated 300 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:04:49.408831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d014f83-63f2-4152-bfe3-7351a3611372 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:49.425690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d014f83-63f2-4152-bfe3-7351a3611372 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:49.431809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe48e4b-e4a4-49dd-810d-d306888f6be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:49.432747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe48e4b-e4a4-49dd-810d-d306888f6be2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:49.433850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe48e4b-e4a4-49dd-810d-d306888f6be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:49.434347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe48e4b-e4a4-49dd-810d-d306888f6be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:49.435293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe48e4b-e4a4-49dd-810d-d306888f6be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:49.437355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe48e4b-e4a4-49dd-810d-d306888f6be2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:49.485727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6158c-76b8-4ba4-b868-95484ec0f0d0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:49.486407 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2491/4959] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:04:49.505114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6158c-76b8-4ba4-b868-95484ec0f0d0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:49.525807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c89e-4555-4803-926a-7119c67753e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:49.529665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c89e-4555-4803-926a-7119c67753e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:49.530770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c89e-4555-4803-926a-7119c67753e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:49.531868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c89e-4555-4803-926a-7119c67753e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:49.532969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c89e-4555-4803-926a-7119c67753e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:49.536091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c89e-4555-4803-926a-7119c67753e4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:49.566105 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2469/4960] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:04:49.570466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe48e4b-e4a4-49dd-810d-d306888f6be2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:49.588555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe48e4b-e4a4-49dd-810d-d306888f6be2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:49.604557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dd7cd-f5ec-4f23-b53d-12ea275936ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:49.609090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dd7cd-f5ec-4f23-b53d-12ea275936ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:49.609591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dd7cd-f5ec-4f23-b53d-12ea275936ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:49.610352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dd7cd-f5ec-4f23-b53d-12ea275936ef admin admin] PATH_INFO: `/v3/projects/88b704bc24504b6baecfe8bcf1ca9b39/users/35a7ced563ae4a2da6fb2c7b317e336e/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:49.685223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dd7cd-f5ec-4f23-b53d-12ea275936ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b704bc24504b6baecfe8bcf1ca9b39, user_id=35a7ced563ae4a2da6fb2c7b317e336e, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:49.688603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dd7cd-f5ec-4f23-b53d-12ea275936ef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:49.747342 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2492/4961] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:04:49 2022] PUT /identity/v3/projects/88b704bc24504b6baecfe8bcf1ca9b39/users/35a7ced563ae4a2da6fb2c7b317e336e/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:04:49.752706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b26632-c27a-45f2-a184-6f38a264b14f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:49.753207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b26632-c27a-45f2-a184-6f38a264b14f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:49.754501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b26632-c27a-45f2-a184-6f38a264b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:49.801520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f0b26632-c27a-45f2-a184-6f38a264b14f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:04:49.804587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f0b26632-c27a-45f2-a184-6f38a264b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:50.064185 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2470/4962] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:04:50.162347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dd7cd-f5ec-4f23-b53d-12ea275936ef admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:50.164356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-717dd7cd-f5ec-4f23-b53d-12ea275936ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:50.393786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dd7cd-f5ec-4f23-b53d-12ea275936ef admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:50.401127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eb1a1-2347-4046-aa48-9f828f6e2290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:50.401763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eb1a1-2347-4046-aa48-9f828f6e2290 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:50.402197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eb1a1-2347-4046-aa48-9f828f6e2290 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:50.402477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eb1a1-2347-4046-aa48-9f828f6e2290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:50.425760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eb1a1-2347-4046-aa48-9f828f6e2290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:50.427207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eb1a1-2347-4046-aa48-9f828f6e2290 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:50.466887 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2493/4963] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:04:50.934760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b26632-c27a-45f2-a184-6f38a264b14f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:04:50.936221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f0b26632-c27a-45f2-a184-6f38a264b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:51.147738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b26632-c27a-45f2-a184-6f38a264b14f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:04:51.176857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:04:51.177506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:04:51.177788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:04:51.178062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:04:51.194452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:04:51.249487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:04:51.254012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:04:51.288375 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2471/4964] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:04:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:00.464902 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:01.275263 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:01.815901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eb1a1-2347-4046-aa48-9f828f6e2290 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:01.817401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9c0eb1a1-2347-4046-aa48-9f828f6e2290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:02.144458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eb1a1-2347-4046-aa48-9f828f6e2290 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:02.156778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d87585-5155-4cba-a5ae-a45233ea3acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:02.158555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d87585-5155-4cba-a5ae-a45233ea3acd service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:02.159113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d87585-5155-4cba-a5ae-a45233ea3acd service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:02.160020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d87585-5155-4cba-a5ae-a45233ea3acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:02.162729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b0d87585-5155-4cba-a5ae-a45233ea3acd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:02.186796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d87585-5155-4cba-a5ae-a45233ea3acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:02.189735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d87585-5155-4cba-a5ae-a45233ea3acd service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:02.231959 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2494/4965] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:06.241522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:06.243849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:06.277502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d895b-3fbd-41a1-8872-5eac718f2b35 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:06.299977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:06.301233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:06.301807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:06.302440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] PATH_INFO: `/v3/users/33d4dcd4a8b64783a1dc7c200f101034` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:06.335270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d4dcd4a8b64783a1dc7c200f101034)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:06.340867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:06.538123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d4dcd4a8b64783a1dc7c200f101034'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:06.629239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d4dcd4a8b64783a1dc7c200f101034'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:06.647460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d4dcd4a8b64783a1dc7c200f101034'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:06.678262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d4dcd4a8b64783a1dc7c200f101034'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:06.679177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d4dcd4a8b64783a1dc7c200f101034'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:06.692935 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2472/4966] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:05:06 2022] DELETE /identity/v3/users/33d4dcd4a8b64783a1dc7c200f101034 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:06.699405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec2462-bc77-441c-b1d1-cbdb67d02177 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:06.700027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec2462-bc77-441c-b1d1-cbdb67d02177 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:06.700027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec2462-bc77-441c-b1d1-cbdb67d02177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:06.788003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f1ec2462-bc77-441c-b1d1-cbdb67d02177 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:06.790208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1ec2462-bc77-441c-b1d1-cbdb67d02177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:07.020182 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2495/4967] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:07.055053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:07.056984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:07.256350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404481b-bfce-4401-9083-6fb10727a09a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:07.277571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370774c7-ff9a-4432-be53-bf0b6b1be505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:07.278482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370774c7-ff9a-4432-be53-bf0b6b1be505 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:07.282175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370774c7-ff9a-4432-be53-bf0b6b1be505 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:07.283843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370774c7-ff9a-4432-be53-bf0b6b1be505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:07.331158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370774c7-ff9a-4432-be53-bf0b6b1be505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:07.332909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370774c7-ff9a-4432-be53-bf0b6b1be505 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:07.373650 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2473/4968] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:07.480776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177cfd0-a0af-4bc2-8917-bef69f38ec87 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:07.481065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177cfd0-a0af-4bc2-8917-bef69f38ec87 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:07.481336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177cfd0-a0af-4bc2-8917-bef69f38ec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:07.541718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0177cfd0-a0af-4bc2-8917-bef69f38ec87 None None] MFA Rules not processed for user `35a7ced563ae4a2da6fb2c7b317e336e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:07.550872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0177cfd0-a0af-4bc2-8917-bef69f38ec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:07.751552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60362-f08f-4a20-b5e8-62afe4fe45cf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:07.752343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60362-f08f-4a20-b5e8-62afe4fe45cf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:07.752964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60362-f08f-4a20-b5e8-62afe4fe45cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:07.753406 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2496/4969] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:07.848436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-eed60362-f08f-4a20-b5e8-62afe4fe45cf None None] MFA Rules not processed for user `35a7ced563ae4a2da6fb2c7b317e336e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:07.850342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eed60362-f08f-4a20-b5e8-62afe4fe45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:07.870973 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2474/4970] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:05:07.954687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177cfd0-a0af-4bc2-8917-bef69f38ec87 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:07.956475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0177cfd0-a0af-4bc2-8917-bef69f38ec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:08.013337 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:08.185842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177cfd0-a0af-4bc2-8917-bef69f38ec87 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:08.198952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c919f5-c95e-4743-94bc-735ded09bf69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:08.199642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c919f5-c95e-4743-94bc-735ded09bf69 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:08.199895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c919f5-c95e-4743-94bc-735ded09bf69 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:08.200174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c919f5-c95e-4743-94bc-735ded09bf69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:08.253989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c919f5-c95e-4743-94bc-735ded09bf69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:08.255196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c919f5-c95e-4743-94bc-735ded09bf69 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:08.280700 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2497/4971] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:10.266255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed60362-f08f-4a20-b5e8-62afe4fe45cf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:10.267693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eed60362-f08f-4a20-b5e8-62afe4fe45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:10.300134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed60362-f08f-4a20-b5e8-62afe4fe45cf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:10.317810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:10.322892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:10.327821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:10.328361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] PATH_INFO: `/v3/projects/5a6ab3aa4cbc483cbd0063df6c5730c5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:10.332986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6ab3aa4cbc483cbd0063df6c5730c5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:10.347240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:10.496514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6ab3aa4cbc483cbd0063df6c5730c5', 'request_id': 'req-cf4bd9f6-16b5-462b-b7d5-0993c5994941'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:10.519213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6ab3aa4cbc483cbd0063df6c5730c5', 'request_id': 'req-cf4bd9f6-16b5-462b-b7d5-0993c5994941'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:10.525481 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:10.527750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6ab3aa4cbc483cbd0063df6c5730c5', 'request_id': 'req-cf4bd9f6-16b5-462b-b7d5-0993c5994941'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:10.564037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] The token cache is being invalidate because project 5a6ab3aa4cbc483cbd0063df6c5730c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:05:10.564445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:10.565514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:10.569974 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2475/4972] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:10 2022] DELETE /identity/v3/projects/5a6ab3aa4cbc483cbd0063df6c5730c5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:10.571244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c919f5-c95e-4743-94bc-735ded09bf69 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:10.608475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c919f5-c95e-4743-94bc-735ded09bf69 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:10.872918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:10.876305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:10.878145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:10.878447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] PATH_INFO: `/v3/users/bf52f403d1564e5ca8271cceb62ca632` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:10.881242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf52f403d1564e5ca8271cceb62ca632)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:10.897279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:11.132335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf52f403d1564e5ca8271cceb62ca632'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:11.212016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf52f403d1564e5ca8271cceb62ca632'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:11.265935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf52f403d1564e5ca8271cceb62ca632'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:11.296365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf52f403d1564e5ca8271cceb62ca632'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:11.297286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5bf3b061-346c-4281-aa46-a344a829dc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf52f403d1564e5ca8271cceb62ca632'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:11.320370 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2498/4973] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:05:10 2022] DELETE /identity/v3/users/bf52f403d1564e5ca8271cceb62ca632 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:12.369704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:12.371605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:12.402903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bd9f6-16b5-462b-b7d5-0993c5994941 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:12.746267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:12.747289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:12.747910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:12.748364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] PATH_INFO: `/v3/projects/91c7333826e240f3aaedb062869f7236` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:12.751304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c7333826e240f3aaedb062869f7236)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:12.776758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:12.889054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c7333826e240f3aaedb062869f7236', 'request_id': 'req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:12.905143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c7333826e240f3aaedb062869f7236', 'request_id': 'req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:12.915085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c7333826e240f3aaedb062869f7236', 'request_id': 'req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:12.949857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] The token cache is being invalidate because project 91c7333826e240f3aaedb062869f7236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:05:12.950244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:12.952424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb2fa6b1-1f94-4a31-bc4c-4830fb1d5be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:12.956145 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2476/4974] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:12 2022] DELETE /identity/v3/projects/91c7333826e240f3aaedb062869f7236 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:12.960909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab1479-5bf4-4673-b625-ccc007236c1f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:12.961430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab1479-5bf4-4673-b625-ccc007236c1f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:12.961529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab1479-5bf4-4673-b625-ccc007236c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:12.993538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-51ab1479-5bf4-4673-b625-ccc007236c1f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:12.996006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-51ab1479-5bf4-4673-b625-ccc007236c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:13.018254 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:13.143994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2499/4975] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:13.152089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63346-71ac-4308-9af3-0f1bad384faf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:13.152374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63346-71ac-4308-9af3-0f1bad384faf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:13.156827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63346-71ac-4308-9af3-0f1bad384faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:13.188402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-09d63346-71ac-4308-9af3-0f1bad384faf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:13.189708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09d63346-71ac-4308-9af3-0f1bad384faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:13.206480 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2477/4976] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:13.210466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab1479-5bf4-4673-b625-ccc007236c1f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:13.228072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab1479-5bf4-4673-b625-ccc007236c1f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:13.253681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadffe2d-aa77-47f5-bbe1-1170e975ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:13.271572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadffe2d-aa77-47f5-bbe1-1170e975ed5b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:13.272109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadffe2d-aa77-47f5-bbe1-1170e975ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:13.273988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadffe2d-aa77-47f5-bbe1-1170e975ed5b admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:13.275574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadffe2d-aa77-47f5-bbe1-1170e975ed5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:05:13.276983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadffe2d-aa77-47f5-bbe1-1170e975ed5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:13.282028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadffe2d-aa77-47f5-bbe1-1170e975ed5b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:13.318074 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2500/4977] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:05:13.319402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63346-71ac-4308-9af3-0f1bad384faf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:13.332132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63346-71ac-4308-9af3-0f1bad384faf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:13.358722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a52223-0c64-464a-8981-6af760d89ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:13.359853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a52223-0c64-464a-8981-6af760d89ada admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:13.360377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a52223-0c64-464a-8981-6af760d89ada admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:13.360706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a52223-0c64-464a-8981-6af760d89ada admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:13.361356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a52223-0c64-464a-8981-6af760d89ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:13.363305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a52223-0c64-464a-8981-6af760d89ada admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:13.429215 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2478/4978] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:05:13 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:05:13.433965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadffe2d-aa77-47f5-bbe1-1170e975ed5b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:13.461007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadffe2d-aa77-47f5-bbe1-1170e975ed5b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:13.593371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b247a7a-6545-4c50-bad0-991f438fff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:13.594847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b247a7a-6545-4c50-bad0-991f438fff9c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:13.595133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b247a7a-6545-4c50-bad0-991f438fff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:13.595411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b247a7a-6545-4c50-bad0-991f438fff9c admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:13.596116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b247a7a-6545-4c50-bad0-991f438fff9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:13.598188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b247a7a-6545-4c50-bad0-991f438fff9c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:13.698410 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2501/4979] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:05:13 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:05:13.701026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a52223-0c64-464a-8981-6af760d89ada admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:13.713534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a52223-0c64-464a-8981-6af760d89ada admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:13.728009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b8d6e-805f-4949-bb51-90a2db009fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:13.730528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b8d6e-805f-4949-bb51-90a2db009fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:13.731565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b8d6e-805f-4949-bb51-90a2db009fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:13.731923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b8d6e-805f-4949-bb51-90a2db009fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:13.732672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b8d6e-805f-4949-bb51-90a2db009fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:13.735810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b8d6e-805f-4949-bb51-90a2db009fa5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:13.773088 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2479/4980] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:05:13.773905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b247a7a-6545-4c50-bad0-991f438fff9c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:13.806992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b247a7a-6545-4c50-bad0-991f438fff9c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:13.828035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25988c5-0d13-4dea-833e-0b26eeb5f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:13.829655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25988c5-0d13-4dea-833e-0b26eeb5f54b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:13.832019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25988c5-0d13-4dea-833e-0b26eeb5f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:13.832566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25988c5-0d13-4dea-833e-0b26eeb5f54b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:13.833892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25988c5-0d13-4dea-833e-0b26eeb5f54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:13.837660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25988c5-0d13-4dea-833e-0b26eeb5f54b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:13.863495 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2502/4981] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:05:13.865204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b8d6e-805f-4949-bb51-90a2db009fa5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:13.888967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b8d6e-805f-4949-bb51-90a2db009fa5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:13.912883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25988c5-0d13-4dea-833e-0b26eeb5f54b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:13.924971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a25988c5-0d13-4dea-833e-0b26eeb5f54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:13.966639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7779e78-6201-401e-b4e8-9a20083cda60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:13.974114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7779e78-6201-401e-b4e8-9a20083cda60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:13.981920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7779e78-6201-401e-b4e8-9a20083cda60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:13.982325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7779e78-6201-401e-b4e8-9a20083cda60 admin admin] PATH_INFO: `/v3/projects/e8ea683e30244f6eaf4cede5382e100e/users/6659748aa96a4904a741871a8a6ab47b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:14.081305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7779e78-6201-401e-b4e8-9a20083cda60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ea683e30244f6eaf4cede5382e100e, user_id=6659748aa96a4904a741871a8a6ab47b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:14.098112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7779e78-6201-401e-b4e8-9a20083cda60 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:14.181832 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2480/4982] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:05:13 2022] PUT /identity/v3/projects/e8ea683e30244f6eaf4cede5382e100e/users/6659748aa96a4904a741871a8a6ab47b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:14.186985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f2c9-cb98-434e-a836-3e301f774fac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:14.188907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f2c9-cb98-434e-a836-3e301f774fac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:14.189301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f2c9-cb98-434e-a836-3e301f774fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:14.352319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9b56f2c9-cb98-434e-a836-3e301f774fac None None] MFA Rules not processed for user `6659748aa96a4904a741871a8a6ab47b`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:14.360361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9b56f2c9-cb98-434e-a836-3e301f774fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:14.382502 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:14.421833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25988c5-0d13-4dea-833e-0b26eeb5f54b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:14.498464 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:14.571278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1356a-9425-472c-8f7e-579c2e87230e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:14.574261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1356a-9425-472c-8f7e-579c2e87230e service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:14.574675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1356a-9425-472c-8f7e-579c2e87230e service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:14.575068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1356a-9425-472c-8f7e-579c2e87230e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:14.581884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-87f1356a-9425-472c-8f7e-579c2e87230e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:14.592468 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2481/4983] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:14.608505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56f2c9-cb98-434e-a836-3e301f774fac None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:14.609955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9b56f2c9-cb98-434e-a836-3e301f774fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:14.621320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1356a-9425-472c-8f7e-579c2e87230e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:14.623116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1356a-9425-472c-8f7e-579c2e87230e service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:14.646088 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2503/4984] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:14.849830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56f2c9-cb98-434e-a836-3e301f774fac None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:14.875386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a851c-57b6-4207-8468-e4888ca1cd59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:14.878992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a851c-57b6-4207-8468-e4888ca1cd59 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:14.879302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a851c-57b6-4207-8468-e4888ca1cd59 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:14.879579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a851c-57b6-4207-8468-e4888ca1cd59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:14.904439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a851c-57b6-4207-8468-e4888ca1cd59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:14.910755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a851c-57b6-4207-8468-e4888ca1cd59 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:14.988729 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2482/4985] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:05:15.028844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1356a-9425-472c-8f7e-579c2e87230e service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:15.292145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1356a-9425-472c-8f7e-579c2e87230e service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:15.313151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:15.315234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:15.315564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:15.315791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] PATH_INFO: `/v3/users/6659748aa96a4904a741871a8a6ab47b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:15.319289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6659748aa96a4904a741871a8a6ab47b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:15.322631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:15.469523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6659748aa96a4904a741871a8a6ab47b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:15.515227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6659748aa96a4904a741871a8a6ab47b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:15.532698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6659748aa96a4904a741871a8a6ab47b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:15.555724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6659748aa96a4904a741871a8a6ab47b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:15.557764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6659748aa96a4904a741871a8a6ab47b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:15.575418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2504/4986] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:05:15 2022] DELETE /identity/v3/users/6659748aa96a4904a741871a8a6ab47b => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:15.581145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3524e3-7f1e-421d-9880-9933ce45a650 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:15.581782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3524e3-7f1e-421d-9880-9933ce45a650 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:15.582285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3524e3-7f1e-421d-9880-9933ce45a650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:15.646497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3d3524e3-7f1e-421d-9880-9933ce45a650 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:15.649138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3d3524e3-7f1e-421d-9880-9933ce45a650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:15.832704 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2483/4987] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:15.843403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:15.844987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:15.914263 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:15.996891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7058c-8bc1-4780-ac04-b38370bec928 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:16.020798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0f259-1f6b-4d31-a534-a4723bb886cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:16.021540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f259-1f6b-4d31-a534-a4723bb886cd service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:16.021706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f259-1f6b-4d31-a534-a4723bb886cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:16.021986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f259-1f6b-4d31-a534-a4723bb886cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:16.048773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0f259-1f6b-4d31-a534-a4723bb886cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:16.050226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0f259-1f6b-4d31-a534-a4723bb886cd service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:16.076984 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2505/4988] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:17.454822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3524e3-7f1e-421d-9880-9933ce45a650 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:17.456582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3d3524e3-7f1e-421d-9880-9933ce45a650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:17.513179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3524e3-7f1e-421d-9880-9933ce45a650 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:17.523396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346ef3-a259-4424-a518-0c4bba1cc126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:17.524037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346ef3-a259-4424-a518-0c4bba1cc126 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:17.524316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346ef3-a259-4424-a518-0c4bba1cc126 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:17.524590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346ef3-a259-4424-a518-0c4bba1cc126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:17.533253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-53346ef3-a259-4424-a518-0c4bba1cc126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:17.567987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346ef3-a259-4424-a518-0c4bba1cc126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:17.569885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346ef3-a259-4424-a518-0c4bba1cc126 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:17.592464 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2484/4989] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:17.687187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0f259-1f6b-4d31-a534-a4723bb886cd service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:17.689397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-73f0f259-1f6b-4d31-a534-a4723bb886cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:17.715783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0f259-1f6b-4d31-a534-a4723bb886cd service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:17.737590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:17.740151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:17.740680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:17.741164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] PATH_INFO: `/v3/projects/e8ea683e30244f6eaf4cede5382e100e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:17.748593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ea683e30244f6eaf4cede5382e100e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:17.750695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:17.929541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ea683e30244f6eaf4cede5382e100e', 'request_id': 'req-5ac95900-adc5-401b-a0d4-c13a752cb010'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:17.946092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ea683e30244f6eaf4cede5382e100e', 'request_id': 'req-5ac95900-adc5-401b-a0d4-c13a752cb010'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:17.969164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ea683e30244f6eaf4cede5382e100e', 'request_id': 'req-5ac95900-adc5-401b-a0d4-c13a752cb010'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:17.988513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] The token cache is being invalidate because project e8ea683e30244f6eaf4cede5382e100e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:05:17.988903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:18.001245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac95900-adc5-401b-a0d4-c13a752cb010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:18.003920 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2506/4990] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:17 2022] DELETE /identity/v3/projects/e8ea683e30244f6eaf4cede5382e100e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:18.008490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3271f-9981-4e5d-9b2a-9ee70b34e4c2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:18.009212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3271f-9981-4e5d-9b2a-9ee70b34e4c2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:18.010002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3271f-9981-4e5d-9b2a-9ee70b34e4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:18.044065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6aa3271f-9981-4e5d-9b2a-9ee70b34e4c2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:18.046690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6aa3271f-9981-4e5d-9b2a-9ee70b34e4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:18.122820 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:18.219865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2485/4991] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:18.220871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a933b-1306-4c83-9102-333f185d7c1b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:18.221221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a933b-1306-4c83-9102-333f185d7c1b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:18.221456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a933b-1306-4c83-9102-333f185d7c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:18.303146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-274a933b-1306-4c83-9102-333f185d7c1b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:18.306012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-274a933b-1306-4c83-9102-333f185d7c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:18.340973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3271f-9981-4e5d-9b2a-9ee70b34e4c2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:18.348594 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2507/4992] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:18.361606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3271f-9981-4e5d-9b2a-9ee70b34e4c2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:18.371202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd1e4-6ab0-43ed-8aa8-e6ee88ae4e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:18.372080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd1e4-6ab0-43ed-8aa8-e6ee88ae4e6d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:18.376320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd1e4-6ab0-43ed-8aa8-e6ee88ae4e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:18.376812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fd1e4-6ab0-43ed-8aa8-e6ee88ae4e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:18.378336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fd1e4-6ab0-43ed-8aa8-e6ee88ae4e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:05:18.378875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fd1e4-6ab0-43ed-8aa8-e6ee88ae4e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:18.381039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fd1e4-6ab0-43ed-8aa8-e6ee88ae4e6d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:18.404037 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2486/4993] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:05:18.407076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a933b-1306-4c83-9102-333f185d7c1b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:18.422371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a933b-1306-4c83-9102-333f185d7c1b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:18.450390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482ba95-f18d-4cd1-bff9-ad5c672e6df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:18.451395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482ba95-f18d-4cd1-bff9-ad5c672e6df4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:18.451917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482ba95-f18d-4cd1-bff9-ad5c672e6df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:18.452417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482ba95-f18d-4cd1-bff9-ad5c672e6df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:18.453320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482ba95-f18d-4cd1-bff9-ad5c672e6df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:18.464918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482ba95-f18d-4cd1-bff9-ad5c672e6df4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:18.599329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2508/4994] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:05:18 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:05:18.607995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd1e4-6ab0-43ed-8aa8-e6ee88ae4e6d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:18.647448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fd1e4-6ab0-43ed-8aa8-e6ee88ae4e6d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:18.828914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a40b70-bb4f-45af-a6c2-89423a6c2440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:18.829755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a40b70-bb4f-45af-a6c2-89423a6c2440 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:18.830193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a40b70-bb4f-45af-a6c2-89423a6c2440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:18.830634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a40b70-bb4f-45af-a6c2-89423a6c2440 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:18.831424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a40b70-bb4f-45af-a6c2-89423a6c2440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:18.833582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a40b70-bb4f-45af-a6c2-89423a6c2440 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:18.891000 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2487/4995] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:05:18 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:05:18.892118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482ba95-f18d-4cd1-bff9-ad5c672e6df4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:18.905422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482ba95-f18d-4cd1-bff9-ad5c672e6df4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:18.929609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193706-63e2-47bd-9264-fb8fdbabb89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:18.930471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193706-63e2-47bd-9264-fb8fdbabb89c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:18.930938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193706-63e2-47bd-9264-fb8fdbabb89c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:18.931455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193706-63e2-47bd-9264-fb8fdbabb89c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:18.933559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d193706-63e2-47bd-9264-fb8fdbabb89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:18.935564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d193706-63e2-47bd-9264-fb8fdbabb89c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:18.954527 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2509/4996] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:05:18.956869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a40b70-bb4f-45af-a6c2-89423a6c2440 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:18.970135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a40b70-bb4f-45af-a6c2-89423a6c2440 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:18.985732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd9a16-2ec6-4927-9614-71a69eea90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:18.986368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9a16-2ec6-4927-9614-71a69eea90d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:18.986651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9a16-2ec6-4927-9614-71a69eea90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:18.986926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9a16-2ec6-4927-9614-71a69eea90d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:18.987584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd9a16-2ec6-4927-9614-71a69eea90d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:18.999982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd9a16-2ec6-4927-9614-71a69eea90d2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:19.035329 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2488/4997] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:05:19.039207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193706-63e2-47bd-9264-fb8fdbabb89c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:19.061335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193706-63e2-47bd-9264-fb8fdbabb89c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:19.078621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9c923-d26c-41c8-a4e3-638c5980d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:19.079387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9c923-d26c-41c8-a4e3-638c5980d300 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:19.079737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9c923-d26c-41c8-a4e3-638c5980d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:19.080687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9c923-d26c-41c8-a4e3-638c5980d300 admin admin] PATH_INFO: `/v3/projects/bba1f6d6b168482ca3b36bc4f6b2f11e/users/155ceced7f634bb88cb07eb0e9b62241/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:19.142499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9c923-d26c-41c8-a4e3-638c5980d300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba1f6d6b168482ca3b36bc4f6b2f11e, user_id=155ceced7f634bb88cb07eb0e9b62241, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:19.145430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9c923-d26c-41c8-a4e3-638c5980d300 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:19.179912 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2510/4998] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:05:19 2022] PUT /identity/v3/projects/bba1f6d6b168482ca3b36bc4f6b2f11e/users/155ceced7f634bb88cb07eb0e9b62241/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:19.190276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147cff9-5210-431f-80cf-382db693ed1b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:19.191026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147cff9-5210-431f-80cf-382db693ed1b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:19.191506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147cff9-5210-431f-80cf-382db693ed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:19.246793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4147cff9-5210-431f-80cf-382db693ed1b None None] MFA Rules not processed for user `155ceced7f634bb88cb07eb0e9b62241`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:19.249713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4147cff9-5210-431f-80cf-382db693ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:19.431480 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2489/4999] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:19.571254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9c923-d26c-41c8-a4e3-638c5980d300 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:19.575454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-80c9c923-d26c-41c8-a4e3-638c5980d300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:19.754735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9c923-d26c-41c8-a4e3-638c5980d300 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:19.769014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ffc10-af1e-46ad-9ba1-2eef2a1f2920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:19.770872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ffc10-af1e-46ad-9ba1-2eef2a1f2920 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:19.772138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ffc10-af1e-46ad-9ba1-2eef2a1f2920 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:19.773160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ffc10-af1e-46ad-9ba1-2eef2a1f2920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:19.790170 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:19.803933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ffc10-af1e-46ad-9ba1-2eef2a1f2920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:19.809352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ffc10-af1e-46ad-9ba1-2eef2a1f2920 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:19.837012 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2511/5000] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:29.416597 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:29.825661 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:33.863405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147cff9-5210-431f-80cf-382db693ed1b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:33.864991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4147cff9-5210-431f-80cf-382db693ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:34.030027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147cff9-5210-431f-80cf-382db693ed1b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:34.040140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db655d71-1785-4d31-a7a9-2d86bafddace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:34.041384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db655d71-1785-4d31-a7a9-2d86bafddace service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:34.041698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db655d71-1785-4d31-a7a9-2d86bafddace service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:34.041962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db655d71-1785-4d31-a7a9-2d86bafddace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:34.053421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-db655d71-1785-4d31-a7a9-2d86bafddace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:34.264103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db655d71-1785-4d31-a7a9-2d86bafddace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:34.266769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db655d71-1785-4d31-a7a9-2d86bafddace service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:34.307323 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2490/5001] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:39.590210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ffc10-af1e-46ad-9ba1-2eef2a1f2920 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:39.617902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ffc10-af1e-46ad-9ba1-2eef2a1f2920 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:39.632612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:39.640026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:39.640635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:39.641092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] PATH_INFO: `/v3/users/155ceced7f634bb88cb07eb0e9b62241` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:39.643916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155ceced7f634bb88cb07eb0e9b62241)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:39.646300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:39.756614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155ceced7f634bb88cb07eb0e9b62241'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:39.781675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155ceced7f634bb88cb07eb0e9b62241'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:39.797826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155ceced7f634bb88cb07eb0e9b62241'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:39.808933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155ceced7f634bb88cb07eb0e9b62241'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:39.809698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155ceced7f634bb88cb07eb0e9b62241'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:39.823314 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2512/5002] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:05:39 2022] DELETE /identity/v3/users/155ceced7f634bb88cb07eb0e9b62241 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:39.827994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcba7a0-be11-4a36-bc29-249dfd8fa7e7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:39.828462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcba7a0-be11-4a36-bc29-249dfd8fa7e7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:39.828650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcba7a0-be11-4a36-bc29-249dfd8fa7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:39.870077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2dcba7a0-be11-4a36-bc29-249dfd8fa7e7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:39.871956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2dcba7a0-be11-4a36-bc29-249dfd8fa7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:40.037995 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2491/5003] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:40.099821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:40.101324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:40.303186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f4e71-11e9-4a55-b39c-1311ecf67f72 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:40.328895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78899632-cf0d-4ef4-ac91-1cb18ea179ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:40.333069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78899632-cf0d-4ef4-ac91-1cb18ea179ef service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:40.333353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78899632-cf0d-4ef4-ac91-1cb18ea179ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:40.333637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78899632-cf0d-4ef4-ac91-1cb18ea179ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:40.380022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78899632-cf0d-4ef4-ac91-1cb18ea179ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:40.381850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78899632-cf0d-4ef4-ac91-1cb18ea179ef service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:40.399124 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2513/5004] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:42.577885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcba7a0-be11-4a36-bc29-249dfd8fa7e7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:42.580280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2dcba7a0-be11-4a36-bc29-249dfd8fa7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:42.602658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcba7a0-be11-4a36-bc29-249dfd8fa7e7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:42.617417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:42.621567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:42.623336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:42.623778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] PATH_INFO: `/v3/projects/bba1f6d6b168482ca3b36bc4f6b2f11e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:42.628081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba1f6d6b168482ca3b36bc4f6b2f11e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:42.632341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:42.815014 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:42.829294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba1f6d6b168482ca3b36bc4f6b2f11e', 'request_id': 'req-3cd5d38b-484b-488d-a13c-60b4e883c19f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:42.847612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba1f6d6b168482ca3b36bc4f6b2f11e', 'request_id': 'req-3cd5d38b-484b-488d-a13c-60b4e883c19f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:42.860812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba1f6d6b168482ca3b36bc4f6b2f11e', 'request_id': 'req-3cd5d38b-484b-488d-a13c-60b4e883c19f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:42.903747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] The token cache is being invalidate because project bba1f6d6b168482ca3b36bc4f6b2f11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:05:42.904392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:42.905462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cd5d38b-484b-488d-a13c-60b4e883c19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:42.910699 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2492/5005] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:42 2022] DELETE /identity/v3/projects/bba1f6d6b168482ca3b36bc4f6b2f11e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:42.916055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73b961-5d34-4fe5-b1d3-f32ec1163faa None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:42.917224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73b961-5d34-4fe5-b1d3-f32ec1163faa None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:42.917815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73b961-5d34-4fe5-b1d3-f32ec1163faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:42.958598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ea73b961-5d34-4fe5-b1d3-f32ec1163faa None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:42.961713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea73b961-5d34-4fe5-b1d3-f32ec1163faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:43.098574 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2514/5006] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:43.106401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff940d-e241-461f-9829-436621822088 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:43.109427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff940d-e241-461f-9829-436621822088 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:43.109874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff940d-e241-461f-9829-436621822088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:43.153506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d3ff940d-e241-461f-9829-436621822088 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:43.154894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d3ff940d-e241-461f-9829-436621822088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:43.178999 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2493/5007] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:43.180383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73b961-5d34-4fe5-b1d3-f32ec1163faa None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:43.195803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73b961-5d34-4fe5-b1d3-f32ec1163faa None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:43.209340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db77d7-9678-49a2-b656-3e6be9a28480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:43.211831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db77d7-9678-49a2-b656-3e6be9a28480 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:43.217049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db77d7-9678-49a2-b656-3e6be9a28480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:43.217503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db77d7-9678-49a2-b656-3e6be9a28480 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:43.221993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db77d7-9678-49a2-b656-3e6be9a28480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:05:43.222581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db77d7-9678-49a2-b656-3e6be9a28480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:43.228316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db77d7-9678-49a2-b656-3e6be9a28480 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:43.250973 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2515/5008] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:05:43.255945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff940d-e241-461f-9829-436621822088 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:43.272399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff940d-e241-461f-9829-436621822088 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:43.284952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2868-599b-4cd1-aae9-b149399dc7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:43.285882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2868-599b-4cd1-aae9-b149399dc7db admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:43.286307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2868-599b-4cd1-aae9-b149399dc7db admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:43.286708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2868-599b-4cd1-aae9-b149399dc7db admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:43.287477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b2868-599b-4cd1-aae9-b149399dc7db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:43.289621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b2868-599b-4cd1-aae9-b149399dc7db admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:43.356894 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2494/5009] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:05:43 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:05:43.358247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db77d7-9678-49a2-b656-3e6be9a28480 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:43.364964 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:43.376201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db77d7-9678-49a2-b656-3e6be9a28480 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:43.540687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b899e9-de0d-46eb-896f-9e97ac676608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:43.541682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b899e9-de0d-46eb-896f-9e97ac676608 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:43.541966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b899e9-de0d-46eb-896f-9e97ac676608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:43.542243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b899e9-de0d-46eb-896f-9e97ac676608 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:43.542895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b899e9-de0d-46eb-896f-9e97ac676608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:43.544864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b899e9-de0d-46eb-896f-9e97ac676608 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:43.599180 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2516/5010] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:05:43 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:05:43.603169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2868-599b-4cd1-aae9-b149399dc7db admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:43.619874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2868-599b-4cd1-aae9-b149399dc7db admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:43.632186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052d06e-f738-496f-8815-3992e7a99a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:43.633370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052d06e-f738-496f-8815-3992e7a99a52 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:43.633855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052d06e-f738-496f-8815-3992e7a99a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:43.635057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052d06e-f738-496f-8815-3992e7a99a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:43.636003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052d06e-f738-496f-8815-3992e7a99a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:43.638316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052d06e-f738-496f-8815-3992e7a99a52 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:43.675724 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2495/5011] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:05:43.677696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b899e9-de0d-46eb-896f-9e97ac676608 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:43.697475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b899e9-de0d-46eb-896f-9e97ac676608 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:43.709229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3c427-88f7-49b6-a5f7-1abe15d57ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:43.709861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3c427-88f7-49b6-a5f7-1abe15d57ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:43.710147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3c427-88f7-49b6-a5f7-1abe15d57ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:43.710420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3c427-88f7-49b6-a5f7-1abe15d57ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:43.711061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3c427-88f7-49b6-a5f7-1abe15d57ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:43.712788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3c427-88f7-49b6-a5f7-1abe15d57ad9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:43.744720 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2517/5012] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:05:43.746050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052d06e-f738-496f-8815-3992e7a99a52 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:43.760071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052d06e-f738-496f-8815-3992e7a99a52 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:43.777712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889229bf-9764-4ef6-b5b4-14b4e2d048ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:43.778161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889229bf-9764-4ef6-b5b4-14b4e2d048ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:43.778442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889229bf-9764-4ef6-b5b4-14b4e2d048ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:43.778720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889229bf-9764-4ef6-b5b4-14b4e2d048ee admin admin] PATH_INFO: `/v3/projects/76324c71e5b8454eacc51f54b8dc1a60/users/90ae6a32f99c4aa9861ec9ada939b6bb/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:43.817631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889229bf-9764-4ef6-b5b4-14b4e2d048ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=76324c71e5b8454eacc51f54b8dc1a60, user_id=90ae6a32f99c4aa9861ec9ada939b6bb, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:43.820344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889229bf-9764-4ef6-b5b4-14b4e2d048ee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:43.847066 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2496/5013] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:05:43 2022] PUT /identity/v3/projects/76324c71e5b8454eacc51f54b8dc1a60/users/90ae6a32f99c4aa9861ec9ada939b6bb/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:43.859101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c7bb4-6b2c-447e-a6a7-772bcf4aedc6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:43.859383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c7bb4-6b2c-447e-a6a7-772bcf4aedc6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:43.859656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c7bb4-6b2c-447e-a6a7-772bcf4aedc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:43.919008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e96c7bb4-6b2c-447e-a6a7-772bcf4aedc6 None None] MFA Rules not processed for user `90ae6a32f99c4aa9861ec9ada939b6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:43.920249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e96c7bb4-6b2c-447e-a6a7-772bcf4aedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:44.136994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2518/5014] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:44.137223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889229bf-9764-4ef6-b5b4-14b4e2d048ee admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:44.138888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-889229bf-9764-4ef6-b5b4-14b4e2d048ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:44.292450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889229bf-9764-4ef6-b5b4-14b4e2d048ee admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:44.297953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4dc0-6424-4638-956d-1638e51835d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:44.298558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4dc0-6424-4638-956d-1638e51835d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:44.298845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4dc0-6424-4638-956d-1638e51835d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:44.299123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4dc0-6424-4638-956d-1638e51835d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:44.319227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b4dc0-6424-4638-956d-1638e51835d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:44.320773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b4dc0-6424-4638-956d-1638e51835d9 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:44.340338 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2497/5015] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:05:45.607953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c7bb4-6b2c-447e-a6a7-772bcf4aedc6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:45.609456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e96c7bb4-6b2c-447e-a6a7-772bcf4aedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:45.800408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c7bb4-6b2c-447e-a6a7-772bcf4aedc6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:45.813016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab4b36-57c2-4a59-b8fe-fc3c1c2c0b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:45.813664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4b36-57c2-4a59-b8fe-fc3c1c2c0b97 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:45.813946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4b36-57c2-4a59-b8fe-fc3c1c2c0b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:45.814223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4b36-57c2-4a59-b8fe-fc3c1c2c0b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:45.817236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b7ab4b36-57c2-4a59-b8fe-fc3c1c2c0b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:45.893014 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:45.974561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab4b36-57c2-4a59-b8fe-fc3c1c2c0b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:45.976183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab4b36-57c2-4a59-b8fe-fc3c1c2c0b97 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:46.004959 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2519/5016] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:47.576493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4dc0-6424-4638-956d-1638e51835d9 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:47.578610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ea2b4dc0-6424-4638-956d-1638e51835d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:47.599136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4dc0-6424-4638-956d-1638e51835d9 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:47.611375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:47.612465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:47.613003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:47.613514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] PATH_INFO: `/v3/users/1f062f2ecc0547ae960ed98e7aeef9ee` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:47.615231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f062f2ecc0547ae960ed98e7aeef9ee)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:47.618966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da6c3-d3c7-4d7c-b6ce-a556c9b29b91 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:47.619813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da6c3-d3c7-4d7c-b6ce-a556c9b29b91 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:47.620336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da6c3-d3c7-4d7c-b6ce-a556c9b29b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:47.630587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:47.667243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-484da6c3-d3c7-4d7c-b6ce-a556c9b29b91 None None] MFA Rules not processed for user `5ac399b59740442a93081bb1a78297b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:47.674778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-484da6c3-d3c7-4d7c-b6ce-a556c9b29b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:47.765391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f062f2ecc0547ae960ed98e7aeef9ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:47.782999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f062f2ecc0547ae960ed98e7aeef9ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:47.787101 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:47.813909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f062f2ecc0547ae960ed98e7aeef9ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:47.828459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f062f2ecc0547ae960ed98e7aeef9ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:47.829444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f062f2ecc0547ae960ed98e7aeef9ee'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:47.832762 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2520/5017] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:47.834366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59691aa7-cb4d-4f23-9460-e4e935cc28f1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:47.834602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59691aa7-cb4d-4f23-9460-e4e935cc28f1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:47.835063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59691aa7-cb4d-4f23-9460-e4e935cc28f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:47.843107 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2498/5018] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:05:47 2022] DELETE /identity/v3/users/1f062f2ecc0547ae960ed98e7aeef9ee => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:47.889329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-59691aa7-cb4d-4f23-9460-e4e935cc28f1 None None] MFA Rules not processed for user `5ac399b59740442a93081bb1a78297b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:47.890872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-59691aa7-cb4d-4f23-9460-e4e935cc28f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:48.038224 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2521/5019] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:48.264476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:48.266020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:48.531485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df6cd0-2e0b-4983-840b-d56677452f44 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:48.543444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:48.545063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:48.545357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:48.546040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] PATH_INFO: `/v3/projects/d0a15ec11a0f4e33941010967cdc55f3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:48.551383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a15ec11a0f4e33941010967cdc55f3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:48.554133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:48.727742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a15ec11a0f4e33941010967cdc55f3', 'request_id': 'req-b28a9d47-2c03-4205-ab40-d76312c637cf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:48.752795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a15ec11a0f4e33941010967cdc55f3', 'request_id': 'req-b28a9d47-2c03-4205-ab40-d76312c637cf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:48.772788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a15ec11a0f4e33941010967cdc55f3', 'request_id': 'req-b28a9d47-2c03-4205-ab40-d76312c637cf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:48.815093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] The token cache is being invalidate because project d0a15ec11a0f4e33941010967cdc55f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:05:48.815687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:48.818710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b28a9d47-2c03-4205-ab40-d76312c637cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:05:48.829535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc9716-adc2-40f6-b289-fdd0f189eb16 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:48.830525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc9716-adc2-40f6-b289-fdd0f189eb16 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:48.831019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc9716-adc2-40f6-b289-fdd0f189eb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:48.834250 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2499/5020] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:48 2022] DELETE /identity/v3/projects/d0a15ec11a0f4e33941010967cdc55f3 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:48.870483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-27bc9716-adc2-40f6-b289-fdd0f189eb16 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:48.872072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-27bc9716-adc2-40f6-b289-fdd0f189eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:49.026982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b3f5-fd11-4122-a606-8a918a1229a6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:49.027255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b3f5-fd11-4122-a606-8a918a1229a6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:49.027540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b3f5-fd11-4122-a606-8a918a1229a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:49.036933 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2522/5021] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:49.054464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6cc0b3f5-fd11-4122-a606-8a918a1229a6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:49.056963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6cc0b3f5-fd11-4122-a606-8a918a1229a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:49.067431 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2500/5022] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:49.072447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc9716-adc2-40f6-b289-fdd0f189eb16 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:49.108812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc9716-adc2-40f6-b289-fdd0f189eb16 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:49.127803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39228-aeb7-4ef5-9f17-2c9cfbdf5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:49.128460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39228-aeb7-4ef5-9f17-2c9cfbdf5c5b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:49.128770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39228-aeb7-4ef5-9f17-2c9cfbdf5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:49.129045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39228-aeb7-4ef5-9f17-2c9cfbdf5c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:49.130084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa39228-aeb7-4ef5-9f17-2c9cfbdf5c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:05:49.130084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa39228-aeb7-4ef5-9f17-2c9cfbdf5c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:49.142057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa39228-aeb7-4ef5-9f17-2c9cfbdf5c5b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:49.167811 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:49.206677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b3f5-fd11-4122-a606-8a918a1229a6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:49.207308 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2523/5023] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:05:49.219281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b3f5-fd11-4122-a606-8a918a1229a6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:49.235508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ffdbf-3097-408d-9e2c-53637f7e8eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:49.236161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ffdbf-3097-408d-9e2c-53637f7e8eca admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:49.236442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ffdbf-3097-408d-9e2c-53637f7e8eca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:49.236740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ffdbf-3097-408d-9e2c-53637f7e8eca admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:49.237403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ffdbf-3097-408d-9e2c-53637f7e8eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:49.251972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ffdbf-3097-408d-9e2c-53637f7e8eca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:49.328929 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2501/5024] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:05:49 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:05:49.334373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39228-aeb7-4ef5-9f17-2c9cfbdf5c5b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:49.350484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39228-aeb7-4ef5-9f17-2c9cfbdf5c5b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:49.545067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea2cda-3d5a-46b8-a5de-943d48d83f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:49.545964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea2cda-3d5a-46b8-a5de-943d48d83f38 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:49.547972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea2cda-3d5a-46b8-a5de-943d48d83f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:49.548413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea2cda-3d5a-46b8-a5de-943d48d83f38 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:49.549280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea2cda-3d5a-46b8-a5de-943d48d83f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:49.555711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea2cda-3d5a-46b8-a5de-943d48d83f38 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:49.636916 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2524/5025] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:05:49 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:05:49.642535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ffdbf-3097-408d-9e2c-53637f7e8eca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:49.664437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ffdbf-3097-408d-9e2c-53637f7e8eca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:49.682884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6af112-2488-4670-8818-b360f05e8ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:49.685298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6af112-2488-4670-8818-b360f05e8ece admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:49.685544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6af112-2488-4670-8818-b360f05e8ece admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:49.685818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6af112-2488-4670-8818-b360f05e8ece admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:49.690185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6af112-2488-4670-8818-b360f05e8ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:49.700399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6af112-2488-4670-8818-b360f05e8ece admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:49.724944 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2502/5026] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:05:49.732531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea2cda-3d5a-46b8-a5de-943d48d83f38 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:49.750888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea2cda-3d5a-46b8-a5de-943d48d83f38 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:49.771243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01505d74-8fe1-41c4-a833-cda8259684c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:49.781336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01505d74-8fe1-41c4-a833-cda8259684c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:49.781767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01505d74-8fe1-41c4-a833-cda8259684c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:49.782924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01505d74-8fe1-41c4-a833-cda8259684c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:49.783051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01505d74-8fe1-41c4-a833-cda8259684c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:49.793541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01505d74-8fe1-41c4-a833-cda8259684c6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:49.827934 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2525/5027] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:05:49.835390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6af112-2488-4670-8818-b360f05e8ece admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:49.861269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6af112-2488-4670-8818-b360f05e8ece admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:49.871445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c87c-d96f-4890-b8bc-5e8cdc5e7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:49.872326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c87c-d96f-4890-b8bc-5e8cdc5e7dca admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:49.872721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c87c-d96f-4890-b8bc-5e8cdc5e7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:49.873114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c87c-d96f-4890-b8bc-5e8cdc5e7dca admin admin] PATH_INFO: `/v3/projects/979214475e474053bef7b2daaf4ae6fc/users/314b17e8914f48e985e90481cd3c3a3d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:49.928431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2c87c-d96f-4890-b8bc-5e8cdc5e7dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=979214475e474053bef7b2daaf4ae6fc, user_id=314b17e8914f48e985e90481cd3c3a3d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:49.931572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2c87c-d96f-4890-b8bc-5e8cdc5e7dca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:50.004149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2503/5028] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:05:49 2022] PUT /identity/v3/projects/979214475e474053bef7b2daaf4ae6fc/users/314b17e8914f48e985e90481cd3c3a3d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:05:50.016293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed6e5-bb1b-40a4-921c-0beae5770fec None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:50.017659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed6e5-bb1b-40a4-921c-0beae5770fec None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:50.018188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed6e5-bb1b-40a4-921c-0beae5770fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:50.094882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6abed6e5-bb1b-40a4-921c-0beae5770fec None None] MFA Rules not processed for user `314b17e8914f48e985e90481cd3c3a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:50.096445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6abed6e5-bb1b-40a4-921c-0beae5770fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:50.356147 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2526/5029] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:50.358079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c87c-d96f-4890-b8bc-5e8cdc5e7dca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:50.360189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-17d2c87c-d96f-4890-b8bc-5e8cdc5e7dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:50.385518 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:50.463704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c87c-d96f-4890-b8bc-5e8cdc5e7dca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:50.468486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5dff7-61ac-4e45-bd2c-8797970d0e37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:50.469167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5dff7-61ac-4e45-bd2c-8797970d0e37 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:50.469444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5dff7-61ac-4e45-bd2c-8797970d0e37 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:50.469857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5dff7-61ac-4e45-bd2c-8797970d0e37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:50.482624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5dff7-61ac-4e45-bd2c-8797970d0e37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:50.484257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5dff7-61ac-4e45-bd2c-8797970d0e37 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:50.501415 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2504/5030] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:51.127856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbf3f4-34d0-48e5-8476-58f9ab949618 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:51.127856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbf3f4-34d0-48e5-8476-58f9ab949618 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:51.127856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbf3f4-34d0-48e5-8476-58f9ab949618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:51.198450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-26dbf3f4-34d0-48e5-8476-58f9ab949618 None None] MFA Rules not processed for user `e3d4cc70eeca421585fabdb682af7caf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:51.200081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-26dbf3f4-34d0-48e5-8476-58f9ab949618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:51.389061 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2527/5031] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:51.829164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab2a1b-8264-43be-86a9-bffd07e5ac16 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:51.830088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab2a1b-8264-43be-86a9-bffd07e5ac16 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:51.830524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab2a1b-8264-43be-86a9-bffd07e5ac16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:51.999494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2bab2a1b-8264-43be-86a9-bffd07e5ac16 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:52.001373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2bab2a1b-8264-43be-86a9-bffd07e5ac16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:52.171750 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2505/5032] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:52.255970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbf3f4-34d0-48e5-8476-58f9ab949618 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:52.258224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-26dbf3f4-34d0-48e5-8476-58f9ab949618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:52.292218 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:52.521961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbf3f4-34d0-48e5-8476-58f9ab949618 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:52.534344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69772797-b7fc-4b10-b8c1-0bbd95c87ab5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:52.535161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772797-b7fc-4b10-b8c1-0bbd95c87ab5 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:52.535554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772797-b7fc-4b10-b8c1-0bbd95c87ab5 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:52.535937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772797-b7fc-4b10-b8c1-0bbd95c87ab5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:52.553552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69772797-b7fc-4b10-b8c1-0bbd95c87ab5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:52.563089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69772797-b7fc-4b10-b8c1-0bbd95c87ab5 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:52.582103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2528/5033] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:05:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:53.286465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab2a1b-8264-43be-86a9-bffd07e5ac16 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:53.288250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2bab2a1b-8264-43be-86a9-bffd07e5ac16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:53.461037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab2a1b-8264-43be-86a9-bffd07e5ac16 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:53.473673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff4c98-5069-4e12-9dec-d16cf5630ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:53.474317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff4c98-5069-4e12-9dec-d16cf5630ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:53.474594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff4c98-5069-4e12-9dec-d16cf5630ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:53.474866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff4c98-5069-4e12-9dec-d16cf5630ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:53.476882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-84ff4c98-5069-4e12-9dec-d16cf5630ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:53.504875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff4c98-5069-4e12-9dec-d16cf5630ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:53.506570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff4c98-5069-4e12-9dec-d16cf5630ef1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:53.536300 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2506/5034] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:05:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:05:57.330456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55b8fe-f3b8-414d-8df3-34ba074cf312 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:57.330861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55b8fe-f3b8-414d-8df3-34ba074cf312 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:57.331002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55b8fe-f3b8-414d-8df3-34ba074cf312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:57.425670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6a55b8fe-f3b8-414d-8df3-34ba074cf312 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:57.427709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6a55b8fe-f3b8-414d-8df3-34ba074cf312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:57.439978 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2529/5035] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:05:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:57.489790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff4c98-5069-4e12-9dec-d16cf5630ef1 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:57.528068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff4c98-5069-4e12-9dec-d16cf5630ef1 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:57.538244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4ec60-c7c3-4c0f-8365-025f4513a91d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:57.539171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4ec60-c7c3-4c0f-8365-025f4513a91d service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:57.539622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4ec60-c7c3-4c0f-8365-025f4513a91d service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:57.540087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4ec60-c7c3-4c0f-8365-025f4513a91d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:57.590927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4ec60-c7c3-4c0f-8365-025f4513a91d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:57.599336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4ec60-c7c3-4c0f-8365-025f4513a91d service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:57.637563 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2507/5036] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:05:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:05:59.283176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f74f-ab67-4995-9dad-519a195b9853 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:59.284211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f74f-ab67-4995-9dad-519a195b9853 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:59.285637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f74f-ab67-4995-9dad-519a195b9853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:59.327152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d984f74f-ab67-4995-9dad-519a195b9853 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:59.328596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d984f74f-ab67-4995-9dad-519a195b9853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:59.338805 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2530/5037] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:05:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:05:59.352129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4ec60-c7c3-4c0f-8365-025f4513a91d service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:05:59.373662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4ec60-c7c3-4c0f-8365-025f4513a91d service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:05:59.393371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c11ea1-a9c8-4273-8c73-079c6b130034 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:05:59.393998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c11ea1-a9c8-4273-8c73-079c6b130034 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:59.394275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c11ea1-a9c8-4273-8c73-079c6b130034 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:59.394659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c11ea1-a9c8-4273-8c73-079c6b130034 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:59.426170 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:59.453570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c11ea1-a9c8-4273-8c73-079c6b130034 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:05:59.468756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c11ea1-a9c8-4273-8c73-079c6b130034 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:05:59.486269 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2508/5038] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:05:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:59.908490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8bf16-fbfa-43de-af43-9a08eb6ebd0f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:05:59.909111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8bf16-fbfa-43de-af43-9a08eb6ebd0f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:05:59.909548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8bf16-fbfa-43de-af43-9a08eb6ebd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:05:59.938013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-60c8bf16-fbfa-43de-af43-9a08eb6ebd0f None None] MFA Rules not processed for user `314b17e8914f48e985e90481cd3c3a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:05:59.943257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-60c8bf16-fbfa-43de-af43-9a08eb6ebd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:05:59.973947 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2531/5039] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:05:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:01.153277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c11ea1-a9c8-4273-8c73-079c6b130034 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:01.154825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d1c11ea1-a9c8-4273-8c73-079c6b130034 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:01.179147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b3365-432b-4699-8be6-28bd7c199079 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:01.179612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b3365-432b-4699-8be6-28bd7c199079 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:01.179759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b3365-432b-4699-8be6-28bd7c199079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:01.282257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2b5b3365-432b-4699-8be6-28bd7c199079 None None] MFA Rules not processed for user `314b17e8914f48e985e90481cd3c3a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:01.294349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2b5b3365-432b-4699-8be6-28bd7c199079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:01.325426 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2532/5040] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:01.421502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c11ea1-a9c8-4273-8c73-079c6b130034 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:01.443419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:01.445574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:01.446295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:01.447962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] PATH_INFO: `/v3/users/35a7ced563ae4a2da6fb2c7b317e336e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:01.452306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a7ced563ae4a2da6fb2c7b317e336e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:01.458642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:01.676823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a7ced563ae4a2da6fb2c7b317e336e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:01.803814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a7ced563ae4a2da6fb2c7b317e336e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:01.830124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a7ced563ae4a2da6fb2c7b317e336e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:01.841705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a7ced563ae4a2da6fb2c7b317e336e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:01.844499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b33cda4e-3747-4ffc-b10e-ef2f3de8d000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a7ced563ae4a2da6fb2c7b317e336e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:01.861262 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2509/5041] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:01 2022] DELETE /identity/v3/users/35a7ced563ae4a2da6fb2c7b317e336e => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:04.703516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b3365-432b-4699-8be6-28bd7c199079 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:04.732866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b3365-432b-4699-8be6-28bd7c199079 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:04.941288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:04.942606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:04.942894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:04.943190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] PATH_INFO: `/v3/projects/88b704bc24504b6baecfe8bcf1ca9b39` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:04.947406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b704bc24504b6baecfe8bcf1ca9b39)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:04.951546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:05.069945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b704bc24504b6baecfe8bcf1ca9b39', 'request_id': 'req-258d196b-63bc-4bf1-8ef4-3c8906a667b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:05.083509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b704bc24504b6baecfe8bcf1ca9b39', 'request_id': 'req-258d196b-63bc-4bf1-8ef4-3c8906a667b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:05.097034 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:05.111405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b704bc24504b6baecfe8bcf1ca9b39', 'request_id': 'req-258d196b-63bc-4bf1-8ef4-3c8906a667b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:05.143405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] The token cache is being invalidate because project 88b704bc24504b6baecfe8bcf1ca9b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:05.143969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:05.145134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:05.151223 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2533/5042] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:04 2022] DELETE /identity/v3/projects/88b704bc24504b6baecfe8bcf1ca9b39 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:05.153156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32554-a9f9-4cc7-b601-9f8891e7af1e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:05.153984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32554-a9f9-4cc7-b601-9f8891e7af1e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:05.154423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32554-a9f9-4cc7-b601-9f8891e7af1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:05.207085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c2c32554-a9f9-4cc7-b601-9f8891e7af1e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:05.208555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c2c32554-a9f9-4cc7-b601-9f8891e7af1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:05.300640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:05.302232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:05.349849 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2510/5043] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:05.357571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970542-470e-48d4-909a-b5f85d95424a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:05.357861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970542-470e-48d4-909a-b5f85d95424a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:05.358139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970542-470e-48d4-909a-b5f85d95424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:05.397071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1e970542-470e-48d4-909a-b5f85d95424a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:05.398389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e970542-470e-48d4-909a-b5f85d95424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:05.424070 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2511/5044] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:05.428255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970542-470e-48d4-909a-b5f85d95424a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:05.462923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970542-470e-48d4-909a-b5f85d95424a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:05.489816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d196b-63bc-4bf1-8ef4-3c8906a667b5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:05.495130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbef13f-a184-42d9-b823-89ced9566f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:05.495772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbef13f-a184-42d9-b823-89ced9566f5e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:05.496050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbef13f-a184-42d9-b823-89ced9566f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:05.496519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbef13f-a184-42d9-b823-89ced9566f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:05.497380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbef13f-a184-42d9-b823-89ced9566f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:05.498586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbef13f-a184-42d9-b823-89ced9566f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:05.500888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d9fcc-0cb0-4bad-9a00-a4f74d68fae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:05.502380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbef13f-a184-42d9-b823-89ced9566f5e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:05.503175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d9fcc-0cb0-4bad-9a00-a4f74d68fae2 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:05.503636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d9fcc-0cb0-4bad-9a00-a4f74d68fae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:05.505480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d9fcc-0cb0-4bad-9a00-a4f74d68fae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:05.507652 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:05.508043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-972d9fcc-0cb0-4bad-9a00-a4f74d68fae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:05.535629 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2512/5045] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:06:05.538095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbef13f-a184-42d9-b823-89ced9566f5e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:05.569248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbef13f-a184-42d9-b823-89ced9566f5e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:05.581466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6eeaf-ae14-41db-861f-ea21b6185def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:05.582324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6eeaf-ae14-41db-861f-ea21b6185def admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:05.582790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6eeaf-ae14-41db-861f-ea21b6185def admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:05.583222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6eeaf-ae14-41db-861f-ea21b6185def admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:05.584986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6eeaf-ae14-41db-861f-ea21b6185def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:05.589032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6eeaf-ae14-41db-861f-ea21b6185def admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:05.697146 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2513/5046] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:05 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:05.701366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6eeaf-ae14-41db-861f-ea21b6185def admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:05.709880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d9fcc-0cb0-4bad-9a00-a4f74d68fae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:05.713387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d9fcc-0cb0-4bad-9a00-a4f74d68fae2 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:05.743427 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2534/5047] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:05.830658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6eeaf-ae14-41db-861f-ea21b6185def admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:05.838421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a48ef-31a4-43d8-b78f-f9664bcd8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:05.839192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a48ef-31a4-43d8-b78f-f9664bcd8af8 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:05.839551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a48ef-31a4-43d8-b78f-f9664bcd8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:05.839892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a48ef-31a4-43d8-b78f-f9664bcd8af8 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:05.840697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a48ef-31a4-43d8-b78f-f9664bcd8af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:05.843422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a48ef-31a4-43d8-b78f-f9664bcd8af8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:05.905273 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2514/5048] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:05 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:05.910144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d9fcc-0cb0-4bad-9a00-a4f74d68fae2 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:05.928157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d9fcc-0cb0-4bad-9a00-a4f74d68fae2 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:05.935633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8934e-ed0c-4c64-8e86-5ecb54ece141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:05.946116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8934e-ed0c-4c64-8e86-5ecb54ece141 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:05.947247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8934e-ed0c-4c64-8e86-5ecb54ece141 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:05.947519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8934e-ed0c-4c64-8e86-5ecb54ece141 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:05.951846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8934e-ed0c-4c64-8e86-5ecb54ece141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:05.953699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8934e-ed0c-4c64-8e86-5ecb54ece141 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:05.983332 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2535/5049] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:05.987412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a48ef-31a4-43d8-b78f-f9664bcd8af8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:06.025479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a48ef-31a4-43d8-b78f-f9664bcd8af8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:06.065081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc6527-9683-4834-9196-b1767f5b93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:06.065748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6527-9683-4834-9196-b1767f5b93fd admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:06.066035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6527-9683-4834-9196-b1767f5b93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:06.066331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6527-9683-4834-9196-b1767f5b93fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:06.066976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc6527-9683-4834-9196-b1767f5b93fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:06.068753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc6527-9683-4834-9196-b1767f5b93fd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:06.107119 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2515/5050] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:06.108204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8934e-ed0c-4c64-8e86-5ecb54ece141 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:06.171451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8934e-ed0c-4c64-8e86-5ecb54ece141 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:06.208429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f941073-cf14-4e49-a01f-2df2cbc29a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:06.210677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f941073-cf14-4e49-a01f-2df2cbc29a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:06.222264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f941073-cf14-4e49-a01f-2df2cbc29a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:06.224505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f941073-cf14-4e49-a01f-2df2cbc29a23 admin admin] PATH_INFO: `/v3/projects/7f6213a887b044f49207f366ca8f5980/users/fa1f3b94587e468d8c6dd9f134665691/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:06.296534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f941073-cf14-4e49-a01f-2df2cbc29a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6213a887b044f49207f366ca8f5980, user_id=fa1f3b94587e468d8c6dd9f134665691, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:06.299514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f941073-cf14-4e49-a01f-2df2cbc29a23 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:06.342154 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2536/5051] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:06 2022] PUT /identity/v3/projects/7f6213a887b044f49207f366ca8f5980/users/fa1f3b94587e468d8c6dd9f134665691/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:06:06.348860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561684-c7a5-4485-baad-176133831fa9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:06.349291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561684-c7a5-4485-baad-176133831fa9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:06.350150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561684-c7a5-4485-baad-176133831fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:06.430300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-48561684-c7a5-4485-baad-176133831fa9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:06.432079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-48561684-c7a5-4485-baad-176133831fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:06.635249 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2516/5052] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:06.673165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f941073-cf14-4e49-a01f-2df2cbc29a23 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:06.674938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0f941073-cf14-4e49-a01f-2df2cbc29a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:06.816965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f941073-cf14-4e49-a01f-2df2cbc29a23 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:06.823602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad7cd3-a9f6-4f59-991b-d928ace8d97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:06.824569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad7cd3-a9f6-4f59-991b-d928ace8d97a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:06.825110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad7cd3-a9f6-4f59-991b-d928ace8d97a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:06.825744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad7cd3-a9f6-4f59-991b-d928ace8d97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:06.835186 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:06.840958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad7cd3-a9f6-4f59-991b-d928ace8d97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:06.843958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad7cd3-a9f6-4f59-991b-d928ace8d97a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:06.863969 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2537/5053] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:08.217870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561684-c7a5-4485-baad-176133831fa9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:08.219348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-48561684-c7a5-4485-baad-176133831fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:08.238424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561684-c7a5-4485-baad-176133831fa9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:08.262232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:08.262894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:08.263383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:08.263957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] PATH_INFO: `/v3/users/098f448796ff4635ac6b4b7262bf6ff1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:08.272832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] RBAC: Authorizing `identity:delete_user(user_id=098f448796ff4635ac6b4b7262bf6ff1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:08.276316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:08.395474 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:08.408176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098f448796ff4635ac6b4b7262bf6ff1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:08.453332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098f448796ff4635ac6b4b7262bf6ff1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:08.476008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098f448796ff4635ac6b4b7262bf6ff1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:08.516124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098f448796ff4635ac6b4b7262bf6ff1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:08.517238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-48d3fd82-8b9e-4714-8e43-9a428112a83d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098f448796ff4635ac6b4b7262bf6ff1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:08.538566 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2517/5054] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:08 2022] DELETE /identity/v3/users/098f448796ff4635ac6b4b7262bf6ff1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:10.031313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad7cd3-a9f6-4f59-991b-d928ace8d97a service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:10.056248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad7cd3-a9f6-4f59-991b-d928ace8d97a service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:10.306753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:10.307439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:10.307726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:10.308007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] PATH_INFO: `/v3/projects/daa2d47392564feabc36c67f7382cddf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:10.312792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa2d47392564feabc36c67f7382cddf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:10.322373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:10.449374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa2d47392564feabc36c67f7382cddf', 'request_id': 'req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:10.484150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa2d47392564feabc36c67f7382cddf', 'request_id': 'req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:10.498501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa2d47392564feabc36c67f7382cddf', 'request_id': 'req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:10.543327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] The token cache is being invalidate because project daa2d47392564feabc36c67f7382cddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:10.543625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:10.548758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-125a0cd1-1f85-4fdf-9a5f-dc7b2475d97b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:10.550699 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2538/5055] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:10 2022] DELETE /identity/v3/projects/daa2d47392564feabc36c67f7382cddf => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:10.559572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfe94-80d0-492e-aa3f-326e03a7fa2a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:10.560084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfe94-80d0-492e-aa3f-326e03a7fa2a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:10.560838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfe94-80d0-492e-aa3f-326e03a7fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:10.612716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-401cfe94-80d0-492e-aa3f-326e03a7fa2a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:10.614252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-401cfe94-80d0-492e-aa3f-326e03a7fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:10.890843 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2518/5056] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:10.892979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d086-8c1c-45c7-abba-74cd039ad8d4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:10.892979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d086-8c1c-45c7-abba-74cd039ad8d4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:10.893223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d086-8c1c-45c7-abba-74cd039ad8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:10.945051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-33d8d086-8c1c-45c7-abba-74cd039ad8d4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:10.946270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-33d8d086-8c1c-45c7-abba-74cd039ad8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:10.962523 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2539/5057] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:10.963723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfe94-80d0-492e-aa3f-326e03a7fa2a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:10.999430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfe94-80d0-492e-aa3f-326e03a7fa2a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:11.017710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d98d5-6ae4-4859-801a-c2e5b1d6d46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:11.018362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d98d5-6ae4-4859-801a-c2e5b1d6d46d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:11.018806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d98d5-6ae4-4859-801a-c2e5b1d6d46d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:11.019089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d98d5-6ae4-4859-801a-c2e5b1d6d46d admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:11.019760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d98d5-6ae4-4859-801a-c2e5b1d6d46d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:11.020063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d98d5-6ae4-4859-801a-c2e5b1d6d46d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:11.021716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d98d5-6ae4-4859-801a-c2e5b1d6d46d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:11.057163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8d086-8c1c-45c7-abba-74cd039ad8d4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:11.064576 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2519/5058] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:06:11.067736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8d086-8c1c-45c7-abba-74cd039ad8d4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:11.084399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ed44-b1a1-4a79-a2e4-b9af85a8dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:11.085057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ed44-b1a1-4a79-a2e4-b9af85a8dcef admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:11.085339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ed44-b1a1-4a79-a2e4-b9af85a8dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:11.085612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ed44-b1a1-4a79-a2e4-b9af85a8dcef admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:11.086530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ed44-b1a1-4a79-a2e4-b9af85a8dcef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:11.088718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ed44-b1a1-4a79-a2e4-b9af85a8dcef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:11.197174 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2540/5059] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:11 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:11.198987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d98d5-6ae4-4859-801a-c2e5b1d6d46d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:11.216362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d98d5-6ae4-4859-801a-c2e5b1d6d46d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:11.429064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128d979-481f-4fd9-b143-32e2355a34ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:11.429730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128d979-481f-4fd9-b143-32e2355a34ca admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:11.430055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128d979-481f-4fd9-b143-32e2355a34ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:11.430875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128d979-481f-4fd9-b143-32e2355a34ca admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:11.431427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128d979-481f-4fd9-b143-32e2355a34ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:11.433256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128d979-481f-4fd9-b143-32e2355a34ca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:11.505081 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2520/5060] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:11 2022] POST /identity/v3/users => generated 292 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:11.509767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ed44-b1a1-4a79-a2e4-b9af85a8dcef admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:11.521712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ed44-b1a1-4a79-a2e4-b9af85a8dcef admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:11.528565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca0e9-3c87-4691-a1e6-9d54f558706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:11.529456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca0e9-3c87-4691-a1e6-9d54f558706d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:11.530047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca0e9-3c87-4691-a1e6-9d54f558706d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:11.530479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca0e9-3c87-4691-a1e6-9d54f558706d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:11.531389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeca0e9-3c87-4691-a1e6-9d54f558706d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:11.533737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeca0e9-3c87-4691-a1e6-9d54f558706d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:11.554462 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2541/5061] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:11.555749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128d979-481f-4fd9-b143-32e2355a34ca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:11.569720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128d979-481f-4fd9-b143-32e2355a34ca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:11.592945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf0263-8240-4748-b232-7982c1596671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:11.593602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf0263-8240-4748-b232-7982c1596671 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:11.593887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf0263-8240-4748-b232-7982c1596671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:11.594162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf0263-8240-4748-b232-7982c1596671 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:11.594822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf0263-8240-4748-b232-7982c1596671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:11.596467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf0263-8240-4748-b232-7982c1596671 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:11.630852 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2521/5062] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:11.635045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca0e9-3c87-4691-a1e6-9d54f558706d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:11.651652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca0e9-3c87-4691-a1e6-9d54f558706d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:11.665752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498beb7-b232-45bd-945e-0fea8429b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:11.666714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498beb7-b232-45bd-945e-0fea8429b866 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:11.667173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498beb7-b232-45bd-945e-0fea8429b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:11.667660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498beb7-b232-45bd-945e-0fea8429b866 admin admin] PATH_INFO: `/v3/projects/e21c7c3e9f2147c8910696804f18b174/users/5a9b1ee40121440ca87e221609f3a2e4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:11.746252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498beb7-b232-45bd-945e-0fea8429b866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21c7c3e9f2147c8910696804f18b174, user_id=5a9b1ee40121440ca87e221609f3a2e4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:11.757308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498beb7-b232-45bd-945e-0fea8429b866 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:11.799313 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2542/5063] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:11 2022] PUT /identity/v3/projects/e21c7c3e9f2147c8910696804f18b174/users/5a9b1ee40121440ca87e221609f3a2e4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:11.809694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21bdfd-acdb-472f-8108-57257aed60b0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:11.810133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21bdfd-acdb-472f-8108-57257aed60b0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:11.810409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21bdfd-acdb-472f-8108-57257aed60b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:11.933503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ca21bdfd-acdb-472f-8108-57257aed60b0 None None] MFA Rules not processed for user `5a9b1ee40121440ca87e221609f3a2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:11.944363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ca21bdfd-acdb-472f-8108-57257aed60b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:12.025491 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:12.246782 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2522/5064] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:12.251486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498beb7-b232-45bd-945e-0fea8429b866 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:12.300593 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:12.445896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498beb7-b232-45bd-945e-0fea8429b866 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:12.459663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1c680-7f1b-4632-ab6c-97e10deb4b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:12.463960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1c680-7f1b-4632-ab6c-97e10deb4b64 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:12.464680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1c680-7f1b-4632-ab6c-97e10deb4b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:12.465298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1c680-7f1b-4632-ab6c-97e10deb4b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:12.466537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1c680-7f1b-4632-ab6c-97e10deb4b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:12.469010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1c680-7f1b-4632-ab6c-97e10deb4b64 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:12.527488 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2543/5065] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:12 2022] POST /identity/v3/projects => generated 389 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:12.528779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21bdfd-acdb-472f-8108-57257aed60b0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:12.554023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21bdfd-acdb-472f-8108-57257aed60b0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:12.776552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d28a0-8241-43cd-bcb9-b4a5589d7b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:12.777933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d28a0-8241-43cd-bcb9-b4a5589d7b79 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:12.780478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d28a0-8241-43cd-bcb9-b4a5589d7b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:12.781070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d28a0-8241-43cd-bcb9-b4a5589d7b79 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:12.781892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d28a0-8241-43cd-bcb9-b4a5589d7b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:12.785514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d28a0-8241-43cd-bcb9-b4a5589d7b79 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:12.883021 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2523/5066] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:12 2022] POST /identity/v3/users => generated 301 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:12.887051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1c680-7f1b-4632-ab6c-97e10deb4b64 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:12.907523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1c680-7f1b-4632-ab6c-97e10deb4b64 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:12.928023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d784-b2fd-4897-bf0d-fc9b6f60219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:12.928762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d784-b2fd-4897-bf0d-fc9b6f60219d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:12.929043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d784-b2fd-4897-bf0d-fc9b6f60219d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:12.929313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d784-b2fd-4897-bf0d-fc9b6f60219d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:12.930080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4d784-b2fd-4897-bf0d-fc9b6f60219d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:12.936658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4d784-b2fd-4897-bf0d-fc9b6f60219d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:12.970523 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2544/5067] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:12.974403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d28a0-8241-43cd-bcb9-b4a5589d7b79 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:12.994610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d28a0-8241-43cd-bcb9-b4a5589d7b79 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:13.027184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a7441-bf87-4f8a-a87a-eb82e28b3d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:13.027882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a7441-bf87-4f8a-a87a-eb82e28b3d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:13.028163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a7441-bf87-4f8a-a87a-eb82e28b3d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:13.029562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a7441-bf87-4f8a-a87a-eb82e28b3d64 admin admin] PATH_INFO: `/v3/projects/0fd05e7977584e37bbb37839dafa0564/users/4f3087f6dcdb45d395a47f3ad042d9e7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:13.095415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a7441-bf87-4f8a-a87a-eb82e28b3d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd05e7977584e37bbb37839dafa0564, user_id=4f3087f6dcdb45d395a47f3ad042d9e7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:13.099672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a7441-bf87-4f8a-a87a-eb82e28b3d64 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:13.145545 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2524/5068] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:12 2022] PUT /identity/v3/projects/0fd05e7977584e37bbb37839dafa0564/users/4f3087f6dcdb45d395a47f3ad042d9e7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:13.149562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d784-b2fd-4897-bf0d-fc9b6f60219d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:13.163299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d784-b2fd-4897-bf0d-fc9b6f60219d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:13.318899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd057754-67ab-476e-a96b-efbbb23e34a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:13.320595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd057754-67ab-476e-a96b-efbbb23e34a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:13.321262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd057754-67ab-476e-a96b-efbbb23e34a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:13.325343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd057754-67ab-476e-a96b-efbbb23e34a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:13.326443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd057754-67ab-476e-a96b-efbbb23e34a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:13.328395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd057754-67ab-476e-a96b-efbbb23e34a6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:13.364255 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2545/5069] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:13.368598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a7441-bf87-4f8a-a87a-eb82e28b3d64 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:13.387263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a7441-bf87-4f8a-a87a-eb82e28b3d64 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:13.400195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d787a6-b203-4260-a433-c567b0706aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:13.401544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d787a6-b203-4260-a433-c567b0706aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:13.402140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d787a6-b203-4260-a433-c567b0706aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:13.404885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d787a6-b203-4260-a433-c567b0706aa5 admin admin] PATH_INFO: `/v3/projects/0fd05e7977584e37bbb37839dafa0564/users/4f3087f6dcdb45d395a47f3ad042d9e7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:13.410136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d787a6-b203-4260-a433-c567b0706aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd05e7977584e37bbb37839dafa0564, user_id=4f3087f6dcdb45d395a47f3ad042d9e7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:13.416836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d787a6-b203-4260-a433-c567b0706aa5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:13.443561 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2525/5070] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:13 2022] PUT /identity/v3/projects/0fd05e7977584e37bbb37839dafa0564/users/4f3087f6dcdb45d395a47f3ad042d9e7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:13.456571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139245-392a-40ae-aea1-539791f99fbf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:13.457386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139245-392a-40ae-aea1-539791f99fbf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:13.457906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139245-392a-40ae-aea1-539791f99fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:13.544807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-31139245-392a-40ae-aea1-539791f99fbf None None] MFA Rules not processed for user `4f3087f6dcdb45d395a47f3ad042d9e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:13.546657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-31139245-392a-40ae-aea1-539791f99fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:13.704974 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2546/5071] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:13.705838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d787a6-b203-4260-a433-c567b0706aa5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:13.721671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d787a6-b203-4260-a433-c567b0706aa5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:13.728848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c3765-b510-462a-89d1-43a0920a9eaa tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:13.730091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c3765-b510-462a-89d1-43a0920a9eaa tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:13.730603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c3765-b510-462a-89d1-43a0920a9eaa tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:13.731030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c3765-b510-462a-89d1-43a0920a9eaa tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects/e21c7c3e9f2147c8910696804f18b174` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:13.732555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c3765-b510-462a-89d1-43a0920a9eaa tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:get_project(project_id=e21c7c3e9f2147c8910696804f18b174)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:13.735754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c3765-b510-462a-89d1-43a0920a9eaa tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:13.745668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31139245-392a-40ae-aea1-539791f99fbf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:13.757069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31139245-392a-40ae-aea1-539791f99fbf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:13.757636 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2526/5072] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:06:13 2022] GET /identity/v3/projects/e21c7c3e9f2147c8910696804f18b174 => generated 383 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:06:13.764239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121cd44-3471-469e-bb4e-dccafbc7fd40 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:13.765647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121cd44-3471-469e-bb4e-dccafbc7fd40 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:13.766091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121cd44-3471-469e-bb4e-dccafbc7fd40 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:13.766370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121cd44-3471-469e-bb4e-dccafbc7fd40 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:13.767015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121cd44-3471-469e-bb4e-dccafbc7fd40 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:13.769634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121cd44-3471-469e-bb4e-dccafbc7fd40 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:13.798167 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:13.827233 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2547/5073] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:06:13 2022] POST /identity/v3/projects => generated 338 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:06:13.828104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c3765-b510-462a-89d1-43a0920a9eaa tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:13.847842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c3765-b510-462a-89d1-43a0920a9eaa tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:13.978998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599823-e747-4045-9a5f-bf4cacf7ca24 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:13.979799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599823-e747-4045-9a5f-bf4cacf7ca24 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:13.980329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599823-e747-4045-9a5f-bf4cacf7ca24 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:13.980911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599823-e747-4045-9a5f-bf4cacf7ca24 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:13.982386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599823-e747-4045-9a5f-bf4cacf7ca24 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:13.984848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599823-e747-4045-9a5f-bf4cacf7ca24 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:14.008829 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:14.028923 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2527/5074] 10.222.0.27 () {58 vars in 1131 bytes} [Wed Oct 19 01:06:13 2022] GET /identity/v3/projects => generated 6581 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:14.032871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121cd44-3471-469e-bb4e-dccafbc7fd40 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:14.053274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121cd44-3471-469e-bb4e-dccafbc7fd40 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:14.067734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c50b1-02f9-437d-9310-4d62eaa64d70 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:14.072140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c50b1-02f9-437d-9310-4d62eaa64d70 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:14.072596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c50b1-02f9-437d-9310-4d62eaa64d70 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:14.074582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c50b1-02f9-437d-9310-4d62eaa64d70 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects/e21c7c3e9f2147c8910696804f18b174` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:14.076894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c50b1-02f9-437d-9310-4d62eaa64d70 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:get_project(project_id=e21c7c3e9f2147c8910696804f18b174)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:14.082378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c50b1-02f9-437d-9310-4d62eaa64d70 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:14.085791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2548/5075] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:06:14 2022] GET /identity/v3/projects/e21c7c3e9f2147c8910696804f18b174 => generated 383 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:06:14.096015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599823-e747-4045-9a5f-bf4cacf7ca24 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:14.120923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599823-e747-4045-9a5f-bf4cacf7ca24 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:14.138721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b588e98-f08b-4cd8-9166-3194955a07ed tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:14.140112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b588e98-f08b-4cd8-9166-3194955a07ed tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:14.140844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b588e98-f08b-4cd8-9166-3194955a07ed tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:14.142261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b588e98-f08b-4cd8-9166-3194955a07ed tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects/d013552dd90746bf834d41ba478f1257` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:14.146787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b588e98-f08b-4cd8-9166-3194955a07ed tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:get_project(project_id=d013552dd90746bf834d41ba478f1257)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:14.162762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b588e98-f08b-4cd8-9166-3194955a07ed tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:14.168211 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2528/5076] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:06:14 2022] GET /identity/v3/projects/d013552dd90746bf834d41ba478f1257 => generated 338 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:06:14.172458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c50b1-02f9-437d-9310-4d62eaa64d70 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:14.190956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c50b1-02f9-437d-9310-4d62eaa64d70 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:14.209583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feafc3b-7b90-4c7c-8799-bc3c3a128837 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:14.210268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feafc3b-7b90-4c7c-8799-bc3c3a128837 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:14.210552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feafc3b-7b90-4c7c-8799-bc3c3a128837 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:14.210875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feafc3b-7b90-4c7c-8799-bc3c3a128837 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:14.212103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feafc3b-7b90-4c7c-8799-bc3c3a128837 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:14.215383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feafc3b-7b90-4c7c-8799-bc3c3a128837 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:14.283076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b588e98-f08b-4cd8-9166-3194955a07ed tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:14.283471 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2549/5077] 10.222.0.27 () {58 vars in 1131 bytes} [Wed Oct 19 01:06:14 2022] GET /identity/v3/projects => generated 6581 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:14.296086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b588e98-f08b-4cd8-9166-3194955a07ed tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:14.314645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab467593-44b0-430d-82ca-055b70f56f68 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:14.315684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab467593-44b0-430d-82ca-055b70f56f68 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:14.316190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab467593-44b0-430d-82ca-055b70f56f68 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:14.316751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab467593-44b0-430d-82ca-055b70f56f68 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:14.321378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab467593-44b0-430d-82ca-055b70f56f68 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:14.323079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab467593-44b0-430d-82ca-055b70f56f68 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:14.325096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab467593-44b0-430d-82ca-055b70f56f68 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:14.407314 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2529/5078] 10.222.0.27 () {58 vars in 1166 bytes} [Wed Oct 19 01:06:14 2022] GET /identity/v3/projects?domain_id=default => generated 6250 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:06:14.411914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feafc3b-7b90-4c7c-8799-bc3c3a128837 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:14.439698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feafc3b-7b90-4c7c-8799-bc3c3a128837 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:14.451913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb316-5fa4-43f1-9fff-c91c9a3c013f tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:14.453921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb316-5fa4-43f1-9fff-c91c9a3c013f tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:14.454211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb316-5fa4-43f1-9fff-c91c9a3c013f tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:14.456445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb316-5fa4-43f1-9fff-c91c9a3c013f tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:14.457153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfb316-5fa4-43f1-9fff-c91c9a3c013f tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:14.462711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfb316-5fa4-43f1-9fff-c91c9a3c013f tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:14.543652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab467593-44b0-430d-82ca-055b70f56f68 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:14.546368 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2550/5079] 10.222.0.27 () {58 vars in 1131 bytes} [Wed Oct 19 01:06:14 2022] GET /identity/v3/projects => generated 6581 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:14.562327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab467593-44b0-430d-82ca-055b70f56f68 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:14.579218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9324f1d-15cf-4b7b-a011-936cc7c927dc tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:14.580089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9324f1d-15cf-4b7b-a011-936cc7c927dc tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:14.580917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9324f1d-15cf-4b7b-a011-936cc7c927dc tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:14.582057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9324f1d-15cf-4b7b-a011-936cc7c927dc tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:14.582862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9324f1d-15cf-4b7b-a011-936cc7c927dc tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:14.589063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9324f1d-15cf-4b7b-a011-936cc7c927dc tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:14.591194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9324f1d-15cf-4b7b-a011-936cc7c927dc tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:14.647446 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2530/5080] 10.222.0.27 () {58 vars in 1166 bytes} [Wed Oct 19 01:06:14 2022] GET /identity/v3/projects?domain_id=default => generated 6250 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:14.654133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb316-5fa4-43f1-9fff-c91c9a3c013f tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:14.675492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb316-5fa4-43f1-9fff-c91c9a3c013f tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:14.690380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b22ee9-9626-41b8-a4a6-8a2a5fa9524a tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:14.691167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22ee9-9626-41b8-a4a6-8a2a5fa9524a tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:14.692055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22ee9-9626-41b8-a4a6-8a2a5fa9524a tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:14.692333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22ee9-9626-41b8-a4a6-8a2a5fa9524a tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:14.695442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b22ee9-9626-41b8-a4a6-8a2a5fa9524a tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:14.703660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b22ee9-9626-41b8-a4a6-8a2a5fa9524a tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:14.841418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9324f1d-15cf-4b7b-a011-936cc7c927dc tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:14.842428 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2551/5081] 10.222.0.27 () {58 vars in 1131 bytes} [Wed Oct 19 01:06:14 2022] GET /identity/v3/projects => generated 6581 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:14.860109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9324f1d-15cf-4b7b-a011-936cc7c927dc tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:14.870385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:14.871686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:14.872691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:14.873590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:14.876085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-7587750) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:14.876865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:14.879053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:14.905236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b22ee9-9626-41b8-a4a6-8a2a5fa9524a tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:14.917854 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2531/5082] 10.222.0.27 () {58 vars in 1226 bytes} [Wed Oct 19 01:06:14 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-7587750 => generated 528 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:06:14.921269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b22ee9-9626-41b8-a4a6-8a2a5fa9524a tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:14.927410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3087f6dcdb45d395a47f3ad042d9e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fd05e7977584e37bbb37839dafa0564', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:14.928314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:14.928977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:14.929541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] PATH_INFO: `/v3/projects/d013552dd90746bf834d41ba478f1257` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:14.931779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d013552dd90746bf834d41ba478f1257)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:14.934351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:15.014939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd013552dd90746bf834d41ba478f1257', 'request_id': 'req-a6f673bd-8c70-4af1-9abd-880554fe3c22'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.027868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd013552dd90746bf834d41ba478f1257', 'request_id': 'req-a6f673bd-8c70-4af1-9abd-880554fe3c22'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.037841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd013552dd90746bf834d41ba478f1257', 'request_id': 'req-a6f673bd-8c70-4af1-9abd-880554fe3c22'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.055587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] The token cache is being invalidate because project d013552dd90746bf834d41ba478f1257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:15.056021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.057210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.059656 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2552/5083] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:14 2022] DELETE /identity/v3/projects/d013552dd90746bf834d41ba478f1257 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:15.064471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:15.066877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:15.195364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3909a2-f68f-4d90-9450-73eb6aafdd11 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:15.321533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:15.322450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:15.322730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:15.323003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] PATH_INFO: `/v3/users/5a9b1ee40121440ca87e221609f3a2e4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:15.331046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9b1ee40121440ca87e221609f3a2e4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:15.340016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:15.451812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9b1ee40121440ca87e221609f3a2e4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.484985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9b1ee40121440ca87e221609f3a2e4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.499473 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:15.502623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:15.506295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:15.526447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9b1ee40121440ca87e221609f3a2e4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.565880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9b1ee40121440ca87e221609f3a2e4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.566676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04cd02d1-5eaa-46b6-946f-f87bcc55c144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9b1ee40121440ca87e221609f3a2e4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:15.590716 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2532/5084] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:15 2022] DELETE /identity/v3/users/5a9b1ee40121440ca87e221609f3a2e4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:15.598946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c5280-11c3-48f5-8435-8dfbbaa7a92f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:15.599226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c5280-11c3-48f5-8435-8dfbbaa7a92f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:15.599705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c5280-11c3-48f5-8435-8dfbbaa7a92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:15.646169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-664c5280-11c3-48f5-8435-8dfbbaa7a92f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:15.647583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-664c5280-11c3-48f5-8435-8dfbbaa7a92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:15.702700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f673bd-8c70-4af1-9abd-880554fe3c22 tempest-ListProjectsStaticTestJSON-1070471541 tempest-ListProjectsStaticTestJSON-1070471541-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:15.802148 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2533/5085] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:15.816203 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:15.838479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:15.842290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:15.842860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:15.844608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:15.862418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:15.872966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c5280-11c3-48f5-8435-8dfbbaa7a92f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:15.874524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-664c5280-11c3-48f5-8435-8dfbbaa7a92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:15.897537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c5280-11c3-48f5-8435-8dfbbaa7a92f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:15.909917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88578e0f-1f87-43b2-a548-c8ce053e568a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:15.910605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88578e0f-1f87-43b2-a548-c8ce053e568a service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:15.910820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88578e0f-1f87-43b2-a548-c8ce053e568a service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:15.911091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88578e0f-1f87-43b2-a548-c8ce053e568a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:15.940840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88578e0f-1f87-43b2-a548-c8ce053e568a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:15.945967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88578e0f-1f87-43b2-a548-c8ce053e568a service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:15.977894 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2534/5086] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:16.006437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:16.009478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:16.026767 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2553/5087] 10.222.0.27 () {60 vars in 1396 bytes} [Wed Oct 19 01:06:15 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:16.438270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88578e0f-1f87-43b2-a548-c8ce053e568a service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:16.444638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-88578e0f-1f87-43b2-a548-c8ce053e568a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:16.728564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88578e0f-1f87-43b2-a548-c8ce053e568a service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:16.745811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed7149-1d06-4a14-9b94-666e68d09319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:16.746452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed7149-1d06-4a14-9b94-666e68d09319 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:16.746729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed7149-1d06-4a14-9b94-666e68d09319 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:16.746999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed7149-1d06-4a14-9b94-666e68d09319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:16.756473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-42ed7149-1d06-4a14-9b94-666e68d09319 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:16.959116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed7149-1d06-4a14-9b94-666e68d09319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:16.959116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed7149-1d06-4a14-9b94-666e68d09319 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:16.974408 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2535/5088] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:17.528568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:17.534334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:17.599046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c0d8a-e588-43a0-957d-fd1d5fc9143b service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:17.616131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:17.616986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:17.617464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:17.618494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] PATH_INFO: `/v3/users/90ae6a32f99c4aa9861ec9ada939b6bb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:17.625675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ae6a32f99c4aa9861ec9ada939b6bb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:17.634298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:17.801323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ae6a32f99c4aa9861ec9ada939b6bb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:17.837262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ae6a32f99c4aa9861ec9ada939b6bb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:17.851359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ae6a32f99c4aa9861ec9ada939b6bb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:17.866325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ae6a32f99c4aa9861ec9ada939b6bb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:17.868241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ae6a32f99c4aa9861ec9ada939b6bb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:17.890285 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2554/5089] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:17 2022] DELETE /identity/v3/users/90ae6a32f99c4aa9861ec9ada939b6bb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:17.891830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4623b1-13db-4e05-b39f-0656e274c7a2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:17.892347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4623b1-13db-4e05-b39f-0656e274c7a2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:17.892828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4623b1-13db-4e05-b39f-0656e274c7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:17.949938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0e4623b1-13db-4e05-b39f-0656e274c7a2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:17.952846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0e4623b1-13db-4e05-b39f-0656e274c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:17.986302 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:18.184964 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2536/5090] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:18.247271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:18.248785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:18.378702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4623b1-13db-4e05-b39f-0656e274c7a2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:18.380453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0e4623b1-13db-4e05-b39f-0656e274c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:18.407249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4623b1-13db-4e05-b39f-0656e274c7a2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:18.409972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18537ca6-451d-4d93-90b2-0a7456b6987c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:18.417484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9313a-e7b7-4192-b58c-3468f3df666f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:18.418450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:18.419114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:18.419384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:18.419802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] PATH_INFO: `/v3/projects/e21c7c3e9f2147c8910696804f18b174` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:18.423883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9313a-e7b7-4192-b58c-3468f3df666f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:18.424261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9313a-e7b7-4192-b58c-3468f3df666f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:18.424549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9313a-e7b7-4192-b58c-3468f3df666f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:18.427318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21c7c3e9f2147c8910696804f18b174)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:18.429461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:18.465233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9313a-e7b7-4192-b58c-3468f3df666f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:18.466735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9313a-e7b7-4192-b58c-3468f3df666f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:18.510858 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2555/5091] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:18.564838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21c7c3e9f2147c8910696804f18b174', 'request_id': 'req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:18.590713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21c7c3e9f2147c8910696804f18b174', 'request_id': 'req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:18.599824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21c7c3e9f2147c8910696804f18b174', 'request_id': 'req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:18.616819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] The token cache is being invalidate because project e21c7c3e9f2147c8910696804f18b174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:18.617962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:18.619584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:18.622562 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2537/5092] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:18 2022] DELETE /identity/v3/projects/e21c7c3e9f2147c8910696804f18b174 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:18.626362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9313a-e7b7-4192-b58c-3468f3df666f service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:18.642647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9313a-e7b7-4192-b58c-3468f3df666f service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:18.685550 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:18.853158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:18.853879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:18.854231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:18.854793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] PATH_INFO: `/v3/users/4f3087f6dcdb45d395a47f3ad042d9e7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:18.856311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3087f6dcdb45d395a47f3ad042d9e7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:18.859952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:19.034995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3087f6dcdb45d395a47f3ad042d9e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:19.065329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3087f6dcdb45d395a47f3ad042d9e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:19.080977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3087f6dcdb45d395a47f3ad042d9e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:19.094084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3087f6dcdb45d395a47f3ad042d9e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:19.094978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3087f6dcdb45d395a47f3ad042d9e7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:19.106715 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2556/5093] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:18 2022] DELETE /identity/v3/users/4f3087f6dcdb45d395a47f3ad042d9e7 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:21.623416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:21.626079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:21.657215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae461c41-6c5f-49fe-8a5c-43058b0c7f5a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:21.695765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:21.697586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:21.866684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:21.867884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:21.868240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:21.868449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] PATH_INFO: `/v3/projects/76324c71e5b8454eacc51f54b8dc1a60` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:21.869853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76324c71e5b8454eacc51f54b8dc1a60)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:21.876337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227abca-2669-4e4a-ba1e-455533ffa1d3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:21.877697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:21.888245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:21.889141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:21.889512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:21.889788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] PATH_INFO: `/v3/projects/0fd05e7977584e37bbb37839dafa0564` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:21.891137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd05e7977584e37bbb37839dafa0564)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:21.895608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:22.004696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76324c71e5b8454eacc51f54b8dc1a60', 'request_id': 'req-06384164-4510-414d-86a4-2d14e1d53dd5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.006668 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:22.024038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76324c71e5b8454eacc51f54b8dc1a60', 'request_id': 'req-06384164-4510-414d-86a4-2d14e1d53dd5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.038141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76324c71e5b8454eacc51f54b8dc1a60', 'request_id': 'req-06384164-4510-414d-86a4-2d14e1d53dd5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.062986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] The token cache is being invalidate because project 76324c71e5b8454eacc51f54b8dc1a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:22.063494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.065293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06384164-4510-414d-86a4-2d14e1d53dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.067214 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2538/5094] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:21 2022] DELETE /identity/v3/projects/76324c71e5b8454eacc51f54b8dc1a60 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:06:22.075443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46054e-929c-432d-8664-5caf8947ff0d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.075988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46054e-929c-432d-8664-5caf8947ff0d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.076423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46054e-929c-432d-8664-5caf8947ff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.091826 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:22.123923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd05e7977584e37bbb37839dafa0564', 'request_id': 'req-42d56506-37b8-4705-9e57-3a3e163c2d46'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.134175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6d46054e-929c-432d-8664-5caf8947ff0d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:22.138030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6d46054e-929c-432d-8664-5caf8947ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:22.141539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd05e7977584e37bbb37839dafa0564', 'request_id': 'req-42d56506-37b8-4705-9e57-3a3e163c2d46'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.153837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd05e7977584e37bbb37839dafa0564', 'request_id': 'req-42d56506-37b8-4705-9e57-3a3e163c2d46'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.186861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] The token cache is being invalidate because project 0fd05e7977584e37bbb37839dafa0564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:22.187158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.188182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42d56506-37b8-4705-9e57-3a3e163c2d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:22.192825 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2557/5095] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:21 2022] DELETE /identity/v3/projects/0fd05e7977584e37bbb37839dafa0564 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:22.212894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd79b-df98-4658-8f6d-c224fe38c43d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.213302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd79b-df98-4658-8f6d-c224fe38c43d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.213583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd79b-df98-4658-8f6d-c224fe38c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.284162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a4dcd79b-df98-4658-8f6d-c224fe38c43d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:22.286239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a4dcd79b-df98-4658-8f6d-c224fe38c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:22.329735 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2539/5096] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:22.338731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09d89-bc0a-4e68-9aa6-eb67e7bd0351 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.339182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09d89-bc0a-4e68-9aa6-eb67e7bd0351 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.339610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09d89-bc0a-4e68-9aa6-eb67e7bd0351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.373354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bfb09d89-bc0a-4e68-9aa6-eb67e7bd0351 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:22.375155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bfb09d89-bc0a-4e68-9aa6-eb67e7bd0351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:22.387967 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2540/5097] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:22.406194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09d89-bc0a-4e68-9aa6-eb67e7bd0351 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:22.417700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09d89-bc0a-4e68-9aa6-eb67e7bd0351 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:22.423995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61b75-9b0b-44d6-b5ce-ac0d9326b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:22.424737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61b75-9b0b-44d6-b5ce-ac0d9326b115 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.425117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61b75-9b0b-44d6-b5ce-ac0d9326b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.425531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61b75-9b0b-44d6-b5ce-ac0d9326b115 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.426258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf61b75-9b0b-44d6-b5ce-ac0d9326b115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:22.426649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf61b75-9b0b-44d6-b5ce-ac0d9326b115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:22.428835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf61b75-9b0b-44d6-b5ce-ac0d9326b115 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:22.431190 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2558/5098] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:22.438777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735669f-8fe4-475e-9279-300445d39aaf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.439061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735669f-8fe4-475e-9279-300445d39aaf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.439338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735669f-8fe4-475e-9279-300445d39aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.459717 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2541/5099] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:06:22.464192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61b75-9b0b-44d6-b5ce-ac0d9326b115 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:22.477403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4735669f-8fe4-475e-9279-300445d39aaf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:22.478637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4735669f-8fe4-475e-9279-300445d39aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:22.487231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61b75-9b0b-44d6-b5ce-ac0d9326b115 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:22.493638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f342-a5e2-491c-ad28-093d45b71918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:22.495905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f342-a5e2-491c-ad28-093d45b71918 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.497114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f342-a5e2-491c-ad28-093d45b71918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.497547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f342-a5e2-491c-ad28-093d45b71918 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.498344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611f342-a5e2-491c-ad28-093d45b71918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:22.501025 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2559/5100] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:22.504600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611f342-a5e2-491c-ad28-093d45b71918 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:22.504970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735669f-8fe4-475e-9279-300445d39aaf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:22.530327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735669f-8fe4-475e-9279-300445d39aaf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:22.549361 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2542/5101] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:22 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:22.550361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ff19-ee05-4e0e-b01f-de658b86d3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:22.550518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f342-a5e2-491c-ad28-093d45b71918 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:22.550994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ff19-ee05-4e0e-b01f-de658b86d3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.551275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ff19-ee05-4e0e-b01f-de658b86d3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.551546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ff19-ee05-4e0e-b01f-de658b86d3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.552198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4ff19-ee05-4e0e-b01f-de658b86d3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:22.552499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4ff19-ee05-4e0e-b01f-de658b86d3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:22.554171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4ff19-ee05-4e0e-b01f-de658b86d3a1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:22.588339 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2560/5102] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:06:22.589729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ff19-ee05-4e0e-b01f-de658b86d3a1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:22.609897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ff19-ee05-4e0e-b01f-de658b86d3a1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:22.683014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f342-a5e2-491c-ad28-093d45b71918 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:22.701131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d90dc-5e72-401a-a0a0-75a2aace4e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:22.703139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d90dc-5e72-401a-a0a0-75a2aace4e2d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.703450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d90dc-5e72-401a-a0a0-75a2aace4e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.705319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d90dc-5e72-401a-a0a0-75a2aace4e2d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.705989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d90dc-5e72-401a-a0a0-75a2aace4e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:22.707939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d90dc-5e72-401a-a0a0-75a2aace4e2d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:22.790474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df56b3b-eb74-47fb-b2bb-53c068ed13e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:22.791650 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2543/5103] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:22 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:06:22.792067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56b3b-eb74-47fb-b2bb-53c068ed13e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.793513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d90dc-5e72-401a-a0a0-75a2aace4e2d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:22.794317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56b3b-eb74-47fb-b2bb-53c068ed13e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.794602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56b3b-eb74-47fb-b2bb-53c068ed13e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.795261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df56b3b-eb74-47fb-b2bb-53c068ed13e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:22.803425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df56b3b-eb74-47fb-b2bb-53c068ed13e4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:22.821888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d90dc-5e72-401a-a0a0-75a2aace4e2d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:22.841213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b06bde-c02e-4b6b-9527-73b09f19102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:22.841880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06bde-c02e-4b6b-9527-73b09f19102a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:22.842111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06bde-c02e-4b6b-9527-73b09f19102a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:22.842381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06bde-c02e-4b6b-9527-73b09f19102a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:22.845628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b06bde-c02e-4b6b-9527-73b09f19102a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:22.856810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b06bde-c02e-4b6b-9527-73b09f19102a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:22.900942 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2561/5104] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:22 2022] POST /identity/v3/projects => generated 377 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:22.901897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df56b3b-eb74-47fb-b2bb-53c068ed13e4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:22.903869 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2544/5105] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:22.907588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b06bde-c02e-4b6b-9527-73b09f19102a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:22.942542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b06bde-c02e-4b6b-9527-73b09f19102a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:22.986854 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:23.030543 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:23.128644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df56b3b-eb74-47fb-b2bb-53c068ed13e4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:23.142176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67a45b-f842-46c4-a114-aeeb50f879ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:23.142790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67a45b-f842-46c4-a114-aeeb50f879ad admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:23.143072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67a45b-f842-46c4-a114-aeeb50f879ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:23.143344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67a45b-f842-46c4-a114-aeeb50f879ad admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:23.143983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67a45b-f842-46c4-a114-aeeb50f879ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:23.146198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67a45b-f842-46c4-a114-aeeb50f879ad admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:23.147800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4321fa-6d7f-4751-a94c-2f9fcfdef4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:23.149117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4321fa-6d7f-4751-a94c-2f9fcfdef4af admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:23.149527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4321fa-6d7f-4751-a94c-2f9fcfdef4af admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:23.149897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4321fa-6d7f-4751-a94c-2f9fcfdef4af admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:23.150665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4321fa-6d7f-4751-a94c-2f9fcfdef4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:23.154852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4321fa-6d7f-4751-a94c-2f9fcfdef4af admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:23.180920 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2545/5106] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:23.182123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4321fa-6d7f-4751-a94c-2f9fcfdef4af admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:23.190792 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2562/5107] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:22 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:23.194751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67a45b-f842-46c4-a114-aeeb50f879ad admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:23.206930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4321fa-6d7f-4751-a94c-2f9fcfdef4af admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:23.218291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67a45b-f842-46c4-a114-aeeb50f879ad admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:23.229415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373c6e3-1832-44f4-a1e1-79965ef0d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:23.230052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373c6e3-1832-44f4-a1e1-79965ef0d3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:23.230334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373c6e3-1832-44f4-a1e1-79965ef0d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:23.230603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373c6e3-1832-44f4-a1e1-79965ef0d3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:23.231260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373c6e3-1832-44f4-a1e1-79965ef0d3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:23.232922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373c6e3-1832-44f4-a1e1-79965ef0d3e9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:23.246394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cc1ce-7a4a-4759-beaa-62a7426bc2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:23.247282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cc1ce-7a4a-4759-beaa-62a7426bc2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:23.247677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cc1ce-7a4a-4759-beaa-62a7426bc2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:23.248592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cc1ce-7a4a-4759-beaa-62a7426bc2e3 admin admin] PATH_INFO: `/v3/projects/44453298a7d04311bd64354938bf2431/users/2052fd7bb1ee432cb3ca4ec07698292c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:23.267029 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2563/5108] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:06:23.281674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373c6e3-1832-44f4-a1e1-79965ef0d3e9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:23.297394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cc1ce-7a4a-4759-beaa-62a7426bc2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44453298a7d04311bd64354938bf2431, user_id=2052fd7bb1ee432cb3ca4ec07698292c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:23.302943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cc1ce-7a4a-4759-beaa-62a7426bc2e3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:23.327663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373c6e3-1832-44f4-a1e1-79965ef0d3e9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:23.341486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9e61c-f86e-4a89-bd05-9a3f7d55f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:23.342464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9e61c-f86e-4a89-bd05-9a3f7d55f505 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:23.342916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9e61c-f86e-4a89-bd05-9a3f7d55f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:23.343355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9e61c-f86e-4a89-bd05-9a3f7d55f505 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:23.344161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9e61c-f86e-4a89-bd05-9a3f7d55f505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:23.346011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9e61c-f86e-4a89-bd05-9a3f7d55f505 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:23.356811 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2546/5109] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:23 2022] PUT /identity/v3/projects/44453298a7d04311bd64354938bf2431/users/2052fd7bb1ee432cb3ca4ec07698292c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:23.362735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6596-bbcc-4d41-a024-98b371675ac3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:23.363302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6596-bbcc-4d41-a024-98b371675ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:23.363468 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2564/5110] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:23.363802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6596-bbcc-4d41-a024-98b371675ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:23.364934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9e61c-f86e-4a89-bd05-9a3f7d55f505 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:23.388836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9e61c-f86e-4a89-bd05-9a3f7d55f505 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:23.436841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-02af6596-bbcc-4d41-a024-98b371675ac3 None None] MFA Rules not processed for user `2052fd7bb1ee432cb3ca4ec07698292c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:23.439036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-02af6596-bbcc-4d41-a024-98b371675ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:23.545904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a3093-f11e-431d-a60f-dce959f7bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:23.546604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3093-f11e-431d-a60f-dce959f7bc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:23.546886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3093-f11e-431d-a60f-dce959f7bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:23.547163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3093-f11e-431d-a60f-dce959f7bc23 admin admin] PATH_INFO: `/v3/projects/ec777cb7a9d34e3eab37bedd84064dee/users/dfd82f5f6a4c4d198e02fac14fc7d3aa/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:23.610221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a3093-f11e-431d-a60f-dce959f7bc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec777cb7a9d34e3eab37bedd84064dee, user_id=dfd82f5f6a4c4d198e02fac14fc7d3aa, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:23.613020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a3093-f11e-431d-a60f-dce959f7bc23 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:23.624206 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2547/5111] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:23.627204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6596-bbcc-4d41-a024-98b371675ac3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:23.639209 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2565/5112] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:23 2022] PUT /identity/v3/projects/ec777cb7a9d34e3eab37bedd84064dee/users/dfd82f5f6a4c4d198e02fac14fc7d3aa/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:23.652884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9b3c5-de13-46bf-b8c3-f419aa2f668c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:23.653239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9b3c5-de13-46bf-b8c3-f419aa2f668c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:23.653440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9b3c5-de13-46bf-b8c3-f419aa2f668c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:23.672565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6596-bbcc-4d41-a024-98b371675ac3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:23.723095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-13a9b3c5-de13-46bf-b8c3-f419aa2f668c None None] MFA Rules not processed for user `dfd82f5f6a4c4d198e02fac14fc7d3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:23.724346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-13a9b3c5-de13-46bf-b8c3-f419aa2f668c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:23.830602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ea4b-1c17-4f6b-a816-cbd9b7987c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:23.832888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ea4b-1c17-4f6b-a816-cbd9b7987c00 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:23.833168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ea4b-1c17-4f6b-a816-cbd9b7987c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:23.833439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ea4b-1c17-4f6b-a816-cbd9b7987c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:23.836583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147ea4b-1c17-4f6b-a816-cbd9b7987c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:23.845587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147ea4b-1c17-4f6b-a816-cbd9b7987c00 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:23.914796 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2566/5113] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:23.919707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9b3c5-de13-46bf-b8c3-f419aa2f668c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:23.929915 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2548/5114] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:23 2022] POST /identity/v3/projects => generated 391 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:23.930775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9b3c5-de13-46bf-b8c3-f419aa2f668c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:23.931461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ea4b-1c17-4f6b-a816-cbd9b7987c00 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:23.941836 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:23.982799 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:24.076322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287de7b-75fa-4438-bcc6-a6c196c041cf tempest-DefaultDomainTestJSON-723926146 tempest-DefaultDomainTestJSON-723926146-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfd82f5f6a4c4d198e02fac14fc7d3aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec777cb7a9d34e3eab37bedd84064dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:24.077002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287de7b-75fa-4438-bcc6-a6c196c041cf tempest-DefaultDomainTestJSON-723926146 tempest-DefaultDomainTestJSON-723926146-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:24.077287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287de7b-75fa-4438-bcc6-a6c196c041cf tempest-DefaultDomainTestJSON-723926146 tempest-DefaultDomainTestJSON-723926146-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:24.077566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287de7b-75fa-4438-bcc6-a6c196c041cf tempest-DefaultDomainTestJSON-723926146 tempest-DefaultDomainTestJSON-723926146-project] PATH_INFO: `/v3/domains/default` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:24.079226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287de7b-75fa-4438-bcc6-a6c196c041cf tempest-DefaultDomainTestJSON-723926146 tempest-DefaultDomainTestJSON-723926146-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:24.081234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287de7b-75fa-4438-bcc6-a6c196c041cf tempest-DefaultDomainTestJSON-723926146 tempest-DefaultDomainTestJSON-723926146-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:24.088145 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2567/5115] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 01:06:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:06:24.089362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287de7b-75fa-4438-bcc6-a6c196c041cf tempest-DefaultDomainTestJSON-723926146 tempest-DefaultDomainTestJSON-723926146-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:24.205271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ea4b-1c17-4f6b-a816-cbd9b7987c00 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:24.220705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495124-251e-4e5b-9ce3-70728a21c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:24.224750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495124-251e-4e5b-9ce3-70728a21c8ed admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:24.224750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495124-251e-4e5b-9ce3-70728a21c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:24.224750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495124-251e-4e5b-9ce3-70728a21c8ed admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:24.224750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495124-251e-4e5b-9ce3-70728a21c8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:24.224750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495124-251e-4e5b-9ce3-70728a21c8ed admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:24.260717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287de7b-75fa-4438-bcc6-a6c196c041cf tempest-DefaultDomainTestJSON-723926146 tempest-DefaultDomainTestJSON-723926146-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:24.273207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:24.273871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:24.274148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:24.274421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] PATH_INFO: `/v3/users/dfd82f5f6a4c4d198e02fac14fc7d3aa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:24.275604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd82f5f6a4c4d198e02fac14fc7d3aa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:24.279094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:24.298456 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2549/5116] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:23 2022] POST /identity/v3/users => generated 302 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:24.311144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495124-251e-4e5b-9ce3-70728a21c8ed admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:24.350305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495124-251e-4e5b-9ce3-70728a21c8ed admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:24.369352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e1737-7047-4817-bd1c-38a57b0a6c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:24.369987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e1737-7047-4817-bd1c-38a57b0a6c19 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:24.370263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e1737-7047-4817-bd1c-38a57b0a6c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:24.370536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e1737-7047-4817-bd1c-38a57b0a6c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:24.371184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e1737-7047-4817-bd1c-38a57b0a6c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:24.377483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e1737-7047-4817-bd1c-38a57b0a6c19 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:24.410053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd82f5f6a4c4d198e02fac14fc7d3aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:24.424829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd82f5f6a4c4d198e02fac14fc7d3aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:24.436520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd82f5f6a4c4d198e02fac14fc7d3aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:24.438726 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2550/5117] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:24.439339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e1737-7047-4817-bd1c-38a57b0a6c19 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:24.458643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd82f5f6a4c4d198e02fac14fc7d3aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:24.460298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-586795f2-3fb1-4cdf-8583-6a0c3b0b6e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd82f5f6a4c4d198e02fac14fc7d3aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:24.478850 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2568/5118] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:24 2022] DELETE /identity/v3/users/dfd82f5f6a4c4d198e02fac14fc7d3aa => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:24.483352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d3d1e-22b2-47f8-9679-d953d41d06c3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:24.483833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d3d1e-22b2-47f8-9679-d953d41d06c3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:24.484329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d3d1e-22b2-47f8-9679-d953d41d06c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:24.486161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e1737-7047-4817-bd1c-38a57b0a6c19 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:24.535040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ea0d3d1e-22b2-47f8-9679-d953d41d06c3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:24.538867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea0d3d1e-22b2-47f8-9679-d953d41d06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:24.631764 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:24.635084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060160a2-d67a-47a8-813f-2c7f8a62e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:24.636079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060160a2-d67a-47a8-813f-2c7f8a62e509 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:24.636528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060160a2-d67a-47a8-813f-2c7f8a62e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:24.636983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060160a2-d67a-47a8-813f-2c7f8a62e509 admin admin] PATH_INFO: `/v3/projects/8c8fc0312ad4431da003046209628ef5/users/0e9884a2aa304ed6b241e20dcbc852ff/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:24.677709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060160a2-d67a-47a8-813f-2c7f8a62e509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8fc0312ad4431da003046209628ef5, user_id=0e9884a2aa304ed6b241e20dcbc852ff, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:24.688313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060160a2-d67a-47a8-813f-2c7f8a62e509 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:24.702508 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2569/5119] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:24.719951 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2551/5120] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:24 2022] PUT /identity/v3/projects/8c8fc0312ad4431da003046209628ef5/users/0e9884a2aa304ed6b241e20dcbc852ff/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:24.723323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d3d1e-22b2-47f8-9679-d953d41d06c3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:24.725028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea0d3d1e-22b2-47f8-9679-d953d41d06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:24.746422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d3d1e-22b2-47f8-9679-d953d41d06c3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:24.878806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060160a2-d67a-47a8-813f-2c7f8a62e509 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:24.881452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-060160a2-d67a-47a8-813f-2c7f8a62e509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:24.965923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15d961-537d-4b4e-a7a8-b4343b18a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:24.966733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15d961-537d-4b4e-a7a8-b4343b18a41d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:24.967183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15d961-537d-4b4e-a7a8-b4343b18a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:24.969660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15d961-537d-4b4e-a7a8-b4343b18a41d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:24.972895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15d961-537d-4b4e-a7a8-b4343b18a41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:24.977008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15d961-537d-4b4e-a7a8-b4343b18a41d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:25.018618 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2570/5121] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:25.020509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15d961-537d-4b4e-a7a8-b4343b18a41d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:25.064013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15d961-537d-4b4e-a7a8-b4343b18a41d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:25.096549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ca2fd-740b-4f1f-bba8-14d9eec65fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:25.097466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ca2fd-740b-4f1f-bba8-14d9eec65fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:25.097900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ca2fd-740b-4f1f-bba8-14d9eec65fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:25.098314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ca2fd-740b-4f1f-bba8-14d9eec65fcc admin admin] PATH_INFO: `/v3/projects/8c8fc0312ad4431da003046209628ef5/users/0e9884a2aa304ed6b241e20dcbc852ff/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:25.114419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ca2fd-740b-4f1f-bba8-14d9eec65fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8fc0312ad4431da003046209628ef5, user_id=0e9884a2aa304ed6b241e20dcbc852ff, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:25.120907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060160a2-d67a-47a8-813f-2c7f8a62e509 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:25.123729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ca2fd-740b-4f1f-bba8-14d9eec65fcc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:25.135702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1eb1-c9f3-4bdd-aeee-a72842fb2050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:25.136496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1eb1-c9f3-4bdd-aeee-a72842fb2050 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:25.136963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1eb1-c9f3-4bdd-aeee-a72842fb2050 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:25.137349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1eb1-c9f3-4bdd-aeee-a72842fb2050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:25.167818 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2571/5122] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:25 2022] PUT /identity/v3/projects/8c8fc0312ad4431da003046209628ef5/users/0e9884a2aa304ed6b241e20dcbc852ff/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:25.182862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0cce-236d-41c7-a862-e1a2f466da6a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:25.183982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b1eb1-c9f3-4bdd-aeee-a72842fb2050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:25.184362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0cce-236d-41c7-a862-e1a2f466da6a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:25.184798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0cce-236d-41c7-a862-e1a2f466da6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:25.189229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b1eb1-c9f3-4bdd-aeee-a72842fb2050 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:25.229312 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2552/5123] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:06:25.266636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fa4b0cce-236d-41c7-a862-e1a2f466da6a None None] MFA Rules not processed for user `0e9884a2aa304ed6b241e20dcbc852ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:25.268134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fa4b0cce-236d-41c7-a862-e1a2f466da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:25.480633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1eb1-c9f3-4bdd-aeee-a72842fb2050 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:25.482337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a12b1eb1-c9f3-4bdd-aeee-a72842fb2050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:25.483668 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2572/5124] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:25.514796 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:25.679005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1eb1-c9f3-4bdd-aeee-a72842fb2050 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:25.866521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710edf-2f6e-4b97-b25c-5065c5a8db3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:25.867354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710edf-2f6e-4b97-b25c-5065c5a8db3c service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:25.867744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710edf-2f6e-4b97-b25c-5065c5a8db3c service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:25.868250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710edf-2f6e-4b97-b25c-5065c5a8db3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:25.875626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6f710edf-2f6e-4b97-b25c-5065c5a8db3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:26.021529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f710edf-2f6e-4b97-b25c-5065c5a8db3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:26.024397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f710edf-2f6e-4b97-b25c-5065c5a8db3c service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:26.075766 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2553/5125] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:06:29.453769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b0cce-236d-41c7-a862-e1a2f466da6a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:29.455858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fa4b0cce-236d-41c7-a862-e1a2f466da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:29.682672 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:29.729353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b0cce-236d-41c7-a862-e1a2f466da6a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:29.754990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:29.756355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:29.756798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:29.757746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] PATH_INFO: `/v3/projects/ec777cb7a9d34e3eab37bedd84064dee` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:29.765731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec777cb7a9d34e3eab37bedd84064dee)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:29.768227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:29.919270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec777cb7a9d34e3eab37bedd84064dee', 'request_id': 'req-04e3f032-5086-49da-a72f-5784f7308070'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:29.933810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec777cb7a9d34e3eab37bedd84064dee', 'request_id': 'req-04e3f032-5086-49da-a72f-5784f7308070'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:29.952513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953064a-fabe-43dc-a9ef-206b9ff4d0a2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:29.953712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953064a-fabe-43dc-a9ef-206b9ff4d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:29.954481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953064a-fabe-43dc-a9ef-206b9ff4d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:29.994379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec777cb7a9d34e3eab37bedd84064dee', 'request_id': 'req-04e3f032-5086-49da-a72f-5784f7308070'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:30.038180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] The token cache is being invalidate because project ec777cb7a9d34e3eab37bedd84064dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:30.038721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:30.039533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04e3f032-5086-49da-a72f-5784f7308070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:30.056762 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2573/5126] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:29 2022] DELETE /identity/v3/projects/ec777cb7a9d34e3eab37bedd84064dee => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:30.058621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff51884-6dba-4b09-b28f-7ee0c8bff536 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:30.058988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff51884-6dba-4b09-b28f-7ee0c8bff536 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:30.059341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff51884-6dba-4b09-b28f-7ee0c8bff536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:30.060779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8953064a-fabe-43dc-a9ef-206b9ff4d0a2 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:30.062222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8953064a-fabe-43dc-a9ef-206b9ff4d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:30.108555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9ff51884-6dba-4b09-b28f-7ee0c8bff536 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:30.109948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9ff51884-6dba-4b09-b28f-7ee0c8bff536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:30.145019 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:30.231460 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2554/5127] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:30.243577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0f143-7aca-4f24-bc50-222b61253ad8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:30.244153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0f143-7aca-4f24-bc50-222b61253ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:30.244614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0f143-7aca-4f24-bc50-222b61253ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:30.291041 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2574/5128] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:30.298549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d816d-dc3f-4045-acc6-0b89111b77b4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:30.298882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d816d-dc3f-4045-acc6-0b89111b77b4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:30.299269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d816d-dc3f-4045-acc6-0b89111b77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:30.305317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3aa0f143-7aca-4f24-bc50-222b61253ad8 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:30.306880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3aa0f143-7aca-4f24-bc50-222b61253ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:30.319595 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2555/5129] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:30.332382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0f143-7aca-4f24-bc50-222b61253ad8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:30.333825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3aa0f143-7aca-4f24-bc50-222b61253ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:30.357020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4b9d816d-dc3f-4045-acc6-0b89111b77b4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:30.358961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4b9d816d-dc3f-4045-acc6-0b89111b77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:30.397398 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2575/5130] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:30.399341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d816d-dc3f-4045-acc6-0b89111b77b4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:30.428349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d816d-dc3f-4045-acc6-0b89111b77b4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:30.447732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4508a-aeff-4b45-9001-e60c31195140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:30.448438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4508a-aeff-4b45-9001-e60c31195140 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:30.448899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4508a-aeff-4b45-9001-e60c31195140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:30.449322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4508a-aeff-4b45-9001-e60c31195140 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:30.450058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4508a-aeff-4b45-9001-e60c31195140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:30.450465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4508a-aeff-4b45-9001-e60c31195140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:30.456603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4508a-aeff-4b45-9001-e60c31195140 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:30.502019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0f143-7aca-4f24-bc50-222b61253ad8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:30.506298 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2576/5131] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:06:30.509823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4508a-aeff-4b45-9001-e60c31195140 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:30.522641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69183a8c-d20c-4415-b3ff-66ad9a519763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:30.524944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69183a8c-d20c-4415-b3ff-66ad9a519763 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:30.525386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69183a8c-d20c-4415-b3ff-66ad9a519763 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:30.525836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69183a8c-d20c-4415-b3ff-66ad9a519763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:30.531991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4508a-aeff-4b45-9001-e60c31195140 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:30.540443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d4167-cd9d-45f8-be39-5be14535eb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:30.541949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d4167-cd9d-45f8-be39-5be14535eb73 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:30.542367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d4167-cd9d-45f8-be39-5be14535eb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:30.542818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d4167-cd9d-45f8-be39-5be14535eb73 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:30.543648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d4167-cd9d-45f8-be39-5be14535eb73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:30.546217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d4167-cd9d-45f8-be39-5be14535eb73 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:30.568818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69183a8c-d20c-4415-b3ff-66ad9a519763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:30.572202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69183a8c-d20c-4415-b3ff-66ad9a519763 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:30.613123 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2556/5132] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:30.686615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2577/5133] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:30 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:30.686986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69183a8c-d20c-4415-b3ff-66ad9a519763 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:30.704893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69183a8c-d20c-4415-b3ff-66ad9a519763 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:30.938476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb701b7d-0190-416a-a35d-80f643e401ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:30.939146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb701b7d-0190-416a-a35d-80f643e401ff admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:30.939528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb701b7d-0190-416a-a35d-80f643e401ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:30.939926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb701b7d-0190-416a-a35d-80f643e401ff admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:30.940526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb701b7d-0190-416a-a35d-80f643e401ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:30.949428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb701b7d-0190-416a-a35d-80f643e401ff admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:30.995422 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2557/5134] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:30 2022] POST /identity/v3/users => generated 281 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:06:30.998953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d4167-cd9d-45f8-be39-5be14535eb73 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:31.019586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d4167-cd9d-45f8-be39-5be14535eb73 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:31.032742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3acb48-3859-4c7a-a1e3-37340e3d6064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:31.033371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3acb48-3859-4c7a-a1e3-37340e3d6064 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.033651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3acb48-3859-4c7a-a1e3-37340e3d6064 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.033930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3acb48-3859-4c7a-a1e3-37340e3d6064 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.034578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3acb48-3859-4c7a-a1e3-37340e3d6064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:31.050060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3acb48-3859-4c7a-a1e3-37340e3d6064 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:31.075594 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2578/5135] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:31.079590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb701b7d-0190-416a-a35d-80f643e401ff admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:31.106521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb701b7d-0190-416a-a35d-80f643e401ff admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:31.118026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfa22e-8c20-45b1-8453-e48cc196665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:31.118917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfa22e-8c20-45b1-8453-e48cc196665e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.119969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfa22e-8c20-45b1-8453-e48cc196665e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.120406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfa22e-8c20-45b1-8453-e48cc196665e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.121320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfa22e-8c20-45b1-8453-e48cc196665e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:31.123445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfa22e-8c20-45b1-8453-e48cc196665e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:31.148179 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2558/5136] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:31.153255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3acb48-3859-4c7a-a1e3-37340e3d6064 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:31.171233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3acb48-3859-4c7a-a1e3-37340e3d6064 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:31.184835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f9ccd-70c0-4e9d-833b-a81d82649676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:31.185823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f9ccd-70c0-4e9d-833b-a81d82649676 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.187241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f9ccd-70c0-4e9d-833b-a81d82649676 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.189745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f9ccd-70c0-4e9d-833b-a81d82649676 admin admin] PATH_INFO: `/v3/projects/f006123258d74fd9b29b2f741a416243/users/da3bdbf8403341bf8cb51a1544e8d974/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.235746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f9ccd-70c0-4e9d-833b-a81d82649676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f006123258d74fd9b29b2f741a416243, user_id=da3bdbf8403341bf8cb51a1544e8d974, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:31.244433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f9ccd-70c0-4e9d-833b-a81d82649676 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:31.271493 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2579/5137] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:31 2022] PUT /identity/v3/projects/f006123258d74fd9b29b2f741a416243/users/da3bdbf8403341bf8cb51a1544e8d974/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:31.282564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdafc5-788b-4cdc-a5ae-acdcd30cbbe5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.283704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdafc5-788b-4cdc-a5ae-acdcd30cbbe5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.284139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdafc5-788b-4cdc-a5ae-acdcd30cbbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.377192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9cbdafc5-788b-4cdc-a5ae-acdcd30cbbe5 None None] MFA Rules not processed for user `da3bdbf8403341bf8cb51a1544e8d974`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:31.378441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9cbdafc5-788b-4cdc-a5ae-acdcd30cbbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:31.423451 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:31.563387 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2559/5138] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:31.570449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b0936-9c78-46fe-af00-43e69a42acd3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.570449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b0936-9c78-46fe-af00-43e69a42acd3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.571065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b0936-9c78-46fe-af00-43e69a42acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.579593 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:31.606529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6e9b0936-9c78-46fe-af00-43e69a42acd3 None None] MFA Rules not processed for user `da3bdbf8403341bf8cb51a1544e8d974`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:31.607970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6e9b0936-9c78-46fe-af00-43e69a42acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:31.625194 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2580/5139] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:31 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:06:31.626989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa84f3-f8c1-4e56-ae28-948466014bbd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.627280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa84f3-f8c1-4e56-ae28-948466014bbd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.627557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa84f3-f8c1-4e56-ae28-948466014bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.661556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-50fa84f3-f8c1-4e56-ae28-948466014bbd None None] MFA Rules not processed for user `da3bdbf8403341bf8cb51a1544e8d974`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:31.662960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-50fa84f3-f8c1-4e56-ae28-948466014bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:31.674927 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2560/5140] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:31 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:06:31.676173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b0936-9c78-46fe-af00-43e69a42acd3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:31.693058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b0936-9c78-46fe-af00-43e69a42acd3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:31.703696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc39da8-2d50-42df-a00b-9435bf225e05 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3bdbf8403341bf8cb51a1544e8d974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f006123258d74fd9b29b2f741a416243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:31.704384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc39da8-2d50-42df-a00b-9435bf225e05 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.705032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc39da8-2d50-42df-a00b-9435bf225e05 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.705321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc39da8-2d50-42df-a00b-9435bf225e05 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.724080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc39da8-2d50-42df-a00b-9435bf225e05 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorizing `identity:check_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:31.725362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc39da8-2d50-42df-a00b-9435bf225e05 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:31.747706 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2581/5141] 10.222.0.27 () {56 vars in 1264 bytes} [Wed Oct 19 01:06:31 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 19 01:06:31.749037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa84f3-f8c1-4e56-ae28-948466014bbd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:31.770220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa84f3-f8c1-4e56-ae28-948466014bbd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:31.785041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42eaa1-5c73-4f10-b6e1-2fd6100e4ca4 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3bdbf8403341bf8cb51a1544e8d974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f006123258d74fd9b29b2f741a416243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:31.786609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42eaa1-5c73-4f10-b6e1-2fd6100e4ca4 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.786951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42eaa1-5c73-4f10-b6e1-2fd6100e4ca4 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.787240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42eaa1-5c73-4f10-b6e1-2fd6100e4ca4 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.810740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42eaa1-5c73-4f10-b6e1-2fd6100e4ca4 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:31.812894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42eaa1-5c73-4f10-b6e1-2fd6100e4ca4 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:31.843777 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2561/5142] 10.222.0.27 () {56 vars in 1263 bytes} [Wed Oct 19 01:06:31 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:31.847983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc39da8-2d50-42df-a00b-9435bf225e05 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:31.864866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc39da8-2d50-42df-a00b-9435bf225e05 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:31.875910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dcb23-e8ae-4c23-b9db-49db0d6babbe tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3bdbf8403341bf8cb51a1544e8d974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f006123258d74fd9b29b2f741a416243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:31.876561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dcb23-e8ae-4c23-b9db-49db0d6babbe tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.876874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dcb23-e8ae-4c23-b9db-49db0d6babbe tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.877441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dcb23-e8ae-4c23-b9db-49db0d6babbe tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.905816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dcb23-e8ae-4c23-b9db-49db0d6babbe tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:31.908059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dcb23-e8ae-4c23-b9db-49db0d6babbe tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:31.946473 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2582/5143] 10.222.0.27 () {56 vars in 1266 bytes} [Wed Oct 19 01:06:31 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:31.950691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42eaa1-5c73-4f10-b6e1-2fd6100e4ca4 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:31.963783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42eaa1-5c73-4f10-b6e1-2fd6100e4ca4 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:31.973401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef8a2f-5178-425b-8a79-606d3d6ebdb1 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3bdbf8403341bf8cb51a1544e8d974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f006123258d74fd9b29b2f741a416243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:31.974073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef8a2f-5178-425b-8a79-606d3d6ebdb1 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:31.974357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef8a2f-5178-425b-8a79-606d3d6ebdb1 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:31.974968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef8a2f-5178-425b-8a79-606d3d6ebdb1 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:31.978420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6cef8a2f-5178-425b-8a79-606d3d6ebdb1 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-6cef8a2f-5178-425b-8a79-606d3d6ebdb1 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 19 01:06:32.020397 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 19 01:06:32.021939 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 19 01:06:32.023865 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:06:32.023865 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:06:32.023865 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 19 01:06:32.023865 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 19 01:06:32.023865 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 19 01:06:32.023865 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:06:32.023865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2562/5144] 10.222.0.27 () {56 vars in 1264 bytes} [Wed Oct 19 01:06:31 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 19 01:06:32.030458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198db8-222c-48b8-b2e7-7435e1b4ca32 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:32.030757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198db8-222c-48b8-b2e7-7435e1b4ca32 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:32.031063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198db8-222c-48b8-b2e7-7435e1b4ca32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:32.071995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-25198db8-222c-48b8-b2e7-7435e1b4ca32 None None] MFA Rules not processed for user `da3bdbf8403341bf8cb51a1544e8d974`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:32.073242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-25198db8-222c-48b8-b2e7-7435e1b4ca32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:32.098124 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2583/5145] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:32 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:06:32.101913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef8a2f-5178-425b-8a79-606d3d6ebdb1 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:32.118808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef8a2f-5178-425b-8a79-606d3d6ebdb1 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:32.128296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cf3b5-c1fa-4777-ac5a-3199575039f8 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3bdbf8403341bf8cb51a1544e8d974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f006123258d74fd9b29b2f741a416243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:32.129054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cf3b5-c1fa-4777-ac5a-3199575039f8 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:32.129369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cf3b5-c1fa-4777-ac5a-3199575039f8 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:32.129662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cf3b5-c1fa-4777-ac5a-3199575039f8 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:32.150495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cf3b5-c1fa-4777-ac5a-3199575039f8 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:32.152360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cf3b5-c1fa-4777-ac5a-3199575039f8 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:32.174388 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2563/5146] 10.222.0.27 () {56 vars in 1263 bytes} [Wed Oct 19 01:06:32 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:32.177508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198db8-222c-48b8-b2e7-7435e1b4ca32 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:32.204124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198db8-222c-48b8-b2e7-7435e1b4ca32 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:32.223355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7fdd-608d-49cc-96c4-00c1885c93ad tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3bdbf8403341bf8cb51a1544e8d974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f006123258d74fd9b29b2f741a416243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:32.224068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7fdd-608d-49cc-96c4-00c1885c93ad tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:32.224379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7fdd-608d-49cc-96c4-00c1885c93ad tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:32.224701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7fdd-608d-49cc-96c4-00c1885c93ad tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:32.241755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef7fdd-608d-49cc-96c4-00c1885c93ad tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:32.244377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef7fdd-608d-49cc-96c4-00c1885c93ad tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:32.279132 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2584/5147] 10.222.0.27 () {56 vars in 1266 bytes} [Wed Oct 19 01:06:32 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:32.283174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cf3b5-c1fa-4777-ac5a-3199575039f8 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:32.301606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cf3b5-c1fa-4777-ac5a-3199575039f8 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:32.312353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75bd5-2d95-48b6-b9d2-ae7f0a70b685 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3bdbf8403341bf8cb51a1544e8d974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f006123258d74fd9b29b2f741a416243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:32.313080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75bd5-2d95-48b6-b9d2-ae7f0a70b685 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:32.313361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75bd5-2d95-48b6-b9d2-ae7f0a70b685 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:32.313715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75bd5-2d95-48b6-b9d2-ae7f0a70b685 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:32.322585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-76a75bd5-2d95-48b6-b9d2-ae7f0a70b685 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-76a75bd5-2d95-48b6-b9d2-ae7f0a70b685 tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 19 01:06:32.339811 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 19 01:06:32.341179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 19 01:06:32.342466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:06:32.342466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:06:32.342466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 19 01:06:32.342466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 19 01:06:32.342466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 19 01:06:32.342466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:06:32.346241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7fdd-608d-49cc-96c4-00c1885c93ad tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:32.347836 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2564/5148] 10.222.0.27 () {56 vars in 1263 bytes} [Wed Oct 19 01:06:32 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 01:06:32.506968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7fdd-608d-49cc-96c4-00c1885c93ad tempest-TokensV3Test-1062298504 tempest-TokensV3Test-1062298504-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:32.520531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:32.522335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:32.523401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:32.524031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] PATH_INFO: `/v3/users/da3bdbf8403341bf8cb51a1544e8d974` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:32.525663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3bdbf8403341bf8cb51a1544e8d974)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:32.532317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:32.664570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3bdbf8403341bf8cb51a1544e8d974'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:32.706115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3bdbf8403341bf8cb51a1544e8d974'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:32.725635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3bdbf8403341bf8cb51a1544e8d974'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:32.752825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3bdbf8403341bf8cb51a1544e8d974'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:32.758271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3bdbf8403341bf8cb51a1544e8d974'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:32.770812 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2585/5149] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:32 2022] DELETE /identity/v3/users/da3bdbf8403341bf8cb51a1544e8d974 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:06:32.775729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda957b-c414-404c-ae22-80ffad9cfa10 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:32.775965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda957b-c414-404c-ae22-80ffad9cfa10 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:32.776243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda957b-c414-404c-ae22-80ffad9cfa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:32.813939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5cda957b-c414-404c-ae22-80ffad9cfa10 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:32.815327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cda957b-c414-404c-ae22-80ffad9cfa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:33.000281 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2565/5150] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:33.012348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:33.013968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:33.065322 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:33.185538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963eb5-45dd-48cd-af31-400d99a1571c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:33.205062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e2051-9863-447a-b378-6e88cbff8a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:33.206402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2051-9863-447a-b378-6e88cbff8a78 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:33.206716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2051-9863-447a-b378-6e88cbff8a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:33.207008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2051-9863-447a-b378-6e88cbff8a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:33.230459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e2051-9863-447a-b378-6e88cbff8a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:33.231984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e2051-9863-447a-b378-6e88cbff8a78 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:33.257694 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2586/5151] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:34.327790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda957b-c414-404c-ae22-80ffad9cfa10 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:34.330585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cda957b-c414-404c-ae22-80ffad9cfa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:34.356799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda957b-c414-404c-ae22-80ffad9cfa10 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:34.381915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:34.382934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:34.383470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:34.383982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] PATH_INFO: `/v3/projects/f006123258d74fd9b29b2f741a416243` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:34.393535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f006123258d74fd9b29b2f741a416243)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:34.395903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:34.495192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f006123258d74fd9b29b2f741a416243', 'request_id': 'req-f8eb5dae-a3e3-4295-9ffd-2a902f275194'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:34.514107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f006123258d74fd9b29b2f741a416243', 'request_id': 'req-f8eb5dae-a3e3-4295-9ffd-2a902f275194'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:34.528404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f006123258d74fd9b29b2f741a416243', 'request_id': 'req-f8eb5dae-a3e3-4295-9ffd-2a902f275194'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:34.529798 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:34.562158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] The token cache is being invalidate because project f006123258d74fd9b29b2f741a416243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:34.562470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:34.563183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8eb5dae-a3e3-4295-9ffd-2a902f275194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:34.568572 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2566/5152] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:34 2022] DELETE /identity/v3/projects/f006123258d74fd9b29b2f741a416243 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:34.570164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c68c-082d-4c7f-9b9d-a082e5ade772 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:34.571216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c68c-082d-4c7f-9b9d-a082e5ade772 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:34.571986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c68c-082d-4c7f-9b9d-a082e5ade772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:34.630853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7eb2c68c-082d-4c7f-9b9d-a082e5ade772 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:34.641358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7eb2c68c-082d-4c7f-9b9d-a082e5ade772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:34.843890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191562f-2ddb-47b9-863f-4049b18c6009 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:34.844259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191562f-2ddb-47b9-863f-4049b18c6009 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:34.844607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191562f-2ddb-47b9-863f-4049b18c6009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:34.851895 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2587/5153] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:34.880584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6191562f-2ddb-47b9-863f-4049b18c6009 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:34.882498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6191562f-2ddb-47b9-863f-4049b18c6009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:34.911354 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2567/5154] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:34.916515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c68c-082d-4c7f-9b9d-a082e5ade772 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:34.933499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c68c-082d-4c7f-9b9d-a082e5ade772 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:34.954517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b0e25-0102-4dfe-b7b7-f2bb89dbbe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:34.955389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b0e25-0102-4dfe-b7b7-f2bb89dbbe06 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:34.955994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b0e25-0102-4dfe-b7b7-f2bb89dbbe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:34.957781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b0e25-0102-4dfe-b7b7-f2bb89dbbe06 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:34.958702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b0e25-0102-4dfe-b7b7-f2bb89dbbe06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:34.959216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b0e25-0102-4dfe-b7b7-f2bb89dbbe06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:34.962613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b0e25-0102-4dfe-b7b7-f2bb89dbbe06 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:35.001213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191562f-2ddb-47b9-863f-4049b18c6009 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:35.008302 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2588/5155] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:06:35.012652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191562f-2ddb-47b9-863f-4049b18c6009 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:35.025476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1b4d6-fce3-4dbb-bc4c-af50a174979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:35.026604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1b4d6-fce3-4dbb-bc4c-af50a174979e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:35.027093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1b4d6-fce3-4dbb-bc4c-af50a174979e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:35.027664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1b4d6-fce3-4dbb-bc4c-af50a174979e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:35.028510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1b4d6-fce3-4dbb-bc4c-af50a174979e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:35.031009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1b4d6-fce3-4dbb-bc4c-af50a174979e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:35.080634 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2568/5156] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:35 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:06:35.085676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b0e25-0102-4dfe-b7b7-f2bb89dbbe06 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:35.099253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b0e25-0102-4dfe-b7b7-f2bb89dbbe06 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:35.277685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb359d41-83d0-42e8-8c26-9a36a9a6220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:35.278325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb359d41-83d0-42e8-8c26-9a36a9a6220a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:35.278610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb359d41-83d0-42e8-8c26-9a36a9a6220a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:35.278887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb359d41-83d0-42e8-8c26-9a36a9a6220a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:35.279523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb359d41-83d0-42e8-8c26-9a36a9a6220a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:35.281522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb359d41-83d0-42e8-8c26-9a36a9a6220a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:35.334953 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2589/5157] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:35 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:06:35.336929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1b4d6-fce3-4dbb-bc4c-af50a174979e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:35.351130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1b4d6-fce3-4dbb-bc4c-af50a174979e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:35.368984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d1b7-d736-4719-bb58-c9469331e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:35.372118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d1b7-d736-4719-bb58-c9469331e76c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:35.372771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d1b7-d736-4719-bb58-c9469331e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:35.374535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d1b7-d736-4719-bb58-c9469331e76c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:35.375502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718d1b7-d736-4719-bb58-c9469331e76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:35.379928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718d1b7-d736-4719-bb58-c9469331e76c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:35.397523 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2569/5158] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:35.401623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb359d41-83d0-42e8-8c26-9a36a9a6220a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:35.428849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb359d41-83d0-42e8-8c26-9a36a9a6220a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:35.444238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2d2f-2b3d-438d-b0fc-7cf537e111aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:35.447432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2d2f-2b3d-438d-b0fc-7cf537e111aa admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:35.447793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2d2f-2b3d-438d-b0fc-7cf537e111aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:35.448661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2d2f-2b3d-438d-b0fc-7cf537e111aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:35.448798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b2d2f-2b3d-438d-b0fc-7cf537e111aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:35.452571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b2d2f-2b3d-438d-b0fc-7cf537e111aa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:35.488238 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2590/5159] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:35.493494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d1b7-d736-4719-bb58-c9469331e76c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:35.509322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d1b7-d736-4719-bb58-c9469331e76c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:35.528541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33555b2f-c60b-494f-82fb-407a6a1bec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:35.529261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33555b2f-c60b-494f-82fb-407a6a1bec99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:35.529548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33555b2f-c60b-494f-82fb-407a6a1bec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:35.529825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33555b2f-c60b-494f-82fb-407a6a1bec99 admin admin] PATH_INFO: `/v3/projects/86e003f8c2c2461dac5402b80454483b/users/acd1d9025e0a472999f2d227fcd4b403/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:35.572736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33555b2f-c60b-494f-82fb-407a6a1bec99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e003f8c2c2461dac5402b80454483b, user_id=acd1d9025e0a472999f2d227fcd4b403, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:35.575794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33555b2f-c60b-494f-82fb-407a6a1bec99 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:35.602061 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2570/5160] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:35 2022] PUT /identity/v3/projects/86e003f8c2c2461dac5402b80454483b/users/acd1d9025e0a472999f2d227fcd4b403/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:35.612830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af610ca-fb2e-402c-8662-894df0c3a3cc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:35.614266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af610ca-fb2e-402c-8662-894df0c3a3cc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:35.614732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af610ca-fb2e-402c-8662-894df0c3a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:35.673795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9af610ca-fb2e-402c-8662-894df0c3a3cc None None] MFA Rules not processed for user `acd1d9025e0a472999f2d227fcd4b403`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:35.675160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9af610ca-fb2e-402c-8662-894df0c3a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:35.759193 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:35.926420 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2591/5161] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:35.931528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33555b2f-c60b-494f-82fb-407a6a1bec99 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:36.132157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33555b2f-c60b-494f-82fb-407a6a1bec99 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:36.146487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc2886-fa02-4942-8440-8b476f78c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:36.147461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc2886-fa02-4942-8440-8b476f78c692 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:36.148021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc2886-fa02-4942-8440-8b476f78c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:36.148593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc2886-fa02-4942-8440-8b476f78c692 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:36.149483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc2886-fa02-4942-8440-8b476f78c692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:36.152700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc2886-fa02-4942-8440-8b476f78c692 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:36.218682 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2571/5162] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:35 2022] POST /identity/v3/projects => generated 377 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:36.222886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af610ca-fb2e-402c-8662-894df0c3a3cc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:36.250035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af610ca-fb2e-402c-8662-894df0c3a3cc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:36.400636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d3459-d783-443c-8533-7bd1441de729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:36.401346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d3459-d783-443c-8533-7bd1441de729 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:36.401627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d3459-d783-443c-8533-7bd1441de729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:36.401902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d3459-d783-443c-8533-7bd1441de729 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:36.403281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d3459-d783-443c-8533-7bd1441de729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:36.405654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d3459-d783-443c-8533-7bd1441de729 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:36.436459 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2592/5163] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:36 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:36.440185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc2886-fa02-4942-8440-8b476f78c692 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:36.456870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc2886-fa02-4942-8440-8b476f78c692 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:36.469564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db5cde-1399-4175-b1e6-26ba5513d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:36.470518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5cde-1399-4175-b1e6-26ba5513d0be admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:36.471003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5cde-1399-4175-b1e6-26ba5513d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:36.471514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5cde-1399-4175-b1e6-26ba5513d0be admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:36.472543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db5cde-1399-4175-b1e6-26ba5513d0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:36.477105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db5cde-1399-4175-b1e6-26ba5513d0be admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:36.508250 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2572/5164] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:36.512767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d3459-d783-443c-8533-7bd1441de729 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:36.529857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d3459-d783-443c-8533-7bd1441de729 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:36.535363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4120e-8e26-4936-b24c-ef3b22a00886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:36.536129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4120e-8e26-4936-b24c-ef3b22a00886 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:36.536482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4120e-8e26-4936-b24c-ef3b22a00886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:36.536914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4120e-8e26-4936-b24c-ef3b22a00886 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:36.537718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4120e-8e26-4936-b24c-ef3b22a00886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:36.539791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4120e-8e26-4936-b24c-ef3b22a00886 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:36.554449 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2593/5165] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:36.558245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db5cde-1399-4175-b1e6-26ba5513d0be admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:36.574252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db5cde-1399-4175-b1e6-26ba5513d0be admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:36.610632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470c5b5-7b9e-40b9-8000-a696f7a2b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:36.611313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470c5b5-7b9e-40b9-8000-a696f7a2b2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:36.611590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470c5b5-7b9e-40b9-8000-a696f7a2b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:36.611864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470c5b5-7b9e-40b9-8000-a696f7a2b2fc admin admin] PATH_INFO: `/v3/projects/6bacedd73d8b45a0ac12f073c355f55b/users/c1e25afea17148298609f30865ee1c25/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:36.655006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470c5b5-7b9e-40b9-8000-a696f7a2b2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bacedd73d8b45a0ac12f073c355f55b, user_id=c1e25afea17148298609f30865ee1c25, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:36.657808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470c5b5-7b9e-40b9-8000-a696f7a2b2fc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:36.701672 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2573/5166] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:36 2022] PUT /identity/v3/projects/6bacedd73d8b45a0ac12f073c355f55b/users/c1e25afea17148298609f30865ee1c25/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:36.714764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92181f17-d20d-4912-9048-4a1ebb97419a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:36.715297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92181f17-d20d-4912-9048-4a1ebb97419a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:36.715954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92181f17-d20d-4912-9048-4a1ebb97419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:36.789400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-92181f17-d20d-4912-9048-4a1ebb97419a None None] MFA Rules not processed for user `c1e25afea17148298609f30865ee1c25`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:36.791042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-92181f17-d20d-4912-9048-4a1ebb97419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:36.995886 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2594/5167] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:37.005846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470c5b5-7b9e-40b9-8000-a696f7a2b2fc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:37.016665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3470c5b5-7b9e-40b9-8000-a696f7a2b2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:37.165886 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:37.209654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470c5b5-7b9e-40b9-8000-a696f7a2b2fc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:37.221752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70865f0-418d-4589-b287-d0b9fc698d8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:37.223053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70865f0-418d-4589-b287-d0b9fc698d8a service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:37.223671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70865f0-418d-4589-b287-d0b9fc698d8a service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:37.224920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70865f0-418d-4589-b287-d0b9fc698d8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:37.383279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70865f0-418d-4589-b287-d0b9fc698d8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:37.385142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70865f0-418d-4589-b287-d0b9fc698d8a service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:37.401389 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2574/5168] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:37.630924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e962-ec34-4a14-a190-a42e48c72362 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:37.631215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e962-ec34-4a14-a190-a42e48c72362 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:37.631501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e962-ec34-4a14-a190-a42e48c72362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:37.687860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cf06e962-ec34-4a14-a190-a42e48c72362 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:37.689152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cf06e962-ec34-4a14-a190-a42e48c72362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:37.746324 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:37.856591 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2595/5169] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:37.868957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70865f0-418d-4589-b287-d0b9fc698d8a service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:37.870580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a70865f0-418d-4589-b287-d0b9fc698d8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:38.150957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70865f0-418d-4589-b287-d0b9fc698d8a service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:38.164526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f5e5b-cabe-4cbd-9d0a-d08acdf8befb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:38.165193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5e5b-cabe-4cbd-9d0a-d08acdf8befb service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:38.165477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5e5b-cabe-4cbd-9d0a-d08acdf8befb service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:38.167931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5e5b-cabe-4cbd-9d0a-d08acdf8befb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:38.217589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f5e5b-cabe-4cbd-9d0a-d08acdf8befb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:38.227188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f5e5b-cabe-4cbd-9d0a-d08acdf8befb service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:38.270744 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2575/5170] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:06:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:06:38.638564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e962-ec34-4a14-a190-a42e48c72362 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:38.654232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e962-ec34-4a14-a190-a42e48c72362 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:38.662390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc401b-0950-4995-9a2f-ae42d279fd6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:38.665196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc401b-0950-4995-9a2f-ae42d279fd6d service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:38.665374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc401b-0950-4995-9a2f-ae42d279fd6d service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:38.665516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc401b-0950-4995-9a2f-ae42d279fd6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:38.693180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc401b-0950-4995-9a2f-ae42d279fd6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:38.695907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc401b-0950-4995-9a2f-ae42d279fd6d service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:38.731792 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2596/5171] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:38.807033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05093-877e-4503-a422-8780c57e1b9e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:38.807430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05093-877e-4503-a422-8780c57e1b9e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:38.807820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05093-877e-4503-a422-8780c57e1b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:38.862178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b2e05093-877e-4503-a422-8780c57e1b9e None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:38.863599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b2e05093-877e-4503-a422-8780c57e1b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:38.884977 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2576/5172] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:38.900977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc401b-0950-4995-9a2f-ae42d279fd6d service glance] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:38.927756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc401b-0950-4995-9a2f-ae42d279fd6d service glance] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:38.931064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5d864-0544-492a-b4c6-4d9d401e9852 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:38.931484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5d864-0544-492a-b4c6-4d9d401e9852 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:38.931900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5d864-0544-492a-b4c6-4d9d401e9852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:38.949695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b916f-542b-492d-8519-1e6ffb511e88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:38.950577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b916f-542b-492d-8519-1e6ffb511e88 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:38.951027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b916f-542b-492d-8519-1e6ffb511e88 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:38.951488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b916f-542b-492d-8519-1e6ffb511e88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:38.973775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b916f-542b-492d-8519-1e6ffb511e88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:38.977649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b916f-542b-492d-8519-1e6ffb511e88 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:38.987786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-afc5d864-0544-492a-b4c6-4d9d401e9852 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:38.994217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-afc5d864-0544-492a-b4c6-4d9d401e9852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:38.999800 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2597/5173] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:06:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:06:39.014968 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2577/5174] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:39.034692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b916f-542b-492d-8519-1e6ffb511e88 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:39.059319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b916f-542b-492d-8519-1e6ffb511e88 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:39.069096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec2c32-edcb-4157-9ae5-60b8e318091f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:39.070572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec2c32-edcb-4157-9ae5-60b8e318091f service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:39.071017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec2c32-edcb-4157-9ae5-60b8e318091f service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:39.071717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec2c32-edcb-4157-9ae5-60b8e318091f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:39.095669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec2c32-edcb-4157-9ae5-60b8e318091f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:39.100514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec2c32-edcb-4157-9ae5-60b8e318091f service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:39.122658 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2598/5175] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:06:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:06:39.490899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5d864-0544-492a-b4c6-4d9d401e9852 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:39.686094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5d864-0544-492a-b4c6-4d9d401e9852 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:39.703218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:39.703891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:39.704171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:39.704447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] PATH_INFO: `/v3/users/acd1d9025e0a472999f2d227fcd4b403` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:39.708570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd1d9025e0a472999f2d227fcd4b403)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:39.711474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:39.739824 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:39.832804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd1d9025e0a472999f2d227fcd4b403'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:39.869614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd1d9025e0a472999f2d227fcd4b403'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:39.887193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd1d9025e0a472999f2d227fcd4b403'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:39.907125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd1d9025e0a472999f2d227fcd4b403'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:39.910041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd1d9025e0a472999f2d227fcd4b403'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:39.926254 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2578/5176] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:39 2022] DELETE /identity/v3/users/acd1d9025e0a472999f2d227fcd4b403 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:39.931347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d715f-a9af-4bbf-bab8-7b687f944691 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:39.932194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d715f-a9af-4bbf-bab8-7b687f944691 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:39.932693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d715f-a9af-4bbf-bab8-7b687f944691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:39.982458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-822d715f-a9af-4bbf-bab8-7b687f944691 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:39.983996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-822d715f-a9af-4bbf-bab8-7b687f944691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:40.168244 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2599/5177] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:40.200478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:40.202720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:40.302894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8778ac-6e49-4042-afcc-0958c7681bd2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:40.324902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49953c3-d6af-493e-92e5-9d911554b9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:40.325555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49953c3-d6af-493e-92e5-9d911554b9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:40.325841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49953c3-d6af-493e-92e5-9d911554b9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:40.326193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49953c3-d6af-493e-92e5-9d911554b9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:40.367169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49953c3-d6af-493e-92e5-9d911554b9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:40.369697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49953c3-d6af-493e-92e5-9d911554b9e1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:40.399297 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2579/5178] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:42.042836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d715f-a9af-4bbf-bab8-7b687f944691 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:42.045211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-822d715f-a9af-4bbf-bab8-7b687f944691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:42.068503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d715f-a9af-4bbf-bab8-7b687f944691 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:42.081345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:42.083205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:42.084047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:42.085999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] PATH_INFO: `/v3/projects/86e003f8c2c2461dac5402b80454483b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:42.092419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e003f8c2c2461dac5402b80454483b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:42.096018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:42.218151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e003f8c2c2461dac5402b80454483b', 'request_id': 'req-934e3907-9c8c-47da-8172-e0abf161f458'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.237173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e003f8c2c2461dac5402b80454483b', 'request_id': 'req-934e3907-9c8c-47da-8172-e0abf161f458'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.255852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e003f8c2c2461dac5402b80454483b', 'request_id': 'req-934e3907-9c8c-47da-8172-e0abf161f458'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.289964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] The token cache is being invalidate because project 86e003f8c2c2461dac5402b80454483b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:42.290559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.292917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.298841 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2600/5179] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:42 2022] DELETE /identity/v3/projects/86e003f8c2c2461dac5402b80454483b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:42.302837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49953c3-d6af-493e-92e5-9d911554b9e1 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:42.314417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49953c3-d6af-493e-92e5-9d911554b9e1 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:42.529736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:42.531416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:42.531968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:42.532475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] PATH_INFO: `/v3/users/c1e25afea17148298609f30865ee1c25` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:42.535788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e25afea17148298609f30865ee1c25)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:42.538214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:42.623778 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:42.654889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e25afea17148298609f30865ee1c25'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.684543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e25afea17148298609f30865ee1c25'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.698591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e25afea17148298609f30865ee1c25'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.719173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e25afea17148298609f30865ee1c25'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.720318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e25afea17148298609f30865ee1c25'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:42.736827 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2580/5180] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:42 2022] DELETE /identity/v3/users/c1e25afea17148298609f30865ee1c25 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:45.246788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:45.249712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:45.299364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e3907-9c8c-47da-8172-e0abf161f458 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:45.354852 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:45.505520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:45.506091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:45.506371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:45.506702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] PATH_INFO: `/v3/projects/6bacedd73d8b45a0ac12f073c355f55b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:45.510740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bacedd73d8b45a0ac12f073c355f55b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:45.517665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:45.662401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:45.664814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:45.676383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bacedd73d8b45a0ac12f073c355f55b', 'request_id': 'req-dfbb5586-87cb-42a2-bf28-030699d8635c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:45.689874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bacedd73d8b45a0ac12f073c355f55b', 'request_id': 'req-dfbb5586-87cb-42a2-bf28-030699d8635c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:45.710564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bacedd73d8b45a0ac12f073c355f55b', 'request_id': 'req-dfbb5586-87cb-42a2-bf28-030699d8635c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:45.746926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] The token cache is being invalidate because project 6bacedd73d8b45a0ac12f073c355f55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:45.747290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:45.749448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfbb5586-87cb-42a2-bf28-030699d8635c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:45.753394 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2601/5181] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:45 2022] DELETE /identity/v3/projects/6bacedd73d8b45a0ac12f073c355f55b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:45.760677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496f15-c281-4e9e-b2c4-204e559750a6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:45.766278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496f15-c281-4e9e-b2c4-204e559750a6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:45.766583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496f15-c281-4e9e-b2c4-204e559750a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:45.822308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ee496f15-c281-4e9e-b2c4-204e559750a6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:45.823562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ee496f15-c281-4e9e-b2c4-204e559750a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:45.840533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77828d0-41fd-4ab1-bc4d-ca8ff0a81945 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:45.935674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c229-5f0a-4da8-96ce-b3642e37fba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:45.936684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c229-5f0a-4da8-96ce-b3642e37fba6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:45.937224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c229-5f0a-4da8-96ce-b3642e37fba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:45.938240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74c229-5f0a-4da8-96ce-b3642e37fba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:45.942286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd74c229-5f0a-4da8-96ce-b3642e37fba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:46.039306 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2602/5182] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:46.056943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaf0a0-b051-47d4-bba7-9531175b1c82 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:46.057493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaf0a0-b051-47d4-bba7-9531175b1c82 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:46.057993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaf0a0-b051-47d4-bba7-9531175b1c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:46.130918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-82eaf0a0-b051-47d4-bba7-9531175b1c82 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:46.136449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-82eaf0a0-b051-47d4-bba7-9531175b1c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:46.152971 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2603/5183] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:46.156201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaf0a0-b051-47d4-bba7-9531175b1c82 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:46.169465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaf0a0-b051-47d4-bba7-9531175b1c82 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:46.176478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efac9c-fcbd-40fa-8234-c6cd02012d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:46.177912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efac9c-fcbd-40fa-8234-c6cd02012d54 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:46.178768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efac9c-fcbd-40fa-8234-c6cd02012d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:46.180253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efac9c-fcbd-40fa-8234-c6cd02012d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:46.180609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efac9c-fcbd-40fa-8234-c6cd02012d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:46.181062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efac9c-fcbd-40fa-8234-c6cd02012d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:46.182946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efac9c-fcbd-40fa-8234-c6cd02012d54 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:46.183904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74c229-5f0a-4da8-96ce-b3642e37fba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:46.187974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74c229-5f0a-4da8-96ce-b3642e37fba6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:46.202375 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2604/5184] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:06:46.207021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efac9c-fcbd-40fa-8234-c6cd02012d54 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:46.228337 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2581/5185] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:06:46.230812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efac9c-fcbd-40fa-8234-c6cd02012d54 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:46.244470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9ccce-038e-46ce-bb7d-e0d7e126073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:46.246057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9ccce-038e-46ce-bb7d-e0d7e126073a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:46.248824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9ccce-038e-46ce-bb7d-e0d7e126073a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:46.249433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9ccce-038e-46ce-bb7d-e0d7e126073a admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:46.251326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9ccce-038e-46ce-bb7d-e0d7e126073a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:46.254828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9ccce-038e-46ce-bb7d-e0d7e126073a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:46.292317 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:46.307642 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2605/5186] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:46 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:06:46.311333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c229-5f0a-4da8-96ce-b3642e37fba6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:46.335319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74c229-5f0a-4da8-96ce-b3642e37fba6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:46.368486 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:46.496939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfd00e-986a-43ce-86ce-b619e20cc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:46.497587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfd00e-986a-43ce-86ce-b619e20cc3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:46.498419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfd00e-986a-43ce-86ce-b619e20cc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:46.498905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfd00e-986a-43ce-86ce-b619e20cc3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:46.500078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfd00e-986a-43ce-86ce-b619e20cc3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:46.505476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfd00e-986a-43ce-86ce-b619e20cc3b8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:46.552929 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2582/5187] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:46 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:46.557028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9ccce-038e-46ce-bb7d-e0d7e126073a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:46.584231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9ccce-038e-46ce-bb7d-e0d7e126073a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:46.598738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5826a5-40ea-47d9-9337-3e0312a6ec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:46.600285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5826a5-40ea-47d9-9337-3e0312a6ec18 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:46.601330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5826a5-40ea-47d9-9337-3e0312a6ec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:46.604068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5826a5-40ea-47d9-9337-3e0312a6ec18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:46.606148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5826a5-40ea-47d9-9337-3e0312a6ec18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:46.611088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5826a5-40ea-47d9-9337-3e0312a6ec18 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:46.642608 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2606/5188] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:46.643837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfd00e-986a-43ce-86ce-b619e20cc3b8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:46.658911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfd00e-986a-43ce-86ce-b619e20cc3b8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:46.673675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc59b91-1baf-494e-b86e-43a3434bbaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:46.674355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59b91-1baf-494e-b86e-43a3434bbaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:46.674605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59b91-1baf-494e-b86e-43a3434bbaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:46.674855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59b91-1baf-494e-b86e-43a3434bbaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:46.675697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc59b91-1baf-494e-b86e-43a3434bbaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:46.677334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc59b91-1baf-494e-b86e-43a3434bbaa4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:46.705857 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2583/5189] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:46.707070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5826a5-40ea-47d9-9337-3e0312a6ec18 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:46.722263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5826a5-40ea-47d9-9337-3e0312a6ec18 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:46.733642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39249d-cced-4fc6-b937-b661d746d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:46.734334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39249d-cced-4fc6-b937-b661d746d729 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:46.734618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39249d-cced-4fc6-b937-b661d746d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:46.734896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39249d-cced-4fc6-b937-b661d746d729 admin admin] PATH_INFO: `/v3/projects/0775ec9879b249aa9d1237af21c0d9b5/users/742d158ff462461ba602f4a1289fc42b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:46.770997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39249d-cced-4fc6-b937-b661d746d729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0775ec9879b249aa9d1237af21c0d9b5, user_id=742d158ff462461ba602f4a1289fc42b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:46.780792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39249d-cced-4fc6-b937-b661d746d729 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:46.818227 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2607/5190] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:46 2022] PUT /identity/v3/projects/0775ec9879b249aa9d1237af21c0d9b5/users/742d158ff462461ba602f4a1289fc42b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:46.821060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4cb26-ee30-4409-a6d3-379243c80e59 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:46.823948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4cb26-ee30-4409-a6d3-379243c80e59 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:46.823948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4cb26-ee30-4409-a6d3-379243c80e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:46.924607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8ca4cb26-ee30-4409-a6d3-379243c80e59 None None] MFA Rules not processed for user `742d158ff462461ba602f4a1289fc42b`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:46.930834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8ca4cb26-ee30-4409-a6d3-379243c80e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:47.216598 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2584/5191] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:47.231100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39249d-cced-4fc6-b937-b661d746d729 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:47.233239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fe39249d-cced-4fc6-b937-b661d746d729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:47.391824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39249d-cced-4fc6-b937-b661d746d729 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:47.402712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d95f1-36dc-4675-873a-c155be2aed27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:47.403485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d95f1-36dc-4675-873a-c155be2aed27 service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:47.405729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d95f1-36dc-4675-873a-c155be2aed27 service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:47.406153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d95f1-36dc-4675-873a-c155be2aed27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:47.439242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d95f1-36dc-4675-873a-c155be2aed27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:47.440915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d95f1-36dc-4675-873a-c155be2aed27 service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:47.467167 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2608/5192] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:47.666209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4cb26-ee30-4409-a6d3-379243c80e59 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:47.795007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4cb26-ee30-4409-a6d3-379243c80e59 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:47.805613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:47.805613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:47.807426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:47.807837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] PATH_INFO: `/v3/users/742d158ff462461ba602f4a1289fc42b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:47.812175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742d158ff462461ba602f4a1289fc42b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:47.814530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:47.880136 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:47.922290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742d158ff462461ba602f4a1289fc42b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:47.986138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742d158ff462461ba602f4a1289fc42b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:48.016833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742d158ff462461ba602f4a1289fc42b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:48.055766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742d158ff462461ba602f4a1289fc42b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:48.062058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742d158ff462461ba602f4a1289fc42b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:48.099617 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2585/5193] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:06:47 2022] DELETE /identity/v3/users/742d158ff462461ba602f4a1289fc42b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:48.101138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187251b-0b19-4777-bfd8-ef363d00c234 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:48.101431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187251b-0b19-4777-bfd8-ef363d00c234 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:48.101741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187251b-0b19-4777-bfd8-ef363d00c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:48.152482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b187251b-0b19-4777-bfd8-ef363d00c234 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:48.155222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b187251b-0b19-4777-bfd8-ef363d00c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:48.420933 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2609/5194] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:48.509836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:48.511361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:48.701968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dbce0-72b8-4e09-b9b2-0bf23ae2df60 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:48.712996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059aca2-43a4-47ef-8af3-4243e9dd8c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:48.714553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059aca2-43a4-47ef-8af3-4243e9dd8c4b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:48.714839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059aca2-43a4-47ef-8af3-4243e9dd8c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:48.715113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059aca2-43a4-47ef-8af3-4243e9dd8c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:48.749162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059aca2-43a4-47ef-8af3-4243e9dd8c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:48.750631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059aca2-43a4-47ef-8af3-4243e9dd8c4b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:48.785385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2586/5195] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:06:50.856978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187251b-0b19-4777-bfd8-ef363d00c234 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:50.864614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b187251b-0b19-4777-bfd8-ef363d00c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:50.910522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187251b-0b19-4777-bfd8-ef363d00c234 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:50.950705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:50.951415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:50.951701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:50.952011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] PATH_INFO: `/v3/projects/0775ec9879b249aa9d1237af21c0d9b5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:50.961893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0775ec9879b249aa9d1237af21c0d9b5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:50.994989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:51.251570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0775ec9879b249aa9d1237af21c0d9b5', 'request_id': 'req-a7df4ce4-9d91-4241-a5d4-343a0e204947'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:51.281959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0775ec9879b249aa9d1237af21c0d9b5', 'request_id': 'req-a7df4ce4-9d91-4241-a5d4-343a0e204947'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:51.303054 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:51.310096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0775ec9879b249aa9d1237af21c0d9b5', 'request_id': 'req-a7df4ce4-9d91-4241-a5d4-343a0e204947'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:51.335389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] The token cache is being invalidate because project 0775ec9879b249aa9d1237af21c0d9b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:06:51.335702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:51.339191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7df4ce4-9d91-4241-a5d4-343a0e204947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:06:51.351371 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2610/5196] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:50 2022] DELETE /identity/v3/projects/0775ec9879b249aa9d1237af21c0d9b5 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:51.353491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fe39b-ce7e-4435-97a0-9ac16c186533 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:51.353987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fe39b-ce7e-4435-97a0-9ac16c186533 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:51.353987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fe39b-ce7e-4435-97a0-9ac16c186533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:51.394378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ab1fe39b-ce7e-4435-97a0-9ac16c186533 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:51.397219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ab1fe39b-ce7e-4435-97a0-9ac16c186533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:51.605851 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2587/5197] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:51.607086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041603-2b93-49e9-877e-1ff6cd96e779 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:51.607379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041603-2b93-49e9-877e-1ff6cd96e779 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:51.607654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041603-2b93-49e9-877e-1ff6cd96e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:51.650183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-83041603-2b93-49e9-877e-1ff6cd96e779 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:51.651623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-83041603-2b93-49e9-877e-1ff6cd96e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:51.691628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fe39b-ce7e-4435-97a0-9ac16c186533 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:51.698389 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2611/5198] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:06:51.718489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fe39b-ce7e-4435-97a0-9ac16c186533 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:51.751012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42632ac1-cddd-4670-88ab-f2af7d42d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:51.756708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42632ac1-cddd-4670-88ab-f2af7d42d39b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:51.756885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42632ac1-cddd-4670-88ab-f2af7d42d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:51.761464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42632ac1-cddd-4670-88ab-f2af7d42d39b admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:51.762178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42632ac1-cddd-4670-88ab-f2af7d42d39b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:06:51.762489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42632ac1-cddd-4670-88ab-f2af7d42d39b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:51.764137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42632ac1-cddd-4670-88ab-f2af7d42d39b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:51.816202 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2588/5199] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:06:51.816544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83041603-2b93-49e9-877e-1ff6cd96e779 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:51.840255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83041603-2b93-49e9-877e-1ff6cd96e779 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:51.854784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4516-e79a-4f30-b5de-1d34107daa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:51.855432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4516-e79a-4f30-b5de-1d34107daa37 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:51.855716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4516-e79a-4f30-b5de-1d34107daa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:51.855992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4516-e79a-4f30-b5de-1d34107daa37 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:51.856656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad4516-e79a-4f30-b5de-1d34107daa37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:51.866208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad4516-e79a-4f30-b5de-1d34107daa37 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:51.954306 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2612/5200] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:51 2022] POST /identity/v3/projects => generated 409 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:06:51.958397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42632ac1-cddd-4670-88ab-f2af7d42d39b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:51.989046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42632ac1-cddd-4670-88ab-f2af7d42d39b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:52.116639 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:52.188891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0bdc8-3eac-4ed1-9683-a4aac78bdb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:52.189531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0bdc8-3eac-4ed1-9683-a4aac78bdb81 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:52.189816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0bdc8-3eac-4ed1-9683-a4aac78bdb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:52.190097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0bdc8-3eac-4ed1-9683-a4aac78bdb81 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:52.190753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0bdc8-3eac-4ed1-9683-a4aac78bdb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:52.197524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0bdc8-3eac-4ed1-9683-a4aac78bdb81 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:52.260569 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2589/5201] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:51 2022] POST /identity/v3/users => generated 305 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:52.265024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4516-e79a-4f30-b5de-1d34107daa37 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:52.286940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4516-e79a-4f30-b5de-1d34107daa37 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:52.306510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c8fd-2cdb-4ce9-ba3f-cccd9815cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:52.308555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c8fd-2cdb-4ce9-ba3f-cccd9815cd14 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:52.311318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c8fd-2cdb-4ce9-ba3f-cccd9815cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:52.311623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c8fd-2cdb-4ce9-ba3f-cccd9815cd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:52.314695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c8fd-2cdb-4ce9-ba3f-cccd9815cd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:52.320751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c8fd-2cdb-4ce9-ba3f-cccd9815cd14 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:52.363350 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2613/5202] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:06:52.364792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0bdc8-3eac-4ed1-9683-a4aac78bdb81 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:52.387095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0bdc8-3eac-4ed1-9683-a4aac78bdb81 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:52.401180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36e39-99b5-4e82-b18e-c60b4289582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:52.402137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36e39-99b5-4e82-b18e-c60b4289582d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:52.404585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36e39-99b5-4e82-b18e-c60b4289582d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:52.405332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36e39-99b5-4e82-b18e-c60b4289582d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:52.414018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e36e39-99b5-4e82-b18e-c60b4289582d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:52.419352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e36e39-99b5-4e82-b18e-c60b4289582d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:52.482464 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2590/5203] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:52.484465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c8fd-2cdb-4ce9-ba3f-cccd9815cd14 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:52.500388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c8fd-2cdb-4ce9-ba3f-cccd9815cd14 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:52.517386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24753269-8971-4bd6-9ef2-4b092db7b641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:52.522275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24753269-8971-4bd6-9ef2-4b092db7b641 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:52.522275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24753269-8971-4bd6-9ef2-4b092db7b641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:52.523106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24753269-8971-4bd6-9ef2-4b092db7b641 admin admin] PATH_INFO: `/v3/projects/7c0f76578f8c4f02bfaba6f338e6ab7b/users/4c13b3ccccdd405c92b22699e00db058/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:52.594824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24753269-8971-4bd6-9ef2-4b092db7b641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0f76578f8c4f02bfaba6f338e6ab7b, user_id=4c13b3ccccdd405c92b22699e00db058, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:52.599238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24753269-8971-4bd6-9ef2-4b092db7b641 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:52.646731 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2614/5204] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:52 2022] PUT /identity/v3/projects/7c0f76578f8c4f02bfaba6f338e6ab7b/users/4c13b3ccccdd405c92b22699e00db058/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:06:52.659644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fa292-0015-4f7c-b261-2eb53249a7a3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:52.661086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fa292-0015-4f7c-b261-2eb53249a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:52.661530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fa292-0015-4f7c-b261-2eb53249a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:52.761385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5b9fa292-0015-4f7c-b261-2eb53249a7a3 None None] MFA Rules not processed for user `4c13b3ccccdd405c92b22699e00db058`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:52.765084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5b9fa292-0015-4f7c-b261-2eb53249a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:53.004486 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2591/5205] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:52 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:53.009931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24753269-8971-4bd6-9ef2-4b092db7b641 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:53.254099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24753269-8971-4bd6-9ef2-4b092db7b641 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:53.276152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14022f1-c525-4954-b14f-aa16cdcff20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:53.277235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14022f1-c525-4954-b14f-aa16cdcff20f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:53.281022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14022f1-c525-4954-b14f-aa16cdcff20f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:53.284974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14022f1-c525-4954-b14f-aa16cdcff20f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:53.285460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14022f1-c525-4954-b14f-aa16cdcff20f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:53.287539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14022f1-c525-4954-b14f-aa16cdcff20f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:53.389673 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2615/5206] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:06:53 2022] POST /identity/v3/projects => generated 411 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:53.393392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fa292-0015-4f7c-b261-2eb53249a7a3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:53.415522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fa292-0015-4f7c-b261-2eb53249a7a3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:53.602955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0f6b6-09b3-4e36-8fad-17c69a937885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:53.603601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0f6b6-09b3-4e36-8fad-17c69a937885 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:53.603936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0f6b6-09b3-4e36-8fad-17c69a937885 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:53.604436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0f6b6-09b3-4e36-8fad-17c69a937885 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:53.605269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0f6b6-09b3-4e36-8fad-17c69a937885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:53.607224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0f6b6-09b3-4e36-8fad-17c69a937885 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:53.673049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14022f1-c525-4954-b14f-aa16cdcff20f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:53.673199 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2592/5207] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:06:53 2022] POST /identity/v3/users => generated 312 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:06:53.690382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14022f1-c525-4954-b14f-aa16cdcff20f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:53.704996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec88010-a23e-48d3-a0a0-71967b8b5295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:53.705877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec88010-a23e-48d3-a0a0-71967b8b5295 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:53.706340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec88010-a23e-48d3-a0a0-71967b8b5295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:53.706765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec88010-a23e-48d3-a0a0-71967b8b5295 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:53.707577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec88010-a23e-48d3-a0a0-71967b8b5295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:53.709745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec88010-a23e-48d3-a0a0-71967b8b5295 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:53.761994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2616/5208] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:53.763659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0f6b6-09b3-4e36-8fad-17c69a937885 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:53.775239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0f6b6-09b3-4e36-8fad-17c69a937885 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:53.794490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fcdf3-bf5b-4e54-a483-092143be76f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:53.795333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fcdf3-bf5b-4e54-a483-092143be76f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:53.795617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fcdf3-bf5b-4e54-a483-092143be76f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:53.796369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fcdf3-bf5b-4e54-a483-092143be76f0 admin admin] PATH_INFO: `/v3/projects/cffcfaad604e48db82b57bae93632be2/users/b70706cb86284eb5ac493abffdaf041a/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:53.834154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fcdf3-bf5b-4e54-a483-092143be76f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffcfaad604e48db82b57bae93632be2, user_id=b70706cb86284eb5ac493abffdaf041a, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:53.837665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fcdf3-bf5b-4e54-a483-092143be76f0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:53.871063 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2593/5209] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:53 2022] PUT /identity/v3/projects/cffcfaad604e48db82b57bae93632be2/users/b70706cb86284eb5ac493abffdaf041a/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:53.875590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec88010-a23e-48d3-a0a0-71967b8b5295 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:53.898562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec88010-a23e-48d3-a0a0-71967b8b5295 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:54.262790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47f84e-5bf9-42e2-9c0b-a6dba207c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:54.265487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47f84e-5bf9-42e2-9c0b-a6dba207c5df admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:54.266935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47f84e-5bf9-42e2-9c0b-a6dba207c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:54.267380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47f84e-5bf9-42e2-9c0b-a6dba207c5df admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:54.270692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47f84e-5bf9-42e2-9c0b-a6dba207c5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:54.274546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47f84e-5bf9-42e2-9c0b-a6dba207c5df admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:54.281567 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:54.339750 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2617/5210] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:06:54.342201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fcdf3-bf5b-4e54-a483-092143be76f0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:54.360921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fcdf3-bf5b-4e54-a483-092143be76f0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:54.377122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f823cfb-4cd9-4071-a965-9ab01c2034bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:54.378013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823cfb-4cd9-4071-a965-9ab01c2034bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:54.378516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823cfb-4cd9-4071-a965-9ab01c2034bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:54.378863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823cfb-4cd9-4071-a965-9ab01c2034bf admin admin] PATH_INFO: `/v3/projects/cffcfaad604e48db82b57bae93632be2/users/b70706cb86284eb5ac493abffdaf041a/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:54.384568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f823cfb-4cd9-4071-a965-9ab01c2034bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffcfaad604e48db82b57bae93632be2, user_id=b70706cb86284eb5ac493abffdaf041a, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:54.394053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f823cfb-4cd9-4071-a965-9ab01c2034bf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:54.398441 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:54.428161 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2594/5211] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:06:54 2022] PUT /identity/v3/projects/cffcfaad604e48db82b57bae93632be2/users/b70706cb86284eb5ac493abffdaf041a/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:06:54.438463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95e97-dfa9-475c-994f-090387918932 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:54.439036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95e97-dfa9-475c-994f-090387918932 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:54.439779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95e97-dfa9-475c-994f-090387918932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:54.518014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b1c95e97-dfa9-475c-994f-090387918932 None None] MFA Rules not processed for user `b70706cb86284eb5ac493abffdaf041a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:54.520907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b1c95e97-dfa9-475c-994f-090387918932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:54.724837 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2618/5212] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:54 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:54.741781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f823cfb-4cd9-4071-a965-9ab01c2034bf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:54.743758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f823cfb-4cd9-4071-a965-9ab01c2034bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:55.007875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f823cfb-4cd9-4071-a965-9ab01c2034bf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:06:55.020104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02296621-03e3-4f95-9c8a-6d4d87650490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:06:55.021216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02296621-03e3-4f95-9c8a-6d4d87650490 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:55.021654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02296621-03e3-4f95-9c8a-6d4d87650490 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:55.022379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02296621-03e3-4f95-9c8a-6d4d87650490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:55.049648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02296621-03e3-4f95-9c8a-6d4d87650490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:06:55.051346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02296621-03e3-4f95-9c8a-6d4d87650490 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:06:55.079726 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2595/5213] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:54 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:06:58.079793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1d21f-483a-49ec-ab3f-da01944064af None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:06:58.080332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1d21f-483a-49ec-ab3f-da01944064af None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:06:58.080332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1d21f-483a-49ec-ab3f-da01944064af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:06:58.160371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-05d1d21f-483a-49ec-ab3f-da01944064af None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:06:58.164296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-05d1d21f-483a-49ec-ab3f-da01944064af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:06:58.515010 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2619/5214] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:06:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:06:59.972686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02296621-03e3-4f95-9c8a-6d4d87650490 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:06:59.997778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02296621-03e3-4f95-9c8a-6d4d87650490 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:00.005219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:00.007994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:00.008493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:00.009013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:00.034156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:00.063284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:00.064877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:00.082523 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2596/5215] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:06:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:07:00.984800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39537b2-2263-4b54-9636-2c91b98f33eb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:00.985317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39537b2-2263-4b54-9636-2c91b98f33eb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:00.985503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39537b2-2263-4b54-9636-2c91b98f33eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:01.040107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c39537b2-2263-4b54-9636-2c91b98f33eb None None] MFA Rules not processed for user `2052fd7bb1ee432cb3ca4ec07698292c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:01.072031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c39537b2-2263-4b54-9636-2c91b98f33eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:01.294621 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2620/5216] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:02.627050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:02.629009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:03.017852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a07eea-d33e-4e75-8671-5fa9f65d08f6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:03.045738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd7eb-dd6d-470a-ae65-99b76a358000 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:03.046381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd7eb-dd6d-470a-ae65-99b76a358000 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:03.046656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd7eb-dd6d-470a-ae65-99b76a358000 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:03.046927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd7eb-dd6d-470a-ae65-99b76a358000 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:03.059708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bc4cd7eb-dd6d-470a-ae65-99b76a358000 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:03.094342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cd7eb-dd6d-470a-ae65-99b76a358000 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:03.096335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cd7eb-dd6d-470a-ae65-99b76a358000 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:03.142190 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2597/5217] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:07:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:07:04.124380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39537b2-2263-4b54-9636-2c91b98f33eb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:04.212371 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:04.287690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39537b2-2263-4b54-9636-2c91b98f33eb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:04.300955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:04.301849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:04.302304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:04.303352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] PATH_INFO: `/v3/users/4c13b3ccccdd405c92b22699e00db058` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:04.307682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c13b3ccccdd405c92b22699e00db058)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:04.310279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:04.417997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c13b3ccccdd405c92b22699e00db058'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:04.446578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c13b3ccccdd405c92b22699e00db058'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:04.469302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c13b3ccccdd405c92b22699e00db058'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:04.497176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c13b3ccccdd405c92b22699e00db058'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:04.502612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c13b3ccccdd405c92b22699e00db058'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:04.546782 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2621/5218] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:07:04 2022] DELETE /identity/v3/users/4c13b3ccccdd405c92b22699e00db058 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:07:04.548902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17bade-0a55-4545-9851-f6c387c333af None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:04.549440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17bade-0a55-4545-9851-f6c387c333af None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:04.549581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17bade-0a55-4545-9851-f6c387c333af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:04.612549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:04.614964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:04.650929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fe17bade-0a55-4545-9851-f6c387c333af None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:04.653525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fe17bade-0a55-4545-9851-f6c387c333af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:04.814239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2598/5219] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:04.816814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea0f4e-cf0c-42c3-a883-aaaa57adf08c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:04.824127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:04.824986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:04.825534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:04.826110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:04.829236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:04.847932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:04.851770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:04.869495 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2622/5220] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:07:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:07:04.971835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17bade-0a55-4545-9851-f6c387c333af None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:04.973195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fe17bade-0a55-4545-9851-f6c387c333af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:05.016703 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:05.194642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17bade-0a55-4545-9851-f6c387c333af None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:05.222043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7a61e-234c-4e2c-b5e1-131016e284e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:05.223421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7a61e-234c-4e2c-b5e1-131016e284e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:05.223819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7a61e-234c-4e2c-b5e1-131016e284e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:05.231779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7a61e-234c-4e2c-b5e1-131016e284e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:05.260286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7a61e-234c-4e2c-b5e1-131016e284e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:05.262279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7a61e-234c-4e2c-b5e1-131016e284e5 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:05.290929 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2599/5221] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:07:08.468637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:08.470663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:08.528849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6760019-3c6a-41e2-913b-273f1ed3e3fe service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:08.567400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:08.568816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:08.570001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:08.571035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] PATH_INFO: `/v3/projects/7c0f76578f8c4f02bfaba6f338e6ab7b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:08.576519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0f76578f8c4f02bfaba6f338e6ab7b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:08.578857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:08.799976 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:08.874267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0f76578f8c4f02bfaba6f338e6ab7b', 'request_id': 'req-603a89c1-934a-474d-b65a-6a6565328310'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:08.901271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0f76578f8c4f02bfaba6f338e6ab7b', 'request_id': 'req-603a89c1-934a-474d-b65a-6a6565328310'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:08.930977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0f76578f8c4f02bfaba6f338e6ab7b', 'request_id': 'req-603a89c1-934a-474d-b65a-6a6565328310'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:08.981669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] The token cache is being invalidate because project 7c0f76578f8c4f02bfaba6f338e6ab7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:07:08.991938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:08.993312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:08.995369 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2623/5222] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:08 2022] DELETE /identity/v3/projects/7c0f76578f8c4f02bfaba6f338e6ab7b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:07:08.999063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7a61e-234c-4e2c-b5e1-131016e284e5 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:09.013388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7a61e-234c-4e2c-b5e1-131016e284e5 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:09.197444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:09.198018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:09.198371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:09.198652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] PATH_INFO: `/v3/users/b70706cb86284eb5ac493abffdaf041a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:09.201679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70706cb86284eb5ac493abffdaf041a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:09.207113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:09.340735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70706cb86284eb5ac493abffdaf041a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:09.384752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70706cb86284eb5ac493abffdaf041a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:09.408487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70706cb86284eb5ac493abffdaf041a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:09.424754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70706cb86284eb5ac493abffdaf041a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:09.426303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faea8f67-cc8b-4394-8d22-0d091ffc1d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70706cb86284eb5ac493abffdaf041a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:09.444218 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2600/5223] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:07:08 2022] DELETE /identity/v3/users/b70706cb86284eb5ac493abffdaf041a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:07:10.416669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:10.418549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:10.451776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a89c1-934a-474d-b65a-6a6565328310 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:10.618015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:10.618885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:10.619175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:10.619457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] PATH_INFO: `/v3/projects/cffcfaad604e48db82b57bae93632be2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:10.620706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffcfaad604e48db82b57bae93632be2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:10.624174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:10.715056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffcfaad604e48db82b57bae93632be2', 'request_id': 'req-7d98bee6-8964-4543-bb7c-c423f97143b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:10.726997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffcfaad604e48db82b57bae93632be2', 'request_id': 'req-7d98bee6-8964-4543-bb7c-c423f97143b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:10.737248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffcfaad604e48db82b57bae93632be2', 'request_id': 'req-7d98bee6-8964-4543-bb7c-c423f97143b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:10.765605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] The token cache is being invalidate because project cffcfaad604e48db82b57bae93632be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:07:10.765874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:10.767420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d98bee6-8964-4543-bb7c-c423f97143b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:07:10.772713 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2624/5224] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:10 2022] DELETE /identity/v3/projects/cffcfaad604e48db82b57bae93632be2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:07:10.775423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b959ff-930f-4aac-bba6-8c0fd2da48e9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:10.775927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b959ff-930f-4aac-bba6-8c0fd2da48e9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:10.776046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b959ff-930f-4aac-bba6-8c0fd2da48e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:10.835707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-90b959ff-930f-4aac-bba6-8c0fd2da48e9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:10.839710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-90b959ff-930f-4aac-bba6-8c0fd2da48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:10.955654 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:11.032596 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2601/5225] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:11.040496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdbd14-d354-4117-87bc-17918027d309 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:11.043367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdbd14-d354-4117-87bc-17918027d309 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:11.043826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdbd14-d354-4117-87bc-17918027d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:11.093619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-63cdbd14-d354-4117-87bc-17918027d309 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:11.095048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-63cdbd14-d354-4117-87bc-17918027d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:11.124260 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2625/5226] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:11.125662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b959ff-930f-4aac-bba6-8c0fd2da48e9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:11.152794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b959ff-930f-4aac-bba6-8c0fd2da48e9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:11.172093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c972a-db8b-4017-860b-f58e79d36d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:11.173572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c972a-db8b-4017-860b-f58e79d36d6a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:11.173965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c972a-db8b-4017-860b-f58e79d36d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:11.174577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c972a-db8b-4017-860b-f58e79d36d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:11.175401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c972a-db8b-4017-860b-f58e79d36d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:07:11.175841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c972a-db8b-4017-860b-f58e79d36d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:11.191966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c972a-db8b-4017-860b-f58e79d36d6a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:11.233582 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2602/5227] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:07:11.235023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdbd14-d354-4117-87bc-17918027d309 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:11.255356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdbd14-d354-4117-87bc-17918027d309 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:11.266240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b7d09-7e86-4909-8b85-49e12773dab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:11.266875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7d09-7e86-4909-8b85-49e12773dab4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:11.267153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7d09-7e86-4909-8b85-49e12773dab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:11.267425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7d09-7e86-4909-8b85-49e12773dab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:11.268078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b7d09-7e86-4909-8b85-49e12773dab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:11.270028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b7d09-7e86-4909-8b85-49e12773dab4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:11.326515 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2626/5228] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:07:11 2022] POST /identity/v3/projects => generated 367 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:07:11.327684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c972a-db8b-4017-860b-f58e79d36d6a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:11.358834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c972a-db8b-4017-860b-f58e79d36d6a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:11.554175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1f23c-3974-4ac4-9b13-2c43b6dd92c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:11.556203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1f23c-3974-4ac4-9b13-2c43b6dd92c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:11.556497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1f23c-3974-4ac4-9b13-2c43b6dd92c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:11.556816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1f23c-3974-4ac4-9b13-2c43b6dd92c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:11.557465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1f23c-3974-4ac4-9b13-2c43b6dd92c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:11.560432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1f23c-3974-4ac4-9b13-2c43b6dd92c2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:11.597078 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2603/5229] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:07:11 2022] POST /identity/v3/users => generated 284 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:07:11.604797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b7d09-7e86-4909-8b85-49e12773dab4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:11.620190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b7d09-7e86-4909-8b85-49e12773dab4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:11.642747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0eca-8b8c-49ff-8cb0-035c0335cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:11.644021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0eca-8b8c-49ff-8cb0-035c0335cd37 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:11.644523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0eca-8b8c-49ff-8cb0-035c0335cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:11.645172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0eca-8b8c-49ff-8cb0-035c0335cd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:11.647108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0eca-8b8c-49ff-8cb0-035c0335cd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:11.648897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0eca-8b8c-49ff-8cb0-035c0335cd37 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:11.682606 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2627/5230] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:07:11.686913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1f23c-3974-4ac4-9b13-2c43b6dd92c2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:11.708288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1f23c-3974-4ac4-9b13-2c43b6dd92c2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:11.727886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a02390-98af-4ba5-a204-df8977507dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:11.729018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02390-98af-4ba5-a204-df8977507dcc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:11.729696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02390-98af-4ba5-a204-df8977507dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:11.730189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02390-98af-4ba5-a204-df8977507dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:11.731130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a02390-98af-4ba5-a204-df8977507dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:11.733335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a02390-98af-4ba5-a204-df8977507dcc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:11.747767 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2604/5231] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:07:11.751752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0eca-8b8c-49ff-8cb0-035c0335cd37 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:11.767263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0eca-8b8c-49ff-8cb0-035c0335cd37 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:11.785393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4a201-db49-4584-8ec3-3b05a36ef233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:11.786498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4a201-db49-4584-8ec3-3b05a36ef233 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:11.788264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4a201-db49-4584-8ec3-3b05a36ef233 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:11.790073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4a201-db49-4584-8ec3-3b05a36ef233 admin admin] PATH_INFO: `/v3/projects/ab3441c4e5044c2f9fb8a44f1df9c6dd/users/a7b838a2f3b14af6b4d9f30516b8ce34/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:11.814469 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:11.821901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4a201-db49-4584-8ec3-3b05a36ef233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3441c4e5044c2f9fb8a44f1df9c6dd, user_id=a7b838a2f3b14af6b4d9f30516b8ce34, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:11.833831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4a201-db49-4584-8ec3-3b05a36ef233 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:11.897095 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2628/5232] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:07:11 2022] PUT /identity/v3/projects/ab3441c4e5044c2f9fb8a44f1df9c6dd/users/a7b838a2f3b14af6b4d9f30516b8ce34/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:07:11.923582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91db5-f452-4c45-b5e0-941353c7025f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:11.924029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91db5-f452-4c45-b5e0-941353c7025f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:11.924156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91db5-f452-4c45-b5e0-941353c7025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:12.010620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-39f91db5-f452-4c45-b5e0-941353c7025f None None] MFA Rules not processed for user `a7b838a2f3b14af6b4d9f30516b8ce34`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:12.012091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-39f91db5-f452-4c45-b5e0-941353c7025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:12.254871 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2605/5233] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:12.301263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4a201-db49-4584-8ec3-3b05a36ef233 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:12.304567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-57a4a201-db49-4584-8ec3-3b05a36ef233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:12.464764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4a201-db49-4584-8ec3-3b05a36ef233 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:12.474468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034b337-22bd-4a03-80dd-3ee4ee6b4c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:12.475442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034b337-22bd-4a03-80dd-3ee4ee6b4c63 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:12.475725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034b337-22bd-4a03-80dd-3ee4ee6b4c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:12.475998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034b337-22bd-4a03-80dd-3ee4ee6b4c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:12.500670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034b337-22bd-4a03-80dd-3ee4ee6b4c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:12.502029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034b337-22bd-4a03-80dd-3ee4ee6b4c63 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:12.524375 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2629/5234] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:07:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:07:19.422461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33139aa-9558-4d62-bc0a-184da7767a3b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:19.423029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33139aa-9558-4d62-bc0a-184da7767a3b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:19.423029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33139aa-9558-4d62-bc0a-184da7767a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:19.452471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d33139aa-9558-4d62-bc0a-184da7767a3b None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:19.455557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d33139aa-9558-4d62-bc0a-184da7767a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:19.502243 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:19.584587 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2606/5235] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:07:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:19.594613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034b337-22bd-4a03-80dd-3ee4ee6b4c63 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:19.596173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5034b337-22bd-4a03-80dd-3ee4ee6b4c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:19.778736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034b337-22bd-4a03-80dd-3ee4ee6b4c63 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:19.794233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951744c-f6ef-4c51-9a00-55dc805e69d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:19.794880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951744c-f6ef-4c51-9a00-55dc805e69d0 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:19.795261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951744c-f6ef-4c51-9a00-55dc805e69d0 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:19.795542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951744c-f6ef-4c51-9a00-55dc805e69d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:19.819492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951744c-f6ef-4c51-9a00-55dc805e69d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:19.822101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951744c-f6ef-4c51-9a00-55dc805e69d0 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:19.847099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589f18-e813-4b1e-9e3b-ed402fb95c19 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:19.847444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589f18-e813-4b1e-9e3b-ed402fb95c19 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:19.847752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589f18-e813-4b1e-9e3b-ed402fb95c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:19.855658 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2630/5236] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:07:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:07:19.881360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b5589f18-e813-4b1e-9e3b-ed402fb95c19 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:19.885848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b5589f18-e813-4b1e-9e3b-ed402fb95c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:19.916109 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2607/5237] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:07:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:07:20.006587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951744c-f6ef-4c51-9a00-55dc805e69d0 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:20.031936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951744c-f6ef-4c51-9a00-55dc805e69d0 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:20.057366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639d3a4-8318-4bb5-a2c4-6c5b66be15c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:20.058018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639d3a4-8318-4bb5-a2c4-6c5b66be15c6 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:20.059742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639d3a4-8318-4bb5-a2c4-6c5b66be15c6 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:20.064741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639d3a4-8318-4bb5-a2c4-6c5b66be15c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:20.092157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639d3a4-8318-4bb5-a2c4-6c5b66be15c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:20.093947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639d3a4-8318-4bb5-a2c4-6c5b66be15c6 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:20.113343 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2631/5238] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:07:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:07:29.867181 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=14 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:30.105693 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:42.253797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d2b9-65a4-4b22-88d9-cd12d851efa9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:42.255438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d2b9-65a4-4b22-88d9-cd12d851efa9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:42.255908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d2b9-65a4-4b22-88d9-cd12d851efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:42.344901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2c89d2b9-65a4-4b22-88d9-cd12d851efa9 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:42.351522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2c89d2b9-65a4-4b22-88d9-cd12d851efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:42.532672 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2608/5239] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:46.093454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639d3a4-8318-4bb5-a2c4-6c5b66be15c6 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:46.119871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639d3a4-8318-4bb5-a2c4-6c5b66be15c6 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:46.129996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abd45e-9662-4e0e-8430-c9924c36aedb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:46.130895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abd45e-9662-4e0e-8430-c9924c36aedb service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:46.131373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abd45e-9662-4e0e-8430-c9924c36aedb service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:46.132453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abd45e-9662-4e0e-8430-c9924c36aedb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:46.140690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d7abd45e-9662-4e0e-8430-c9924c36aedb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:46.255242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abd45e-9662-4e0e-8430-c9924c36aedb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:46.256909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abd45e-9662-4e0e-8430-c9924c36aedb service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:46.283668 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2632/5240] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:07:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:07:48.321239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b703-1499-4e40-b6fd-eea45d7de552 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:48.321836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b703-1499-4e40-b6fd-eea45d7de552 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:48.323310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6b703-1499-4e40-b6fd-eea45d7de552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:48.368022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dbd6b703-1499-4e40-b6fd-eea45d7de552 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:48.371075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dbd6b703-1499-4e40-b6fd-eea45d7de552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:48.397743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2609/5241] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:50.375670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8e013-220f-4b84-af75-7aca9fcdde46 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:50.376096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8e013-220f-4b84-af75-7aca9fcdde46 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:50.376219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8e013-220f-4b84-af75-7aca9fcdde46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:50.421371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8fd8e013-220f-4b84-af75-7aca9fcdde46 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:50.430103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8fd8e013-220f-4b84-af75-7aca9fcdde46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:50.447052 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2633/5242] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:07:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:50.468216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6b703-1499-4e40-b6fd-eea45d7de552 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:50.491564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6b703-1499-4e40-b6fd-eea45d7de552 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:50.508342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c20f1-49c9-48b1-be82-11fd5eee9c4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:50.509005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c20f1-49c9-48b1-be82-11fd5eee9c4e service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:50.512761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c20f1-49c9-48b1-be82-11fd5eee9c4e service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:50.513277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c20f1-49c9-48b1-be82-11fd5eee9c4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:50.524510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c20f1-49c9-48b1-be82-11fd5eee9c4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:50.526274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c20f1-49c9-48b1-be82-11fd5eee9c4e service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:50.539492 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2610/5243] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:07:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:07:52.602994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1873d7-ac59-4d56-b018-38387e10d8c1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:52.603456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1873d7-ac59-4d56-b018-38387e10d8c1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:52.603572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1873d7-ac59-4d56-b018-38387e10d8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:52.653351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6b1873d7-ac59-4d56-b018-38387e10d8c1 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:52.655175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6b1873d7-ac59-4d56-b018-38387e10d8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:52.675439 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2634/5244] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:53.939523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c20f1-49c9-48b1-be82-11fd5eee9c4e service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:53.942430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3e4c20f1-49c9-48b1-be82-11fd5eee9c4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:54.163634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c20f1-49c9-48b1-be82-11fd5eee9c4e service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:54.174984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a835a4-b980-47e0-a35b-3ea0301ca6d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:54.177110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a835a4-b980-47e0-a35b-3ea0301ca6d4 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:54.177645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a835a4-b980-47e0-a35b-3ea0301ca6d4 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:54.179170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a835a4-b980-47e0-a35b-3ea0301ca6d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:54.185514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-90a835a4-b980-47e0-a35b-3ea0301ca6d4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:54.451714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a835a4-b980-47e0-a35b-3ea0301ca6d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:54.453763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a835a4-b980-47e0-a35b-3ea0301ca6d4 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:54.483258 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2611/5245] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:07:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:07:54.603981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1873d7-ac59-4d56-b018-38387e10d8c1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:07:54.622104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1873d7-ac59-4d56-b018-38387e10d8c1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:07:54.629789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabc8a3-0107-4fc3-9a67-5543a56e919e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:07:54.638972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabc8a3-0107-4fc3-9a67-5543a56e919e service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:54.639550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabc8a3-0107-4fc3-9a67-5543a56e919e service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:54.639997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabc8a3-0107-4fc3-9a67-5543a56e919e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:54.642498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fdabc8a3-0107-4fc3-9a67-5543a56e919e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:54.669825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabc8a3-0107-4fc3-9a67-5543a56e919e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:07:54.671718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabc8a3-0107-4fc3-9a67-5543a56e919e service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:07:54.718609 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2635/5246] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:07:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:07:55.716039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af440f57-c17f-4aa2-8df1-6d3c6f25ee42 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:55.716754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af440f57-c17f-4aa2-8df1-6d3c6f25ee42 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:55.716754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af440f57-c17f-4aa2-8df1-6d3c6f25ee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:55.762588 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:55.795393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-af440f57-c17f-4aa2-8df1-6d3c6f25ee42 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:55.802424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-af440f57-c17f-4aa2-8df1-6d3c6f25ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:55.857069 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2612/5247] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:07:57.615689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457e459-681e-4a54-b0f2-5ac703fd022e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:57.616207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457e459-681e-4a54-b0f2-5ac703fd022e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:57.616314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457e459-681e-4a54-b0f2-5ac703fd022e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:57.640469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a457e459-681e-4a54-b0f2-5ac703fd022e None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:57.642841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a457e459-681e-4a54-b0f2-5ac703fd022e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:57.669524 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2636/5248] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:07:58.613786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9f094-ef75-410c-927f-d1f8c8269ea2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:07:58.614748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9f094-ef75-410c-927f-d1f8c8269ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:07:58.615202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9f094-ef75-410c-927f-d1f8c8269ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:07:58.704430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-28b9f094-ef75-410c-927f-d1f8c8269ea2 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:07:58.720065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-28b9f094-ef75-410c-927f-d1f8c8269ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:07:58.756771 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2613/5249] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:00.354932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030da89-4b2b-4fd1-b7b0-e977f63fdc41 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:00.355466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030da89-4b2b-4fd1-b7b0-e977f63fdc41 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:00.355675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030da89-4b2b-4fd1-b7b0-e977f63fdc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:00.439925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f030da89-4b2b-4fd1-b7b0-e977f63fdc41 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:00.451026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f030da89-4b2b-4fd1-b7b0-e977f63fdc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:00.474461 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2637/5250] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:08:01.575946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d326-f48c-409a-b557-a82a4bcdcfb7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:01.577256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d326-f48c-409a-b557-a82a4bcdcfb7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:01.577789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d326-f48c-409a-b557-a82a4bcdcfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:01.628180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1632d326-f48c-409a-b557-a82a4bcdcfb7 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:01.634193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1632d326-f48c-409a-b557-a82a4bcdcfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:01.682075 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2614/5251] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:02.804925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7348-a06e-416f-9c67-2a31bb399f3c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:02.805734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7348-a06e-416f-9c67-2a31bb399f3c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:02.806175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7348-a06e-416f-9c67-2a31bb399f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:02.865089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-252c7348-a06e-416f-9c67-2a31bb399f3c None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:02.866592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-252c7348-a06e-416f-9c67-2a31bb399f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:02.880818 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2638/5252] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:08:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:02.911068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d326-f48c-409a-b557-a82a4bcdcfb7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:02.948955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d326-f48c-409a-b557-a82a4bcdcfb7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:02.971547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a054b-b574-4d48-8c73-9a38de01f128 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:02.972897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a054b-b574-4d48-8c73-9a38de01f128 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:02.973061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a054b-b574-4d48-8c73-9a38de01f128 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:02.973340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a054b-b574-4d48-8c73-9a38de01f128 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:03.016981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a054b-b574-4d48-8c73-9a38de01f128 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:03.021568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a054b-b574-4d48-8c73-9a38de01f128 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:03.033204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd344d-c264-41cf-b80e-4c52b2a021b5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:03.033877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd344d-c264-41cf-b80e-4c52b2a021b5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:03.034396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd344d-c264-41cf-b80e-4c52b2a021b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:03.044508 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2615/5253] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:08:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:03.088793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2cfd344d-c264-41cf-b80e-4c52b2a021b5 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:03.091305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2cfd344d-c264-41cf-b80e-4c52b2a021b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:03.128953 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2639/5254] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:13.033724 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=12 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:13.084503 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=52 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:21.586508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f29c0-25d9-4b23-9daf-a79fe45413ea None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:21.587484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f29c0-25d9-4b23-9daf-a79fe45413ea None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:21.588647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f29c0-25d9-4b23-9daf-a79fe45413ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:21.669809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ec6f29c0-25d9-4b23-9daf-a79fe45413ea None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:21.671067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ec6f29c0-25d9-4b23-9daf-a79fe45413ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:21.684021 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2616/5255] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:24.140883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd344d-c264-41cf-b80e-4c52b2a021b5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:24.142489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2cfd344d-c264-41cf-b80e-4c52b2a021b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:24.311661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd344d-c264-41cf-b80e-4c52b2a021b5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:24.318008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:24.318796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:24.319283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:24.319720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:24.322067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:24.336215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:24.337860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:24.370167 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2640/5256] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:24.727925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f29c0-25d9-4b23-9daf-a79fe45413ea None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:24.729478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ec6f29c0-25d9-4b23-9daf-a79fe45413ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:24.754362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f29c0-25d9-4b23-9daf-a79fe45413ea None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:24.765746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07929-c22b-47b5-85f7-aea926624251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:24.766603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07929-c22b-47b5-85f7-aea926624251 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:24.767061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07929-c22b-47b5-85f7-aea926624251 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:24.767512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07929-c22b-47b5-85f7-aea926624251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:24.778248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-01a07929-c22b-47b5-85f7-aea926624251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:24.795756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a07929-c22b-47b5-85f7-aea926624251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:24.807605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a07929-c22b-47b5-85f7-aea926624251 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:24.823377 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2617/5257] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:25.277323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:25.283438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:25.325230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f619f5-8a4a-4c8d-bac6-edc7c53b4eb5 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:25.339026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c5f01-9f38-4e61-acda-dcd079245d35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:25.339710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c5f01-9f38-4e61-acda-dcd079245d35 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:25.340021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c5f01-9f38-4e61-acda-dcd079245d35 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:25.341333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c5f01-9f38-4e61-acda-dcd079245d35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:25.344132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-874c5f01-9f38-4e61-acda-dcd079245d35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:25.368366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c5f01-9f38-4e61-acda-dcd079245d35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:25.370798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c5f01-9f38-4e61-acda-dcd079245d35 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:25.441008 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2641/5258] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:25.916252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07929-c22b-47b5-85f7-aea926624251 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:25.926945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07929-c22b-47b5-85f7-aea926624251 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:25.937723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430312d-39b0-4b4d-b1c6-dd35dcb38e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:25.938361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430312d-39b0-4b4d-b1c6-dd35dcb38e65 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:25.938643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430312d-39b0-4b4d-b1c6-dd35dcb38e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:25.939187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430312d-39b0-4b4d-b1c6-dd35dcb38e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:25.941964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3430312d-39b0-4b4d-b1c6-dd35dcb38e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:25.971877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430312d-39b0-4b4d-b1c6-dd35dcb38e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:25.973980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430312d-39b0-4b4d-b1c6-dd35dcb38e65 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:25.991462 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2618/5259] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:27.908422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d3e74-5355-4fd1-a327-57e3ed6614ce None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:27.909565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d3e74-5355-4fd1-a327-57e3ed6614ce None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:27.910321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d3e74-5355-4fd1-a327-57e3ed6614ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:27.934857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-488d3e74-5355-4fd1-a327-57e3ed6614ce None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:27.937138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-488d3e74-5355-4fd1-a327-57e3ed6614ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:27.949879 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2642/5260] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:08:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:27.967280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430312d-39b0-4b4d-b1c6-dd35dcb38e65 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:28.014996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430312d-39b0-4b4d-b1c6-dd35dcb38e65 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:28.030419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c734481-f28f-45ec-86ce-76c2dc4feebb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:28.034021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734481-f28f-45ec-86ce-76c2dc4feebb service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:28.035930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734481-f28f-45ec-86ce-76c2dc4feebb service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:28.036224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734481-f28f-45ec-86ce-76c2dc4feebb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:28.062323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c734481-f28f-45ec-86ce-76c2dc4feebb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:28.064243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c734481-f28f-45ec-86ce-76c2dc4feebb service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:28.100663 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2619/5261] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:08:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:29.655246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682a31-ea48-4c05-92dd-01e12d93ac2d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:29.656525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682a31-ea48-4c05-92dd-01e12d93ac2d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:29.657097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682a31-ea48-4c05-92dd-01e12d93ac2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:29.705647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-90682a31-ea48-4c05-92dd-01e12d93ac2d None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:29.708390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-90682a31-ea48-4c05-92dd-01e12d93ac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:29.719524 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2643/5262] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:08:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:08:29.738044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c734481-f28f-45ec-86ce-76c2dc4feebb service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:29.752059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c734481-f28f-45ec-86ce-76c2dc4feebb service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:29.761641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dbeeb-5385-4a07-9aa1-fb68172e5691 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:29.762970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dbeeb-5385-4a07-9aa1-fb68172e5691 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:29.763448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dbeeb-5385-4a07-9aa1-fb68172e5691 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:29.764179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dbeeb-5385-4a07-9aa1-fb68172e5691 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:29.787422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dbeeb-5385-4a07-9aa1-fb68172e5691 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:29.789367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dbeeb-5385-4a07-9aa1-fb68172e5691 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:29.846553 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2620/5263] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:08:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:30.711012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abccfac-3f64-44b2-ac7e-8c1e75999656 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:30.711913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abccfac-3f64-44b2-ac7e-8c1e75999656 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:30.712367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abccfac-3f64-44b2-ac7e-8c1e75999656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:30.751087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4abccfac-3f64-44b2-ac7e-8c1e75999656 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:30.754578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4abccfac-3f64-44b2-ac7e-8c1e75999656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:30.781684 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2644/5264] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:08:30.794043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dbeeb-5385-4a07-9aa1-fb68172e5691 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:30.813929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dbeeb-5385-4a07-9aa1-fb68172e5691 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:30.828527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391258c-2b4a-409e-aff3-d12025b9a764 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:30.829470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391258c-2b4a-409e-aff3-d12025b9a764 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:30.829917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391258c-2b4a-409e-aff3-d12025b9a764 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:30.831057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391258c-2b4a-409e-aff3-d12025b9a764 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:30.855430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391258c-2b4a-409e-aff3-d12025b9a764 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:30.857097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391258c-2b4a-409e-aff3-d12025b9a764 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:30.879039 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2621/5265] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:08:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:31.660723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abccfac-3f64-44b2-ac7e-8c1e75999656 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:31.711403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abccfac-3f64-44b2-ac7e-8c1e75999656 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:31.723007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faaa72-bcd6-4749-8655-a62956cbfec2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:31.723928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faaa72-bcd6-4749-8655-a62956cbfec2 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:31.724833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faaa72-bcd6-4749-8655-a62956cbfec2 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:31.725429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faaa72-bcd6-4749-8655-a62956cbfec2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:31.728021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-44faaa72-bcd6-4749-8655-a62956cbfec2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:31.757522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9277-6226-4871-9d62-29fe015bd7f4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:31.757814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9277-6226-4871-9d62-29fe015bd7f4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:31.758507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9277-6226-4871-9d62-29fe015bd7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:31.768743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faaa72-bcd6-4749-8655-a62956cbfec2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:31.771700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faaa72-bcd6-4749-8655-a62956cbfec2 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:31.788690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a52a9277-6226-4871-9d62-29fe015bd7f4 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:31.790473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a52a9277-6226-4871-9d62-29fe015bd7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:31.806041 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2645/5266] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:31.816405 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2622/5267] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:31.838120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faaa72-bcd6-4749-8655-a62956cbfec2 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:31.865442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faaa72-bcd6-4749-8655-a62956cbfec2 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:31.888352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c23b3-01a1-4511-a86d-266b79701d72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:31.889265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c23b3-01a1-4511-a86d-266b79701d72 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:31.889672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c23b3-01a1-4511-a86d-266b79701d72 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:31.890044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c23b3-01a1-4511-a86d-266b79701d72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:31.925167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c23b3-01a1-4511-a86d-266b79701d72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:31.938026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c23b3-01a1-4511-a86d-266b79701d72 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:32.044889 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2646/5268] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:08:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:33.913416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a9277-6226-4871-9d62-29fe015bd7f4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:34.101794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a9277-6226-4871-9d62-29fe015bd7f4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:34.115561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:34.116999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:34.118002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:34.118901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] PATH_INFO: `/v3/users/a7b838a2f3b14af6b4d9f30516b8ce34` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:34.122584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b838a2f3b14af6b4d9f30516b8ce34)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:34.127774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:34.233122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b838a2f3b14af6b4d9f30516b8ce34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:34.288924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b838a2f3b14af6b4d9f30516b8ce34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:34.317191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b838a2f3b14af6b4d9f30516b8ce34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:34.345171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b838a2f3b14af6b4d9f30516b8ce34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:34.348301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86c30783-4944-4c9f-ad5c-77f1d0f2ea22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b838a2f3b14af6b4d9f30516b8ce34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:34.379406 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:34.398838 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2623/5269] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:08:33 2022] DELETE /identity/v3/users/a7b838a2f3b14af6b4d9f30516b8ce34 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:08:34.400348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b9581-3bbc-4e37-a774-74517279569e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:34.400863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b9581-3bbc-4e37-a774-74517279569e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:34.400968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b9581-3bbc-4e37-a774-74517279569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:34.422113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb5e2-db24-4afd-9222-697560104c48 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:34.424469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb5e2-db24-4afd-9222-697560104c48 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:34.425087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb5e2-db24-4afd-9222-697560104c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:34.437856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9f1b9581-3bbc-4e37-a774-74517279569e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:34.442382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9f1b9581-3bbc-4e37-a774-74517279569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:34.468847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d5ffb5e2-db24-4afd-9222-697560104c48 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:34.479270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d5ffb5e2-db24-4afd-9222-697560104c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:34.649845 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2647/5270] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:34.672435 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2624/5271] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:08:34.729377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b9581-3bbc-4e37-a774-74517279569e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:34.731106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9f1b9581-3bbc-4e37-a774-74517279569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:34.830942 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:34.879461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b9581-3bbc-4e37-a774-74517279569e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:34.885271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731a714-a43a-4aeb-a010-54955f9ec370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:34.886571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731a714-a43a-4aeb-a010-54955f9ec370 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:34.887091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731a714-a43a-4aeb-a010-54955f9ec370 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:34.887630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731a714-a43a-4aeb-a010-54955f9ec370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:34.902100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731a714-a43a-4aeb-a010-54955f9ec370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:34.904870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731a714-a43a-4aeb-a010-54955f9ec370 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:34.927050 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2648/5272] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:35.495478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb5e2-db24-4afd-9222-697560104c48 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:35.497512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d5ffb5e2-db24-4afd-9222-697560104c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:35.525139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb5e2-db24-4afd-9222-697560104c48 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:35.532039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:35.532935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:35.533926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:35.534481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] PATH_INFO: `/v3/projects/ab3441c4e5044c2f9fb8a44f1df9c6dd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:35.536335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3441c4e5044c2f9fb8a44f1df9c6dd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:35.541227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:35.593273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100143ca-a8f5-45f5-80ca-53bd921391d1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:35.594226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100143ca-a8f5-45f5-80ca-53bd921391d1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:35.594666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100143ca-a8f5-45f5-80ca-53bd921391d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:35.637611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-100143ca-a8f5-45f5-80ca-53bd921391d1 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:35.641429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-100143ca-a8f5-45f5-80ca-53bd921391d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:35.667497 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2649/5273] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:35.712738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3441c4e5044c2f9fb8a44f1df9c6dd', 'request_id': 'req-6512c0d0-14e5-457b-99c2-a80165e91f8f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:35.734403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3441c4e5044c2f9fb8a44f1df9c6dd', 'request_id': 'req-6512c0d0-14e5-457b-99c2-a80165e91f8f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:35.744908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3441c4e5044c2f9fb8a44f1df9c6dd', 'request_id': 'req-6512c0d0-14e5-457b-99c2-a80165e91f8f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:35.763172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] The token cache is being invalidate because project ab3441c4e5044c2f9fb8a44f1df9c6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:08:35.765566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:35.766446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6512c0d0-14e5-457b-99c2-a80165e91f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:35.772977 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2625/5274] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:08:35 2022] DELETE /identity/v3/projects/ab3441c4e5044c2f9fb8a44f1df9c6dd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:08:35.774772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1921f-dd94-4494-9c29-39a87c845b7e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:35.775165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1921f-dd94-4494-9c29-39a87c845b7e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:35.775545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1921f-dd94-4494-9c29-39a87c845b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:35.799938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-70f1921f-dd94-4494-9c29-39a87c845b7e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:35.801214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-70f1921f-dd94-4494-9c29-39a87c845b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:35.980200 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2650/5275] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:35.989541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12dd30-9777-4be3-aa07-41c7ed072ce4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:35.989826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12dd30-9777-4be3-aa07-41c7ed072ce4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:35.990166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12dd30-9777-4be3-aa07-41c7ed072ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:36.056418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-df12dd30-9777-4be3-aa07-41c7ed072ce4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:36.057683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-df12dd30-9777-4be3-aa07-41c7ed072ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:36.070180 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2626/5276] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:36.074251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1921f-dd94-4494-9c29-39a87c845b7e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:36.089857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1921f-dd94-4494-9c29-39a87c845b7e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:36.104308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96123d1-8776-46e3-9856-f2fcfda91627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:36.105294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96123d1-8776-46e3-9856-f2fcfda91627 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:36.105740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96123d1-8776-46e3-9856-f2fcfda91627 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:36.106177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96123d1-8776-46e3-9856-f2fcfda91627 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:36.107233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96123d1-8776-46e3-9856-f2fcfda91627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:08:36.107703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96123d1-8776-46e3-9856-f2fcfda91627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:36.113779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96123d1-8776-46e3-9856-f2fcfda91627 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:36.144916 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2651/5277] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:08:36.145397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12dd30-9777-4be3-aa07-41c7ed072ce4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:36.175996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12dd30-9777-4be3-aa07-41c7ed072ce4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:36.192000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3bf3c-1164-44d0-bc59-a99a3ff7182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:36.192685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3bf3c-1164-44d0-bc59-a99a3ff7182e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:36.193281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3bf3c-1164-44d0-bc59-a99a3ff7182e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:36.193526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3bf3c-1164-44d0-bc59-a99a3ff7182e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:36.194225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3bf3c-1164-44d0-bc59-a99a3ff7182e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:36.207421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3bf3c-1164-44d0-bc59-a99a3ff7182e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:36.269689 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2627/5278] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:08:36 2022] POST /identity/v3/projects => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:08:36.276614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96123d1-8776-46e3-9856-f2fcfda91627 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:36.303319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96123d1-8776-46e3-9856-f2fcfda91627 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:36.464869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c80a-5a3c-4ead-9062-925a024a277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:36.465843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c80a-5a3c-4ead-9062-925a024a277a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:36.466312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c80a-5a3c-4ead-9062-925a024a277a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:36.466845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c80a-5a3c-4ead-9062-925a024a277a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:36.467709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820c80a-5a3c-4ead-9062-925a024a277a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:36.471012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820c80a-5a3c-4ead-9062-925a024a277a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:36.538118 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2652/5279] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:08:36 2022] POST /identity/v3/users => generated 280 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:08:36.542224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3bf3c-1164-44d0-bc59-a99a3ff7182e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:36.581107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3bf3c-1164-44d0-bc59-a99a3ff7182e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:36.616454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e842-553c-42b5-b317-42d8dfd9b137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:36.616454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e842-553c-42b5-b317-42d8dfd9b137 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:36.616454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e842-553c-42b5-b317-42d8dfd9b137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:36.616454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e842-553c-42b5-b317-42d8dfd9b137 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:36.616906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e842-553c-42b5-b317-42d8dfd9b137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:36.616906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e842-553c-42b5-b317-42d8dfd9b137 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:36.646203 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2628/5280] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:08:36.650235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c80a-5a3c-4ead-9062-925a024a277a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:36.686043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c80a-5a3c-4ead-9062-925a024a277a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:36.695057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696dcf-dcfa-487a-a28c-b092a936a719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:36.696764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696dcf-dcfa-487a-a28c-b092a936a719 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:36.697570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696dcf-dcfa-487a-a28c-b092a936a719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:36.698556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696dcf-dcfa-487a-a28c-b092a936a719 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:36.699376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5696dcf-dcfa-487a-a28c-b092a936a719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:36.701859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5696dcf-dcfa-487a-a28c-b092a936a719 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:36.720862 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2653/5281] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:08:36.723899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e842-553c-42b5-b317-42d8dfd9b137 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:36.747395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e842-553c-42b5-b317-42d8dfd9b137 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:36.766674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11966948-ba2f-4752-9858-c2daf6d7dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:36.767330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11966948-ba2f-4752-9858-c2daf6d7dd6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:36.767648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11966948-ba2f-4752-9858-c2daf6d7dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:36.767925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11966948-ba2f-4752-9858-c2daf6d7dd6a admin admin] PATH_INFO: `/v3/projects/91558b1f11b04d938c780f738cbdea3b/users/33694e263d71460fb6f1f185859d5e07/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:36.788608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11966948-ba2f-4752-9858-c2daf6d7dd6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91558b1f11b04d938c780f738cbdea3b, user_id=33694e263d71460fb6f1f185859d5e07, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:36.804341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11966948-ba2f-4752-9858-c2daf6d7dd6a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:36.842495 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2629/5282] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:08:36 2022] PUT /identity/v3/projects/91558b1f11b04d938c780f738cbdea3b/users/33694e263d71460fb6f1f185859d5e07/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:08:36.847031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2712a4-2e73-4e53-ba00-3b1edf4c0657 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:36.847508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2712a4-2e73-4e53-ba00-3b1edf4c0657 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:36.847942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2712a4-2e73-4e53-ba00-3b1edf4c0657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:36.930791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3e2712a4-2e73-4e53-ba00-3b1edf4c0657 None None] MFA Rules not processed for user `33694e263d71460fb6f1f185859d5e07`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:36.932073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3e2712a4-2e73-4e53-ba00-3b1edf4c0657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:37.037498 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:37.144179 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2654/5283] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:37.190887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11966948-ba2f-4752-9858-c2daf6d7dd6a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:37.192976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-11966948-ba2f-4752-9858-c2daf6d7dd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:37.264678 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:37.353481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11966948-ba2f-4752-9858-c2daf6d7dd6a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:37.365505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2a175-1518-489e-8eb3-cf07bfa49066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:37.366338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2a175-1518-489e-8eb3-cf07bfa49066 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:37.366814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2a175-1518-489e-8eb3-cf07bfa49066 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:37.367292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2a175-1518-489e-8eb3-cf07bfa49066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:37.382106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2a175-1518-489e-8eb3-cf07bfa49066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:37.383562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2a175-1518-489e-8eb3-cf07bfa49066 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:37.404826 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2630/5284] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:43.088828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539f1b-3987-4705-bdcb-2407171894f1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:43.089543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539f1b-3987-4705-bdcb-2407171894f1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:43.089543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539f1b-3987-4705-bdcb-2407171894f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:43.127060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6f539f1b-3987-4705-bdcb-2407171894f1 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:43.128335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6f539f1b-3987-4705-bdcb-2407171894f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:43.275936 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2655/5285] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:43.289847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2a175-1518-489e-8eb3-cf07bfa49066 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:43.292472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-94f2a175-1518-489e-8eb3-cf07bfa49066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:43.438963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2a175-1518-489e-8eb3-cf07bfa49066 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:43.465355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1832-e726-48a6-8536-10763313bcd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:43.466310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1832-e726-48a6-8536-10763313bcd7 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:43.466839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1832-e726-48a6-8536-10763313bcd7 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:43.467311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1832-e726-48a6-8536-10763313bcd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:43.481950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf1832-e726-48a6-8536-10763313bcd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:43.484971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf1832-e726-48a6-8536-10763313bcd7 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:43.499345 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2631/5286] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:08:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:43.847968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f447-bc18-4c2a-915f-9e4897c30cf0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:43.848604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f447-bc18-4c2a-915f-9e4897c30cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:43.849331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f447-bc18-4c2a-915f-9e4897c30cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:43.924765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d967f447-bc18-4c2a-915f-9e4897c30cf0 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:43.926820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d967f447-bc18-4c2a-915f-9e4897c30cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:43.942133 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2656/5287] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:08:43.965386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1832-e726-48a6-8536-10763313bcd7 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:43.984608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1832-e726-48a6-8536-10763313bcd7 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:43.992550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c6596-755e-468e-b9a5-a5da001f9492 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:43.993539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c6596-755e-468e-b9a5-a5da001f9492 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:43.993919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c6596-755e-468e-b9a5-a5da001f9492 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:43.994329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c6596-755e-468e-b9a5-a5da001f9492 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:44.006320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c6596-755e-468e-b9a5-a5da001f9492 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:44.008600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c6596-755e-468e-b9a5-a5da001f9492 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:44.024136 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2632/5288] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:08:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:08:44.348854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189312-5148-4a4e-999f-87385059017d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:44.349429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189312-5148-4a4e-999f-87385059017d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:44.349563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189312-5148-4a4e-999f-87385059017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:44.416952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d1189312-5148-4a4e-999f-87385059017d None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:44.419848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d1189312-5148-4a4e-999f-87385059017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:44.448442 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2657/5289] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:08:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:44.468978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c6596-755e-468e-b9a5-a5da001f9492 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:44.490887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c6596-755e-468e-b9a5-a5da001f9492 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:44.515662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f9218-2277-4e35-8bb3-44dee9dc1c5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:44.517012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9218-2277-4e35-8bb3-44dee9dc1c5a service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:44.517380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9218-2277-4e35-8bb3-44dee9dc1c5a service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:44.517824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f9218-2277-4e35-8bb3-44dee9dc1c5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:44.536090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f9218-2277-4e35-8bb3-44dee9dc1c5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:44.538313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f9218-2277-4e35-8bb3-44dee9dc1c5a service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:44.562900 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2633/5290] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:08:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:44.799532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1189312-5148-4a4e-999f-87385059017d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:44.802741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d1189312-5148-4a4e-999f-87385059017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:44.961455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1189312-5148-4a4e-999f-87385059017d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:44.967080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:44.967841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:44.968169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:44.968445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] PATH_INFO: `/v3/users/314b17e8914f48e985e90481cd3c3a3d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:44.969684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314b17e8914f48e985e90481cd3c3a3d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:44.974769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:45.093813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314b17e8914f48e985e90481cd3c3a3d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:45.116074 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:45.133320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314b17e8914f48e985e90481cd3c3a3d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:45.153926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314b17e8914f48e985e90481cd3c3a3d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:45.185855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314b17e8914f48e985e90481cd3c3a3d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:45.189646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314b17e8914f48e985e90481cd3c3a3d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:45.212410 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2658/5291] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:08:44 2022] DELETE /identity/v3/users/314b17e8914f48e985e90481cd3c3a3d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:08:45.213583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060cf0e-402d-4e4d-8adc-57f85fd43b74 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:45.213872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060cf0e-402d-4e4d-8adc-57f85fd43b74 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:45.214148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060cf0e-402d-4e4d-8adc-57f85fd43b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:45.254558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0060cf0e-402d-4e4d-8adc-57f85fd43b74 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:45.256022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0060cf0e-402d-4e4d-8adc-57f85fd43b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:45.437385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2634/5292] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:08:45.473717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:45.479338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:45.614371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b80600-853c-4aee-b482-b406df87cb57 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:45.619510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f8146-99d4-4e25-86bf-188794f41b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:45.620388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f8146-99d4-4e25-86bf-188794f41b42 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:45.620700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f8146-99d4-4e25-86bf-188794f41b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:45.620974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f8146-99d4-4e25-86bf-188794f41b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:45.639007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f8146-99d4-4e25-86bf-188794f41b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:45.641197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f8146-99d4-4e25-86bf-188794f41b42 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:45.685086 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2659/5293] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:46.596859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060cf0e-402d-4e4d-8adc-57f85fd43b74 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:46.598657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0060cf0e-402d-4e4d-8adc-57f85fd43b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:46.612916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060cf0e-402d-4e4d-8adc-57f85fd43b74 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:46.618661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:46.619528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:46.619992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:46.620439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] PATH_INFO: `/v3/projects/979214475e474053bef7b2daaf4ae6fc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:46.622640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=979214475e474053bef7b2daaf4ae6fc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:46.625070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:46.688205 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:46.724936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979214475e474053bef7b2daaf4ae6fc', 'request_id': 'req-215d49df-1ec0-4130-9ac1-433888e46e98'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:46.740511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979214475e474053bef7b2daaf4ae6fc', 'request_id': 'req-215d49df-1ec0-4130-9ac1-433888e46e98'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:46.750975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979214475e474053bef7b2daaf4ae6fc', 'request_id': 'req-215d49df-1ec0-4130-9ac1-433888e46e98'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:46.771517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] The token cache is being invalidate because project 979214475e474053bef7b2daaf4ae6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:08:46.771979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:46.773379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-215d49df-1ec0-4130-9ac1-433888e46e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:46.781688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c518c1-4710-4795-9dc3-4534dc7912de None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:46.782405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c518c1-4710-4795-9dc3-4534dc7912de None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:46.782405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c518c1-4710-4795-9dc3-4534dc7912de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:46.810174 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2635/5294] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:08:46 2022] DELETE /identity/v3/projects/979214475e474053bef7b2daaf4ae6fc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:08:46.869457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-64c518c1-4710-4795-9dc3-4534dc7912de None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:46.873473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-64c518c1-4710-4795-9dc3-4534dc7912de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:46.996949 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2660/5295] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:46.998153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eef4b-4837-4262-afa2-b983e8e98efc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:46.998450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eef4b-4837-4262-afa2-b983e8e98efc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:46.998867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eef4b-4837-4262-afa2-b983e8e98efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:47.055861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-726eef4b-4837-4262-afa2-b983e8e98efc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:47.057510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-726eef4b-4837-4262-afa2-b983e8e98efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:47.067158 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2636/5296] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:47.071791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c518c1-4710-4795-9dc3-4534dc7912de None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:47.088981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c518c1-4710-4795-9dc3-4534dc7912de None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:47.096868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac80d-0d47-4f20-958b-d28eb4769db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:47.097697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac80d-0d47-4f20-958b-d28eb4769db4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:47.098230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac80d-0d47-4f20-958b-d28eb4769db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:47.098656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac80d-0d47-4f20-958b-d28eb4769db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:47.099489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac80d-0d47-4f20-958b-d28eb4769db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:08:47.099917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac80d-0d47-4f20-958b-d28eb4769db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:47.101968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac80d-0d47-4f20-958b-d28eb4769db4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:47.121811 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2661/5297] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:08:47.123232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eef4b-4837-4262-afa2-b983e8e98efc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:47.157512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eef4b-4837-4262-afa2-b983e8e98efc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:47.166028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb967053-fe9d-4fb4-8c8d-af2a729ec5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:47.166992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967053-fe9d-4fb4-8c8d-af2a729ec5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:47.167709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967053-fe9d-4fb4-8c8d-af2a729ec5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:47.167985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967053-fe9d-4fb4-8c8d-af2a729ec5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:47.168672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb967053-fe9d-4fb4-8c8d-af2a729ec5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:47.170648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb967053-fe9d-4fb4-8c8d-af2a729ec5a5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:47.218869 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2637/5298] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:08:47 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:08:47.224858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac80d-0d47-4f20-958b-d28eb4769db4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:47.241430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac80d-0d47-4f20-958b-d28eb4769db4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:47.391090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c8b44-f3a9-48b7-83a6-8a391b7686ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:47.391867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c8b44-f3a9-48b7-83a6-8a391b7686ec admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:47.392771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c8b44-f3a9-48b7-83a6-8a391b7686ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:47.393059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c8b44-f3a9-48b7-83a6-8a391b7686ec admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:47.393906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c8b44-f3a9-48b7-83a6-8a391b7686ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:47.402552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c8b44-f3a9-48b7-83a6-8a391b7686ec admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:47.451116 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:47.484014 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2662/5299] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:08:47 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:08:47.496098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb967053-fe9d-4fb4-8c8d-af2a729ec5a5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:47.512834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb967053-fe9d-4fb4-8c8d-af2a729ec5a5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:47.520336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a430253-c5c5-4ffd-9407-645a45a0eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:47.520988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a430253-c5c5-4ffd-9407-645a45a0eb8c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:47.521326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a430253-c5c5-4ffd-9407-645a45a0eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:47.521617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a430253-c5c5-4ffd-9407-645a45a0eb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:47.522442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a430253-c5c5-4ffd-9407-645a45a0eb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:47.524274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a430253-c5c5-4ffd-9407-645a45a0eb8c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:47.544564 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2638/5300] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:08:47.548987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c8b44-f3a9-48b7-83a6-8a391b7686ec admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:47.567258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c8b44-f3a9-48b7-83a6-8a391b7686ec admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:47.572832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad950c-9b44-41b5-bd45-ebd1f73a52fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:47.579324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad950c-9b44-41b5-bd45-ebd1f73a52fb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:47.579667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad950c-9b44-41b5-bd45-ebd1f73a52fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:47.581155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad950c-9b44-41b5-bd45-ebd1f73a52fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:47.582005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad950c-9b44-41b5-bd45-ebd1f73a52fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:47.590676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad950c-9b44-41b5-bd45-ebd1f73a52fb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:47.605965 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2663/5301] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:08:47.610220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a430253-c5c5-4ffd-9407-645a45a0eb8c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:47.624599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a430253-c5c5-4ffd-9407-645a45a0eb8c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:47.630990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d041f-42dd-4d56-867b-68e5ad81e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:47.631889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d041f-42dd-4d56-867b-68e5ad81e8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:47.632561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d041f-42dd-4d56-867b-68e5ad81e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:47.633848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d041f-42dd-4d56-867b-68e5ad81e8c4 admin admin] PATH_INFO: `/v3/projects/235a5608bd9142dcbfb621873d3999a7/users/2d97060e766f4e1f982d64b425ddd184/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:47.653583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d041f-42dd-4d56-867b-68e5ad81e8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=235a5608bd9142dcbfb621873d3999a7, user_id=2d97060e766f4e1f982d64b425ddd184, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:47.657286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d041f-42dd-4d56-867b-68e5ad81e8c4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:47.708495 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2639/5302] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:08:47 2022] PUT /identity/v3/projects/235a5608bd9142dcbfb621873d3999a7/users/2d97060e766f4e1f982d64b425ddd184/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:08:47.714485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78cb05-3aae-4ac9-8396-a9d808cb54f3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:47.714867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78cb05-3aae-4ac9-8396-a9d808cb54f3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:47.715266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78cb05-3aae-4ac9-8396-a9d808cb54f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:47.761766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fc78cb05-3aae-4ac9-8396-a9d808cb54f3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:47.765464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fc78cb05-3aae-4ac9-8396-a9d808cb54f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:47.913712 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2664/5303] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:47.933219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d041f-42dd-4d56-867b-68e5ad81e8c4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:47.936847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd9d041f-42dd-4d56-867b-68e5ad81e8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:48.122811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d041f-42dd-4d56-867b-68e5ad81e8c4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:48.127831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956577da-8aa4-4d7e-b391-db32df222140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:48.128821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956577da-8aa4-4d7e-b391-db32df222140 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:48.129176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956577da-8aa4-4d7e-b391-db32df222140 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:48.129608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956577da-8aa4-4d7e-b391-db32df222140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:48.143628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956577da-8aa4-4d7e-b391-db32df222140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:48.145583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956577da-8aa4-4d7e-b391-db32df222140 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:48.160507 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2640/5304] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:48.929805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78cb05-3aae-4ac9-8396-a9d808cb54f3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:48.932561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fc78cb05-3aae-4ac9-8396-a9d808cb54f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:48.964085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78cb05-3aae-4ac9-8396-a9d808cb54f3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:48.975488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14fdb2-90e1-4b2f-ad60-ec8894c2e1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:48.977050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14fdb2-90e1-4b2f-ad60-ec8894c2e1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:48.977879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14fdb2-90e1-4b2f-ad60-ec8894c2e1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:48.978467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14fdb2-90e1-4b2f-ad60-ec8894c2e1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:48.987832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5a14fdb2-90e1-4b2f-ad60-ec8894c2e1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:49.174509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14fdb2-90e1-4b2f-ad60-ec8894c2e1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:49.178545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14fdb2-90e1-4b2f-ad60-ec8894c2e1b0 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:49.213547 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2665/5305] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:49.838772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956577da-8aa4-4d7e-b391-db32df222140 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:49.840898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-956577da-8aa4-4d7e-b391-db32df222140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:49.886288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956577da-8aa4-4d7e-b391-db32df222140 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:49.902801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:49.903722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:49.904361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:49.904838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] PATH_INFO: `/v3/users/4a934a18403841b4a6c044a068285669` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:49.906227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a934a18403841b4a6c044a068285669)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:49.921426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:50.042267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a934a18403841b4a6c044a068285669'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:50.055245 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:50.083606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a934a18403841b4a6c044a068285669'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:50.106760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a934a18403841b4a6c044a068285669'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:50.120030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a934a18403841b4a6c044a068285669'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:50.121119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a934a18403841b4a6c044a068285669'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:50.137892 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2641/5306] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:08:49 2022] DELETE /identity/v3/users/4a934a18403841b4a6c044a068285669 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:08:50.142179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f519db-2f47-491e-8b46-f9ca462ad24a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:50.145911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f519db-2f47-491e-8b46-f9ca462ad24a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:50.146370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f519db-2f47-491e-8b46-f9ca462ad24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:50.176978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-44f519db-2f47-491e-8b46-f9ca462ad24a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:50.179432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-44f519db-2f47-491e-8b46-f9ca462ad24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:50.280727 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2666/5307] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:50.297369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:50.299580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:50.456354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb0de0-754c-4b91-bd8e-4e047ec281dc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:50.460642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f9788-f537-47af-9c53-429eec844c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:50.461348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f9788-f537-47af-9c53-429eec844c40 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:50.461641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f9788-f537-47af-9c53-429eec844c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:50.461920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f9788-f537-47af-9c53-429eec844c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:50.472821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f9788-f537-47af-9c53-429eec844c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:50.474577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f9788-f537-47af-9c53-429eec844c40 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:50.485671 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2642/5308] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:50.685855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8efdf-e27b-439d-b991-7c172f045a44 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:50.686132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8efdf-e27b-439d-b991-7c172f045a44 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:50.686392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8efdf-e27b-439d-b991-7c172f045a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:50.726069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3be8efdf-e27b-439d-b991-7c172f045a44 None None] MFA Rules not processed for user `fa1f3b94587e468d8c6dd9f134665691`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:50.727302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3be8efdf-e27b-439d-b991-7c172f045a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:50.733125 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:50.819120 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2667/5309] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:51.007784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f9788-f537-47af-9c53-429eec844c40 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:51.009586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-929f9788-f537-47af-9c53-429eec844c40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:51.034775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f9788-f537-47af-9c53-429eec844c40 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:51.045642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:51.046347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:51.046865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:51.046973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] PATH_INFO: `/v3/projects/32b77edb99fa46368b3f8185022d94af` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:51.057985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b77edb99fa46368b3f8185022d94af)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:51.059583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:51.193500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b77edb99fa46368b3f8185022d94af', 'request_id': 'req-bab60b0d-0311-4075-8302-47442911da20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:51.238391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b77edb99fa46368b3f8185022d94af', 'request_id': 'req-bab60b0d-0311-4075-8302-47442911da20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:51.264989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b77edb99fa46368b3f8185022d94af', 'request_id': 'req-bab60b0d-0311-4075-8302-47442911da20'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:51.296329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] The token cache is being invalidate because project 32b77edb99fa46368b3f8185022d94af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:08:51.296796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:51.297885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bab60b0d-0311-4075-8302-47442911da20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:51.305663 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2643/5310] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:08:51 2022] DELETE /identity/v3/projects/32b77edb99fa46368b3f8185022d94af => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:08:51.305861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51447b4-5e29-4ac1-bff6-d300271fdac4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:51.306263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51447b4-5e29-4ac1-bff6-d300271fdac4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:51.306924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51447b4-5e29-4ac1-bff6-d300271fdac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:51.368906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d51447b4-5e29-4ac1-bff6-d300271fdac4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:51.372269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d51447b4-5e29-4ac1-bff6-d300271fdac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:51.507159 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2668/5311] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:51.510127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe842c5-c5af-4e07-9a81-524d9dab1edf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:51.510637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe842c5-c5af-4e07-9a81-524d9dab1edf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:51.511093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe842c5-c5af-4e07-9a81-524d9dab1edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:51.543109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-abe842c5-c5af-4e07-9a81-524d9dab1edf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:51.544483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-abe842c5-c5af-4e07-9a81-524d9dab1edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:51.556362 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2644/5312] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:51.560241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51447b4-5e29-4ac1-bff6-d300271fdac4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:51.576899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51447b4-5e29-4ac1-bff6-d300271fdac4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:51.587276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cd8df-6f0d-4a87-b0af-6794bee057ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:51.588159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cd8df-6f0d-4a87-b0af-6794bee057ff admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:51.589480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cd8df-6f0d-4a87-b0af-6794bee057ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:51.589956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cd8df-6f0d-4a87-b0af-6794bee057ff admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:51.590797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cd8df-6f0d-4a87-b0af-6794bee057ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:08:51.591335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cd8df-6f0d-4a87-b0af-6794bee057ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:51.593878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cd8df-6f0d-4a87-b0af-6794bee057ff admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:51.616458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe842c5-c5af-4e07-9a81-524d9dab1edf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:51.630481 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2669/5313] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:08:51.632703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe842c5-c5af-4e07-9a81-524d9dab1edf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:51.638931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d112b98-3f8b-487f-986b-e007aadd45c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:51.639794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d112b98-3f8b-487f-986b-e007aadd45c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:51.640262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d112b98-3f8b-487f-986b-e007aadd45c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:51.640740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d112b98-3f8b-487f-986b-e007aadd45c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:51.642708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d112b98-3f8b-487f-986b-e007aadd45c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:51.647151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d112b98-3f8b-487f-986b-e007aadd45c1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:51.692960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cd8df-6f0d-4a87-b0af-6794bee057ff admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:51.705920 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2645/5314] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:08:51 2022] POST /identity/v3/projects => generated 361 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:08:51.716607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cd8df-6f0d-4a87-b0af-6794bee057ff admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:51.846719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e965-d23c-47c0-8a54-9956a12b79d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:51.847897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e965-d23c-47c0-8a54-9956a12b79d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:51.848521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e965-d23c-47c0-8a54-9956a12b79d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:51.849035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e965-d23c-47c0-8a54-9956a12b79d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:51.849909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e965-d23c-47c0-8a54-9956a12b79d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:51.853113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e965-d23c-47c0-8a54-9956a12b79d2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:51.891717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d112b98-3f8b-487f-986b-e007aadd45c1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:51.902758 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2670/5315] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:08:51 2022] POST /identity/v3/users => generated 281 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:08:51.908588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d112b98-3f8b-487f-986b-e007aadd45c1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:51.921848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a79fe-17b0-474e-8865-9e5327759f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:51.922515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a79fe-17b0-474e-8865-9e5327759f06 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:51.922798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a79fe-17b0-474e-8865-9e5327759f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:51.923104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a79fe-17b0-474e-8865-9e5327759f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:51.926581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a79fe-17b0-474e-8865-9e5327759f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:51.930276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a79fe-17b0-474e-8865-9e5327759f06 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:51.969295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e965-d23c-47c0-8a54-9956a12b79d2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:51.981744 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2646/5316] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:08:51.982159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e965-d23c-47c0-8a54-9956a12b79d2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:51.989071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5316a-894f-482a-b6f1-f6b914f900cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:51.989983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5316a-894f-482a-b6f1-f6b914f900cf admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:51.990309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5316a-894f-482a-b6f1-f6b914f900cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:51.990490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5316a-894f-482a-b6f1-f6b914f900cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:51.991184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5316a-894f-482a-b6f1-f6b914f900cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:51.993836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5316a-894f-482a-b6f1-f6b914f900cf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:52.010404 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2671/5317] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:08:52.016194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a79fe-17b0-474e-8865-9e5327759f06 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:52.032280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a79fe-17b0-474e-8865-9e5327759f06 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:52.043914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff4676-2cda-4ace-8c69-8666315c18f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:52.045359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff4676-2cda-4ace-8c69-8666315c18f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:52.046258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff4676-2cda-4ace-8c69-8666315c18f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:52.046766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff4676-2cda-4ace-8c69-8666315c18f4 admin admin] PATH_INFO: `/v3/projects/4c7d0e9762d546df8dcb63c382028d1a/users/880c764a3e804b4a844b3456d7b42372/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:52.063453 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:52.078286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff4676-2cda-4ace-8c69-8666315c18f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7d0e9762d546df8dcb63c382028d1a, user_id=880c764a3e804b4a844b3456d7b42372, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:52.083771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff4676-2cda-4ace-8c69-8666315c18f4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:52.108655 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2647/5318] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:08:52 2022] PUT /identity/v3/projects/4c7d0e9762d546df8dcb63c382028d1a/users/880c764a3e804b4a844b3456d7b42372/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:08:52.120952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5d1fd-3109-420d-816e-3004676d70b5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:52.121236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5d1fd-3109-420d-816e-3004676d70b5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:52.121528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5d1fd-3109-420d-816e-3004676d70b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:52.172801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2dd5d1fd-3109-420d-816e-3004676d70b5 None None] MFA Rules not processed for user `880c764a3e804b4a844b3456d7b42372`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:52.172801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2dd5d1fd-3109-420d-816e-3004676d70b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:52.211286 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:52.380497 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2672/5319] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:52.411174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff4676-2cda-4ace-8c69-8666315c18f4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:52.412952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65ff4676-2cda-4ace-8c69-8666315c18f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:52.543350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff4676-2cda-4ace-8c69-8666315c18f4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:52.568233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e8aa8-d6ed-415c-bbd2-a89e1ba6144b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:52.568496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e8aa8-d6ed-415c-bbd2-a89e1ba6144b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:52.569165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e8aa8-d6ed-415c-bbd2-a89e1ba6144b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:52.570743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e8aa8-d6ed-415c-bbd2-a89e1ba6144b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:52.602028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e8aa8-d6ed-415c-bbd2-a89e1ba6144b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:52.605414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e8aa8-d6ed-415c-bbd2-a89e1ba6144b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:52.629490 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2648/5320] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:57.060668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5d1fd-3109-420d-816e-3004676d70b5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:57.062647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2dd5d1fd-3109-420d-816e-3004676d70b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:57.227898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5d1fd-3109-420d-816e-3004676d70b5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:57.239311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:57.241131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:57.241625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:57.242179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] PATH_INFO: `/v3/users/33694e263d71460fb6f1f185859d5e07` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:57.244025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=33694e263d71460fb6f1f185859d5e07)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:57.247611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:57.420916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33694e263d71460fb6f1f185859d5e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:57.471477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33694e263d71460fb6f1f185859d5e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:57.493052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33694e263d71460fb6f1f185859d5e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:57.513620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33694e263d71460fb6f1f185859d5e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:57.514509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33694e263d71460fb6f1f185859d5e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:57.531188 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2673/5321] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:08:57 2022] DELETE /identity/v3/users/33694e263d71460fb6f1f185859d5e07 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:08:57.533740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb5b8-d133-437d-8934-690ce971db5e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:57.534222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb5b8-d133-437d-8934-690ce971db5e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:57.534326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb5b8-d133-437d-8934-690ce971db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:57.585788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4b4cb5b8-d133-437d-8934-690ce971db5e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:57.589079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4b4cb5b8-d133-437d-8934-690ce971db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:57.837672 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2649/5322] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:58.015513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:58.017656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:58.101870 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:58.141677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dafcc0-7c32-4068-83cb-24b4be76b2dd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:58.147967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f88326-a76a-4e9b-8169-d24db4707170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:58.148925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f88326-a76a-4e9b-8169-d24db4707170 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:58.149165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f88326-a76a-4e9b-8169-d24db4707170 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:58.149493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f88326-a76a-4e9b-8169-d24db4707170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:58.162560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f88326-a76a-4e9b-8169-d24db4707170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:58.164796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f88326-a76a-4e9b-8169-d24db4707170 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:58.179842 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2674/5323] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:59.168123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb5b8-d133-437d-8934-690ce971db5e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:59.172126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4b4cb5b8-d133-437d-8934-690ce971db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:59.203634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb5b8-d133-437d-8934-690ce971db5e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:59.217516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:59.219937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:59.220226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:59.220503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] PATH_INFO: `/v3/projects/91558b1f11b04d938c780f738cbdea3b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:59.224779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91558b1f11b04d938c780f738cbdea3b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:59.228752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:59.393895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91558b1f11b04d938c780f738cbdea3b', 'request_id': 'req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:59.407711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91558b1f11b04d938c780f738cbdea3b', 'request_id': 'req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:59.423101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91558b1f11b04d938c780f738cbdea3b', 'request_id': 'req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:59.462126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] The token cache is being invalidate because project 91558b1f11b04d938c780f738cbdea3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:08:59.462424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:59.471010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd24f5a6-22e1-4dc4-a38c-801fdb3c8c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:08:59.476114 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2650/5324] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:08:59 2022] DELETE /identity/v3/projects/91558b1f11b04d938c780f738cbdea3b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:08:59.478961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486667-2cda-4b4a-bd73-c5931aa6269c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:59.479440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486667-2cda-4b4a-bd73-c5931aa6269c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:59.479543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486667-2cda-4b4a-bd73-c5931aa6269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:59.524017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-47486667-2cda-4b4a-bd73-c5931aa6269c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:59.525333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-47486667-2cda-4b4a-bd73-c5931aa6269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:59.640918 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2675/5325] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:59.642471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a814f-ab4a-4d20-b833-9c7c077167e4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:59.642756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a814f-ab4a-4d20-b833-9c7c077167e4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:59.643030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a814f-ab4a-4d20-b833-9c7c077167e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:59.691102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1c5a814f-ab4a-4d20-b833-9c7c077167e4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:08:59.696174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1c5a814f-ab4a-4d20-b833-9c7c077167e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:08:59.710300 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2651/5326] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:08:59.714004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47486667-2cda-4b4a-bd73-c5931aa6269c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:59.759055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47486667-2cda-4b4a-bd73-c5931aa6269c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:59.794160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa17b-41a9-4f76-b64e-562499488ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:59.801896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa17b-41a9-4f76-b64e-562499488ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:59.803670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa17b-41a9-4f76-b64e-562499488ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:59.804160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa17b-41a9-4f76-b64e-562499488ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:59.805920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaa17b-41a9-4f76-b64e-562499488ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:08:59.806849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaa17b-41a9-4f76-b64e-562499488ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:59.811557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaa17b-41a9-4f76-b64e-562499488ea9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:59.868675 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2676/5327] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:08:59.873021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a814f-ab4a-4d20-b833-9c7c077167e4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:08:59.894411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a814f-ab4a-4d20-b833-9c7c077167e4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:08:59.909418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d45f74-da3a-49eb-bc1a-11fa494bc1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:08:59.910504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d45f74-da3a-49eb-bc1a-11fa494bc1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:08:59.911812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d45f74-da3a-49eb-bc1a-11fa494bc1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:08:59.913494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d45f74-da3a-49eb-bc1a-11fa494bc1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:08:59.914560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d45f74-da3a-49eb-bc1a-11fa494bc1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:08:59.923949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d45f74-da3a-49eb-bc1a-11fa494bc1a9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:08:59.938498 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:00.010913 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2652/5328] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:08:59 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:09:00.014987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa17b-41a9-4f76-b64e-562499488ea9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:00.028062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa17b-41a9-4f76-b64e-562499488ea9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:00.154591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95ca1b-c974-453d-b481-d980f60ec594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:00.155747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95ca1b-c974-453d-b481-d980f60ec594 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:00.156923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95ca1b-c974-453d-b481-d980f60ec594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:00.157412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95ca1b-c974-453d-b481-d980f60ec594 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:00.158883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95ca1b-c974-453d-b481-d980f60ec594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:00.161619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95ca1b-c974-453d-b481-d980f60ec594 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:00.205791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2677/5329] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:00 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:00.210041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d45f74-da3a-49eb-bc1a-11fa494bc1a9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:00.227666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d45f74-da3a-49eb-bc1a-11fa494bc1a9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:00.240856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433fcc2-377d-40a0-83d4-220a8b81bd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:00.242524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433fcc2-377d-40a0-83d4-220a8b81bd79 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:00.243826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433fcc2-377d-40a0-83d4-220a8b81bd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:00.244120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433fcc2-377d-40a0-83d4-220a8b81bd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:00.245801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433fcc2-377d-40a0-83d4-220a8b81bd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:00.251634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433fcc2-377d-40a0-83d4-220a8b81bd79 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:00.291052 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2653/5330] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:00.296027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95ca1b-c974-453d-b481-d980f60ec594 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:00.343416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95ca1b-c974-453d-b481-d980f60ec594 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:00.363769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac33f41-9227-4d56-9158-f7535a6d8401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:00.364589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac33f41-9227-4d56-9158-f7535a6d8401 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:00.367286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac33f41-9227-4d56-9158-f7535a6d8401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:00.368130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac33f41-9227-4d56-9158-f7535a6d8401 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:00.369779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac33f41-9227-4d56-9158-f7535a6d8401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:00.374109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac33f41-9227-4d56-9158-f7535a6d8401 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:00.398948 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2678/5331] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:00.400397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433fcc2-377d-40a0-83d4-220a8b81bd79 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:00.414536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433fcc2-377d-40a0-83d4-220a8b81bd79 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:00.424093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb5692-cf2d-4c22-b6b5-fa107bb2e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:00.425277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb5692-cf2d-4c22-b6b5-fa107bb2e87b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:00.425814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb5692-cf2d-4c22-b6b5-fa107bb2e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:00.426431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb5692-cf2d-4c22-b6b5-fa107bb2e87b admin admin] PATH_INFO: `/v3/projects/c437a9039aaa49778322e612ada5110e/users/2664c9bc837544dbb17d499e6eb86398/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:00.495832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb5692-cf2d-4c22-b6b5-fa107bb2e87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c437a9039aaa49778322e612ada5110e, user_id=2664c9bc837544dbb17d499e6eb86398, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:00.502826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb5692-cf2d-4c22-b6b5-fa107bb2e87b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:00.503068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb10cb-b239-4efb-9cf8-51dc1090a623 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:00.503920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb10cb-b239-4efb-9cf8-51dc1090a623 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:00.504357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb10cb-b239-4efb-9cf8-51dc1090a623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:00.560725 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2654/5332] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:09:00 2022] PUT /identity/v3/projects/c437a9039aaa49778322e612ada5110e/users/2664c9bc837544dbb17d499e6eb86398/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:00.562263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb9df-c637-466d-8215-eee15205b92f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:00.562565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb9df-c637-466d-8215-eee15205b92f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:00.562839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb9df-c637-466d-8215-eee15205b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:00.617066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1beb10cb-b239-4efb-9cf8-51dc1090a623 None None] MFA Rules not processed for user `2d97060e766f4e1f982d64b425ddd184`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:00.621916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1beb10cb-b239-4efb-9cf8-51dc1090a623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:00.685409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-931fb9df-c637-466d-8215-eee15205b92f None None] MFA Rules not processed for user `2664c9bc837544dbb17d499e6eb86398`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:00.686671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-931fb9df-c637-466d-8215-eee15205b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:00.722073 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:00.824445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2679/5333] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:00.841762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb10cb-b239-4efb-9cf8-51dc1090a623 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:00.845799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1beb10cb-b239-4efb-9cf8-51dc1090a623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:00.883615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2655/5334] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:00.917553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb9df-c637-466d-8215-eee15205b92f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:00.918998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-931fb9df-c637-466d-8215-eee15205b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:01.060328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb10cb-b239-4efb-9cf8-51dc1090a623 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:01.069066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cc3b3-b64d-419e-a15d-eba30cce466e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:01.070862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cc3b3-b64d-419e-a15d-eba30cce466e service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:01.071416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cc3b3-b64d-419e-a15d-eba30cce466e service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:01.071910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cc3b3-b64d-419e-a15d-eba30cce466e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:01.082338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cc3b3-b64d-419e-a15d-eba30cce466e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:01.084306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cc3b3-b64d-419e-a15d-eba30cce466e service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:01.096357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb9df-c637-466d-8215-eee15205b92f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:01.107438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49299919-54bc-4c56-8760-ec54c073d4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:01.109974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299919-54bc-4c56-8760-ec54c073d4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:01.110866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299919-54bc-4c56-8760-ec54c073d4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:01.111165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299919-54bc-4c56-8760-ec54c073d4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:01.117218 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2680/5335] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:01.154136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49299919-54bc-4c56-8760-ec54c073d4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:01.158619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49299919-54bc-4c56-8760-ec54c073d4a8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:01.174338 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2656/5336] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:09:01.219401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9629-7d5f-40dc-82fb-463bd7ceb8bb None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:01.220408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9629-7d5f-40dc-82fb-463bd7ceb8bb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:01.221084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9629-7d5f-40dc-82fb-463bd7ceb8bb None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:01.223076 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2681/5337] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 01:09:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 01:09:01.237906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622a211-a4f9-42bf-829a-738b59532f69 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:01.238474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622a211-a4f9-42bf-829a-738b59532f69 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:01.238474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622a211-a4f9-42bf-829a-738b59532f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:01.279297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d9629-7d5f-40dc-82fb-463bd7ceb8bb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:01.343413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2622a211-a4f9-42bf-829a-738b59532f69 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:01.345268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2622a211-a4f9-42bf-829a-738b59532f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:01.372990 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2657/5338] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:01.404464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622a211-a4f9-42bf-829a-738b59532f69 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:01.421059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622a211-a4f9-42bf-829a-738b59532f69 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:01.429281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5a4d6-6114-4aa8-9f5b-62199ecb84e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:01.430294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a4d6-6114-4aa8-9f5b-62199ecb84e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:01.430809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a4d6-6114-4aa8-9f5b-62199ecb84e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:01.431307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a4d6-6114-4aa8-9f5b-62199ecb84e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:01.439897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d9629-7d5f-40dc-82fb-463bd7ceb8bb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:01.447120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:01.447876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:01.448159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:01.448536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] PATH_INFO: `/v3/users/2664c9bc837544dbb17d499e6eb86398` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:01.449387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5a4d6-6114-4aa8-9f5b-62199ecb84e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:01.450874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2664c9bc837544dbb17d499e6eb86398)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:01.451383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5a4d6-6114-4aa8-9f5b-62199ecb84e4 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:01.453249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:01.473012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2658/5339] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:09:01.573844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2664c9bc837544dbb17d499e6eb86398'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:01.586186 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:01.604845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2664c9bc837544dbb17d499e6eb86398'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:01.622755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2664c9bc837544dbb17d499e6eb86398'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:01.632613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2664c9bc837544dbb17d499e6eb86398'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:01.633396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2664c9bc837544dbb17d499e6eb86398'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:01.641127 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2682/5340] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:09:01 2022] DELETE /identity/v3/users/2664c9bc837544dbb17d499e6eb86398 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:09:01.646200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a869a2e-3928-4826-a58d-c365d9abfd72 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:01.646922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a869a2e-3928-4826-a58d-c365d9abfd72 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:01.647152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a869a2e-3928-4826-a58d-c365d9abfd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:01.682930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1a869a2e-3928-4826-a58d-c365d9abfd72 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:01.692049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1a869a2e-3928-4826-a58d-c365d9abfd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:01.707685 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:01.886345 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2659/5341] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:01.898946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:01.900902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:01.997992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40e3fe-8201-4087-99bf-fed76b965fbf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:02.003884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75784a-fef0-4aac-b0f1-8eae42e62430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:02.005058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75784a-fef0-4aac-b0f1-8eae42e62430 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:02.005950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75784a-fef0-4aac-b0f1-8eae42e62430 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:02.006477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75784a-fef0-4aac-b0f1-8eae42e62430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:02.020102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75784a-fef0-4aac-b0f1-8eae42e62430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:02.022509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75784a-fef0-4aac-b0f1-8eae42e62430 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:02.058702 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2683/5342] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:09:03.512249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a869a2e-3928-4826-a58d-c365d9abfd72 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:03.515227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1a869a2e-3928-4826-a58d-c365d9abfd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:03.540166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a869a2e-3928-4826-a58d-c365d9abfd72 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:03.556179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:03.556879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:03.557164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:03.557437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] PATH_INFO: `/v3/projects/c437a9039aaa49778322e612ada5110e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:03.564201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c437a9039aaa49778322e612ada5110e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:03.566378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:03.659318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c437a9039aaa49778322e612ada5110e', 'request_id': 'req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:03.677688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c437a9039aaa49778322e612ada5110e', 'request_id': 'req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:03.697702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c437a9039aaa49778322e612ada5110e', 'request_id': 'req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:03.739236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] The token cache is being invalidate because project c437a9039aaa49778322e612ada5110e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:09:03.739630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:03.741603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:03.745250 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2660/5343] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:09:03 2022] DELETE /identity/v3/projects/c437a9039aaa49778322e612ada5110e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:03.750431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307cf4e-df9d-4a75-b974-40e575fab1fd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:03.751010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307cf4e-df9d-4a75-b974-40e575fab1fd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:03.751907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307cf4e-df9d-4a75-b974-40e575fab1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:03.792202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0307cf4e-df9d-4a75-b974-40e575fab1fd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:03.795073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0307cf4e-df9d-4a75-b974-40e575fab1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:03.867985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:03.874037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:03.936921 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2684/5344] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:03.948040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66454ad-2651-4ce4-8b41-0828c9c4e9d7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:03.948712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66454ad-2651-4ce4-8b41-0828c9c4e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:03.949627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66454ad-2651-4ce4-8b41-0828c9c4e9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:03.978022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d66454ad-2651-4ce4-8b41-0828c9c4e9d7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:03.979403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d66454ad-2651-4ce4-8b41-0828c9c4e9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:03.989664 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2685/5345] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:03.993793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66454ad-2651-4ce4-8b41-0828c9c4e9d7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:04.018978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66454ad-2651-4ce4-8b41-0828c9c4e9d7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:04.026942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c2ed2-7495-4cd7-b5fd-6fabd0be3e3f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:04.038650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed632a-1501-45d4-8691-18f47b4458b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:04.040478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed632a-1501-45d4-8691-18f47b4458b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:04.041612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed632a-1501-45d4-8691-18f47b4458b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:04.042892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d643-5348-42d8-bc13-6b6efb6e892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:04.043078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed632a-1501-45d4-8691-18f47b4458b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:04.050413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d643-5348-42d8-bc13-6b6efb6e892a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:04.050413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d643-5348-42d8-bc13-6b6efb6e892a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:04.050413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d643-5348-42d8-bc13-6b6efb6e892a admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:04.050413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5d643-5348-42d8-bc13-6b6efb6e892a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:09:04.050413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5d643-5348-42d8-bc13-6b6efb6e892a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:04.050413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5d643-5348-42d8-bc13-6b6efb6e892a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:04.051267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dfed632a-1501-45d4-8691-18f47b4458b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:04.082879 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2686/5346] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:09:04.091861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d643-5348-42d8-bc13-6b6efb6e892a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:04.104041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d643-5348-42d8-bc13-6b6efb6e892a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:04.109754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15bd59-edb6-4edb-8340-360842ed4088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:04.110759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15bd59-edb6-4edb-8340-360842ed4088 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:04.111256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15bd59-edb6-4edb-8340-360842ed4088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:04.111597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15bd59-edb6-4edb-8340-360842ed4088 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:04.112375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15bd59-edb6-4edb-8340-360842ed4088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:04.114723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15bd59-edb6-4edb-8340-360842ed4088 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:04.197427 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2687/5347] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:09:04 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:04.198808 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:04.201487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15bd59-edb6-4edb-8340-360842ed4088 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:04.278335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed632a-1501-45d4-8691-18f47b4458b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:04.281810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed632a-1501-45d4-8691-18f47b4458b8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:04.286657 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:04.332025 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2661/5348] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:09:04.341617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15bd59-edb6-4edb-8340-360842ed4088 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:04.347479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211432d-3a97-4f92-84a0-e811bc556944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:04.348128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211432d-3a97-4f92-84a0-e811bc556944 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:04.348523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211432d-3a97-4f92-84a0-e811bc556944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:04.348997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211432d-3a97-4f92-84a0-e811bc556944 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:04.349665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211432d-3a97-4f92-84a0-e811bc556944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:04.352079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211432d-3a97-4f92-84a0-e811bc556944 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:04.381149 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2688/5349] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:04 2022] POST /identity/v3/users => generated 279 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:04.384895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed632a-1501-45d4-8691-18f47b4458b8 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:04.415148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed632a-1501-45d4-8691-18f47b4458b8 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:04.427646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ea971-d555-4ab2-b7a1-10722c94400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:04.430253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ea971-d555-4ab2-b7a1-10722c94400d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:04.430799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ea971-d555-4ab2-b7a1-10722c94400d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:04.432247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ea971-d555-4ab2-b7a1-10722c94400d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:04.433959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ea971-d555-4ab2-b7a1-10722c94400d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:04.440137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ea971-d555-4ab2-b7a1-10722c94400d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:04.482914 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2662/5350] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:04.487233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211432d-3a97-4f92-84a0-e811bc556944 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:04.509095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211432d-3a97-4f92-84a0-e811bc556944 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:04.526279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36955a0f-e6c0-4c97-b4f6-fb13fd6eec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:04.527081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36955a0f-e6c0-4c97-b4f6-fb13fd6eec12 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:04.529090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36955a0f-e6c0-4c97-b4f6-fb13fd6eec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:04.529488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36955a0f-e6c0-4c97-b4f6-fb13fd6eec12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:04.530423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36955a0f-e6c0-4c97-b4f6-fb13fd6eec12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:04.535741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36955a0f-e6c0-4c97-b4f6-fb13fd6eec12 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:04.570607 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2689/5351] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:04.574618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ea971-d555-4ab2-b7a1-10722c94400d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:04.598299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ea971-d555-4ab2-b7a1-10722c94400d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:04.614576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bcb1-e19a-40cd-bb4f-8784b3748739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:04.617157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bcb1-e19a-40cd-bb4f-8784b3748739 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:04.617651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bcb1-e19a-40cd-bb4f-8784b3748739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:04.618139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bcb1-e19a-40cd-bb4f-8784b3748739 admin admin] PATH_INFO: `/v3/projects/b59413aeabee4fefb41728fba33d871d/users/f1cd62545bd9410997086be2c59d1a21/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:04.640062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bcb1-e19a-40cd-bb4f-8784b3748739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59413aeabee4fefb41728fba33d871d, user_id=f1cd62545bd9410997086be2c59d1a21, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:04.645353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bcb1-e19a-40cd-bb4f-8784b3748739 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:04.686788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2663/5352] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:09:04 2022] PUT /identity/v3/projects/b59413aeabee4fefb41728fba33d871d/users/f1cd62545bd9410997086be2c59d1a21/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:04.702501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541cb54-2ad7-419d-b011-8380d82b1897 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:04.702961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541cb54-2ad7-419d-b011-8380d82b1897 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:04.703342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541cb54-2ad7-419d-b011-8380d82b1897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:04.792230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3541cb54-2ad7-419d-b011-8380d82b1897 None None] MFA Rules not processed for user `f1cd62545bd9410997086be2c59d1a21`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:04.794789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3541cb54-2ad7-419d-b011-8380d82b1897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:04.917011 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2690/5353] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:04.927655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bcb1-e19a-40cd-bb4f-8784b3748739 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:04.929646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b5a3bcb1-e19a-40cd-bb4f-8784b3748739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:05.123932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bcb1-e19a-40cd-bb4f-8784b3748739 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:05.132312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a5a70-c2d9-46d2-afff-39c4162c457c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:05.134451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5a70-c2d9-46d2-afff-39c4162c457c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:05.135434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5a70-c2d9-46d2-afff-39c4162c457c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:05.135916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5a70-c2d9-46d2-afff-39c4162c457c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:05.149813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a5a70-c2d9-46d2-afff-39c4162c457c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:05.151866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a5a70-c2d9-46d2-afff-39c4162c457c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:05.165392 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2664/5354] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:07.401192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044440e6-15cb-4c32-8e10-3e6cf5593fba None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:07.402357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044440e6-15cb-4c32-8e10-3e6cf5593fba None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:07.404952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044440e6-15cb-4c32-8e10-3e6cf5593fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:07.458120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-044440e6-15cb-4c32-8e10-3e6cf5593fba None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:07.463311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-044440e6-15cb-4c32-8e10-3e6cf5593fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:07.650353 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2691/5355] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:07.719582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a5a70-c2d9-46d2-afff-39c4162c457c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:07.724814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dd3a5a70-c2d9-46d2-afff-39c4162c457c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:07.924338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a5a70-c2d9-46d2-afff-39c4162c457c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:07.936707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1869-665c-4803-abfe-4c447c298f5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:07.937356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1869-665c-4803-abfe-4c447c298f5e service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:07.937636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1869-665c-4803-abfe-4c447c298f5e service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:07.937914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1869-665c-4803-abfe-4c447c298f5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:07.965994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e1869-665c-4803-abfe-4c447c298f5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:07.967684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e1869-665c-4803-abfe-4c447c298f5e service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:07.992254 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2665/5356] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:09:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:09:09.640204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccb195-a68b-45be-aeb3-f70afd06cecb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:09.642370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccb195-a68b-45be-aeb3-f70afd06cecb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:09.643813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccb195-a68b-45be-aeb3-f70afd06cecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:09.706501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1cccb195-a68b-45be-aeb3-f70afd06cecb None None] MFA Rules not processed for user `2d97060e766f4e1f982d64b425ddd184`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:09.708341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1cccb195-a68b-45be-aeb3-f70afd06cecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:09.779220 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:09.835030 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2692/5357] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:17.983463 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:19.806415 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:21.058242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1869-665c-4803-abfe-4c447c298f5e service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:21.059706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-019e1869-665c-4803-abfe-4c447c298f5e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:21.307023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1869-665c-4803-abfe-4c447c298f5e service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:21.315293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a67012-c967-4a10-a2a7-58ddd69294a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:21.320187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a67012-c967-4a10-a2a7-58ddd69294a7 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:21.320541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a67012-c967-4a10-a2a7-58ddd69294a7 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:21.320845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a67012-c967-4a10-a2a7-58ddd69294a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:21.322777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-37a67012-c967-4a10-a2a7-58ddd69294a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:21.367437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a67012-c967-4a10-a2a7-58ddd69294a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:21.369095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a67012-c967-4a10-a2a7-58ddd69294a7 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:21.402592 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2666/5358] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:25.154524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccb195-a68b-45be-aeb3-f70afd06cecb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:25.310008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccb195-a68b-45be-aeb3-f70afd06cecb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:25.320574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:25.321441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:25.321705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:25.321979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] PATH_INFO: `/v3/users/f1cd62545bd9410997086be2c59d1a21` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:25.324146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1cd62545bd9410997086be2c59d1a21)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:25.331312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:25.440539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1cd62545bd9410997086be2c59d1a21'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:25.472241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1cd62545bd9410997086be2c59d1a21'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:25.483763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1cd62545bd9410997086be2c59d1a21'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:25.501451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1cd62545bd9410997086be2c59d1a21'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:25.502806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1cd62545bd9410997086be2c59d1a21'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:25.522735 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2693/5359] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:09:25 2022] DELETE /identity/v3/users/f1cd62545bd9410997086be2c59d1a21 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:25.524701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad726d-ca50-4373-873e-73a02ca5aac8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:25.525203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad726d-ca50-4373-873e-73a02ca5aac8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:25.525467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad726d-ca50-4373-873e-73a02ca5aac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:25.576017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-37ad726d-ca50-4373-873e-73a02ca5aac8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:25.577583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-37ad726d-ca50-4373-873e-73a02ca5aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:25.695843 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2667/5360] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:25.702172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:25.703973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:25.841459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc293cf-6bd9-4ad8-904f-fc92c62b5ddb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:25.851946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9bc7c-12df-47c6-99c9-f0b3663a3686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:25.852580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9bc7c-12df-47c6-99c9-f0b3663a3686 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:25.852883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9bc7c-12df-47c6-99c9-f0b3663a3686 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:25.853155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9bc7c-12df-47c6-99c9-f0b3663a3686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:25.879290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9bc7c-12df-47c6-99c9-f0b3663a3686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:25.880783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9bc7c-12df-47c6-99c9-f0b3663a3686 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:25.914420 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2694/5361] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:26.382777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad726d-ca50-4373-873e-73a02ca5aac8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:26.384763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-37ad726d-ca50-4373-873e-73a02ca5aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:26.416450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad726d-ca50-4373-873e-73a02ca5aac8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:26.446076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:26.449152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:26.449479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:26.449763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] PATH_INFO: `/v3/projects/b59413aeabee4fefb41728fba33d871d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:26.451722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59413aeabee4fefb41728fba33d871d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:26.459018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:26.593209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59413aeabee4fefb41728fba33d871d', 'request_id': 'req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:26.652093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59413aeabee4fefb41728fba33d871d', 'request_id': 'req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:26.675508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59413aeabee4fefb41728fba33d871d', 'request_id': 'req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:26.701412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] The token cache is being invalidate because project b59413aeabee4fefb41728fba33d871d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:09:26.702116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:26.703438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aed2ccd5-0fbe-4c4e-b5df-eaf3cff4b1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:26.705558 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2668/5362] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:09:26 2022] DELETE /identity/v3/projects/b59413aeabee4fefb41728fba33d871d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:26.710662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414b93b-25c2-4274-9ba5-cef21444ae96 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:26.712042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414b93b-25c2-4274-9ba5-cef21444ae96 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:26.712338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414b93b-25c2-4274-9ba5-cef21444ae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:26.767498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f414b93b-25c2-4274-9ba5-cef21444ae96 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:26.770542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f414b93b-25c2-4274-9ba5-cef21444ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:26.816588 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:26.914895 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2695/5363] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:26.923497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1692294-db80-49c2-9030-5466665a618f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:26.923805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1692294-db80-49c2-9030-5466665a618f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:26.924064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1692294-db80-49c2-9030-5466665a618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:26.978991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e1692294-db80-49c2-9030-5466665a618f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:26.983522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e1692294-db80-49c2-9030-5466665a618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:27.005021 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2669/5364] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:27.009699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414b93b-25c2-4274-9ba5-cef21444ae96 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:27.034165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414b93b-25c2-4274-9ba5-cef21444ae96 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:27.051699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee831970-05cb-4cf7-b93a-3cd2510fc959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:27.059377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831970-05cb-4cf7-b93a-3cd2510fc959 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:27.059686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831970-05cb-4cf7-b93a-3cd2510fc959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:27.059973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831970-05cb-4cf7-b93a-3cd2510fc959 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:27.060718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee831970-05cb-4cf7-b93a-3cd2510fc959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:09:27.061031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee831970-05cb-4cf7-b93a-3cd2510fc959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:27.068669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee831970-05cb-4cf7-b93a-3cd2510fc959 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:27.100509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1692294-db80-49c2-9030-5466665a618f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:27.101592 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2696/5365] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:09:27.113733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1692294-db80-49c2-9030-5466665a618f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:27.144291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923e99d-1086-448c-8a8a-8b57db6b87eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:27.145063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923e99d-1086-448c-8a8a-8b57db6b87eb admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:27.145455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923e99d-1086-448c-8a8a-8b57db6b87eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:27.148028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923e99d-1086-448c-8a8a-8b57db6b87eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:27.148878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923e99d-1086-448c-8a8a-8b57db6b87eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:27.152013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923e99d-1086-448c-8a8a-8b57db6b87eb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:27.157890 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:27.210113 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2670/5366] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:09:27 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:27.213984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee831970-05cb-4cf7-b93a-3cd2510fc959 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:27.231421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee831970-05cb-4cf7-b93a-3cd2510fc959 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:27.534054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d28a9-d681-4591-9aff-b64773f63bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:27.535046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d28a9-d681-4591-9aff-b64773f63bad admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:27.535507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d28a9-d681-4591-9aff-b64773f63bad admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:27.535962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d28a9-d681-4591-9aff-b64773f63bad admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:27.536817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d28a9-d681-4591-9aff-b64773f63bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:27.548614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d28a9-d681-4591-9aff-b64773f63bad admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:27.595948 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2697/5367] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:27 2022] POST /identity/v3/users => generated 287 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:27.599966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923e99d-1086-448c-8a8a-8b57db6b87eb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:27.617378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923e99d-1086-448c-8a8a-8b57db6b87eb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:27.631668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce3a3a-266b-46d5-b112-f416767d8b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:27.632638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce3a3a-266b-46d5-b112-f416767d8b7b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:27.633093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce3a3a-266b-46d5-b112-f416767d8b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:27.633719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce3a3a-266b-46d5-b112-f416767d8b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:27.634539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce3a3a-266b-46d5-b112-f416767d8b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:27.636387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce3a3a-266b-46d5-b112-f416767d8b7b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:27.664062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d28a9-d681-4591-9aff-b64773f63bad admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:27.670708 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2671/5368] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:27.681395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d28a9-d681-4591-9aff-b64773f63bad admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:27.699364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f1495-c12f-470d-b489-3ff9a5e30d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:27.700208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f1495-c12f-470d-b489-3ff9a5e30d1a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:27.700695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f1495-c12f-470d-b489-3ff9a5e30d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:27.701125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f1495-c12f-470d-b489-3ff9a5e30d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:27.702613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f1495-c12f-470d-b489-3ff9a5e30d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:27.712088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f1495-c12f-470d-b489-3ff9a5e30d1a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:27.729809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce3a3a-266b-46d5-b112-f416767d8b7b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:27.743885 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2698/5369] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:27.750442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce3a3a-266b-46d5-b112-f416767d8b7b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:27.763398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53178-a36e-4b1c-825c-de216fdd1ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:27.764402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53178-a36e-4b1c-825c-de216fdd1ced admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:27.764711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53178-a36e-4b1c-825c-de216fdd1ced admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:27.764990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53178-a36e-4b1c-825c-de216fdd1ced admin admin] PATH_INFO: `/v3/projects/aa818ffa241e4532820f5ed34b05ef7e/users/7aa0bd023b0f492ebc8e65ee0fdb1ba8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:27.795499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53178-a36e-4b1c-825c-de216fdd1ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa818ffa241e4532820f5ed34b05ef7e, user_id=7aa0bd023b0f492ebc8e65ee0fdb1ba8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:27.798797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53178-a36e-4b1c-825c-de216fdd1ced admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:27.833926 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2672/5370] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:09:27 2022] PUT /identity/v3/projects/aa818ffa241e4532820f5ed34b05ef7e/users/7aa0bd023b0f492ebc8e65ee0fdb1ba8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:09:27.846113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b56bf-17a8-4d4b-9df5-d6b6d8d8a5f8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:27.846491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b56bf-17a8-4d4b-9df5-d6b6d8d8a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:27.846650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b56bf-17a8-4d4b-9df5-d6b6d8d8a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:27.917431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d30b56bf-17a8-4d4b-9df5-d6b6d8d8a5f8 None None] MFA Rules not processed for user `7aa0bd023b0f492ebc8e65ee0fdb1ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:27.918953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d30b56bf-17a8-4d4b-9df5-d6b6d8d8a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:28.085735 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2699/5371] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:28.087086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53178-a36e-4b1c-825c-de216fdd1ced admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:28.275319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53178-a36e-4b1c-825c-de216fdd1ced admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:28.282121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7438a4b-aa8d-41bb-a1fc-e1d25a7518fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:28.282995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7438a4b-aa8d-41bb-a1fc-e1d25a7518fb admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:28.283437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7438a4b-aa8d-41bb-a1fc-e1d25a7518fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:28.283882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7438a4b-aa8d-41bb-a1fc-e1d25a7518fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:28.284705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7438a4b-aa8d-41bb-a1fc-e1d25a7518fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:28.289405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7438a4b-aa8d-41bb-a1fc-e1d25a7518fb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:28.343469 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2673/5372] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:09:28 2022] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:28.348503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b56bf-17a8-4d4b-9df5-d6b6d8d8a5f8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:28.364906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b56bf-17a8-4d4b-9df5-d6b6d8d8a5f8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:28.410196 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:28.524719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabd270-3bf6-4974-a8e1-de5c3e651833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:28.525534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabd270-3bf6-4974-a8e1-de5c3e651833 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:28.526499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabd270-3bf6-4974-a8e1-de5c3e651833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:28.526896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabd270-3bf6-4974-a8e1-de5c3e651833 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:28.527669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabd270-3bf6-4974-a8e1-de5c3e651833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:28.535230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabd270-3bf6-4974-a8e1-de5c3e651833 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:28.576394 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2700/5373] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:28 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:28.581647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7438a4b-aa8d-41bb-a1fc-e1d25a7518fb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:28.599029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7438a4b-aa8d-41bb-a1fc-e1d25a7518fb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:28.608481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb696-97ea-4646-9e12-e6404e87b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:28.622416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb696-97ea-4646-9e12-e6404e87b8ad admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:28.623136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb696-97ea-4646-9e12-e6404e87b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:28.623696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb696-97ea-4646-9e12-e6404e87b8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:28.625176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fb696-97ea-4646-9e12-e6404e87b8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:28.628162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fb696-97ea-4646-9e12-e6404e87b8ad admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:28.679816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabd270-3bf6-4974-a8e1-de5c3e651833 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:28.687969 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2674/5374] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:28.692775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabd270-3bf6-4974-a8e1-de5c3e651833 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:28.698877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ee6ed-6ff0-495c-9eee-dc441d23a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:28.699667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee6ed-6ff0-495c-9eee-dc441d23a921 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:28.700074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee6ed-6ff0-495c-9eee-dc441d23a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:28.700451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee6ed-6ff0-495c-9eee-dc441d23a921 admin admin] PATH_INFO: `/v3/projects/5217adb6a7c04e8d99863fd9135c9b53/users/2bde60f2147c4280b71578eae52f6de7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:28.722748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ee6ed-6ff0-495c-9eee-dc441d23a921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5217adb6a7c04e8d99863fd9135c9b53, user_id=2bde60f2147c4280b71578eae52f6de7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:28.726164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ee6ed-6ff0-495c-9eee-dc441d23a921 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:28.770992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb696-97ea-4646-9e12-e6404e87b8ad admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:28.771859 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2701/5375] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:09:28 2022] PUT /identity/v3/projects/5217adb6a7c04e8d99863fd9135c9b53/users/2bde60f2147c4280b71578eae52f6de7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:09:28.799479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb696-97ea-4646-9e12-e6404e87b8ad admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:28.926005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348882aa-950f-48c6-be03-a1e7da2306ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:28.926646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348882aa-950f-48c6-be03-a1e7da2306ba admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:28.926933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348882aa-950f-48c6-be03-a1e7da2306ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:28.927212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348882aa-950f-48c6-be03-a1e7da2306ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:28.927872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348882aa-950f-48c6-be03-a1e7da2306ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:28.933013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348882aa-950f-48c6-be03-a1e7da2306ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:28.961595 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2675/5376] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:28.964001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ee6ed-6ff0-495c-9eee-dc441d23a921 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:28.980267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ee6ed-6ff0-495c-9eee-dc441d23a921 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:29.008083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c95cf-2329-484c-8397-aa4c8ad40e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:29.008799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c95cf-2329-484c-8397-aa4c8ad40e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:29.009079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c95cf-2329-484c-8397-aa4c8ad40e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:29.009352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c95cf-2329-484c-8397-aa4c8ad40e82 admin admin] PATH_INFO: `/v3/projects/5217adb6a7c04e8d99863fd9135c9b53/users/2bde60f2147c4280b71578eae52f6de7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:29.014455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c95cf-2329-484c-8397-aa4c8ad40e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5217adb6a7c04e8d99863fd9135c9b53, user_id=2bde60f2147c4280b71578eae52f6de7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:29.017711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c95cf-2329-484c-8397-aa4c8ad40e82 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:29.086584 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2702/5377] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:09:28 2022] PUT /identity/v3/projects/5217adb6a7c04e8d99863fd9135c9b53/users/2bde60f2147c4280b71578eae52f6de7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:29.087456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de62f-54ac-481c-93fa-fe65b5a64f02 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:29.087779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de62f-54ac-481c-93fa-fe65b5a64f02 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:29.088075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de62f-54ac-481c-93fa-fe65b5a64f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:29.165026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-953de62f-54ac-481c-93fa-fe65b5a64f02 None None] MFA Rules not processed for user `2bde60f2147c4280b71578eae52f6de7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:29.166275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-953de62f-54ac-481c-93fa-fe65b5a64f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:29.189483 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:29.339335 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2676/5378] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:29.352989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c95cf-2329-484c-8397-aa4c8ad40e82 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:29.359464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b37c95cf-2329-484c-8397-aa4c8ad40e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:29.553857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c95cf-2329-484c-8397-aa4c8ad40e82 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:29.562735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe7cc4-d2a0-4269-be9f-ebe0b7148e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:29.563357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7cc4-d2a0-4269-be9f-ebe0b7148e13 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:29.563631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7cc4-d2a0-4269-be9f-ebe0b7148e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:29.563900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7cc4-d2a0-4269-be9f-ebe0b7148e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:29.585151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe7cc4-d2a0-4269-be9f-ebe0b7148e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:29.586635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe7cc4-d2a0-4269-be9f-ebe0b7148e13 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:29.617265 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2703/5379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:29.848896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953de62f-54ac-481c-93fa-fe65b5a64f02 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:29.855721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-953de62f-54ac-481c-93fa-fe65b5a64f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:29.942900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953de62f-54ac-481c-93fa-fe65b5a64f02 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:29.976156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b1de1-aca5-4aa6-9fe5-ab48f197c15b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:29.976941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1de1-aca5-4aa6-9fe5-ab48f197c15b service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:29.977220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1de1-aca5-4aa6-9fe5-ab48f197c15b service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:29.977503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1de1-aca5-4aa6-9fe5-ab48f197c15b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:30.237742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b1de1-aca5-4aa6-9fe5-ab48f197c15b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:30.247094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b1de1-aca5-4aa6-9fe5-ab48f197c15b service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:30.269239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2677/5380] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:31.595517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe7cc4-d2a0-4269-be9f-ebe0b7148e13 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:31.598151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6cbe7cc4-d2a0-4269-be9f-ebe0b7148e13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:31.750831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe7cc4-d2a0-4269-be9f-ebe0b7148e13 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:31.770754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3444ed2-a143-48b8-8a2c-f8c8e2d92e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:31.771940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444ed2-a143-48b8-8a2c-f8c8e2d92e7d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:31.772418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444ed2-a143-48b8-8a2c-f8c8e2d92e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:31.772895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444ed2-a143-48b8-8a2c-f8c8e2d92e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:31.777508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b3444ed2-a143-48b8-8a2c-f8c8e2d92e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:31.850800 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:31.933617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3444ed2-a143-48b8-8a2c-f8c8e2d92e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:31.935504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3444ed2-a143-48b8-8a2c-f8c8e2d92e7d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:31.976781 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2704/5381] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:35.626486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b1de1-aca5-4aa6-9fe5-ab48f197c15b service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:35.633568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-474b1de1-aca5-4aa6-9fe5-ab48f197c15b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:35.824681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b1de1-aca5-4aa6-9fe5-ab48f197c15b service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:35.838838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:35.839608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:35.840015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:35.840394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:35.845112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:35.875910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:35.878051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:35.905933 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2678/5382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:36.848025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3444ed2-a143-48b8-8a2c-f8c8e2d92e7d service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:36.861655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3444ed2-a143-48b8-8a2c-f8c8e2d92e7d service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:36.889818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:36.891382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:36.891874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:36.892435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:36.896556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:36.925322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:36.928752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:36.982325 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2705/5383] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:41.187209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:41.189672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:41.341482 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:41.410080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00700ed-7c74-4dbe-b3d3-fd2dc58c0cd5 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:41.417606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc1026-195f-4ccb-92ce-cbfeac66ae03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:41.418251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc1026-195f-4ccb-92ce-cbfeac66ae03 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:41.419828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc1026-195f-4ccb-92ce-cbfeac66ae03 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:41.420109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc1026-195f-4ccb-92ce-cbfeac66ae03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:41.422849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-51cc1026-195f-4ccb-92ce-cbfeac66ae03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:41.463798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc1026-195f-4ccb-92ce-cbfeac66ae03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:41.465338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc1026-195f-4ccb-92ce-cbfeac66ae03 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:41.538895 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2679/5384] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:09:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:09:43.336641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:43.338338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:43.382620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152f84-53a6-4c0b-aebe-36bd5e4362fd service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:43.418185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:43.419023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:43.419404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:43.419784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] PATH_INFO: `/v3/users/e3d4cc70eeca421585fabdb682af7caf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:43.422542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d4cc70eeca421585fabdb682af7caf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:43.424663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:43.515125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d4cc70eeca421585fabdb682af7caf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:43.533635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d4cc70eeca421585fabdb682af7caf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:43.544339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d4cc70eeca421585fabdb682af7caf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:43.554576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d4cc70eeca421585fabdb682af7caf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:43.555659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9b9a967-2f3d-4932-9af3-ab343541d7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d4cc70eeca421585fabdb682af7caf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:43.563888 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2706/5385] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:09:43 2022] DELETE /identity/v3/users/e3d4cc70eeca421585fabdb682af7caf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:44.508759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc1026-195f-4ccb-92ce-cbfeac66ae03 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:44.529000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc1026-195f-4ccb-92ce-cbfeac66ae03 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:44.727148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:44.728446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:44.728863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:44.729149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] PATH_INFO: `/v3/projects/58b0d66fb5304e7ba517c2f714a7ccac` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:44.730405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b0d66fb5304e7ba517c2f714a7ccac)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:44.732434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:44.793962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b0d66fb5304e7ba517c2f714a7ccac', 'request_id': 'req-2b609f0f-741d-40a0-b9ff-a38c9595282c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:44.807738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b0d66fb5304e7ba517c2f714a7ccac', 'request_id': 'req-2b609f0f-741d-40a0-b9ff-a38c9595282c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:44.817192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b0d66fb5304e7ba517c2f714a7ccac', 'request_id': 'req-2b609f0f-741d-40a0-b9ff-a38c9595282c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:44.834843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] The token cache is being invalidate because project 58b0d66fb5304e7ba517c2f714a7ccac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:09:44.835471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:44.836564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2b609f0f-741d-40a0-b9ff-a38c9595282c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:44.839834 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2680/5386] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:09:44 2022] DELETE /identity/v3/projects/58b0d66fb5304e7ba517c2f714a7ccac => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:44.845615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051a1d-a0bd-4c81-8610-1b2dd4e38ed6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:44.846642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051a1d-a0bd-4c81-8610-1b2dd4e38ed6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:44.847309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051a1d-a0bd-4c81-8610-1b2dd4e38ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:44.880557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-eb051a1d-a0bd-4c81-8610-1b2dd4e38ed6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:44.882473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eb051a1d-a0bd-4c81-8610-1b2dd4e38ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:44.974883 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2707/5387] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:44.977239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b4e7-4fa9-4dcc-9ac8-bd5dbd962379 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:44.977539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b4e7-4fa9-4dcc-9ac8-bd5dbd962379 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:44.977827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b4e7-4fa9-4dcc-9ac8-bd5dbd962379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:45.001301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6d32b4e7-4fa9-4dcc-9ac8-bd5dbd962379 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:45.003448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6d32b4e7-4fa9-4dcc-9ac8-bd5dbd962379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:45.018419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051a1d-a0bd-4c81-8610-1b2dd4e38ed6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:45.025860 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2681/5388] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:45.030768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051a1d-a0bd-4c81-8610-1b2dd4e38ed6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:45.038102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec22efe-7e82-405f-ae3c-22fdaae7fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:45.038734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec22efe-7e82-405f-ae3c-22fdaae7fa7a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:45.039015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec22efe-7e82-405f-ae3c-22fdaae7fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:45.039708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec22efe-7e82-405f-ae3c-22fdaae7fa7a admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:45.040361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec22efe-7e82-405f-ae3c-22fdaae7fa7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:09:45.040705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec22efe-7e82-405f-ae3c-22fdaae7fa7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:45.042306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec22efe-7e82-405f-ae3c-22fdaae7fa7a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:45.063878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b4e7-4fa9-4dcc-9ac8-bd5dbd962379 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:45.071248 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2708/5389] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:09:45.075149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b4e7-4fa9-4dcc-9ac8-bd5dbd962379 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:45.100547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e556f8b-cdb4-4877-983f-24601349048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:45.101208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e556f8b-cdb4-4877-983f-24601349048c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:45.103277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e556f8b-cdb4-4877-983f-24601349048c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:45.103576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e556f8b-cdb4-4877-983f-24601349048c admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:45.104225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e556f8b-cdb4-4877-983f-24601349048c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:45.111906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e556f8b-cdb4-4877-983f-24601349048c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:45.165803 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2682/5390] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:09:45 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:45.170351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec22efe-7e82-405f-ae3c-22fdaae7fa7a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:45.183904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec22efe-7e82-405f-ae3c-22fdaae7fa7a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:45.198996 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:45.340191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc123c79-ccdd-423b-9190-f1542047350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:45.341252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc123c79-ccdd-423b-9190-f1542047350e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:45.341679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc123c79-ccdd-423b-9190-f1542047350e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:45.342099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc123c79-ccdd-423b-9190-f1542047350e admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:45.344789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc123c79-ccdd-423b-9190-f1542047350e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:45.352976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc123c79-ccdd-423b-9190-f1542047350e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:45.399210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2709/5391] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:45 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:45.400251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e556f8b-cdb4-4877-983f-24601349048c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:45.413349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e556f8b-cdb4-4877-983f-24601349048c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:45.428998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3cb70-beec-4f8f-88e8-32b966c9734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:45.429871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3cb70-beec-4f8f-88e8-32b966c9734a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:45.430288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3cb70-beec-4f8f-88e8-32b966c9734a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:45.430720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3cb70-beec-4f8f-88e8-32b966c9734a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:45.431700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3cb70-beec-4f8f-88e8-32b966c9734a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:45.438643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3cb70-beec-4f8f-88e8-32b966c9734a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:45.465445 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2683/5392] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:45.469601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc123c79-ccdd-423b-9190-f1542047350e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:45.486922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc123c79-ccdd-423b-9190-f1542047350e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:45.510519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ac1cd-53f3-4390-8d29-b97227af54cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:45.529137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ac1cd-53f3-4390-8d29-b97227af54cd admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:45.530072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ac1cd-53f3-4390-8d29-b97227af54cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:45.530879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ac1cd-53f3-4390-8d29-b97227af54cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:45.534042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ac1cd-53f3-4390-8d29-b97227af54cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:45.539168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ac1cd-53f3-4390-8d29-b97227af54cd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:45.572978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3cb70-beec-4f8f-88e8-32b966c9734a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:45.584081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3cb70-beec-4f8f-88e8-32b966c9734a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:45.587083 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2710/5393] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:45.599062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00e34-d404-4b28-9859-a70c75acaeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:45.599728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00e34-d404-4b28-9859-a70c75acaeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:45.600179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00e34-d404-4b28-9859-a70c75acaeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:45.600590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00e34-d404-4b28-9859-a70c75acaeaa admin admin] PATH_INFO: `/v3/projects/cac652b1b75a48b1833d316c6c4d942c/users/6d36ede8e2224948814bcc24eb1f00b8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:45.671933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e00e34-d404-4b28-9859-a70c75acaeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac652b1b75a48b1833d316c6c4d942c, user_id=6d36ede8e2224948814bcc24eb1f00b8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:45.674679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e00e34-d404-4b28-9859-a70c75acaeaa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:45.731991 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:45.757332 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2684/5394] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:09:45 2022] PUT /identity/v3/projects/cac652b1b75a48b1833d316c6c4d942c/users/6d36ede8e2224948814bcc24eb1f00b8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:09:45.853323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188f953-a1b5-4727-9b09-2ecfc3fa5f90 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:45.853916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188f953-a1b5-4727-9b09-2ecfc3fa5f90 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:45.853916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188f953-a1b5-4727-9b09-2ecfc3fa5f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:45.902714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4188f953-a1b5-4727-9b09-2ecfc3fa5f90 None None] MFA Rules not processed for user `6d36ede8e2224948814bcc24eb1f00b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:45.904176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4188f953-a1b5-4727-9b09-2ecfc3fa5f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:46.140348 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2711/5395] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:09:46.145320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00e34-d404-4b28-9859-a70c75acaeaa admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:46.347540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00e34-d404-4b28-9859-a70c75acaeaa admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:46.367608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad8cd-ade5-4873-a37d-aea597545bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:46.375206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad8cd-ade5-4873-a37d-aea597545bdd admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:46.376489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad8cd-ade5-4873-a37d-aea597545bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:46.382982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad8cd-ade5-4873-a37d-aea597545bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:46.384013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad8cd-ade5-4873-a37d-aea597545bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:46.386552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad8cd-ade5-4873-a37d-aea597545bdd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:46.479145 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2685/5396] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:09:46 2022] POST /identity/v3/projects => generated 369 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:46.481797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188f953-a1b5-4727-9b09-2ecfc3fa5f90 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:46.497780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188f953-a1b5-4727-9b09-2ecfc3fa5f90 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:46.685163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274af5-7b2a-4f16-b1b2-0368e0ae103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:46.706000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274af5-7b2a-4f16-b1b2-0368e0ae103f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:46.707900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274af5-7b2a-4f16-b1b2-0368e0ae103f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:46.711375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274af5-7b2a-4f16-b1b2-0368e0ae103f admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:46.723652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2274af5-7b2a-4f16-b1b2-0368e0ae103f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:46.738483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2274af5-7b2a-4f16-b1b2-0368e0ae103f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:46.807250 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2712/5397] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:46 2022] POST /identity/v3/users => generated 291 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:46.809063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad8cd-ade5-4873-a37d-aea597545bdd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:46.842072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad8cd-ade5-4873-a37d-aea597545bdd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:46.862913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc42f09-4bbe-4791-885a-cf6499a72152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:46.863905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc42f09-4bbe-4791-885a-cf6499a72152 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:46.864802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc42f09-4bbe-4791-885a-cf6499a72152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:46.865275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc42f09-4bbe-4791-885a-cf6499a72152 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:46.866145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc42f09-4bbe-4791-885a-cf6499a72152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:46.868177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc42f09-4bbe-4791-885a-cf6499a72152 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:46.900807 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2686/5398] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:46.907279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274af5-7b2a-4f16-b1b2-0368e0ae103f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:46.924005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274af5-7b2a-4f16-b1b2-0368e0ae103f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:46.936991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a28638-38d7-4894-84b6-de72a480475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:46.938505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28638-38d7-4894-84b6-de72a480475b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:46.939007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28638-38d7-4894-84b6-de72a480475b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:46.939510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28638-38d7-4894-84b6-de72a480475b admin admin] PATH_INFO: `/v3/projects/6ef4e81d833246da95a17a5e09c2e3e4/users/249c8b2c61524c4e8053e302f89bbbbf/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:46.947234 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:46.988930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a28638-38d7-4894-84b6-de72a480475b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef4e81d833246da95a17a5e09c2e3e4, user_id=249c8b2c61524c4e8053e302f89bbbbf, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:47.063914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a28638-38d7-4894-84b6-de72a480475b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:47.112674 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2713/5399] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:09:46 2022] PUT /identity/v3/projects/6ef4e81d833246da95a17a5e09c2e3e4/users/249c8b2c61524c4e8053e302f89bbbbf/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:47.117156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc42f09-4bbe-4791-885a-cf6499a72152 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:47.155758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc42f09-4bbe-4791-885a-cf6499a72152 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:47.407676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5eb62-714e-468e-9cbd-f87ca7e9680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:47.408368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5eb62-714e-468e-9cbd-f87ca7e9680d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:47.409047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5eb62-714e-468e-9cbd-f87ca7e9680d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:47.409047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5eb62-714e-468e-9cbd-f87ca7e9680d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:47.409639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5eb62-714e-468e-9cbd-f87ca7e9680d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:47.417869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5eb62-714e-468e-9cbd-f87ca7e9680d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:47.439025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc809bd6-4044-4056-b8b9-1fe5e6ea71f5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:47.439441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc809bd6-4044-4056-b8b9-1fe5e6ea71f5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:47.440308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc809bd6-4044-4056-b8b9-1fe5e6ea71f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:47.455065 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2687/5400] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:47.462455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5eb62-714e-468e-9cbd-f87ca7e9680d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:47.492737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5eb62-714e-468e-9cbd-f87ca7e9680d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:47.498550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bc809bd6-4044-4056-b8b9-1fe5e6ea71f5 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:47.503808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc809bd6-4044-4056-b8b9-1fe5e6ea71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:47.512775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fe68a-aefb-4cb7-af3c-203ad2942240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:47.513461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe68a-aefb-4cb7-af3c-203ad2942240 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:47.513748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe68a-aefb-4cb7-af3c-203ad2942240 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:47.514024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe68a-aefb-4cb7-af3c-203ad2942240 admin admin] PATH_INFO: `/v3/projects/6ef4e81d833246da95a17a5e09c2e3e4/users/249c8b2c61524c4e8053e302f89bbbbf/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:47.518551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fe68a-aefb-4cb7-af3c-203ad2942240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef4e81d833246da95a17a5e09c2e3e4, user_id=249c8b2c61524c4e8053e302f89bbbbf, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:47.527229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fe68a-aefb-4cb7-af3c-203ad2942240 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:47.565405 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2688/5401] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:09:47 2022] PUT /identity/v3/projects/6ef4e81d833246da95a17a5e09c2e3e4/users/249c8b2c61524c4e8053e302f89bbbbf/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:47.576293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33debe-b126-4c3c-b608-e6c34ffd7634 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:47.576581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33debe-b126-4c3c-b608-e6c34ffd7634 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:47.576915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33debe-b126-4c3c-b608-e6c34ffd7634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:47.644000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-db33debe-b126-4c3c-b608-e6c34ffd7634 None None] MFA Rules not processed for user `249c8b2c61524c4e8053e302f89bbbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:09:47.645231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-db33debe-b126-4c3c-b608-e6c34ffd7634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:47.686936 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2714/5402] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:09:47.709397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc809bd6-4044-4056-b8b9-1fe5e6ea71f5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:47.716813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc809bd6-4044-4056-b8b9-1fe5e6ea71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:47.795002 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:47.872520 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2689/5403] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:09:47.880492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33debe-b126-4c3c-b608-e6c34ffd7634 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:47.900034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33debe-b126-4c3c-b608-e6c34ffd7634 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:47.906304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc809bd6-4044-4056-b8b9-1fe5e6ea71f5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:47.918631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00594a6f-e6a5-492d-b02c-45cf0cd77a3d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:47.919500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594a6f-e6a5-492d-b02c-45cf0cd77a3d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:47.919785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594a6f-e6a5-492d-b02c-45cf0cd77a3d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:47.920251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594a6f-e6a5-492d-b02c-45cf0cd77a3d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:47.921966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00594a6f-e6a5-492d-b02c-45cf0cd77a3d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:47.929386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00594a6f-e6a5-492d-b02c-45cf0cd77a3d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:47.969019 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2690/5404] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:09:47 2022] POST /identity/v3/domains => generated 276 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:47.970475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00594a6f-e6a5-492d-b02c-45cf0cd77a3d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:48.066567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04129215-c349-4c4a-b656-2cb5d82688e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:48.067197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04129215-c349-4c4a-b656-2cb5d82688e8 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:48.067477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04129215-c349-4c4a-b656-2cb5d82688e8 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:48.067749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04129215-c349-4c4a-b656-2cb5d82688e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:48.154589 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:48.157008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00594a6f-e6a5-492d-b02c-45cf0cd77a3d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:48.176841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ba54c-0ca8-4da7-a93f-28992ed11467 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:48.177604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ba54c-0ca8-4da7-a93f-28992ed11467 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:48.177985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ba54c-0ca8-4da7-a93f-28992ed11467 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:48.178455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ba54c-0ca8-4da7-a93f-28992ed11467 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:48.179112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ba54c-0ca8-4da7-a93f-28992ed11467 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:48.181163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ba54c-0ca8-4da7-a93f-28992ed11467 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:48.219877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04129215-c349-4c4a-b656-2cb5d82688e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:48.221558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04129215-c349-4c4a-b656-2cb5d82688e8 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:48.264254 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2715/5405] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:09:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:09:48.269905 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2691/5406] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:09:47 2022] POST /identity/v3/groups => generated 280 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:48.275623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04129215-c349-4c4a-b656-2cb5d82688e8 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:48.324519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04129215-c349-4c4a-b656-2cb5d82688e8 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:48.347159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ace52-f8e0-42c6-a538-4b177fa3cebc tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:48.347690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ace52-f8e0-42c6-a538-4b177fa3cebc tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:48.347975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ace52-f8e0-42c6-a538-4b177fa3cebc tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:48.348246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ace52-f8e0-42c6-a538-4b177fa3cebc tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/b5dcfe92b2984a088aef45b623a905f7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:48.378384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ace52-f8e0-42c6-a538-4b177fa3cebc tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:update_group(group_id=b5dcfe92b2984a088aef45b623a905f7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:48.379436 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-3b7ace52-f8e0-42c6-a538-4b177fa3cebc tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:09:48.379436 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:09:48.379436 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:09:48.381191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ace52-f8e0-42c6-a538-4b177fa3cebc tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:48.418079 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2716/5407] 10.222.0.27 () {60 vars in 1247 bytes} [Wed Oct 19 01:09:48 2022] PATCH /identity/v3/groups/b5dcfe92b2984a088aef45b623a905f7 => generated 292 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:09:48.423091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ba54c-0ca8-4da7-a93f-28992ed11467 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:48.508486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ba54c-0ca8-4da7-a93f-28992ed11467 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:48.544098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8a620-0c4e-44a7-a744-ab5916a92f5b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:48.548176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a620-0c4e-44a7-a744-ab5916a92f5b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:48.548885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a620-0c4e-44a7-a744-ab5916a92f5b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:48.549415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a620-0c4e-44a7-a744-ab5916a92f5b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/b5dcfe92b2984a088aef45b623a905f7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:48.582170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8a620-0c4e-44a7-a744-ab5916a92f5b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:get_group(group_id=b5dcfe92b2984a088aef45b623a905f7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:48.595273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8a620-0c4e-44a7-a744-ab5916a92f5b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:48.605819 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2692/5408] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:09:48 2022] GET /identity/v3/groups/b5dcfe92b2984a088aef45b623a905f7 => generated 292 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:09:48.607622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ace52-f8e0-42c6-a538-4b177fa3cebc tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:48.618669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ace52-f8e0-42c6-a538-4b177fa3cebc tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:48.651896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d680f-6cfc-401a-a23f-c4d03ccec0ef tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:48.657303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d680f-6cfc-401a-a23f-c4d03ccec0ef tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:48.658159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d680f-6cfc-401a-a23f-c4d03ccec0ef tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:48.658638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d680f-6cfc-401a-a23f-c4d03ccec0ef tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/b5dcfe92b2984a088aef45b623a905f7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:48.662837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d680f-6cfc-401a-a23f-c4d03ccec0ef tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:update_group(group_id=b5dcfe92b2984a088aef45b623a905f7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:48.680284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d680f-6cfc-401a-a23f-c4d03ccec0ef tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:48.738186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8a620-0c4e-44a7-a744-ab5916a92f5b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:48.743515 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2717/5409] 10.222.0.27 () {60 vars in 1246 bytes} [Wed Oct 19 01:09:48 2022] PATCH /identity/v3/groups/b5dcfe92b2984a088aef45b623a905f7 => generated 307 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:09:48.799772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8a620-0c4e-44a7-a744-ab5916a92f5b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:48.813500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e579-7c64-42a6-830f-96584a84347a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:48.816198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e579-7c64-42a6-830f-96584a84347a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:48.816867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e579-7c64-42a6-830f-96584a84347a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:48.823457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e579-7c64-42a6-830f-96584a84347a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/b5dcfe92b2984a088aef45b623a905f7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:48.847591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399e579-7c64-42a6-830f-96584a84347a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b5dcfe92b2984a088aef45b623a905f7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:48.849788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399e579-7c64-42a6-830f-96584a84347a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:48.944740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d680f-6cfc-401a-a23f-c4d03ccec0ef tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:48.945341 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2693/5410] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:09:48 2022] DELETE /identity/v3/groups/b5dcfe92b2984a088aef45b623a905f7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:09:48.964253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d680f-6cfc-401a-a23f-c4d03ccec0ef tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:49.094114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af923d-1074-4d51-a3e6-51c8aea2400c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:49.095565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af923d-1074-4d51-a3e6-51c8aea2400c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:49.096052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af923d-1074-4d51-a3e6-51c8aea2400c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:49.096614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af923d-1074-4d51-a3e6-51c8aea2400c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:49.097491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af923d-1074-4d51-a3e6-51c8aea2400c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:49.099659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af923d-1074-4d51-a3e6-51c8aea2400c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:49.186078 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2718/5411] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:09:48 2022] POST /identity/v3/groups => generated 326 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:49.187788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e579-7c64-42a6-830f-96584a84347a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:49.208749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e579-7c64-42a6-830f-96584a84347a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:49.243458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6e45c-b7fb-4d9a-87da-3a9a0f8971de tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:49.244766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6e45c-b7fb-4d9a-87da-3a9a0f8971de tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:49.244766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6e45c-b7fb-4d9a-87da-3a9a0f8971de tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:49.244766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6e45c-b7fb-4d9a-87da-3a9a0f8971de tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:49.245370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6e45c-b7fb-4d9a-87da-3a9a0f8971de tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:49.247530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6e45c-b7fb-4d9a-87da-3a9a0f8971de tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:49.337496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af923d-1074-4d51-a3e6-51c8aea2400c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:49.348164 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2694/5412] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:49 2022] POST /identity/v3/users => generated 323 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:49.350618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af923d-1074-4d51-a3e6-51c8aea2400c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:49.371983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ca2f-c27e-4011-a9f9-c534aa4930ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:49.372939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ca2f-c27e-4011-a9f9-c534aa4930ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:49.373360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ca2f-c27e-4011-a9f9-c534aa4930ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:49.373878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ca2f-c27e-4011-a9f9-c534aa4930ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/36620904f0ed403a91a9cf0737df93a7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:49.469390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ca2f-c27e-4011-a9f9-c534aa4930ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5, user_id=36620904f0ed403a91a9cf0737df93a7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:49.478274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ca2f-c27e-4011-a9f9-c534aa4930ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:49.537622 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2719/5413] 10.222.0.27 () {60 vars in 1360 bytes} [Wed Oct 19 01:09:49 2022] PUT /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/36620904f0ed403a91a9cf0737df93a7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:49.538949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6e45c-b7fb-4d9a-87da-3a9a0f8971de tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:49.554092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6e45c-b7fb-4d9a-87da-3a9a0f8971de tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:49.708036 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:49.774035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb9544-556f-4dd5-82e3-e8be187ce94b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:49.774743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb9544-556f-4dd5-82e3-e8be187ce94b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:49.775036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb9544-556f-4dd5-82e3-e8be187ce94b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:49.775389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb9544-556f-4dd5-82e3-e8be187ce94b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:49.776174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb9544-556f-4dd5-82e3-e8be187ce94b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:49.778641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb9544-556f-4dd5-82e3-e8be187ce94b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:49.850879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2695/5414] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:49 2022] POST /identity/v3/users => generated 323 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:49.851641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ca2f-c27e-4011-a9f9-c534aa4930ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:49.877797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ca2f-c27e-4011-a9f9-c534aa4930ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:49.911791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283db11-b8ab-424c-93b6-af0edeb8a46b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:49.918723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283db11-b8ab-424c-93b6-af0edeb8a46b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:49.919078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283db11-b8ab-424c-93b6-af0edeb8a46b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:49.919411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283db11-b8ab-424c-93b6-af0edeb8a46b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/b4645e0241214e70a15d0914e55226db` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:50.000614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283db11-b8ab-424c-93b6-af0edeb8a46b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5, user_id=b4645e0241214e70a15d0914e55226db)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:50.005508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283db11-b8ab-424c-93b6-af0edeb8a46b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:50.130934 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2720/5415] 10.222.0.27 () {60 vars in 1360 bytes} [Wed Oct 19 01:09:49 2022] PUT /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/b4645e0241214e70a15d0914e55226db => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:09:50.133053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb9544-556f-4dd5-82e3-e8be187ce94b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:50.154803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb9544-556f-4dd5-82e3-e8be187ce94b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:50.434184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8d511-3d75-4c59-9169-ee32f165d4f4 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:50.441474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8d511-3d75-4c59-9169-ee32f165d4f4 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:50.443236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8d511-3d75-4c59-9169-ee32f165d4f4 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:50.444162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8d511-3d75-4c59-9169-ee32f165d4f4 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:50.445405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8d511-3d75-4c59-9169-ee32f165d4f4 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:50.461652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8d511-3d75-4c59-9169-ee32f165d4f4 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:50.658945 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2696/5416] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:50 2022] POST /identity/v3/users => generated 323 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:50.660567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283db11-b8ab-424c-93b6-af0edeb8a46b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:50.692340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283db11-b8ab-424c-93b6-af0edeb8a46b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:50.721592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e08951-a363-4668-977d-2334a6653e83 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:50.726815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e08951-a363-4668-977d-2334a6653e83 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:50.757365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e08951-a363-4668-977d-2334a6653e83 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:50.763782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e08951-a363-4668-977d-2334a6653e83 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/1a022364240c4d4b8e35493c9fb3ae3b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:50.859209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e08951-a363-4668-977d-2334a6653e83 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5, user_id=1a022364240c4d4b8e35493c9fb3ae3b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:50.886519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e08951-a363-4668-977d-2334a6653e83 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:50.912424 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:UPDATE=2,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:51.043543 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2721/5417] 10.222.0.27 () {60 vars in 1360 bytes} [Wed Oct 19 01:09:50 2022] PUT /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/1a022364240c4d4b8e35493c9fb3ae3b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:51.068495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8d511-3d75-4c59-9169-ee32f165d4f4 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:51.129626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8d511-3d75-4c59-9169-ee32f165d4f4 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:51.463194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4837ae-c326-4670-93fa-986c332c411b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:51.463952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4837ae-c326-4670-93fa-986c332c411b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:51.464152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4837ae-c326-4670-93fa-986c332c411b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:51.464408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4837ae-c326-4670-93fa-986c332c411b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:51.475582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4837ae-c326-4670-93fa-986c332c411b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:51.489005 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-ac4837ae-c326-4670-93fa-986c332c411b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:09:51.489005 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:09:51.489005 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:09:51.490461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4837ae-c326-4670-93fa-986c332c411b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:51.568274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e08951-a363-4668-977d-2334a6653e83 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:51.573055 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2697/5418] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:09:51 2022] GET /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users => generated 1085 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:51.617743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e08951-a363-4668-977d-2334a6653e83 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:51.633918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544786e3-d8f2-4736-bd51-eca8615bb051 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:51.635483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544786e3-d8f2-4736-bd51-eca8615bb051 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:51.635767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544786e3-d8f2-4736-bd51-eca8615bb051 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:51.636048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544786e3-d8f2-4736-bd51-eca8615bb051 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/36620904f0ed403a91a9cf0737df93a7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:51.637975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544786e3-d8f2-4736-bd51-eca8615bb051 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5, user_id=36620904f0ed403a91a9cf0737df93a7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:51.639009 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-544786e3-d8f2-4736-bd51-eca8615bb051 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:09:51.639009 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:09:51.639009 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:09:51.641109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544786e3-d8f2-4736-bd51-eca8615bb051 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:51.688689 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2722/5419] 10.222.0.27 () {58 vars in 1342 bytes} [Wed Oct 19 01:09:51 2022] HEAD /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/36620904f0ed403a91a9cf0737df93a7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:51.691148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4837ae-c326-4670-93fa-986c332c411b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:51.707943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4837ae-c326-4670-93fa-986c332c411b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:51.734614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:51.735660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:51.735660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:51.735813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/36620904f0ed403a91a9cf0737df93a7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:51.753818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5, user_id=36620904f0ed403a91a9cf0737df93a7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:51.754905 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:09:51.754905 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:09:51.754905 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:09:51.756309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:51.793482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '36620904f0ed403a91a9cf0737df93a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:51.823535 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2698/5420] 10.222.0.27 () {58 vars in 1344 bytes} [Wed Oct 19 01:09:51 2022] DELETE /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/36620904f0ed403a91a9cf0737df93a7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:51.830439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544786e3-d8f2-4736-bd51-eca8615bb051 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:51.853124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544786e3-d8f2-4736-bd51-eca8615bb051 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:52.212528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1edc-3f62-4741-ad06-789c73e57490 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:52.214561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1edc-3f62-4741-ad06-789c73e57490 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:52.214872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1edc-3f62-4741-ad06-789c73e57490 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:52.215158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1edc-3f62-4741-ad06-789c73e57490 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/b4645e0241214e70a15d0914e55226db` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:52.221705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f1edc-3f62-4741-ad06-789c73e57490 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5, user_id=b4645e0241214e70a15d0914e55226db)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:52.223697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f1edc-3f62-4741-ad06-789c73e57490 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:52.292013 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2723/5421] 10.222.0.27 () {58 vars in 1342 bytes} [Wed Oct 19 01:09:51 2022] HEAD /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/b4645e0241214e70a15d0914e55226db => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:52.298084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:52.345025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7875433-0f10-419b-a68c-acf8f87a229b tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:52.366596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ae508-ee0b-45f8-a662-a9c6f081b7f9 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:52.367249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ae508-ee0b-45f8-a662-a9c6f081b7f9 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:52.367579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ae508-ee0b-45f8-a662-a9c6f081b7f9 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:52.367886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ae508-ee0b-45f8-a662-a9c6f081b7f9 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/b4645e0241214e70a15d0914e55226db` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:52.370278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ae508-ee0b-45f8-a662-a9c6f081b7f9 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5, user_id=b4645e0241214e70a15d0914e55226db)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:52.372280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ae508-ee0b-45f8-a662-a9c6f081b7f9 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:52.400021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a30ae508-ee0b-45f8-a662-a9c6f081b7f9 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b4645e0241214e70a15d0914e55226db'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:52.442766 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2699/5422] 10.222.0.27 () {58 vars in 1344 bytes} [Wed Oct 19 01:09:52 2022] DELETE /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/b4645e0241214e70a15d0914e55226db => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:52.447146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1edc-3f62-4741-ad06-789c73e57490 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:52.464648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1edc-3f62-4741-ad06-789c73e57490 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:52.718177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf994-517b-450f-9c3d-ad23d457823d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:52.718863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf994-517b-450f-9c3d-ad23d457823d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:52.719113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf994-517b-450f-9c3d-ad23d457823d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:52.719408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf994-517b-450f-9c3d-ad23d457823d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/1a022364240c4d4b8e35493c9fb3ae3b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:52.725310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaf994-517b-450f-9c3d-ad23d457823d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5, user_id=1a022364240c4d4b8e35493c9fb3ae3b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:52.727256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaf994-517b-450f-9c3d-ad23d457823d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:52.774119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ae508-ee0b-45f8-a662-a9c6f081b7f9 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:52.783743 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2724/5423] 10.222.0.27 () {58 vars in 1342 bytes} [Wed Oct 19 01:09:52 2022] HEAD /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/1a022364240c4d4b8e35493c9fb3ae3b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:52.785434 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:INSERT=8,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:52.795718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ae508-ee0b-45f8-a662-a9c6f081b7f9 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:52.822003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1eb0f-d0df-44cb-8412-ecb00646a6a2 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:52.822876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1eb0f-d0df-44cb-8412-ecb00646a6a2 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:52.823368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1eb0f-d0df-44cb-8412-ecb00646a6a2 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:52.835566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1eb0f-d0df-44cb-8412-ecb00646a6a2 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/1a022364240c4d4b8e35493c9fb3ae3b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:52.841627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1eb0f-d0df-44cb-8412-ecb00646a6a2 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5, user_id=1a022364240c4d4b8e35493c9fb3ae3b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:52.850517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1eb0f-d0df-44cb-8412-ecb00646a6a2 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:52.877637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-72a1eb0f-d0df-44cb-8412-ecb00646a6a2 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1a022364240c4d4b8e35493c9fb3ae3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:52.945581 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2700/5424] 10.222.0.27 () {58 vars in 1344 bytes} [Wed Oct 19 01:09:52 2022] DELETE /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users/1a022364240c4d4b8e35493c9fb3ae3b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:52.953107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf994-517b-450f-9c3d-ad23d457823d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:52.966904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf994-517b-450f-9c3d-ad23d457823d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:53.119968 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:53.129324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:53.131660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:53.132200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:53.132897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:53.147308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:53.148840 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:09:53.148840 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:09:53.148840 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:09:53.151474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:53.199536 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2725/5425] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:09:52 2022] GET /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5/users => generated 145 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:09:53.206091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1eb0f-d0df-44cb-8412-ecb00646a6a2 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:53.225200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1eb0f-d0df-44cb-8412-ecb00646a6a2 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:53.242547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:53.243412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:53.248990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:53.249383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/users/1a022364240c4d4b8e35493c9fb3ae3b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:53.263542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1a022364240c4d4b8e35493c9fb3ae3b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:53.266754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:53.479225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a022364240c4d4b8e35493c9fb3ae3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:53.538827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a022364240c4d4b8e35493c9fb3ae3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:53.568153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a022364240c4d4b8e35493c9fb3ae3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:53.595879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a022364240c4d4b8e35493c9fb3ae3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:53.599371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a022364240c4d4b8e35493c9fb3ae3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:53.622771 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2701/5426] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:09:53 2022] DELETE /identity/v3/users/1a022364240c4d4b8e35493c9fb3ae3b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:53.624035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:53.625907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:53.676977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5adab-9d1d-4004-a1fd-1af28794e791 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:53.874968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:53.875686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:53.875914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:53.880438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/users/b4645e0241214e70a15d0914e55226db` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:53.881936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b4645e0241214e70a15d0914e55226db)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:53.884004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:54.138660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4645e0241214e70a15d0914e55226db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.207447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4645e0241214e70a15d0914e55226db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.225638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4645e0241214e70a15d0914e55226db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.236963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4645e0241214e70a15d0914e55226db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.237820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4645e0241214e70a15d0914e55226db'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.249397 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2726/5427] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:09:53 2022] DELETE /identity/v3/users/b4645e0241214e70a15d0914e55226db => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:54.250753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:54.271112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07b62-20e5-4eac-8752-ee5a8241d264 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:54.479260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:54.480047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:54.480336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:54.480634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/users/36620904f0ed403a91a9cf0737df93a7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:54.485683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_user(user_id=36620904f0ed403a91a9cf0737df93a7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:54.549564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:54.691630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36620904f0ed403a91a9cf0737df93a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.699938 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:54.711400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36620904f0ed403a91a9cf0737df93a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.724520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36620904f0ed403a91a9cf0737df93a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.781965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36620904f0ed403a91a9cf0737df93a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.784474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36620904f0ed403a91a9cf0737df93a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:54.823625 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2702/5428] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:09:54 2022] DELETE /identity/v3/users/36620904f0ed403a91a9cf0737df93a7 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:54.827641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:54.829312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:54.858543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b35a93-b7ab-422a-98f1-93d36774b90d tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:55.102458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0295eaf-80c9-42ae-a46e-593bd9b0f570 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:55.104043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0295eaf-80c9-42ae-a46e-593bd9b0f570 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:55.104518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0295eaf-80c9-42ae-a46e-593bd9b0f570 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:55.105029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0295eaf-80c9-42ae-a46e-593bd9b0f570 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:55.106753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0295eaf-80c9-42ae-a46e-593bd9b0f570 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f08a2e9f9ff84761bfa41292a6ea38f5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:55.108901 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-d0295eaf-80c9-42ae-a46e-593bd9b0f570 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:09:55.108901 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:09:55.108901 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:09:55.113734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0295eaf-80c9-42ae-a46e-593bd9b0f570 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:55.156914 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:55.267958 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2727/5429] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:09:54 2022] DELETE /identity/v3/groups/f08a2e9f9ff84761bfa41292a6ea38f5 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:55.273288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:55.276585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:55.365620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f708b3f-2748-4025-8fca-f01015bc29b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:55.532559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a110ef1-9af5-4944-a38f-f0771e1e6a8c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:55.533213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a110ef1-9af5-4944-a38f-f0771e1e6a8c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:55.533495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a110ef1-9af5-4944-a38f-f0771e1e6a8c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:55.533770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a110ef1-9af5-4944-a38f-f0771e1e6a8c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:55.534407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a110ef1-9af5-4944-a38f-f0771e1e6a8c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:55.537624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a110ef1-9af5-4944-a38f-f0771e1e6a8c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:55.575338 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2703/5430] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:09:55 2022] POST /identity/v3/groups => generated 326 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:55.579887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0295eaf-80c9-42ae-a46e-593bd9b0f570 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:55.613287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0295eaf-80c9-42ae-a46e-593bd9b0f570 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:55.650192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5622e-55ae-494d-ae16-594fb112c035 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:55.652049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5622e-55ae-494d-ae16-594fb112c035 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:55.652163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5622e-55ae-494d-ae16-594fb112c035 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:55.652414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5622e-55ae-494d-ae16-594fb112c035 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:55.659894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5622e-55ae-494d-ae16-594fb112c035 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:55.671287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5622e-55ae-494d-ae16-594fb112c035 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:55.757644 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2728/5431] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:09:55 2022] POST /identity/v3/groups => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:55.758805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a110ef1-9af5-4944-a38f-f0771e1e6a8c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:55.775028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a110ef1-9af5-4944-a38f-f0771e1e6a8c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:55.803576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a6a3-5039-4e98-b579-02bbf7c34f30 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:55.804062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a6a3-5039-4e98-b579-02bbf7c34f30 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:55.804355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a6a3-5039-4e98-b579-02bbf7c34f30 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:55.807405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a6a3-5039-4e98-b579-02bbf7c34f30 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:55.808141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440a6a3-5039-4e98-b579-02bbf7c34f30 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:55.826006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440a6a3-5039-4e98-b579-02bbf7c34f30 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:55.876443 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2704/5432] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:09:55 2022] POST /identity/v3/groups => generated 327 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:55.880903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5622e-55ae-494d-ae16-594fb112c035 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:55.900143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5622e-55ae-494d-ae16-594fb112c035 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:55.948870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cd125-ce5b-4868-84d4-609ea7e320ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:55.948870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cd125-ce5b-4868-84d4-609ea7e320ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:55.948870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cd125-ce5b-4868-84d4-609ea7e320ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:55.949202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cd125-ce5b-4868-84d4-609ea7e320ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:55.949202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cd125-ce5b-4868-84d4-609ea7e320ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:55.949202 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-b10cd125-ce5b-4868-84d4-609ea7e320ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:09:55.949202 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:09:55.949202 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:09:55.967567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cd125-ce5b-4868-84d4-609ea7e320ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:56.000416 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2729/5433] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 01:09:55 2022] GET /identity/v3/groups => generated 1488 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:09:56.005170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a6a3-5039-4e98-b579-02bbf7c34f30 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:56.029036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a6a3-5039-4e98-b579-02bbf7c34f30 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:56.052662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b72c-452e-41d9-b48d-5a554407fc68 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:56.053474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b72c-452e-41d9-b48d-5a554407fc68 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:56.053848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b72c-452e-41d9-b48d-5a554407fc68 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:56.054256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b72c-452e-41d9-b48d-5a554407fc68 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/074b58e0de8b438db1057f9ac4172b46` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:56.078722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b72c-452e-41d9-b48d-5a554407fc68 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_group(group_id=074b58e0de8b438db1057f9ac4172b46)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:56.080728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b72c-452e-41d9-b48d-5a554407fc68 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:56.220380 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2705/5434] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:09:56 2022] DELETE /identity/v3/groups/074b58e0de8b438db1057f9ac4172b46 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:56.220586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cd125-ce5b-4868-84d4-609ea7e320ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:56.233994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cd125-ce5b-4868-84d4-609ea7e320ae tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:56.412314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327aeda-0340-49c7-b624-e5b93e73ddf6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:56.413054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327aeda-0340-49c7-b624-e5b93e73ddf6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:56.413339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327aeda-0340-49c7-b624-e5b93e73ddf6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:56.413618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327aeda-0340-49c7-b624-e5b93e73ddf6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/b4ca18bffcac46509170f4a918f1f753` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:56.439474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327aeda-0340-49c7-b624-e5b93e73ddf6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b4ca18bffcac46509170f4a918f1f753)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:56.439474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327aeda-0340-49c7-b624-e5b93e73ddf6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:56.652144 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2730/5435] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:09:56 2022] DELETE /identity/v3/groups/b4ca18bffcac46509170f4a918f1f753 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:56.657107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b72c-452e-41d9-b48d-5a554407fc68 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:56.703577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b72c-452e-41d9-b48d-5a554407fc68 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:57.005113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe31e-23aa-405d-bcbd-7e549ef54944 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:57.005783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe31e-23aa-405d-bcbd-7e549ef54944 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:57.006070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe31e-23aa-405d-bcbd-7e549ef54944 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:57.006348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe31e-23aa-405d-bcbd-7e549ef54944 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/9768728833a8409681f6d1b6582f33f8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:57.019896 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:57.038187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fe31e-23aa-405d-bcbd-7e549ef54944 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9768728833a8409681f6d1b6582f33f8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:57.040165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fe31e-23aa-405d-bcbd-7e549ef54944 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:57.235212 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2706/5436] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:09:56 2022] DELETE /identity/v3/groups/9768728833a8409681f6d1b6582f33f8 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:57.236528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327aeda-0340-49c7-b624-e5b93e73ddf6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:57.249602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327aeda-0340-49c7-b624-e5b93e73ddf6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:57.510869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e577e-e9c3-4415-bff2-037ac0c13d72 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:57.540862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e577e-e9c3-4415-bff2-037ac0c13d72 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:57.541167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e577e-e9c3-4415-bff2-037ac0c13d72 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:57.542461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e577e-e9c3-4415-bff2-037ac0c13d72 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:57.544054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e577e-e9c3-4415-bff2-037ac0c13d72 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:57.551318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e577e-e9c3-4415-bff2-037ac0c13d72 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:57.577459 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:57.619319 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2731/5437] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:09:57 2022] POST /identity/v3/users => generated 323 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:57.620367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe31e-23aa-405d-bcbd-7e549ef54944 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:57.642407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fe31e-23aa-405d-bcbd-7e549ef54944 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:57.651361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872583d7-18fd-49b5-8131-d2a808998aad tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:57.652233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872583d7-18fd-49b5-8131-d2a808998aad tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:57.653674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872583d7-18fd-49b5-8131-d2a808998aad tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:57.654114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872583d7-18fd-49b5-8131-d2a808998aad tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:57.655486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872583d7-18fd-49b5-8131-d2a808998aad tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:57.659480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872583d7-18fd-49b5-8131-d2a808998aad tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:57.709884 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2707/5438] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:09:57 2022] POST /identity/v3/groups => generated 327 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:09:57.714431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e577e-e9c3-4415-bff2-037ac0c13d72 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:57.735499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e577e-e9c3-4415-bff2-037ac0c13d72 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:57.749336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a9564-2234-49c1-85ec-e2a8bc1e1613 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:57.750174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a9564-2234-49c1-85ec-e2a8bc1e1613 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:57.750332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a9564-2234-49c1-85ec-e2a8bc1e1613 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:57.750619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a9564-2234-49c1-85ec-e2a8bc1e1613 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/68a32fdd845e46ef90125292a87d207d/users/60432a0d62fe450fa28c2d27f9f8ffa5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:57.822871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a9564-2234-49c1-85ec-e2a8bc1e1613 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=68a32fdd845e46ef90125292a87d207d, user_id=60432a0d62fe450fa28c2d27f9f8ffa5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:57.827725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a9564-2234-49c1-85ec-e2a8bc1e1613 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:57.890971 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2732/5439] 10.222.0.27 () {60 vars in 1360 bytes} [Wed Oct 19 01:09:57 2022] PUT /identity/v3/groups/68a32fdd845e46ef90125292a87d207d/users/60432a0d62fe450fa28c2d27f9f8ffa5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:57.895020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872583d7-18fd-49b5-8131-d2a808998aad tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:57.919314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872583d7-18fd-49b5-8131-d2a808998aad tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:58.137270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4587bb3-1087-4d3b-9c34-41638dfe2211 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:58.140156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4587bb3-1087-4d3b-9c34-41638dfe2211 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:58.141922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4587bb3-1087-4d3b-9c34-41638dfe2211 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:58.143221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4587bb3-1087-4d3b-9c34-41638dfe2211 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:58.144120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4587bb3-1087-4d3b-9c34-41638dfe2211 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:58.177119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4587bb3-1087-4d3b-9c34-41638dfe2211 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:58.256904 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2708/5440] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:09:57 2022] POST /identity/v3/groups => generated 327 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:09:58.260243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a9564-2234-49c1-85ec-e2a8bc1e1613 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:58.296142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a9564-2234-49c1-85ec-e2a8bc1e1613 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:58.336045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0793c-5ce1-4bd8-a14f-a8727216ea19 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:58.343797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0793c-5ce1-4bd8-a14f-a8727216ea19 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:58.348246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0793c-5ce1-4bd8-a14f-a8727216ea19 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:58.348681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0793c-5ce1-4bd8-a14f-a8727216ea19 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/44dc4a6f632247289034fec4eb5037bf/users/60432a0d62fe450fa28c2d27f9f8ffa5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:58.424863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0793c-5ce1-4bd8-a14f-a8727216ea19 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=44dc4a6f632247289034fec4eb5037bf, user_id=60432a0d62fe450fa28c2d27f9f8ffa5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:58.426829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0793c-5ce1-4bd8-a14f-a8727216ea19 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:58.530050 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2733/5441] 10.222.0.27 () {60 vars in 1360 bytes} [Wed Oct 19 01:09:58 2022] PUT /identity/v3/groups/44dc4a6f632247289034fec4eb5037bf/users/60432a0d62fe450fa28c2d27f9f8ffa5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:58.533917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4587bb3-1087-4d3b-9c34-41638dfe2211 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:58.546248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4587bb3-1087-4d3b-9c34-41638dfe2211 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:58.737378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e2a10-3183-4f16-9bc8-0c287dcfe54a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:58.738766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e2a10-3183-4f16-9bc8-0c287dcfe54a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:58.739370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e2a10-3183-4f16-9bc8-0c287dcfe54a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:58.739825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e2a10-3183-4f16-9bc8-0c287dcfe54a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/users/60432a0d62fe450fa28c2d27f9f8ffa5/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:58.741451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e2a10-3183-4f16-9bc8-0c287dcfe54a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=60432a0d62fe450fa28c2d27f9f8ffa5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:58.745617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e2a10-3183-4f16-9bc8-0c287dcfe54a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:58.789883 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2709/5442] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:09:58 2022] GET /identity/v3/users/60432a0d62fe450fa28c2d27f9f8ffa5/groups => generated 840 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:09:58.793814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0793c-5ce1-4bd8-a14f-a8727216ea19 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:58.809461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0793c-5ce1-4bd8-a14f-a8727216ea19 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:58.821617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc7b74-2db5-453c-82ec-152d7a1210b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:58.831989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc7b74-2db5-453c-82ec-152d7a1210b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:58.832559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc7b74-2db5-453c-82ec-152d7a1210b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:58.833028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc7b74-2db5-453c-82ec-152d7a1210b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/44dc4a6f632247289034fec4eb5037bf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:58.842290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc7b74-2db5-453c-82ec-152d7a1210b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_group(group_id=44dc4a6f632247289034fec4eb5037bf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:58.845260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc7b74-2db5-453c-82ec-152d7a1210b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:58.956852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e2a10-3183-4f16-9bc8-0c287dcfe54a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:58.957439 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2734/5443] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:09:58 2022] DELETE /identity/v3/groups/44dc4a6f632247289034fec4eb5037bf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:58.970082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e2a10-3183-4f16-9bc8-0c287dcfe54a tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:59.004855 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:59.078502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c212d-abad-4dd6-9346-11b187de641c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:59.080019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c212d-abad-4dd6-9346-11b187de641c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:59.081033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c212d-abad-4dd6-9346-11b187de641c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:59.081696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c212d-abad-4dd6-9346-11b187de641c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/groups/68a32fdd845e46ef90125292a87d207d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:59.083776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c212d-abad-4dd6-9346-11b187de641c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_group(group_id=68a32fdd845e46ef90125292a87d207d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:59.088156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c212d-abad-4dd6-9346-11b187de641c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:59.214321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc7b74-2db5-453c-82ec-152d7a1210b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:59.221147 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2710/5444] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:09:58 2022] DELETE /identity/v3/groups/68a32fdd845e46ef90125292a87d207d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:59.229724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc7b74-2db5-453c-82ec-152d7a1210b6 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:59.385592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:59.386502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:59.386866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:59.387184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/users/60432a0d62fe450fa28c2d27f9f8ffa5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:59.396865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_user(user_id=60432a0d62fe450fa28c2d27f9f8ffa5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:59.402153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:59.519801 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:59.549713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60432a0d62fe450fa28c2d27f9f8ffa5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:59.581903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60432a0d62fe450fa28c2d27f9f8ffa5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:59.601468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60432a0d62fe450fa28c2d27f9f8ffa5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:59.620685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60432a0d62fe450fa28c2d27f9f8ffa5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:59.621574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60432a0d62fe450fa28c2d27f9f8ffa5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:59.640769 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2735/5445] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:09:59 2022] DELETE /identity/v3/users/60432a0d62fe450fa28c2d27f9f8ffa5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:09:59.645958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c212d-abad-4dd6-9346-11b187de641c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:09:59.648201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-034c212d-abad-4dd6-9346-11b187de641c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:09:59.679704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c212d-abad-4dd6-9346-11b187de641c tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:09:59.842125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:09:59.842900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:09:59.843353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:09:59.843783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/domains/fc06bab9c31044cf9dba38fcf1a36795` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:09:59.847824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fc06bab9c31044cf9dba38fcf1a36795)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:09:59.852026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:09:59.931227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:09:59.934071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.014404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.015997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.022709 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2711/5446] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:09:59 2022] PATCH /identity/v3/domains/fc06bab9c31044cf9dba38fcf1a36795 => generated 277 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:00.024012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:00.047788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca04b-103d-4226-82d2-28a171bb089f tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:00.240362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '249c8b2c61524c4e8053e302f89bbbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef4e81d833246da95a17a5e09c2e3e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:00.241098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:00.241582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:00.241688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] PATH_INFO: `/v3/domains/fc06bab9c31044cf9dba38fcf1a36795` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:00.267908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fc06bab9c31044cf9dba38fcf1a36795)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:00.271648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:00.360042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.420676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.634341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795', 'request_id': 'req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.694937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795', 'request_id': 'req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.714352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795', 'request_id': 'req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.763658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] The token cache is being invalidate because project fc06bab9c31044cf9dba38fcf1a36795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:00.766113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.776081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.829767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795', 'request_id': 'req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.836658 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:00.849073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795', 'request_id': 'req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.850182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fc06bab9c31044cf9dba38fcf1a36795', 'request_id': 'req-0a2d5d92-8201-41c2-b4db-bfa7b1fa8d81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:00.866566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2736/5447] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:10:00 2022] DELETE /identity/v3/domains/fc06bab9c31044cf9dba38fcf1a36795 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:00.871151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:00.874357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:00.977975 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:01.018392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2012fc-30a3-400f-877b-08c9ceb9e372 tempest-GroupsV3TestJSON-1588718686 tempest-GroupsV3TestJSON-1588718686-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:01.174598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:01.176468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:01.197287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:01.197727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] PATH_INFO: `/v3/users/6d36ede8e2224948814bcc24eb1f00b8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:01.199495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d36ede8e2224948814bcc24eb1f00b8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:01.202226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:01.348185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d36ede8e2224948814bcc24eb1f00b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:01.378451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d36ede8e2224948814bcc24eb1f00b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:01.391075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d36ede8e2224948814bcc24eb1f00b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:01.410416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d36ede8e2224948814bcc24eb1f00b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:01.411981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d36ede8e2224948814bcc24eb1f00b8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:01.432430 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2712/5448] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:00 2022] DELETE /identity/v3/users/6d36ede8e2224948814bcc24eb1f00b8 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:01.435410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bfd5f-d714-481c-af9e-7a3adb4db78f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:01.436468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bfd5f-d714-481c-af9e-7a3adb4db78f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:01.437174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bfd5f-d714-481c-af9e-7a3adb4db78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:01.497413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1b4bfd5f-d714-481c-af9e-7a3adb4db78f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:01.511768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b4bfd5f-d714-481c-af9e-7a3adb4db78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:01.754423 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2737/5449] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:01.766113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:01.768449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:01.917263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb389-7017-460f-8aa4-fa5f6b1ab223 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:01.927496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e304ddd-760a-4214-aba1-53a5ff3e4fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:01.938436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304ddd-760a-4214-aba1-53a5ff3e4fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:01.938436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304ddd-760a-4214-aba1-53a5ff3e4fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:01.938436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304ddd-760a-4214-aba1-53a5ff3e4fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:01.951712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e304ddd-760a-4214-aba1-53a5ff3e4fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:01.953383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e304ddd-760a-4214-aba1-53a5ff3e4fd7 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:01.968768 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2713/5450] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:02.908115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bfd5f-d714-481c-af9e-7a3adb4db78f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:02.912535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b4bfd5f-d714-481c-af9e-7a3adb4db78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:02.988968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bfd5f-d714-481c-af9e-7a3adb4db78f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:03.009701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:03.016400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:03.017105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:03.019310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] PATH_INFO: `/v3/projects/cac652b1b75a48b1833d316c6c4d942c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:03.026846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac652b1b75a48b1833d316c6c4d942c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:03.038252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:03.195071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac652b1b75a48b1833d316c6c4d942c', 'request_id': 'req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.209734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac652b1b75a48b1833d316c6c4d942c', 'request_id': 'req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.226639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac652b1b75a48b1833d316c6c4d942c', 'request_id': 'req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.262239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] The token cache is being invalidate because project cac652b1b75a48b1833d316c6c4d942c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:03.262541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.276497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.283287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e304ddd-760a-4214-aba1-53a5ff3e4fd7 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:03.288377 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2738/5451] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:02 2022] DELETE /identity/v3/projects/cac652b1b75a48b1833d316c6c4d942c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:03.311310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e304ddd-760a-4214-aba1-53a5ff3e4fd7 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:03.335030 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:03.448219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:03.448835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:03.449124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:03.449442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] PATH_INFO: `/v3/users/249c8b2c61524c4e8053e302f89bbbbf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:03.453799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] RBAC: Authorizing `identity:delete_user(user_id=249c8b2c61524c4e8053e302f89bbbbf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:03.456295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:03.556118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249c8b2c61524c4e8053e302f89bbbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.594528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249c8b2c61524c4e8053e302f89bbbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.608953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249c8b2c61524c4e8053e302f89bbbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.624343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249c8b2c61524c4e8053e302f89bbbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.625312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b54191a-b698-4f83-a00b-ec1465dd819a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249c8b2c61524c4e8053e302f89bbbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:03.644846 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2714/5452] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:03 2022] DELETE /identity/v3/users/249c8b2c61524c4e8053e302f89bbbbf => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:05.528456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:05.531304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:05.560120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18274fe-d9d2-4f65-be7b-e8faaa5e7821 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:05.709441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:05.710917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:05.711575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:05.712033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] PATH_INFO: `/v3/projects/6ef4e81d833246da95a17a5e09c2e3e4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:05.713556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef4e81d833246da95a17a5e09c2e3e4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:05.717831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:05.783270 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:05.858647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef4e81d833246da95a17a5e09c2e3e4', 'request_id': 'req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:05.876328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef4e81d833246da95a17a5e09c2e3e4', 'request_id': 'req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:05.903265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef4e81d833246da95a17a5e09c2e3e4', 'request_id': 'req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:05.929646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] The token cache is being invalidate because project 6ef4e81d833246da95a17a5e09c2e3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:05.930043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:05.930829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1e3a6a1-a13a-4528-95f0-69da2a0a9218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:05.944911 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2739/5453] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:05 2022] DELETE /identity/v3/projects/6ef4e81d833246da95a17a5e09c2e3e4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:05.950111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7343-169c-4d36-b5c6-600b0529ff3a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:05.950986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7343-169c-4d36-b5c6-600b0529ff3a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:05.951512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7343-169c-4d36-b5c6-600b0529ff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:05.978613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bbbe7343-169c-4d36-b5c6-600b0529ff3a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:05.980357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bbbe7343-169c-4d36-b5c6-600b0529ff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:06.208960 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2715/5454] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:06.219043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a24e3-6be2-4f53-800b-e984be6fc884 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:06.219564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a24e3-6be2-4f53-800b-e984be6fc884 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:06.220238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a24e3-6be2-4f53-800b-e984be6fc884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:06.256493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-db2a24e3-6be2-4f53-800b-e984be6fc884 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:06.258456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db2a24e3-6be2-4f53-800b-e984be6fc884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:06.269418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2740/5455] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:06.273330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7343-169c-4d36-b5c6-600b0529ff3a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:06.291717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7343-169c-4d36-b5c6-600b0529ff3a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:06.298546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc134bc-7a3c-4938-a8a2-b457b5463f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:06.299616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc134bc-7a3c-4938-a8a2-b457b5463f20 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:06.299904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc134bc-7a3c-4938-a8a2-b457b5463f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:06.300185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc134bc-7a3c-4938-a8a2-b457b5463f20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:06.300926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc134bc-7a3c-4938-a8a2-b457b5463f20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:06.301307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc134bc-7a3c-4938-a8a2-b457b5463f20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:06.303127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc134bc-7a3c-4938-a8a2-b457b5463f20 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:06.325852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a24e3-6be2-4f53-800b-e984be6fc884 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:06.326778 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2716/5456] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:10:06.354055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a24e3-6be2-4f53-800b-e984be6fc884 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:06.376554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f11c-f944-42b4-924b-542f75e1e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:06.380031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f11c-f944-42b4-924b-542f75e1e539 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:06.380324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f11c-f944-42b4-924b-542f75e1e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:06.380602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f11c-f944-42b4-924b-542f75e1e539 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:06.383535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521f11c-f944-42b4-924b-542f75e1e539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:06.394335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521f11c-f944-42b4-924b-542f75e1e539 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:06.469507 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2741/5457] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:06 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:06.473908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc134bc-7a3c-4938-a8a2-b457b5463f20 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:06.489572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc134bc-7a3c-4938-a8a2-b457b5463f20 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:06.541262 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:06.601269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61058e5-838b-42b7-bc77-0e6fd3d89f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:06.601982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61058e5-838b-42b7-bc77-0e6fd3d89f70 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:06.602266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61058e5-838b-42b7-bc77-0e6fd3d89f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:06.602668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61058e5-838b-42b7-bc77-0e6fd3d89f70 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:06.603312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61058e5-838b-42b7-bc77-0e6fd3d89f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:06.605785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61058e5-838b-42b7-bc77-0e6fd3d89f70 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:06.641966 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2717/5458] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:06 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:06.645644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f11c-f944-42b4-924b-542f75e1e539 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:06.664196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f11c-f944-42b4-924b-542f75e1e539 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:06.670698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99894eb1-e84c-4c0f-a90a-4a7c21830d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:06.671639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99894eb1-e84c-4c0f-a90a-4a7c21830d77 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:06.672101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99894eb1-e84c-4c0f-a90a-4a7c21830d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:06.672542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99894eb1-e84c-4c0f-a90a-4a7c21830d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:06.673390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99894eb1-e84c-4c0f-a90a-4a7c21830d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:06.676370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99894eb1-e84c-4c0f-a90a-4a7c21830d77 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:06.694763 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2742/5459] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:10:06.698415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61058e5-838b-42b7-bc77-0e6fd3d89f70 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:06.713750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61058e5-838b-42b7-bc77-0e6fd3d89f70 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:06.730714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec226f-3abb-490c-bb72-8484a180b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:06.733035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec226f-3abb-490c-bb72-8484a180b302 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:06.733347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec226f-3abb-490c-bb72-8484a180b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:06.733624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec226f-3abb-490c-bb72-8484a180b302 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:06.734628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec226f-3abb-490c-bb72-8484a180b302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:06.737344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec226f-3abb-490c-bb72-8484a180b302 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:06.763027 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2718/5460] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:06.767109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99894eb1-e84c-4c0f-a90a-4a7c21830d77 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:06.783030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99894eb1-e84c-4c0f-a90a-4a7c21830d77 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:06.788698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b9fb1-9d9d-4101-a773-9b9a207a1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:06.789470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b9fb1-9d9d-4101-a773-9b9a207a1b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:06.789622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b9fb1-9d9d-4101-a773-9b9a207a1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:06.789955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b9fb1-9d9d-4101-a773-9b9a207a1b4a admin admin] PATH_INFO: `/v3/projects/5f2388e9be5640a181fe874e1d03aae4/users/33306bfdbcb04821a4e5512ea85e8887/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:06.819724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b9fb1-9d9d-4101-a773-9b9a207a1b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2388e9be5640a181fe874e1d03aae4, user_id=33306bfdbcb04821a4e5512ea85e8887, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:06.822927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b9fb1-9d9d-4101-a773-9b9a207a1b4a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:06.866280 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2743/5461] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:06 2022] PUT /identity/v3/projects/5f2388e9be5640a181fe874e1d03aae4/users/33306bfdbcb04821a4e5512ea85e8887/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:06.868537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39820-b3b5-4687-ab7e-1506a68d91cb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:06.868870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39820-b3b5-4687-ab7e-1506a68d91cb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:06.869160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39820-b3b5-4687-ab7e-1506a68d91cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:06.924534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-91d39820-b3b5-4687-ab7e-1506a68d91cb None None] MFA Rules not processed for user `33306bfdbcb04821a4e5512ea85e8887`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:06.925922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-91d39820-b3b5-4687-ab7e-1506a68d91cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:07.053228 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2719/5462] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:07.054825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b9fb1-9d9d-4101-a773-9b9a207a1b4a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:07.184703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b9fb1-9d9d-4101-a773-9b9a207a1b4a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:07.192107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b44dd-201c-410c-bf1d-a03ee3961641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:07.192921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b44dd-201c-410c-bf1d-a03ee3961641 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:07.193707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b44dd-201c-410c-bf1d-a03ee3961641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:07.193987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b44dd-201c-410c-bf1d-a03ee3961641 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:07.195120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b44dd-201c-410c-bf1d-a03ee3961641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:07.204973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b44dd-201c-410c-bf1d-a03ee3961641 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:07.247346 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2744/5463] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:07 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:07.251782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39820-b3b5-4687-ab7e-1506a68d91cb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:07.278431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39820-b3b5-4687-ab7e-1506a68d91cb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:07.535134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fec727-e67e-4ed5-b369-2672e5734527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:07.535773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fec727-e67e-4ed5-b369-2672e5734527 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:07.536058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fec727-e67e-4ed5-b369-2672e5734527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:07.536334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fec727-e67e-4ed5-b369-2672e5734527 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:07.537012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fec727-e67e-4ed5-b369-2672e5734527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:07.539036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fec727-e67e-4ed5-b369-2672e5734527 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:07.588500 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2720/5464] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:07 2022] POST /identity/v3/users => generated 295 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:07.589482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b44dd-201c-410c-bf1d-a03ee3961641 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:07.618836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b44dd-201c-410c-bf1d-a03ee3961641 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:07.639171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916de44-a589-473d-9fa4-e64ee975ef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:07.640088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916de44-a589-473d-9fa4-e64ee975ef3f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:07.640927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916de44-a589-473d-9fa4-e64ee975ef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:07.641583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916de44-a589-473d-9fa4-e64ee975ef3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:07.642427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916de44-a589-473d-9fa4-e64ee975ef3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:07.645118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916de44-a589-473d-9fa4-e64ee975ef3f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:07.677625 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2745/5465] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:07.682390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fec727-e67e-4ed5-b369-2672e5734527 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:07.695470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fec727-e67e-4ed5-b369-2672e5734527 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:07.703108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca835d7-4174-4b15-8394-458942e3ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:07.703857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca835d7-4174-4b15-8394-458942e3ae97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:07.704736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca835d7-4174-4b15-8394-458942e3ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:07.705202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca835d7-4174-4b15-8394-458942e3ae97 admin admin] PATH_INFO: `/v3/projects/9295a812c75e47d383d5598458753552/users/1b4806ec552e477f8e47e732da8a7986/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:07.757692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca835d7-4174-4b15-8394-458942e3ae97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9295a812c75e47d383d5598458753552, user_id=1b4806ec552e477f8e47e732da8a7986, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:07.766176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca835d7-4174-4b15-8394-458942e3ae97 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:07.783177 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:07.796305 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2721/5466] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:07 2022] PUT /identity/v3/projects/9295a812c75e47d383d5598458753552/users/1b4806ec552e477f8e47e732da8a7986/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:07.801358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916de44-a589-473d-9fa4-e64ee975ef3f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:07.820605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916de44-a589-473d-9fa4-e64ee975ef3f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:07.839647 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:07.954731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00f5a5-1095-422b-85e0-599eb981ffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:07.955590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00f5a5-1095-422b-85e0-599eb981ffb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:07.956014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00f5a5-1095-422b-85e0-599eb981ffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:07.956444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00f5a5-1095-422b-85e0-599eb981ffb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:07.957717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00f5a5-1095-422b-85e0-599eb981ffb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:07.963393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00f5a5-1095-422b-85e0-599eb981ffb3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:08.000084 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2746/5467] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:08.004491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca835d7-4174-4b15-8394-458942e3ae97 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:08.025091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca835d7-4174-4b15-8394-458942e3ae97 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:08.044597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbdd02-4913-4e29-a005-f910ff6c405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:08.048443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbdd02-4913-4e29-a005-f910ff6c405d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:08.048888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbdd02-4913-4e29-a005-f910ff6c405d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:08.055045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbdd02-4913-4e29-a005-f910ff6c405d admin admin] PATH_INFO: `/v3/projects/9295a812c75e47d383d5598458753552/users/1b4806ec552e477f8e47e732da8a7986/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:08.065632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbdd02-4913-4e29-a005-f910ff6c405d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9295a812c75e47d383d5598458753552, user_id=1b4806ec552e477f8e47e732da8a7986, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:08.068484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbdd02-4913-4e29-a005-f910ff6c405d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:08.088680 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2722/5468] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:08 2022] PUT /identity/v3/projects/9295a812c75e47d383d5598458753552/users/1b4806ec552e477f8e47e732da8a7986/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:08.099507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39680f03-4b84-4708-b2c1-4d73d1a86580 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:08.099792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39680f03-4b84-4708-b2c1-4d73d1a86580 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:08.100071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39680f03-4b84-4708-b2c1-4d73d1a86580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:08.153912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-39680f03-4b84-4708-b2c1-4d73d1a86580 None None] MFA Rules not processed for user `1b4806ec552e477f8e47e732da8a7986`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:08.155352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-39680f03-4b84-4708-b2c1-4d73d1a86580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:08.310952 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2747/5469] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:08.312661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbdd02-4913-4e29-a005-f910ff6c405d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:08.327508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbdd02-4913-4e29-a005-f910ff6c405d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:08.343689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b08521-7ec5-4716-8df1-64388e7d6725 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4806ec552e477f8e47e732da8a7986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9295a812c75e47d383d5598458753552', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:08.344318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b08521-7ec5-4716-8df1-64388e7d6725 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:08.344962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b08521-7ec5-4716-8df1-64388e7d6725 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:08.345502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b08521-7ec5-4716-8df1-64388e7d6725 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:08.346286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b08521-7ec5-4716-8df1-64388e7d6725 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:08.348388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b08521-7ec5-4716-8df1-64388e7d6725 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:08.413947 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2723/5470] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:08 2022] POST /identity/v3/projects => generated 334 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:08.421412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39680f03-4b84-4708-b2c1-4d73d1a86580 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:08.450027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39680f03-4b84-4708-b2c1-4d73d1a86580 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:08.615380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85585f-e6d0-4867-ad1c-52b6047c1fa7 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4806ec552e477f8e47e732da8a7986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9295a812c75e47d383d5598458753552', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:08.616031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85585f-e6d0-4867-ad1c-52b6047c1fa7 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:08.616316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85585f-e6d0-4867-ad1c-52b6047c1fa7 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:08.616596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85585f-e6d0-4867-ad1c-52b6047c1fa7 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:08.617982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85585f-e6d0-4867-ad1c-52b6047c1fa7 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:08.620252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85585f-e6d0-4867-ad1c-52b6047c1fa7 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:08.686911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b08521-7ec5-4716-8df1-64388e7d6725 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:08.694696 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2748/5471] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:10:08 2022] POST /identity/v3/projects => generated 333 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:08.699488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b08521-7ec5-4716-8df1-64388e7d6725 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:08.865461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adc28a-744d-4a66-bae7-78f62c2f53e4 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4806ec552e477f8e47e732da8a7986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9295a812c75e47d383d5598458753552', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:08.865675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc28a-744d-4a66-bae7-78f62c2f53e4 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:08.866066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc28a-744d-4a66-bae7-78f62c2f53e4 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:08.866451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc28a-744d-4a66-bae7-78f62c2f53e4 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:08.867380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adc28a-744d-4a66-bae7-78f62c2f53e4 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:08.869495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adc28a-744d-4a66-bae7-78f62c2f53e4 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:08.967705 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2724/5472] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:08 2022] POST /identity/v3/projects => generated 358 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:08.968124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85585f-e6d0-4867-ad1c-52b6047c1fa7 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:08.981855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85585f-e6d0-4867-ad1c-52b6047c1fa7 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:09.005833 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:09.099230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b94c7-baa1-46fa-bed3-1a942b73961c tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4806ec552e477f8e47e732da8a7986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9295a812c75e47d383d5598458753552', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:09.099963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b94c7-baa1-46fa-bed3-1a942b73961c tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:09.100317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b94c7-baa1-46fa-bed3-1a942b73961c tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:09.100732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b94c7-baa1-46fa-bed3-1a942b73961c tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:09.101600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b94c7-baa1-46fa-bed3-1a942b73961c tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:09.103736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b94c7-baa1-46fa-bed3-1a942b73961c tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:09.145740 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2749/5473] 10.222.0.27 () {58 vars in 1131 bytes} [Wed Oct 19 01:10:08 2022] GET /identity/v3/projects => generated 7926 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:09.152702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adc28a-744d-4a66-bae7-78f62c2f53e4 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:09.166336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adc28a-744d-4a66-bae7-78f62c2f53e4 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:09.173523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289bc2a-f0b6-40eb-bc14-ba0835d1695f tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4806ec552e477f8e47e732da8a7986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9295a812c75e47d383d5598458753552', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:09.175379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289bc2a-f0b6-40eb-bc14-ba0835d1695f tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:09.175883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289bc2a-f0b6-40eb-bc14-ba0835d1695f tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:09.176402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289bc2a-f0b6-40eb-bc14-ba0835d1695f tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:09.177897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289bc2a-f0b6-40eb-bc14-ba0835d1695f tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:09.178963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289bc2a-f0b6-40eb-bc14-ba0835d1695f tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:09.181773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289bc2a-f0b6-40eb-bc14-ba0835d1695f tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:09.208516 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2725/5474] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 01:10:09 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:09.209360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b94c7-baa1-46fa-bed3-1a942b73961c tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:09.225982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b94c7-baa1-46fa-bed3-1a942b73961c tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:09.242843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4806ec552e477f8e47e732da8a7986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9295a812c75e47d383d5598458753552', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:09.243626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:09.244438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:09.244438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:09.245259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Adding query filter params (parent_id=bf00f8adf0954e9c9aa22df7a83834ee) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:09.245667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:09.248447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:09.300157 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2750/5475] 10.222.0.27 () {58 vars in 1216 bytes} [Wed Oct 19 01:10:09 2022] GET /identity/v3/projects?parent_id=bf00f8adf0954e9c9aa22df7a83834ee => generated 498 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:10:09.305721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289bc2a-f0b6-40eb-bc14-ba0835d1695f tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:09.322005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289bc2a-f0b6-40eb-bc14-ba0835d1695f tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:09.346485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4806ec552e477f8e47e732da8a7986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9295a812c75e47d383d5598458753552', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:09.347161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:09.347697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:09.348144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] PATH_INFO: `/v3/projects/8f07b1186d504d458b8a3395e56e9f12` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:09.352825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f07b1186d504d458b8a3395e56e9f12)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:09.355982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:09.454360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f07b1186d504d458b8a3395e56e9f12', 'request_id': 'req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.471040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f07b1186d504d458b8a3395e56e9f12', 'request_id': 'req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.480476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f07b1186d504d458b8a3395e56e9f12', 'request_id': 'req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.496011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] The token cache is being invalidate because project 8f07b1186d504d458b8a3395e56e9f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:09.496309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.497332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.500209 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2726/5476] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:09 2022] DELETE /identity/v3/projects/8f07b1186d504d458b8a3395e56e9f12 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:09.504746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:09.506879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:09.527601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4461-a00a-4a84-a4a1-b2b428fd243e tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:09.629866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4806ec552e477f8e47e732da8a7986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9295a812c75e47d383d5598458753552', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:09.630816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:09.631232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:09.631670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] PATH_INFO: `/v3/projects/bf00f8adf0954e9c9aa22df7a83834ee` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:09.633515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf00f8adf0954e9c9aa22df7a83834ee)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:09.635431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:09.769212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf00f8adf0954e9c9aa22df7a83834ee', 'request_id': 'req-7c3c9f3a-193d-43b6-8427-99559a7196ea'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.797692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf00f8adf0954e9c9aa22df7a83834ee', 'request_id': 'req-7c3c9f3a-193d-43b6-8427-99559a7196ea'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.808688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf00f8adf0954e9c9aa22df7a83834ee', 'request_id': 'req-7c3c9f3a-193d-43b6-8427-99559a7196ea'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.829822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] The token cache is being invalidate because project bf00f8adf0954e9c9aa22df7a83834ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:09.831159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.832545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:09.835803 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2751/5477] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:09 2022] DELETE /identity/v3/projects/bf00f8adf0954e9c9aa22df7a83834ee => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:09.839729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:09.853268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff42c81-d80c-4bfe-a9e3-90de52d3beb5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:09.871789 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:09.995903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4806ec552e477f8e47e732da8a7986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9295a812c75e47d383d5598458753552', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:09.996968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:09.997499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:09.999041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] PATH_INFO: `/v3/projects/17143f11c6a146f79bcf7867220b93f0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:10.001264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17143f11c6a146f79bcf7867220b93f0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:10.006192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:10.123772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17143f11c6a146f79bcf7867220b93f0', 'request_id': 'req-a23b2d52-7984-4c95-8aad-e2e2272e14f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.142393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17143f11c6a146f79bcf7867220b93f0', 'request_id': 'req-a23b2d52-7984-4c95-8aad-e2e2272e14f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.150620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17143f11c6a146f79bcf7867220b93f0', 'request_id': 'req-a23b2d52-7984-4c95-8aad-e2e2272e14f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.179694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] The token cache is being invalidate because project 17143f11c6a146f79bcf7867220b93f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:10.180288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.181041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a23b2d52-7984-4c95-8aad-e2e2272e14f5 tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.189239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2727/5478] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:09 2022] DELETE /identity/v3/projects/17143f11c6a146f79bcf7867220b93f0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:10.190251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:10.191721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:10.298831 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:10.360691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9f3a-193d-43b6-8427-99559a7196ea tempest-ListProjectsTestJSON-1771023068 tempest-ListProjectsTestJSON-1771023068-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:10.477157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:10.478570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:10.479962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:10.480385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] PATH_INFO: `/v3/users/33306bfdbcb04821a4e5512ea85e8887` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:10.482186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33306bfdbcb04821a4e5512ea85e8887)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:10.485319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:10.643615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33306bfdbcb04821a4e5512ea85e8887'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.659345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33306bfdbcb04821a4e5512ea85e8887'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.672342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33306bfdbcb04821a4e5512ea85e8887'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.690639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33306bfdbcb04821a4e5512ea85e8887'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.692770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33306bfdbcb04821a4e5512ea85e8887'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:10.712706 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2752/5479] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:10 2022] DELETE /identity/v3/users/33306bfdbcb04821a4e5512ea85e8887 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:10.714048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a4237-abe2-4ad9-bd85-e68e3e9883fd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:10.714339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a4237-abe2-4ad9-bd85-e68e3e9883fd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:10.714615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a4237-abe2-4ad9-bd85-e68e3e9883fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:10.753482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7f5a4237-abe2-4ad9-bd85-e68e3e9883fd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:10.755628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f5a4237-abe2-4ad9-bd85-e68e3e9883fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:10.863098 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2728/5480] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:10.877279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:10.878806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:10.972845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347e31-a5c1-43e2-927a-df16354fed74 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:10.979367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b35adc-3ff9-4ee4-804e-816bd0ac1492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:10.980379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b35adc-3ff9-4ee4-804e-816bd0ac1492 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:10.980759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b35adc-3ff9-4ee4-804e-816bd0ac1492 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:10.981066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b35adc-3ff9-4ee4-804e-816bd0ac1492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:10.992893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b35adc-3ff9-4ee4-804e-816bd0ac1492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:11.000466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b35adc-3ff9-4ee4-804e-816bd0ac1492 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:11.026637 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2753/5481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:11.688113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684abe46-0b82-4f1a-bc95-65196975e7d5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:11.688730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684abe46-0b82-4f1a-bc95-65196975e7d5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:11.688730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684abe46-0b82-4f1a-bc95-65196975e7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:11.739064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-684abe46-0b82-4f1a-bc95-65196975e7d5 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:11.740349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-684abe46-0b82-4f1a-bc95-65196975e7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:11.838937 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:11.891063 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2729/5482] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:11.962182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b35adc-3ff9-4ee4-804e-816bd0ac1492 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:11.970480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-84b35adc-3ff9-4ee4-804e-816bd0ac1492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:11.986727 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:12.091899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b35adc-3ff9-4ee4-804e-816bd0ac1492 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:12.097786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5d04-0527-4623-914d-281370c10b8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:12.098581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5d04-0527-4623-914d-281370c10b8b service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:12.099011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5d04-0527-4623-914d-281370c10b8b service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:12.099431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5d04-0527-4623-914d-281370c10b8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:12.120918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba5d04-0527-4623-914d-281370c10b8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:12.122284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba5d04-0527-4623-914d-281370c10b8b service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:12.133307 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2754/5483] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:10:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:10:12.756521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684abe46-0b82-4f1a-bc95-65196975e7d5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:12.761376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-684abe46-0b82-4f1a-bc95-65196975e7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:12.807817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684abe46-0b82-4f1a-bc95-65196975e7d5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:12.824285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:12.829096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:12.829882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:12.835014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] PATH_INFO: `/v3/projects/5f2388e9be5640a181fe874e1d03aae4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:12.843105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2388e9be5640a181fe874e1d03aae4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:12.850217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:12.979142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2388e9be5640a181fe874e1d03aae4', 'request_id': 'req-04c49367-2455-4ffe-aced-f5811ead4b61'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:12.992080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2388e9be5640a181fe874e1d03aae4', 'request_id': 'req-04c49367-2455-4ffe-aced-f5811ead4b61'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:13.001869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2388e9be5640a181fe874e1d03aae4', 'request_id': 'req-04c49367-2455-4ffe-aced-f5811ead4b61'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:13.027733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] The token cache is being invalidate because project 5f2388e9be5640a181fe874e1d03aae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:13.028060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:13.029927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:13.041075 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2730/5484] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:12 2022] DELETE /identity/v3/projects/5f2388e9be5640a181fe874e1d03aae4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:13.043401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5d04-0527-4623-914d-281370c10b8b service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:13.087137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5d04-0527-4623-914d-281370c10b8b service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:13.265659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:13.266401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:13.266750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:13.267091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] PATH_INFO: `/v3/users/1b4806ec552e477f8e47e732da8a7986` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:13.268390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b4806ec552e477f8e47e732da8a7986)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:13.270423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:13.385610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4806ec552e477f8e47e732da8a7986'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:13.420524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4806ec552e477f8e47e732da8a7986'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:13.431511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4806ec552e477f8e47e732da8a7986'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:13.453829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4806ec552e477f8e47e732da8a7986'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:13.454988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a8097c10-e2e2-46e3-8bf8-b746daeaf05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4806ec552e477f8e47e732da8a7986'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:13.483715 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2755/5485] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:13 2022] DELETE /identity/v3/users/1b4806ec552e477f8e47e732da8a7986 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:13.953268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:13.956154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:13.995786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c49367-2455-4ffe-aced-f5811ead4b61 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:14.222826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:14.224952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:14.225237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:14.225514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] PATH_INFO: `/v3/projects/9295a812c75e47d383d5598458753552` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:14.234265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9295a812c75e47d383d5598458753552)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:14.238246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:14.427602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9295a812c75e47d383d5598458753552', 'request_id': 'req-3434f8a4-2751-477e-b64c-c414208151f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:14.455113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9295a812c75e47d383d5598458753552', 'request_id': 'req-3434f8a4-2751-477e-b64c-c414208151f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:14.475967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9295a812c75e47d383d5598458753552', 'request_id': 'req-3434f8a4-2751-477e-b64c-c414208151f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:14.515299 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:14.522382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] The token cache is being invalidate because project 9295a812c75e47d383d5598458753552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:14.522691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:14.531428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3434f8a4-2751-477e-b64c-c414208151f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:14.533943 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2731/5486] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:13 2022] DELETE /identity/v3/projects/9295a812c75e47d383d5598458753552 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:14.539264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49011c-5f5a-4f84-a4d5-3821432b662f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:14.539779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49011c-5f5a-4f84-a4d5-3821432b662f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:14.539855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49011c-5f5a-4f84-a4d5-3821432b662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:14.585633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3d49011c-5f5a-4f84-a4d5-3821432b662f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:14.586961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3d49011c-5f5a-4f84-a4d5-3821432b662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:14.637639 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:14.797887 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2756/5487] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:14.799208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dae644-a147-4642-87e6-d6721c731bb2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:14.799502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dae644-a147-4642-87e6-d6721c731bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:14.799778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dae644-a147-4642-87e6-d6721c731bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:14.837759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-88dae644-a147-4642-87e6-d6721c731bb2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:14.839001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-88dae644-a147-4642-87e6-d6721c731bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:14.862187 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2732/5488] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:10:14.867070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49011c-5f5a-4f84-a4d5-3821432b662f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:14.881630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49011c-5f5a-4f84-a4d5-3821432b662f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:14.898880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605e532-a485-4c3d-9955-da06d29cab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:14.902657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605e532-a485-4c3d-9955-da06d29cab24 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:14.903698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605e532-a485-4c3d-9955-da06d29cab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:14.905343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605e532-a485-4c3d-9955-da06d29cab24 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:14.906310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605e532-a485-4c3d-9955-da06d29cab24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:14.906865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605e532-a485-4c3d-9955-da06d29cab24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:14.911586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605e532-a485-4c3d-9955-da06d29cab24 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:14.959686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dae644-a147-4642-87e6-d6721c731bb2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:14.960498 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2757/5489] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:14.974906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dae644-a147-4642-87e6-d6721c731bb2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:14.989678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad41321-966b-42f5-b17b-d91cd8daeb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:14.990553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41321-966b-42f5-b17b-d91cd8daeb79 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:14.990983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41321-966b-42f5-b17b-d91cd8daeb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:14.991428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41321-966b-42f5-b17b-d91cd8daeb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:14.992214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad41321-966b-42f5-b17b-d91cd8daeb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:14.994164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad41321-966b-42f5-b17b-d91cd8daeb79 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:15.094249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605e532-a485-4c3d-9955-da06d29cab24 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:15.113922 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2733/5490] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:14 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:15.114652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605e532-a485-4c3d-9955-da06d29cab24 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:15.265802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ce613-76c2-49e9-89a9-8d48e86a9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:15.266760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ce613-76c2-49e9-89a9-8d48e86a9011 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:15.267253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ce613-76c2-49e9-89a9-8d48e86a9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:15.267735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ce613-76c2-49e9-89a9-8d48e86a9011 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:15.268716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ce613-76c2-49e9-89a9-8d48e86a9011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:15.271427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ce613-76c2-49e9-89a9-8d48e86a9011 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:15.392249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad41321-966b-42f5-b17b-d91cd8daeb79 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:15.411198 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2758/5491] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:15 2022] POST /identity/v3/users => generated 284 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:15.416231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad41321-966b-42f5-b17b-d91cd8daeb79 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:15.430918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2ec50-9ee9-4151-b84f-cd9fcd536484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:15.431567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2ec50-9ee9-4151-b84f-cd9fcd536484 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:15.432255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2ec50-9ee9-4151-b84f-cd9fcd536484 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:15.432572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2ec50-9ee9-4151-b84f-cd9fcd536484 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:15.435579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2ec50-9ee9-4151-b84f-cd9fcd536484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:15.439810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2ec50-9ee9-4151-b84f-cd9fcd536484 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:15.487488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ce613-76c2-49e9-89a9-8d48e86a9011 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:15.501544 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2734/5492] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:15.503718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ce613-76c2-49e9-89a9-8d48e86a9011 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:15.518116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17f8f2-c4dd-4b00-9151-e61e03353105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:15.520996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17f8f2-c4dd-4b00-9151-e61e03353105 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:15.522722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17f8f2-c4dd-4b00-9151-e61e03353105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:15.523026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17f8f2-c4dd-4b00-9151-e61e03353105 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:15.523717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17f8f2-c4dd-4b00-9151-e61e03353105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:15.528467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17f8f2-c4dd-4b00-9151-e61e03353105 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:15.564700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2ec50-9ee9-4151-b84f-cd9fcd536484 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:15.565564 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2759/5493] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:15.579786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2ec50-9ee9-4151-b84f-cd9fcd536484 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:15.588338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572d26-73cd-431f-949e-338dedea3be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:15.589122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572d26-73cd-431f-949e-338dedea3be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:15.589523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572d26-73cd-431f-949e-338dedea3be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:15.589977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572d26-73cd-431f-949e-338dedea3be9 admin admin] PATH_INFO: `/v3/projects/5316a8dfb3754c709790af0cc2dda8f7/users/822802d0841b4104b6087482cf51c7c5/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:15.617776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7572d26-73cd-431f-949e-338dedea3be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5316a8dfb3754c709790af0cc2dda8f7, user_id=822802d0841b4104b6087482cf51c7c5, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:15.621434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7572d26-73cd-431f-949e-338dedea3be9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:15.656143 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2735/5494] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:15 2022] PUT /identity/v3/projects/5316a8dfb3754c709790af0cc2dda8f7/users/822802d0841b4104b6087482cf51c7c5/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:15.656856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd46a2-ca51-4e3b-b4b0-3281b57f6a3a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:15.657253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd46a2-ca51-4e3b-b4b0-3281b57f6a3a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:15.657784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd46a2-ca51-4e3b-b4b0-3281b57f6a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:15.731605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2dcd46a2-ca51-4e3b-b4b0-3281b57f6a3a None None] MFA Rules not processed for user `822802d0841b4104b6087482cf51c7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:15.733554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2dcd46a2-ca51-4e3b-b4b0-3281b57f6a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:15.988357 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2760/5495] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:15.989941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572d26-73cd-431f-949e-338dedea3be9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:16.197346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572d26-73cd-431f-949e-338dedea3be9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:16.213512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b34c7d-4b94-4128-b2d3-655e86af3474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:16.214584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b34c7d-4b94-4128-b2d3-655e86af3474 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:16.215364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b34c7d-4b94-4128-b2d3-655e86af3474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:16.215916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b34c7d-4b94-4128-b2d3-655e86af3474 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:16.218432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b34c7d-4b94-4128-b2d3-655e86af3474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:16.222700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b34c7d-4b94-4128-b2d3-655e86af3474 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:16.382822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd46a2-ca51-4e3b-b4b0-3281b57f6a3a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:16.384372 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2736/5496] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:15 2022] POST /identity/v3/projects => generated 367 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:16.398613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd46a2-ca51-4e3b-b4b0-3281b57f6a3a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:16.428491 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:16.683155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2826e9-736b-405a-9571-a1eccdc7fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:16.684113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2826e9-736b-405a-9571-a1eccdc7fe3d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:16.684113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2826e9-736b-405a-9571-a1eccdc7fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:16.689440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2826e9-736b-405a-9571-a1eccdc7fe3d admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:16.690173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2826e9-736b-405a-9571-a1eccdc7fe3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:16.692146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2826e9-736b-405a-9571-a1eccdc7fe3d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:16.788341 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2761/5497] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:16 2022] POST /identity/v3/users => generated 290 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:16.792403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b34c7d-4b94-4128-b2d3-655e86af3474 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:16.812075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b34c7d-4b94-4128-b2d3-655e86af3474 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:16.824723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37d1d3-9c1f-4696-956b-9444f7e2d6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:16.825357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37d1d3-9c1f-4696-956b-9444f7e2d6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:16.826227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37d1d3-9c1f-4696-956b-9444f7e2d6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:16.826646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37d1d3-9c1f-4696-956b-9444f7e2d6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:16.827484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37d1d3-9c1f-4696-956b-9444f7e2d6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:16.830579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37d1d3-9c1f-4696-956b-9444f7e2d6a1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:16.855435 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2737/5498] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:16.860384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2826e9-736b-405a-9571-a1eccdc7fe3d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:16.880912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2826e9-736b-405a-9571-a1eccdc7fe3d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:16.890599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c04444-11a8-4a0d-b47e-ec83e9782248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:16.891670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c04444-11a8-4a0d-b47e-ec83e9782248 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:16.892405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c04444-11a8-4a0d-b47e-ec83e9782248 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:16.892872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c04444-11a8-4a0d-b47e-ec83e9782248 admin admin] PATH_INFO: `/v3/projects/355e95b6dce3419092e4a35bcdf9fa4c/users/05c621ce231145de91ea20e49d6d59d7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:16.929371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c04444-11a8-4a0d-b47e-ec83e9782248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355e95b6dce3419092e4a35bcdf9fa4c, user_id=05c621ce231145de91ea20e49d6d59d7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:16.941986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c04444-11a8-4a0d-b47e-ec83e9782248 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:16.975955 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2762/5499] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:16 2022] PUT /identity/v3/projects/355e95b6dce3419092e4a35bcdf9fa4c/users/05c621ce231145de91ea20e49d6d59d7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:16.980147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37d1d3-9c1f-4696-956b-9444f7e2d6a1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:17.005847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37d1d3-9c1f-4696-956b-9444f7e2d6a1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:17.153293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd8b7d-3625-4115-9d8d-6ad842462dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:17.153960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd8b7d-3625-4115-9d8d-6ad842462dec admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:17.154344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd8b7d-3625-4115-9d8d-6ad842462dec admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:17.154834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd8b7d-3625-4115-9d8d-6ad842462dec admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:17.155625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd8b7d-3625-4115-9d8d-6ad842462dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:17.160793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd8b7d-3625-4115-9d8d-6ad842462dec admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:17.190362 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2738/5500] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:17.195097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c04444-11a8-4a0d-b47e-ec83e9782248 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:17.214331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c04444-11a8-4a0d-b47e-ec83e9782248 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:17.245025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc84c-38ef-40a6-a9c3-783f25098637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:17.246025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc84c-38ef-40a6-a9c3-783f25098637 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:17.246505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc84c-38ef-40a6-a9c3-783f25098637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:17.246954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc84c-38ef-40a6-a9c3-783f25098637 admin admin] PATH_INFO: `/v3/projects/355e95b6dce3419092e4a35bcdf9fa4c/users/05c621ce231145de91ea20e49d6d59d7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:17.257480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cc84c-38ef-40a6-a9c3-783f25098637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355e95b6dce3419092e4a35bcdf9fa4c, user_id=05c621ce231145de91ea20e49d6d59d7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:17.260838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cc84c-38ef-40a6-a9c3-783f25098637 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:17.306056 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2763/5501] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:17 2022] PUT /identity/v3/projects/355e95b6dce3419092e4a35bcdf9fa4c/users/05c621ce231145de91ea20e49d6d59d7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:17.317742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd5a26-35b3-4a57-9829-43d83e49f6b9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:17.318289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd5a26-35b3-4a57-9829-43d83e49f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:17.318708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd5a26-35b3-4a57-9829-43d83e49f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:17.343944 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:17.378489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-eafd5a26-35b3-4a57-9829-43d83e49f6b9 None None] MFA Rules not processed for user `05c621ce231145de91ea20e49d6d59d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:17.380019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eafd5a26-35b3-4a57-9829-43d83e49f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:17.655302 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2739/5502] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:17.655744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc84c-38ef-40a6-a9c3-783f25098637 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:17.674025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc84c-38ef-40a6-a9c3-783f25098637 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:17.688590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1398417-e42a-4b00-a469-2f823b1a4c9d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:17.689264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1398417-e42a-4b00-a469-2f823b1a4c9d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:17.689583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1398417-e42a-4b00-a469-2f823b1a4c9d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:17.689803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1398417-e42a-4b00-a469-2f823b1a4c9d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:17.690473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1398417-e42a-4b00-a469-2f823b1a4c9d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:17.692775 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-e1398417-e42a-4b00-a469-2f823b1a4c9d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:10:17.692775 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:10:17.692775 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:10:17.692775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1398417-e42a-4b00-a469-2f823b1a4c9d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:17.807203 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2764/5503] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:10:17 2022] POST /identity/v3/regions => generated 223 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:17.828991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd5a26-35b3-4a57-9829-43d83e49f6b9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:17.844967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd5a26-35b3-4a57-9829-43d83e49f6b9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:17.887878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037733cc-4f58-4738-b577-aeb74afe2f3d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:17.895224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037733cc-4f58-4738-b577-aeb74afe2f3d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:17.895656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037733cc-4f58-4738-b577-aeb74afe2f3d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:17.896935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037733cc-4f58-4738-b577-aeb74afe2f3d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:17.897769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037733cc-4f58-4738-b577-aeb74afe2f3d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:17.906084 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-037733cc-4f58-4738-b577-aeb74afe2f3d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:10:17.906084 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:10:17.906084 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:10:17.907114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037733cc-4f58-4738-b577-aeb74afe2f3d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:17.958057 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2740/5504] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:10:17 2022] POST /identity/v3/regions => generated 224 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:17.962201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1398417-e42a-4b00-a469-2f823b1a4c9d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:17.976999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1398417-e42a-4b00-a469-2f823b1a4c9d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:18.014987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56843506-218e-4752-baf0-67433e179364 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:18.015661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843506-218e-4752-baf0-67433e179364 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:18.015947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843506-218e-4752-baf0-67433e179364 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:18.016308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843506-218e-4752-baf0-67433e179364 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions/a1ed3165-e582-4780-ac8c-b905fca75eff` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:18.017238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56843506-218e-4752-baf0-67433e179364 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:create_region(region_id=a1ed3165-e582-4780-ac8c-b905fca75eff)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:18.020252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56843506-218e-4752-baf0-67433e179364 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:18.099099 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2765/5505] 10.222.0.27 () {60 vars in 1259 bytes} [Wed Oct 19 01:10:17 2022] PUT /identity/v3/regions/a1ed3165-e582-4780-ac8c-b905fca75eff => generated 229 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:18.103594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037733cc-4f58-4738-b577-aeb74afe2f3d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:18.122273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037733cc-4f58-4738-b577-aeb74afe2f3d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:18.162073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca962-2a18-4b7b-88e2-49dc2b7899e6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:18.163103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca962-2a18-4b7b-88e2-49dc2b7899e6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:18.163589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca962-2a18-4b7b-88e2-49dc2b7899e6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:18.164097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca962-2a18-4b7b-88e2-49dc2b7899e6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions/a1ed3165-e582-4780-ac8c-b905fca75eff` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:18.164949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ca962-2a18-4b7b-88e2-49dc2b7899e6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a1ed3165-e582-4780-ac8c-b905fca75eff)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:18.166499 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-657ca962-2a18-4b7b-88e2-49dc2b7899e6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:10:18.166499 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:10:18.166499 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:10:18.168475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ca962-2a18-4b7b-88e2-49dc2b7899e6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:18.249052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56843506-218e-4752-baf0-67433e179364 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:18.265535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56843506-218e-4752-baf0-67433e179364 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:18.267823 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2741/5506] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:10:18 2022] DELETE /identity/v3/regions/a1ed3165-e582-4780-ac8c-b905fca75eff => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:18.304471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576fab4-ff8a-4eee-b725-584f333d597d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:18.305575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576fab4-ff8a-4eee-b725-584f333d597d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:18.306065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576fab4-ff8a-4eee-b725-584f333d597d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:18.312309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576fab4-ff8a-4eee-b725-584f333d597d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:18.314784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576fab4-ff8a-4eee-b725-584f333d597d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:18.319457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576fab4-ff8a-4eee-b725-584f333d597d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:18.358538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2766/5507] 10.222.0.27 () {60 vars in 1150 bytes} [Wed Oct 19 01:10:18 2022] POST /identity/v3/regions => generated 253 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:18.363022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca962-2a18-4b7b-88e2-49dc2b7899e6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:18.379024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca962-2a18-4b7b-88e2-49dc2b7899e6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:18.440915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed736d07-b285-4638-a812-d9519882182b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:18.442643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed736d07-b285-4638-a812-d9519882182b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:18.443204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed736d07-b285-4638-a812-d9519882182b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:18.443692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed736d07-b285-4638-a812-d9519882182b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions/01564334d5c747cc96eb27589206f66a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:18.444858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed736d07-b285-4638-a812-d9519882182b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:update_region(region_id=01564334d5c747cc96eb27589206f66a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:18.453708 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-ed736d07-b285-4638-a812-d9519882182b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:10:18.453708 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:10:18.453708 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:10:18.455293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed736d07-b285-4638-a812-d9519882182b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:18.501041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576fab4-ff8a-4eee-b725-584f333d597d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:18.502693 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2742/5508] 10.222.0.27 () {60 vars in 1250 bytes} [Wed Oct 19 01:10:18 2022] PATCH /identity/v3/regions/01564334d5c747cc96eb27589206f66a => generated 253 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:18.517942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576fab4-ff8a-4eee-b725-584f333d597d tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:18.564883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a21104-3500-487f-8f62-17526b2278dc tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:18.565869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a21104-3500-487f-8f62-17526b2278dc tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:18.566408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a21104-3500-487f-8f62-17526b2278dc tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:18.566905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a21104-3500-487f-8f62-17526b2278dc tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions/01564334d5c747cc96eb27589206f66a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:18.567719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a21104-3500-487f-8f62-17526b2278dc tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:get_region(region_id=01564334d5c747cc96eb27589206f66a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:18.569292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a21104-3500-487f-8f62-17526b2278dc tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:18.587344 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2767/5509] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:10:18 2022] GET /identity/v3/regions/01564334d5c747cc96eb27589206f66a => generated 253 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:10:18.590044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed736d07-b285-4638-a812-d9519882182b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:18.609182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed736d07-b285-4638-a812-d9519882182b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:18.634236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371bab6-f400-40ca-816c-b0f7be5e953b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:18.634904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371bab6-f400-40ca-816c-b0f7be5e953b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:18.635189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371bab6-f400-40ca-816c-b0f7be5e953b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:18.636846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371bab6-f400-40ca-816c-b0f7be5e953b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions/01564334d5c747cc96eb27589206f66a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:18.639666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371bab6-f400-40ca-816c-b0f7be5e953b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:delete_region(region_id=01564334d5c747cc96eb27589206f66a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:18.647849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371bab6-f400-40ca-816c-b0f7be5e953b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:18.696537 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2743/5510] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:10:18 2022] DELETE /identity/v3/regions/01564334d5c747cc96eb27589206f66a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:18.701670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a21104-3500-487f-8f62-17526b2278dc tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:18.755008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a21104-3500-487f-8f62-17526b2278dc tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:18.815907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae3ce6-53b9-4c6f-8c99-0ca86fbda925 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:18.817322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae3ce6-53b9-4c6f-8c99-0ca86fbda925 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:18.818374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae3ce6-53b9-4c6f-8c99-0ca86fbda925 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:18.818927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae3ce6-53b9-4c6f-8c99-0ca86fbda925 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:18.820055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae3ce6-53b9-4c6f-8c99-0ca86fbda925 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:18.821372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae3ce6-53b9-4c6f-8c99-0ca86fbda925 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:18.832977 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2768/5511] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 01:10:18 2022] GET /identity/v3/regions => generated 669 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:18.836787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371bab6-f400-40ca-816c-b0f7be5e953b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:18.918061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371bab6-f400-40ca-816c-b0f7be5e953b tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:18.930535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d2efc-c440-47b5-9366-fa7c99269385 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:18.931204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d2efc-c440-47b5-9366-fa7c99269385 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:18.931492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d2efc-c440-47b5-9366-fa7c99269385 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:18.931777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d2efc-c440-47b5-9366-fa7c99269385 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions/01564334d5c747cc96eb27589206f66a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:18.932375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d2efc-c440-47b5-9366-fa7c99269385 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:delete_region(region_id=01564334d5c747cc96eb27589206f66a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:18.934220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d2efc-c440-47b5-9366-fa7c99269385 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-895d2efc-c440-47b5-9366-fa7c99269385 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Could not find region: 01564334d5c747cc96eb27589206f66a.: keystone.exception.RegionNotFound: Could not find region: 01564334d5c747cc96eb27589206f66a. Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 01564334d5c747cc96eb27589206f66a. Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:10:18.970375 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 01564334d5c747cc96eb27589206f66a. Oct 19 01:10:18.971302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:10:18.975558 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2744/5512] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:10:18 2022] DELETE /identity/v3/regions/01564334d5c747cc96eb27589206f66a => generated 112 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:10:18.986520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae3ce6-53b9-4c6f-8c99-0ca86fbda925 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:19.004135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae3ce6-53b9-4c6f-8c99-0ca86fbda925 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:19.026323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6bd77-267a-4792-95c6-ad8160f4d554 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:19.026944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bd77-267a-4792-95c6-ad8160f4d554 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:19.027550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bd77-267a-4792-95c6-ad8160f4d554 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:19.028040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bd77-267a-4792-95c6-ad8160f4d554 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:19.032252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6bd77-267a-4792-95c6-ad8160f4d554 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:19.035172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6bd77-267a-4792-95c6-ad8160f4d554 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:19.053625 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2769/5513] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 01:10:18 2022] GET /identity/v3/regions => generated 669 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:19.055010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d2efc-c440-47b5-9366-fa7c99269385 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:19.075935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d2efc-c440-47b5-9366-fa7c99269385 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:19.099636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867d08-df17-4139-9a5b-e4afc544d0d6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:19.100793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867d08-df17-4139-9a5b-e4afc544d0d6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:19.101086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867d08-df17-4139-9a5b-e4afc544d0d6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:19.103962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867d08-df17-4139-9a5b-e4afc544d0d6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:19.104786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867d08-df17-4139-9a5b-e4afc544d0d6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:19.109792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867d08-df17-4139-9a5b-e4afc544d0d6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:19.165192 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2745/5514] 10.222.0.27 () {60 vars in 1150 bytes} [Wed Oct 19 01:10:19 2022] POST /identity/v3/regions => generated 254 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:19.169184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6bd77-267a-4792-95c6-ad8160f4d554 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:19.176814 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:19.186736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6bd77-267a-4792-95c6-ad8160f4d554 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:19.219849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7e5dd-4fbd-4805-b29c-333851d8c92e tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:19.220939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e5dd-4fbd-4805-b29c-333851d8c92e tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:19.221500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e5dd-4fbd-4805-b29c-333851d8c92e tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:19.225047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e5dd-4fbd-4805-b29c-333851d8c92e tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:19.226104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7e5dd-4fbd-4805-b29c-333851d8c92e tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Adding query filter params (parent_region_id=2f3db70a794647788b0bd5ed63e33ad4) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:19.226625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7e5dd-4fbd-4805-b29c-333851d8c92e tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:19.227923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7e5dd-4fbd-4805-b29c-333851d8c92e tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:19.243168 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2770/5515] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:10:19 2022] GET /identity/v3/regions?parent_region_id=2f3db70a794647788b0bd5ed63e33ad4 => generated 400 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:10:19.247604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867d08-df17-4139-9a5b-e4afc544d0d6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:19.278246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867d08-df17-4139-9a5b-e4afc544d0d6 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:19.305765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba7f13-43cf-478e-9537-a8a6901435e0 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:19.306887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7f13-43cf-478e-9537-a8a6901435e0 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:19.307593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7f13-43cf-478e-9537-a8a6901435e0 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:19.308068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7f13-43cf-478e-9537-a8a6901435e0 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions/83d90a8d6b9948d591e2137026ef9a77` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:19.308937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba7f13-43cf-478e-9537-a8a6901435e0 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:delete_region(region_id=83d90a8d6b9948d591e2137026ef9a77)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:19.311229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba7f13-43cf-478e-9537-a8a6901435e0 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:19.328888 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:19.375262 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2746/5516] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:10:19 2022] DELETE /identity/v3/regions/83d90a8d6b9948d591e2137026ef9a77 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:19.380486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7e5dd-4fbd-4805-b29c-333851d8c92e tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:19.398853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7e5dd-4fbd-4805-b29c-333851d8c92e tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:19.437507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b29e36-5e1e-459a-9139-637cf8ab1d7a tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:19.438487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b29e36-5e1e-459a-9139-637cf8ab1d7a tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:19.438987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b29e36-5e1e-459a-9139-637cf8ab1d7a tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:19.439451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b29e36-5e1e-459a-9139-637cf8ab1d7a tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions/fba0e012c5404a4abee6fb5e5aa980cb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:19.440250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b29e36-5e1e-459a-9139-637cf8ab1d7a tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fba0e012c5404a4abee6fb5e5aa980cb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:19.441481 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-e4b29e36-5e1e-459a-9139-637cf8ab1d7a tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:10:19.441481 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:10:19.441481 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:10:19.442818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b29e36-5e1e-459a-9139-637cf8ab1d7a tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:19.511952 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2771/5517] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:10:19 2022] DELETE /identity/v3/regions/fba0e012c5404a4abee6fb5e5aa980cb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:19.516915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba7f13-43cf-478e-9537-a8a6901435e0 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:19.548150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba7f13-43cf-478e-9537-a8a6901435e0 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:19.605987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e655f58-db5d-4abf-8e4e-81a4acef5760 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c621ce231145de91ea20e49d6d59d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '355e95b6dce3419092e4a35bcdf9fa4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:19.606652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e655f58-db5d-4abf-8e4e-81a4acef5760 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:19.607532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e655f58-db5d-4abf-8e4e-81a4acef5760 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:19.607812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e655f58-db5d-4abf-8e4e-81a4acef5760 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] PATH_INFO: `/v3/regions/2f3db70a794647788b0bd5ed63e33ad4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:19.608422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e655f58-db5d-4abf-8e4e-81a4acef5760 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2f3db70a794647788b0bd5ed63e33ad4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:19.610094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e655f58-db5d-4abf-8e4e-81a4acef5760 tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:19.643437 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2747/5518] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:10:19 2022] DELETE /identity/v3/regions/2f3db70a794647788b0bd5ed63e33ad4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:19.647664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b29e36-5e1e-459a-9139-637cf8ab1d7a tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:19.809544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b29e36-5e1e-459a-9139-637cf8ab1d7a tempest-RegionsTestJSON-1527371933 tempest-RegionsTestJSON-1527371933-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:19.830686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:19.831493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:19.831989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:19.832452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] PATH_INFO: `/v3/users/822802d0841b4104b6087482cf51c7c5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:19.834213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=822802d0841b4104b6087482cf51c7c5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:19.845295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:19.957066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822802d0841b4104b6087482cf51c7c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:19.973542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822802d0841b4104b6087482cf51c7c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:19.984973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822802d0841b4104b6087482cf51c7c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:19.997246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822802d0841b4104b6087482cf51c7c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:19.998754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822802d0841b4104b6087482cf51c7c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:20.006211 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2772/5519] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:19 2022] DELETE /identity/v3/users/822802d0841b4104b6087482cf51c7c5 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:20.010905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bc21a-6a4d-4e68-9e7f-2bd10f61d708 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:20.011322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bc21a-6a4d-4e68-9e7f-2bd10f61d708 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:20.011709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bc21a-6a4d-4e68-9e7f-2bd10f61d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:20.059828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e01bc21a-6a4d-4e68-9e7f-2bd10f61d708 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:20.063549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e01bc21a-6a4d-4e68-9e7f-2bd10f61d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:20.230910 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2748/5520] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:20.272583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:20.274243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:20.367665 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:20.401268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7f4f-0ed1-4aa1-be4f-6e7226c9ef37 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:20.401869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7f4f-0ed1-4aa1-be4f-6e7226c9ef37 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:20.402328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7f4f-0ed1-4aa1-be4f-6e7226c9ef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:20.444272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e69a7f4f-0ed1-4aa1-be4f-6e7226c9ef37 None None] MFA Rules not processed for user `2052fd7bb1ee432cb3ca4ec07698292c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:20.448278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e69a7f4f-0ed1-4aa1-be4f-6e7226c9ef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:20.583378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c759fbe-9d15-4ac9-9524-b129263f7ce6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:20.609890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb74c-5f69-4920-b62f-f442a6d8bc7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:20.610532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb74c-5f69-4920-b62f-f442a6d8bc7d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:20.611217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb74c-5f69-4920-b62f-f442a6d8bc7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:20.611497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb74c-5f69-4920-b62f-f442a6d8bc7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:20.646838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fb74c-5f69-4920-b62f-f442a6d8bc7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:20.648418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fb74c-5f69-4920-b62f-f442a6d8bc7d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:20.688060 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2749/5521] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:20.688898 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2773/5522] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:22.013773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d3df5-628a-4b29-b8ee-099e29588468 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:22.014262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d3df5-628a-4b29-b8ee-099e29588468 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:22.014648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d3df5-628a-4b29-b8ee-099e29588468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:22.070629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f80d3df5-628a-4b29-b8ee-099e29588468 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:22.073480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f80d3df5-628a-4b29-b8ee-099e29588468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:22.083627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb74c-5f69-4920-b62f-f442a6d8bc7d service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:22.095478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e72fb74c-5f69-4920-b62f-f442a6d8bc7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:22.134952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb74c-5f69-4920-b62f-f442a6d8bc7d service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:22.147182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:22.147710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:22.147993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:22.148268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] PATH_INFO: `/v3/projects/5316a8dfb3754c709790af0cc2dda8f7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:22.151121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5316a8dfb3754c709790af0cc2dda8f7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:22.153310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:22.269421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5316a8dfb3754c709790af0cc2dda8f7', 'request_id': 'req-c6a92075-d80f-4566-887a-4b73ec5a3f28'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.280482 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:22.285945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5316a8dfb3754c709790af0cc2dda8f7', 'request_id': 'req-c6a92075-d80f-4566-887a-4b73ec5a3f28'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.295555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5316a8dfb3754c709790af0cc2dda8f7', 'request_id': 'req-c6a92075-d80f-4566-887a-4b73ec5a3f28'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.309694 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2750/5523] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:10:22.324284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d3df5-628a-4b29-b8ee-099e29588468 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:22.327501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f80d3df5-628a-4b29-b8ee-099e29588468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:22.328943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] The token cache is being invalidate because project 5316a8dfb3754c709790af0cc2dda8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:22.329241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.332300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.334872 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2774/5524] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:22 2022] DELETE /identity/v3/projects/5316a8dfb3754c709790af0cc2dda8f7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:22.338839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:22.340572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:22.477251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a92075-d80f-4566-887a-4b73ec5a3f28 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:22.488919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:22.489642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:22.489924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:22.490199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] PATH_INFO: `/v3/users/05c621ce231145de91ea20e49d6d59d7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:22.492262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c621ce231145de91ea20e49d6d59d7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:22.495174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:22.502750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d3df5-628a-4b29-b8ee-099e29588468 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:22.579466 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:22.602332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c621ce231145de91ea20e49d6d59d7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.632306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2eaff-b30b-4f4b-b114-5f4d5ca2bda5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:22.632961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2eaff-b30b-4f4b-b114-5f4d5ca2bda5 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:22.633241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2eaff-b30b-4f4b-b114-5f4d5ca2bda5 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:22.633512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2eaff-b30b-4f4b-b114-5f4d5ca2bda5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:22.635805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-efc2eaff-b30b-4f4b-b114-5f4d5ca2bda5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:22.642305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c621ce231145de91ea20e49d6d59d7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.662478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c621ce231145de91ea20e49d6d59d7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.678028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c621ce231145de91ea20e49d6d59d7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.678856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c621ce231145de91ea20e49d6d59d7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:22.696546 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2775/5525] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:22 2022] DELETE /identity/v3/users/05c621ce231145de91ea20e49d6d59d7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:22.777608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2eaff-b30b-4f4b-b114-5f4d5ca2bda5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:22.779957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2eaff-b30b-4f4b-b114-5f4d5ca2bda5 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:22.798175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:22.800024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:22.802074 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2751/5526] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:10:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:10:23.094876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a34b3-6d27-4af0-a620-55c3eac466ae admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:23.108783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5a5f8-4189-43ff-800c-7b633519f42d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:23.109676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5a5f8-4189-43ff-800c-7b633519f42d service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:23.110807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5a5f8-4189-43ff-800c-7b633519f42d service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:23.111240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5a5f8-4189-43ff-800c-7b633519f42d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:23.117052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-38e5a5f8-4189-43ff-800c-7b633519f42d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:23.158861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5a5f8-4189-43ff-800c-7b633519f42d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:23.165374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5a5f8-4189-43ff-800c-7b633519f42d service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:23.224354 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2776/5527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:23.822617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2eaff-b30b-4f4b-b114-5f4d5ca2bda5 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:23.841926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2eaff-b30b-4f4b-b114-5f4d5ca2bda5 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:23.969070 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:24.036733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:24.037634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:24.038023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:24.038425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] PATH_INFO: `/v3/projects/355e95b6dce3419092e4a35bcdf9fa4c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:24.052317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=355e95b6dce3419092e4a35bcdf9fa4c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:24.054592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:24.239516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355e95b6dce3419092e4a35bcdf9fa4c', 'request_id': 'req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:24.254451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355e95b6dce3419092e4a35bcdf9fa4c', 'request_id': 'req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:24.266717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355e95b6dce3419092e4a35bcdf9fa4c', 'request_id': 'req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:24.297126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] The token cache is being invalidate because project 355e95b6dce3419092e4a35bcdf9fa4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:24.297126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:24.297950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0cd7da1b-c1f1-4bcb-b6b2-9003a003cfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:24.302633 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2752/5528] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:23 2022] DELETE /identity/v3/projects/355e95b6dce3419092e4a35bcdf9fa4c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:24.309012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5cf1-400f-4b32-9337-4982eb393a11 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:24.309717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5cf1-400f-4b32-9337-4982eb393a11 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:24.309717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5cf1-400f-4b32-9337-4982eb393a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:24.397010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-227e5cf1-400f-4b32-9337-4982eb393a11 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:24.402078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-227e5cf1-400f-4b32-9337-4982eb393a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:24.694433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b88857-4483-473c-9dc3-dbe654412ccd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:24.695024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b88857-4483-473c-9dc3-dbe654412ccd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:24.695511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b88857-4483-473c-9dc3-dbe654412ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:24.695763 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2777/5529] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:24.743546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5cf1-400f-4b32-9337-4982eb393a11 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:24.745733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-227e5cf1-400f-4b32-9337-4982eb393a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:24.758610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-09b88857-4483-473c-9dc3-dbe654412ccd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:24.761771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09b88857-4483-473c-9dc3-dbe654412ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:24.802524 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2753/5530] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:24.804292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b88857-4483-473c-9dc3-dbe654412ccd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:24.810427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5cf1-400f-4b32-9337-4982eb393a11 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:24.821208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:24.822828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:24.823292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:24.838775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b88857-4483-473c-9dc3-dbe654412ccd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:24.839700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] PATH_INFO: `/v3/users/880c764a3e804b4a844b3456d7b42372` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:24.845512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880c764a3e804b4a844b3456d7b42372)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:24.852099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:24.855076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:24.856445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:24.857275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:24.857658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:24.861908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:24.862823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:24.869132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:24.927615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2754/5531] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:24.932837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:24.937107 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:24.946114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:24.971892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880c764a3e804b4a844b3456d7b42372'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:25.008908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880c764a3e804b4a844b3456d7b42372'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:25.023602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880c764a3e804b4a844b3456d7b42372'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:25.041828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880c764a3e804b4a844b3456d7b42372'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:25.044115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880c764a3e804b4a844b3456d7b42372'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:25.068634 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2778/5532] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:24 2022] DELETE /identity/v3/users/880c764a3e804b4a844b3456d7b42372 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:25.073563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:25.075966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:25.328778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177880a1-377a-4714-99fd-09e64674a5c1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:25.340960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f3975-395f-4884-a089-c862973820e1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:25.354185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533b276-da29-4a93-b103-727bb7a502e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:25.355555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533b276-da29-4a93-b103-727bb7a502e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:25.357747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533b276-da29-4a93-b103-727bb7a502e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:25.358716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533b276-da29-4a93-b103-727bb7a502e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:25.359586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533b276-da29-4a93-b103-727bb7a502e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:25.363943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533b276-da29-4a93-b103-727bb7a502e6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:25.445656 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:25.490012 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2779/5533] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:25 2022] POST /identity/v3/projects => generated 381 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:25.498910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c5fd1-de5e-4c92-8ddc-521d6a04d7b1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:25.502853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c5fd1-de5e-4c92-8ddc-521d6a04d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:25.505264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c5fd1-de5e-4c92-8ddc-521d6a04d7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:25.578629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a09c5fd1-de5e-4c92-8ddc-521d6a04d7b1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:25.591211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a09c5fd1-de5e-4c92-8ddc-521d6a04d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:25.613911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178eaf93-0f40-4702-8008-0696adfca564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:25.614808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178eaf93-0f40-4702-8008-0696adfca564 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:25.615115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178eaf93-0f40-4702-8008-0696adfca564 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:25.615406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178eaf93-0f40-4702-8008-0696adfca564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:25.628370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-178eaf93-0f40-4702-8008-0696adfca564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:25.695837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178eaf93-0f40-4702-8008-0696adfca564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:25.707464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178eaf93-0f40-4702-8008-0696adfca564 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:25.773612 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2755/5534] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 844 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:25.774504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178eaf93-0f40-4702-8008-0696adfca564 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:25.829559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178eaf93-0f40-4702-8008-0696adfca564 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:25.932433 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2780/5535] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:25.943705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c5fd1-de5e-4c92-8ddc-521d6a04d7b1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:25.947190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a09c5fd1-de5e-4c92-8ddc-521d6a04d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:26.019275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aa583-8d42-4a34-ac45-63dba89c01bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:26.021456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aa583-8d42-4a34-ac45-63dba89c01bd admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:26.021790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aa583-8d42-4a34-ac45-63dba89c01bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:26.022070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aa583-8d42-4a34-ac45-63dba89c01bd admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:26.022718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057aa583-8d42-4a34-ac45-63dba89c01bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:26.031157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057aa583-8d42-4a34-ac45-63dba89c01bd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:26.104364 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:26.118351 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2756/5536] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:25 2022] POST /identity/v3/users => generated 291 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:26.125700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aa583-8d42-4a34-ac45-63dba89c01bd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:26.157704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aa583-8d42-4a34-ac45-63dba89c01bd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:26.163061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c365d9f-18f5-496c-9461-c4d514460421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:26.164199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c365d9f-18f5-496c-9461-c4d514460421 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:26.164555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c365d9f-18f5-496c-9461-c4d514460421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:26.164919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c365d9f-18f5-496c-9461-c4d514460421 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:26.165784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c365d9f-18f5-496c-9461-c4d514460421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:26.170451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c365d9f-18f5-496c-9461-c4d514460421 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:26.187919 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2757/5537] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:26.188978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c365d9f-18f5-496c-9461-c4d514460421 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:26.191429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c5fd1-de5e-4c92-8ddc-521d6a04d7b1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:26.202324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c365d9f-18f5-496c-9461-c4d514460421 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:26.204218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9084c21-017f-4360-96b6-859846c0f383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:26.208493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d9b5-8c7e-45bf-8247-eb3876f4de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:26.208802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084c21-017f-4360-96b6-859846c0f383 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:26.209211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084c21-017f-4360-96b6-859846c0f383 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:26.209425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d9b5-8c7e-45bf-8247-eb3876f4de68 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:26.209811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084c21-017f-4360-96b6-859846c0f383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:26.209925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d9b5-8c7e-45bf-8247-eb3876f4de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:26.210307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d9b5-8c7e-45bf-8247-eb3876f4de68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:26.211344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9d9b5-8c7e-45bf-8247-eb3876f4de68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:26.213502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9d9b5-8c7e-45bf-8247-eb3876f4de68 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:26.234071 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2758/5538] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:26.235162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d9b5-8c7e-45bf-8247-eb3876f4de68 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:26.244083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9084c21-017f-4360-96b6-859846c0f383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:26.245751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9084c21-017f-4360-96b6-859846c0f383 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:26.253257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d9b5-8c7e-45bf-8247-eb3876f4de68 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:26.261321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a25f-9da5-45e3-a254-97b1983f445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:26.262101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a25f-9da5-45e3-a254-97b1983f445a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:26.262557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a25f-9da5-45e3-a254-97b1983f445a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:26.263481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a25f-9da5-45e3-a254-97b1983f445a admin admin] PATH_INFO: `/v3/projects/aa25700c44fd443585d327f8eb57f8cd/users/0b1a50368572480eaf33144bffbbad05/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:26.277038 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2781/5539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:26.312607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148a25f-9da5-45e3-a254-97b1983f445a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa25700c44fd443585d327f8eb57f8cd, user_id=0b1a50368572480eaf33144bffbbad05, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:26.321811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148a25f-9da5-45e3-a254-97b1983f445a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:26.385145 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2759/5540] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:26 2022] PUT /identity/v3/projects/aa25700c44fd443585d327f8eb57f8cd/users/0b1a50368572480eaf33144bffbbad05/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:26.388146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e52b7-db65-4cc0-8451-a42f37fc85e8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:26.388661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e52b7-db65-4cc0-8451-a42f37fc85e8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:26.388808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e52b7-db65-4cc0-8451-a42f37fc85e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:26.453146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1c1e52b7-db65-4cc0-8451-a42f37fc85e8 None None] MFA Rules not processed for user `0b1a50368572480eaf33144bffbbad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:26.454621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1c1e52b7-db65-4cc0-8451-a42f37fc85e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:26.686811 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2782/5541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:26.691230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a25f-9da5-45e3-a254-97b1983f445a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:26.733962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e52b7-db65-4cc0-8451-a42f37fc85e8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:26.735580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1c1e52b7-db65-4cc0-8451-a42f37fc85e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:26.910688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a25f-9da5-45e3-a254-97b1983f445a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:26.929237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a968a-530b-4150-a7a1-06bbb1cfee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:26.929931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a968a-530b-4150-a7a1-06bbb1cfee3f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:26.930318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a968a-530b-4150-a7a1-06bbb1cfee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:26.930697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a968a-530b-4150-a7a1-06bbb1cfee3f admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:26.931448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a968a-530b-4150-a7a1-06bbb1cfee3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:26.933512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a968a-530b-4150-a7a1-06bbb1cfee3f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:26.946547 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:26.955696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e52b7-db65-4cc0-8451-a42f37fc85e8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:26.970826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:26.971590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:26.971894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:26.972183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] PATH_INFO: `/v3/projects/4c7d0e9762d546df8dcb63c382028d1a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:26.973906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7d0e9762d546df8dcb63c382028d1a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:26.976433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:27.000963 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2760/5542] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:26 2022] POST /identity/v3/projects => generated 381 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:27.005868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a968a-530b-4150-a7a1-06bbb1cfee3f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:27.109452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7d0e9762d546df8dcb63c382028d1a', 'request_id': 'req-c98703f7-068d-417d-bdeb-383af63b9ce4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:27.132488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7d0e9762d546df8dcb63c382028d1a', 'request_id': 'req-c98703f7-068d-417d-bdeb-383af63b9ce4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:27.148452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7d0e9762d546df8dcb63c382028d1a', 'request_id': 'req-c98703f7-068d-417d-bdeb-383af63b9ce4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:27.156022 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:27.175916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] The token cache is being invalidate because project 4c7d0e9762d546df8dcb63c382028d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:27.176462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:27.179619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c98703f7-068d-417d-bdeb-383af63b9ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:27.181839 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2783/5543] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:26 2022] DELETE /identity/v3/projects/4c7d0e9762d546df8dcb63c382028d1a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:27.187274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09bd87-9605-43f3-962f-497d95233906 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:27.187815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09bd87-9605-43f3-962f-497d95233906 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:27.188244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09bd87-9605-43f3-962f-497d95233906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:27.253281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a968a-530b-4150-a7a1-06bbb1cfee3f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:27.264814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7a09bd87-9605-43f3-962f-497d95233906 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:27.266227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7a09bd87-9605-43f3-962f-497d95233906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:27.460005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546396a-da92-4bde-bcc4-af41753af48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:27.469172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546396a-da92-4bde-bcc4-af41753af48b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:27.470702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546396a-da92-4bde-bcc4-af41753af48b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:27.470980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546396a-da92-4bde-bcc4-af41753af48b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:27.471677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546396a-da92-4bde-bcc4-af41753af48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:27.483407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546396a-da92-4bde-bcc4-af41753af48b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:27.491388 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2784/5544] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:27.492878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d066ab7-6a43-4a0b-9406-8597019cb3ee None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:27.493169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d066ab7-6a43-4a0b-9406-8597019cb3ee None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:27.493446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d066ab7-6a43-4a0b-9406-8597019cb3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:27.542154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9d066ab7-6a43-4a0b-9406-8597019cb3ee None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:27.545571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9d066ab7-6a43-4a0b-9406-8597019cb3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:27.570880 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2761/5545] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:27 2022] POST /identity/v3/users => generated 291 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:27.577940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546396a-da92-4bde-bcc4-af41753af48b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:27.581139 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2785/5546] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:27.582077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d066ab7-6a43-4a0b-9406-8597019cb3ee None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:27.596546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8546396a-da92-4bde-bcc4-af41753af48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:27.599135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d066ab7-6a43-4a0b-9406-8597019cb3ee None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:27.621510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119c757-f3e2-43eb-afe1-b235ed8af8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:27.622247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119c757-f3e2-43eb-afe1-b235ed8af8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:27.623138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119c757-f3e2-43eb-afe1-b235ed8af8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:27.623424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119c757-f3e2-43eb-afe1-b235ed8af8c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:27.624093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119c757-f3e2-43eb-afe1-b235ed8af8c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:27.624400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119c757-f3e2-43eb-afe1-b235ed8af8c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:27.626162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119c757-f3e2-43eb-afe1-b235ed8af8c1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:27.631239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546396a-da92-4bde-bcc4-af41753af48b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:27.643376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc450191-f0a6-4246-b2ef-993548c0d6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:27.655650 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2786/5547] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:27.661569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119c757-f3e2-43eb-afe1-b235ed8af8c1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:27.686132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc450191-f0a6-4246-b2ef-993548c0d6df admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:27.686132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc450191-f0a6-4246-b2ef-993548c0d6df admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:27.686132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc450191-f0a6-4246-b2ef-993548c0d6df admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:27.686132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc450191-f0a6-4246-b2ef-993548c0d6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:27.691157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc450191-f0a6-4246-b2ef-993548c0d6df admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:27.704657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119c757-f3e2-43eb-afe1-b235ed8af8c1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:27.713460 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2762/5548] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:27.717341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef29879-d22a-40c1-915e-12bd2167b671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:27.718104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef29879-d22a-40c1-915e-12bd2167b671 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:27.718401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef29879-d22a-40c1-915e-12bd2167b671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:27.718685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef29879-d22a-40c1-915e-12bd2167b671 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:27.719342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef29879-d22a-40c1-915e-12bd2167b671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:27.721333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef29879-d22a-40c1-915e-12bd2167b671 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:27.721446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc450191-f0a6-4246-b2ef-993548c0d6df admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:27.743549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc450191-f0a6-4246-b2ef-993548c0d6df admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:27.753642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097c253-82dc-4ad1-b92c-b9b5f2726dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:27.754253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097c253-82dc-4ad1-b92c-b9b5f2726dab admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:27.754534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097c253-82dc-4ad1-b92c-b9b5f2726dab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:27.754805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097c253-82dc-4ad1-b92c-b9b5f2726dab admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:27.757722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097c253-82dc-4ad1-b92c-b9b5f2726dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:27.762016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097c253-82dc-4ad1-b92c-b9b5f2726dab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:27.782864 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2787/5549] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:27 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:27.788172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef29879-d22a-40c1-915e-12bd2167b671 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:27.799191 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2763/5550] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:10:27.799191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097c253-82dc-4ad1-b92c-b9b5f2726dab admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:27.819647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097c253-82dc-4ad1-b92c-b9b5f2726dab admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:27.949151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef29879-d22a-40c1-915e-12bd2167b671 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:27.965489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef412-602f-4ddb-9564-e689c79ff542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:27.968179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef412-602f-4ddb-9564-e689c79ff542 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:27.968647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef412-602f-4ddb-9564-e689c79ff542 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:27.969946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef412-602f-4ddb-9564-e689c79ff542 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:27.971914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef412-602f-4ddb-9564-e689c79ff542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:27.974085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef412-602f-4ddb-9564-e689c79ff542 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:27.976158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17cd8d-f1bd-4994-851e-b7d17fff3412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:27.976869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cd8d-f1bd-4994-851e-b7d17fff3412 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:27.977148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cd8d-f1bd-4994-851e-b7d17fff3412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:27.977418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cd8d-f1bd-4994-851e-b7d17fff3412 admin admin] PATH_INFO: `/v3/projects/f66ffe18c40b41da8fd6954d6e6313c3/users/2490d4d05e74415bb26e9f7ee2680a5a/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:27.986245 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:28.020159 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2788/5551] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:27 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:28.023922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef412-602f-4ddb-9564-e689c79ff542 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:28.030079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17cd8d-f1bd-4994-851e-b7d17fff3412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66ffe18c40b41da8fd6954d6e6313c3, user_id=2490d4d05e74415bb26e9f7ee2680a5a, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:28.035831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17cd8d-f1bd-4994-851e-b7d17fff3412 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:28.043838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef412-602f-4ddb-9564-e689c79ff542 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:28.102384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8406ff3-4991-43c7-a6de-ca3b2db593b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:28.103019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8406ff3-4991-43c7-a6de-ca3b2db593b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:28.103296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8406ff3-4991-43c7-a6de-ca3b2db593b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:28.103567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8406ff3-4991-43c7-a6de-ca3b2db593b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:28.104217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8406ff3-4991-43c7-a6de-ca3b2db593b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:28.110168 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2764/5552] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:27 2022] PUT /identity/v3/projects/f66ffe18c40b41da8fd6954d6e6313c3/users/2490d4d05e74415bb26e9f7ee2680a5a/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:28.110945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8406ff3-4991-43c7-a6de-ca3b2db593b8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:28.122057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc20bd5-6512-4581-a25e-5d1f26163517 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:28.123130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc20bd5-6512-4581-a25e-5d1f26163517 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:28.123695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc20bd5-6512-4581-a25e-5d1f26163517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:28.141226 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2789/5553] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:28.143655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8406ff3-4991-43c7-a6de-ca3b2db593b8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:28.165256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8406ff3-4991-43c7-a6de-ca3b2db593b8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:28.213545 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:28.226462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1dc20bd5-6512-4581-a25e-5d1f26163517 None None] MFA Rules not processed for user `2490d4d05e74415bb26e9f7ee2680a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:28.227742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1dc20bd5-6512-4581-a25e-5d1f26163517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:28.262536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbddc1-0718-4864-8b1b-c253ea079965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:28.263961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbddc1-0718-4864-8b1b-c253ea079965 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:28.264514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbddc1-0718-4864-8b1b-c253ea079965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:28.265677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbddc1-0718-4864-8b1b-c253ea079965 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:28.267790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbddc1-0718-4864-8b1b-c253ea079965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:28.269613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbddc1-0718-4864-8b1b-c253ea079965 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:28.326052 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2790/5554] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:28.326996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbddc1-0718-4864-8b1b-c253ea079965 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:28.359656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbddc1-0718-4864-8b1b-c253ea079965 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:28.377266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548a5e4-075f-4f8a-8d24-fabc8d92e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:28.378075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548a5e4-075f-4f8a-8d24-fabc8d92e6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:28.378711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548a5e4-075f-4f8a-8d24-fabc8d92e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:28.380390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548a5e4-075f-4f8a-8d24-fabc8d92e6cb admin admin] PATH_INFO: `/v3/projects/88fe70b6bdba416da837cab2a3ed032e/users/12d0a4421ba74c348f264f875ba21766/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:28.425855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548a5e4-075f-4f8a-8d24-fabc8d92e6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fe70b6bdba416da837cab2a3ed032e, user_id=12d0a4421ba74c348f264f875ba21766, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:28.428906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548a5e4-075f-4f8a-8d24-fabc8d92e6cb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:28.433500 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2765/5555] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:28.438185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc20bd5-6512-4581-a25e-5d1f26163517 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:28.440268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1dc20bd5-6512-4581-a25e-5d1f26163517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:28.469697 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2791/5556] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:28 2022] PUT /identity/v3/projects/88fe70b6bdba416da837cab2a3ed032e/users/12d0a4421ba74c348f264f875ba21766/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:28.471538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf760fb-8fba-4caa-8f7a-58179cdb9765 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:28.472025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf760fb-8fba-4caa-8f7a-58179cdb9765 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:28.472442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf760fb-8fba-4caa-8f7a-58179cdb9765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:28.522778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2bf760fb-8fba-4caa-8f7a-58179cdb9765 None None] MFA Rules not processed for user `12d0a4421ba74c348f264f875ba21766`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:28.524538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2bf760fb-8fba-4caa-8f7a-58179cdb9765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:28.614288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc20bd5-6512-4581-a25e-5d1f26163517 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:28.832037 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2792/5557] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:28.844289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf760fb-8fba-4caa-8f7a-58179cdb9765 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:28.847551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2bf760fb-8fba-4caa-8f7a-58179cdb9765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:28.852803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ef9ae-ec9b-4a17-8e6c-e407cea463f8 tempest-IdentityV3ProjectsTest-1348821529 tempest-IdentityV3ProjectsTest-1348821529-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b1a50368572480eaf33144bffbbad05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa25700c44fd443585d327f8eb57f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:28.854519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ef9ae-ec9b-4a17-8e6c-e407cea463f8 tempest-IdentityV3ProjectsTest-1348821529 tempest-IdentityV3ProjectsTest-1348821529-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:28.854806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ef9ae-ec9b-4a17-8e6c-e407cea463f8 tempest-IdentityV3ProjectsTest-1348821529 tempest-IdentityV3ProjectsTest-1348821529-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:28.855090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ef9ae-ec9b-4a17-8e6c-e407cea463f8 tempest-IdentityV3ProjectsTest-1348821529 tempest-IdentityV3ProjectsTest-1348821529-project] PATH_INFO: `/v3/users/0b1a50368572480eaf33144bffbbad05/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:28.856513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ef9ae-ec9b-4a17-8e6c-e407cea463f8 tempest-IdentityV3ProjectsTest-1348821529 tempest-IdentityV3ProjectsTest-1348821529-project] RBAC: Authorizing `identity:list_user_projects(user_id=0b1a50368572480eaf33144bffbbad05)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:28.858515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ef9ae-ec9b-4a17-8e6c-e407cea463f8 tempest-IdentityV3ProjectsTest-1348821529 tempest-IdentityV3ProjectsTest-1348821529-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:29.022860 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:29.105242 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2766/5558] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:10:28 2022] GET /identity/v3/users/0b1a50368572480eaf33144bffbbad05/projects => generated 517 bytes in 665 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:29.108453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980abc9-2938-4fa9-8468-713371e36dca None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:29.108764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980abc9-2938-4fa9-8468-713371e36dca None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:29.109047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980abc9-2938-4fa9-8468-713371e36dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:29.158198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf760fb-8fba-4caa-8f7a-58179cdb9765 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:29.181590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4980abc9-2938-4fa9-8468-713371e36dca None None] MFA Rules not processed for user `0b1a50368572480eaf33144bffbbad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:29.182962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4980abc9-2938-4fa9-8468-713371e36dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:29.184387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71698162-beb8-4699-bcf6-542d758b9290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:29.185380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71698162-beb8-4699-bcf6-542d758b9290 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:29.185763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71698162-beb8-4699-bcf6-542d758b9290 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:29.186045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71698162-beb8-4699-bcf6-542d758b9290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:29.197592 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2767/5559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:29.199047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc0359-1307-4a0b-b218-88840386f569 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:29.199408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc0359-1307-4a0b-b218-88840386f569 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:29.199762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc0359-1307-4a0b-b218-88840386f569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:29.202004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71698162-beb8-4699-bcf6-542d758b9290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:29.208575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71698162-beb8-4699-bcf6-542d758b9290 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:29.242045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1dfc0359-1307-4a0b-b218-88840386f569 None None] MFA Rules not processed for user `0b1a50368572480eaf33144bffbbad05`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:29.247958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1dfc0359-1307-4a0b-b218-88840386f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:29.258979 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2793/5560] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:29.267336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71698162-beb8-4699-bcf6-542d758b9290 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:29.268870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-71698162-beb8-4699-bcf6-542d758b9290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:29.298881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71698162-beb8-4699-bcf6-542d758b9290 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:29.317627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d371b-b6d9-4791-ac14-0b7eb14ad398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:29.318327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d371b-b6d9-4791-ac14-0b7eb14ad398 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:29.318518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d371b-b6d9-4791-ac14-0b7eb14ad398 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:29.318804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d371b-b6d9-4791-ac14-0b7eb14ad398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:29.322128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4e4d371b-b6d9-4791-ac14-0b7eb14ad398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:29.345070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d371b-b6d9-4791-ac14-0b7eb14ad398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:29.346663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d371b-b6d9-4791-ac14-0b7eb14ad398 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:29.371510 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2794/5561] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:29.387530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.models.token_model [None req-1dfc0359-1307-4a0b-b218-88840386f569 None None] User 0b1a50368572480eaf33144bffbbad05 has no access to project f66ffe18c40b41da8fd6954d6e6313c3 {{(pid=86424) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 19 01:10:29.395929 n-d-master-1 devstack@keystone.service[86424]: WARNING keystone.server.flask.application [None req-1dfc0359-1307-4a0b-b218-88840386f569 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 19 01:10:29.406056 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2768/5562] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:29 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 207 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 19 01:10:29.406369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d371b-b6d9-4791-ac14-0b7eb14ad398 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:29.487625 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:29.595774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d371b-b6d9-4791-ac14-0b7eb14ad398 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:29.604667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:29.606228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:29.607180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:29.607912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] PATH_INFO: `/v3/users/0b1a50368572480eaf33144bffbbad05` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:29.609592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1a50368572480eaf33144bffbbad05)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:29.612008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:29.715350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1a50368572480eaf33144bffbbad05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:29.742871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1a50368572480eaf33144bffbbad05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:29.760459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1a50368572480eaf33144bffbbad05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:29.786673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1a50368572480eaf33144bffbbad05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:29.787819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1a50368572480eaf33144bffbbad05'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:29.808126 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2795/5563] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:29 2022] DELETE /identity/v3/users/0b1a50368572480eaf33144bffbbad05 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:29.813118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0067-3d1c-4192-802b-86e041385adf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:29.813648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0067-3d1c-4192-802b-86e041385adf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:29.813648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0067-3d1c-4192-802b-86e041385adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:29.890142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-89bc0067-3d1c-4192-802b-86e041385adf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:29.894475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-89bc0067-3d1c-4192-802b-86e041385adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:30.074124 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2769/5564] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:30.089904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:30.092306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:30.234766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854bff6-a078-4a41-9d9e-c00c79532570 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:30.253060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2d7a2-0baf-41a2-8268-602371e1c6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:30.253840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2d7a2-0baf-41a2-8268-602371e1c6dc service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:30.254124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2d7a2-0baf-41a2-8268-602371e1c6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:30.254396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2d7a2-0baf-41a2-8268-602371e1c6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:30.288388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2d7a2-0baf-41a2-8268-602371e1c6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:30.290870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2d7a2-0baf-41a2-8268-602371e1c6dc service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:30.313248 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2796/5565] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:31.192482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc0067-3d1c-4192-802b-86e041385adf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:31.194823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-89bc0067-3d1c-4192-802b-86e041385adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:31.218406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc0067-3d1c-4192-802b-86e041385adf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:31.260043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:31.263252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:31.263700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:31.263940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] PATH_INFO: `/v3/projects/aa25700c44fd443585d327f8eb57f8cd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:31.269834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa25700c44fd443585d327f8eb57f8cd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:31.271782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:31.468844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa25700c44fd443585d327f8eb57f8cd', 'request_id': 'req-98c61639-9fde-4ef5-80f5-af6671cb06d2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:31.494766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa25700c44fd443585d327f8eb57f8cd', 'request_id': 'req-98c61639-9fde-4ef5-80f5-af6671cb06d2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:31.513244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa25700c44fd443585d327f8eb57f8cd', 'request_id': 'req-98c61639-9fde-4ef5-80f5-af6671cb06d2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:31.569680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] The token cache is being invalidate because project aa25700c44fd443585d327f8eb57f8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:31.570210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:31.571126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:31.572934 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2770/5566] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:31 2022] DELETE /identity/v3/projects/aa25700c44fd443585d327f8eb57f8cd => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:31.577186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2d7a2-0baf-41a2-8268-602371e1c6dc service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:31.594860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2d7a2-0baf-41a2-8268-602371e1c6dc service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:31.763771 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:31.795697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:31.796369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:31.797760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:31.798082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] PATH_INFO: `/v3/users/2490d4d05e74415bb26e9f7ee2680a5a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:31.800348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2490d4d05e74415bb26e9f7ee2680a5a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:31.802347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:31.965590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2490d4d05e74415bb26e9f7ee2680a5a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:31.984706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2490d4d05e74415bb26e9f7ee2680a5a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:31.997583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2490d4d05e74415bb26e9f7ee2680a5a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:32.014439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2490d4d05e74415bb26e9f7ee2680a5a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:32.015284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2490d4d05e74415bb26e9f7ee2680a5a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:32.029939 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2797/5567] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:31 2022] DELETE /identity/v3/users/2490d4d05e74415bb26e9f7ee2680a5a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:32.263475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:32.266075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:32.323517 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:32.527836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c61639-9fde-4ef5-80f5-af6671cb06d2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:32.690969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:32.692674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:32.791351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f31f8b-7009-4383-b369-712606614efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:32.792180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f31f8b-7009-4383-b369-712606614efc service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:32.793020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f31f8b-7009-4383-b369-712606614efc service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:32.793505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f31f8b-7009-4383-b369-712606614efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:32.797079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-75f31f8b-7009-4383-b369-712606614efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:32.835333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f31f8b-7009-4383-b369-712606614efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:32.837635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f31f8b-7009-4383-b369-712606614efc service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:32.871358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de633ab6-1df2-4ff0-8132-491ae25fa770 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:32.893521 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2771/5568] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:32.900799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:32.901867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:32.902153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:32.902432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] PATH_INFO: `/v3/projects/f66ffe18c40b41da8fd6954d6e6313c3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:32.913043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66ffe18c40b41da8fd6954d6e6313c3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:32.922243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:33.066364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66ffe18c40b41da8fd6954d6e6313c3', 'request_id': 'req-6ca2c704-07de-4e75-b3df-2dadbcbe8212'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:33.077270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66ffe18c40b41da8fd6954d6e6313c3', 'request_id': 'req-6ca2c704-07de-4e75-b3df-2dadbcbe8212'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:33.100068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66ffe18c40b41da8fd6954d6e6313c3', 'request_id': 'req-6ca2c704-07de-4e75-b3df-2dadbcbe8212'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:33.102346 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:33.114725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] The token cache is being invalidate because project f66ffe18c40b41da8fd6954d6e6313c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:33.115038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:33.116591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ca2c704-07de-4e75-b3df-2dadbcbe8212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:33.118502 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2798/5569] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:32 2022] DELETE /identity/v3/projects/f66ffe18c40b41da8fd6954d6e6313c3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:33.124270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a81a9-848e-4949-8353-40011220aebb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:33.124903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a81a9-848e-4949-8353-40011220aebb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:33.125391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a81a9-848e-4949-8353-40011220aebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:33.188970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ee4a81a9-848e-4949-8353-40011220aebb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:33.190836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ee4a81a9-848e-4949-8353-40011220aebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:33.374204 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2772/5570] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:33.381838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2dc0-8254-4064-aafc-9e8775dbd329 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:33.382376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2dc0-8254-4064-aafc-9e8775dbd329 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:33.382836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2dc0-8254-4064-aafc-9e8775dbd329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:33.430459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-415c2dc0-8254-4064-aafc-9e8775dbd329 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:33.431902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-415c2dc0-8254-4064-aafc-9e8775dbd329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:33.466744 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2799/5571] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:33.469800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a81a9-848e-4949-8353-40011220aebb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:33.486759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a81a9-848e-4949-8353-40011220aebb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:33.501917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d6a3-d535-45c2-a1f3-980b1ed2c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:33.502984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d6a3-d535-45c2-a1f3-980b1ed2c1ad admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:33.503470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d6a3-d535-45c2-a1f3-980b1ed2c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:33.503894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d6a3-d535-45c2-a1f3-980b1ed2c1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:33.505144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d6a3-d535-45c2-a1f3-980b1ed2c1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:33.505594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d6a3-d535-45c2-a1f3-980b1ed2c1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:33.507587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d6a3-d535-45c2-a1f3-980b1ed2c1ad admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:33.538044 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2773/5572] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:33.541463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c2dc0-8254-4064-aafc-9e8775dbd329 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:33.556877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c2dc0-8254-4064-aafc-9e8775dbd329 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:33.569192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c5e95-8641-41da-9cf7-68958a29152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:33.570210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c5e95-8641-41da-9cf7-68958a29152d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:33.570789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c5e95-8641-41da-9cf7-68958a29152d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:33.571205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c5e95-8641-41da-9cf7-68958a29152d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:33.572024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c5e95-8641-41da-9cf7-68958a29152d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:33.574130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c5e95-8641-41da-9cf7-68958a29152d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:33.640086 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2800/5573] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:33 2022] POST /identity/v3/projects => generated 395 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:33.644585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d6a3-d535-45c2-a1f3-980b1ed2c1ad admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:33.671293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d6a3-d535-45c2-a1f3-980b1ed2c1ad admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:33.750448 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:33.824238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7af478-7f4f-4f3e-be01-fdc211ac1f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:33.826337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7af478-7f4f-4f3e-be01-fdc211ac1f4c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:33.826744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7af478-7f4f-4f3e-be01-fdc211ac1f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:33.827148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7af478-7f4f-4f3e-be01-fdc211ac1f4c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:33.827865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7af478-7f4f-4f3e-be01-fdc211ac1f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:33.830757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7af478-7f4f-4f3e-be01-fdc211ac1f4c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:33.865800 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2774/5574] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:33 2022] POST /identity/v3/users => generated 304 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:33.870229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c5e95-8641-41da-9cf7-68958a29152d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:33.883750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c5e95-8641-41da-9cf7-68958a29152d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:33.889764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549ba6b-4542-46bb-97b9-5ff4ed41912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:33.890482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549ba6b-4542-46bb-97b9-5ff4ed41912d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:33.890828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549ba6b-4542-46bb-97b9-5ff4ed41912d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:33.891307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549ba6b-4542-46bb-97b9-5ff4ed41912d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:33.892036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549ba6b-4542-46bb-97b9-5ff4ed41912d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:33.894051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549ba6b-4542-46bb-97b9-5ff4ed41912d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:33.906630 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2801/5575] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:33.910422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7af478-7f4f-4f3e-be01-fdc211ac1f4c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:33.928786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7af478-7f4f-4f3e-be01-fdc211ac1f4c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:33.949574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cd343-74d1-483b-b1e2-bfe38db54d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:33.950493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cd343-74d1-483b-b1e2-bfe38db54d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:33.950965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cd343-74d1-483b-b1e2-bfe38db54d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:33.951346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cd343-74d1-483b-b1e2-bfe38db54d44 admin admin] PATH_INFO: `/v3/projects/6b34f15c7add4f0ebcc86e575f423fb9/users/4baddd97278c44d7a1d121525a1fe999/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:33.986076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cd343-74d1-483b-b1e2-bfe38db54d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b34f15c7add4f0ebcc86e575f423fb9, user_id=4baddd97278c44d7a1d121525a1fe999, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:33.996228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cd343-74d1-483b-b1e2-bfe38db54d44 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:34.023464 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2775/5576] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:33 2022] PUT /identity/v3/projects/6b34f15c7add4f0ebcc86e575f423fb9/users/4baddd97278c44d7a1d121525a1fe999/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:34.027438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549ba6b-4542-46bb-97b9-5ff4ed41912d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:34.044916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549ba6b-4542-46bb-97b9-5ff4ed41912d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:34.231570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b421459-3e4d-43bf-b276-bf0945a34eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:34.232311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b421459-3e4d-43bf-b276-bf0945a34eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:34.240477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b421459-3e4d-43bf-b276-bf0945a34eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:34.240477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b421459-3e4d-43bf-b276-bf0945a34eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:34.240477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b421459-3e4d-43bf-b276-bf0945a34eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:34.240477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b421459-3e4d-43bf-b276-bf0945a34eb8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:34.260318 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2802/5577] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:10:34.264856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cd343-74d1-483b-b1e2-bfe38db54d44 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:34.279486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cd343-74d1-483b-b1e2-bfe38db54d44 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:34.295937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb495b64-95ec-4c5b-9634-43ff2b29426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:34.298192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb495b64-95ec-4c5b-9634-43ff2b29426c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:34.298674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb495b64-95ec-4c5b-9634-43ff2b29426c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:34.299351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb495b64-95ec-4c5b-9634-43ff2b29426c admin admin] PATH_INFO: `/v3/projects/6b34f15c7add4f0ebcc86e575f423fb9/users/4baddd97278c44d7a1d121525a1fe999/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:34.303002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb495b64-95ec-4c5b-9634-43ff2b29426c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b34f15c7add4f0ebcc86e575f423fb9, user_id=4baddd97278c44d7a1d121525a1fe999, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:34.309175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb495b64-95ec-4c5b-9634-43ff2b29426c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:34.328195 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2776/5578] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:34 2022] PUT /identity/v3/projects/6b34f15c7add4f0ebcc86e575f423fb9/users/4baddd97278c44d7a1d121525a1fe999/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:34.338361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1ec9f-727f-4a45-aed1-73d9e4c9d696 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:34.338910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1ec9f-727f-4a45-aed1-73d9e4c9d696 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:34.339399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1ec9f-727f-4a45-aed1-73d9e4c9d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:34.436082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9ef1ec9f-727f-4a45-aed1-73d9e4c9d696 None None] MFA Rules not processed for user `4baddd97278c44d7a1d121525a1fe999`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:34.437875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9ef1ec9f-727f-4a45-aed1-73d9e4c9d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:34.687315 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2803/5579] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:34.688103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb495b64-95ec-4c5b-9634-43ff2b29426c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:34.812826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb495b64-95ec-4c5b-9634-43ff2b29426c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:34.826862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03964b16-b3d9-4394-aed2-213d3e98f05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:34.832805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03964b16-b3d9-4394-aed2-213d3e98f05f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:34.833251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03964b16-b3d9-4394-aed2-213d3e98f05f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:34.834278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03964b16-b3d9-4394-aed2-213d3e98f05f admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:34.836397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03964b16-b3d9-4394-aed2-213d3e98f05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:34.843359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03964b16-b3d9-4394-aed2-213d3e98f05f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:34.946591 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2777/5580] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:34 2022] POST /identity/v3/projects => generated 393 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:34.951738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1ec9f-727f-4a45-aed1-73d9e4c9d696 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:34.981718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1ec9f-727f-4a45-aed1-73d9e4c9d696 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:35.083359 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:35.151078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe13d67-7843-4724-95a2-3f317ffcccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:35.153859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe13d67-7843-4724-95a2-3f317ffcccaf admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:35.154527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe13d67-7843-4724-95a2-3f317ffcccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:35.154993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe13d67-7843-4724-95a2-3f317ffcccaf admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:35.155805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe13d67-7843-4724-95a2-3f317ffcccaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:35.160862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe13d67-7843-4724-95a2-3f317ffcccaf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:35.241616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03964b16-b3d9-4394-aed2-213d3e98f05f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:35.251532 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2804/5581] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:34 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:35.260316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03964b16-b3d9-4394-aed2-213d3e98f05f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:35.281349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96823a25-95c8-4c49-93ce-ede620b6e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:35.287023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823a25-95c8-4c49-93ce-ede620b6e010 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:35.287330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823a25-95c8-4c49-93ce-ede620b6e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:35.287614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823a25-95c8-4c49-93ce-ede620b6e010 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:35.291435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96823a25-95c8-4c49-93ce-ede620b6e010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:35.298871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96823a25-95c8-4c49-93ce-ede620b6e010 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:35.339521 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2778/5582] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:10:35.344041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe13d67-7843-4724-95a2-3f317ffcccaf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:35.365840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe13d67-7843-4724-95a2-3f317ffcccaf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:35.383098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c323d0e-eafb-443c-bf13-86d1a47a9766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:35.386666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c323d0e-eafb-443c-bf13-86d1a47a9766 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:35.386957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c323d0e-eafb-443c-bf13-86d1a47a9766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:35.387243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c323d0e-eafb-443c-bf13-86d1a47a9766 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:35.392733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c323d0e-eafb-443c-bf13-86d1a47a9766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:35.396749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c323d0e-eafb-443c-bf13-86d1a47a9766 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:35.428830 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2805/5583] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:35.433172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96823a25-95c8-4c49-93ce-ede620b6e010 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:35.461580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96823a25-95c8-4c49-93ce-ede620b6e010 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:35.490370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f8db1-30e0-46e8-9eaa-16ade3897247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:35.491340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f8db1-30e0-46e8-9eaa-16ade3897247 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:35.491787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f8db1-30e0-46e8-9eaa-16ade3897247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:35.492216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f8db1-30e0-46e8-9eaa-16ade3897247 admin admin] PATH_INFO: `/v3/projects/ca22623e61bd4ac3bc06ae80b3a0ae38/users/9439dc0c94cc4d2ba0b5e518c6d36e07/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:35.535899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f8db1-30e0-46e8-9eaa-16ade3897247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca22623e61bd4ac3bc06ae80b3a0ae38, user_id=9439dc0c94cc4d2ba0b5e518c6d36e07, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:35.538682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f8db1-30e0-46e8-9eaa-16ade3897247 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:35.589148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8a3e-d2f1-4e2d-a8b2-f6d1ea52a436 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:35.590291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8a3e-d2f1-4e2d-a8b2-f6d1ea52a436 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:35.591491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8a3e-d2f1-4e2d-a8b2-f6d1ea52a436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:35.596355 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2779/5584] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:35 2022] PUT /identity/v3/projects/ca22623e61bd4ac3bc06ae80b3a0ae38/users/9439dc0c94cc4d2ba0b5e518c6d36e07/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:35.656025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cc5f8a3e-d2f1-4e2d-a8b2-f6d1ea52a436 None None] MFA Rules not processed for user `9439dc0c94cc4d2ba0b5e518c6d36e07`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:35.657337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cc5f8a3e-d2f1-4e2d-a8b2-f6d1ea52a436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:35.800219 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2806/5585] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:35.809137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f8db1-30e0-46e8-9eaa-16ade3897247 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:35.812327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9f0f8db1-30e0-46e8-9eaa-16ade3897247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:36.060556 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:36.157051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f8db1-30e0-46e8-9eaa-16ade3897247 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:36.168229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732fdb-5420-4477-a224-08ca8f37daf6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:36.171788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732fdb-5420-4477-a224-08ca8f37daf6 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:36.173422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732fdb-5420-4477-a224-08ca8f37daf6 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:36.173973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732fdb-5420-4477-a224-08ca8f37daf6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:36.345733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63732fdb-5420-4477-a224-08ca8f37daf6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:36.352318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63732fdb-5420-4477-a224-08ca8f37daf6 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:36.388742 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2780/5586] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:35 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:37.442697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f8a3e-d2f1-4e2d-a8b2-f6d1ea52a436 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:37.660610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f8a3e-d2f1-4e2d-a8b2-f6d1ea52a436 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:37.672729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:37.673627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:37.674053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:37.674471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] PATH_INFO: `/v3/users/4baddd97278c44d7a1d121525a1fe999` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:37.675806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4baddd97278c44d7a1d121525a1fe999)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:37.678288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:37.771767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4baddd97278c44d7a1d121525a1fe999'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:37.773847 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:37.789161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4baddd97278c44d7a1d121525a1fe999'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:37.809494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4baddd97278c44d7a1d121525a1fe999'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:37.820105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4baddd97278c44d7a1d121525a1fe999'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:37.820980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4baddd97278c44d7a1d121525a1fe999'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:37.828876 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2807/5587] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:37 2022] DELETE /identity/v3/users/4baddd97278c44d7a1d121525a1fe999 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:37.833715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011956e-4953-4367-9668-6725c7330fcc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:37.834631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011956e-4953-4367-9668-6725c7330fcc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:37.835127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011956e-4953-4367-9668-6725c7330fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:37.875637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c011956e-4953-4367-9668-6725c7330fcc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:37.891821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c011956e-4953-4367-9668-6725c7330fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:38.109901 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2781/5588] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:10:38.117715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:38.119379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:38.273559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141d38f-2a8d-446c-9450-4d8caa8aeb9f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:38.282161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18d5d1-e5fa-4e7b-8a96-58e59ed387ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:38.282899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18d5d1-e5fa-4e7b-8a96-58e59ed387ba service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:38.284012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18d5d1-e5fa-4e7b-8a96-58e59ed387ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:38.284368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18d5d1-e5fa-4e7b-8a96-58e59ed387ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:38.307694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18d5d1-e5fa-4e7b-8a96-58e59ed387ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:38.310872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18d5d1-e5fa-4e7b-8a96-58e59ed387ba service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:38.336802 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2808/5589] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:39.117417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011956e-4953-4367-9668-6725c7330fcc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:39.118957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c011956e-4953-4367-9668-6725c7330fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:39.139404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011956e-4953-4367-9668-6725c7330fcc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:39.185267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:39.186331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:39.186618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:39.186904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] PATH_INFO: `/v3/projects/6b34f15c7add4f0ebcc86e575f423fb9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:39.191843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b34f15c7add4f0ebcc86e575f423fb9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:39.194166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:39.337501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b34f15c7add4f0ebcc86e575f423fb9', 'request_id': 'req-af23954e-60cc-46af-982e-cb6323c109d8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.358737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b34f15c7add4f0ebcc86e575f423fb9', 'request_id': 'req-af23954e-60cc-46af-982e-cb6323c109d8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.369193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b34f15c7add4f0ebcc86e575f423fb9', 'request_id': 'req-af23954e-60cc-46af-982e-cb6323c109d8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.373767 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:39.435628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] The token cache is being invalidate because project 6b34f15c7add4f0ebcc86e575f423fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:39.436656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.439374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.446894 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2782/5590] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:39 2022] DELETE /identity/v3/projects/6b34f15c7add4f0ebcc86e575f423fb9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:39.447842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18d5d1-e5fa-4e7b-8a96-58e59ed387ba service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:39.463500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18d5d1-e5fa-4e7b-8a96-58e59ed387ba service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:39.635425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:39.636995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:39.639569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:39.640865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] PATH_INFO: `/v3/users/9439dc0c94cc4d2ba0b5e518c6d36e07` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:39.645867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9439dc0c94cc4d2ba0b5e518c6d36e07)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:39.648028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:39.781482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9439dc0c94cc4d2ba0b5e518c6d36e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.813651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9439dc0c94cc4d2ba0b5e518c6d36e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.836915 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:39.849998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9439dc0c94cc4d2ba0b5e518c6d36e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.863450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9439dc0c94cc4d2ba0b5e518c6d36e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.864405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b6961fbf-ce7e-459d-a84c-21ab5962ef82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9439dc0c94cc4d2ba0b5e518c6d36e07'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:39.879685 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2809/5591] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:39 2022] DELETE /identity/v3/users/9439dc0c94cc4d2ba0b5e518c6d36e07 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:40.427063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:40.429691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:40.455578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23954e-60cc-46af-982e-cb6323c109d8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:40.624865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:40.625706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:40.629887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:40.630974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] PATH_INFO: `/v3/projects/ca22623e61bd4ac3bc06ae80b3a0ae38` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:40.632421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca22623e61bd4ac3bc06ae80b3a0ae38)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:40.635018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:40.807695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca22623e61bd4ac3bc06ae80b3a0ae38', 'request_id': 'req-2ac37680-5d1d-443a-8ae8-081ceead0737'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:40.823727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca22623e61bd4ac3bc06ae80b3a0ae38', 'request_id': 'req-2ac37680-5d1d-443a-8ae8-081ceead0737'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:40.837969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca22623e61bd4ac3bc06ae80b3a0ae38', 'request_id': 'req-2ac37680-5d1d-443a-8ae8-081ceead0737'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:40.860196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] The token cache is being invalidate because project ca22623e61bd4ac3bc06ae80b3a0ae38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:40.861660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:40.863197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:40.871428 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2783/5592] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:40 2022] DELETE /identity/v3/projects/ca22623e61bd4ac3bc06ae80b3a0ae38 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:40.874133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567190a3-b3e3-4423-95f2-3ed66e3be209 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:40.875425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567190a3-b3e3-4423-95f2-3ed66e3be209 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:40.876091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567190a3-b3e3-4423-95f2-3ed66e3be209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:40.995114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-567190a3-b3e3-4423-95f2-3ed66e3be209 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:41.002553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-567190a3-b3e3-4423-95f2-3ed66e3be209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:41.072412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:41.074156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:41.184472 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2810/5593] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:41.189649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3ad37-9961-403f-9da0-860fbb944fd5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:41.191032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3ad37-9961-403f-9da0-860fbb944fd5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:41.191456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3ad37-9961-403f-9da0-860fbb944fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:41.266891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5eb3ad37-9961-403f-9da0-860fbb944fd5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:41.271127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5eb3ad37-9961-403f-9da0-860fbb944fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:41.294369 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2811/5594] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:41.297278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3ad37-9961-403f-9da0-860fbb944fd5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:41.354610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3ad37-9961-403f-9da0-860fbb944fd5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:41.369684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3c3e6-0cdd-48ac-b991-99e5c3413d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:41.370459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3c3e6-0cdd-48ac-b991-99e5c3413d75 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:41.370875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3c3e6-0cdd-48ac-b991-99e5c3413d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:41.371243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3c3e6-0cdd-48ac-b991-99e5c3413d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:41.373500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3c3e6-0cdd-48ac-b991-99e5c3413d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:41.373918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3c3e6-0cdd-48ac-b991-99e5c3413d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:41.375679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3c3e6-0cdd-48ac-b991-99e5c3413d75 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:41.385431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac37680-5d1d-443a-8ae8-081ceead0737 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:41.391711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:41.392335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:41.392632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:41.392929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] PATH_INFO: `/v3/users/12d0a4421ba74c348f264f875ba21766` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:41.395487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d0a4421ba74c348f264f875ba21766)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:41.398085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:41.403622 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2812/5595] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:41.405045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3c3e6-0cdd-48ac-b991-99e5c3413d75 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:41.433754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3c3e6-0cdd-48ac-b991-99e5c3413d75 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:41.450560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e042b-f923-4cc2-8e00-f747fe02e496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:41.451272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e042b-f923-4cc2-8e00-f747fe02e496 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:41.451609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e042b-f923-4cc2-8e00-f747fe02e496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:41.452018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e042b-f923-4cc2-8e00-f747fe02e496 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:41.452661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e042b-f923-4cc2-8e00-f747fe02e496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:41.454740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e042b-f923-4cc2-8e00-f747fe02e496 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:41.469186 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:41.519077 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2813/5596] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:41 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:41.523471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e042b-f923-4cc2-8e00-f747fe02e496 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:41.546136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d0a4421ba74c348f264f875ba21766'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:41.599962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d0a4421ba74c348f264f875ba21766'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:41.618377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d0a4421ba74c348f264f875ba21766'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:41.644849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d0a4421ba74c348f264f875ba21766'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:41.646696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04a681fa-60d6-4dec-ab9f-3def3e269430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d0a4421ba74c348f264f875ba21766'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:41.667012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2784/5597] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:41 2022] DELETE /identity/v3/users/12d0a4421ba74c348f264f875ba21766 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:41.672033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b6219-90a6-4ddd-a871-833b72b01149 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:41.672556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b6219-90a6-4ddd-a871-833b72b01149 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:41.673545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b6219-90a6-4ddd-a871-833b72b01149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:41.714606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c06b6219-90a6-4ddd-a871-833b72b01149 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:41.716467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c06b6219-90a6-4ddd-a871-833b72b01149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:41.723903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e042b-f923-4cc2-8e00-f747fe02e496 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:41.830940 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:41.865723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393ee00-74a4-4244-a255-491d707d0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:41.866263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393ee00-74a4-4244-a255-491d707d0607 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:41.866595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393ee00-74a4-4244-a255-491d707d0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:41.866875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393ee00-74a4-4244-a255-491d707d0607 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:41.867516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393ee00-74a4-4244-a255-491d707d0607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:41.869498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393ee00-74a4-4244-a255-491d707d0607 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:41.877788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2785/5598] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:10:41.889881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b6219-90a6-4ddd-a871-833b72b01149 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:41.893033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c06b6219-90a6-4ddd-a871-833b72b01149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:41.924172 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2814/5599] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:41 2022] POST /identity/v3/users => generated 300 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:41.928075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393ee00-74a4-4244-a255-491d707d0607 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:41.933730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f393ee00-74a4-4244-a255-491d707d0607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:41.955701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393ee00-74a4-4244-a255-491d707d0607 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:41.981956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d2e27-ae97-4903-95c4-8fa1d69150e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:41.982644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d2e27-ae97-4903-95c4-8fa1d69150e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:41.982932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d2e27-ae97-4903-95c4-8fa1d69150e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:41.983208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d2e27-ae97-4903-95c4-8fa1d69150e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:41.984012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d2e27-ae97-4903-95c4-8fa1d69150e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:41.985738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d2e27-ae97-4903-95c4-8fa1d69150e0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:42.005784 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2815/5600] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:10:42.010314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d2e27-ae97-4903-95c4-8fa1d69150e0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:42.033626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d2e27-ae97-4903-95c4-8fa1d69150e0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:42.057222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0ed88-9870-419d-8f32-436786331ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:42.057916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0ed88-9870-419d-8f32-436786331ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:42.058201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0ed88-9870-419d-8f32-436786331ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:42.058475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0ed88-9870-419d-8f32-436786331ca4 admin admin] PATH_INFO: `/v3/projects/363c88804565491f8787c1518e711176/users/19c046581a27435988768de6571b012a/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:42.093558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b6219-90a6-4ddd-a871-833b72b01149 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:42.096398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0ed88-9870-419d-8f32-436786331ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363c88804565491f8787c1518e711176, user_id=19c046581a27435988768de6571b012a, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:42.101307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0ed88-9870-419d-8f32-436786331ca4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:42.105083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52394a89-370e-4c54-af68-98cc201be9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:42.105734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52394a89-370e-4c54-af68-98cc201be9cb service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:42.107045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52394a89-370e-4c54-af68-98cc201be9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:42.107348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52394a89-370e-4c54-af68-98cc201be9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:42.135036 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2816/5601] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:42 2022] PUT /identity/v3/projects/363c88804565491f8787c1518e711176/users/19c046581a27435988768de6571b012a/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:42.136939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52394a89-370e-4c54-af68-98cc201be9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:42.138447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52394a89-370e-4c54-af68-98cc201be9cb service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:42.139976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0ed88-9870-419d-8f32-436786331ca4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:42.169468 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2786/5602] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:10:42.239795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0ed88-9870-419d-8f32-436786331ca4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:42.247845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e16ed4-d937-49a4-b1b8-a5543d3c6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:42.248310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16ed4-d937-49a4-b1b8-a5543d3c6146 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:42.248593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16ed4-d937-49a4-b1b8-a5543d3c6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:42.248899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16ed4-d937-49a4-b1b8-a5543d3c6146 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:42.249548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e16ed4-d937-49a4-b1b8-a5543d3c6146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:42.251373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e16ed4-d937-49a4-b1b8-a5543d3c6146 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:42.265898 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2817/5603] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:42.270642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52394a89-370e-4c54-af68-98cc201be9cb service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:42.285652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52394a89-370e-4c54-af68-98cc201be9cb service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:42.290925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023093d-b06b-4234-a426-6e29a3e90742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:42.291602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023093d-b06b-4234-a426-6e29a3e90742 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:42.292085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023093d-b06b-4234-a426-6e29a3e90742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:42.292775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023093d-b06b-4234-a426-6e29a3e90742 admin admin] PATH_INFO: `/v3/projects/363c88804565491f8787c1518e711176/users/19c046581a27435988768de6571b012a/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:42.296607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023093d-b06b-4234-a426-6e29a3e90742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363c88804565491f8787c1518e711176, user_id=19c046581a27435988768de6571b012a, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:42.300348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023093d-b06b-4234-a426-6e29a3e90742 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:42.324707 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2787/5604] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:42 2022] PUT /identity/v3/projects/363c88804565491f8787c1518e711176/users/19c046581a27435988768de6571b012a/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:42.339289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c3753-0c57-4ab1-9bad-238e90e98ce0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:42.339662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c3753-0c57-4ab1-9bad-238e90e98ce0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:42.340055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c3753-0c57-4ab1-9bad-238e90e98ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:42.394722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1c3c3753-0c57-4ab1-9bad-238e90e98ce0 None None] MFA Rules not processed for user `19c046581a27435988768de6571b012a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:42.396880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1c3c3753-0c57-4ab1-9bad-238e90e98ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:42.531582 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2818/5605] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:42.532045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023093d-b06b-4234-a426-6e29a3e90742 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:42.660860 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:42.725530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c3753-0c57-4ab1-9bad-238e90e98ce0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:42.727896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1c3c3753-0c57-4ab1-9bad-238e90e98ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:42.836799 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:42.857123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023093d-b06b-4234-a426-6e29a3e90742 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:42.879175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b34a7e-be23-42f1-87d1-215d60c8b60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:42.879821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b34a7e-be23-42f1-87d1-215d60c8b60d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:42.880101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b34a7e-be23-42f1-87d1-215d60c8b60d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:42.880374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b34a7e-be23-42f1-87d1-215d60c8b60d admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:42.881056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b34a7e-be23-42f1-87d1-215d60c8b60d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:42.883014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b34a7e-be23-42f1-87d1-215d60c8b60d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:42.914836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c3753-0c57-4ab1-9bad-238e90e98ce0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:42.922634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:42.923515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:42.923770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:42.924052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] PATH_INFO: `/v3/projects/88fe70b6bdba416da837cab2a3ed032e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:42.941489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88fe70b6bdba416da837cab2a3ed032e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:42.943442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:42.994619 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2788/5606] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:42 2022] POST /identity/v3/projects => generated 387 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:10:43.002584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b34a7e-be23-42f1-87d1-215d60c8b60d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:43.113885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88fe70b6bdba416da837cab2a3ed032e', 'request_id': 'req-427a0b4f-6051-4ecf-a344-60988fe3ff23'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:43.130239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88fe70b6bdba416da837cab2a3ed032e', 'request_id': 'req-427a0b4f-6051-4ecf-a344-60988fe3ff23'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:43.145250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88fe70b6bdba416da837cab2a3ed032e', 'request_id': 'req-427a0b4f-6051-4ecf-a344-60988fe3ff23'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:43.177363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] The token cache is being invalidate because project 88fe70b6bdba416da837cab2a3ed032e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:43.177670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:43.179901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-427a0b4f-6051-4ecf-a344-60988fe3ff23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:43.191210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2819/5607] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:42 2022] DELETE /identity/v3/projects/88fe70b6bdba416da837cab2a3ed032e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:43.194117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6db58-5ac3-4082-bdf4-f8d3db39dd9d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:43.194432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6db58-5ac3-4082-bdf4-f8d3db39dd9d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:43.194828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6db58-5ac3-4082-bdf4-f8d3db39dd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:43.206301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b34a7e-be23-42f1-87d1-215d60c8b60d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:43.243974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-30d6db58-5ac3-4082-bdf4-f8d3db39dd9d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:43.248991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-30d6db58-5ac3-4082-bdf4-f8d3db39dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:43.397904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b134c-3675-4703-b7a4-e3907089cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:43.398542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b134c-3675-4703-b7a4-e3907089cd02 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:43.398823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b134c-3675-4703-b7a4-e3907089cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:43.399099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b134c-3675-4703-b7a4-e3907089cd02 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:43.399738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b134c-3675-4703-b7a4-e3907089cd02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:43.401893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b134c-3675-4703-b7a4-e3907089cd02 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:43.457281 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2820/5608] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:10:43.462698 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2789/5609] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:42 2022] POST /identity/v3/users => generated 294 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:43.470240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531fc0-e23f-4098-81c2-84801972fc33 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:43.472987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531fc0-e23f-4098-81c2-84801972fc33 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:43.472987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531fc0-e23f-4098-81c2-84801972fc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:43.475580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b134c-3675-4703-b7a4-e3907089cd02 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:43.482552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ff7b134c-3675-4703-b7a4-e3907089cd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:43.516494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b134c-3675-4703-b7a4-e3907089cd02 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:43.523391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1d531fc0-e23f-4098-81c2-84801972fc33 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:43.525121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1d531fc0-e23f-4098-81c2-84801972fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:43.531373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b283e3-6ae6-451b-a382-ebacfe2e3a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:43.531373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b283e3-6ae6-451b-a382-ebacfe2e3a92 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:43.531629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b283e3-6ae6-451b-a382-ebacfe2e3a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:43.531922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b283e3-6ae6-451b-a382-ebacfe2e3a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:43.535248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b283e3-6ae6-451b-a382-ebacfe2e3a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:43.538389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b283e3-6ae6-451b-a382-ebacfe2e3a92 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:43.554797 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2821/5610] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:43.556245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531fc0-e23f-4098-81c2-84801972fc33 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:43.564718 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2790/5611] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:43.576041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b283e3-6ae6-451b-a382-ebacfe2e3a92 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:43.582019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531fc0-e23f-4098-81c2-84801972fc33 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:43.597259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fc0b-479e-4c8b-b9a2-9f98998cd124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:43.597895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fc0b-479e-4c8b-b9a2-9f98998cd124 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:43.598450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fc0b-479e-4c8b-b9a2-9f98998cd124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:43.598727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fc0b-479e-4c8b-b9a2-9f98998cd124 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:43.599388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109fc0b-479e-4c8b-b9a2-9f98998cd124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:43.599697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109fc0b-479e-4c8b-b9a2-9f98998cd124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:43.603208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b283e3-6ae6-451b-a382-ebacfe2e3a92 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:43.612821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109fc0b-479e-4c8b-b9a2-9f98998cd124 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:43.627604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c297-d517-4b05-a292-1acfef06c5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:43.628278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c297-d517-4b05-a292-1acfef06c5cf admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:43.628516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c297-d517-4b05-a292-1acfef06c5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:43.632246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c297-d517-4b05-a292-1acfef06c5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:43.633115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6c297-d517-4b05-a292-1acfef06c5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:43.635017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6c297-d517-4b05-a292-1acfef06c5cf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:43.652502 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2822/5612] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:10:43.654705 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2791/5613] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:43.655052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fc0b-479e-4c8b-b9a2-9f98998cd124 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:43.659885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c297-d517-4b05-a292-1acfef06c5cf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:43.674086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fc0b-479e-4c8b-b9a2-9f98998cd124 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:43.686786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c297-d517-4b05-a292-1acfef06c5cf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:43.687872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a72474-d607-4947-80d6-0328e8f1150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:43.702334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a72474-d607-4947-80d6-0328e8f1150d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:43.703123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a72474-d607-4947-80d6-0328e8f1150d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:43.703123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a72474-d607-4947-80d6-0328e8f1150d admin admin] PATH_INFO: `/v3/projects/ccf43bcb5ec54b4aa1edae4af1c9d13f/users/35bee9fc5ac3433eb0273d2e154e09f6/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:43.710264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f7879-6169-4144-b516-ae369e57b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:43.712879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f7879-6169-4144-b516-ae369e57b4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:43.713494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f7879-6169-4144-b516-ae369e57b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:43.714038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f7879-6169-4144-b516-ae369e57b4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:43.717167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f7879-6169-4144-b516-ae369e57b4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:43.719639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f7879-6169-4144-b516-ae369e57b4a3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:43.755542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a72474-d607-4947-80d6-0328e8f1150d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf43bcb5ec54b4aa1edae4af1c9d13f, user_id=35bee9fc5ac3433eb0273d2e154e09f6, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:43.771965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a72474-d607-4947-80d6-0328e8f1150d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:43.828409 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2823/5614] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:43 2022] PUT /identity/v3/projects/ccf43bcb5ec54b4aa1edae4af1c9d13f/users/35bee9fc5ac3433eb0273d2e154e09f6/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:43.832093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963d003-b7f8-4915-bab8-db1386a761da None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:43.832611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963d003-b7f8-4915-bab8-db1386a761da None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:43.832908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963d003-b7f8-4915-bab8-db1386a761da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:43.842029 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2792/5615] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:43 2022] POST /identity/v3/projects => generated 391 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:43.845881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f7879-6169-4144-b516-ae369e57b4a3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:43.882199 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:43.915253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a963d003-b7f8-4915-bab8-db1386a761da None None] MFA Rules not processed for user `35bee9fc5ac3433eb0273d2e154e09f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:43.916856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a963d003-b7f8-4915-bab8-db1386a761da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:43.923136 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:44.031681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f7879-6169-4144-b516-ae369e57b4a3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:44.058357 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2824/5616] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:44.068384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963d003-b7f8-4915-bab8-db1386a761da None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:44.071696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2958cd-f19a-4f9e-8f0b-5924c6f84545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:44.073647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2958cd-f19a-4f9e-8f0b-5924c6f84545 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:44.073864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a963d003-b7f8-4915-bab8-db1386a761da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:44.075001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2958cd-f19a-4f9e-8f0b-5924c6f84545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:44.077144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2958cd-f19a-4f9e-8f0b-5924c6f84545 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:44.084429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2958cd-f19a-4f9e-8f0b-5924c6f84545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:44.097569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2958cd-f19a-4f9e-8f0b-5924c6f84545 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:44.170289 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2793/5617] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:43 2022] POST /identity/v3/users => generated 296 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:44.173683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2958cd-f19a-4f9e-8f0b-5924c6f84545 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:44.199228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2958cd-f19a-4f9e-8f0b-5924c6f84545 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:44.218250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec86c5-3fe0-4081-85cf-5588318fb0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:44.219172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec86c5-3fe0-4081-85cf-5588318fb0fc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:44.219673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec86c5-3fe0-4081-85cf-5588318fb0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:44.220173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec86c5-3fe0-4081-85cf-5588318fb0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:44.221101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec86c5-3fe0-4081-85cf-5588318fb0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:44.222954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec86c5-3fe0-4081-85cf-5588318fb0fc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:44.253797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963d003-b7f8-4915-bab8-db1386a761da None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:44.261980 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2794/5618] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:44.266549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2182-868f-47e9-b1c9-1fe5335c4ee5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:44.267200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2182-868f-47e9-b1c9-1fe5335c4ee5 service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:44.267484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2182-868f-47e9-b1c9-1fe5335c4ee5 service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:44.267765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2182-868f-47e9-b1c9-1fe5335c4ee5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:44.268601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec86c5-3fe0-4081-85cf-5588318fb0fc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:44.269724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a65b2182-868f-47e9-b1c9-1fe5335c4ee5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:44.308120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec86c5-3fe0-4081-85cf-5588318fb0fc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:44.356803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0c395-87bf-46d5-938e-687b6a97b090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:44.359107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0c395-87bf-46d5-938e-687b6a97b090 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:44.362544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0c395-87bf-46d5-938e-687b6a97b090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:44.363054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0c395-87bf-46d5-938e-687b6a97b090 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:44.366113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0c395-87bf-46d5-938e-687b6a97b090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:44.372802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0c395-87bf-46d5-938e-687b6a97b090 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:44.407860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2182-868f-47e9-b1c9-1fe5335c4ee5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:44.409387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2182-868f-47e9-b1c9-1fe5335c4ee5 service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:44.425389 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2795/5619] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:44.427272 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2825/5620] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:44.427446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0c395-87bf-46d5-938e-687b6a97b090 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:44.447984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0c395-87bf-46d5-938e-687b6a97b090 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:44.466353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f902cd-4f3d-4e94-8b24-560848f2e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:44.467280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f902cd-4f3d-4e94-8b24-560848f2e8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:44.467572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f902cd-4f3d-4e94-8b24-560848f2e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:44.467850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f902cd-4f3d-4e94-8b24-560848f2e8bc admin admin] PATH_INFO: `/v3/projects/1ac5c91bfe8e4692be683d1a71cc95fc/users/f298e21f07c144a2b569fb830057a3fe/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:44.516418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f902cd-4f3d-4e94-8b24-560848f2e8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac5c91bfe8e4692be683d1a71cc95fc, user_id=f298e21f07c144a2b569fb830057a3fe, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:44.522563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f902cd-4f3d-4e94-8b24-560848f2e8bc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:44.557851 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2796/5621] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:44 2022] PUT /identity/v3/projects/1ac5c91bfe8e4692be683d1a71cc95fc/users/f298e21f07c144a2b569fb830057a3fe/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:44.569735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a433e-a0c9-4869-a8b9-da9b36b3be68 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:44.570320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a433e-a0c9-4869-a8b9-da9b36b3be68 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:44.570913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a433e-a0c9-4869-a8b9-da9b36b3be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:44.658500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d11a433e-a0c9-4869-a8b9-da9b36b3be68 None None] MFA Rules not processed for user `f298e21f07c144a2b569fb830057a3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:44.659753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d11a433e-a0c9-4869-a8b9-da9b36b3be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:44.769313 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:44.825142 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2826/5622] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:44.826345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f902cd-4f3d-4e94-8b24-560848f2e8bc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:45.023326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f902cd-4f3d-4e94-8b24-560848f2e8bc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:45.040111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff621d-7a9e-4fc9-83ee-7d6b7abd357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:45.041977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff621d-7a9e-4fc9-83ee-7d6b7abd357d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:45.042911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff621d-7a9e-4fc9-83ee-7d6b7abd357d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:45.044922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff621d-7a9e-4fc9-83ee-7d6b7abd357d admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:45.045739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff621d-7a9e-4fc9-83ee-7d6b7abd357d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:45.051523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff621d-7a9e-4fc9-83ee-7d6b7abd357d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:45.151601 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2797/5623] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:44 2022] POST /identity/v3/projects => generated 391 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:45.157892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a433e-a0c9-4869-a8b9-da9b36b3be68 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:45.185280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a433e-a0c9-4869-a8b9-da9b36b3be68 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:45.400682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca7c95-2d49-48a8-8fd9-a325f4cc0808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:45.406488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca7c95-2d49-48a8-8fd9-a325f4cc0808 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:45.409130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca7c95-2d49-48a8-8fd9-a325f4cc0808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:45.409650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca7c95-2d49-48a8-8fd9-a325f4cc0808 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:45.410525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca7c95-2d49-48a8-8fd9-a325f4cc0808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:45.416754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca7c95-2d49-48a8-8fd9-a325f4cc0808 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:45.492807 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2827/5624] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:45 2022] POST /identity/v3/users => generated 302 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:45.493505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff621d-7a9e-4fc9-83ee-7d6b7abd357d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:45.510408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff621d-7a9e-4fc9-83ee-7d6b7abd357d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:45.534370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6fe1f-5dfe-4bb9-ac0d-0a4a316f58ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:45.535277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6fe1f-5dfe-4bb9-ac0d-0a4a316f58ad admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:45.535719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6fe1f-5dfe-4bb9-ac0d-0a4a316f58ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:45.536138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6fe1f-5dfe-4bb9-ac0d-0a4a316f58ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:45.537002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6fe1f-5dfe-4bb9-ac0d-0a4a316f58ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:45.538751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6fe1f-5dfe-4bb9-ac0d-0a4a316f58ad admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:45.603840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2798/5625] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:10:45.609279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca7c95-2d49-48a8-8fd9-a325f4cc0808 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:45.623172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca7c95-2d49-48a8-8fd9-a325f4cc0808 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:45.641083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191faa22-032e-4664-8bd0-cb19c20bcebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:45.641778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191faa22-032e-4664-8bd0-cb19c20bcebb admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:45.642067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191faa22-032e-4664-8bd0-cb19c20bcebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:45.642537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191faa22-032e-4664-8bd0-cb19c20bcebb admin admin] PATH_INFO: `/v3/projects/04afb8fc5028411c845f664f5e273587/users/098240814acc4d369fe5d352e0bcbd93/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:45.701162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191faa22-032e-4664-8bd0-cb19c20bcebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=04afb8fc5028411c845f664f5e273587, user_id=098240814acc4d369fe5d352e0bcbd93, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:45.704399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191faa22-032e-4664-8bd0-cb19c20bcebb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:45.757694 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2828/5626] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:45 2022] PUT /identity/v3/projects/04afb8fc5028411c845f664f5e273587/users/098240814acc4d369fe5d352e0bcbd93/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:45.761547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6fe1f-5dfe-4bb9-ac0d-0a4a316f58ad admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:45.780967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6fe1f-5dfe-4bb9-ac0d-0a4a316f58ad admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:45.891494 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:45.940873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545161f9-91f4-4ca9-be94-f248b6397558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:45.941970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545161f9-91f4-4ca9-be94-f248b6397558 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:45.942487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545161f9-91f4-4ca9-be94-f248b6397558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:45.943096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545161f9-91f4-4ca9-be94-f248b6397558 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:45.944335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545161f9-91f4-4ca9-be94-f248b6397558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:45.946221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545161f9-91f4-4ca9-be94-f248b6397558 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:45.966919 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2799/5627] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:45.967665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191faa22-032e-4664-8bd0-cb19c20bcebb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:45.986810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191faa22-032e-4664-8bd0-cb19c20bcebb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:46.014225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e894a0b-eb31-4bc1-8efd-c32f29240320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:46.014963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894a0b-eb31-4bc1-8efd-c32f29240320 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:46.015250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894a0b-eb31-4bc1-8efd-c32f29240320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:46.015526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894a0b-eb31-4bc1-8efd-c32f29240320 admin admin] PATH_INFO: `/v3/projects/04afb8fc5028411c845f664f5e273587/users/098240814acc4d369fe5d352e0bcbd93/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:46.024083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e894a0b-eb31-4bc1-8efd-c32f29240320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04afb8fc5028411c845f664f5e273587, user_id=098240814acc4d369fe5d352e0bcbd93, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:46.031338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e894a0b-eb31-4bc1-8efd-c32f29240320 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:46.080282 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2829/5628] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:45 2022] PUT /identity/v3/projects/04afb8fc5028411c845f664f5e273587/users/098240814acc4d369fe5d352e0bcbd93/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:46.092892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c8a32-ec06-4c4e-8ef8-3e050d2b2b18 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:46.092892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c8a32-ec06-4c4e-8ef8-3e050d2b2b18 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:46.093152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c8a32-ec06-4c4e-8ef8-3e050d2b2b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:46.136151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e894a0b-eb31-4bc1-8efd-c32f29240320 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:46.178271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7f7c8a32-ec06-4c4e-8ef8-3e050d2b2b18 None None] MFA Rules not processed for user `098240814acc4d369fe5d352e0bcbd93`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:46.179837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f7c8a32-ec06-4c4e-8ef8-3e050d2b2b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:46.311278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e894a0b-eb31-4bc1-8efd-c32f29240320 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:46.323993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:46.327259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:46.327560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:46.327819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] PATH_INFO: `/v3/users/19c046581a27435988768de6571b012a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:46.329905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c046581a27435988768de6571b012a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:46.332006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:46.348140 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2800/5629] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:46.361864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c8a32-ec06-4c4e-8ef8-3e050d2b2b18 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:46.363287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7f7c8a32-ec06-4c4e-8ef8-3e050d2b2b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:46.420331 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:46.445195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c046581a27435988768de6571b012a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:46.481499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c046581a27435988768de6571b012a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:46.505717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c046581a27435988768de6571b012a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:46.538749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c046581a27435988768de6571b012a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:46.538749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-695cfad9-eaad-4743-9b36-b8453fdd873d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c046581a27435988768de6571b012a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:46.550815 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2830/5630] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:46 2022] DELETE /identity/v3/users/19c046581a27435988768de6571b012a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:46.556536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b58fa2-0e16-424d-8481-9cebbd9b5dda None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:46.556852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b58fa2-0e16-424d-8481-9cebbd9b5dda None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:46.557131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b58fa2-0e16-424d-8481-9cebbd9b5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:46.589281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c8a32-ec06-4c4e-8ef8-3e050d2b2b18 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:46.606809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-96b58fa2-0e16-424d-8481-9cebbd9b5dda None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:46.609216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-96b58fa2-0e16-424d-8481-9cebbd9b5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:46.664602 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:46.674123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:46.675769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:46.676346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:46.676865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:46.682369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:46.747882 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2831/5631] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:46.763247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b58fa2-0e16-424d-8481-9cebbd9b5dda None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:46.765614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-96b58fa2-0e16-424d-8481-9cebbd9b5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:46.914050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:46.915767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:46.923681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b58fa2-0e16-424d-8481-9cebbd9b5dda None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:46.931559 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2801/5632] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:46.932685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1fd92-4a45-49c7-b611-b53fbb8e2cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:46.933492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1fd92-4a45-49c7-b611-b53fbb8e2cbf service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:46.934547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1fd92-4a45-49c7-b611-b53fbb8e2cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:46.936089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1fd92-4a45-49c7-b611-b53fbb8e2cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:46.987154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1fd92-4a45-49c7-b611-b53fbb8e2cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:46.988742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1fd92-4a45-49c7-b611-b53fbb8e2cbf service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:47.023877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:47.025333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:47.068993 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2832/5633] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:10:47.081051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4650b-6039-4845-b07f-240244de7e7d service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:47.091116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19becf8-c8cc-4088-bc67-cdb485fd925e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:47.091758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19becf8-c8cc-4088-bc67-cdb485fd925e service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:47.092044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19becf8-c8cc-4088-bc67-cdb485fd925e service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:47.092325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19becf8-c8cc-4088-bc67-cdb485fd925e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:47.097900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f19becf8-c8cc-4088-bc67-cdb485fd925e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:47.291745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19becf8-c8cc-4088-bc67-cdb485fd925e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:47.293868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19becf8-c8cc-4088-bc67-cdb485fd925e service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:47.329896 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2802/5634] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:10:47.919536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1fd92-4a45-49c7-b611-b53fbb8e2cbf service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:47.921246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-07e1fd92-4a45-49c7-b611-b53fbb8e2cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:47.966963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1fd92-4a45-49c7-b611-b53fbb8e2cbf service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:48.018117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:48.022437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:48.022737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:48.023021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] PATH_INFO: `/v3/projects/363c88804565491f8787c1518e711176` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:48.029149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=363c88804565491f8787c1518e711176)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:48.042960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:48.258877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363c88804565491f8787c1518e711176', 'request_id': 'req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.265133 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:48.276039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363c88804565491f8787c1518e711176', 'request_id': 'req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.291419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363c88804565491f8787c1518e711176', 'request_id': 'req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.332691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] The token cache is being invalidate because project 363c88804565491f8787c1518e711176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:48.333263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.339408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.345053 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2833/5635] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:47 2022] DELETE /identity/v3/projects/363c88804565491f8787c1518e711176 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:48.348738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19becf8-c8cc-4088-bc67-cdb485fd925e service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:48.362758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19becf8-c8cc-4088-bc67-cdb485fd925e service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:48.507700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:48.508921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:48.509427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:48.509923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] PATH_INFO: `/v3/users/35bee9fc5ac3433eb0273d2e154e09f6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:48.511536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bee9fc5ac3433eb0273d2e154e09f6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:48.514845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:48.602970 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:48.614918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bee9fc5ac3433eb0273d2e154e09f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.645539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bee9fc5ac3433eb0273d2e154e09f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.661705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bee9fc5ac3433eb0273d2e154e09f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.683097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bee9fc5ac3433eb0273d2e154e09f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.684655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c8388fb5-dd75-4920-8c08-834d907d0a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bee9fc5ac3433eb0273d2e154e09f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:48.709534 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2803/5636] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:48 2022] DELETE /identity/v3/users/35bee9fc5ac3433eb0273d2e154e09f6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:49.938011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:49.940638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:49.972436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683f87b-df49-47cd-ac0c-ce7b5c6abe2a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:50.187427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:50.188261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:50.188817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:50.189216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] PATH_INFO: `/v3/projects/ccf43bcb5ec54b4aa1edae4af1c9d13f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:50.193507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf43bcb5ec54b4aa1edae4af1c9d13f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:50.196028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:50.351866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf43bcb5ec54b4aa1edae4af1c9d13f', 'request_id': 'req-33fde17e-b02d-4552-8491-3db77aa47558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:50.379744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf43bcb5ec54b4aa1edae4af1c9d13f', 'request_id': 'req-33fde17e-b02d-4552-8491-3db77aa47558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:50.410012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf43bcb5ec54b4aa1edae4af1c9d13f', 'request_id': 'req-33fde17e-b02d-4552-8491-3db77aa47558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:50.453949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] The token cache is being invalidate because project ccf43bcb5ec54b4aa1edae4af1c9d13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:50.454467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:50.459296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-33fde17e-b02d-4552-8491-3db77aa47558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:50.464568 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2834/5637] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:49 2022] DELETE /identity/v3/projects/ccf43bcb5ec54b4aa1edae4af1c9d13f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:50.470145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44830b-bccc-4c00-978b-85fbf164baf3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:50.470831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44830b-bccc-4c00-978b-85fbf164baf3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:50.471334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44830b-bccc-4c00-978b-85fbf164baf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:50.513635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4a44830b-bccc-4c00-978b-85fbf164baf3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:50.520598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4a44830b-bccc-4c00-978b-85fbf164baf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:50.730068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db9c10-f83e-4be5-8167-212eb42118a7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:50.730524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db9c10-f83e-4be5-8167-212eb42118a7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:50.731028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db9c10-f83e-4be5-8167-212eb42118a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:50.737487 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2804/5638] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:50.784868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c7db9c10-f83e-4be5-8167-212eb42118a7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:50.789160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c7db9c10-f83e-4be5-8167-212eb42118a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:50.849682 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2835/5639] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:10:50.850633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44830b-bccc-4c00-978b-85fbf164baf3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:50.887480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44830b-bccc-4c00-978b-85fbf164baf3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:50.907965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be255a46-2607-4f31-b5db-31217b79097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:50.912796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255a46-2607-4f31-b5db-31217b79097f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:50.912796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255a46-2607-4f31-b5db-31217b79097f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:50.912796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255a46-2607-4f31-b5db-31217b79097f admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:50.912796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be255a46-2607-4f31-b5db-31217b79097f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:50.925633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be255a46-2607-4f31-b5db-31217b79097f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:50.930087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be255a46-2607-4f31-b5db-31217b79097f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:51.009858 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2805/5640] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:51.010361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db9c10-f83e-4be5-8167-212eb42118a7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:51.022998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db9c10-f83e-4be5-8167-212eb42118a7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:51.036470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17a2c9-3faf-4c7b-811b-1a90c43a88f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:51.037409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17a2c9-3faf-4c7b-811b-1a90c43a88f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:51.040003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17a2c9-3faf-4c7b-811b-1a90c43a88f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:51.040480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17a2c9-3faf-4c7b-811b-1a90c43a88f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:51.041331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17a2c9-3faf-4c7b-811b-1a90c43a88f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:51.055931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17a2c9-3faf-4c7b-811b-1a90c43a88f8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:51.200204 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2836/5641] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:51 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:51.201325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be255a46-2607-4f31-b5db-31217b79097f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:51.223272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be255a46-2607-4f31-b5db-31217b79097f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:51.460031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f52627-a543-4b5b-b865-e375bf3397ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:51.460191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f52627-a543-4b5b-b865-e375bf3397ba admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:51.463457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f52627-a543-4b5b-b865-e375bf3397ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:51.463457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f52627-a543-4b5b-b865-e375bf3397ba admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:51.468700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f52627-a543-4b5b-b865-e375bf3397ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:51.482802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f52627-a543-4b5b-b865-e375bf3397ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:51.560812 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2806/5642] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:51 2022] POST /identity/v3/users => generated 286 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:51.563118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17a2c9-3faf-4c7b-811b-1a90c43a88f8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:51.582191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17a2c9-3faf-4c7b-811b-1a90c43a88f8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:51.602280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010ac21-5c2a-4bcd-8b68-2eea298bbb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:51.603013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010ac21-5c2a-4bcd-8b68-2eea298bbb91 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:51.603295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010ac21-5c2a-4bcd-8b68-2eea298bbb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:51.603612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010ac21-5c2a-4bcd-8b68-2eea298bbb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:51.604312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010ac21-5c2a-4bcd-8b68-2eea298bbb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:51.606204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010ac21-5c2a-4bcd-8b68-2eea298bbb91 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:51.630386 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2837/5643] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:51.632320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f52627-a543-4b5b-b865-e375bf3397ba admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:51.657784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f52627-a543-4b5b-b865-e375bf3397ba admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:51.667240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadaa7e-62b2-447e-a0c3-32b705db73ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:51.667903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadaa7e-62b2-447e-a0c3-32b705db73ec admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:51.668181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadaa7e-62b2-447e-a0c3-32b705db73ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:51.668714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadaa7e-62b2-447e-a0c3-32b705db73ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:51.671569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadaa7e-62b2-447e-a0c3-32b705db73ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:51.673787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadaa7e-62b2-447e-a0c3-32b705db73ec admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:51.704388 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2807/5644] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:51.709375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010ac21-5c2a-4bcd-8b68-2eea298bbb91 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:51.725372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010ac21-5c2a-4bcd-8b68-2eea298bbb91 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:51.733129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac8f33-ea0c-4c7d-ac5c-0761441aaed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:51.734097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8f33-ea0c-4c7d-ac5c-0761441aaed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:51.734444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8f33-ea0c-4c7d-ac5c-0761441aaed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:51.735006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8f33-ea0c-4c7d-ac5c-0761441aaed3 admin admin] PATH_INFO: `/v3/projects/f3e514526bac4184876b5cd98553c941/users/e501a5261baa40d389c2a63e6da9ffe3/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:51.764491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac8f33-ea0c-4c7d-ac5c-0761441aaed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e514526bac4184876b5cd98553c941, user_id=e501a5261baa40d389c2a63e6da9ffe3, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:51.767410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac8f33-ea0c-4c7d-ac5c-0761441aaed3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:51.790185 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2838/5645] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:51 2022] PUT /identity/v3/projects/f3e514526bac4184876b5cd98553c941/users/e501a5261baa40d389c2a63e6da9ffe3/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:51.801898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a19ca-226a-487b-8fe3-c52b26d09474 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:51.802271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a19ca-226a-487b-8fe3-c52b26d09474 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:51.802503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a19ca-226a-487b-8fe3-c52b26d09474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:51.838492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-220a19ca-226a-487b-8fe3-c52b26d09474 None None] MFA Rules not processed for user `e501a5261baa40d389c2a63e6da9ffe3`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:51.839898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-220a19ca-226a-487b-8fe3-c52b26d09474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:51.858204 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:51.941197 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2808/5646] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:51.955015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac8f33-ea0c-4c7d-ac5c-0761441aaed3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:51.956987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8dac8f33-ea0c-4c7d-ac5c-0761441aaed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:51.972827 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:52.069214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac8f33-ea0c-4c7d-ac5c-0761441aaed3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:52.073067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcecc03-a987-4c4a-8173-1030563a2e49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:52.073890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcecc03-a987-4c4a-8173-1030563a2e49 service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:52.074885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcecc03-a987-4c4a-8173-1030563a2e49 service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:52.074885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcecc03-a987-4c4a-8173-1030563a2e49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:52.098810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcecc03-a987-4c4a-8173-1030563a2e49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:52.100276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcecc03-a987-4c4a-8173-1030563a2e49 service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:52.111862 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2839/5647] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:53.873438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a19ca-226a-487b-8fe3-c52b26d09474 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:53.979768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a19ca-226a-487b-8fe3-c52b26d09474 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:53.991447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:53.992166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:53.992451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:53.992783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] PATH_INFO: `/v3/users/e501a5261baa40d389c2a63e6da9ffe3` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:53.995506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e501a5261baa40d389c2a63e6da9ffe3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:54.001056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:54.121508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e501a5261baa40d389c2a63e6da9ffe3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:54.148825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e501a5261baa40d389c2a63e6da9ffe3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:54.170957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e501a5261baa40d389c2a63e6da9ffe3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:54.183867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e501a5261baa40d389c2a63e6da9ffe3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:54.184888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e501a5261baa40d389c2a63e6da9ffe3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:54.205683 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2809/5648] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:53 2022] DELETE /identity/v3/users/e501a5261baa40d389c2a63e6da9ffe3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:54.212146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c05d1c-8460-4058-8729-2bcfd0e1a25c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:54.213130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c05d1c-8460-4058-8729-2bcfd0e1a25c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:54.213550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c05d1c-8460-4058-8729-2bcfd0e1a25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:54.261857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d0c05d1c-8460-4058-8729-2bcfd0e1a25c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:54.263348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d0c05d1c-8460-4058-8729-2bcfd0e1a25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:54.433004 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2840/5649] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:54.455335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:54.456946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:54.575503 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:54.672771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2672ad-8c16-4d6c-9699-5fa3d5b80e26 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:54.682983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64427f-6821-452d-a9da-ca714e266d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:54.684443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64427f-6821-452d-a9da-ca714e266d0b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:54.684896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64427f-6821-452d-a9da-ca714e266d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:54.685312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64427f-6821-452d-a9da-ca714e266d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:54.712866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64427f-6821-452d-a9da-ca714e266d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:54.714680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64427f-6821-452d-a9da-ca714e266d0b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:54.739656 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2810/5650] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:56.203121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c05d1c-8460-4058-8729-2bcfd0e1a25c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:56.205172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d0c05d1c-8460-4058-8729-2bcfd0e1a25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:56.260185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c05d1c-8460-4058-8729-2bcfd0e1a25c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:56.276880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:56.277770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:56.278360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:56.278953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] PATH_INFO: `/v3/projects/f3e514526bac4184876b5cd98553c941` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:56.280947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e514526bac4184876b5cd98553c941)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:56.283038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:56.440813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e514526bac4184876b5cd98553c941', 'request_id': 'req-d1176bd8-053b-4c17-88f1-e45bafd440f3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:56.452205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e514526bac4184876b5cd98553c941', 'request_id': 'req-d1176bd8-053b-4c17-88f1-e45bafd440f3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:56.462648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e514526bac4184876b5cd98553c941', 'request_id': 'req-d1176bd8-053b-4c17-88f1-e45bafd440f3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:56.483019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] The token cache is being invalidate because project f3e514526bac4184876b5cd98553c941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:10:56.484048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:56.485260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1176bd8-053b-4c17-88f1-e45bafd440f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:56.488130 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2841/5651] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:56 2022] DELETE /identity/v3/projects/f3e514526bac4184876b5cd98553c941 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:56.492925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec8ff-e203-4c5f-ae04-d229177c4e1e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:56.493454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec8ff-e203-4c5f-ae04-d229177c4e1e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:56.493534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec8ff-e203-4c5f-ae04-d229177c4e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:56.538969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ecdec8ff-e203-4c5f-ae04-d229177c4e1e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:56.540181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ecdec8ff-e203-4c5f-ae04-d229177c4e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:56.669409 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2811/5652] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:56.677827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0a1cf-85e2-4a11-8f7f-a48a19323e7f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:56.677827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0a1cf-85e2-4a11-8f7f-a48a19323e7f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:56.677827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0a1cf-85e2-4a11-8f7f-a48a19323e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:56.727930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-61e0a1cf-85e2-4a11-8f7f-a48a19323e7f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:56.729406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-61e0a1cf-85e2-4a11-8f7f-a48a19323e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:56.749942 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2842/5653] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:56.753880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdec8ff-e203-4c5f-ae04-d229177c4e1e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:56.799820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdec8ff-e203-4c5f-ae04-d229177c4e1e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:56.808312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72362146-61b8-40ff-a0ef-ee25f85557f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:56.809275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72362146-61b8-40ff-a0ef-ee25f85557f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:56.809664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72362146-61b8-40ff-a0ef-ee25f85557f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:56.811456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72362146-61b8-40ff-a0ef-ee25f85557f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:56.812244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72362146-61b8-40ff-a0ef-ee25f85557f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:10:56.813285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72362146-61b8-40ff-a0ef-ee25f85557f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:56.815010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72362146-61b8-40ff-a0ef-ee25f85557f0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:56.845029 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2812/5654] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:10:56.847504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0a1cf-85e2-4a11-8f7f-a48a19323e7f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:56.859119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0a1cf-85e2-4a11-8f7f-a48a19323e7f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:56.873966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c4752-fac1-4afa-9e50-4c3369e8f53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:56.874775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c4752-fac1-4afa-9e50-4c3369e8f53b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:56.875164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c4752-fac1-4afa-9e50-4c3369e8f53b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:56.875545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c4752-fac1-4afa-9e50-4c3369e8f53b admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:56.876301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c4752-fac1-4afa-9e50-4c3369e8f53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:56.878373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c4752-fac1-4afa-9e50-4c3369e8f53b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:56.946762 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2843/5655] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:10:56 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:56.951940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72362146-61b8-40ff-a0ef-ee25f85557f0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:56.963146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72362146-61b8-40ff-a0ef-ee25f85557f0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:57.139236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11d5c3-a5fb-44f6-a550-02e2ef692d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:57.139880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11d5c3-a5fb-44f6-a550-02e2ef692d79 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:57.140175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11d5c3-a5fb-44f6-a550-02e2ef692d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:57.140476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11d5c3-a5fb-44f6-a550-02e2ef692d79 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:57.141124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11d5c3-a5fb-44f6-a550-02e2ef692d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:57.143550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11d5c3-a5fb-44f6-a550-02e2ef692d79 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:57.207301 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2813/5656] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:10:56 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:10:57.208514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c4752-fac1-4afa-9e50-4c3369e8f53b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:57.252028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c4752-fac1-4afa-9e50-4c3369e8f53b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:57.272568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0de16-130c-469a-8bab-6d78292d7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:57.274110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0de16-130c-469a-8bab-6d78292d7e45 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:57.275298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0de16-130c-469a-8bab-6d78292d7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:57.276767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0de16-130c-469a-8bab-6d78292d7e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:57.279202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0de16-130c-469a-8bab-6d78292d7e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:57.285293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0de16-130c-469a-8bab-6d78292d7e45 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:57.291363 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:57.320604 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2844/5657] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:57.324987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11d5c3-a5fb-44f6-a550-02e2ef692d79 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:57.341612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11d5c3-a5fb-44f6-a550-02e2ef692d79 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:57.359934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9bada-cbbc-47bb-80e7-9ad33c9a0db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:57.360544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bada-cbbc-47bb-80e7-9ad33c9a0db9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:57.360864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bada-cbbc-47bb-80e7-9ad33c9a0db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:57.361144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bada-cbbc-47bb-80e7-9ad33c9a0db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:57.361801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9bada-cbbc-47bb-80e7-9ad33c9a0db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:57.364113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9bada-cbbc-47bb-80e7-9ad33c9a0db9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:57.377155 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2814/5658] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:10:57.381366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0de16-130c-469a-8bab-6d78292d7e45 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:57.393500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0de16-130c-469a-8bab-6d78292d7e45 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:57.407270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6ac21-0b7f-4877-ad59-512dbad13571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:57.408181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6ac21-0b7f-4877-ad59-512dbad13571 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:57.408567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6ac21-0b7f-4877-ad59-512dbad13571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:57.408971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6ac21-0b7f-4877-ad59-512dbad13571 admin admin] PATH_INFO: `/v3/projects/f0d4bfc329af447b9953fc34e137686e/users/8ef4fd0706214723b4c2479b75152695/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:57.437081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6ac21-0b7f-4877-ad59-512dbad13571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d4bfc329af447b9953fc34e137686e, user_id=8ef4fd0706214723b4c2479b75152695, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:57.440826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6ac21-0b7f-4877-ad59-512dbad13571 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:57.466309 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2845/5659] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:10:57 2022] PUT /identity/v3/projects/f0d4bfc329af447b9953fc34e137686e/users/8ef4fd0706214723b4c2479b75152695/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:10:57.480276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963a8d-9037-44c7-8c82-d9d8b967d38b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:57.482934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963a8d-9037-44c7-8c82-d9d8b967d38b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:57.483917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963a8d-9037-44c7-8c82-d9d8b967d38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:57.585106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2b963a8d-9037-44c7-8c82-d9d8b967d38b None None] MFA Rules not processed for user `8ef4fd0706214723b4c2479b75152695`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:57.586346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2b963a8d-9037-44c7-8c82-d9d8b967d38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:57.684722 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:57.781787 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2815/5660] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:57.792451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6ac21-0b7f-4877-ad59-512dbad13571 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:57.795940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d5b6ac21-0b7f-4877-ad59-512dbad13571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:57.966371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6ac21-0b7f-4877-ad59-512dbad13571 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:57.989499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446a96-d78d-4501-aeea-b63ef90bca3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:57.990408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446a96-d78d-4501-aeea-b63ef90bca3a service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:57.990408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446a96-d78d-4501-aeea-b63ef90bca3a service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:57.990694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446a96-d78d-4501-aeea-b63ef90bca3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:58.015268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55446a96-d78d-4501-aeea-b63ef90bca3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:58.017009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55446a96-d78d-4501-aeea-b63ef90bca3a service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:58.049175 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2846/5661] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:58.451885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963a8d-9037-44c7-8c82-d9d8b967d38b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:58.545272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963a8d-9037-44c7-8c82-d9d8b967d38b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:58.550704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:58.551632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:58.552069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:58.552497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] PATH_INFO: `/v3/users/8ef4fd0706214723b4c2479b75152695` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:58.553834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef4fd0706214723b4c2479b75152695)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:58.556153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:58.667985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef4fd0706214723b4c2479b75152695'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:58.689482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef4fd0706214723b4c2479b75152695'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:58.703509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef4fd0706214723b4c2479b75152695'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:58.718105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef4fd0706214723b4c2479b75152695'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:58.718596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef4fd0706214723b4c2479b75152695'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:58.728675 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2816/5662] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:58 2022] DELETE /identity/v3/users/8ef4fd0706214723b4c2479b75152695 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:58.733271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872acb6a-7f67-402f-a617-56b37a1f54fe None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:58.733833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872acb6a-7f67-402f-a617-56b37a1f54fe None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:58.733833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872acb6a-7f67-402f-a617-56b37a1f54fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:58.775306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-872acb6a-7f67-402f-a617-56b37a1f54fe None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:58.776709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-872acb6a-7f67-402f-a617-56b37a1f54fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:58.940580 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2847/5663] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:58.952429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:58.953943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:59.076762 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:59.094576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063e039-4477-4379-af0e-251215fd0d19 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:59.102303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137bf9a-3079-48c6-bf53-a838d4c92dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:59.103304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137bf9a-3079-48c6-bf53-a838d4c92dbb service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:59.105591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137bf9a-3079-48c6-bf53-a838d4c92dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:59.106160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137bf9a-3079-48c6-bf53-a838d4c92dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:59.133349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137bf9a-3079-48c6-bf53-a838d4c92dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:59.137155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137bf9a-3079-48c6-bf53-a838d4c92dbb service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:59.165713 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2817/5664] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:10:59.372877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872acb6a-7f67-402f-a617-56b37a1f54fe None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:59.374350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-872acb6a-7f67-402f-a617-56b37a1f54fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:59.406237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872acb6a-7f67-402f-a617-56b37a1f54fe None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:59.421362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:59.422003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:59.422286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:59.422559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] PATH_INFO: `/v3/users/f298e21f07c144a2b569fb830057a3fe` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:59.425304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f298e21f07c144a2b569fb830057a3fe)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:59.427268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:10:59.539916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f298e21f07c144a2b569fb830057a3fe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:59.573450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f298e21f07c144a2b569fb830057a3fe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:59.602160 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:59.611356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f298e21f07c144a2b569fb830057a3fe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:59.639538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f298e21f07c144a2b569fb830057a3fe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:59.640769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f298e21f07c144a2b569fb830057a3fe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:10:59.659614 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2848/5665] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:10:59 2022] DELETE /identity/v3/users/f298e21f07c144a2b569fb830057a3fe => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:10:59.664256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856e405-c1f5-4712-8cec-4841d251683e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:59.664549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856e405-c1f5-4712-8cec-4841d251683e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:59.664860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856e405-c1f5-4712-8cec-4841d251683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:59.706252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7856e405-c1f5-4712-8cec-4841d251683e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:10:59.708930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7856e405-c1f5-4712-8cec-4841d251683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:59.815362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:59.817593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:59.922305 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2818/5666] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:10:59.931168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856e405-c1f5-4712-8cec-4841d251683e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:10:59.937044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7856e405-c1f5-4712-8cec-4841d251683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:10:59.954254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd686fee-29ca-4449-a8e0-a53cf402403f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:10:59.969240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:10:59.969899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:10:59.970183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:10:59.970457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] PATH_INFO: `/v3/projects/f0d4bfc329af447b9953fc34e137686e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:10:59.979589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d4bfc329af447b9953fc34e137686e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:10:59.986570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:00.085597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d4bfc329af447b9953fc34e137686e', 'request_id': 'req-aca28e92-9c5a-4924-b4c8-8e52db2da39a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:00.106793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d4bfc329af447b9953fc34e137686e', 'request_id': 'req-aca28e92-9c5a-4924-b4c8-8e52db2da39a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:00.114879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d4bfc329af447b9953fc34e137686e', 'request_id': 'req-aca28e92-9c5a-4924-b4c8-8e52db2da39a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:00.151648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] The token cache is being invalidate because project f0d4bfc329af447b9953fc34e137686e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:00.151992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:00.154027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aca28e92-9c5a-4924-b4c8-8e52db2da39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:00.159652 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2849/5667] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:10:59 2022] DELETE /identity/v3/projects/f0d4bfc329af447b9953fc34e137686e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:00.164121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28340e4a-9b38-463b-b86a-610c092255bb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:00.164409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28340e4a-9b38-463b-b86a-610c092255bb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:00.164705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28340e4a-9b38-463b-b86a-610c092255bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:00.185554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856e405-c1f5-4712-8cec-4841d251683e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:00.222600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-28340e4a-9b38-463b-b86a-610c092255bb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:00.223855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-28340e4a-9b38-463b-b86a-610c092255bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:00.372807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f71aa-41ee-4d9a-a569-d7f40f341b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:00.373447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f71aa-41ee-4d9a-a569-d7f40f341b0d service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:00.373733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f71aa-41ee-4d9a-a569-d7f40f341b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:00.374015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f71aa-41ee-4d9a-a569-d7f40f341b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:00.378369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-328f71aa-41ee-4d9a-a569-d7f40f341b0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:00.382139 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2850/5668] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:00.395674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6bb9-cdf6-4e7f-a667-36745e1ff1eb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:00.395999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6bb9-cdf6-4e7f-a667-36745e1ff1eb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:00.396282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6bb9-cdf6-4e7f-a667-36745e1ff1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:00.421400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f71aa-41ee-4d9a-a569-d7f40f341b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:00.422876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f71aa-41ee-4d9a-a569-d7f40f341b0d service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:00.450374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c99f6bb9-cdf6-4e7f-a667-36745e1ff1eb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:00.451616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c99f6bb9-cdf6-4e7f-a667-36745e1ff1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:00.452179 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2819/5669] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:11:00.475103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2851/5670] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:00.479049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f71aa-41ee-4d9a-a569-d7f40f341b0d service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:00.494962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f71aa-41ee-4d9a-a569-d7f40f341b0d service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:00.508394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663a53-7ad0-45b5-92f4-96b0eeef5d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:00.509078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663a53-7ad0-45b5-92f4-96b0eeef5d0f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:00.509362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663a53-7ad0-45b5-92f4-96b0eeef5d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:00.509642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663a53-7ad0-45b5-92f4-96b0eeef5d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:00.510638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663a53-7ad0-45b5-92f4-96b0eeef5d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:11:00.510948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663a53-7ad0-45b5-92f4-96b0eeef5d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:00.519013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663a53-7ad0-45b5-92f4-96b0eeef5d0f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:00.554825 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2820/5671] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:00.556017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6bb9-cdf6-4e7f-a667-36745e1ff1eb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:00.580538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6bb9-cdf6-4e7f-a667-36745e1ff1eb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:00.586662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54766a92-a11a-4dfc-aa29-b7e504483044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:00.587414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54766a92-a11a-4dfc-aa29-b7e504483044 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:00.587799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54766a92-a11a-4dfc-aa29-b7e504483044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:00.588181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54766a92-a11a-4dfc-aa29-b7e504483044 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:00.604420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54766a92-a11a-4dfc-aa29-b7e504483044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:00.617389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54766a92-a11a-4dfc-aa29-b7e504483044 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:00.679167 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:00.747417 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2852/5672] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:00 2022] POST /identity/v3/projects => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:00.750948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663a53-7ad0-45b5-92f4-96b0eeef5d0f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:00.766760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663a53-7ad0-45b5-92f4-96b0eeef5d0f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:00.867902 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:00.936561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bb10a-680d-4e48-87f8-d13b2024a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:00.937301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bb10a-680d-4e48-87f8-d13b2024a9ed admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:00.937646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bb10a-680d-4e48-87f8-d13b2024a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:00.937993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bb10a-680d-4e48-87f8-d13b2024a9ed admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:00.938700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bb10a-680d-4e48-87f8-d13b2024a9ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:00.940740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bb10a-680d-4e48-87f8-d13b2024a9ed admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:00.986981 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2821/5673] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:00 2022] POST /identity/v3/users => generated 281 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:00.990953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54766a92-a11a-4dfc-aa29-b7e504483044 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:01.016076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54766a92-a11a-4dfc-aa29-b7e504483044 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:01.023959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5901b1-5ae1-4895-80b0-240bf11b8ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:01.024911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5901b1-5ae1-4895-80b0-240bf11b8ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:01.025051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5901b1-5ae1-4895-80b0-240bf11b8ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:01.025330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5901b1-5ae1-4895-80b0-240bf11b8ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:01.026001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5901b1-5ae1-4895-80b0-240bf11b8ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:01.028527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5901b1-5ae1-4895-80b0-240bf11b8ef0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:01.043083 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2853/5674] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:01.046991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bb10a-680d-4e48-87f8-d13b2024a9ed admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:01.058514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bb10a-680d-4e48-87f8-d13b2024a9ed admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:01.068054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d2480-2018-4edb-8cab-fc92f6e1ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:01.069123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d2480-2018-4edb-8cab-fc92f6e1ee42 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:01.069469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d2480-2018-4edb-8cab-fc92f6e1ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:01.069838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d2480-2018-4edb-8cab-fc92f6e1ee42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:01.070644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d2480-2018-4edb-8cab-fc92f6e1ee42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:01.072499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d2480-2018-4edb-8cab-fc92f6e1ee42 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:01.092327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2822/5675] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:01.094980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5901b1-5ae1-4895-80b0-240bf11b8ef0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:01.111142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5901b1-5ae1-4895-80b0-240bf11b8ef0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:01.149212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fe62c-e36b-405f-9d1a-1b386f33ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:01.150487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fe62c-e36b-405f-9d1a-1b386f33ebf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:01.150985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fe62c-e36b-405f-9d1a-1b386f33ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:01.151373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fe62c-e36b-405f-9d1a-1b386f33ebf2 admin admin] PATH_INFO: `/v3/projects/1f171f256b944ee2815119bf696888c6/users/a10eeb0b471b4629aa3cfeaaa75247b2/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:01.169631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fe62c-e36b-405f-9d1a-1b386f33ebf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f171f256b944ee2815119bf696888c6, user_id=a10eeb0b471b4629aa3cfeaaa75247b2, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:01.172489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fe62c-e36b-405f-9d1a-1b386f33ebf2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:01.202497 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2854/5676] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:01 2022] PUT /identity/v3/projects/1f171f256b944ee2815119bf696888c6/users/a10eeb0b471b4629aa3cfeaaa75247b2/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:01.204594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d24681-5e1c-48ea-b38f-03992552c4bc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:01.207573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d24681-5e1c-48ea-b38f-03992552c4bc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:01.209117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d24681-5e1c-48ea-b38f-03992552c4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:01.306629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a8d24681-5e1c-48ea-b38f-03992552c4bc None None] MFA Rules not processed for user `a10eeb0b471b4629aa3cfeaaa75247b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:01.308774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a8d24681-5e1c-48ea-b38f-03992552c4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:01.505237 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2823/5677] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:01.516042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fe62c-e36b-405f-9d1a-1b386f33ebf2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:01.637962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d24681-5e1c-48ea-b38f-03992552c4bc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:01.659251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a8d24681-5e1c-48ea-b38f-03992552c4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:01.697178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fe62c-e36b-405f-9d1a-1b386f33ebf2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:01.711035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:01.716202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:01.716650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:01.717085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] PATH_INFO: `/v3/users/a10eeb0b471b4629aa3cfeaaa75247b2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:01.721497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10eeb0b471b4629aa3cfeaaa75247b2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:01.723576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:01.863207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10eeb0b471b4629aa3cfeaaa75247b2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:01.880863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10eeb0b471b4629aa3cfeaaa75247b2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:01.897248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10eeb0b471b4629aa3cfeaaa75247b2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:01.898742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d24681-5e1c-48ea-b38f-03992552c4bc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:01.919270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:01.923399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:01.924429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:01.924429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] PATH_INFO: `/v3/projects/1ac5c91bfe8e4692be683d1a71cc95fc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:01.928982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac5c91bfe8e4692be683d1a71cc95fc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:01.930921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:01.931854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10eeb0b471b4629aa3cfeaaa75247b2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:01.934153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50b03abd-10a6-47e4-99c4-47724bef7675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10eeb0b471b4629aa3cfeaaa75247b2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:01.955862 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2855/5678] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:01 2022] DELETE /identity/v3/users/a10eeb0b471b4629aa3cfeaaa75247b2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:01.960816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f475d-c37e-454f-a25c-4098dc9b6e4c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:01.963180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f475d-c37e-454f-a25c-4098dc9b6e4c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:01.963828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f475d-c37e-454f-a25c-4098dc9b6e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:02.012332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ac7f475d-c37e-454f-a25c-4098dc9b6e4c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:02.015030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ac7f475d-c37e-454f-a25c-4098dc9b6e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:02.061245 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:02.063894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac5c91bfe8e4692be683d1a71cc95fc', 'request_id': 'req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.079833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac5c91bfe8e4692be683d1a71cc95fc', 'request_id': 'req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.081341 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:02.087908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac5c91bfe8e4692be683d1a71cc95fc', 'request_id': 'req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.102151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] The token cache is being invalidate because project 1ac5c91bfe8e4692be683d1a71cc95fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:02.102633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.103629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.107102 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2824/5679] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:01 2022] DELETE /identity/v3/projects/1ac5c91bfe8e4692be683d1a71cc95fc => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:02.110595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:02.116560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:02.196001 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2856/5680] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:02.209201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f475d-c37e-454f-a25c-4098dc9b6e4c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:02.211030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ac7f475d-c37e-454f-a25c-4098dc9b6e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:02.236117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468e894-3ab3-4931-b8c7-a0fdbcdd5a0b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:02.245350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:02.246446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:02.246830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:02.247258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] PATH_INFO: `/v3/users/098240814acc4d369fe5d352e0bcbd93` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:02.249923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098240814acc4d369fe5d352e0bcbd93)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:02.254324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:02.338060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f475d-c37e-454f-a25c-4098dc9b6e4c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:02.353272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098240814acc4d369fe5d352e0bcbd93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.379551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098240814acc4d369fe5d352e0bcbd93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.395442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098240814acc4d369fe5d352e0bcbd93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.407402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098240814acc4d369fe5d352e0bcbd93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.408778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098240814acc4d369fe5d352e0bcbd93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.417728 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2825/5681] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:02 2022] DELETE /identity/v3/users/098240814acc4d369fe5d352e0bcbd93 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:02.438194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:02.439220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:02.439735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:02.440397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:02.443952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:02.500458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:02.501972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:02.529833 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2857/5682] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:11:02.578158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:02.579699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:02.729932 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:02.742804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58c315-af76-4866-909a-07c714941456 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:02.757339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:02.759694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:02.760065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:02.762041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] PATH_INFO: `/v3/users/fa1f3b94587e468d8c6dd9f134665691` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:02.765638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1f3b94587e468d8c6dd9f134665691)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:02.769508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:02.889353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1f3b94587e468d8c6dd9f134665691'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.920903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1f3b94587e468d8c6dd9f134665691'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.934896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1f3b94587e468d8c6dd9f134665691'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.945683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1f3b94587e468d8c6dd9f134665691'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.950391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1f3b94587e468d8c6dd9f134665691'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:02.984058 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2826/5683] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:02 2022] DELETE /identity/v3/users/fa1f3b94587e468d8c6dd9f134665691 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:03.132530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:03.138675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:03.156251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de62ec-57af-4a10-9fe6-451bff9af725 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:03.320852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:03.323551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:03.324744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:03.326322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] PATH_INFO: `/v3/projects/04afb8fc5028411c845f664f5e273587` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:03.328243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:03.328636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04afb8fc5028411c845f664f5e273587)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:03.329802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:03.330784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:03.355536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2acb-9039-46f7-83bb-62eca7470fee admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:03.369337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:03.371398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:03.371775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:03.372206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] PATH_INFO: `/v3/projects/1f171f256b944ee2815119bf696888c6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:03.374449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f171f256b944ee2815119bf696888c6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:03.376650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:03.464124 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:03.508947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04afb8fc5028411c845f664f5e273587', 'request_id': 'req-f0828840-6cdd-43cd-b006-82b2a29d2254'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.519079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f171f256b944ee2815119bf696888c6', 'request_id': 'req-b9c3ce6a-f111-4875-b90a-9338a3525165'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.524198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04afb8fc5028411c845f664f5e273587', 'request_id': 'req-f0828840-6cdd-43cd-b006-82b2a29d2254'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.540797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f171f256b944ee2815119bf696888c6', 'request_id': 'req-b9c3ce6a-f111-4875-b90a-9338a3525165'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.544429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04afb8fc5028411c845f664f5e273587', 'request_id': 'req-f0828840-6cdd-43cd-b006-82b2a29d2254'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.549882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f171f256b944ee2815119bf696888c6', 'request_id': 'req-b9c3ce6a-f111-4875-b90a-9338a3525165'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.559894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] The token cache is being invalidate because project 04afb8fc5028411c845f664f5e273587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:03.560196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.560986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.570427 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2858/5684] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:03 2022] DELETE /identity/v3/projects/04afb8fc5028411c845f664f5e273587 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:03.571278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:03.572847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:03.582397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] The token cache is being invalidate because project 1f171f256b944ee2815119bf696888c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:03.582778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.583502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9c3ce6a-f111-4875-b90a-9338a3525165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.589042 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2827/5685] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:03 2022] DELETE /identity/v3/projects/1f171f256b944ee2815119bf696888c6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:03.589042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385007a-6f79-4901-b1b3-0f26cde7ea9d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:03.589042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385007a-6f79-4901-b1b3-0f26cde7ea9d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:03.589042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385007a-6f79-4901-b1b3-0f26cde7ea9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:03.617782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4385007a-6f79-4901-b1b3-0f26cde7ea9d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:03.619015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4385007a-6f79-4901-b1b3-0f26cde7ea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:03.666475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828840-6cdd-43cd-b006-82b2a29d2254 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:03.694319 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:03.718958 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2828/5686] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:03.722641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa419-1162-46b8-b55c-febbe476baff None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:03.725777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa419-1162-46b8-b55c-febbe476baff None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:03.726434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa419-1162-46b8-b55c-febbe476baff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:03.758947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-328fa419-1162-46b8-b55c-febbe476baff None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:03.760241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-328fa419-1162-46b8-b55c-febbe476baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:03.770875 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2829/5687] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:03.771912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130aa6f-b3b5-4183-a770-abedf755250b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:03.772203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130aa6f-b3b5-4183-a770-abedf755250b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:03.772480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130aa6f-b3b5-4183-a770-abedf755250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:03.802638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f130aa6f-b3b5-4183-a770-abedf755250b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:03.803903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f130aa6f-b3b5-4183-a770-abedf755250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:03.805618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:03.807396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:03.807692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:03.808030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] PATH_INFO: `/v3/projects/7f6213a887b044f49207f366ca8f5980` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:03.809978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6213a887b044f49207f366ca8f5980)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:03.813803 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2830/5688] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:03.814722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130aa6f-b3b5-4183-a770-abedf755250b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:03.816590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:03.820126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f130aa6f-b3b5-4183-a770-abedf755250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:03.928443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130aa6f-b3b5-4183-a770-abedf755250b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:03.936177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6213a887b044f49207f366ca8f5980', 'request_id': 'req-81d01f26-1354-4fc5-bd8c-751cded7f800'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.946636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6213a887b044f49207f366ca8f5980', 'request_id': 'req-81d01f26-1354-4fc5-bd8c-751cded7f800'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.954322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6213a887b044f49207f366ca8f5980', 'request_id': 'req-81d01f26-1354-4fc5-bd8c-751cded7f800'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.970060 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:03.979409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] The token cache is being invalidate because project 7f6213a887b044f49207f366ca8f5980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:03.980754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.982032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-81d01f26-1354-4fc5-bd8c-751cded7f800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:03.988896 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2859/5689] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:03 2022] DELETE /identity/v3/projects/7f6213a887b044f49207f366ca8f5980 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:03.995037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d5e7-b488-4a01-9df5-e8ec5ea039bd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:03.995479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d5e7-b488-4a01-9df5-e8ec5ea039bd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:03.996368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d5e7-b488-4a01-9df5-e8ec5ea039bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.020817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-20e0d5e7-b488-4a01-9df5-e8ec5ea039bd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:04.021590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b0d18-3e8b-4f7b-9adf-b413e8689969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.022044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-20e0d5e7-b488-4a01-9df5-e8ec5ea039bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:04.022237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0d18-3e8b-4f7b-9adf-b413e8689969 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.022486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0d18-3e8b-4f7b-9adf-b413e8689969 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.022757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0d18-3e8b-4f7b-9adf-b413e8689969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.025235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f46b0d18-3e8b-4f7b-9adf-b413e8689969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:04.101236 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2860/5690] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:04.101236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0d5e7-b488-4a01-9df5-e8ec5ea039bd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.101236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-20e0d5e7-b488-4a01-9df5-e8ec5ea039bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:04.114886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0d18-3e8b-4f7b-9adf-b413e8689969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.116518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0d18-3e8b-4f7b-9adf-b413e8689969 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.117989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0d5e7-b488-4a01-9df5-e8ec5ea039bd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.125548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a08cc-4e2c-4d08-a298-b646071e6d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.126179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a08cc-4e2c-4d08-a298-b646071e6d09 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.126466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a08cc-4e2c-4d08-a298-b646071e6d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.127014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a08cc-4e2c-4d08-a298-b646071e6d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.128377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a08cc-4e2c-4d08-a298-b646071e6d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:11:04.128818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a08cc-4e2c-4d08-a298-b646071e6d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.130524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a08cc-4e2c-4d08-a298-b646071e6d09 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.138668 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2831/5691] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:04.140292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c399fb0-7b38-42c9-8a51-6ddd60ee8846 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.140778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c399fb0-7b38-42c9-8a51-6ddd60ee8846 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.141234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c399fb0-7b38-42c9-8a51-6ddd60ee8846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.149812 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2861/5692] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:04.149812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc6ff-0e8a-475d-bed0-42e5e54d0bee None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.149812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc6ff-0e8a-475d-bed0-42e5e54d0bee None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.149812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc6ff-0e8a-475d-bed0-42e5e54d0bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.165563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0c399fb0-7b38-42c9-8a51-6ddd60ee8846 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:04.167390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0c399fb0-7b38-42c9-8a51-6ddd60ee8846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:04.174047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3dfdc6ff-0e8a-475d-bed0-42e5e54d0bee None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:04.175255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3dfdc6ff-0e8a-475d-bed0-42e5e54d0bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:04.178208 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:04.185258 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2862/5693] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:04.186193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc6ff-0e8a-475d-bed0-42e5e54d0bee None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.196692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc6ff-0e8a-475d-bed0-42e5e54d0bee None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.202541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdbe8a-6666-4d5e-adbf-147ab42c37a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.203161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdbe8a-6666-4d5e-adbf-147ab42c37a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.203584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdbe8a-6666-4d5e-adbf-147ab42c37a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.203858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdbe8a-6666-4d5e-adbf-147ab42c37a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.204516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdbe8a-6666-4d5e-adbf-147ab42c37a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:11:04.204851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdbe8a-6666-4d5e-adbf-147ab42c37a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.206858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdbe8a-6666-4d5e-adbf-147ab42c37a7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.234177 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2863/5694] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:04.235534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdbe8a-6666-4d5e-adbf-147ab42c37a7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.248111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdbe8a-6666-4d5e-adbf-147ab42c37a7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.254450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fbc91-dc21-4d5e-9910-cff9844dd591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.255100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fbc91-dc21-4d5e-9910-cff9844dd591 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.255378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fbc91-dc21-4d5e-9910-cff9844dd591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.255702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fbc91-dc21-4d5e-9910-cff9844dd591 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.256331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fbc91-dc21-4d5e-9910-cff9844dd591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.258359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fbc91-dc21-4d5e-9910-cff9844dd591 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.284759 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2832/5695] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:11:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:04.286126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c127ea0-cec0-4029-b4d7-e7d38c07e42f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.286477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c127ea0-cec0-4029-b4d7-e7d38c07e42f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.286815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c127ea0-cec0-4029-b4d7-e7d38c07e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.322261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0c127ea0-cec0-4029-b4d7-e7d38c07e42f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:04.323664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0c127ea0-cec0-4029-b4d7-e7d38c07e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:04.332458 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2833/5696] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:04.333158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c127ea0-cec0-4029-b4d7-e7d38c07e42f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.333813 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2864/5697] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:04 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:04.334966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fbc91-dc21-4d5e-9910-cff9844dd591 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.337256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5c0fbc91-dc21-4d5e-9910-cff9844dd591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:04.343720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c127ea0-cec0-4029-b4d7-e7d38c07e42f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.457502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea4135-e455-4f1e-9fd8-775df72ead9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.458135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea4135-e455-4f1e-9fd8-775df72ead9b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.458418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea4135-e455-4f1e-9fd8-775df72ead9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.458696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea4135-e455-4f1e-9fd8-775df72ead9b admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.459337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea4135-e455-4f1e-9fd8-775df72ead9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.461291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea4135-e455-4f1e-9fd8-775df72ead9b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.527661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fbc91-dc21-4d5e-9910-cff9844dd591 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.532909 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2834/5698] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:04 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:04.533986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea4135-e455-4f1e-9fd8-775df72ead9b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.553118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e106252-ee48-4244-a852-edbc180d033c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.553757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e106252-ee48-4244-a852-edbc180d033c service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.554035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e106252-ee48-4244-a852-edbc180d033c service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.554307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e106252-ee48-4244-a852-edbc180d033c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.651630 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:04.666737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e106252-ee48-4244-a852-edbc180d033c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.666737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e106252-ee48-4244-a852-edbc180d033c service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.678565 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2865/5699] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:11:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:11:04.680992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea4135-e455-4f1e-9fd8-775df72ead9b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.682483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e106252-ee48-4244-a852-edbc180d033c service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.693436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51498c3-535a-4f95-99d2-e0846b7c5d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.694286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51498c3-535a-4f95-99d2-e0846b7c5d55 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.694564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51498c3-535a-4f95-99d2-e0846b7c5d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.694895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51498c3-535a-4f95-99d2-e0846b7c5d55 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.695571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51498c3-535a-4f95-99d2-e0846b7c5d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.700091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51498c3-535a-4f95-99d2-e0846b7c5d55 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.710414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e106252-ee48-4244-a852-edbc180d033c service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.716898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228cbe4-d80d-41fd-a362-77505869e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.725259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228cbe4-d80d-41fd-a362-77505869e915 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.725657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228cbe4-d80d-41fd-a362-77505869e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.726095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228cbe4-d80d-41fd-a362-77505869e915 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.727414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228cbe4-d80d-41fd-a362-77505869e915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:11:04.727883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228cbe4-d80d-41fd-a362-77505869e915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.733436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228cbe4-d80d-41fd-a362-77505869e915 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.753809 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2835/5700] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:04 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:04.754686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51498c3-535a-4f95-99d2-e0846b7c5d55 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.768421 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2866/5701] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:04.769350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228cbe4-d80d-41fd-a362-77505869e915 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.780414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51498c3-535a-4f95-99d2-e0846b7c5d55 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.785171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228cbe4-d80d-41fd-a362-77505869e915 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.791911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52451234-a340-4d54-a7f8-56d5284b1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.792373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52451234-a340-4d54-a7f8-56d5284b1b34 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.793279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52451234-a340-4d54-a7f8-56d5284b1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.793565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52451234-a340-4d54-a7f8-56d5284b1b34 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.794209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52451234-a340-4d54-a7f8-56d5284b1b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.796137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52451234-a340-4d54-a7f8-56d5284b1b34 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.806882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724e2cf-2edb-481e-bf03-4adffeda13a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.807527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724e2cf-2edb-481e-bf03-4adffeda13a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.807785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724e2cf-2edb-481e-bf03-4adffeda13a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.808698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724e2cf-2edb-481e-bf03-4adffeda13a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.809413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724e2cf-2edb-481e-bf03-4adffeda13a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.810996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724e2cf-2edb-481e-bf03-4adffeda13a8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.837827 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2836/5702] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:04 2022] POST /identity/v3/users => generated 292 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:04.839407 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2867/5703] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:04.841625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52451234-a340-4d54-a7f8-56d5284b1b34 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.843176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724e2cf-2edb-481e-bf03-4adffeda13a8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.858271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52451234-a340-4d54-a7f8-56d5284b1b34 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.868258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724e2cf-2edb-481e-bf03-4adffeda13a8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.871731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1ce83-d15d-4f27-a68f-cc2c6adf04da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.872361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ce83-d15d-4f27-a68f-cc2c6adf04da admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.872664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ce83-d15d-4f27-a68f-cc2c6adf04da admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.873443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ce83-d15d-4f27-a68f-cc2c6adf04da admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.874210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1ce83-d15d-4f27-a68f-cc2c6adf04da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.876775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1ce83-d15d-4f27-a68f-cc2c6adf04da admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.876911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306d4aa-a8f4-46f3-935b-0484a535dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.877467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d4aa-a8f4-46f3-935b-0484a535dfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.877772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d4aa-a8f4-46f3-935b-0484a535dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.878153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d4aa-a8f4-46f3-935b-0484a535dfd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.878918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306d4aa-a8f4-46f3-935b-0484a535dfd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.880717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306d4aa-a8f4-46f3-935b-0484a535dfd0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.888519 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:04.899984 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2868/5704] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:04.901035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306d4aa-a8f4-46f3-935b-0484a535dfd0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.922250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306d4aa-a8f4-46f3-935b-0484a535dfd0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.927948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1b7bb-4c6d-4ef3-9e3a-46968bfa448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.928577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1b7bb-4c6d-4ef3-9e3a-46968bfa448d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.928950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1b7bb-4c6d-4ef3-9e3a-46968bfa448d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.929238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1b7bb-4c6d-4ef3-9e3a-46968bfa448d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.930904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1b7bb-4c6d-4ef3-9e3a-46968bfa448d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.932738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1b7bb-4c6d-4ef3-9e3a-46968bfa448d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.950686 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2869/5705] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:04.950686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1b7bb-4c6d-4ef3-9e3a-46968bfa448d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.963242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1b7bb-4c6d-4ef3-9e3a-46968bfa448d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:04.969461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10e8fc-20dd-48e9-98ad-d2f440989c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:04.970298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10e8fc-20dd-48e9-98ad-d2f440989c97 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:04.970589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10e8fc-20dd-48e9-98ad-d2f440989c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:04.971094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10e8fc-20dd-48e9-98ad-d2f440989c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:04.971802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10e8fc-20dd-48e9-98ad-d2f440989c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:04.973886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10e8fc-20dd-48e9-98ad-d2f440989c97 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:04.986474 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2837/5706] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:04 2022] POST /identity/v3/projects => generated 357 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:04.988567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1ce83-d15d-4f27-a68f-cc2c6adf04da admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:04.993059 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2870/5707] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:04.993059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10e8fc-20dd-48e9-98ad-d2f440989c97 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:05.006735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10e8fc-20dd-48e9-98ad-d2f440989c97 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:05.098012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1ce83-d15d-4f27-a68f-cc2c6adf04da admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:05.103241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebaaad-78d0-4f48-a388-a03a7a254602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:05.103705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81e795-732b-4d64-9d3e-7bbd5f18d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:05.104062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebaaad-78d0-4f48-a388-a03a7a254602 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.104346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebaaad-78d0-4f48-a388-a03a7a254602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.105309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebaaad-78d0-4f48-a388-a03a7a254602 admin admin] PATH_INFO: `/v3/projects/b98d13da461545be9445d07ebffe51f6/users/f999b44dd2a243eaa874a13d0d79ad40/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:05.106859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81e795-732b-4d64-9d3e-7bbd5f18d8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.107354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81e795-732b-4d64-9d3e-7bbd5f18d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.107808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81e795-732b-4d64-9d3e-7bbd5f18d8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:05.108867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81e795-732b-4d64-9d3e-7bbd5f18d8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:05.111262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81e795-732b-4d64-9d3e-7bbd5f18d8a5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:05.132831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebaaad-78d0-4f48-a388-a03a7a254602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98d13da461545be9445d07ebffe51f6, user_id=f999b44dd2a243eaa874a13d0d79ad40, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:05.135826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebaaad-78d0-4f48-a388-a03a7a254602 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:05.161826 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2871/5708] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:04 2022] POST /identity/v3/users => generated 279 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:05.163320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81e795-732b-4d64-9d3e-7bbd5f18d8a5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:05.169621 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2838/5709] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:04 2022] PUT /identity/v3/projects/b98d13da461545be9445d07ebffe51f6/users/f999b44dd2a243eaa874a13d0d79ad40/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:05.178581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebaaad-78d0-4f48-a388-a03a7a254602 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:05.187662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81e795-732b-4d64-9d3e-7bbd5f18d8a5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:05.303816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df8b2e-e6e4-40c9-86fa-2124431911da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:05.304513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8b2e-e6e4-40c9-86fa-2124431911da admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.304827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8b2e-e6e4-40c9-86fa-2124431911da admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.305110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8b2e-e6e4-40c9-86fa-2124431911da admin admin] PATH_INFO: `/v3/projects/3cc23cf780cf445aac0a4f7bef125640/users/39d455530cf945d590c1b00cc45e238b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:05.327474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebaaad-78d0-4f48-a388-a03a7a254602 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:05.333116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c4e45-4a0b-47ee-8521-37e492bd912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:05.333770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c4e45-4a0b-47ee-8521-37e492bd912e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.334051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c4e45-4a0b-47ee-8521-37e492bd912e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.334349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c4e45-4a0b-47ee-8521-37e492bd912e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:05.334844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df8b2e-e6e4-40c9-86fa-2124431911da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc23cf780cf445aac0a4f7bef125640, user_id=39d455530cf945d590c1b00cc45e238b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:05.335050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c4e45-4a0b-47ee-8521-37e492bd912e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:05.337396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c4e45-4a0b-47ee-8521-37e492bd912e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:05.338825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df8b2e-e6e4-40c9-86fa-2124431911da admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:05.354111 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2839/5710] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:05.356059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2408a-0ee7-43ad-8eb9-51ab76e67ee6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.356445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2408a-0ee7-43ad-8eb9-51ab76e67ee6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.356919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2408a-0ee7-43ad-8eb9-51ab76e67ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:05.368083 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2872/5711] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:05 2022] PUT /identity/v3/projects/3cc23cf780cf445aac0a4f7bef125640/users/39d455530cf945d590c1b00cc45e238b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:05.369384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df8b2e-e6e4-40c9-86fa-2124431911da admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:05.374920 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:05.596367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c4f2408a-0ee7-43ad-8eb9-51ab76e67ee6 None None] MFA Rules not processed for user `f999b44dd2a243eaa874a13d0d79ad40`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:05.596367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c4f2408a-0ee7-43ad-8eb9-51ab76e67ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:05.598228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df8b2e-e6e4-40c9-86fa-2124431911da admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:05.598228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c77ff9-bd93-49e5-8fbb-d61af45a20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:05.598228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c77ff9-bd93-49e5-8fbb-d61af45a20c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.598228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c77ff9-bd93-49e5-8fbb-d61af45a20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.598875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c77ff9-bd93-49e5-8fbb-d61af45a20c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:05.598875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c77ff9-bd93-49e5-8fbb-d61af45a20c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:05.598875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c77ff9-bd93-49e5-8fbb-d61af45a20c9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:05.598875 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2873/5712] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:05.598875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd89add-4b1c-4ae3-bef8-a9d1ebdba68b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.598875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd89add-4b1c-4ae3-bef8-a9d1ebdba68b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.599809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd89add-4b1c-4ae3-bef8-a9d1ebdba68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:05.609311 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:05.625319 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2840/5713] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:05.626224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2408a-0ee7-43ad-8eb9-51ab76e67ee6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:05.645947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bcd89add-4b1c-4ae3-bef8-a9d1ebdba68b None None] MFA Rules not processed for user `39d455530cf945d590c1b00cc45e238b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:05.647235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bcd89add-4b1c-4ae3-bef8-a9d1ebdba68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:05.653806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2408a-0ee7-43ad-8eb9-51ab76e67ee6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:05.663512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa23044-4e95-4cc6-8c10-127d8d86feb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:05.665134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa23044-4e95-4cc6-8c10-127d8d86feb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.665761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa23044-4e95-4cc6-8c10-127d8d86feb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.666237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa23044-4e95-4cc6-8c10-127d8d86feb4 admin admin] PATH_INFO: `/v3/projects/da9626fec00f4cf8a828c5aa04641c99/users/aca5e21098f6401490f9920cfa5df36e/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:05.706506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa23044-4e95-4cc6-8c10-127d8d86feb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9626fec00f4cf8a828c5aa04641c99, user_id=aca5e21098f6401490f9920cfa5df36e, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:05.709200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa23044-4e95-4cc6-8c10-127d8d86feb4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:05.738775 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2841/5714] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:05 2022] PUT /identity/v3/projects/da9626fec00f4cf8a828c5aa04641c99/users/aca5e21098f6401490f9920cfa5df36e/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:05.742665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa23044-4e95-4cc6-8c10-127d8d86feb4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:05.751771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-baa23044-4e95-4cc6-8c10-127d8d86feb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:05.839033 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2874/5715] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:05.841946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804dba7-3d51-4c54-955f-f43a29418129 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.842437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804dba7-3d51-4c54-955f-f43a29418129 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.842986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804dba7-3d51-4c54-955f-f43a29418129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:05.893277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6804dba7-3d51-4c54-955f-f43a29418129 None None] MFA Rules not processed for user `aca5e21098f6401490f9920cfa5df36e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:05.897300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6804dba7-3d51-4c54-955f-f43a29418129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:05.933516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa23044-4e95-4cc6-8c10-127d8d86feb4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:05.945218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2df2-5645-49cb-8bf0-ffd4f79806a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:05.945945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2df2-5645-49cb-8bf0-ffd4f79806a0 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:05.946300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2df2-5645-49cb-8bf0-ffd4f79806a0 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:05.946771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2df2-5645-49cb-8bf0-ffd4f79806a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:06.138137 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2875/5716] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:06.139339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804dba7-3d51-4c54-955f-f43a29418129 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:06.185325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a2df2-5645-49cb-8bf0-ffd4f79806a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:06.187654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a2df2-5645-49cb-8bf0-ffd4f79806a0 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:06.208416 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:06.220679 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2842/5717] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:06.221692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2df2-5645-49cb-8bf0-ffd4f79806a0 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:06.364005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804dba7-3d51-4c54-955f-f43a29418129 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:06.382836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab93b-9ed9-4572-916d-af1c8c5d7a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:06.383216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab93b-9ed9-4572-916d-af1c8c5d7a1a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:06.383501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab93b-9ed9-4572-916d-af1c8c5d7a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:06.383781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab93b-9ed9-4572-916d-af1c8c5d7a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:06.384586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ab93b-9ed9-4572-916d-af1c8c5d7a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:06.392378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ab93b-9ed9-4572-916d-af1c8c5d7a1a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:06.430864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2df2-5645-49cb-8bf0-ffd4f79806a0 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:06.437133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:06.437503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:06.437787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:06.438070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] PATH_INFO: `/v3/users/aca5e21098f6401490f9920cfa5df36e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:06.439680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca5e21098f6401490f9920cfa5df36e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:06.441822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:06.500890 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2876/5718] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:06 2022] POST /identity/v3/projects => generated 379 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:06.504549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab93b-9ed9-4572-916d-af1c8c5d7a1a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:06.506280 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:06.545013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca5e21098f6401490f9920cfa5df36e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:06.610186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca5e21098f6401490f9920cfa5df36e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:06.623913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca5e21098f6401490f9920cfa5df36e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:06.636593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca5e21098f6401490f9920cfa5df36e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:06.639250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0eaf2a7c-ffd5-460d-8161-1a775410726b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca5e21098f6401490f9920cfa5df36e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:06.656614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab93b-9ed9-4572-916d-af1c8c5d7a1a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:06.668279 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2843/5719] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:06 2022] DELETE /identity/v3/users/aca5e21098f6401490f9920cfa5df36e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:06.671034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fed13-aa03-453d-bcb0-3fb766919230 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:06.671325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fed13-aa03-453d-bcb0-3fb766919230 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:06.676355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fed13-aa03-453d-bcb0-3fb766919230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:06.741581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3a1fed13-aa03-453d-bcb0-3fb766919230 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:06.748257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3a1fed13-aa03-453d-bcb0-3fb766919230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:06.762820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f83149-ecc8-4c0c-a6f3-60a8d5fe7781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:06.763454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f83149-ecc8-4c0c-a6f3-60a8d5fe7781 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:06.763746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f83149-ecc8-4c0c-a6f3-60a8d5fe7781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:06.764302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f83149-ecc8-4c0c-a6f3-60a8d5fe7781 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:06.765195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f83149-ecc8-4c0c-a6f3-60a8d5fe7781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:06.767540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f83149-ecc8-4c0c-a6f3-60a8d5fe7781 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:06.784382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2844/5720] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:06.804170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fed13-aa03-453d-bcb0-3fb766919230 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:06.805804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3a1fed13-aa03-453d-bcb0-3fb766919230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:06.846695 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2877/5721] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:06 2022] POST /identity/v3/users => generated 290 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:06.859143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f83149-ecc8-4c0c-a6f3-60a8d5fe7781 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:06.873775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-55f83149-ecc8-4c0c-a6f3-60a8d5fe7781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:06.911043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f83149-ecc8-4c0c-a6f3-60a8d5fe7781 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:06.922744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033955fe-c083-4456-8823-ae8417fc1ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:06.923379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033955fe-c083-4456-8823-ae8417fc1ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:06.923663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033955fe-c083-4456-8823-ae8417fc1ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:06.923940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033955fe-c083-4456-8823-ae8417fc1ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:06.924582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033955fe-c083-4456-8823-ae8417fc1ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:06.926311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033955fe-c083-4456-8823-ae8417fc1ef2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:06.965181 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2878/5722] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:06.969700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033955fe-c083-4456-8823-ae8417fc1ef2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:06.997897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033955fe-c083-4456-8823-ae8417fc1ef2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:07.018149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fed13-aa03-453d-bcb0-3fb766919230 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:07.025958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea04c8-71f4-4f87-a097-5b8d5b25496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:07.027320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e37ef-7e66-4c86-b272-0cd90eb1916f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:07.027970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e37ef-7e66-4c86-b272-0cd90eb1916f service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:07.028256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e37ef-7e66-4c86-b272-0cd90eb1916f service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:07.028535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e37ef-7e66-4c86-b272-0cd90eb1916f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:07.029115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea04c8-71f4-4f87-a097-5b8d5b25496f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:07.030752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea04c8-71f4-4f87-a097-5b8d5b25496f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:07.031266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea04c8-71f4-4f87-a097-5b8d5b25496f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:07.032138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea04c8-71f4-4f87-a097-5b8d5b25496f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:07.034681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea04c8-71f4-4f87-a097-5b8d5b25496f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:07.069584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e37ef-7e66-4c86-b272-0cd90eb1916f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:07.071327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e37ef-7e66-4c86-b272-0cd90eb1916f service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:07.118734 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2879/5723] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:11:07.122116 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2845/5724] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:11:07.123280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea04c8-71f4-4f87-a097-5b8d5b25496f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:07.148154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea04c8-71f4-4f87-a097-5b8d5b25496f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:07.185431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17bc7c-45b3-4a86-a572-65c37b5bbafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:07.186291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17bc7c-45b3-4a86-a572-65c37b5bbafd admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:07.186741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17bc7c-45b3-4a86-a572-65c37b5bbafd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:07.187161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17bc7c-45b3-4a86-a572-65c37b5bbafd admin admin] PATH_INFO: `/v3/projects/3e74cf6ab7494e38b6f03cf3c713fef8/users/7589d506eebb42cca2fd636d95f16739/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:07.265942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17bc7c-45b3-4a86-a572-65c37b5bbafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e74cf6ab7494e38b6f03cf3c713fef8, user_id=7589d506eebb42cca2fd636d95f16739, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:07.269326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17bc7c-45b3-4a86-a572-65c37b5bbafd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:07.276231 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:07.310183 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2880/5725] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:07 2022] PUT /identity/v3/projects/3e74cf6ab7494e38b6f03cf3c713fef8/users/7589d506eebb42cca2fd636d95f16739/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:07.320698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec60528-6b58-4053-9539-1093b59ba5dd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:07.321195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec60528-6b58-4053-9539-1093b59ba5dd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:07.321273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec60528-6b58-4053-9539-1093b59ba5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:07.401258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7ec60528-6b58-4053-9539-1093b59ba5dd None None] MFA Rules not processed for user `7589d506eebb42cca2fd636d95f16739`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:07.404429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7ec60528-6b58-4053-9539-1093b59ba5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:07.577993 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2846/5726] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:07.582320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17bc7c-45b3-4a86-a572-65c37b5bbafd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:07.761430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17bc7c-45b3-4a86-a572-65c37b5bbafd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:07.770507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f18a71-0fee-4e4b-b82f-06cad25a06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:07.771604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f18a71-0fee-4e4b-b82f-06cad25a06f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:07.772041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f18a71-0fee-4e4b-b82f-06cad25a06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:07.772493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f18a71-0fee-4e4b-b82f-06cad25a06f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:07.774077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f18a71-0fee-4e4b-b82f-06cad25a06f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:07.776274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f18a71-0fee-4e4b-b82f-06cad25a06f9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:07.844615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2881/5727] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:07 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:07.848405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec60528-6b58-4053-9539-1093b59ba5dd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:07.870970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec60528-6b58-4053-9539-1093b59ba5dd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:07.944575 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:08.057113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1b1a0-fa24-4b05-b9cc-7c2066c5df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:08.057836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1b1a0-fa24-4b05-b9cc-7c2066c5df3a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:08.058754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1b1a0-fa24-4b05-b9cc-7c2066c5df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:08.059032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1b1a0-fa24-4b05-b9cc-7c2066c5df3a admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:08.059671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1b1a0-fa24-4b05-b9cc-7c2066c5df3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:08.061764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1b1a0-fa24-4b05-b9cc-7c2066c5df3a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:08.114567 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2847/5728] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:07 2022] POST /identity/v3/users => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:08.118638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f18a71-0fee-4e4b-b82f-06cad25a06f9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:08.146767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f18a71-0fee-4e4b-b82f-06cad25a06f9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:08.172906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c77e-c33f-4689-85b4-c821a871d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:08.173541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c77e-c33f-4689-85b4-c821a871d570 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:08.173827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c77e-c33f-4689-85b4-c821a871d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:08.174102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c77e-c33f-4689-85b4-c821a871d570 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:08.174759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035c77e-c33f-4689-85b4-c821a871d570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:08.186567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035c77e-c33f-4689-85b4-c821a871d570 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:08.251290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1b1a0-fa24-4b05-b9cc-7c2066c5df3a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:08.256708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2882/5729] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:08.266612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1b1a0-fa24-4b05-b9cc-7c2066c5df3a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:08.285205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e603f-c951-43cf-9e78-f14a4a6fa5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:08.285435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e603f-c951-43cf-9e78-f14a4a6fa5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:08.285628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e603f-c951-43cf-9e78-f14a4a6fa5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:08.285900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e603f-c951-43cf-9e78-f14a4a6fa5ff admin admin] PATH_INFO: `/v3/projects/f465a6a1b2364bde91911ffdfcaab3ba/users/0b13ec9858d54baaa52d8210cbd1bc6c/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:08.299081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c77e-c33f-4689-85b4-c821a871d570 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:08.302742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0035c77e-c33f-4689-85b4-c821a871d570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:08.365779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c77e-c33f-4689-85b4-c821a871d570 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:08.373345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e603f-c951-43cf-9e78-f14a4a6fa5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f465a6a1b2364bde91911ffdfcaab3ba, user_id=0b13ec9858d54baaa52d8210cbd1bc6c, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:08.385591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:08.387256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:08.387720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:08.388272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] PATH_INFO: `/v3/projects/da9626fec00f4cf8a828c5aa04641c99` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:08.391023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9626fec00f4cf8a828c5aa04641c99)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:08.391162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e603f-c951-43cf-9e78-f14a4a6fa5ff admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:08.395522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:08.410943 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2848/5730] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:08 2022] PUT /identity/v3/projects/f465a6a1b2364bde91911ffdfcaab3ba/users/0b13ec9858d54baaa52d8210cbd1bc6c/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:08.415129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e603f-c951-43cf-9e78-f14a4a6fa5ff admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:08.501739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9626fec00f4cf8a828c5aa04641c99', 'request_id': 'req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:08.522652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9626fec00f4cf8a828c5aa04641c99', 'request_id': 'req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:08.533397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9626fec00f4cf8a828c5aa04641c99', 'request_id': 'req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:08.563814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] The token cache is being invalidate because project da9626fec00f4cf8a828c5aa04641c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:08.564469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:08.568191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e35dc061-ba92-479f-bb62-ccd7a9aea5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:08.575551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2883/5731] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:08 2022] DELETE /identity/v3/projects/da9626fec00f4cf8a828c5aa04641c99 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:08.576002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e603f-c951-43cf-9e78-f14a4a6fa5ff admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:08.580163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256020f-8efb-4ad3-a31d-874b5f837dcf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:08.580520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256020f-8efb-4ad3-a31d-874b5f837dcf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:08.580987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256020f-8efb-4ad3-a31d-874b5f837dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:08.634389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f256020f-8efb-4ad3-a31d-874b5f837dcf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:08.637013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f256020f-8efb-4ad3-a31d-874b5f837dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:08.689427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353041a-66d4-4f86-a68b-4606fb9fd5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:08.690864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353041a-66d4-4f86-a68b-4606fb9fd5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:08.691770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353041a-66d4-4f86-a68b-4606fb9fd5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:08.692254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353041a-66d4-4f86-a68b-4606fb9fd5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:08.694087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353041a-66d4-4f86-a68b-4606fb9fd5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:08.696075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353041a-66d4-4f86-a68b-4606fb9fd5c6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:08.721426 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2849/5732] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:08.723107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353041a-66d4-4f86-a68b-4606fb9fd5c6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:08.725551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7353041a-66d4-4f86-a68b-4606fb9fd5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:08.739817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353041a-66d4-4f86-a68b-4606fb9fd5c6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:08.763272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914d1b-5e53-4c90-8286-f63c0c446678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:08.765242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914d1b-5e53-4c90-8286-f63c0c446678 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:08.765242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914d1b-5e53-4c90-8286-f63c0c446678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:08.766654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914d1b-5e53-4c90-8286-f63c0c446678 admin admin] PATH_INFO: `/v3/projects/f465a6a1b2364bde91911ffdfcaab3ba/users/0b13ec9858d54baaa52d8210cbd1bc6c/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:08.773293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88914d1b-5e53-4c90-8286-f63c0c446678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f465a6a1b2364bde91911ffdfcaab3ba, user_id=0b13ec9858d54baaa52d8210cbd1bc6c, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:08.779563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88914d1b-5e53-4c90-8286-f63c0c446678 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:08.791657 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:08.809176 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2850/5733] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:08 2022] PUT /identity/v3/projects/f465a6a1b2364bde91911ffdfcaab3ba/users/0b13ec9858d54baaa52d8210cbd1bc6c/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:08.833421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c532c5-9f43-4bc9-9aee-4ba7c99a820f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:08.833730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c532c5-9f43-4bc9-9aee-4ba7c99a820f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:08.833999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c532c5-9f43-4bc9-9aee-4ba7c99a820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:08.851932 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2884/5734] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:08.863656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17312e-f04e-4873-ba1d-6c26b81e1a75 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:08.864704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17312e-f04e-4873-ba1d-6c26b81e1a75 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:08.867158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17312e-f04e-4873-ba1d-6c26b81e1a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:08.911059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-25c532c5-9f43-4bc9-9aee-4ba7c99a820f None None] MFA Rules not processed for user `0b13ec9858d54baaa52d8210cbd1bc6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:08.912218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ea17312e-f04e-4873-ba1d-6c26b81e1a75 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:08.913415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea17312e-f04e-4873-ba1d-6c26b81e1a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:08.914888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-25c532c5-9f43-4bc9-9aee-4ba7c99a820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:08.957264 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:09.105835 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2851/5735] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:09.118118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c532c5-9f43-4bc9-9aee-4ba7c99a820f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:09.121600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-25c532c5-9f43-4bc9-9aee-4ba7c99a820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:09.141792 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2885/5736] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:09.145527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17312e-f04e-4873-ba1d-6c26b81e1a75 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:09.163284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17312e-f04e-4873-ba1d-6c26b81e1a75 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:09.177763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9f7af-0f89-44f9-bb12-fa7743a73b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:09.178580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9f7af-0f89-44f9-bb12-fa7743a73b00 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:09.178989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9f7af-0f89-44f9-bb12-fa7743a73b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:09.179177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9f7af-0f89-44f9-bb12-fa7743a73b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:09.183553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9f7af-0f89-44f9-bb12-fa7743a73b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:11:09.186042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9f7af-0f89-44f9-bb12-fa7743a73b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:09.190645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9f7af-0f89-44f9-bb12-fa7743a73b00 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:09.217603 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2886/5737] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:09.221657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9f7af-0f89-44f9-bb12-fa7743a73b00 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:09.246367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9f7af-0f89-44f9-bb12-fa7743a73b00 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:09.257580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce4b34-bb64-40ed-8e63-a7cda7f93972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:09.258229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4b34-bb64-40ed-8e63-a7cda7f93972 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:09.258630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4b34-bb64-40ed-8e63-a7cda7f93972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:09.258911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4b34-bb64-40ed-8e63-a7cda7f93972 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:09.259562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce4b34-bb64-40ed-8e63-a7cda7f93972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:09.267313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce4b34-bb64-40ed-8e63-a7cda7f93972 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:09.390273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c532c5-9f43-4bc9-9aee-4ba7c99a820f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:09.410890 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2887/5738] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:09 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:09.414376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce4b34-bb64-40ed-8e63-a7cda7f93972 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:09.642200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ea9c6-5db4-42a4-9cdb-95744c93047c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:09.643815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ea9c6-5db4-42a4-9cdb-95744c93047c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:09.644112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ea9c6-5db4-42a4-9cdb-95744c93047c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:09.644404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ea9c6-5db4-42a4-9cdb-95744c93047c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:09.648529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7b4ea9c6-5db4-42a4-9cdb-95744c93047c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:09.709305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce4b34-bb64-40ed-8e63-a7cda7f93972 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:09.719634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7e3b4-5ddb-4ebe-8adc-3d3d36af7029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:09.720425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e3b4-5ddb-4ebe-8adc-3d3d36af7029 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:09.721214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e3b4-5ddb-4ebe-8adc-3d3d36af7029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:09.721533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e3b4-5ddb-4ebe-8adc-3d3d36af7029 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:09.722788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7e3b4-5ddb-4ebe-8adc-3d3d36af7029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:09.725176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7e3b4-5ddb-4ebe-8adc-3d3d36af7029 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:09.820886 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2888/5739] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:09 2022] POST /identity/v3/users => generated 283 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:09.833160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7e3b4-5ddb-4ebe-8adc-3d3d36af7029 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:09.873947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ea9c6-5db4-42a4-9cdb-95744c93047c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:09.876710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ea9c6-5db4-42a4-9cdb-95744c93047c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:09.879501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7e3b4-5ddb-4ebe-8adc-3d3d36af7029 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:09.902725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6894e-7eb6-46e2-a62f-6b54fe303663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:09.903360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6894e-7eb6-46e2-a62f-6b54fe303663 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:09.903641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6894e-7eb6-46e2-a62f-6b54fe303663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:09.903916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6894e-7eb6-46e2-a62f-6b54fe303663 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:09.904564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6894e-7eb6-46e2-a62f-6b54fe303663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:09.910826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6894e-7eb6-46e2-a62f-6b54fe303663 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:09.915399 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2852/5740] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:11:09.957762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ea9c6-5db4-42a4-9cdb-95744c93047c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:09.959938 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2889/5741] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:09.975218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ea9c6-5db4-42a4-9cdb-95744c93047c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:10.006210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d4e31-3ca3-45fc-886a-2823606d8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:10.007899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d4e31-3ca3-45fc-886a-2823606d8b86 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:10.008192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d4e31-3ca3-45fc-886a-2823606d8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:10.010656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d4e31-3ca3-45fc-886a-2823606d8b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:10.011990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d4e31-3ca3-45fc-886a-2823606d8b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:10.014184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d4e31-3ca3-45fc-886a-2823606d8b86 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:10.045931 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2853/5742] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:11:10.050299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6894e-7eb6-46e2-a62f-6b54fe303663 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:10.072559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6894e-7eb6-46e2-a62f-6b54fe303663 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:10.086224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083155-fa71-46e5-ac0f-d852a26d6213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:10.088013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083155-fa71-46e5-ac0f-d852a26d6213 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:10.089867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083155-fa71-46e5-ac0f-d852a26d6213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:10.090466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083155-fa71-46e5-ac0f-d852a26d6213 admin admin] PATH_INFO: `/v3/projects/c569857d759d43178cbe93e3bcff023d/users/503d6dc34e4844ff95703cf3fa2c0ae7/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:10.136529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2083155-fa71-46e5-ac0f-d852a26d6213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c569857d759d43178cbe93e3bcff023d, user_id=503d6dc34e4844ff95703cf3fa2c0ae7, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:10.141485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2083155-fa71-46e5-ac0f-d852a26d6213 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:10.171867 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2890/5743] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:10 2022] PUT /identity/v3/projects/c569857d759d43178cbe93e3bcff023d/users/503d6dc34e4844ff95703cf3fa2c0ae7/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:11:10.182365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9933be-cd01-4f8d-ab9c-feef3a1148a0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:10.184441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9933be-cd01-4f8d-ab9c-feef3a1148a0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:10.184923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9933be-cd01-4f8d-ab9c-feef3a1148a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:10.240937 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:10.252484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083155-fa71-46e5-ac0f-d852a26d6213 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:10.254466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f2083155-fa71-46e5-ac0f-d852a26d6213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:10.303932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ce9933be-cd01-4f8d-ab9c-feef3a1148a0 None None] MFA Rules not processed for user `503d6dc34e4844ff95703cf3fa2c0ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:10.303932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ce9933be-cd01-4f8d-ab9c-feef3a1148a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:10.308295 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:10.513510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083155-fa71-46e5-ac0f-d852a26d6213 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:10.531429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:10.532077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:10.532380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:10.533576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] PATH_INFO: `/v3/users/7aa0bd023b0f492ebc8e65ee0fdb1ba8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:10.539616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa0bd023b0f492ebc8e65ee0fdb1ba8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:10.547990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:10.572370 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2854/5744] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:10.580418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9933be-cd01-4f8d-ab9c-feef3a1148a0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:10.583189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ce9933be-cd01-4f8d-ab9c-feef3a1148a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:10.667814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa0bd023b0f492ebc8e65ee0fdb1ba8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:10.726708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa0bd023b0f492ebc8e65ee0fdb1ba8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:10.747187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa0bd023b0f492ebc8e65ee0fdb1ba8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:10.756985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa0bd023b0f492ebc8e65ee0fdb1ba8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:10.757864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d3bf0f4-ea9c-49a4-afdb-45a8bf42e31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa0bd023b0f492ebc8e65ee0fdb1ba8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:10.769522 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2891/5745] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:10 2022] DELETE /identity/v3/users/7aa0bd023b0f492ebc8e65ee0fdb1ba8 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:10.776293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f87a4-9823-4ab2-ae3f-34e86f9ebbd8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:10.781119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f87a4-9823-4ab2-ae3f-34e86f9ebbd8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:10.781448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f87a4-9823-4ab2-ae3f-34e86f9ebbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:10.856843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9933be-cd01-4f8d-ab9c-feef3a1148a0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:10.866158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-655f87a4-9823-4ab2-ae3f-34e86f9ebbd8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:10.871929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-655f87a4-9823-4ab2-ae3f-34e86f9ebbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:11.037488 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2892/5746] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:11.040805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:11.041442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:11.041727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:11.042526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:11.051364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:11.086683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f87a4-9823-4ab2-ae3f-34e86f9ebbd8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:11.088822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-655f87a4-9823-4ab2-ae3f-34e86f9ebbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:11.225949 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:11.333061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:11.333061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:11.335287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f87a4-9823-4ab2-ae3f-34e86f9ebbd8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:11.348849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce79675-f5c1-44fb-8dd0-57cd6b95ffff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:11.363025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce79675-f5c1-44fb-8dd0-57cd6b95ffff service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:11.367749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce79675-f5c1-44fb-8dd0-57cd6b95ffff service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:11.372682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce79675-f5c1-44fb-8dd0-57cd6b95ffff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:11.397879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2855/5747] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:11.413598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce79675-f5c1-44fb-8dd0-57cd6b95ffff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:11.415772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce79675-f5c1-44fb-8dd0-57cd6b95ffff service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:11.435055 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2893/5748] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:12.574020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:12.576243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:12.650659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a330b-e1c6-4fd0-b443-e7db62ebe4fd service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:12.658237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:12.658897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:12.659174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:12.659446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] PATH_INFO: `/v3/projects/aa818ffa241e4532820f5ed34b05ef7e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:12.662878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa818ffa241e4532820f5ed34b05ef7e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:12.664860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:12.679506 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:12.839231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa818ffa241e4532820f5ed34b05ef7e', 'request_id': 'req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:12.856417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa818ffa241e4532820f5ed34b05ef7e', 'request_id': 'req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:12.870990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa818ffa241e4532820f5ed34b05ef7e', 'request_id': 'req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:12.931860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] The token cache is being invalidate because project aa818ffa241e4532820f5ed34b05ef7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:12.932905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:12.934686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:12.941957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce79675-f5c1-44fb-8dd0-57cd6b95ffff service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:12.944342 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2856/5749] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:12 2022] DELETE /identity/v3/projects/aa818ffa241e4532820f5ed34b05ef7e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:12.962586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce79675-f5c1-44fb-8dd0-57cd6b95ffff service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:13.292458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:13.293473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:13.293601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:13.293866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] PATH_INFO: `/v3/users/2bde60f2147c4280b71578eae52f6de7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:13.297479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bde60f2147c4280b71578eae52f6de7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:13.299653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:13.514659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bde60f2147c4280b71578eae52f6de7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:13.602449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bde60f2147c4280b71578eae52f6de7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:13.627861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bde60f2147c4280b71578eae52f6de7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:13.678924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bde60f2147c4280b71578eae52f6de7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:13.682398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8615b85d-ae44-47b2-8c21-e1d0874b34d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bde60f2147c4280b71578eae52f6de7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:13.714379 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2894/5750] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:12 2022] DELETE /identity/v3/users/2bde60f2147c4280b71578eae52f6de7 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:15.292827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:15.294859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:15.332448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282df00-b9d3-4ff6-8b6a-83d2d7289c68 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:15.523968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:15.524893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:15.525233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:15.525599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] PATH_INFO: `/v3/projects/5217adb6a7c04e8d99863fd9135c9b53` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:15.530272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5217adb6a7c04e8d99863fd9135c9b53)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:15.531110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:15.655613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5217adb6a7c04e8d99863fd9135c9b53', 'request_id': 'req-71559260-31cd-4461-ad74-d68b088d2154'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:15.671029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5217adb6a7c04e8d99863fd9135c9b53', 'request_id': 'req-71559260-31cd-4461-ad74-d68b088d2154'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:15.688408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5217adb6a7c04e8d99863fd9135c9b53', 'request_id': 'req-71559260-31cd-4461-ad74-d68b088d2154'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:15.735603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] The token cache is being invalidate because project 5217adb6a7c04e8d99863fd9135c9b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:15.735900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:15.736962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71559260-31cd-4461-ad74-d68b088d2154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:15.747924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded31d5-b81c-4248-8073-7eaa84d10718 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:15.749257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded31d5-b81c-4248-8073-7eaa84d10718 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:15.749943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded31d5-b81c-4248-8073-7eaa84d10718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:15.769611 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2857/5751] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:15 2022] DELETE /identity/v3/projects/5217adb6a7c04e8d99863fd9135c9b53 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:15.816455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1ded31d5-b81c-4248-8073-7eaa84d10718 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:15.818972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1ded31d5-b81c-4248-8073-7eaa84d10718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:15.979678 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:16.040429 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2895/5752] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:16.048011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3416-259b-49a5-83bf-c5011daeeaa5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:16.048316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3416-259b-49a5-83bf-c5011daeeaa5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:16.048513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3416-259b-49a5-83bf-c5011daeeaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:16.110749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fa2d3416-259b-49a5-83bf-c5011daeeaa5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:16.126356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fa2d3416-259b-49a5-83bf-c5011daeeaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:16.174358 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2858/5753] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:16.175275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded31d5-b81c-4248-8073-7eaa84d10718 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:16.194126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded31d5-b81c-4248-8073-7eaa84d10718 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:16.211627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e23c47-6985-4cce-a166-eed4bbe1c481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:16.213448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23c47-6985-4cce-a166-eed4bbe1c481 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:16.214965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23c47-6985-4cce-a166-eed4bbe1c481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:16.215364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23c47-6985-4cce-a166-eed4bbe1c481 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:16.216586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e23c47-6985-4cce-a166-eed4bbe1c481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:11:16.218607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e23c47-6985-4cce-a166-eed4bbe1c481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:16.260216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e23c47-6985-4cce-a166-eed4bbe1c481 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:16.312376 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2896/5754] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:11:16.320240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d3416-259b-49a5-83bf-c5011daeeaa5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:16.351119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d3416-259b-49a5-83bf-c5011daeeaa5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:16.365195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aea645-9de5-46e0-b052-86faa138a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:16.366092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aea645-9de5-46e0-b052-86faa138a232 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:16.366475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aea645-9de5-46e0-b052-86faa138a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:16.366851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aea645-9de5-46e0-b052-86faa138a232 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:16.367668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aea645-9de5-46e0-b052-86faa138a232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:16.377118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aea645-9de5-46e0-b052-86faa138a232 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:16.434398 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:16.502727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e23c47-6985-4cce-a166-eed4bbe1c481 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:16.509922 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2859/5755] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:16 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:16.526997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e23c47-6985-4cce-a166-eed4bbe1c481 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:16.730002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b42d1-ef5c-4e24-8b7a-5748995791b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:16.730750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b42d1-ef5c-4e24-8b7a-5748995791b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:16.731135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b42d1-ef5c-4e24-8b7a-5748995791b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:16.731511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b42d1-ef5c-4e24-8b7a-5748995791b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:16.732655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b42d1-ef5c-4e24-8b7a-5748995791b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:16.735005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aea645-9de5-46e0-b052-86faa138a232 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:16.736885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-14aea645-9de5-46e0-b052-86faa138a232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:16.740232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b42d1-ef5c-4e24-8b7a-5748995791b0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:16.895094 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2897/5756] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:16 2022] POST /identity/v3/users => generated 293 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:16.897122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b42d1-ef5c-4e24-8b7a-5748995791b0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:16.936644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b42d1-ef5c-4e24-8b7a-5748995791b0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:16.960148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81938d-f021-4987-bc96-61270ff5fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:16.960946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81938d-f021-4987-bc96-61270ff5fe8f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:16.961464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81938d-f021-4987-bc96-61270ff5fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:16.962587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81938d-f021-4987-bc96-61270ff5fe8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:16.966101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81938d-f021-4987-bc96-61270ff5fe8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:16.968182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81938d-f021-4987-bc96-61270ff5fe8f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:17.014722 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2898/5757] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:17.016578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81938d-f021-4987-bc96-61270ff5fe8f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:17.035003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81938d-f021-4987-bc96-61270ff5fe8f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:17.041395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666cad7-6562-4ba8-aff7-6c0dd3564f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:17.042334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666cad7-6562-4ba8-aff7-6c0dd3564f9b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:17.042894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666cad7-6562-4ba8-aff7-6c0dd3564f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:17.043424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666cad7-6562-4ba8-aff7-6c0dd3564f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:17.044305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666cad7-6562-4ba8-aff7-6c0dd3564f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:17.046710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666cad7-6562-4ba8-aff7-6c0dd3564f9b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:17.063986 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2899/5758] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:17.065325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666cad7-6562-4ba8-aff7-6c0dd3564f9b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:17.080451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aea645-9de5-46e0-b052-86faa138a232 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:17.097360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90629956-5c63-4880-bcec-9b97e93d3c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:17.099087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90629956-5c63-4880-bcec-9b97e93d3c8e service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:17.099589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666cad7-6562-4ba8-aff7-6c0dd3564f9b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:17.103481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90629956-5c63-4880-bcec-9b97e93d3c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:17.103784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90629956-5c63-4880-bcec-9b97e93d3c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:17.111529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-90629956-5c63-4880-bcec-9b97e93d3c8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:17.112265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb80522-4d23-476b-9a90-db3b2ccc27c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:17.113251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb80522-4d23-476b-9a90-db3b2ccc27c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:17.113760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb80522-4d23-476b-9a90-db3b2ccc27c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:17.116319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb80522-4d23-476b-9a90-db3b2ccc27c7 admin admin] PATH_INFO: `/v3/projects/ca51bbf796934412845cea899ca49dbf/users/c6cd887b5d634975a28947eb6740675f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:17.147138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb80522-4d23-476b-9a90-db3b2ccc27c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca51bbf796934412845cea899ca49dbf, user_id=c6cd887b5d634975a28947eb6740675f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:17.157077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb80522-4d23-476b-9a90-db3b2ccc27c7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:17.208594 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2900/5759] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:17 2022] PUT /identity/v3/projects/ca51bbf796934412845cea899ca49dbf/users/c6cd887b5d634975a28947eb6740675f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:17.215995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b123-d677-4838-8e13-a3df38c244e9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:17.218721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b123-d677-4838-8e13-a3df38c244e9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:17.220168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b123-d677-4838-8e13-a3df38c244e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:17.305713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5610b123-d677-4838-8e13-a3df38c244e9 None None] MFA Rules not processed for user `c6cd887b5d634975a28947eb6740675f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:17.309725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5610b123-d677-4838-8e13-a3df38c244e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:17.534857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90629956-5c63-4880-bcec-9b97e93d3c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:17.552040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90629956-5c63-4880-bcec-9b97e93d3c8e service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:17.599306 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2901/5760] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:17.604159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610b123-d677-4838-8e13-a3df38c244e9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:17.664547 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2860/5761] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 930 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:17.684072 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:17.829886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610b123-d677-4838-8e13-a3df38c244e9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:17.845990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85097b6-2bef-4805-ba66-41d4a805815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:17.846682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85097b6-2bef-4805-ba66-41d4a805815d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:17.848143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85097b6-2bef-4805-ba66-41d4a805815d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:17.848605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85097b6-2bef-4805-ba66-41d4a805815d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:17.851340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85097b6-2bef-4805-ba66-41d4a805815d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:17.858881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85097b6-2bef-4805-ba66-41d4a805815d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:18.047373 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2902/5762] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:18.048511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90629956-5c63-4880-bcec-9b97e93d3c8e service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:18.096504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90629956-5c63-4880-bcec-9b97e93d3c8e service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:18.378709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4a0fa-bdae-404b-846b-58a61b2ac0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:18.378920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4a0fa-bdae-404b-846b-58a61b2ac0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:18.379038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4a0fa-bdae-404b-846b-58a61b2ac0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:18.379493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4a0fa-bdae-404b-846b-58a61b2ac0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:18.380455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4a0fa-bdae-404b-846b-58a61b2ac0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:18.383657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4a0fa-bdae-404b-846b-58a61b2ac0c3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:18.494631 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2861/5763] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:18 2022] POST /identity/v3/users => generated 293 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:18.498342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85097b6-2bef-4805-ba66-41d4a805815d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:18.515720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85097b6-2bef-4805-ba66-41d4a805815d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:18.560045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a92f-5952-400b-a312-f221ca30d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:18.560924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a92f-5952-400b-a312-f221ca30d6ee admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:18.561396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a92f-5952-400b-a312-f221ca30d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:18.562005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a92f-5952-400b-a312-f221ca30d6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:18.575830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5a92f-5952-400b-a312-f221ca30d6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:18.580946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5a92f-5952-400b-a312-f221ca30d6ee admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:18.630807 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2903/5764] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:18.634342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4a0fa-bdae-404b-846b-58a61b2ac0c3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:18.663323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4a0fa-bdae-404b-846b-58a61b2ac0c3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:18.701261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d28f4-595f-48c9-8879-4b5781d89833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:18.702078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d28f4-595f-48c9-8879-4b5781d89833 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:18.716164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d28f4-595f-48c9-8879-4b5781d89833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:18.717425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d28f4-595f-48c9-8879-4b5781d89833 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:18.718222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d28f4-595f-48c9-8879-4b5781d89833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:18.751687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d28f4-595f-48c9-8879-4b5781d89833 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:18.779212 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:18.827797 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2862/5765] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:18.832649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a92f-5952-400b-a312-f221ca30d6ee admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:18.849345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a92f-5952-400b-a312-f221ca30d6ee admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:18.865224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502e94c-efea-46e6-81b8-536924c68095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:18.866082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e94c-efea-46e6-81b8-536924c68095 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:18.866526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e94c-efea-46e6-81b8-536924c68095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:18.866950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e94c-efea-46e6-81b8-536924c68095 admin admin] PATH_INFO: `/v3/projects/39b428ed3dec4d77aae81a3f6d39e3c7/users/b75a38545bab453695849000c3601256/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:18.914092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502e94c-efea-46e6-81b8-536924c68095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b428ed3dec4d77aae81a3f6d39e3c7, user_id=b75a38545bab453695849000c3601256, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:18.922101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502e94c-efea-46e6-81b8-536924c68095 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:18.949031 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2904/5766] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:18 2022] PUT /identity/v3/projects/39b428ed3dec4d77aae81a3f6d39e3c7/users/b75a38545bab453695849000c3601256/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:18.959938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbbee1-803f-4d57-bfc3-07ab92f28e17 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:18.960830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbbee1-803f-4d57-bfc3-07ab92f28e17 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:18.961360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbbee1-803f-4d57-bfc3-07ab92f28e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:19.065662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8bcbbee1-803f-4d57-bfc3-07ab92f28e17 None None] MFA Rules not processed for user `b75a38545bab453695849000c3601256`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:19.072741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8bcbbee1-803f-4d57-bfc3-07ab92f28e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:19.352418 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2863/5767] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:19.356810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502e94c-efea-46e6-81b8-536924c68095 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:19.597771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502e94c-efea-46e6-81b8-536924c68095 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:19.615499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157e85e-db05-49e0-af73-02ae604a56d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:19.616356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e85e-db05-49e0-af73-02ae604a56d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:19.616826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e85e-db05-49e0-af73-02ae604a56d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:19.617317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e85e-db05-49e0-af73-02ae604a56d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:19.618199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157e85e-db05-49e0-af73-02ae604a56d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:19.628047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157e85e-db05-49e0-af73-02ae604a56d3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:19.684934 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2905/5768] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:19 2022] POST /identity/v3/projects => generated 385 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:19.688777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbbee1-803f-4d57-bfc3-07ab92f28e17 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:19.710527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbbee1-803f-4d57-bfc3-07ab92f28e17 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:19.850281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47cf77-ff9b-419e-8ac8-6228c610c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:19.850680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47cf77-ff9b-419e-8ac8-6228c610c4fd admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:19.851144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47cf77-ff9b-419e-8ac8-6228c610c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:19.851452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47cf77-ff9b-419e-8ac8-6228c610c4fd admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:19.852104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47cf77-ff9b-419e-8ac8-6228c610c4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:19.854950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47cf77-ff9b-419e-8ac8-6228c610c4fd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:19.961084 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2864/5769] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:19 2022] POST /identity/v3/users => generated 299 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:19.962778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157e85e-db05-49e0-af73-02ae604a56d3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:20.013188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157e85e-db05-49e0-af73-02ae604a56d3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:20.051065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b138d3-b34f-4aa8-8346-3e0a6dd2d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:20.051878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b138d3-b34f-4aa8-8346-3e0a6dd2d698 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:20.052165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b138d3-b34f-4aa8-8346-3e0a6dd2d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:20.052553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b138d3-b34f-4aa8-8346-3e0a6dd2d698 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:20.056790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b138d3-b34f-4aa8-8346-3e0a6dd2d698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:20.058589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b138d3-b34f-4aa8-8346-3e0a6dd2d698 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:20.087242 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2906/5770] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:20.089364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47cf77-ff9b-419e-8ac8-6228c610c4fd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:20.116528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47cf77-ff9b-419e-8ac8-6228c610c4fd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:20.151804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cce628-0214-4213-9f33-929a9ce56bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:20.155633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cce628-0214-4213-9f33-929a9ce56bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:20.155633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cce628-0214-4213-9f33-929a9ce56bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:20.155633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cce628-0214-4213-9f33-929a9ce56bfb admin admin] PATH_INFO: `/v3/projects/47249678672247f6ab2504b23a1255d1/users/d3909e37eb924aa79066384d56ecee88/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:20.180141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cce628-0214-4213-9f33-929a9ce56bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=47249678672247f6ab2504b23a1255d1, user_id=d3909e37eb924aa79066384d56ecee88, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:20.183258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cce628-0214-4213-9f33-929a9ce56bfb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:20.228713 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2865/5771] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:20 2022] PUT /identity/v3/projects/47249678672247f6ab2504b23a1255d1/users/d3909e37eb924aa79066384d56ecee88/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:11:20.230416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b138d3-b34f-4aa8-8346-3e0a6dd2d698 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:20.241840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b138d3-b34f-4aa8-8346-3e0a6dd2d698 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:20.320031 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:20.384498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5aca6-ac3b-4d38-91ba-56435bb80ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:20.388604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5aca6-ac3b-4d38-91ba-56435bb80ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:20.389791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5aca6-ac3b-4d38-91ba-56435bb80ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:20.390187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5aca6-ac3b-4d38-91ba-56435bb80ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:20.391761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5aca6-ac3b-4d38-91ba-56435bb80ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:20.394455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5aca6-ac3b-4d38-91ba-56435bb80ca3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:20.430826 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2907/5772] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:20.443231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cce628-0214-4213-9f33-929a9ce56bfb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:20.463894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cce628-0214-4213-9f33-929a9ce56bfb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:20.478265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ccb29-4be6-4bbe-9266-ae8bb56fa1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:20.483255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ccb29-4be6-4bbe-9266-ae8bb56fa1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:20.483833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ccb29-4be6-4bbe-9266-ae8bb56fa1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:20.484432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ccb29-4be6-4bbe-9266-ae8bb56fa1c2 admin admin] PATH_INFO: `/v3/projects/47249678672247f6ab2504b23a1255d1/users/d3909e37eb924aa79066384d56ecee88/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:20.497566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ccb29-4be6-4bbe-9266-ae8bb56fa1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47249678672247f6ab2504b23a1255d1, user_id=d3909e37eb924aa79066384d56ecee88, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:20.507359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ccb29-4be6-4bbe-9266-ae8bb56fa1c2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:20.575923 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2866/5773] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:20 2022] PUT /identity/v3/projects/47249678672247f6ab2504b23a1255d1/users/d3909e37eb924aa79066384d56ecee88/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:20.585780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128edc9a-1d61-41f5-9201-62894c241c9b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:20.586291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128edc9a-1d61-41f5-9201-62894c241c9b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:20.586714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128edc9a-1d61-41f5-9201-62894c241c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:20.662608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-128edc9a-1d61-41f5-9201-62894c241c9b None None] MFA Rules not processed for user `d3909e37eb924aa79066384d56ecee88`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:20.667285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-128edc9a-1d61-41f5-9201-62894c241c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:20.849658 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2908/5774] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:20.860732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ccb29-4be6-4bbe-9266-ae8bb56fa1c2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:20.862658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-132ccb29-4be6-4bbe-9266-ae8bb56fa1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:21.002350 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:21.039150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ccb29-4be6-4bbe-9266-ae8bb56fa1c2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:21.061783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bcb29-41dd-4d80-8ae5-621ce01448be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:21.062512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bcb29-41dd-4d80-8ae5-621ce01448be service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:21.062791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bcb29-41dd-4d80-8ae5-621ce01448be service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:21.063066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bcb29-41dd-4d80-8ae5-621ce01448be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:21.102307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bcb29-41dd-4d80-8ae5-621ce01448be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:21.104818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bcb29-41dd-4d80-8ae5-621ce01448be service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:21.136382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2867/5775] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:11:23.859534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128edc9a-1d61-41f5-9201-62894c241c9b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:23.879427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128edc9a-1d61-41f5-9201-62894c241c9b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:23.884167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bd5bf-42eb-4bfd-b576-e948b1b08dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:23.885081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bd5bf-42eb-4bfd-b576-e948b1b08dcb service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:23.886126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bd5bf-42eb-4bfd-b576-e948b1b08dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:23.886670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bd5bf-42eb-4bfd-b576-e948b1b08dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:24.134578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bd5bf-42eb-4bfd-b576-e948b1b08dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:24.136408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bd5bf-42eb-4bfd-b576-e948b1b08dcb service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:24.154929 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2909/5776] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:25.430055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bcb29-41dd-4d80-8ae5-621ce01448be service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:25.431628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-082bcb29-41dd-4d80-8ae5-621ce01448be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:25.676495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bcb29-41dd-4d80-8ae5-621ce01448be service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:25.690409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:25.691041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:25.691330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:25.691606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:25.698111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:25.881984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:25.883959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:25.907219 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2868/5777] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:26.508538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bd5bf-42eb-4bfd-b576-e948b1b08dcb service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:26.510146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-328bd5bf-42eb-4bfd-b576-e948b1b08dcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:26.632434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bd5bf-42eb-4bfd-b576-e948b1b08dcb service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:26.640232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:26.641149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:26.641316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:26.641693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:26.652336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:26.668965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:26.671462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:26.690973 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:26.694976 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2910/5778] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:26.752273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:26.754050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:26.900447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568d3cc-1bf9-4d8f-a05a-e71a258c6d03 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:26.924410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57b6be-7404-4043-93d5-1f6a4e02d54a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:26.925304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57b6be-7404-4043-93d5-1f6a4e02d54a service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:26.925675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57b6be-7404-4043-93d5-1f6a4e02d54a service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:26.926016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57b6be-7404-4043-93d5-1f6a4e02d54a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:26.928211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8d57b6be-7404-4043-93d5-1f6a4e02d54a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:26.967592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57b6be-7404-4043-93d5-1f6a4e02d54a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:26.969447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57b6be-7404-4043-93d5-1f6a4e02d54a service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:27.001301 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2869/5779] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:32.566625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:32.569995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:32.597669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dd19-5d26-4229-81b9-f3aff7d0b658 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:32.618867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255bf14-7b92-4571-b7c4-5d580f19acdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:32.619581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255bf14-7b92-4571-b7c4-5d580f19acdd service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:32.619833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255bf14-7b92-4571-b7c4-5d580f19acdd service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:32.620105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255bf14-7b92-4571-b7c4-5d580f19acdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:32.633155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0255bf14-7b92-4571-b7c4-5d580f19acdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:32.921451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255bf14-7b92-4571-b7c4-5d580f19acdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:32.923150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255bf14-7b92-4571-b7c4-5d580f19acdd service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:32.936591 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2911/5780] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:36.984833 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:39.103237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57b6be-7404-4043-93d5-1f6a4e02d54a service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:39.146771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57b6be-7404-4043-93d5-1f6a4e02d54a service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:39.157265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08076b-4fdb-4cd7-8c0d-b5620a93d970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:39.158183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08076b-4fdb-4cd7-8c0d-b5620a93d970 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:39.158721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08076b-4fdb-4cd7-8c0d-b5620a93d970 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:39.159029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08076b-4fdb-4cd7-8c0d-b5620a93d970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:39.313983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08076b-4fdb-4cd7-8c0d-b5620a93d970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:39.315745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08076b-4fdb-4cd7-8c0d-b5620a93d970 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:39.343125 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2870/5781] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:42.866892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255bf14-7b92-4571-b7c4-5d580f19acdd service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:42.910326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255bf14-7b92-4571-b7c4-5d580f19acdd service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:42.926687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd438-086e-4515-ad52-7fc62a9e99be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:42.927336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd438-086e-4515-ad52-7fc62a9e99be service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:42.927614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd438-086e-4515-ad52-7fc62a9e99be service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:42.927889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd438-086e-4515-ad52-7fc62a9e99be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:42.929882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8b9fd438-086e-4515-ad52-7fc62a9e99be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:43.042825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fd438-086e-4515-ad52-7fc62a9e99be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:43.044381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fd438-086e-4515-ad52-7fc62a9e99be service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:43.056129 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2912/5782] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:46.206051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08076b-4fdb-4cd7-8c0d-b5620a93d970 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:46.208826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7d08076b-4fdb-4cd7-8c0d-b5620a93d970 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:46.244530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd438-086e-4515-ad52-7fc62a9e99be service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:46.547786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd438-086e-4515-ad52-7fc62a9e99be service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:46.549951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08076b-4fdb-4cd7-8c0d-b5620a93d970 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:46.585382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:46.586044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:46.586527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:46.586646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] PATH_INFO: `/v3/users/c6cd887b5d634975a28947eb6740675f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:46.589091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:46.589777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:46.590054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:46.590676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] PATH_INFO: `/v3/users/503d6dc34e4844ff95703cf3fa2c0ae7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:46.593561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6cd887b5d634975a28947eb6740675f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:46.595544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:46.609425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=503d6dc34e4844ff95703cf3fa2c0ae7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:46.611774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:46.622459 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:46.769220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6cd887b5d634975a28947eb6740675f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.785407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503d6dc34e4844ff95703cf3fa2c0ae7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.825708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503d6dc34e4844ff95703cf3fa2c0ae7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.831334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6cd887b5d634975a28947eb6740675f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.847045 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:46.859091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503d6dc34e4844ff95703cf3fa2c0ae7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.866861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6cd887b5d634975a28947eb6740675f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.889288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503d6dc34e4844ff95703cf3fa2c0ae7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.892840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86e1b804-782a-4c02-9723-864b66ccbefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503d6dc34e4844ff95703cf3fa2c0ae7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.893340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6cd887b5d634975a28947eb6740675f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.903365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-94f5184b-f337-4c34-b1b3-c755ec5f8131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6cd887b5d634975a28947eb6740675f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:46.924787 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2871/5783] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:46 2022] DELETE /identity/v3/users/503d6dc34e4844ff95703cf3fa2c0ae7 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:46.931720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d72a1-0b74-4381-b0e0-ce4ab28a3477 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:46.932012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d72a1-0b74-4381-b0e0-ce4ab28a3477 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:46.932117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d72a1-0b74-4381-b0e0-ce4ab28a3477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:46.961171 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2913/5784] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:46 2022] DELETE /identity/v3/users/c6cd887b5d634975a28947eb6740675f => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:11:46.968635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d99d-d1c7-4200-b776-832fec70a428 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:46.970291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d99d-d1c7-4200-b776-832fec70a428 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:46.972548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d99d-d1c7-4200-b776-832fec70a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:47.049876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-eb3d72a1-0b74-4381-b0e0-ce4ab28a3477 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:47.054202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6de7d99d-d1c7-4200-b776-832fec70a428 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:47.056828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eb3d72a1-0b74-4381-b0e0-ce4ab28a3477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:47.057464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6de7d99d-d1c7-4200-b776-832fec70a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:47.278330 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2914/5785] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:47.310225 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2872/5786] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:47.323687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7d99d-d1c7-4200-b776-832fec70a428 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:47.325340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6de7d99d-d1c7-4200-b776-832fec70a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:47.373140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8804922-4920-4494-9372-af8ee334ef96 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:47.373419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8804922-4920-4494-9372-af8ee334ef96 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:47.373889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8804922-4920-4494-9372-af8ee334ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:47.438304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7d99d-d1c7-4200-b776-832fec70a428 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:47.442715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ea147-c045-4529-8ec5-b9dd6828d205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:47.443439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b8804922-4920-4494-9372-af8ee334ef96 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:47.444105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ea147-c045-4529-8ec5-b9dd6828d205 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:47.444579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ea147-c045-4529-8ec5-b9dd6828d205 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:47.445143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ea147-c045-4529-8ec5-b9dd6828d205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:47.446259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b8804922-4920-4494-9372-af8ee334ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:47.457467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ea147-c045-4529-8ec5-b9dd6828d205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:47.459883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ea147-c045-4529-8ec5-b9dd6828d205 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:47.474349 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2915/5787] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:47.475796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ea147-c045-4529-8ec5-b9dd6828d205 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:47.477624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-790ea147-c045-4529-8ec5-b9dd6828d205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:47.495647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ea147-c045-4529-8ec5-b9dd6828d205 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:47.505185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b2cb-1010-4fcf-8870-b61943ddd7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:47.506447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b2cb-1010-4fcf-8870-b61943ddd7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:47.506839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b2cb-1010-4fcf-8870-b61943ddd7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:47.507368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b2cb-1010-4fcf-8870-b61943ddd7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:47.520289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450b2cb-1010-4fcf-8870-b61943ddd7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:47.522651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450b2cb-1010-4fcf-8870-b61943ddd7a1 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:47.536335 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2916/5788] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:47.622502 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2873/5789] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:11:47.639297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b2cb-1010-4fcf-8870-b61943ddd7a1 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:47.641560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8450b2cb-1010-4fcf-8870-b61943ddd7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:47.657671 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:47.778624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b2cb-1010-4fcf-8870-b61943ddd7a1 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:47.793637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4733f-7cca-41f4-88b6-3579545af53d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:47.794435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4733f-7cca-41f4-88b6-3579545af53d service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:47.794803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4733f-7cca-41f4-88b6-3579545af53d service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:47.795103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4733f-7cca-41f4-88b6-3579545af53d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:47.805510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4733f-7cca-41f4-88b6-3579545af53d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:47.807277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4733f-7cca-41f4-88b6-3579545af53d service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:47.819040 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2917/5790] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:11:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:11:49.849023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8804922-4920-4494-9372-af8ee334ef96 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:49.851785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b8804922-4920-4494-9372-af8ee334ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:49.895663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8804922-4920-4494-9372-af8ee334ef96 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:49.923874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:49.927851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:49.928147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:49.928432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] PATH_INFO: `/v3/projects/ca51bbf796934412845cea899ca49dbf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:49.930161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca51bbf796934412845cea899ca49dbf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:49.938616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:50.154172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca51bbf796934412845cea899ca49dbf', 'request_id': 'req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.182342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca51bbf796934412845cea899ca49dbf', 'request_id': 'req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.190008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4733f-7cca-41f4-88b6-3579545af53d service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:50.191589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-51e4733f-7cca-41f4-88b6-3579545af53d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:50.225233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca51bbf796934412845cea899ca49dbf', 'request_id': 'req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.237756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4733f-7cca-41f4-88b6-3579545af53d service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:50.286491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] The token cache is being invalidate because project ca51bbf796934412845cea899ca49dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:50.286802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.295816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.297694 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2874/5791] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:49 2022] DELETE /identity/v3/projects/ca51bbf796934412845cea899ca49dbf => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:50.305813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:50.314850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:50.377442 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:50.474332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:50.475815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:50.476111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:50.476387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] PATH_INFO: `/v3/projects/c569857d759d43178cbe93e3bcff023d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:50.483444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c569857d759d43178cbe93e3bcff023d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:50.488535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:50.585016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9691f0-099d-4bbb-9e6c-1f8ad4496905 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:50.601331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:50.601953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:50.607683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:50.608039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] PATH_INFO: `/v3/users/b75a38545bab453695849000c3601256` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:50.617070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75a38545bab453695849000c3601256)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:50.619101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:50.726526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c569857d759d43178cbe93e3bcff023d', 'request_id': 'req-3eef76a2-046b-400f-bd45-f8b28e33b63f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.748405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c569857d759d43178cbe93e3bcff023d', 'request_id': 'req-3eef76a2-046b-400f-bd45-f8b28e33b63f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.770513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c569857d759d43178cbe93e3bcff023d', 'request_id': 'req-3eef76a2-046b-400f-bd45-f8b28e33b63f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.831646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] The token cache is being invalidate because project c569857d759d43178cbe93e3bcff023d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:50.832008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.835772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3eef76a2-046b-400f-bd45-f8b28e33b63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.850424 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2918/5792] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:50 2022] DELETE /identity/v3/projects/c569857d759d43178cbe93e3bcff023d => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:11:50.851977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90ddb-5f34-434f-83b5-e6ac9ef8964e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:50.852259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90ddb-5f34-434f-83b5-e6ac9ef8964e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:50.852533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90ddb-5f34-434f-83b5-e6ac9ef8964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:50.871050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75a38545bab453695849000c3601256'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.907846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75a38545bab453695849000c3601256'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.918750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6eb90ddb-5f34-434f-83b5-e6ac9ef8964e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:50.920180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6eb90ddb-5f34-434f-83b5-e6ac9ef8964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:50.934518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75a38545bab453695849000c3601256'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.963210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75a38545bab453695849000c3601256'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.968954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7758618e-adb4-426b-872a-7165aa8bade6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75a38545bab453695849000c3601256'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:50.971895 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:50.997256 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2875/5793] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:50 2022] DELETE /identity/v3/users/b75a38545bab453695849000c3601256 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:51.120679 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2919/5794] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:51.128493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5971e1f-6318-4ab0-b2e0-41ede9351ec9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:51.128829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5971e1f-6318-4ab0-b2e0-41ede9351ec9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:51.129115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5971e1f-6318-4ab0-b2e0-41ede9351ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:51.171699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c5971e1f-6318-4ab0-b2e0-41ede9351ec9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:51.173484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c5971e1f-6318-4ab0-b2e0-41ede9351ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:51.328085 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2876/5795] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:51.329451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90ddb-5f34-434f-83b5-e6ac9ef8964e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:51.358718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90ddb-5f34-434f-83b5-e6ac9ef8964e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:51.366725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92e3d8-00d0-4f8d-a5b6-fc4a6b4661b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:51.372980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92e3d8-00d0-4f8d-a5b6-fc4a6b4661b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:51.373380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92e3d8-00d0-4f8d-a5b6-fc4a6b4661b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:51.373906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92e3d8-00d0-4f8d-a5b6-fc4a6b4661b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:51.374924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92e3d8-00d0-4f8d-a5b6-fc4a6b4661b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:11:51.375345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92e3d8-00d0-4f8d-a5b6-fc4a6b4661b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:51.377217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92e3d8-00d0-4f8d-a5b6-fc4a6b4661b3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:51.401150 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2920/5796] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:51.405089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5971e1f-6318-4ab0-b2e0-41ede9351ec9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:51.420454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5971e1f-6318-4ab0-b2e0-41ede9351ec9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:51.437405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5ec8-fd47-4ac4-93cf-0fbcdfbb8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:51.439964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5ec8-fd47-4ac4-93cf-0fbcdfbb8944 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:51.440270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5ec8-fd47-4ac4-93cf-0fbcdfbb8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:51.440550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5ec8-fd47-4ac4-93cf-0fbcdfbb8944 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:51.441259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c5ec8-fd47-4ac4-93cf-0fbcdfbb8944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:51.444086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c5ec8-fd47-4ac4-93cf-0fbcdfbb8944 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:51.499055 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2877/5797] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:51 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:51.503297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92e3d8-00d0-4f8d-a5b6-fc4a6b4661b3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:51.531351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92e3d8-00d0-4f8d-a5b6-fc4a6b4661b3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:51.746550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f372b-0908-4ebc-833f-5e77fed0a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:51.747266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f372b-0908-4ebc-833f-5e77fed0a2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:51.747620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f372b-0908-4ebc-833f-5e77fed0a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:51.747964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f372b-0908-4ebc-833f-5e77fed0a2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:51.749524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f372b-0908-4ebc-833f-5e77fed0a2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:51.751946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f372b-0908-4ebc-833f-5e77fed0a2c1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:51.807673 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2921/5798] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:51 2022] POST /identity/v3/users => generated 287 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:51.810888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5ec8-fd47-4ac4-93cf-0fbcdfbb8944 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:51.826070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5ec8-fd47-4ac4-93cf-0fbcdfbb8944 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:51.857675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a676f-a900-44f6-8574-754024941895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:51.858308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a676f-a900-44f6-8574-754024941895 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:51.858586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a676f-a900-44f6-8574-754024941895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:51.858856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a676f-a900-44f6-8574-754024941895 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:51.859507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a676f-a900-44f6-8574-754024941895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:51.861167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a676f-a900-44f6-8574-754024941895 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:51.896343 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2878/5799] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:51.905962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f372b-0908-4ebc-833f-5e77fed0a2c1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:51.933355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f372b-0908-4ebc-833f-5e77fed0a2c1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:51.973677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76c1ee-6934-4af4-878a-cdb34eaa1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:51.980569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76c1ee-6934-4af4-878a-cdb34eaa1b08 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:51.983517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76c1ee-6934-4af4-878a-cdb34eaa1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:51.984061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76c1ee-6934-4af4-878a-cdb34eaa1b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:51.988033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76c1ee-6934-4af4-878a-cdb34eaa1b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:51.990146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76c1ee-6934-4af4-878a-cdb34eaa1b08 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:52.045491 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2922/5800] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:52.048790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a676f-a900-44f6-8574-754024941895 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:52.055679 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:52.073039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a676f-a900-44f6-8574-754024941895 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:52.100647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c9095-6469-4a9b-866a-0bb8b9a53b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:52.101353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c9095-6469-4a9b-866a-0bb8b9a53b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:52.101636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c9095-6469-4a9b-866a-0bb8b9a53b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:52.102003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c9095-6469-4a9b-866a-0bb8b9a53b6a admin admin] PATH_INFO: `/v3/projects/8c919db97d2b45578cf3635016ed8ed8/users/44b86384bd25412ebbf136740265dcf1/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:52.144734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c9095-6469-4a9b-866a-0bb8b9a53b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c919db97d2b45578cf3635016ed8ed8, user_id=44b86384bd25412ebbf136740265dcf1, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:52.155137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c9095-6469-4a9b-866a-0bb8b9a53b6a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:52.204966 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2879/5801] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:52 2022] PUT /identity/v3/projects/8c919db97d2b45578cf3635016ed8ed8/users/44b86384bd25412ebbf136740265dcf1/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:52.207648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfdcb4-d851-4a78-8efa-2c778cb1a8b4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:52.208134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfdcb4-d851-4a78-8efa-2c778cb1a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:52.208505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfdcb4-d851-4a78-8efa-2c778cb1a8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:52.261612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-21cfdcb4-d851-4a78-8efa-2c778cb1a8b4 None None] MFA Rules not processed for user `44b86384bd25412ebbf136740265dcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:52.263343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-21cfdcb4-d851-4a78-8efa-2c778cb1a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:52.363569 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2923/5802] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:52.367657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c9095-6469-4a9b-866a-0bb8b9a53b6a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:52.535030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c9095-6469-4a9b-866a-0bb8b9a53b6a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:52.557609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd9168-b656-45b8-ad32-6b6be121290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:52.558520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd9168-b656-45b8-ad32-6b6be121290d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:52.558959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd9168-b656-45b8-ad32-6b6be121290d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:52.559388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd9168-b656-45b8-ad32-6b6be121290d admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:52.560216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd9168-b656-45b8-ad32-6b6be121290d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:52.562515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd9168-b656-45b8-ad32-6b6be121290d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:52.629062 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2880/5803] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:52 2022] POST /identity/v3/projects => generated 375 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:52.633166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfdcb4-d851-4a78-8efa-2c778cb1a8b4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:52.648558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfdcb4-d851-4a78-8efa-2c778cb1a8b4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:52.705919 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:52.784862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41dfd0-f087-4e9a-9e05-4da62db2c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:52.787202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41dfd0-f087-4e9a-9e05-4da62db2c10a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:52.788098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41dfd0-f087-4e9a-9e05-4da62db2c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:52.789269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41dfd0-f087-4e9a-9e05-4da62db2c10a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:52.791251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41dfd0-f087-4e9a-9e05-4da62db2c10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:52.801364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41dfd0-f087-4e9a-9e05-4da62db2c10a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:52.858779 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2924/5804] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:52 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:52.860646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd9168-b656-45b8-ad32-6b6be121290d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:52.880944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd9168-b656-45b8-ad32-6b6be121290d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:52.897063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bae20-8d56-4a31-b2fc-2d4772f220a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:52.897697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bae20-8d56-4a31-b2fc-2d4772f220a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:52.897985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bae20-8d56-4a31-b2fc-2d4772f220a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:52.898263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bae20-8d56-4a31-b2fc-2d4772f220a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:52.899435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bae20-8d56-4a31-b2fc-2d4772f220a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:52.906618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bae20-8d56-4a31-b2fc-2d4772f220a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:52.939996 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2881/5805] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:52.956646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41dfd0-f087-4e9a-9e05-4da62db2c10a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:52.963934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41dfd0-f087-4e9a-9e05-4da62db2c10a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:52.971630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c534b-e978-4069-97c8-cfd0fd915c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:52.972320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c534b-e978-4069-97c8-cfd0fd915c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:52.972601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c534b-e978-4069-97c8-cfd0fd915c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:52.972903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c534b-e978-4069-97c8-cfd0fd915c20 admin admin] PATH_INFO: `/v3/projects/1407ab4e6abf412f963ed6541894e035/users/acc6bee33af64ed9a33c2d4868f5d8e6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:53.010442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c534b-e978-4069-97c8-cfd0fd915c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1407ab4e6abf412f963ed6541894e035, user_id=acc6bee33af64ed9a33c2d4868f5d8e6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:53.013234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c534b-e978-4069-97c8-cfd0fd915c20 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:53.054226 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2925/5806] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:52 2022] PUT /identity/v3/projects/1407ab4e6abf412f963ed6541894e035/users/acc6bee33af64ed9a33c2d4868f5d8e6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:53.058092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bae20-8d56-4a31-b2fc-2d4772f220a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:53.068839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bae20-8d56-4a31-b2fc-2d4772f220a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:53.220711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6ea70-f6a5-41ad-b7f0-ec520e678623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:53.221410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6ea70-f6a5-41ad-b7f0-ec520e678623 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:53.225780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6ea70-f6a5-41ad-b7f0-ec520e678623 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:53.227378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6ea70-f6a5-41ad-b7f0-ec520e678623 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:53.228324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6ea70-f6a5-41ad-b7f0-ec520e678623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:53.235933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6ea70-f6a5-41ad-b7f0-ec520e678623 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:53.259606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c534b-e978-4069-97c8-cfd0fd915c20 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:53.260070 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2882/5807] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:53.282942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c534b-e978-4069-97c8-cfd0fd915c20 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:53.303681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d5160-2e1c-4cd3-b329-89792286ab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:53.304378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d5160-2e1c-4cd3-b329-89792286ab80 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:53.304685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d5160-2e1c-4cd3-b329-89792286ab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:53.304968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d5160-2e1c-4cd3-b329-89792286ab80 admin admin] PATH_INFO: `/v3/projects/1407ab4e6abf412f963ed6541894e035/users/acc6bee33af64ed9a33c2d4868f5d8e6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:53.319581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d5160-2e1c-4cd3-b329-89792286ab80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1407ab4e6abf412f963ed6541894e035, user_id=acc6bee33af64ed9a33c2d4868f5d8e6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:53.330768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d5160-2e1c-4cd3-b329-89792286ab80 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:53.395854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5632a1-6091-4b8f-b729-e76ec40b73a4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:53.396191 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2926/5808] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:53 2022] PUT /identity/v3/projects/1407ab4e6abf412f963ed6541894e035/users/acc6bee33af64ed9a33c2d4868f5d8e6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:53.396691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5632a1-6091-4b8f-b729-e76ec40b73a4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:53.396691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5632a1-6091-4b8f-b729-e76ec40b73a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:53.478311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fc5632a1-6091-4b8f-b729-e76ec40b73a4 None None] MFA Rules not processed for user `acc6bee33af64ed9a33c2d4868f5d8e6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:53.479781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc5632a1-6091-4b8f-b729-e76ec40b73a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:53.591412 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:53.755070 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2883/5809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:11:53.760292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d5160-2e1c-4cd3-b329-89792286ab80 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:53.787133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d5160-2e1c-4cd3-b329-89792286ab80 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:53.816301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495131-97f8-4c93-9a25-dcec0088b006 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:53.817033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495131-97f8-4c93-9a25-dcec0088b006 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:53.821002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495131-97f8-4c93-9a25-dcec0088b006 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:53.821322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495131-97f8-4c93-9a25-dcec0088b006 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:53.822540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab495131-97f8-4c93-9a25-dcec0088b006 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:53.836896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab495131-97f8-4c93-9a25-dcec0088b006 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:53.927027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5632a1-6091-4b8f-b729-e76ec40b73a4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:53.932071 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2927/5810] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:53 2022] POST /identity/v3/projects => generated 351 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:53.952662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5632a1-6091-4b8f-b729-e76ec40b73a4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:54.062270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb264da-5f28-4d16-afa4-084568c02fc1 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:54.063555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb264da-5f28-4d16-afa4-084568c02fc1 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:54.063555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb264da-5f28-4d16-afa4-084568c02fc1 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:54.063555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb264da-5f28-4d16-afa4-084568c02fc1 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:54.064466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb264da-5f28-4d16-afa4-084568c02fc1 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:54.066447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb264da-5f28-4d16-afa4-084568c02fc1 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:54.096390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495131-97f8-4c93-9a25-dcec0088b006 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:54.098494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab495131-97f8-4c93-9a25-dcec0088b006 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:54.145315 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2884/5811] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:53 2022] POST /identity/v3/projects => generated 351 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:54.148841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb264da-5f28-4d16-afa4-084568c02fc1 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:54.271572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495131-97f8-4c93-9a25-dcec0088b006 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:54.355634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb264da-5f28-4d16-afa4-084568c02fc1 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:54.376289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8597-2c58-4999-934c-2dbfff7ed818 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:54.378451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8597-2c58-4999-934c-2dbfff7ed818 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:54.378777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8597-2c58-4999-934c-2dbfff7ed818 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:54.379936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8597-2c58-4999-934c-2dbfff7ed818 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/users/44b86384bd25412ebbf136740265dcf1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:54.382315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8597-2c58-4999-934c-2dbfff7ed818 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:get_user(user_id=44b86384bd25412ebbf136740265dcf1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:54.384381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8597-2c58-4999-934c-2dbfff7ed818 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:54.387425 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2885/5812] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:11:54 2022] GET /identity/v3/users/44b86384bd25412ebbf136740265dcf1 => generated 287 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:54.391775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8597-2c58-4999-934c-2dbfff7ed818 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:54.420064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8597-2c58-4999-934c-2dbfff7ed818 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:54.451588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:54.452184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd84a0-ab9f-4506-bce2-40f1b9b47a59 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:54.452409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:54.452787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:54.452954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd84a0-ab9f-4506-bce2-40f1b9b47a59 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:54.453208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] PATH_INFO: `/v3/projects/39b428ed3dec4d77aae81a3f6d39e3c7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:54.453361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd84a0-ab9f-4506-bce2-40f1b9b47a59 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:54.453704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd84a0-ab9f-4506-bce2-40f1b9b47a59 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/credentials` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:54.454775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd84a0-ab9f-4506-bce2-40f1b9b47a59 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:54.455035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b428ed3dec4d77aae81a3f6d39e3c7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:54.458702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:54.460509 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:54.460860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd84a0-ab9f-4506-bce2-40f1b9b47a59 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:54.521365 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2886/5813] 10.222.0.27 () {60 vars in 1162 bytes} [Wed Oct 19 01:11:54 2022] POST /identity/v3/credentials => generated 431 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:54.526029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd84a0-ab9f-4506-bce2-40f1b9b47a59 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:54.566152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b428ed3dec4d77aae81a3f6d39e3c7', 'request_id': 'req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:54.584873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd84a0-ab9f-4506-bce2-40f1b9b47a59 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:54.588226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b428ed3dec4d77aae81a3f6d39e3c7', 'request_id': 'req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:54.617718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b428ed3dec4d77aae81a3f6d39e3c7', 'request_id': 'req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:54.648585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] The token cache is being invalidate because project 39b428ed3dec4d77aae81a3f6d39e3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:54.648910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:54.649891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:54.657364 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2928/5814] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:54 2022] DELETE /identity/v3/projects/39b428ed3dec4d77aae81a3f6d39e3c7 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:11:54.658380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:54.659913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:54.738713 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:54.798992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18bf8d-001d-4b53-83fd-91dfa77e98b4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:54.811836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:54.812962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:54.813761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:54.814168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:54.814530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/credentials/07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:54.814652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:54.815097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:54.815561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] PATH_INFO: `/v3/users/d3909e37eb924aa79066384d56ecee88` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:54.819647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3909e37eb924aa79066384d56ecee88)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:54.822190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:54.824931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:54.826883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:54.830745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:54.850686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:54.883030 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2887/5815] 10.222.0.27 () {60 vars in 1358 bytes} [Wed Oct 19 01:11:54 2022] PATCH /identity/v3/credentials/07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363 => generated 437 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:54.885218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:54.888166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:54.924433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57745721-cb45-47bf-b13a-8e2b6b760ab9 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:54.938895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73169c6-c3db-4728-901f-aa8a9a5c892b tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:54.939801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73169c6-c3db-4728-901f-aa8a9a5c892b tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:54.940199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73169c6-c3db-4728-901f-aa8a9a5c892b tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:54.940586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73169c6-c3db-4728-901f-aa8a9a5c892b tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/credentials/07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:54.944850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73169c6-c3db-4728-901f-aa8a9a5c892b tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:54.953213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3909e37eb924aa79066384d56ecee88'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:54.954234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73169c6-c3db-4728-901f-aa8a9a5c892b tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:54.960764 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2888/5816] 10.222.0.27 () {58 vars in 1335 bytes} [Wed Oct 19 01:11:54 2022] GET /identity/v3/credentials/07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363 => generated 437 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:54.962329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73169c6-c3db-4728-901f-aa8a9a5c892b tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:54.975440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3909e37eb924aa79066384d56ecee88'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:54.987000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73169c6-c3db-4728-901f-aa8a9a5c892b tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:55.000300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3909e37eb924aa79066384d56ecee88'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:55.017492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df210-ae1d-4c99-84f6-426fb5743160 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:55.018167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df210-ae1d-4c99-84f6-426fb5743160 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:55.018455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df210-ae1d-4c99-84f6-426fb5743160 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:55.018732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df210-ae1d-4c99-84f6-426fb5743160 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/credentials/07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:55.028011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3909e37eb924aa79066384d56ecee88'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:55.028887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3909e37eb924aa79066384d56ecee88'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:55.033109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5df210-ae1d-4c99-84f6-426fb5743160 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:55.035567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5df210-ae1d-4c99-84f6-426fb5743160 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:55.065438 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2929/5817] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:54 2022] DELETE /identity/v3/users/d3909e37eb924aa79066384d56ecee88 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:55.109884 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2889/5818] 10.222.0.27 () {58 vars in 1338 bytes} [Wed Oct 19 01:11:54 2022] DELETE /identity/v3/credentials/07cea6fc8fe083cf58e711bc5e64dcb1fedf9b2a0837a893f47be7e12cffe363 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:55.115078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:55.116561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:55.144054 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:55.355594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67e45-4fb8-45e3-acec-6691821404af admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:55.367023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f065-a109-48ec-879d-6290ae0bad38 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:55.368533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f065-a109-48ec-879d-6290ae0bad38 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:55.368855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f065-a109-48ec-879d-6290ae0bad38 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:55.369119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f065-a109-48ec-879d-6290ae0bad38 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:55.371991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5f065-a109-48ec-879d-6290ae0bad38 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:55.376034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5f065-a109-48ec-879d-6290ae0bad38 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:55.419947 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2930/5819] 10.222.0.27 () {60 vars in 1162 bytes} [Wed Oct 19 01:11:55 2022] POST /identity/v3/credentials => generated 430 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:55.424082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df210-ae1d-4c99-84f6-426fb5743160 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:55.442721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df210-ae1d-4c99-84f6-426fb5743160 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:55.457699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab29415-cbdc-4e48-9e84-a9454ccc9508 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:55.458342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab29415-cbdc-4e48-9e84-a9454ccc9508 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:55.458645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab29415-cbdc-4e48-9e84-a9454ccc9508 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:55.458922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab29415-cbdc-4e48-9e84-a9454ccc9508 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/credentials` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:55.463284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab29415-cbdc-4e48-9e84-a9454ccc9508 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:55.465141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab29415-cbdc-4e48-9e84-a9454ccc9508 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:55.521817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f065-a109-48ec-879d-6290ae0bad38 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:55.534634 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2890/5820] 10.222.0.27 () {60 vars in 1162 bytes} [Wed Oct 19 01:11:55 2022] POST /identity/v3/credentials => generated 430 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:55.539350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f065-a109-48ec-879d-6290ae0bad38 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:55.558279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:55.562085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:55.563403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:55.563867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:55.566482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:55.571071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:55.606165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:55.617776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:55.626627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:55.633139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:55.649185 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2931/5821] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Oct 19 01:11:55 2022] GET /identity/v3/credentials => generated 945 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:55.651571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab29415-cbdc-4e48-9e84-a9454ccc9508 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:55.678138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab29415-cbdc-4e48-9e84-a9454ccc9508 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:55.688402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a06b-11b1-4fc7-8c1e-39f12da51fb6 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:55.688402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a06b-11b1-4fc7-8c1e-39f12da51fb6 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:55.688402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a06b-11b1-4fc7-8c1e-39f12da51fb6 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:55.688863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a06b-11b1-4fc7-8c1e-39f12da51fb6 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/credentials/e60903fee4d3c18929e5efed13ce99387925652a015ed2876a0ea6825a7e0907` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:55.693899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068a06b-11b1-4fc7-8c1e-39f12da51fb6 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=e60903fee4d3c18929e5efed13ce99387925652a015ed2876a0ea6825a7e0907)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:55.699028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068a06b-11b1-4fc7-8c1e-39f12da51fb6 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:55.733508 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2891/5822] 10.222.0.27 () {58 vars in 1338 bytes} [Wed Oct 19 01:11:55 2022] DELETE /identity/v3/credentials/e60903fee4d3c18929e5efed13ce99387925652a015ed2876a0ea6825a7e0907 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:11:55.737888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:55.748353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa6f98-fcf4-4968-bab6-ae2bd73620a5 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:55.765789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f49cd-8c62-457c-88f0-f85b7acd0d85 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:55.766488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f49cd-8c62-457c-88f0-f85b7acd0d85 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:55.766741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f49cd-8c62-457c-88f0-f85b7acd0d85 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:55.767024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f49cd-8c62-457c-88f0-f85b7acd0d85 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/credentials/43590a95403ff76e85cf49b3e180591a174d92f7990e3f79b265d221ca76e865` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:55.769071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f49cd-8c62-457c-88f0-f85b7acd0d85 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=43590a95403ff76e85cf49b3e180591a174d92f7990e3f79b265d221ca76e865)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:55.770846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f49cd-8c62-457c-88f0-f85b7acd0d85 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:55.809553 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2932/5823] 10.222.0.27 () {58 vars in 1338 bytes} [Wed Oct 19 01:11:55 2022] DELETE /identity/v3/credentials/43590a95403ff76e85cf49b3e180591a174d92f7990e3f79b265d221ca76e865 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:55.814791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a06b-11b1-4fc7-8c1e-39f12da51fb6 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:55.845854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a06b-11b1-4fc7-8c1e-39f12da51fb6 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:55.859602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:55.860694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:55.861110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:55.861474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/projects/6af410a83ec1413aa9670786b87fada4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:55.865090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6af410a83ec1413aa9670786b87fada4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:55.867205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:56.026754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f49cd-8c62-457c-88f0-f85b7acd0d85 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:56.028854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-291f49cd-8c62-457c-88f0-f85b7acd0d85 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:56.072080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af410a83ec1413aa9670786b87fada4', 'request_id': 'req-104df575-8a58-40a5-adcb-a330206d24f2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.107326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af410a83ec1413aa9670786b87fada4', 'request_id': 'req-104df575-8a58-40a5-adcb-a330206d24f2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.129953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af410a83ec1413aa9670786b87fada4', 'request_id': 'req-104df575-8a58-40a5-adcb-a330206d24f2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.150965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] The token cache is being invalidate because project 6af410a83ec1413aa9670786b87fada4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:56.151396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.152814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.161498 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2892/5824] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:55 2022] DELETE /identity/v3/projects/6af410a83ec1413aa9670786b87fada4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:56.161498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:56.162131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:56.264520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f49cd-8c62-457c-88f0-f85b7acd0d85 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:56.307941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104df575-8a58-40a5-adcb-a330206d24f2 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:56.320426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:56.321106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:56.321449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:56.321725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] PATH_INFO: `/v3/users/f999b44dd2a243eaa874a13d0d79ad40` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:56.323483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f999b44dd2a243eaa874a13d0d79ad40)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:56.325692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:56.375115 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:56.433439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f999b44dd2a243eaa874a13d0d79ad40'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.489704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f999b44dd2a243eaa874a13d0d79ad40'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.529124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f999b44dd2a243eaa874a13d0d79ad40'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.547842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f999b44dd2a243eaa874a13d0d79ad40'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.548636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:56.549600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:56.549883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:56.550158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] PATH_INFO: `/v3/projects/47249678672247f6ab2504b23a1255d1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:56.551009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f999b44dd2a243eaa874a13d0d79ad40'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.551962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47249678672247f6ab2504b23a1255d1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:56.558875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:56.568792 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2893/5825] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:56 2022] DELETE /identity/v3/users/f999b44dd2a243eaa874a13d0d79ad40 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:56.570727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:56.576945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:56.678316 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:56.750967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47249678672247f6ab2504b23a1255d1', 'request_id': 'req-6e29b971-d112-49bf-9f00-ec32a624bd36'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.783802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47249678672247f6ab2504b23a1255d1', 'request_id': 'req-6e29b971-d112-49bf-9f00-ec32a624bd36'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.795961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47249678672247f6ab2504b23a1255d1', 'request_id': 'req-6e29b971-d112-49bf-9f00-ec32a624bd36'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.819458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46862d44-ec7c-43ab-aef2-02c3e355b000 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:56.826954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] The token cache is being invalidate because project 47249678672247f6ab2504b23a1255d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:56.827603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.829642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6e29b971-d112-49bf-9f00-ec32a624bd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:56.833620 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2933/5826] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:56 2022] DELETE /identity/v3/projects/47249678672247f6ab2504b23a1255d1 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:56.835256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852a63-743c-4941-bd84-6f7ead55460f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:56.835787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852a63-743c-4941-bd84-6f7ead55460f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:56.840453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852a63-743c-4941-bd84-6f7ead55460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:56.864119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-76852a63-743c-4941-bd84-6f7ead55460f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:56.865897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-76852a63-743c-4941-bd84-6f7ead55460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:56.995356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc6bee33af64ed9a33c2d4868f5d8e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1407ab4e6abf412f963ed6541894e035', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:56.997674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:56.998404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:56.999485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] PATH_INFO: `/v3/projects/7e5246263a024048822bc49c903d04a7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:57.003330 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2934/5827] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:57.003999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e5246263a024048822bc49c903d04a7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:57.007087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb00e-0d10-47a1-a30f-ef8eaa3e461e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:57.007602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb00e-0d10-47a1-a30f-ef8eaa3e461e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:57.009739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:57.011669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb00e-0d10-47a1-a30f-ef8eaa3e461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:57.062719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-33ebb00e-0d10-47a1-a30f-ef8eaa3e461e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:57.068812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-33ebb00e-0d10-47a1-a30f-ef8eaa3e461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:57.107242 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2935/5828] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:57.110377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634b9f0-6148-4c35-b8de-7eceac7f6e3f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:57.111359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634b9f0-6148-4c35-b8de-7eceac7f6e3f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:57.111697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634b9f0-6148-4c35-b8de-7eceac7f6e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:57.153087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0634b9f0-6148-4c35-b8de-7eceac7f6e3f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:57.154407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0634b9f0-6148-4c35-b8de-7eceac7f6e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:57.166392 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:57.172241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5246263a024048822bc49c903d04a7', 'request_id': 'req-779e433d-b5fc-41db-931c-0fb2c4541078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.201214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5246263a024048822bc49c903d04a7', 'request_id': 'req-779e433d-b5fc-41db-931c-0fb2c4541078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.230136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5246263a024048822bc49c903d04a7', 'request_id': 'req-779e433d-b5fc-41db-931c-0fb2c4541078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.251134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] The token cache is being invalidate because project 7e5246263a024048822bc49c903d04a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:11:57.251507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.252497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.254570 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2894/5829] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:56 2022] DELETE /identity/v3/projects/7e5246263a024048822bc49c903d04a7 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:57.255673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:57.257398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:57.301154 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2936/5830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:57.302081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634b9f0-6148-4c35-b8de-7eceac7f6e3f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:57.306885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0634b9f0-6148-4c35-b8de-7eceac7f6e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:57.327062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634b9f0-6148-4c35-b8de-7eceac7f6e3f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:57.345353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:57.346089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:57.346368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:57.346696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] PATH_INFO: `/v3/users/44b86384bd25412ebbf136740265dcf1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:57.348207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b86384bd25412ebbf136740265dcf1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:57.351450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:57.452841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e433d-b5fc-41db-931c-0fb2c4541078 tempest-CredentialsTestJSON-1314884395 tempest-CredentialsTestJSON-1314884395-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:57.465680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de127a07-1870-4857-a433-e6d306b617ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:57.469957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de127a07-1870-4857-a433-e6d306b617ac service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:57.470462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de127a07-1870-4857-a433-e6d306b617ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:57.471428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de127a07-1870-4857-a433-e6d306b617ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:57.476319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-de127a07-1870-4857-a433-e6d306b617ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:57.519430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de127a07-1870-4857-a433-e6d306b617ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:57.521088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de127a07-1870-4857-a433-e6d306b617ac service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:57.527413 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:57.532640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b86384bd25412ebbf136740265dcf1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.552079 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2895/5831] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:57.558836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b86384bd25412ebbf136740265dcf1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.559626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de127a07-1870-4857-a433-e6d306b617ac service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:57.570287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b86384bd25412ebbf136740265dcf1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.583321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de127a07-1870-4857-a433-e6d306b617ac service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:57.588090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b86384bd25412ebbf136740265dcf1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.590735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-537db23a-b0af-470d-ba32-40e141e6510d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b86384bd25412ebbf136740265dcf1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:11:57.596474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:57.597472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:57.597903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:57.598329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:57.599140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:11:57.599597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:57.601396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:57.620748 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2937/5832] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:11:57 2022] DELETE /identity/v3/users/44b86384bd25412ebbf136740265dcf1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:57.622402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306123-4591-442c-98cc-ac688a5423e7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:57.624433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306123-4591-442c-98cc-ac688a5423e7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:57.625420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306123-4591-442c-98cc-ac688a5423e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:57.634604 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2896/5833] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:11:57.635759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:57.642180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:57.674640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d87a3-5198-43c3-b326-3ae0a14d3103 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:57.676005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-92306123-4591-442c-98cc-ac688a5423e7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:57.679232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-92306123-4591-442c-98cc-ac688a5423e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:57.860153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5ce74-084f-4e9b-9f76-9036cdba86d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:57.860810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5ce74-084f-4e9b-9f76-9036cdba86d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:57.861090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5ce74-084f-4e9b-9f76-9036cdba86d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:57.861369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5ce74-084f-4e9b-9f76-9036cdba86d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:57.862013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5ce74-084f-4e9b-9f76-9036cdba86d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:57.863929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5ce74-084f-4e9b-9f76-9036cdba86d9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:57.874487 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2938/5834] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:57.886617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306123-4591-442c-98cc-ac688a5423e7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:57.889260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-92306123-4591-442c-98cc-ac688a5423e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:57.957285 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2897/5835] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:57 2022] POST /identity/v3/projects => generated 399 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:57.960479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5ce74-084f-4e9b-9f76-9036cdba86d9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:58.048183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306123-4591-442c-98cc-ac688a5423e7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:58.099031 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:58.131368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5ce74-084f-4e9b-9f76-9036cdba86d9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:58.144135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896464e-dfd1-49b7-9f10-b1ac030a3c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:58.144804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896464e-dfd1-49b7-9f10-b1ac030a3c5a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:58.145087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896464e-dfd1-49b7-9f10-b1ac030a3c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:58.145363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896464e-dfd1-49b7-9f10-b1ac030a3c5a admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:58.146009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896464e-dfd1-49b7-9f10-b1ac030a3c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:58.147955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896464e-dfd1-49b7-9f10-b1ac030a3c5a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:58.166735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f6480-f7ca-4d8a-9c22-ed4397f95c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:58.167688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f6480-f7ca-4d8a-9c22-ed4397f95c8a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:58.168196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f6480-f7ca-4d8a-9c22-ed4397f95c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:58.169677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f6480-f7ca-4d8a-9c22-ed4397f95c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:58.194961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f6480-f7ca-4d8a-9c22-ed4397f95c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:58.199538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f6480-f7ca-4d8a-9c22-ed4397f95c8a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:58.200018 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2898/5836] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:57 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:11:58.204249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896464e-dfd1-49b7-9f10-b1ac030a3c5a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:58.225886 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2939/5837] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:11:58.241236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896464e-dfd1-49b7-9f10-b1ac030a3c5a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:58.253268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7870d10-176e-4cfd-9629-d2d98c6e1f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:58.254351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7870d10-176e-4cfd-9629-d2d98c6e1f21 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:58.254707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7870d10-176e-4cfd-9629-d2d98c6e1f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:58.255061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7870d10-176e-4cfd-9629-d2d98c6e1f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:58.255867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7870d10-176e-4cfd-9629-d2d98c6e1f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:58.257890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7870d10-176e-4cfd-9629-d2d98c6e1f21 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:58.275370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f6480-f7ca-4d8a-9c22-ed4397f95c8a service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:58.281221 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2899/5838] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:58.287397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f6480-f7ca-4d8a-9c22-ed4397f95c8a service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:58.293397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e96c10-1ac1-41e6-9d1f-e06d51c6d2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:58.294139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e96c10-1ac1-41e6-9d1f-e06d51c6d2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:58.294671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e96c10-1ac1-41e6-9d1f-e06d51c6d2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:58.295180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e96c10-1ac1-41e6-9d1f-e06d51c6d2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:58.296362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e96c10-1ac1-41e6-9d1f-e06d51c6d2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:58.298458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e96c10-1ac1-41e6-9d1f-e06d51c6d2c0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:58.319008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7870d10-176e-4cfd-9629-d2d98c6e1f21 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:58.327098 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2940/5839] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:11:58.334026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7870d10-176e-4cfd-9629-d2d98c6e1f21 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:58.343893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88500ff-9287-42ac-8757-23bbc711d294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:58.344784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88500ff-9287-42ac-8757-23bbc711d294 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:58.345207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88500ff-9287-42ac-8757-23bbc711d294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:58.345654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88500ff-9287-42ac-8757-23bbc711d294 admin admin] PATH_INFO: `/v3/projects/115a626878d5477d886f478753425e6f/users/60fa48f0599441b788b2a149ba9b20ef/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:58.368227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88500ff-9287-42ac-8757-23bbc711d294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115a626878d5477d886f478753425e6f, user_id=60fa48f0599441b788b2a149ba9b20ef, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:58.371992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88500ff-9287-42ac-8757-23bbc711d294 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:58.401828 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2900/5840] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:58 2022] PUT /identity/v3/projects/115a626878d5477d886f478753425e6f/users/60fa48f0599441b788b2a149ba9b20ef/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:11:58.411732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801edd9-c0b2-4cd9-8615-8ece5776ee36 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:58.412136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801edd9-c0b2-4cd9-8615-8ece5776ee36 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:58.412538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801edd9-c0b2-4cd9-8615-8ece5776ee36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:58.453979 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:58.481880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5801edd9-c0b2-4cd9-8615-8ece5776ee36 None None] MFA Rules not processed for user `60fa48f0599441b788b2a149ba9b20ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:11:58.487644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5801edd9-c0b2-4cd9-8615-8ece5776ee36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:59.004110 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2941/5841] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:11:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 594 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:11:59.009303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88500ff-9287-42ac-8757-23bbc711d294 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:59.314845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88500ff-9287-42ac-8757-23bbc711d294 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:59.335492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b84b2-6c7c-4226-a0a1-be9848ca5270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:59.336141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b84b2-6c7c-4226-a0a1-be9848ca5270 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:59.336443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b84b2-6c7c-4226-a0a1-be9848ca5270 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:59.336772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b84b2-6c7c-4226-a0a1-be9848ca5270 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:59.337447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b84b2-6c7c-4226-a0a1-be9848ca5270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:59.339417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b84b2-6c7c-4226-a0a1-be9848ca5270 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:59.462706 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2901/5842] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:11:59 2022] POST /identity/v3/projects => generated 399 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:11:59.466885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801edd9-c0b2-4cd9-8615-8ece5776ee36 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:59.484583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801edd9-c0b2-4cd9-8615-8ece5776ee36 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:59.693533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c9757-6f32-4898-a26a-8dc9ecdf5896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:59.701376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c9757-6f32-4898-a26a-8dc9ecdf5896 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:59.701376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c9757-6f32-4898-a26a-8dc9ecdf5896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:59.701582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c9757-6f32-4898-a26a-8dc9ecdf5896 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:59.702123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c9757-6f32-4898-a26a-8dc9ecdf5896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:59.727430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c9757-6f32-4898-a26a-8dc9ecdf5896 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:59.809844 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2942/5843] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:11:59 2022] POST /identity/v3/users => generated 306 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:11:59.813842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b84b2-6c7c-4226-a0a1-be9848ca5270 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:59.825684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b84b2-6c7c-4226-a0a1-be9848ca5270 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:59.849346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeba25-1e22-4ee7-8975-89bc2f354ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:59.849988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeba25-1e22-4ee7-8975-89bc2f354ecb admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:59.853288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeba25-1e22-4ee7-8975-89bc2f354ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:59.853582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeba25-1e22-4ee7-8975-89bc2f354ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:59.854410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aeba25-1e22-4ee7-8975-89bc2f354ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:59.856046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aeba25-1e22-4ee7-8975-89bc2f354ecb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:11:59.894973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c9757-6f32-4898-a26a-8dc9ecdf5896 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:59.896917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3b8c9757-6f32-4898-a26a-8dc9ecdf5896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:11:59.943695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c9757-6f32-4898-a26a-8dc9ecdf5896 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:11:59.957144 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2902/5844] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:11:59.958014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeba25-1e22-4ee7-8975-89bc2f354ecb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:11:59.972277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:11:59.972963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:11:59.973241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:11:59.973555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] PATH_INFO: `/v3/projects/8c919db97d2b45578cf3635016ed8ed8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:11:59.977630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c919db97d2b45578cf3635016ed8ed8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:11:59.981412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:00.016222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeba25-1e22-4ee7-8975-89bc2f354ecb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:00.032080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32367ab8-b67b-4f2d-9e84-cf0fe318b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:00.032805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32367ab8-b67b-4f2d-9e84-cf0fe318b3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:00.033089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32367ab8-b67b-4f2d-9e84-cf0fe318b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:00.033368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32367ab8-b67b-4f2d-9e84-cf0fe318b3b4 admin admin] PATH_INFO: `/v3/projects/3de9e3c9911243ad99ee67b8af4b92bf/users/c7bd613a599f4d59a288304730519f34/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:00.091405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32367ab8-b67b-4f2d-9e84-cf0fe318b3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de9e3c9911243ad99ee67b8af4b92bf, user_id=c7bd613a599f4d59a288304730519f34, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:00.094576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32367ab8-b67b-4f2d-9e84-cf0fe318b3b4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:00.136534 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2903/5845] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:11:59 2022] PUT /identity/v3/projects/3de9e3c9911243ad99ee67b8af4b92bf/users/c7bd613a599f4d59a288304730519f34/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:00.141256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32367ab8-b67b-4f2d-9e84-cf0fe318b3b4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:00.164758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c919db97d2b45578cf3635016ed8ed8', 'request_id': 'req-9bab4c49-aefc-4492-a800-aa7f0b10c6df'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.188936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c919db97d2b45578cf3635016ed8ed8', 'request_id': 'req-9bab4c49-aefc-4492-a800-aa7f0b10c6df'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.204326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c919db97d2b45578cf3635016ed8ed8', 'request_id': 'req-9bab4c49-aefc-4492-a800-aa7f0b10c6df'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.249047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] The token cache is being invalidate because project 8c919db97d2b45578cf3635016ed8ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:00.249326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.253254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.263199 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2943/5846] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:11:59 2022] DELETE /identity/v3/projects/8c919db97d2b45578cf3635016ed8ed8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:00.267830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:00.273817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:00.325821 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:00.338833 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:00.355837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32367ab8-b67b-4f2d-9e84-cf0fe318b3b4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:00.486235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab4c49-aefc-4492-a800-aa7f0b10c6df admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:00.499126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:00.499819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:00.500256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:00.500877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] PATH_INFO: `/v3/users/acc6bee33af64ed9a33c2d4868f5d8e6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:00.502917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc6bee33af64ed9a33c2d4868f5d8e6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:00.505518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:00.511665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90332a-b0e4-4d4c-afbe-c97116668f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:00.512285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90332a-b0e4-4d4c-afbe-c97116668f3b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:00.513004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90332a-b0e4-4d4c-afbe-c97116668f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:00.513004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90332a-b0e4-4d4c-afbe-c97116668f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:00.513631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90332a-b0e4-4d4c-afbe-c97116668f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:00.515719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90332a-b0e4-4d4c-afbe-c97116668f3b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:00.548525 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2904/5847] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:00.550037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90332a-b0e4-4d4c-afbe-c97116668f3b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:00.555318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e90332a-b0e4-4d4c-afbe-c97116668f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:00.586937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90332a-b0e4-4d4c-afbe-c97116668f3b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:00.594475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:00.595131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:00.595662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:00.595662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] PATH_INFO: `/v3/projects/b98d13da461545be9445d07ebffe51f6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:00.597310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98d13da461545be9445d07ebffe51f6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:00.601903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:00.615003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc6bee33af64ed9a33c2d4868f5d8e6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.661615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc6bee33af64ed9a33c2d4868f5d8e6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.679434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc6bee33af64ed9a33c2d4868f5d8e6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.693179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc6bee33af64ed9a33c2d4868f5d8e6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.694183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc6bee33af64ed9a33c2d4868f5d8e6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.703391 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2944/5848] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:00 2022] DELETE /identity/v3/users/acc6bee33af64ed9a33c2d4868f5d8e6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:00.705603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:00.707320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98d13da461545be9445d07ebffe51f6', 'request_id': 'req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.721357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:00.726570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98d13da461545be9445d07ebffe51f6', 'request_id': 'req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.734629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98d13da461545be9445d07ebffe51f6', 'request_id': 'req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.753186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] The token cache is being invalidate because project b98d13da461545be9445d07ebffe51f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:00.753481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.754240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3bdd5df-ff1b-4fb1-bdd3-74fab4e009f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:00.755771 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2905/5849] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:00 2022] DELETE /identity/v3/projects/b98d13da461545be9445d07ebffe51f6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:00.762063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17977f7-b5ea-400c-b2f1-c3f7a78ef697 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:00.763030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17977f7-b5ea-400c-b2f1-c3f7a78ef697 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:00.764088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17977f7-b5ea-400c-b2f1-c3f7a78ef697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:00.831967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d17977f7-b5ea-400c-b2f1-c3f7a78ef697 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:00.837309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d17977f7-b5ea-400c-b2f1-c3f7a78ef697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:00.966754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816cb8-1c15-44dd-875f-3d90e299ad42 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:00.984268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666b39e-37c9-4043-a4ea-9514f9eab36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:00.984988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b39e-37c9-4043-a4ea-9514f9eab36b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:00.985265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b39e-37c9-4043-a4ea-9514f9eab36b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:00.985536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b39e-37c9-4043-a4ea-9514f9eab36b admin admin] PATH_INFO: `/v3/projects/3de9e3c9911243ad99ee67b8af4b92bf/users/c7bd613a599f4d59a288304730519f34/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:00.991595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666b39e-37c9-4043-a4ea-9514f9eab36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de9e3c9911243ad99ee67b8af4b92bf, user_id=c7bd613a599f4d59a288304730519f34, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:00.995902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666b39e-37c9-4043-a4ea-9514f9eab36b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:01.014829 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2906/5850] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:01.025459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a089df-688e-4d4c-8927-59475dbf305b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:01.029224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a089df-688e-4d4c-8927-59475dbf305b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:01.029535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a089df-688e-4d4c-8927-59475dbf305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:01.035511 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2945/5851] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:00 2022] PUT /identity/v3/projects/3de9e3c9911243ad99ee67b8af4b92bf/users/c7bd613a599f4d59a288304730519f34/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:01.048493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193df3-19fb-4094-949a-52449067a91e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:01.048819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193df3-19fb-4094-949a-52449067a91e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:01.049066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193df3-19fb-4094-949a-52449067a91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:01.103855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a0a089df-688e-4d4c-8927-59475dbf305b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:01.112439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a0a089df-688e-4d4c-8927-59475dbf305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:01.115849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7b193df3-19fb-4094-949a-52449067a91e None None] MFA Rules not processed for user `c7bd613a599f4d59a288304730519f34`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:01.117209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7b193df3-19fb-4094-949a-52449067a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:01.140983 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:01.187113 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:01.287839 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2946/5852] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:01.329604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193df3-19fb-4094-949a-52449067a91e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:01.331200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7b193df3-19fb-4094-949a-52449067a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:01.354898 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2907/5853] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:01.358800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a089df-688e-4d4c-8927-59475dbf305b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:01.379937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a089df-688e-4d4c-8927-59475dbf305b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:01.390047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:01.390930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:01.393643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:01.394206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:01.395203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:01.395664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:01.400122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:01.427957 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2908/5854] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:01.428970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:01.433219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:01.507345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193df3-19fb-4094-949a-52449067a91e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:01.523889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:01.524954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:01.527066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:01.527536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] PATH_INFO: `/v3/projects/1407ab4e6abf412f963ed6541894e035` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:01.529275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1407ab4e6abf412f963ed6541894e035)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:01.534281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:01.572668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8b2c5-bbaf-4cdd-8e74-19e78313d73a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:01.580400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bba371-1f51-42e8-b376-56d0764f9bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:01.582197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bba371-1f51-42e8-b376-56d0764f9bba service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:01.582481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bba371-1f51-42e8-b376-56d0764f9bba service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:01.582757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bba371-1f51-42e8-b376-56d0764f9bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:01.638195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bba371-1f51-42e8-b376-56d0764f9bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:01.641882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bba371-1f51-42e8-b376-56d0764f9bba service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:01.686213 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2909/5855] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:01 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:01.687178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1407ab4e6abf412f963ed6541894e035', 'request_id': 'req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:01.691145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bba371-1f51-42e8-b376-56d0764f9bba service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:01.704016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1407ab4e6abf412f963ed6541894e035', 'request_id': 'req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:01.710984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1407ab4e6abf412f963ed6541894e035', 'request_id': 'req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:01.730349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] The token cache is being invalidate because project 1407ab4e6abf412f963ed6541894e035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:01.730902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:01.731905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8c29c5d2-07e4-4e15-bd37-9ce5cae2ae2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:01.734494 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2947/5856] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:01 2022] DELETE /identity/v3/projects/1407ab4e6abf412f963ed6541894e035 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:01.739530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6703b-0be7-4ddf-87af-b332941059b3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:01.742336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6703b-0be7-4ddf-87af-b332941059b3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:01.744433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6703b-0be7-4ddf-87af-b332941059b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:01.750915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bba371-1f51-42e8-b376-56d0764f9bba service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:01.808489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aee6703b-0be7-4ddf-87af-b332941059b3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:01.810071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aee6703b-0be7-4ddf-87af-b332941059b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:01.890155 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:01.958680 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2948/5857] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:01.958680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6703b-0be7-4ddf-87af-b332941059b3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:01.958680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aee6703b-0be7-4ddf-87af-b332941059b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:01.993118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955eb1d-07dc-42a6-8553-c32c62bb6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:01.994713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955eb1d-07dc-42a6-8553-c32c62bb6336 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:01.995265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955eb1d-07dc-42a6-8553-c32c62bb6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:01.995685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955eb1d-07dc-42a6-8553-c32c62bb6336 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:01.996340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955eb1d-07dc-42a6-8553-c32c62bb6336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:01.998426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955eb1d-07dc-42a6-8553-c32c62bb6336 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:02.050808 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2910/5858] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:01 2022] POST /identity/v3/projects => generated 377 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:02.052803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de1d65-f374-48e3-bc10-847aee280579 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.053570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de1d65-f374-48e3-bc10-847aee280579 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.054643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de1d65-f374-48e3-bc10-847aee280579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:02.069726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6703b-0be7-4ddf-87af-b332941059b3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:02.082154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-35de1d65-f374-48e3-bc10-847aee280579 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:02.083376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-35de1d65-f374-48e3-bc10-847aee280579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:02.137846 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:02.179379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:02.181513 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2911/5859] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:02.182585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de1d65-f374-48e3-bc10-847aee280579 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:02.183892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.184178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.184463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:02.184897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-35de1d65-f374-48e3-bc10-847aee280579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:02.186343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:02.385870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:02.387452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:02.393769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de1d65-f374-48e3-bc10-847aee280579 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:02.406190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d60f-d17a-4a7d-9988-2ecbad3fc92f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:02.406693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d60f-d17a-4a7d-9988-2ecbad3fc92f service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.406972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d60f-d17a-4a7d-9988-2ecbad3fc92f service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.407242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d60f-d17a-4a7d-9988-2ecbad3fc92f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:02.409260 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2949/5860] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:02.409396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b5b7d60f-d17a-4a7d-9988-2ecbad3fc92f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:02.409898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:02.416861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:02.458749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f644b-f1a9-40d6-9824-21afa374905b service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:02.459199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7d60f-d17a-4a7d-9988-2ecbad3fc92f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:02.461621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7d60f-d17a-4a7d-9988-2ecbad3fc92f service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:02.474685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f0a3f-fea9-478c-9d71-169c807e60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:02.475324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f0a3f-fea9-478c-9d71-169c807e60f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.477871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f0a3f-fea9-478c-9d71-169c807e60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.478248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f0a3f-fea9-478c-9d71-169c807e60f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:02.479332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f0a3f-fea9-478c-9d71-169c807e60f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:02.485980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f0a3f-fea9-478c-9d71-169c807e60f0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:02.495766 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2912/5861] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:02.497908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d60f-d17a-4a7d-9988-2ecbad3fc92f service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:02.523369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d60f-d17a-4a7d-9988-2ecbad3fc92f service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:02.537631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aef2e0-d614-4dbe-ad9a-3b517477a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:02.539476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aef2e0-d614-4dbe-ad9a-3b517477a4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.541878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aef2e0-d614-4dbe-ad9a-3b517477a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.542218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aef2e0-d614-4dbe-ad9a-3b517477a4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:02.544967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aef2e0-d614-4dbe-ad9a-3b517477a4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:02.546129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aef2e0-d614-4dbe-ad9a-3b517477a4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:02.550257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aef2e0-d614-4dbe-ad9a-3b517477a4e4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:02.558483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2950/5862] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:02 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:02.562217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f0a3f-fea9-478c-9d71-169c807e60f0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:02.591955 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2913/5863] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:02.594287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f0a3f-fea9-478c-9d71-169c807e60f0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:02.595368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aef2e0-d614-4dbe-ad9a-3b517477a4e4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:02.625879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2371-eab6-4f87-9a0a-3e3112f849b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:02.628103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2371-eab6-4f87-9a0a-3e3112f849b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.628394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2371-eab6-4f87-9a0a-3e3112f849b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.628697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2371-eab6-4f87-9a0a-3e3112f849b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:02.629489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd2371-eab6-4f87-9a0a-3e3112f849b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:02.633653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aef2e0-d614-4dbe-ad9a-3b517477a4e4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:02.639260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd2371-eab6-4f87-9a0a-3e3112f849b6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:02.652608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674280b6-675b-458e-b7e9-03f7ae225a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:02.653168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674280b6-675b-458e-b7e9-03f7ae225a08 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.653446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674280b6-675b-458e-b7e9-03f7ae225a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.653720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674280b6-675b-458e-b7e9-03f7ae225a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:02.654515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674280b6-675b-458e-b7e9-03f7ae225a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:02.659221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674280b6-675b-458e-b7e9-03f7ae225a08 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:02.681332 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2951/5864] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:02.684343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2371-eab6-4f87-9a0a-3e3112f849b6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:02.715200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2371-eab6-4f87-9a0a-3e3112f849b6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:02.729269 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2914/5865] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:02 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:02.729503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b635ecc-a3e3-4fc7-b7dd-1ad09aec2652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:02.730552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674280b6-675b-458e-b7e9-03f7ae225a08 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:02.732272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b635ecc-a3e3-4fc7-b7dd-1ad09aec2652 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.732660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b635ecc-a3e3-4fc7-b7dd-1ad09aec2652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.734345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b635ecc-a3e3-4fc7-b7dd-1ad09aec2652 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:02.735808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b635ecc-a3e3-4fc7-b7dd-1ad09aec2652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:02.739315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b635ecc-a3e3-4fc7-b7dd-1ad09aec2652 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:02.781899 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2952/5866] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:02.783671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b635ecc-a3e3-4fc7-b7dd-1ad09aec2652 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:02.819250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b635ecc-a3e3-4fc7-b7dd-1ad09aec2652 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:02.839672 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:02.927822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674280b6-675b-458e-b7e9-03f7ae225a08 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:02.951201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391da69b-5f69-4257-b30c-bdbd96bf5742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:02.951847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391da69b-5f69-4257-b30c-bdbd96bf5742 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.952132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391da69b-5f69-4257-b30c-bdbd96bf5742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.954492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391da69b-5f69-4257-b30c-bdbd96bf5742 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:02.956269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391da69b-5f69-4257-b30c-bdbd96bf5742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:02.960453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8380-6dbf-4a39-af72-80c319a4f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:02.961142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391da69b-5f69-4257-b30c-bdbd96bf5742 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:02.962875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8380-6dbf-4a39-af72-80c319a4f12c admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:02.963212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8380-6dbf-4a39-af72-80c319a4f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:02.963501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8380-6dbf-4a39-af72-80c319a4f12c admin admin] PATH_INFO: `/v3/projects/f60293036e5c4a04a30d92634799d191/users/1c848f5942ad4f378803247521eadb86/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:03.018953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8380-6dbf-4a39-af72-80c319a4f12c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60293036e5c4a04a30d92634799d191, user_id=1c848f5942ad4f378803247521eadb86, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:03.029384 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2915/5867] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:02 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:03.033080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8380-6dbf-4a39-af72-80c319a4f12c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:03.045751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391da69b-5f69-4257-b30c-bdbd96bf5742 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:03.092977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391da69b-5f69-4257-b30c-bdbd96bf5742 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:03.106365 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:03.112292 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2953/5868] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:02 2022] PUT /identity/v3/projects/f60293036e5c4a04a30d92634799d191/users/1c848f5942ad4f378803247521eadb86/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:03.152136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92e587-c2c9-483e-bf29-9cfde1f84582 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:03.152435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92e587-c2c9-483e-bf29-9cfde1f84582 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:03.152738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92e587-c2c9-483e-bf29-9cfde1f84582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:03.203181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660a077-4824-42a7-a383-ea62e0af131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:03.203915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a077-4824-42a7-a383-ea62e0af131c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:03.204359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a077-4824-42a7-a383-ea62e0af131c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:03.205017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a077-4824-42a7-a383-ea62e0af131c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:03.205886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660a077-4824-42a7-a383-ea62e0af131c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:03.207597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660a077-4824-42a7-a383-ea62e0af131c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:03.224189 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2916/5869] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:03.227100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660a077-4824-42a7-a383-ea62e0af131c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:03.271126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660a077-4824-42a7-a383-ea62e0af131c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:03.285952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a3599-5461-4859-bd5a-99b50a03d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:03.287890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a3599-5461-4859-bd5a-99b50a03d63d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:03.289478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a3599-5461-4859-bd5a-99b50a03d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:03.290492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a3599-5461-4859-bd5a-99b50a03d63d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:03.292880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a3599-5461-4859-bd5a-99b50a03d63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:03.300532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a3599-5461-4859-bd5a-99b50a03d63d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:03.315593 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2917/5870] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:03.323886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a3599-5461-4859-bd5a-99b50a03d63d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:03.332681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9d92e587-c2c9-483e-bf29-9cfde1f84582 None None] MFA Rules not processed for user `1c848f5942ad4f378803247521eadb86`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:03.338546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9d92e587-c2c9-483e-bf29-9cfde1f84582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:03.406135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a3599-5461-4859-bd5a-99b50a03d63d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:03.446763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b51698-b70d-4f97-871b-851afef47a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:03.449239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51698-b70d-4f97-871b-851afef47a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:03.449919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51698-b70d-4f97-871b-851afef47a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:03.450414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51698-b70d-4f97-871b-851afef47a4e admin admin] PATH_INFO: `/v3/projects/40a6a3396d4943acb570625f2b710f7a/users/eb6718a3bc8f456abf504d5bb82a3be6/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:03.512710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b51698-b70d-4f97-871b-851afef47a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a6a3396d4943acb570625f2b710f7a, user_id=eb6718a3bc8f456abf504d5bb82a3be6, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:03.521135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b51698-b70d-4f97-871b-851afef47a4e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:03.550415 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2918/5871] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:03 2022] PUT /identity/v3/projects/40a6a3396d4943acb570625f2b710f7a/users/eb6718a3bc8f456abf504d5bb82a3be6/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:03.550934 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2954/5872] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:03.552247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b51698-b70d-4f97-871b-851afef47a4e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:03.560236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d928d-54e8-41bf-93ae-afbcdf11406d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:03.561129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d928d-54e8-41bf-93ae-afbcdf11406d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:03.561838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d928d-54e8-41bf-93ae-afbcdf11406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:03.601800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ea4d928d-54e8-41bf-93ae-afbcdf11406d None None] MFA Rules not processed for user `eb6718a3bc8f456abf504d5bb82a3be6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:03.619888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea4d928d-54e8-41bf-93ae-afbcdf11406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:03.697190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b51698-b70d-4f97-871b-851afef47a4e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:03.713474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a44474-9d1e-4659-ae48-82836d98bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:03.714441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a44474-9d1e-4659-ae48-82836d98bce6 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:03.714879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a44474-9d1e-4659-ae48-82836d98bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:03.715282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a44474-9d1e-4659-ae48-82836d98bce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:03.716076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a44474-9d1e-4659-ae48-82836d98bce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:03.719287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a44474-9d1e-4659-ae48-82836d98bce6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:03.787026 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2919/5873] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:03 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:03.795172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a44474-9d1e-4659-ae48-82836d98bce6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:03.803020 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2955/5874] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:03.806955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d928d-54e8-41bf-93ae-afbcdf11406d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:03.841755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d928d-54e8-41bf-93ae-afbcdf11406d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:03.888884 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:03.943812 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:03.950358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a44474-9d1e-4659-ae48-82836d98bce6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:03.957573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f36d5-a74b-4c4b-88db-f087cf236b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:03.958402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f36d5-a74b-4c4b-88db-f087cf236b52 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:03.958790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f36d5-a74b-4c4b-88db-f087cf236b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:03.959693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f36d5-a74b-4c4b-88db-f087cf236b52 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:03.960405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f36d5-a74b-4c4b-88db-f087cf236b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:03.964003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f36d5-a74b-4c4b-88db-f087cf236b52 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.008809 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2920/5875] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:03 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:04.012543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f36d5-a74b-4c4b-88db-f087cf236b52 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:04.026819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f36d5-a74b-4c4b-88db-f087cf236b52 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:04.037206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f447-bdca-49f7-b2ba-ec6fc4a174e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:04.041215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f447-bdca-49f7-b2ba-ec6fc4a174e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.041785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f447-bdca-49f7-b2ba-ec6fc4a174e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.042312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f447-bdca-49f7-b2ba-ec6fc4a174e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.043248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f447-bdca-49f7-b2ba-ec6fc4a174e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:04.045190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f447-bdca-49f7-b2ba-ec6fc4a174e3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.069271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f52895-096e-4354-8058-85e6f5ca26a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:04.069999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f52895-096e-4354-8058-85e6f5ca26a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.074444 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2921/5876] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:04.074915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f52895-096e-4354-8058-85e6f5ca26a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.075302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f52895-096e-4354-8058-85e6f5ca26a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.076170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f52895-096e-4354-8058-85e6f5ca26a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:04.077706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f447-bdca-49f7-b2ba-ec6fc4a174e3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:04.079792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f52895-096e-4354-8058-85e6f5ca26a4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.104660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f447-bdca-49f7-b2ba-ec6fc4a174e3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:04.138013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e328f9-c0ed-4e3f-84c7-0761a5e38770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:04.139810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e328f9-c0ed-4e3f-84c7-0761a5e38770 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.140098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e328f9-c0ed-4e3f-84c7-0761a5e38770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.140444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e328f9-c0ed-4e3f-84c7-0761a5e38770 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.142968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e328f9-c0ed-4e3f-84c7-0761a5e38770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:04.146352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e328f9-c0ed-4e3f-84c7-0761a5e38770 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.179867 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2956/5877] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:03 2022] POST /identity/v3/projects => generated 373 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:04.185441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f52895-096e-4354-8058-85e6f5ca26a4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:04.195214 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2922/5878] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:04.199421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e328f9-c0ed-4e3f-84c7-0761a5e38770 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:04.225477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e328f9-c0ed-4e3f-84c7-0761a5e38770 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:04.361845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f52895-096e-4354-8058-85e6f5ca26a4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:04.363706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8c76d-de7c-47cb-8c79-2453207fa588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:04.364392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c76d-de7c-47cb-8c79-2453207fa588 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.364687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c76d-de7c-47cb-8c79-2453207fa588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.364963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8c76d-de7c-47cb-8c79-2453207fa588 admin admin] PATH_INFO: `/v3/projects/a3c707e069d3491eb2dbf1c4bab0d179/users/2a67bdccf9d44659b3cdfc506f702dad/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.370395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65b691-5bf1-4263-a7f4-de6d8e3a8ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:04.371528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65b691-5bf1-4263-a7f4-de6d8e3a8ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.371970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65b691-5bf1-4263-a7f4-de6d8e3a8ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.372989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65b691-5bf1-4263-a7f4-de6d8e3a8ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.373746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65b691-5bf1-4263-a7f4-de6d8e3a8ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:04.377408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65b691-5bf1-4263-a7f4-de6d8e3a8ee9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.399123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8c76d-de7c-47cb-8c79-2453207fa588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c707e069d3491eb2dbf1c4bab0d179, user_id=2a67bdccf9d44659b3cdfc506f702dad, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:04.407296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8c76d-de7c-47cb-8c79-2453207fa588 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.425574 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2957/5879] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:04 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:04.427788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65b691-5bf1-4263-a7f4-de6d8e3a8ee9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:04.433620 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2923/5880] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:04 2022] PUT /identity/v3/projects/a3c707e069d3491eb2dbf1c4bab0d179/users/2a67bdccf9d44659b3cdfc506f702dad/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:04.437578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8c76d-de7c-47cb-8c79-2453207fa588 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:04.565043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8c76d-de7c-47cb-8c79-2453207fa588 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:04.578623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c51d-40db-4962-8680-e68c7ab3cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:04.579966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c51d-40db-4962-8680-e68c7ab3cfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.580519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c51d-40db-4962-8680-e68c7ab3cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.580703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c51d-40db-4962-8680-e68c7ab3cfe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.581293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9c51d-40db-4962-8680-e68c7ab3cfe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:04.583076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9c51d-40db-4962-8680-e68c7ab3cfe9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.609427 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2924/5881] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:04.609427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205357f-1aca-4b91-a92d-53411e95724a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.609427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205357f-1aca-4b91-a92d-53411e95724a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.612659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205357f-1aca-4b91-a92d-53411e95724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.636276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65b691-5bf1-4263-a7f4-de6d8e3a8ee9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:04.674437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5205357f-1aca-4b91-a92d-53411e95724a None None] MFA Rules not processed for user `2a67bdccf9d44659b3cdfc506f702dad`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:04.675673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5205357f-1aca-4b91-a92d-53411e95724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:04.717671 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:04.754977 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:04.798387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19996518-2f67-4f8d-a391-9aad6d3b6e99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:04.799505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996518-2f67-4f8d-a391-9aad6d3b6e99 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.799899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996518-2f67-4f8d-a391-9aad6d3b6e99 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.800432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996518-2f67-4f8d-a391-9aad6d3b6e99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.804733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-19996518-2f67-4f8d-a391-9aad6d3b6e99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:04.827187 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2925/5882] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:04.827970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205357f-1aca-4b91-a92d-53411e95724a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:04.828110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19996518-2f67-4f8d-a391-9aad6d3b6e99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:04.829835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19996518-2f67-4f8d-a391-9aad6d3b6e99 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.866252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205357f-1aca-4b91-a92d-53411e95724a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:04.882594 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2958/5883] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:04.883836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19996518-2f67-4f8d-a391-9aad6d3b6e99 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:04.889741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d49db-ded6-419b-9330-8cdb2dbba580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:04.890382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d49db-ded6-419b-9330-8cdb2dbba580 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.890666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d49db-ded6-419b-9330-8cdb2dbba580 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.890943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d49db-ded6-419b-9330-8cdb2dbba580 admin admin] PATH_INFO: `/v3/projects/806f29d12e5b4b03a2f460d1a58450b0/users/ba1a31e33a0148f99cfc04f759ebb5c8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.904999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19996518-2f67-4f8d-a391-9aad6d3b6e99 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:04.914028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1006-a332-4969-b35b-db96dcce6f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:04.915644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1006-a332-4969-b35b-db96dcce6f5d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:04.916169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1006-a332-4969-b35b-db96dcce6f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:04.916757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1006-a332-4969-b35b-db96dcce6f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:04.917877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c1006-a332-4969-b35b-db96dcce6f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:04.921734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c1006-a332-4969-b35b-db96dcce6f5d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.950354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d49db-ded6-419b-9330-8cdb2dbba580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806f29d12e5b4b03a2f460d1a58450b0, user_id=ba1a31e33a0148f99cfc04f759ebb5c8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:04.953342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d49db-ded6-419b-9330-8cdb2dbba580 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:04.984280 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2926/5884] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:04 2022] PUT /identity/v3/projects/806f29d12e5b4b03a2f460d1a58450b0/users/ba1a31e33a0148f99cfc04f759ebb5c8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:04.985154 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2959/5885] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:04 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:04.985815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d49db-ded6-419b-9330-8cdb2dbba580 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:04.989183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1006-a332-4969-b35b-db96dcce6f5d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:05.202622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1006-a332-4969-b35b-db96dcce6f5d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:05.245397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85dbec-50a6-42e4-b4a8-b8397fcb4a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:05.249238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85dbec-50a6-42e4-b4a8-b8397fcb4a43 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.249238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85dbec-50a6-42e4-b4a8-b8397fcb4a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.249238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85dbec-50a6-42e4-b4a8-b8397fcb4a43 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.250185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85dbec-50a6-42e4-b4a8-b8397fcb4a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:05.256498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85dbec-50a6-42e4-b4a8-b8397fcb4a43 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:05.265069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d49db-ded6-419b-9330-8cdb2dbba580 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:05.285326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c97e5-00fb-4cc7-b194-b0620f231926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:05.285966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c97e5-00fb-4cc7-b194-b0620f231926 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.286250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c97e5-00fb-4cc7-b194-b0620f231926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.286525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c97e5-00fb-4cc7-b194-b0620f231926 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.287184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c97e5-00fb-4cc7-b194-b0620f231926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:05.292825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c97e5-00fb-4cc7-b194-b0620f231926 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:05.312584 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2960/5886] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:04 2022] POST /identity/v3/users => generated 294 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:05.320552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85dbec-50a6-42e4-b4a8-b8397fcb4a43 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:05.324239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2927/5887] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:12:05.328794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c97e5-00fb-4cc7-b194-b0620f231926 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:05.338874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85dbec-50a6-42e4-b4a8-b8397fcb4a43 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:05.345119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f07d7f-460e-4e51-a997-93083cd1f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:05.345883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f07d7f-460e-4e51-a997-93083cd1f1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.346275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f07d7f-460e-4e51-a997-93083cd1f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.347313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f07d7f-460e-4e51-a997-93083cd1f1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.348357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f07d7f-460e-4e51-a997-93083cd1f1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:05.350979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f07d7f-460e-4e51-a997-93083cd1f1c0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:05.351150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c97e5-00fb-4cc7-b194-b0620f231926 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:05.366197 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2961/5888] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:05.371875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f07d7f-460e-4e51-a997-93083cd1f1c0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:05.379163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c539-d836-4f91-af1e-43ff78ec9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:05.379780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c539-d836-4f91-af1e-43ff78ec9f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.380063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c539-d836-4f91-af1e-43ff78ec9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.380341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c539-d836-4f91-af1e-43ff78ec9f9a admin admin] PATH_INFO: `/v3/projects/806f29d12e5b4b03a2f460d1a58450b0/users/ba1a31e33a0148f99cfc04f759ebb5c8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.384214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6c539-d836-4f91-af1e-43ff78ec9f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=806f29d12e5b4b03a2f460d1a58450b0, user_id=ba1a31e33a0148f99cfc04f759ebb5c8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:05.410195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f07d7f-460e-4e51-a997-93083cd1f1c0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:05.412072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6c539-d836-4f91-af1e-43ff78ec9f9a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:05.422219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd130d1-489b-4388-a0e9-d74ea96600c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:05.423164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd130d1-489b-4388-a0e9-d74ea96600c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.423441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd130d1-489b-4388-a0e9-d74ea96600c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.423713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd130d1-489b-4388-a0e9-d74ea96600c1 admin admin] PATH_INFO: `/v3/projects/3524ebe051e44e2d9b8abbdde60295a9/users/ecae519fa11f43fd9c82e0b1d09315eb/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.441107 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2928/5889] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:05 2022] PUT /identity/v3/projects/806f29d12e5b4b03a2f460d1a58450b0/users/ba1a31e33a0148f99cfc04f759ebb5c8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:05.495231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd130d1-489b-4388-a0e9-d74ea96600c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3524ebe051e44e2d9b8abbdde60295a9, user_id=ecae519fa11f43fd9c82e0b1d09315eb, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:05.502818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd130d1-489b-4388-a0e9-d74ea96600c1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:05.553189 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2962/5890] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:05 2022] PUT /identity/v3/projects/3524ebe051e44e2d9b8abbdde60295a9/users/ecae519fa11f43fd9c82e0b1d09315eb/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:05.555291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c539-d836-4f91-af1e-43ff78ec9f9a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:05.567196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4de86-f62f-47ca-8ee1-9fcaf5c43872 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.568028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4de86-f62f-47ca-8ee1-9fcaf5c43872 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.568488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4de86-f62f-47ca-8ee1-9fcaf5c43872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.644176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dcf4de86-f62f-47ca-8ee1-9fcaf5c43872 None None] MFA Rules not processed for user `ba1a31e33a0148f99cfc04f759ebb5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:05.647461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dcf4de86-f62f-47ca-8ee1-9fcaf5c43872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:05.724818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c539-d836-4f91-af1e-43ff78ec9f9a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:05.769639 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:05.783901 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:05.797534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31922a34-ab86-4aad-ba99-530260e13302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:05.798537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31922a34-ab86-4aad-ba99-530260e13302 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.799284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31922a34-ab86-4aad-ba99-530260e13302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.799800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31922a34-ab86-4aad-ba99-530260e13302 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.801193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31922a34-ab86-4aad-ba99-530260e13302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:05.803059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31922a34-ab86-4aad-ba99-530260e13302 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:05.815742 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2929/5891] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:12:05.821553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31922a34-ab86-4aad-ba99-530260e13302 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:05.842575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31922a34-ab86-4aad-ba99-530260e13302 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:05.844631 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2963/5892] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:12:05.849730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4de86-f62f-47ca-8ee1-9fcaf5c43872 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:05.861548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55d025-f415-427e-a67d-7816bd00af15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:05.862641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55d025-f415-427e-a67d-7816bd00af15 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.863161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55d025-f415-427e-a67d-7816bd00af15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.863667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55d025-f415-427e-a67d-7816bd00af15 admin admin] PATH_INFO: `/v3/projects/3524ebe051e44e2d9b8abbdde60295a9/users/ecae519fa11f43fd9c82e0b1d09315eb/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.868519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55d025-f415-427e-a67d-7816bd00af15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3524ebe051e44e2d9b8abbdde60295a9, user_id=ecae519fa11f43fd9c82e0b1d09315eb, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:05.874096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55d025-f415-427e-a67d-7816bd00af15 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:05.876940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4de86-f62f-47ca-8ee1-9fcaf5c43872 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:05.887922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8b1b7-31db-4b8c-8e34-54e5a282a9d2 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:05.890560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b1b7-31db-4b8c-8e34-54e5a282a9d2 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.891361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b1b7-31db-4b8c-8e34-54e5a282a9d2 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.893067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b1b7-31db-4b8c-8e34-54e5a282a9d2 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.893974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b1b7-31db-4b8c-8e34-54e5a282a9d2 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:05.896127 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-50b8b1b7-31db-4b8c-8e34-54e5a282a9d2 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:05.896127 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:05.896127 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:05.900243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b1b7-31db-4b8c-8e34-54e5a282a9d2 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:05.907357 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2930/5893] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:05 2022] PUT /identity/v3/projects/3524ebe051e44e2d9b8abbdde60295a9/users/ecae519fa11f43fd9c82e0b1d09315eb/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:05.921853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba875-6208-43c9-bead-be497c15bc0c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:05.922183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba875-6208-43c9-bead-be497c15bc0c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:05.922416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba875-6208-43c9-bead-be497c15bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:05.945403 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2964/5894] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:05 2022] POST /identity/v3/services => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:05.949901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8b1b7-31db-4b8c-8e34-54e5a282a9d2 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:05.978366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8b1b7-31db-4b8c-8e34-54e5a282a9d2 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:06.004019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-147ba875-6208-43c9-bead-be497c15bc0c None None] MFA Rules not processed for user `ecae519fa11f43fd9c82e0b1d09315eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:06.008826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-147ba875-6208-43c9-bead-be497c15bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:06.172226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ff52c-884e-40f5-bf1f-b2c0ff33dbd6 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:06.175288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ff52c-884e-40f5-bf1f-b2c0ff33dbd6 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:06.175896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ff52c-884e-40f5-bf1f-b2c0ff33dbd6 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:06.177456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ff52c-884e-40f5-bf1f-b2c0ff33dbd6 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:06.178249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ff52c-884e-40f5-bf1f-b2c0ff33dbd6 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:06.180713 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-fa7ff52c-884e-40f5-bf1f-b2c0ff33dbd6 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:06.180713 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:06.180713 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:06.183206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ff52c-884e-40f5-bf1f-b2c0ff33dbd6 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:06.208111 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2965/5895] 10.222.0.27 () {60 vars in 1213 bytes} [Wed Oct 19 01:12:05 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:06.213636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ff52c-884e-40f5-bf1f-b2c0ff33dbd6 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:06.231532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ff52c-884e-40f5-bf1f-b2c0ff33dbd6 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:06.238285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4118b-9516-4777-8ead-8bfb2b25a0ae tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:06.238986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4118b-9516-4777-8ead-8bfb2b25a0ae tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:06.239341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4118b-9516-4777-8ead-8bfb2b25a0ae tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:06.239717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4118b-9516-4777-8ead-8bfb2b25a0ae tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:06.240459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4118b-9516-4777-8ead-8bfb2b25a0ae tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:06.242374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4118b-9516-4777-8ead-8bfb2b25a0ae tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:06.255247 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2931/5896] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3452 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:06.269579 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2966/5897] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:06 2022] POST /identity/v3/services => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:06.270628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba875-6208-43c9-bead-be497c15bc0c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:06.270894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4118b-9516-4777-8ead-8bfb2b25a0ae tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:06.272946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-147ba875-6208-43c9-bead-be497c15bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:06.310531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4118b-9516-4777-8ead-8bfb2b25a0ae tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:06.316711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec46f2-fd87-4df4-a370-e4933aac2175 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:06.317546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec46f2-fd87-4df4-a370-e4933aac2175 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:06.318066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec46f2-fd87-4df4-a370-e4933aac2175 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:06.318935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec46f2-fd87-4df4-a370-e4933aac2175 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:06.319630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec46f2-fd87-4df4-a370-e4933aac2175 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:06.321314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec46f2-fd87-4df4-a370-e4933aac2175 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:06.339352 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2967/5898] 10.222.0.27 () {60 vars in 1213 bytes} [Wed Oct 19 01:12:06 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:06.340321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec46f2-fd87-4df4-a370-e4933aac2175 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:06.342701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a9ec46f2-fd87-4df4-a370-e4933aac2175 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:06.579558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec46f2-fd87-4df4-a370-e4933aac2175 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:06.600989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:06.601926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:06.603065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:06.603840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] PATH_INFO: `/v3/users/39d455530cf945d590c1b00cc45e238b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:06.605860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d455530cf945d590c1b00cc45e238b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:06.606586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba875-6208-43c9-bead-be497c15bc0c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:06.609185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:06.663571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e65ffb-d322-4c28-b53f-ead4b087f6e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:06.664225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65ffb-d322-4c28-b53f-ead4b087f6e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:06.664509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65ffb-d322-4c28-b53f-ead4b087f6e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:06.666053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65ffb-d322-4c28-b53f-ead4b087f6e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:06.672878 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:06.761398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d455530cf945d590c1b00cc45e238b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:06.787646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d455530cf945d590c1b00cc45e238b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:06.801534 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:06.809614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d455530cf945d590c1b00cc45e238b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:06.825235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d455530cf945d590c1b00cc45e238b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:06.826260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d455530cf945d590c1b00cc45e238b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:06.847871 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2968/5899] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:06 2022] DELETE /identity/v3/users/39d455530cf945d590c1b00cc45e238b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:06.848988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:06.850442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:06.857037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e65ffb-d322-4c28-b53f-ead4b087f6e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:06.858440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e65ffb-d322-4c28-b53f-ead4b087f6e7 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:06.975340 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2932/5900] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:06 2022] GET /identity/v3/auth/tokens => generated 3520 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:06.979634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c365-361f-44e2-8fa7-9d15b47df0bd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:06.989538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c365-361f-44e2-8fa7-9d15b47df0bd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:06.990152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c365-361f-44e2-8fa7-9d15b47df0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:06.999128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf414fc-a853-48b3-9ca6-26996bc68fe3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.012825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1cc86-2468-41f5-b0bc-b4cc00af7379 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.014365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1cc86-2468-41f5-b0bc-b4cc00af7379 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.016068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1cc86-2468-41f5-b0bc-b4cc00af7379 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.016472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1cc86-2468-41f5-b0bc-b4cc00af7379 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.017488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1cc86-2468-41f5-b0bc-b4cc00af7379 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.022068 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-d1d1cc86-2468-41f5-b0bc-b4cc00af7379 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:07.022068 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:07.022068 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:07.023533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1cc86-2468-41f5-b0bc-b4cc00af7379 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.047354 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2969/5901] 10.222.0.27 () {58 vars in 1191 bytes} [Wed Oct 19 01:12:06 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:07.050693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1cc86-2468-41f5-b0bc-b4cc00af7379 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.077749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1cc86-2468-41f5-b0bc-b4cc00af7379 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.084704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c454f84-cc8d-4e5a-a90e-dddca077f298 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.085718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c454f84-cc8d-4e5a-a90e-dddca077f298 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.089512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c454f84-cc8d-4e5a-a90e-dddca077f298 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.091793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c454f84-cc8d-4e5a-a90e-dddca077f298 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/464a5132f91146b6be5cbd36c62da5fa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.096867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-39b9c365-361f-44e2-8fa7-9d15b47df0bd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:07.097424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c454f84-cc8d-4e5a-a90e-dddca077f298 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=464a5132f91146b6be5cbd36c62da5fa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.101307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-39b9c365-361f-44e2-8fa7-9d15b47df0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:07.103707 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-3c454f84-cc8d-4e5a-a90e-dddca077f298 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:07.103707 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:07.103707 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:07.104958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c454f84-cc8d-4e5a-a90e-dddca077f298 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.138164 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2970/5902] 10.222.0.27 () {58 vars in 1290 bytes} [Wed Oct 19 01:12:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/464a5132f91146b6be5cbd36c62da5fa => generated 332 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:07.140297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c454f84-cc8d-4e5a-a90e-dddca077f298 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.198100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c454f84-cc8d-4e5a-a90e-dddca077f298 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.214495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1fc43-fbb8-4733-875b-5ba2155e79e5 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.215804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1fc43-fbb8-4733-875b-5ba2155e79e5 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.218047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1fc43-fbb8-4733-875b-5ba2155e79e5 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.219098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1fc43-fbb8-4733-875b-5ba2155e79e5 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/464a5132f91146b6be5cbd36c62da5fa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.220857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1fc43-fbb8-4733-875b-5ba2155e79e5 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=464a5132f91146b6be5cbd36c62da5fa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.225329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1fc43-fbb8-4733-875b-5ba2155e79e5 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.247735 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2971/5903] 10.222.0.27 () {58 vars in 1291 bytes} [Wed Oct 19 01:12:07 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/464a5132f91146b6be5cbd36c62da5fa => generated 0 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 19 01:12:07.248865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1fc43-fbb8-4733-875b-5ba2155e79e5 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.259906 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2933/5904] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:06 2022] POST /identity/v3/auth/tokens => generated 3505 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:07.277925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c365-361f-44e2-8fa7-9d15b47df0bd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.281123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1fc43-fbb8-4733-875b-5ba2155e79e5 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.292962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-39b9c365-361f-44e2-8fa7-9d15b47df0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:07.313940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b08ca2-85b3-4acf-8966-0f80d21660b7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.317038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b08ca2-85b3-4acf-8966-0f80d21660b7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.320468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b08ca2-85b3-4acf-8966-0f80d21660b7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.322729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b08ca2-85b3-4acf-8966-0f80d21660b7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/464a5132f91146b6be5cbd36c62da5fa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.323559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b08ca2-85b3-4acf-8966-0f80d21660b7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=464a5132f91146b6be5cbd36c62da5fa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.329062 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-83b08ca2-85b3-4acf-8966-0f80d21660b7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:07.329062 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:07.329062 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:07.334130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b08ca2-85b3-4acf-8966-0f80d21660b7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.362717 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2972/5905] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 01:12:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/464a5132f91146b6be5cbd36c62da5fa => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:07.366558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b08ca2-85b3-4acf-8966-0f80d21660b7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.391024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b08ca2-85b3-4acf-8966-0f80d21660b7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.413075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fcc6b-1e6a-4f59-ab8a-222812e98c05 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.413742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fcc6b-1e6a-4f59-ab8a-222812e98c05 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.414028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fcc6b-1e6a-4f59-ab8a-222812e98c05 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.419367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fcc6b-1e6a-4f59-ab8a-222812e98c05 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.420089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fcc6b-1e6a-4f59-ab8a-222812e98c05 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.425467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fcc6b-1e6a-4f59-ab8a-222812e98c05 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.439041 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2973/5906] 10.222.0.27 () {58 vars in 1191 bytes} [Wed Oct 19 01:12:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:07.442568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fcc6b-1e6a-4f59-ab8a-222812e98c05 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.467609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fcc6b-1e6a-4f59-ab8a-222812e98c05 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.483220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355bf27-6afc-45cc-a8d8-8866d6d9cd81 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.483887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355bf27-6afc-45cc-a8d8-8866d6d9cd81 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.484165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355bf27-6afc-45cc-a8d8-8866d6d9cd81 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.484443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355bf27-6afc-45cc-a8d8-8866d6d9cd81 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/464a5132f91146b6be5cbd36c62da5fa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.487883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355bf27-6afc-45cc-a8d8-8866d6d9cd81 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=464a5132f91146b6be5cbd36c62da5fa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.492212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355bf27-6afc-45cc-a8d8-8866d6d9cd81 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.500793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c365-361f-44e2-8fa7-9d15b47df0bd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.514194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafee2f-988b-4de0-a618-72a142d6ae7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.516048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafee2f-988b-4de0-a618-72a142d6ae7b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.516898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafee2f-988b-4de0-a618-72a142d6ae7b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.518981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafee2f-988b-4de0-a618-72a142d6ae7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-d355bf27-6afc-45cc-a8d8-8866d6d9cd81 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Could not find Endpoint Group: 464a5132f91146b6be5cbd36c62da5fa.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 464a5132f91146b6be5cbd36c62da5fa. Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 19 01:12:07.528235 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 19 01:12:07.529380 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 19 01:12:07.529380 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 19 01:12:07.529380 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 19 01:12:07.529380 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 19 01:12:07.529380 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 464a5132f91146b6be5cbd36c62da5fa. Oct 19 01:12:07.529380 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:12:07.532013 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2974/5907] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 01:12:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/464a5132f91146b6be5cbd36c62da5fa => generated 120 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:12:07.536023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355bf27-6afc-45cc-a8d8-8866d6d9cd81 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.549185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafee2f-988b-4de0-a618-72a142d6ae7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.591717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafee2f-988b-4de0-a618-72a142d6ae7b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.611179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355bf27-6afc-45cc-a8d8-8866d6d9cd81 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.637362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e25c7-38b9-4650-995f-f592066759d7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.641316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e25c7-38b9-4650-995f-f592066759d7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.643161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e25c7-38b9-4650-995f-f592066759d7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.644442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e25c7-38b9-4650-995f-f592066759d7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/services/56f2621c1f7641fba6e7903ed16b616f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.647844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e25c7-38b9-4650-995f-f592066759d7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:delete_service(service_id=56f2621c1f7641fba6e7903ed16b616f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.652725 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2934/5908] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:07 2022] GET /identity/v3/auth/tokens => generated 3505 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:07.683407 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-105e25c7-38b9-4650-995f-f592066759d7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:07.683407 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:07.683407 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:07.691287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e25c7-38b9-4650-995f-f592066759d7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.781449 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2975/5909] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:07 2022] DELETE /identity/v3/services/56f2621c1f7641fba6e7903ed16b616f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:07.785968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafee2f-988b-4de0-a618-72a142d6ae7b service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.804881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafee2f-988b-4de0-a618-72a142d6ae7b service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.838028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5f0f8-c5d2-4985-a750-3ad18e59838c tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.838728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5f0f8-c5d2-4985-a750-3ad18e59838c tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.839073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5f0f8-c5d2-4985-a750-3ad18e59838c tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.839354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5f0f8-c5d2-4985-a750-3ad18e59838c tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.841187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5f0f8-c5d2-4985-a750-3ad18e59838c tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.842256 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-23f5f0f8-c5d2-4985-a750-3ad18e59838c tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:07.842256 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:12:07.842256 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:12:07.845343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5f0f8-c5d2-4985-a750-3ad18e59838c tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.875455 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2935/5910] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:07 2022] POST /identity/v3/services => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:07.879350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e25c7-38b9-4650-995f-f592066759d7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.892970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e25c7-38b9-4650-995f-f592066759d7 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:07.936880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117790f7-7e53-46ce-ada4-4d42e3d9231f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:07.937530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117790f7-7e53-46ce-ada4-4d42e3d9231f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:07.937818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117790f7-7e53-46ce-ada4-4d42e3d9231f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:07.938100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117790f7-7e53-46ce-ada4-4d42e3d9231f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:07.938785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117790f7-7e53-46ce-ada4-4d42e3d9231f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:07.944541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117790f7-7e53-46ce-ada4-4d42e3d9231f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:07.963197 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2976/5911] 10.222.0.27 () {60 vars in 1213 bytes} [Wed Oct 19 01:12:07 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:07.967033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5f0f8-c5d2-4985-a750-3ad18e59838c tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:07.992282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5f0f8-c5d2-4985-a750-3ad18e59838c tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:08.012217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f71a5-3681-4bee-949c-b10d40dc306b tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:08.012964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f71a5-3681-4bee-949c-b10d40dc306b tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:08.013257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f71a5-3681-4bee-949c-b10d40dc306b tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:08.013542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f71a5-3681-4bee-949c-b10d40dc306b tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:08.014209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f71a5-3681-4bee-949c-b10d40dc306b tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:08.016583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f71a5-3681-4bee-949c-b10d40dc306b tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:08.059482 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2936/5912] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:07 2022] POST /identity/v3/services => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:08.063148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117790f7-7e53-46ce-ada4-4d42e3d9231f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:08.072238 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:08.099770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117790f7-7e53-46ce-ada4-4d42e3d9231f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:08.162022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d55f-2a44-41e6-8524-6e33d511e61f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:08.162853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d55f-2a44-41e6-8524-6e33d511e61f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:08.163139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d55f-2a44-41e6-8524-6e33d511e61f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:08.163410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d55f-2a44-41e6-8524-6e33d511e61f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a086a882ff5341f29f9207cd81bd6758` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:08.164163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6d55f-2a44-41e6-8524-6e33d511e61f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=a086a882ff5341f29f9207cd81bd6758)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:08.169355 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-54f6d55f-2a44-41e6-8524-6e33d511e61f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:08.169355 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:08.169355 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:08.170221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f71a5-3681-4bee-949c-b10d40dc306b tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:08.170344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6d55f-2a44-41e6-8524-6e33d511e61f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:08.172497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4c5f71a5-3681-4bee-949c-b10d40dc306b tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:08.199108 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2977/5913] 10.222.0.27 () {60 vars in 1313 bytes} [Wed Oct 19 01:12:08 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/a086a882ff5341f29f9207cd81bd6758 => generated 336 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:08.201279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d55f-2a44-41e6-8524-6e33d511e61f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:08.222699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d55f-2a44-41e6-8524-6e33d511e61f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:08.229195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7210c3e-4f76-40c6-9586-65d41f7cda43 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:08.229835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7210c3e-4f76-40c6-9586-65d41f7cda43 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:08.230115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7210c3e-4f76-40c6-9586-65d41f7cda43 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:08.230391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7210c3e-4f76-40c6-9586-65d41f7cda43 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/services/82a169fafc9d424d8c797796eee11759` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:08.231237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7210c3e-4f76-40c6-9586-65d41f7cda43 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:delete_service(service_id=82a169fafc9d424d8c797796eee11759)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:08.233014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7210c3e-4f76-40c6-9586-65d41f7cda43 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:08.250551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f71a5-3681-4bee-949c-b10d40dc306b tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:08.258498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:08.259211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:08.259595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:08.259929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] PATH_INFO: `/v3/projects/3cc23cf780cf445aac0a4f7bef125640` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:08.268003 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2978/5914] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:08 2022] DELETE /identity/v3/services/82a169fafc9d424d8c797796eee11759 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:08.269371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7210c3e-4f76-40c6-9586-65d41f7cda43 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:08.271721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc23cf780cf445aac0a4f7bef125640)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:08.274055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:08.317195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7210c3e-4f76-40c6-9586-65d41f7cda43 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:08.324685 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:08.330969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa0e25-fdcd-4ccb-933e-a912e0621897 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:08.331918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa0e25-fdcd-4ccb-933e-a912e0621897 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:08.332269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa0e25-fdcd-4ccb-933e-a912e0621897 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:08.332552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa0e25-fdcd-4ccb-933e-a912e0621897 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a086a882ff5341f29f9207cd81bd6758` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:08.333777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa0e25-fdcd-4ccb-933e-a912e0621897 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a086a882ff5341f29f9207cd81bd6758)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:08.335921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa0e25-fdcd-4ccb-933e-a912e0621897 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:08.364606 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2979/5915] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 01:12:08 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a086a882ff5341f29f9207cd81bd6758 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:08.369057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa0e25-fdcd-4ccb-933e-a912e0621897 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:08.380226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc23cf780cf445aac0a4f7bef125640', 'request_id': 'req-a07a507c-ac1a-4694-8f78-1f24e33d0b61'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:08.389336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa0e25-fdcd-4ccb-933e-a912e0621897 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:08.398067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc23cf780cf445aac0a4f7bef125640', 'request_id': 'req-a07a507c-ac1a-4694-8f78-1f24e33d0b61'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:08.408439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc23cf780cf445aac0a4f7bef125640', 'request_id': 'req-a07a507c-ac1a-4694-8f78-1f24e33d0b61'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:08.439223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] The token cache is being invalidate because project 3cc23cf780cf445aac0a4f7bef125640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:08.439529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:08.440841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:08.443819 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2937/5916] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:08 2022] DELETE /identity/v3/projects/3cc23cf780cf445aac0a4f7bef125640 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:08.450286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:08.456210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:08.604226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58f097-f2a8-4336-bf97-5755c0587c2f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:08.604920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58f097-f2a8-4336-bf97-5755c0587c2f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:08.605204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58f097-f2a8-4336-bf97-5755c0587c2f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:08.605484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58f097-f2a8-4336-bf97-5755c0587c2f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/services/e3319381f38149d8a13d2a396a21fa29` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:08.606078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58f097-f2a8-4336-bf97-5755c0587c2f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e3319381f38149d8a13d2a396a21fa29)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:08.609818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58f097-f2a8-4336-bf97-5755c0587c2f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:08.647591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a507c-ac1a-4694-8f78-1f24e33d0b61 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:08.709231 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2980/5917] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:08 2022] DELETE /identity/v3/services/e3319381f38149d8a13d2a396a21fa29 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:08.714034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58f097-f2a8-4336-bf97-5755c0587c2f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:08.718119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4d58f097-f2a8-4336-bf97-5755c0587c2f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:08.748849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:08.750245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:08.750689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:08.751392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] PATH_INFO: `/v3/users/7589d506eebb42cca2fd636d95f16739` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:08.763982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7589d506eebb42cca2fd636d95f16739)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:08.767075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:08.822546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58f097-f2a8-4336-bf97-5755c0587c2f tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:08.840937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b072aed-175d-437b-b85a-a71ad03fe5f3 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:08.841591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b072aed-175d-437b-b85a-a71ad03fe5f3 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:08.841872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b072aed-175d-437b-b85a-a71ad03fe5f3 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:08.842144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b072aed-175d-437b-b85a-a71ad03fe5f3 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e83efad010054f4280ad1c05294d09fa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:08.842738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b072aed-175d-437b-b85a-a71ad03fe5f3 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e83efad010054f4280ad1c05294d09fa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:08.844387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b072aed-175d-437b-b85a-a71ad03fe5f3 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:08.866530 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2981/5918] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 01:12:08 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e83efad010054f4280ad1c05294d09fa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:08.868491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b072aed-175d-437b-b85a-a71ad03fe5f3 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:08.883046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b072aed-175d-437b-b85a-a71ad03fe5f3 tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:08.893847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f395-4974-424f-913e-713f5f0ad65d tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1a31e33a0148f99cfc04f759ebb5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '806f29d12e5b4b03a2f460d1a58450b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:08.894534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f395-4974-424f-913e-713f5f0ad65d tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:08.896854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f395-4974-424f-913e-713f5f0ad65d tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:08.897181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f395-4974-424f-913e-713f5f0ad65d tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] PATH_INFO: `/v3/services/f582ebebb60e4ef980ce8cd9ca57a624` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:08.898180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9f395-4974-424f-913e-713f5f0ad65d tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f582ebebb60e4ef980ce8cd9ca57a624)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:08.903282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9f395-4974-424f-913e-713f5f0ad65d tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:08.955545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7589d506eebb42cca2fd636d95f16739'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:08.970264 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2982/5919] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:08 2022] DELETE /identity/v3/services/f582ebebb60e4ef980ce8cd9ca57a624 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:08.974424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f395-4974-424f-913e-713f5f0ad65d tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:08.985404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c5d9f395-4974-424f-913e-713f5f0ad65d tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:09.031605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7589d506eebb42cca2fd636d95f16739'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:09.069235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7589d506eebb42cca2fd636d95f16739'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:09.089852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7589d506eebb42cca2fd636d95f16739'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:09.092678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b9515bba-f3df-41e7-8880-f59d0f22de97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7589d506eebb42cca2fd636d95f16739'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:09.137392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f395-4974-424f-913e-713f5f0ad65d tempest-EndPointGroupsTest-1628413740 tempest-EndPointGroupsTest-1628413740-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:09.167530 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2938/5920] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:08 2022] DELETE /identity/v3/users/7589d506eebb42cca2fd636d95f16739 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:09.217955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:09.217955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:09.217955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:09.218731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] PATH_INFO: `/v3/users/eb6718a3bc8f456abf504d5bb82a3be6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:09.230627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6718a3bc8f456abf504d5bb82a3be6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:09.235648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:09.316994 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:DELETE=13 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:09.424361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6718a3bc8f456abf504d5bb82a3be6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:09.502237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6718a3bc8f456abf504d5bb82a3be6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:09.515893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6718a3bc8f456abf504d5bb82a3be6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:09.533246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6718a3bc8f456abf504d5bb82a3be6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:09.534113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6718a3bc8f456abf504d5bb82a3be6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:09.552336 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2983/5921] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:08 2022] DELETE /identity/v3/users/eb6718a3bc8f456abf504d5bb82a3be6 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:09.553773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2ecf-19ba-4602-aaa5-af5c3554cca4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:09.554062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2ecf-19ba-4602-aaa5-af5c3554cca4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:09.554337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2ecf-19ba-4602-aaa5-af5c3554cca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:09.635519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-80ad2ecf-19ba-4602-aaa5-af5c3554cca4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:09.639133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-80ad2ecf-19ba-4602-aaa5-af5c3554cca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:09.726765 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:09.877487 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2939/5922] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:10.065214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:10.066691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:10.266118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f9284-997a-4c62-a8b0-b10999916271 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:10.286362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5709c-4a49-4d6a-b6a7-eb691e8837e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:10.287076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5709c-4a49-4d6a-b6a7-eb691e8837e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:10.287191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5709c-4a49-4d6a-b6a7-eb691e8837e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:10.287439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5709c-4a49-4d6a-b6a7-eb691e8837e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:10.317347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5709c-4a49-4d6a-b6a7-eb691e8837e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:10.318623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5709c-4a49-4d6a-b6a7-eb691e8837e4 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:10.355090 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2984/5923] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:11.485719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2ecf-19ba-4602-aaa5-af5c3554cca4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:11.487380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-80ad2ecf-19ba-4602-aaa5-af5c3554cca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:11.541338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5709c-4a49-4d6a-b6a7-eb691e8837e4 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:11.542388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2ecf-19ba-4602-aaa5-af5c3554cca4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:11.542819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e3e5709c-4a49-4d6a-b6a7-eb691e8837e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:11.564159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:11.564880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:11.565218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:11.565420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] PATH_INFO: `/v3/projects/3e74cf6ab7494e38b6f03cf3c713fef8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:11.566649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e74cf6ab7494e38b6f03cf3c713fef8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:11.568911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:11.736323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e74cf6ab7494e38b6f03cf3c713fef8', 'request_id': 'req-4946c19e-5433-4bec-bdf1-6c825d2ee340'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:11.758728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5709c-4a49-4d6a-b6a7-eb691e8837e4 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:11.765117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e74cf6ab7494e38b6f03cf3c713fef8', 'request_id': 'req-4946c19e-5433-4bec-bdf1-6c825d2ee340'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:11.775558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e74cf6ab7494e38b6f03cf3c713fef8', 'request_id': 'req-4946c19e-5433-4bec-bdf1-6c825d2ee340'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:11.819671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] The token cache is being invalidate because project 3e74cf6ab7494e38b6f03cf3c713fef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:11.819968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:11.821367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:11.824815 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2940/5924] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:11 2022] DELETE /identity/v3/projects/3e74cf6ab7494e38b6f03cf3c713fef8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:11.829488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:11.837891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:11.916488 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:11.957453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:11.958220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:11.958517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:11.958859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:11.968057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:12.039886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946c19e-5433-4bec-bdf1-6c825d2ee340 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:12.059359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:12.060026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:12.060312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:12.060590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] PATH_INFO: `/v3/users/0b13ec9858d54baaa52d8210cbd1bc6c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:12.063071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b13ec9858d54baaa52d8210cbd1bc6c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:12.065143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:12.129019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:12.132060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:12.212018 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:12.213392 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2985/5925] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:12:12.233609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b13ec9858d54baaa52d8210cbd1bc6c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:12.283110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b13ec9858d54baaa52d8210cbd1bc6c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:12.308604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b13ec9858d54baaa52d8210cbd1bc6c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:12.329944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b13ec9858d54baaa52d8210cbd1bc6c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:12.331046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b13ec9858d54baaa52d8210cbd1bc6c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:12.345844 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2941/5926] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:11 2022] DELETE /identity/v3/users/0b13ec9858d54baaa52d8210cbd1bc6c => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:12.569351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:12.571981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:12.594736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70d4d6-65be-4555-81cc-59b3bebea1f4 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:12.714017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:12.716324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:12.717119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:12.717433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] PATH_INFO: `/v3/projects/40a6a3396d4943acb570625f2b710f7a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:12.720259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a6a3396d4943acb570625f2b710f7a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:12.726043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:12.981784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a6a3396d4943acb570625f2b710f7a', 'request_id': 'req-6a8d579f-e259-4321-b8cb-a10022f57fcc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.017653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a6a3396d4943acb570625f2b710f7a', 'request_id': 'req-6a8d579f-e259-4321-b8cb-a10022f57fcc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.041002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a6a3396d4943acb570625f2b710f7a', 'request_id': 'req-6a8d579f-e259-4321-b8cb-a10022f57fcc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.106709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] The token cache is being invalidate because project 40a6a3396d4943acb570625f2b710f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:13.106912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.112093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.118354 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2986/5927] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:12 2022] DELETE /identity/v3/projects/40a6a3396d4943acb570625f2b710f7a => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:13.122533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:13.124303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:13.160740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7473c0-237a-481e-87f7-4a3a37996d46 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:13.394292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:13.406743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:13.410139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:13.410990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] PATH_INFO: `/v3/users/ba1a31e33a0148f99cfc04f759ebb5c8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:13.417150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1a31e33a0148f99cfc04f759ebb5c8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:13.423808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:13.663863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:13.665900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:13.703159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d579f-e259-4321-b8cb-a10022f57fcc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:13.729115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:13.729413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1a31e33a0148f99cfc04f759ebb5c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.729778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:13.730892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:13.731331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] PATH_INFO: `/v3/projects/f465a6a1b2364bde91911ffdfcaab3ba` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:13.734368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f465a6a1b2364bde91911ffdfcaab3ba)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:13.742161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:13.785992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1a31e33a0148f99cfc04f759ebb5c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.790326 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:13.806625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1a31e33a0148f99cfc04f759ebb5c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.825531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1a31e33a0148f99cfc04f759ebb5c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.830274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1a31e33a0148f99cfc04f759ebb5c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.838991 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2942/5928] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:13 2022] DELETE /identity/v3/users/ba1a31e33a0148f99cfc04f759ebb5c8 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:13.871265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:13.878286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:13.966720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f465a6a1b2364bde91911ffdfcaab3ba', 'request_id': 'req-988ac5fe-33f3-48d4-be6a-466b5b9d8373'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:13.989496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f465a6a1b2364bde91911ffdfcaab3ba', 'request_id': 'req-988ac5fe-33f3-48d4-be6a-466b5b9d8373'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:14.012563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f465a6a1b2364bde91911ffdfcaab3ba', 'request_id': 'req-988ac5fe-33f3-48d4-be6a-466b5b9d8373'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:14.054380 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:14.060274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] The token cache is being invalidate because project f465a6a1b2364bde91911ffdfcaab3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:14.061726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:14.064352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-988ac5fe-33f3-48d4-be6a-466b5b9d8373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:14.068710 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2987/5929] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:13 2022] DELETE /identity/v3/projects/f465a6a1b2364bde91911ffdfcaab3ba => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:14.074222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ed3b3-138d-4cb7-b9f0-396591c3c47d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:14.074511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ed3b3-138d-4cb7-b9f0-396591c3c47d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:14.074830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ed3b3-138d-4cb7-b9f0-396591c3c47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:14.093488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce4c9-3c0b-42dd-8584-1338fdbfe0b6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:14.187532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-154ed3b3-138d-4cb7-b9f0-396591c3c47d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:14.193822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-154ed3b3-138d-4cb7-b9f0-396591c3c47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:14.305614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a94c-7ec1-4821-a79e-bae6cdafb403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:14.306256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a94c-7ec1-4821-a79e-bae6cdafb403 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:14.306539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a94c-7ec1-4821-a79e-bae6cdafb403 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:14.306920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a94c-7ec1-4821-a79e-bae6cdafb403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:14.313339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f973a94c-7ec1-4821-a79e-bae6cdafb403 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:14.434797 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2988/5930] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:14.443438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a582e5-a42b-4855-a3c9-82fdba94db21 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:14.443728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a582e5-a42b-4855-a3c9-82fdba94db21 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:14.444007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a582e5-a42b-4855-a3c9-82fdba94db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:14.456383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973a94c-7ec1-4821-a79e-bae6cdafb403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:14.458247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973a94c-7ec1-4821-a79e-bae6cdafb403 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:14.482258 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2943/5931] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:14.517883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f9a582e5-a42b-4855-a3c9-82fdba94db21 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:14.519204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f9a582e5-a42b-4855-a3c9-82fdba94db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:14.529794 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2989/5932] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:14.533731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a94c-7ec1-4821-a79e-bae6cdafb403 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:14.547142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a94c-7ec1-4821-a79e-bae6cdafb403 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:14.558192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3183c-6de2-450e-82a4-624633b620fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:14.559032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3183c-6de2-450e-82a4-624633b620fd admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:14.564778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3183c-6de2-450e-82a4-624633b620fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:14.565322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3183c-6de2-450e-82a4-624633b620fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:14.568229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3183c-6de2-450e-82a4-624633b620fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:14.569083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3183c-6de2-450e-82a4-624633b620fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:14.575715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3183c-6de2-450e-82a4-624633b620fd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:14.610923 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2944/5933] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:14.616039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a582e5-a42b-4855-a3c9-82fdba94db21 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:14.633831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a582e5-a42b-4855-a3c9-82fdba94db21 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:14.645332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb06c71-2b6c-4508-8c16-c9e50438a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:14.647160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb06c71-2b6c-4508-8c16-c9e50438a51d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:14.648537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb06c71-2b6c-4508-8c16-c9e50438a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:14.649366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb06c71-2b6c-4508-8c16-c9e50438a51d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:14.650098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb06c71-2b6c-4508-8c16-c9e50438a51d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:14.652053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb06c71-2b6c-4508-8c16-c9e50438a51d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:14.761355 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2990/5934] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:14 2022] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:14.762778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3183c-6de2-450e-82a4-624633b620fd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:14.778264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3183c-6de2-450e-82a4-624633b620fd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:14.822365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb06c71-2b6c-4508-8c16-c9e50438a51d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:14.824236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5eb06c71-2b6c-4508-8c16-c9e50438a51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:14.964439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d3e6f-6f74-4ca1-905d-3cee3d241be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:14.965239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d3e6f-6f74-4ca1-905d-3cee3d241be4 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:14.967076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d3e6f-6f74-4ca1-905d-3cee3d241be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:14.969486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d3e6f-6f74-4ca1-905d-3cee3d241be4 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:14.971502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d3e6f-6f74-4ca1-905d-3cee3d241be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:14.973620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d3e6f-6f74-4ca1-905d-3cee3d241be4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:15.024009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb06c71-2b6c-4508-8c16-c9e50438a51d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:15.030892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:15.031548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.031877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.032156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] PATH_INFO: `/v3/projects/806f29d12e5b4b03a2f460d1a58450b0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.034155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] RBAC: Authorizing `identity:delete_project(project_id=806f29d12e5b4b03a2f460d1a58450b0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:15.050212 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2945/5935] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:14 2022] POST /identity/v3/users => generated 279 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:15.052415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:15.054508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d3e6f-6f74-4ca1-905d-3cee3d241be4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:15.058483 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:15.088351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d3e6f-6f74-4ca1-905d-3cee3d241be4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:15.098865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db7109-49d4-4137-81d4-9b14b00f69a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:15.099589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db7109-49d4-4137-81d4-9b14b00f69a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.099959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db7109-49d4-4137-81d4-9b14b00f69a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.100311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db7109-49d4-4137-81d4-9b14b00f69a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.101122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db7109-49d4-4137-81d4-9b14b00f69a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:15.108086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db7109-49d4-4137-81d4-9b14b00f69a5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:15.133008 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2946/5936] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:15.141027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db7109-49d4-4137-81d4-9b14b00f69a5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:15.152796 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:15.157658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db7109-49d4-4137-81d4-9b14b00f69a5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:15.197224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806f29d12e5b4b03a2f460d1a58450b0', 'request_id': 'req-ca354d6f-5eda-44de-94c8-caf01c34645a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:15.231795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806f29d12e5b4b03a2f460d1a58450b0', 'request_id': 'req-ca354d6f-5eda-44de-94c8-caf01c34645a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:15.241379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a14e9-36f3-4b38-bab4-178988d56b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:15.242853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a14e9-36f3-4b38-bab4-178988d56b4c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.243538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a14e9-36f3-4b38-bab4-178988d56b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.243856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a14e9-36f3-4b38-bab4-178988d56b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.244730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a14e9-36f3-4b38-bab4-178988d56b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:15.245011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806f29d12e5b4b03a2f460d1a58450b0', 'request_id': 'req-ca354d6f-5eda-44de-94c8-caf01c34645a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:15.246584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a14e9-36f3-4b38-bab4-178988d56b4c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:15.258915 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2947/5937] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:15.268132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a14e9-36f3-4b38-bab4-178988d56b4c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:15.278382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] The token cache is being invalidate because project 806f29d12e5b4b03a2f460d1a58450b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:15.278733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:15.279241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ca354d6f-5eda-44de-94c8-caf01c34645a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:15.280806 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2991/5938] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:14 2022] DELETE /identity/v3/projects/806f29d12e5b4b03a2f460d1a58450b0 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:15.285499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef51619-6e83-4213-98bf-b55131deca59 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.285657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a14e9-36f3-4b38-bab4-178988d56b4c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:15.285791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef51619-6e83-4213-98bf-b55131deca59 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.286069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef51619-6e83-4213-98bf-b55131deca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.292116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662401-fbfd-445c-a360-76eaf2c4bffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:15.292934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662401-fbfd-445c-a360-76eaf2c4bffc admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.293308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662401-fbfd-445c-a360-76eaf2c4bffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.294089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662401-fbfd-445c-a360-76eaf2c4bffc admin admin] PATH_INFO: `/v3/projects/2f1401d2f8a84fffa26d8ef55c7ec88f/users/e1258daa2a694d64af12d3a69e0eedbb/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.314707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9662401-fbfd-445c-a360-76eaf2c4bffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1401d2f8a84fffa26d8ef55c7ec88f, user_id=e1258daa2a694d64af12d3a69e0eedbb, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:15.318575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9662401-fbfd-445c-a360-76eaf2c4bffc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:15.340641 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2948/5939] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:15 2022] PUT /identity/v3/projects/2f1401d2f8a84fffa26d8ef55c7ec88f/users/e1258daa2a694d64af12d3a69e0eedbb/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:15.341819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5ef51619-6e83-4213-98bf-b55131deca59 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:15.343093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5ef51619-6e83-4213-98bf-b55131deca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:15.353602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e367-c676-42ab-9cd2-850ba59e51fd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.354226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e367-c676-42ab-9cd2-850ba59e51fd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.354704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e367-c676-42ab-9cd2-850ba59e51fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.436394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8aa4e367-c676-42ab-9cd2-850ba59e51fd None None] MFA Rules not processed for user `e1258daa2a694d64af12d3a69e0eedbb`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:15.437591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8aa4e367-c676-42ab-9cd2-850ba59e51fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:15.547672 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2992/5940] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:15.560022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22986f1-19a0-4346-951a-24906ea4494a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.560022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22986f1-19a0-4346-951a-24906ea4494a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.560416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22986f1-19a0-4346-951a-24906ea4494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.653864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d22986f1-19a0-4346-951a-24906ea4494a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:15.655086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d22986f1-19a0-4346-951a-24906ea4494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:15.690137 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2993/5941] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:15.690698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22986f1-19a0-4346-951a-24906ea4494a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:15.691123 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2949/5942] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:15.696139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4e367-c676-42ab-9cd2-850ba59e51fd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:15.700288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8aa4e367-c676-42ab-9cd2-850ba59e51fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:15.710342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22986f1-19a0-4346-951a-24906ea4494a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:15.731319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bedd2-33d0-446c-b69c-40883cd67cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:15.731954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bedd2-33d0-446c-b69c-40883cd67cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.732232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bedd2-33d0-446c-b69c-40883cd67cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.732582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bedd2-33d0-446c-b69c-40883cd67cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.733192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bedd2-33d0-446c-b69c-40883cd67cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:15.733497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bedd2-33d0-446c-b69c-40883cd67cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:15.735190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bedd2-33d0-446c-b69c-40883cd67cc1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:15.737836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4e367-c676-42ab-9cd2-850ba59e51fd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:15.752968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337a61-5b6c-43fa-821a-dee082d56e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:15.755259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337a61-5b6c-43fa-821a-dee082d56e23 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.755616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337a61-5b6c-43fa-821a-dee082d56e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.756027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337a61-5b6c-43fa-821a-dee082d56e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.756768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6337a61-5b6c-43fa-821a-dee082d56e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:15.758909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6337a61-5b6c-43fa-821a-dee082d56e23 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:15.782403 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2994/5943] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:15.783313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bedd2-33d0-446c-b69c-40883cd67cc1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:15.816688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bedd2-33d0-446c-b69c-40883cd67cc1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:15.818813 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2950/5944] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:15 2022] POST /identity/v3/projects => generated 355 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:15.824504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337a61-5b6c-43fa-821a-dee082d56e23 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:15.942096 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:15.977421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337a61-5b6c-43fa-821a-dee082d56e23 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:15.992357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c58c13-7e41-4a9c-b123-d8d15903aecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:15.993111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c58c13-7e41-4a9c-b123-d8d15903aecc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:15.993472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c58c13-7e41-4a9c-b123-d8d15903aecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:15.993847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c58c13-7e41-4a9c-b123-d8d15903aecc admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:15.994741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c58c13-7e41-4a9c-b123-d8d15903aecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:15.996931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c58c13-7e41-4a9c-b123-d8d15903aecc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:16.015552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6cdd9-1ea5-48da-864e-574e87605af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:16.016181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6cdd9-1ea5-48da-864e-574e87605af3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:16.016457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6cdd9-1ea5-48da-864e-574e87605af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:16.016817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6cdd9-1ea5-48da-864e-574e87605af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:16.017377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6cdd9-1ea5-48da-864e-574e87605af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:16.019266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6cdd9-1ea5-48da-864e-574e87605af3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:16.084318 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2951/5945] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:15 2022] POST /identity/v3/users => generated 284 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:16.085731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c58c13-7e41-4a9c-b123-d8d15903aecc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:16.110939 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:16.116266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c58c13-7e41-4a9c-b123-d8d15903aecc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:16.143875 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2995/5946] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:15 2022] POST /identity/v3/projects => generated 371 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:16.145537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bc7c9-5a78-4b6e-856f-afc8e6d956dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:16.145859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6cdd9-1ea5-48da-864e-574e87605af3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:16.146645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bc7c9-5a78-4b6e-856f-afc8e6d956dc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:16.147163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bc7c9-5a78-4b6e-856f-afc8e6d956dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:16.147647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bc7c9-5a78-4b6e-856f-afc8e6d956dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:16.149074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bc7c9-5a78-4b6e-856f-afc8e6d956dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:16.152089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bc7c9-5a78-4b6e-856f-afc8e6d956dc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:16.203557 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2952/5947] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:16.206322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bc7c9-5a78-4b6e-856f-afc8e6d956dc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:16.242909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bc7c9-5a78-4b6e-856f-afc8e6d956dc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:16.287942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6cdd9-1ea5-48da-864e-574e87605af3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:16.294964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7fb1-0fa5-4d5f-b59d-41ddcc5bcff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:16.295391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7fb1-0fa5-4d5f-b59d-41ddcc5bcff2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:16.295391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7fb1-0fa5-4d5f-b59d-41ddcc5bcff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:16.295609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7fb1-0fa5-4d5f-b59d-41ddcc5bcff2 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:16.296230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7fb1-0fa5-4d5f-b59d-41ddcc5bcff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:16.298712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7fb1-0fa5-4d5f-b59d-41ddcc5bcff2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:16.350349 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2996/5948] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:16 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:16.350940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7fb1-0fa5-4d5f-b59d-41ddcc5bcff2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:16.385306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7fb1-0fa5-4d5f-b59d-41ddcc5bcff2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:16.399472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24244901-bce0-4b0e-b3a9-f667a6b27292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:16.403397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24244901-bce0-4b0e-b3a9-f667a6b27292 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:16.403397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24244901-bce0-4b0e-b3a9-f667a6b27292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:16.403397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24244901-bce0-4b0e-b3a9-f667a6b27292 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:16.403758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24244901-bce0-4b0e-b3a9-f667a6b27292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:16.408275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24244901-bce0-4b0e-b3a9-f667a6b27292 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:16.437480 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2997/5949] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:16.442417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24244901-bce0-4b0e-b3a9-f667a6b27292 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:16.446818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-24244901-bce0-4b0e-b3a9-f667a6b27292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:16.479281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24244901-bce0-4b0e-b3a9-f667a6b27292 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:16.491422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:16.492304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:16.494782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:16.496092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] PATH_INFO: `/v3/users/60fa48f0599441b788b2a149ba9b20ef` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:16.498515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fa48f0599441b788b2a149ba9b20ef)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:16.503901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:16.514820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411adf1-9910-42dc-9dbe-0e7c3da27468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:16.517169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411adf1-9910-42dc-9dbe-0e7c3da27468 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:16.517464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411adf1-9910-42dc-9dbe-0e7c3da27468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:16.517740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411adf1-9910-42dc-9dbe-0e7c3da27468 admin admin] PATH_INFO: `/v3/projects/5545bd3647014270906fc2a93c995b87/users/9ee75fabd5c64c2da4858095f3ae1558/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:16.604301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411adf1-9910-42dc-9dbe-0e7c3da27468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5545bd3647014270906fc2a93c995b87, user_id=9ee75fabd5c64c2da4858095f3ae1558, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:16.612835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411adf1-9910-42dc-9dbe-0e7c3da27468 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:16.613061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fa48f0599441b788b2a149ba9b20ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:16.645809 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2953/5950] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:16 2022] PUT /identity/v3/projects/5545bd3647014270906fc2a93c995b87/users/9ee75fabd5c64c2da4858095f3ae1558/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:16.645983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fa48f0599441b788b2a149ba9b20ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:16.646087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411adf1-9910-42dc-9dbe-0e7c3da27468 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:16.660400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fa48f0599441b788b2a149ba9b20ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:16.688274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fa48f0599441b788b2a149ba9b20ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:16.691252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fa48f0599441b788b2a149ba9b20ef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:16.707560 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2998/5951] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:16 2022] DELETE /identity/v3/users/60fa48f0599441b788b2a149ba9b20ef => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:16.710194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:16.718632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:16.807554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411adf1-9910-42dc-9dbe-0e7c3da27468 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:16.936496 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:17.002417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3647d-da4b-4c79-8f00-a3006d4b6514 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:17.038912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325822d7-d8d8-4642-90bd-951ca218e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:17.040216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325822d7-d8d8-4642-90bd-951ca218e35f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:17.040497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325822d7-d8d8-4642-90bd-951ca218e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:17.040802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325822d7-d8d8-4642-90bd-951ca218e35f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:17.041561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325822d7-d8d8-4642-90bd-951ca218e35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:17.043240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325822d7-d8d8-4642-90bd-951ca218e35f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:17.058634 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 2999/5952] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:17.058634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f062f4-b0f5-44b1-839a-141fb1e8eed0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:17.058634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f062f4-b0f5-44b1-839a-141fb1e8eed0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:17.058634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f062f4-b0f5-44b1-839a-141fb1e8eed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:17.082376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-42f062f4-b0f5-44b1-839a-141fb1e8eed0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:17.083911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-42f062f4-b0f5-44b1-839a-141fb1e8eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:17.103201 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3000/5953] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:17.103353 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:17.103441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f062f4-b0f5-44b1-839a-141fb1e8eed0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:17.131148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f062f4-b0f5-44b1-839a-141fb1e8eed0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:17.138237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b61087-9766-4010-a2b9-ceef154cb02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:17.140036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b61087-9766-4010-a2b9-ceef154cb02f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:17.140279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b61087-9766-4010-a2b9-ceef154cb02f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:17.140494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b61087-9766-4010-a2b9-ceef154cb02f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:17.141190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b61087-9766-4010-a2b9-ceef154cb02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:17.143524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7d3d-283a-4791-911c-c5c6e4d7691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:17.144268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7d3d-283a-4791-911c-c5c6e4d7691f admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:17.150517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b61087-9766-4010-a2b9-ceef154cb02f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:17.158407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7d3d-283a-4791-911c-c5c6e4d7691f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:17.159522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7d3d-283a-4791-911c-c5c6e4d7691f admin admin] PATH_INFO: `/v3/projects/5545bd3647014270906fc2a93c995b87/users/9ee75fabd5c64c2da4858095f3ae1558/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:17.166215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c7d3d-283a-4791-911c-c5c6e4d7691f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5545bd3647014270906fc2a93c995b87, user_id=9ee75fabd5c64c2da4858095f3ae1558, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:17.182631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c7d3d-283a-4791-911c-c5c6e4d7691f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:17.203595 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2954/5954] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 560 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:17.217013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b61087-9766-4010-a2b9-ceef154cb02f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:17.233116 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3001/5955] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:17 2022] PUT /identity/v3/projects/5545bd3647014270906fc2a93c995b87/users/9ee75fabd5c64c2da4858095f3ae1558/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:17.234225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7d3d-283a-4791-911c-c5c6e4d7691f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:17.236055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-da6c7d3d-283a-4791-911c-c5c6e4d7691f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:17.249656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-50b61087-9766-4010-a2b9-ceef154cb02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:17.397485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7d3d-283a-4791-911c-c5c6e4d7691f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:17.403985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e898fb-3090-4704-ad72-304d85ec252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:17.404694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e898fb-3090-4704-ad72-304d85ec252c admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:17.404974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e898fb-3090-4704-ad72-304d85ec252c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:17.405251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e898fb-3090-4704-ad72-304d85ec252c admin admin] PATH_INFO: `/v3/projects/ed3bec8bd6c04a6e8ae0c17820eefcd2/users/fb4ab55969ca40e1bbfdc90f93ddc3bf/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:17.425439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e898fb-3090-4704-ad72-304d85ec252c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3bec8bd6c04a6e8ae0c17820eefcd2, user_id=fb4ab55969ca40e1bbfdc90f93ddc3bf, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:17.428790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e898fb-3090-4704-ad72-304d85ec252c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:17.448975 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3002/5956] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:17 2022] PUT /identity/v3/projects/ed3bec8bd6c04a6e8ae0c17820eefcd2/users/fb4ab55969ca40e1bbfdc90f93ddc3bf/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:17.451037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8de9-74e4-427d-b278-4210dc7bcb7a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:17.452358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8de9-74e4-427d-b278-4210dc7bcb7a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:17.452913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8de9-74e4-427d-b278-4210dc7bcb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:17.510950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6b0b8de9-74e4-427d-b278-4210dc7bcb7a None None] MFA Rules not processed for user `9ee75fabd5c64c2da4858095f3ae1558`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:17.513045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6b0b8de9-74e4-427d-b278-4210dc7bcb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:17.623221 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3003/5957] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:17.623221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec036f-c94f-4941-b9fa-724868c5abcd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:17.623221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec036f-c94f-4941-b9fa-724868c5abcd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:17.623221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec036f-c94f-4941-b9fa-724868c5abcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:17.624268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b61087-9766-4010-a2b9-ceef154cb02f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:17.676895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-91ec036f-c94f-4941-b9fa-724868c5abcd None None] MFA Rules not processed for user `fb4ab55969ca40e1bbfdc90f93ddc3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:17.678769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-91ec036f-c94f-4941-b9fa-724868c5abcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:17.728937 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:17.812764 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3004/5958] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:17.814430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec036f-c94f-4941-b9fa-724868c5abcd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:17.847148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec036f-c94f-4941-b9fa-724868c5abcd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:17.861541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79100a-8f07-44ca-9c87-2e1ce3d09225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:17.862416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79100a-8f07-44ca-9c87-2e1ce3d09225 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:17.862740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79100a-8f07-44ca-9c87-2e1ce3d09225 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:17.862994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79100a-8f07-44ca-9c87-2e1ce3d09225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:17.873812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb5393-e6c2-4976-b054-13b5055d40a7 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee75fabd5c64c2da4858095f3ae1558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5545bd3647014270906fc2a93c995b87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:17.879685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5393-e6c2-4976-b054-13b5055d40a7 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:17.881051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5393-e6c2-4976-b054-13b5055d40a7 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:17.881314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5393-e6c2-4976-b054-13b5055d40a7 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:17.883333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb5393-e6c2-4976-b054-13b5055d40a7 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:17.884548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb5393-e6c2-4976-b054-13b5055d40a7 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:17.888084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb5393-e6c2-4976-b054-13b5055d40a7 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:17.946946 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3005/5959] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:17.948218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb5393-e6c2-4976-b054-13b5055d40a7 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:18.192419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb5393-e6c2-4976-b054-13b5055d40a7 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:18.208180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a8146-5d16-4ccd-bd88-db1915689c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:18.209361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8146-5d16-4ccd-bd88-db1915689c03 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:18.213108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8146-5d16-4ccd-bd88-db1915689c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:18.213709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8146-5d16-4ccd-bd88-db1915689c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:18.215138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a8146-5d16-4ccd-bd88-db1915689c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:18.217384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a8146-5d16-4ccd-bd88-db1915689c03 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:18.374884 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3006/5960] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:17 2022] POST /identity/v3/projects => generated 369 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:18.379493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a8146-5d16-4ccd-bd88-db1915689c03 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:18.400918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79100a-8f07-44ca-9c87-2e1ce3d09225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:18.416929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79100a-8f07-44ca-9c87-2e1ce3d09225 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:18.435018 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2955/5961] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:18.436399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79100a-8f07-44ca-9c87-2e1ce3d09225 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:18.474533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79100a-8f07-44ca-9c87-2e1ce3d09225 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:18.611465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a8146-5d16-4ccd-bd88-db1915689c03 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:18.625893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c379-8e29-4a06-961a-6de2a89a9617 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee75fabd5c64c2da4858095f3ae1558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5545bd3647014270906fc2a93c995b87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:18.627586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c379-8e29-4a06-961a-6de2a89a9617 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:18.627912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c379-8e29-4a06-961a-6de2a89a9617 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:18.628296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c379-8e29-4a06-961a-6de2a89a9617 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:18.629300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14c379-8e29-4a06-961a-6de2a89a9617 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:18.637392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14c379-8e29-4a06-961a-6de2a89a9617 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:18.660296 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:18.677011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40c8b2-a019-4f82-8860-97437c889cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:18.677701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40c8b2-a019-4f82-8860-97437c889cbd admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:18.678036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40c8b2-a019-4f82-8860-97437c889cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:18.678386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40c8b2-a019-4f82-8860-97437c889cbd admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:18.679425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40c8b2-a019-4f82-8860-97437c889cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:18.686032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40c8b2-a019-4f82-8860-97437c889cbd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:18.764680 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2956/5962] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:18 2022] POST /identity/v3/users => generated 291 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:18.768806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40c8b2-a019-4f82-8860-97437c889cbd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:18.783924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40c8b2-a019-4f82-8860-97437c889cbd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:18.792587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6febe8-120c-465b-b1e0-ca6f11bd22e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:18.794095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6febe8-120c-465b-b1e0-ca6f11bd22e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:18.794475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6febe8-120c-465b-b1e0-ca6f11bd22e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:18.794850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6febe8-120c-465b-b1e0-ca6f11bd22e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:18.796190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6febe8-120c-465b-b1e0-ca6f11bd22e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:18.798107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6febe8-120c-465b-b1e0-ca6f11bd22e3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:18.806998 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3007/5963] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:18 2022] POST /identity/v3/projects => generated 349 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:18.817291 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2957/5964] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:18.820535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6febe8-120c-465b-b1e0-ca6f11bd22e3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:18.826781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c379-8e29-4a06-961a-6de2a89a9617 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:18.836141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6febe8-120c-465b-b1e0-ca6f11bd22e3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:18.959998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743fe75-85df-45b2-afdc-0dca9f089292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:18.961660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743fe75-85df-45b2-afdc-0dca9f089292 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:18.962785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743fe75-85df-45b2-afdc-0dca9f089292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:18.963580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743fe75-85df-45b2-afdc-0dca9f089292 admin admin] PATH_INFO: `/v3/projects/389c64f02f0e42a1bde5ec433eca095c/users/975616c47625445c91f114e745a25b59/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:18.989739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743fe75-85df-45b2-afdc-0dca9f089292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389c64f02f0e42a1bde5ec433eca095c, user_id=975616c47625445c91f114e745a25b59, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:18.995040 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:19.011012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743fe75-85df-45b2-afdc-0dca9f089292 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:19.053594 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2958/5965] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:18 2022] PUT /identity/v3/projects/389c64f02f0e42a1bde5ec433eca095c/users/975616c47625445c91f114e745a25b59/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:19.061274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743fe75-85df-45b2-afdc-0dca9f089292 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:19.219811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c379-8e29-4a06-961a-6de2a89a9617 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:19.292595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743fe75-85df-45b2-afdc-0dca9f089292 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:19.325421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14f25f-5162-46a6-b90c-c8a5eaec66be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:19.328473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14f25f-5162-46a6-b90c-c8a5eaec66be admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:19.329049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14f25f-5162-46a6-b90c-c8a5eaec66be admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:19.329466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14f25f-5162-46a6-b90c-c8a5eaec66be admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:19.331729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14f25f-5162-46a6-b90c-c8a5eaec66be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:19.336944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14f25f-5162-46a6-b90c-c8a5eaec66be admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:19.366404 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2959/5966] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:19.368092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14f25f-5162-46a6-b90c-c8a5eaec66be admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:19.387253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71506b63-8179-409c-b9fc-d554d1285005 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee75fabd5c64c2da4858095f3ae1558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5545bd3647014270906fc2a93c995b87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:19.394711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71506b63-8179-409c-b9fc-d554d1285005 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:19.395902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71506b63-8179-409c-b9fc-d554d1285005 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:19.396280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71506b63-8179-409c-b9fc-d554d1285005 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:19.400352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71506b63-8179-409c-b9fc-d554d1285005 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:19.400610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14f25f-5162-46a6-b90c-c8a5eaec66be admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:19.401413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71506b63-8179-409c-b9fc-d554d1285005 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:19.407509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71506b63-8179-409c-b9fc-d554d1285005 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:19.415699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c6afd-ade7-42b5-85a2-a1b4f9c058ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:19.416058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c6afd-ade7-42b5-85a2-a1b4f9c058ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:19.419408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c6afd-ade7-42b5-85a2-a1b4f9c058ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:19.420971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c6afd-ade7-42b5-85a2-a1b4f9c058ee admin admin] PATH_INFO: `/v3/projects/389c64f02f0e42a1bde5ec433eca095c/users/975616c47625445c91f114e745a25b59/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:19.428497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c6afd-ade7-42b5-85a2-a1b4f9c058ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=389c64f02f0e42a1bde5ec433eca095c, user_id=975616c47625445c91f114e745a25b59, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:19.434039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c6afd-ade7-42b5-85a2-a1b4f9c058ee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:19.458730 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3008/5967] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 647 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:19.477488 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2960/5968] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:19 2022] PUT /identity/v3/projects/389c64f02f0e42a1bde5ec433eca095c/users/975616c47625445c91f114e745a25b59/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:19.488582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08a7b2-45b8-4d42-86bd-bbb1d4d5359e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:19.488902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08a7b2-45b8-4d42-86bd-bbb1d4d5359e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:19.489205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08a7b2-45b8-4d42-86bd-bbb1d4d5359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:19.602397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fa08a7b2-45b8-4d42-86bd-bbb1d4d5359e None None] MFA Rules not processed for user `975616c47625445c91f114e745a25b59`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:19.603679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fa08a7b2-45b8-4d42-86bd-bbb1d4d5359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:19.623880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c6afd-ade7-42b5-85a2-a1b4f9c058ee admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:19.626198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f60c6afd-ade7-42b5-85a2-a1b4f9c058ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:19.830762 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:19.880821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c6afd-ade7-42b5-85a2-a1b4f9c058ee admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:19.894596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d245e0-ca73-47b3-826d-c4e321a4f11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:19.896106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d245e0-ca73-47b3-826d-c4e321a4f11e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:19.896383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d245e0-ca73-47b3-826d-c4e321a4f11e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:19.896668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d245e0-ca73-47b3-826d-c4e321a4f11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:19.943118 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3009/5969] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:19.947434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08a7b2-45b8-4d42-86bd-bbb1d4d5359e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:19.964220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08a7b2-45b8-4d42-86bd-bbb1d4d5359e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:19.978868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8db1b-bf5c-4434-8441-542c9c87c3ae tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:19.980357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8db1b-bf5c-4434-8441-542c9c87c3ae tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:19.980679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8db1b-bf5c-4434-8441-542c9c87c3ae tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:19.980967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8db1b-bf5c-4434-8441-542c9c87c3ae tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:19.982131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8db1b-bf5c-4434-8441-542c9c87c3ae tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:19.983792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8db1b-bf5c-4434-8441-542c9c87c3ae tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:20.050689 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3010/5970] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:19 2022] POST /identity/v3/services => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:20.056610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8db1b-bf5c-4434-8441-542c9c87c3ae tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:20.140231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8db1b-bf5c-4434-8441-542c9c87c3ae tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:20.152897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:20.153723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:20.154186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:20.154622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:20.155459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:20.156659 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:20.156659 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:20.156659 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:20.165895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:20.211694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d245e0-ca73-47b3-826d-c4e321a4f11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:20.213625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d245e0-ca73-47b3-826d-c4e321a4f11e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:20.243960 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2013189743. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:12:20.243960 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:12:20.243960 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:20.253759 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2961/5971] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:12:20.254401 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:20.309329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3011/5972] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 01:12:20 2022] POST /identity/v3/endpoints => generated 360 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:20.311140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d245e0-ca73-47b3-826d-c4e321a4f11e service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:20.367861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d245e0-ca73-47b3-826d-c4e321a4f11e service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:20.418973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf96e7-5385-434c-8484-806db67961cb tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:20.419630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf96e7-5385-434c-8484-806db67961cb tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:20.419913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf96e7-5385-434c-8484-806db67961cb tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:20.420190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf96e7-5385-434c-8484-806db67961cb tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-2013189743` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:20.420818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf96e7-5385-434c-8484-806db67961cb tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2013189743)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:20.421895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf96e7-5385-434c-8484-806db67961cb tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:20.430173 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2962/5973] 10.222.0.27 () {58 vars in 1206 bytes} [Wed Oct 19 01:12:20 2022] GET /identity/v3/regions/tempest-region-2013189743 => generated 180 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:12:20.434731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:20.451050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8b12-ba23-404d-8b91-e6b7c59a6c9a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:20.456777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93731dd-9f04-48d4-9c40-4b327c40db5b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:20.457924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93731dd-9f04-48d4-9c40-4b327c40db5b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:20.458098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93731dd-9f04-48d4-9c40-4b327c40db5b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:20.458545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93731dd-9f04-48d4-9c40-4b327c40db5b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:20.459553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93731dd-9f04-48d4-9c40-4b327c40db5b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:20.461636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93731dd-9f04-48d4-9c40-4b327c40db5b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:20.499900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf96e7-5385-434c-8484-806db67961cb tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:20.510999 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3012/5974] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:20 2022] POST /identity/v3/services => generated 286 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:20.515262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf96e7-5385-434c-8484-806db67961cb tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:20.600992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:20.601926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:20.602372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:20.602871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:20.603714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:20.605666 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:20.605666 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:12:20.605666 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:12:20.606588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:20.616751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93731dd-9f04-48d4-9c40-4b327c40db5b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:20.619647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b93731dd-9f04-48d4-9c40-4b327c40db5b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:20.669420 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1610861741. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:12:20.669420 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:12:20.669420 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:12:20.771425 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2963/5975] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 01:12:20 2022] POST /identity/v3/endpoints => generated 362 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:20.781440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:20.846842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb97b6-bd14-4d4f-a44f-67062953761a tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:20.862468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc9b6-f8b9-4799-a0aa-6e336b926871 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:20.863275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc9b6-f8b9-4799-a0aa-6e336b926871 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:20.863671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc9b6-f8b9-4799-a0aa-6e336b926871 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:20.864058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc9b6-f8b9-4799-a0aa-6e336b926871 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-1610861741` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:20.864942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfc9b6-f8b9-4799-a0aa-6e336b926871 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1610861741)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:20.866366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfc9b6-f8b9-4799-a0aa-6e336b926871 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:20.873815 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2964/5976] 10.222.0.27 () {58 vars in 1206 bytes} [Wed Oct 19 01:12:20 2022] GET /identity/v3/regions/tempest-region-1610861741 => generated 180 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:20.873815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc9b6-f8b9-4799-a0aa-6e336b926871 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:20.894442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93731dd-9f04-48d4-9c40-4b327c40db5b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:20.924662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc9b6-f8b9-4799-a0aa-6e336b926871 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:20.935575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:20.936337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:20.936464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee75fabd5c64c2da4858095f3ae1558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5545bd3647014270906fc2a93c995b87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:20.936892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:20.937069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:20.937309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] PATH_INFO: `/v3/projects/115a626878d5477d886f478753425e6f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:20.937591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:20.937881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] PATH_INFO: `/v3/projects/c0512ddf87494a2da728924c6ee7ba02` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:20.939075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115a626878d5477d886f478753425e6f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:20.944007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c0512ddf87494a2da728924c6ee7ba02)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:20.951744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:20.956218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:21.145343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0512ddf87494a2da728924c6ee7ba02', 'request_id': 'req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.154295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115a626878d5477d886f478753425e6f', 'request_id': 'req-1af41cfa-b5ee-4053-bb80-6653844c3a47'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.161369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0512ddf87494a2da728924c6ee7ba02', 'request_id': 'req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.169876 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:21.175579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0512ddf87494a2da728924c6ee7ba02', 'request_id': 'req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.194594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115a626878d5477d886f478753425e6f', 'request_id': 'req-1af41cfa-b5ee-4053-bb80-6653844c3a47'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.210413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] The token cache is being invalidate because project c0512ddf87494a2da728924c6ee7ba02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:21.211008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.211907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.219670 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2965/5977] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:20 2022] DELETE /identity/v3/projects/c0512ddf87494a2da728924c6ee7ba02 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:21.221088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:21.223202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:21.226496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115a626878d5477d886f478753425e6f', 'request_id': 'req-1af41cfa-b5ee-4053-bb80-6653844c3a47'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.282916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] The token cache is being invalidate because project 115a626878d5477d886f478753425e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:21.283260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.284342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.286780 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3013/5978] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:20 2022] DELETE /identity/v3/projects/115a626878d5477d886f478753425e6f => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:21.291592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:21.302054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:21.359140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2692d-8db7-485c-9a91-ccc3ee9d8af9 tempest-QuotasTest-103222008 tempest-QuotasTest-103222008-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:21.377611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:21.378615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:21.379104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:21.379635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:21.380916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:21.383357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:21.414116 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1548867684. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:12:21.414116 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:12:21.414116 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:12:21.420110 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:21.465937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41cfa-b5ee-4053-bb80-6653844c3a47 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:21.473908 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2966/5979] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 01:12:21 2022] POST /identity/v3/endpoints => generated 359 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:21.473908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:21.485795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:21.625202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:21.626968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:21.629081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:21.629433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] PATH_INFO: `/v3/users/c7bd613a599f4d59a288304730519f34` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:21.633211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7bd613a599f4d59a288304730519f34)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:21.639189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:21.645452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f048d-5841-4435-970f-cf62fecf2313 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:21.661736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:21.662505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:21.662874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:21.663564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] PATH_INFO: `/v3/users/e1258daa2a694d64af12d3a69e0eedbb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:21.667856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1258daa2a694d64af12d3a69e0eedbb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:21.671585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:21.738717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7bd613a599f4d59a288304730519f34'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.774361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7bd613a599f4d59a288304730519f34'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.782911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1258daa2a694d64af12d3a69e0eedbb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.791743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7bd613a599f4d59a288304730519f34'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.806863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7bd613a599f4d59a288304730519f34'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.809240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7bd613a599f4d59a288304730519f34'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.812826 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:21.815258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1258daa2a694d64af12d3a69e0eedbb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.826214 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3014/5980] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:21 2022] DELETE /identity/v3/users/c7bd613a599f4d59a288304730519f34 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:21.828037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:21.841537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:21.847044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1258daa2a694d64af12d3a69e0eedbb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.864892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1258daa2a694d64af12d3a69e0eedbb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.866732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-859eea88-841b-495a-99fc-719c190896b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1258daa2a694d64af12d3a69e0eedbb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:21.892879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2967/5981] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:21 2022] DELETE /identity/v3/users/e1258daa2a694d64af12d3a69e0eedbb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:21.901657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5c9b-ecf0-42f8-9aab-15c41a1660f7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:21.903501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5c9b-ecf0-42f8-9aab-15c41a1660f7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:21.904364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac5c9b-ecf0-42f8-9aab-15c41a1660f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:21.983290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-57ac5c9b-ecf0-42f8-9aab-15c41a1660f7 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:21.985214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-57ac5c9b-ecf0-42f8-9aab-15c41a1660f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:21.985788 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:22.004017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b08891-a3c9-4d8d-b839-02a97a97cd42 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:22.165740 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2968/5982] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:12:21 2022] POST /identity/v3/auth/tokens => generated 4011 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:22.168110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389256c-17d6-4e6c-8a08-a730c00907c8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:22.168466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389256c-17d6-4e6c-8a08-a730c00907c8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:22.172413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389256c-17d6-4e6c-8a08-a730c00907c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:22.220272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19b1e5-4dc0-4fe3-92cf-e043f8ba952b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:22.221033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19b1e5-4dc0-4fe3-92cf-e043f8ba952b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:22.221380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19b1e5-4dc0-4fe3-92cf-e043f8ba952b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:22.221723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19b1e5-4dc0-4fe3-92cf-e043f8ba952b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-1548867684` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:22.222383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19b1e5-4dc0-4fe3-92cf-e043f8ba952b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1548867684)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:22.223536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19b1e5-4dc0-4fe3-92cf-e043f8ba952b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:22.227261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a389256c-17d6-4e6c-8a08-a730c00907c8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:22.227830 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3015/5983] 10.222.0.27 () {58 vars in 1206 bytes} [Wed Oct 19 01:12:21 2022] GET /identity/v3/regions/tempest-region-1548867684 => generated 180 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:22.229314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19b1e5-4dc0-4fe3-92cf-e043f8ba952b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:22.231394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6e19b1e5-4dc0-4fe3-92cf-e043f8ba952b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:22.232954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a389256c-17d6-4e6c-8a08-a730c00907c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:22.386602 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2969/5984] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:22 2022] POST /identity/v3/auth/tokens => generated 4055 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:22.387608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389256c-17d6-4e6c-8a08-a730c00907c8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:22.391328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a389256c-17d6-4e6c-8a08-a730c00907c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:22.420414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389256c-17d6-4e6c-8a08-a730c00907c8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:22.435392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:22.435392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:22.435392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:22.435933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:22.435933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:22.435933 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:22.435933 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:12:22.435933 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:12:22.435933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:22.437849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19b1e5-4dc0-4fe3-92cf-e043f8ba952b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:22.458710 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2970/5985] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Oct 19 01:12:22 2022] GET /identity/v3/endpoints => generated 4395 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:22.459934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:22.462671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8185b0-2933-4608-9a63-d7db7b59f379 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:22.463738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8185b0-2933-4608-9a63-d7db7b59f379 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:22.464029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8185b0-2933-4608-9a63-d7db7b59f379 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:22.464304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8185b0-2933-4608-9a63-d7db7b59f379 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:22.464762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:22.521796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8185b0-2933-4608-9a63-d7db7b59f379 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:22.523516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8185b0-2933-4608-9a63-d7db7b59f379 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:22.562023 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3016/5986] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:12:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:12:22.562822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8185b0-2933-4608-9a63-d7db7b59f379 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:22.597043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8185b0-2933-4608-9a63-d7db7b59f379 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:22.620687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:22.621340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:22.621646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:22.621876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints/fd390f03c4a44db9930f7f5a3eeccc72` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:22.656536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=fd390f03c4a44db9930f7f5a3eeccc72)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:22.657610 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:22.657610 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:22.657610 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:22.658641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:22.660730 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3017/5987] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:22 2022] GET /identity/v3/endpoints/fd390f03c4a44db9930f7f5a3eeccc72 => generated 359 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:22.671021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:22.690473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:22.721967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ef145-5b65-4a43-b28d-cdbfca9be050 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:22.735920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:22.736591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:22.736899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:22.737190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] PATH_INFO: `/v3/projects/3de9e3c9911243ad99ee67b8af4b92bf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:22.738364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de9e3c9911243ad99ee67b8af4b92bf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:22.740304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:22.746159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fff2fc-2ad7-4903-bcf0-cd019feca0ca tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:22.754690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cefe2b-343c-454d-84a0-4ea8ebb341ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:22.756491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cefe2b-343c-454d-84a0-4ea8ebb341ec service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:22.756987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cefe2b-343c-454d-84a0-4ea8ebb341ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:22.757333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cefe2b-343c-454d-84a0-4ea8ebb341ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:22.767010 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:22.773110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cefe2b-343c-454d-84a0-4ea8ebb341ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:22.777768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cefe2b-343c-454d-84a0-4ea8ebb341ec service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:22.812733 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2971/5988] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:22 2022] GET /identity/v3/auth/tokens => generated 4055 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:22.816242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cefe2b-343c-454d-84a0-4ea8ebb341ec service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:22.855173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cefe2b-343c-454d-84a0-4ea8ebb341ec service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:22.877302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de9e3c9911243ad99ee67b8af4b92bf', 'request_id': 'req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:22.898334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de9e3c9911243ad99ee67b8af4b92bf', 'request_id': 'req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:22.917480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de9e3c9911243ad99ee67b8af4b92bf', 'request_id': 'req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:22.942818 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:22.966676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] The token cache is being invalidate because project 3de9e3c9911243ad99ee67b8af4b92bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:22.967391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:22.969018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-10aeb49f-d346-4c2e-bf35-7cdd6d939f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:22.975687 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3018/5989] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:22 2022] DELETE /identity/v3/projects/3de9e3c9911243ad99ee67b8af4b92bf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:22.981518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3127e17-47de-4901-a62f-0bb8620545eb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:22.982222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3127e17-47de-4901-a62f-0bb8620545eb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:22.982651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3127e17-47de-4901-a62f-0bb8620545eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.006434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.009542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.011334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.011885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints/fd390f03c4a44db9930f7f5a3eeccc72` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.014637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=fd390f03c4a44db9930f7f5a3eeccc72)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:23.018363 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:23.018363 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:12:23.018363 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:12:23.020797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:23.031096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d3127e17-47de-4901-a62f-0bb8620545eb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:23.033329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d3127e17-47de-4901-a62f-0bb8620545eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:23.053171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'fd390f03c4a44db9930f7f5a3eeccc72', 'request_id': 'req-3deb4fc0-2406-4074-bf82-4b6dd7a92854'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:23.073536 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2972/5990] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:22 2022] DELETE /identity/v3/endpoints/fd390f03c4a44db9930f7f5a3eeccc72 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:23.078195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:23.082196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:23.132061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb4fc0-2406-4074-bf82-4b6dd7a92854 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:23.140558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0b999-87e6-4ec3-aa88-4eb5aeebdf3e tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.141579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0b999-87e6-4ec3-aa88-4eb5aeebdf3e tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.142097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0b999-87e6-4ec3-aa88-4eb5aeebdf3e tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.142624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0b999-87e6-4ec3-aa88-4eb5aeebdf3e tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.144332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0b999-87e6-4ec3-aa88-4eb5aeebdf3e tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:23.147352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0b999-87e6-4ec3-aa88-4eb5aeebdf3e tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:23.184755 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2973/5991] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Oct 19 01:12:23 2022] GET /identity/v3/endpoints => generated 4049 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:23.185988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0b999-87e6-4ec3-aa88-4eb5aeebdf3e tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:23.227713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0b999-87e6-4ec3-aa88-4eb5aeebdf3e tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:23.237500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3f9d6-c0e3-4b85-89e2-24f812ac5a39 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.238605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3f9d6-c0e3-4b85-89e2-24f812ac5a39 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.239126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3f9d6-c0e3-4b85-89e2-24f812ac5a39 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.240384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3f9d6-c0e3-4b85-89e2-24f812ac5a39 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints/fd390f03c4a44db9930f7f5a3eeccc72` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.247704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3f9d6-c0e3-4b85-89e2-24f812ac5a39 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-01a3f9d6-c0e3-4b85-89e2-24f812ac5a39 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Could not find endpoint: fd390f03c4a44db9930f7f5a3eeccc72.: keystone.exception.EndpointNotFound: Could not find endpoint: fd390f03c4a44db9930f7f5a3eeccc72. Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._iter().one() Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._only_one_row( Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:12:23.288304 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: fd390f03c4a44db9930f7f5a3eeccc72. Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:12:23.290189 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:12:23.293277 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: fd390f03c4a44db9930f7f5a3eeccc72. Oct 19 01:12:23.294245 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:12:23.300727 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2974/5992] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:23 2022] DELETE /identity/v3/endpoints/fd390f03c4a44db9930f7f5a3eeccc72 => generated 114 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:12:23.304703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3f9d6-c0e3-4b85-89e2-24f812ac5a39 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:23.319111 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3019/5993] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3872 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:23.327763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292cf6b-93d5-45f5-a105-8c590090c104 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.328860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292cf6b-93d5-45f5-a105-8c590090c104 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.329270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292cf6b-93d5-45f5-a105-8c590090c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.342508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3f9d6-c0e3-4b85-89e2-24f812ac5a39 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:23.362715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b96b4-a95c-4e58-a2e1-a5c46db98a5d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.363558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b96b4-a95c-4e58-a2e1-a5c46db98a5d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.366299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b96b4-a95c-4e58-a2e1-a5c46db98a5d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.368374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b96b4-a95c-4e58-a2e1-a5c46db98a5d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-1548867684` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.370431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b96b4-a95c-4e58-a2e1-a5c46db98a5d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1548867684)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:23.371063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5292cf6b-93d5-45f5-a105-8c590090c104 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:23.372528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5292cf6b-93d5-45f5-a105-8c590090c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:23.377740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b96b4-a95c-4e58-a2e1-a5c46db98a5d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:23.392606 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3020/5994] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3872 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:12:23.396559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292cf6b-93d5-45f5-a105-8c590090c104 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:23.412662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292cf6b-93d5-45f5-a105-8c590090c104 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:23.426907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856f59-24e1-43d9-9ac8-d0a665c4a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.428553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856f59-24e1-43d9-9ac8-d0a665c4a209 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.429108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856f59-24e1-43d9-9ac8-d0a665c4a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.430238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856f59-24e1-43d9-9ac8-d0a665c4a209 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.433522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856f59-24e1-43d9-9ac8-d0a665c4a209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:23.434192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856f59-24e1-43d9-9ac8-d0a665c4a209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:23.436166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856f59-24e1-43d9-9ac8-d0a665c4a209 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:23.469004 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3021/5995] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:12:23.470891 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2975/5996] 10.222.0.27 () {58 vars in 1209 bytes} [Wed Oct 19 01:12:23 2022] DELETE /identity/v3/regions/tempest-region-1548867684 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:23.476158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856f59-24e1-43d9-9ac8-d0a665c4a209 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:23.477297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b96b4-a95c-4e58-a2e1-a5c46db98a5d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:23.500897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856f59-24e1-43d9-9ac8-d0a665c4a209 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:23.573382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a763-db2a-4b12-8391-9870ca6cc5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.574156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a763-db2a-4b12-8391-9870ca6cc5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.576479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a763-db2a-4b12-8391-9870ca6cc5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.576884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a763-db2a-4b12-8391-9870ca6cc5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.577656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698a763-db2a-4b12-8391-9870ca6cc5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:23.580391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b96b4-a95c-4e58-a2e1-a5c46db98a5d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:23.586327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698a763-db2a-4b12-8391-9870ca6cc5b4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:23.606260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad444a8-9118-47d7-87dd-ed2b7a9d1712 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.607301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad444a8-9118-47d7-87dd-ed2b7a9d1712 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.607832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad444a8-9118-47d7-87dd-ed2b7a9d1712 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.608327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad444a8-9118-47d7-87dd-ed2b7a9d1712 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.609220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad444a8-9118-47d7-87dd-ed2b7a9d1712 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:23.611295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad444a8-9118-47d7-87dd-ed2b7a9d1712 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:23.634299 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2976/5997] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Oct 19 01:12:23 2022] GET /identity/v3/endpoints => generated 4049 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:23.634867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad444a8-9118-47d7-87dd-ed2b7a9d1712 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:23.640443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3ad444a8-9118-47d7-87dd-ed2b7a9d1712 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:23.666098 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3022/5998] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:23 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:23.668286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a763-db2a-4b12-8391-9870ca6cc5b4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:23.673153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad444a8-9118-47d7-87dd-ed2b7a9d1712 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:23.888909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.890397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.890896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.892910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] PATH_INFO: `/v3/projects/2f1401d2f8a84fffa26d8ef55c7ec88f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.896251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1401d2f8a84fffa26d8ef55c7ec88f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:23.903265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:23.907686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a763-db2a-4b12-8391-9870ca6cc5b4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:23.916703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.917353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.917637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.917913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.918714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Adding query filter params (service_id=b90ff62d413946d7afa977cec13b3152) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:23.919023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:23.920243 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:23.920243 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:23.920243 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:23.921298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:23.932702 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3023/5999] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:12:23 2022] GET /identity/v3/endpoints?service_id=b90ff62d413946d7afa977cec13b3152 => generated 502 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:23.935015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:23.948090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb1f13-3e09-4daf-806b-caa16c84f22b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:23.954051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c925b6-b745-44f6-8395-211c57c71fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:23.954748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c925b6-b745-44f6-8395-211c57c71fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:23.955578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c925b6-b745-44f6-8395-211c57c71fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:23.955875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c925b6-b745-44f6-8395-211c57c71fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:23.956730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c925b6-b745-44f6-8395-211c57c71fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:23.959233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c925b6-b745-44f6-8395-211c57c71fe9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:24.000370 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:24.002267 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3024/6000] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:23 2022] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:24.004750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c925b6-b745-44f6-8395-211c57c71fe9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:24.026897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c925b6-b745-44f6-8395-211c57c71fe9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:24.056163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1401d2f8a84fffa26d8ef55c7ec88f', 'request_id': 'req-9e59ef09-644d-441f-a1d0-2ab02404713a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.060663 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:24.073144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1401d2f8a84fffa26d8ef55c7ec88f', 'request_id': 'req-9e59ef09-644d-441f-a1d0-2ab02404713a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.081735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1401d2f8a84fffa26d8ef55c7ec88f', 'request_id': 'req-9e59ef09-644d-441f-a1d0-2ab02404713a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.096486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] The token cache is being invalidate because project 2f1401d2f8a84fffa26d8ef55c7ec88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:24.096862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.098167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.100536 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2977/6001] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:23 2022] DELETE /identity/v3/projects/2f1401d2f8a84fffa26d8ef55c7ec88f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:24.102199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:24.107305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:24.149423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:24.151140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:24.152904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:24.153277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:24.154051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Adding query filter params (service_id=f330c35906964ca1a0b5b56b4cadc339) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:24.157014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:24.158949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:24.175871 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3025/6002] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:12:24 2022] GET /identity/v3/endpoints?service_id=f330c35906964ca1a0b5b56b4cadc339 => generated 504 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:24.177718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:24.181501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:24.207739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59ef09-644d-441f-a1d0-2ab02404713a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:24.215402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7c4b-dda5-4287-b11b-4aa7f6d40da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:24.216280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7c4b-dda5-4287-b11b-4aa7f6d40da3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:24.216853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7c4b-dda5-4287-b11b-4aa7f6d40da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:24.217230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7c4b-dda5-4287-b11b-4aa7f6d40da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:24.218078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd7c4b-dda5-4287-b11b-4aa7f6d40da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:24.220542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd7c4b-dda5-4287-b11b-4aa7f6d40da3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:24.236682 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2978/6003] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:24.241054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986273e7-5474-408d-a500-b4bb2c95e800 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:24.241523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986273e7-5474-408d-a500-b4bb2c95e800 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:24.242005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986273e7-5474-408d-a500-b4bb2c95e800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:24.265900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-986273e7-5474-408d-a500-b4bb2c95e800 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:24.267391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-986273e7-5474-408d-a500-b4bb2c95e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:24.272213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73c8a8-371c-466c-81dd-344eb7316bd5 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:24.278355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:24.279146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:24.279427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:24.279705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] PATH_INFO: `/v3/users/9ee75fabd5c64c2da4858095f3ae1558` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:24.281626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee75fabd5c64c2da4858095f3ae1558)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:24.283869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:24.345152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee75fabd5c64c2da4858095f3ae1558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.363129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee75fabd5c64c2da4858095f3ae1558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.372958 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2979/6004] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3828 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:24.374302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986273e7-5474-408d-a500-b4bb2c95e800 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:24.377231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee75fabd5c64c2da4858095f3ae1558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.379555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-986273e7-5474-408d-a500-b4bb2c95e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:24.392222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee75fabd5c64c2da4858095f3ae1558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.393190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee75fabd5c64c2da4858095f3ae1558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:24.404560 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3026/6005] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:24 2022] DELETE /identity/v3/users/9ee75fabd5c64c2da4858095f3ae1558 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:24.405984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:24.407499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:24.439214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986273e7-5474-408d-a500-b4bb2c95e800 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:24.490007 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:24.514072 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:24.523900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb3d30-20c9-4f60-8ddc-e1f997a089cb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:24.530852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65c119-2ce5-465e-b0fe-2ebed911b4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:24.531972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65c119-2ce5-465e-b0fe-2ebed911b4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:24.532498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65c119-2ce5-465e-b0fe-2ebed911b4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:24.533125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65c119-2ce5-465e-b0fe-2ebed911b4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:24.534028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65c119-2ce5-465e-b0fe-2ebed911b4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:24.536193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65c119-2ce5-465e-b0fe-2ebed911b4f2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:24.550771 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3027/6006] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:24.551999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65c119-2ce5-465e-b0fe-2ebed911b4f2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:24.554202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980079c-9f6d-4e07-8bba-e60df950b77b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:24.554763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6b65c119-2ce5-465e-b0fe-2ebed911b4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:24.556365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980079c-9f6d-4e07-8bba-e60df950b77b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:24.557382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980079c-9f6d-4e07-8bba-e60df950b77b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:24.557901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980079c-9f6d-4e07-8bba-e60df950b77b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:24.558655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980079c-9f6d-4e07-8bba-e60df950b77b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:24.559070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980079c-9f6d-4e07-8bba-e60df950b77b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:24.561389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980079c-9f6d-4e07-8bba-e60df950b77b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:24.575816 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2980/6007] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Oct 19 01:12:24 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:24.577260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980079c-9f6d-4e07-8bba-e60df950b77b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:24.596739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980079c-9f6d-4e07-8bba-e60df950b77b tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:24.603866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320368a-9caf-4db5-92d7-6102d297ba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:24.605168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320368a-9caf-4db5-92d7-6102d297ba76 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:24.605704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320368a-9caf-4db5-92d7-6102d297ba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:24.605998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320368a-9caf-4db5-92d7-6102d297ba76 admin admin] PATH_INFO: `/v3/projects/e43e312fe1784fa3a33e8d73d7855496/users/ba2f1fbe02094d5480ea55ee97c57b34/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:24.626009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320368a-9caf-4db5-92d7-6102d297ba76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43e312fe1784fa3a33e8d73d7855496, user_id=ba2f1fbe02094d5480ea55ee97c57b34, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:24.632077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320368a-9caf-4db5-92d7-6102d297ba76 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:24.663283 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2981/6008] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:24 2022] PUT /identity/v3/projects/e43e312fe1784fa3a33e8d73d7855496/users/ba2f1fbe02094d5480ea55ee97c57b34/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:24.665330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320368a-9caf-4db5-92d7-6102d297ba76 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:24.667392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8320368a-9caf-4db5-92d7-6102d297ba76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:24.786981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65c119-2ce5-465e-b0fe-2ebed911b4f2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:24.906213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320368a-9caf-4db5-92d7-6102d297ba76 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:24.929173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96300fb1-c42f-4641-94b5-2015f02e9cdf tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:24.930687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96300fb1-c42f-4641-94b5-2015f02e9cdf tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:24.932596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96300fb1-c42f-4641-94b5-2015f02e9cdf tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:24.933724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96300fb1-c42f-4641-94b5-2015f02e9cdf tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:24.934421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96300fb1-c42f-4641-94b5-2015f02e9cdf tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:24.934733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96300fb1-c42f-4641-94b5-2015f02e9cdf tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:24.939156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96300fb1-c42f-4641-94b5-2015f02e9cdf tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:24.956108 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2982/6009] 10.222.0.27 () {58 vars in 1171 bytes} [Wed Oct 19 01:12:24 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:24.956991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b23dd-5b7e-40c1-a41a-135b460130f8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:24.958927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b23dd-5b7e-40c1-a41a-135b460130f8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:24.959192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b23dd-5b7e-40c1-a41a-135b460130f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:25.003024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1e8b23dd-5b7e-40c1-a41a-135b460130f8 None None] MFA Rules not processed for user `ba2f1fbe02094d5480ea55ee97c57b34`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:25.004199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e8b23dd-5b7e-40c1-a41a-135b460130f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:25.010400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6d312-4504-41c0-99ce-536688641a82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:25.011279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6d312-4504-41c0-99ce-536688641a82 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:25.012904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6d312-4504-41c0-99ce-536688641a82 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:25.014007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6d312-4504-41c0-99ce-536688641a82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:25.019684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-64d6d312-4504-41c0-99ce-536688641a82 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:25.157917 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2983/6010] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3875 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:25.160231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b23dd-5b7e-40c1-a41a-135b460130f8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:25.163112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1e8b23dd-5b7e-40c1-a41a-135b460130f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:25.174565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6d312-4504-41c0-99ce-536688641a82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:25.177725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6d312-4504-41c0-99ce-536688641a82 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:25.189870 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3028/6011] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:12:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:12:25.203482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6d312-4504-41c0-99ce-536688641a82 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:25.243761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6d312-4504-41c0-99ce-536688641a82 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:25.259391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed0b0f-4aaa-4de7-96d9-2898aaca76d6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:25.261488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed0b0f-4aaa-4de7-96d9-2898aaca76d6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:25.261779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed0b0f-4aaa-4de7-96d9-2898aaca76d6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:25.262100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed0b0f-4aaa-4de7-96d9-2898aaca76d6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:25.262768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed0b0f-4aaa-4de7-96d9-2898aaca76d6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:25.267445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed0b0f-4aaa-4de7-96d9-2898aaca76d6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:25.278085 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:25.297701 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3029/6012] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:25 2022] POST /identity/v3/services => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:25.302878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed0b0f-4aaa-4de7-96d9-2898aaca76d6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:25.358303 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:25.495876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b23dd-5b7e-40c1-a41a-135b460130f8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:25.513219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed0b0f-4aaa-4de7-96d9-2898aaca76d6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:25.525526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f50a3b-95b0-416c-926f-4bc0f04748cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:25.526443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f50a3b-95b0-416c-926f-4bc0f04748cb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:25.526874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f50a3b-95b0-416c-926f-4bc0f04748cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:25.527315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f50a3b-95b0-416c-926f-4bc0f04748cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:25.528134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f50a3b-95b0-416c-926f-4bc0f04748cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:25.534017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f50a3b-95b0-416c-926f-4bc0f04748cb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:25.564957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:25.565623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:25.565913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:25.566199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] PATH_INFO: `/v3/projects/5545bd3647014270906fc2a93c995b87` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:25.575060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5545bd3647014270906fc2a93c995b87)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:25.582198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:25.607111 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3030/6013] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:25 2022] POST /identity/v3/projects => generated 365 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:25.609587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f50a3b-95b0-416c-926f-4bc0f04748cb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:25.678233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5545bd3647014270906fc2a93c995b87', 'request_id': 'req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:25.695556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5545bd3647014270906fc2a93c995b87', 'request_id': 'req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:25.706167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5545bd3647014270906fc2a93c995b87', 'request_id': 'req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:25.734004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] The token cache is being invalidate because project 5545bd3647014270906fc2a93c995b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:25.734195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:25.735017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:25.741935 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2984/6014] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:25 2022] DELETE /identity/v3/projects/5545bd3647014270906fc2a93c995b87 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:25.741935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:25.741935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:25.791804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f50a3b-95b0-416c-926f-4bc0f04748cb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:25.884234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9b0ba-722e-4b15-a012-1bc0bc61cac2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:25.890966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc36c-4150-4112-b260-d3b02cd5b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:25.891800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc36c-4150-4112-b260-d3b02cd5b077 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:25.892286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc36c-4150-4112-b260-d3b02cd5b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:25.892930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc36c-4150-4112-b260-d3b02cd5b077 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:25.893808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccc36c-4150-4112-b260-d3b02cd5b077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:25.896324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccc36c-4150-4112-b260-d3b02cd5b077 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:25.931054 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2985/6015] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:25 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:25.933756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c765-9d3d-4367-8637-ef6bf4edda35 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:25.934377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c765-9d3d-4367-8637-ef6bf4edda35 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:25.934874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c765-9d3d-4367-8637-ef6bf4edda35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:25.964696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6ea98-7aa0-4e42-9113-d46e3abb1a45 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:25.965963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6ea98-7aa0-4e42-9113-d46e3abb1a45 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:25.966085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6ea98-7aa0-4e42-9113-d46e3abb1a45 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:25.966490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6ea98-7aa0-4e42-9113-d46e3abb1a45 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:25.967371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6ea98-7aa0-4e42-9113-d46e3abb1a45 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:25.969356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6ea98-7aa0-4e42-9113-d46e3abb1a45 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:25.972816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1aa0c765-9d3d-4367-8637-ef6bf4edda35 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:25.976460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1aa0c765-9d3d-4367-8637-ef6bf4edda35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:25.987068 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:26.003892 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-7ba6ea98-7aa0-4e42-9113-d46e3abb1a45 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-105830736. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:12:26.003892 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:12:26.003892 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:26.004249 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2986/6016] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:25 2022] POST /identity/v3/auth/tokens => generated 4005 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:26.004249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c51b2c-1c4d-4a7f-9f95-57956e9f7076 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.004249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c51b2c-1c4d-4a7f-9f95-57956e9f7076 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.004249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c51b2c-1c4d-4a7f-9f95-57956e9f7076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.033665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-01c51b2c-1c4d-4a7f-9f95-57956e9f7076 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:26.035220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-01c51b2c-1c4d-4a7f-9f95-57956e9f7076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:26.043777 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3031/6017] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 01:12:25 2022] POST /identity/v3/endpoints => generated 359 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:26.044956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6ea98-7aa0-4e42-9113-d46e3abb1a45 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.073537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6ea98-7aa0-4e42-9113-d46e3abb1a45 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.078893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5db41-99d5-4e9d-9335-589f6a650879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.079776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5db41-99d5-4e9d-9335-589f6a650879 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.080057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5db41-99d5-4e9d-9335-589f6a650879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.080334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5db41-99d5-4e9d-9335-589f6a650879 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.081148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5db41-99d5-4e9d-9335-589f6a650879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.082751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5db41-99d5-4e9d-9335-589f6a650879 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.099131 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3032/6018] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:26.106214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8c6ac-241d-498a-8c61-cf896d4a6cbe None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.106494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8c6ac-241d-498a-8c61-cf896d4a6cbe None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.106765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8c6ac-241d-498a-8c61-cf896d4a6cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.112666 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:26.131574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2bc8c6ac-241d-498a-8c61-cf896d4a6cbe None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:26.133619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2bc8c6ac-241d-498a-8c61-cf896d4a6cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:26.142452 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3033/6019] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:26 2022] POST /identity/v3/auth/tokens => generated 4188 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:26.143447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8c6ac-241d-498a-8c61-cf896d4a6cbe None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.144517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2bc8c6ac-241d-498a-8c61-cf896d4a6cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:26.148971 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2987/6020] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:12:26 2022] POST /identity/v3/auth/tokens => generated 4144 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:26.150121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c51b2c-1c4d-4a7f-9f95-57956e9f7076 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.173999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c51b2c-1c4d-4a7f-9f95-57956e9f7076 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.180518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e742e-a7fd-4440-bd22-e64876e25df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.181491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e742e-a7fd-4440-bd22-e64876e25df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.186321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e742e-a7fd-4440-bd22-e64876e25df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.187674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e742e-a7fd-4440-bd22-e64876e25df4 admin admin] PATH_INFO: `/v3/projects/6ad6f56334b7425ca161891119e7c161/users/da4ddb6b5cb8400ab4b461f40bd27b75/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.188184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8c6ac-241d-498a-8c61-cf896d4a6cbe None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.202672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60c15-0287-4882-b300-0532b56a3242 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.203340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60c15-0287-4882-b300-0532b56a3242 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.203622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60c15-0287-4882-b300-0532b56a3242 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.203900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60c15-0287-4882-b300-0532b56a3242 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-105830736` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.204532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b60c15-0287-4882-b300-0532b56a3242 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-105830736)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.205837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b60c15-0287-4882-b300-0532b56a3242 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.209725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e742e-a7fd-4440-bd22-e64876e25df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad6f56334b7425ca161891119e7c161, user_id=da4ddb6b5cb8400ab4b461f40bd27b75, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.214561 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3034/6021] 10.222.0.27 () {58 vars in 1203 bytes} [Wed Oct 19 01:12:26 2022] GET /identity/v3/regions/tempest-region-105830736 => generated 178 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:26.215036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e742e-a7fd-4440-bd22-e64876e25df4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.218444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60c15-0287-4882-b300-0532b56a3242 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.232165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60c15-0287-4882-b300-0532b56a3242 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.238373 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2988/6022] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:26 2022] PUT /identity/v3/projects/6ad6f56334b7425ca161891119e7c161/users/da4ddb6b5cb8400ab4b461f40bd27b75/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:26.239875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e742e-a7fd-4440-bd22-e64876e25df4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.242429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9c4e742e-a7fd-4440-bd22-e64876e25df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:26.308026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33063f5-4236-4b00-8176-4048dbaa2219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.309031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33063f5-4236-4b00-8176-4048dbaa2219 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.309903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33063f5-4236-4b00-8176-4048dbaa2219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.310266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33063f5-4236-4b00-8176-4048dbaa2219 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.311196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33063f5-4236-4b00-8176-4048dbaa2219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:26.311502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33063f5-4236-4b00-8176-4048dbaa2219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.313995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33063f5-4236-4b00-8176-4048dbaa2219 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.331360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3035/6023] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:26.331360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33063f5-4236-4b00-8176-4048dbaa2219 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.367462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e742e-a7fd-4440-bd22-e64876e25df4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.376061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f1307-ace3-42bb-9c37-6d05fe9faa1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.377072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f1307-ace3-42bb-9c37-6d05fe9faa1f service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.377518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f1307-ace3-42bb-9c37-6d05fe9faa1f service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.377956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f1307-ace3-42bb-9c37-6d05fe9faa1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.406566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33063f5-4236-4b00-8176-4048dbaa2219 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.411493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.412258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.412603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.413005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints/8b56562ad24847748e26e649afc8a89d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.424903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=8b56562ad24847748e26e649afc8a89d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.426284 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:26.426284 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:26.426284 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:26.427895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.452312 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1905810276. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:12:26.452312 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:12:26.452312 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:26.484502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f1307-ace3-42bb-9c37-6d05fe9faa1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.486317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f1307-ace3-42bb-9c37-6d05fe9faa1f service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.499750 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2989/6024] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:12:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:12:26.501111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f1307-ace3-42bb-9c37-6d05fe9faa1f service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.510433 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:26.522962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f1307-ace3-42bb-9c37-6d05fe9faa1f service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.524804 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3036/6025] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 01:12:26 2022] PATCH /identity/v3/endpoints/8b56562ad24847748e26e649afc8a89d => generated 364 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:26.525677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.550763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86a062-d3b4-4e63-99ec-4d8f01b406e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.552157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86a062-d3b4-4e63-99ec-4d8f01b406e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.552841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86a062-d3b4-4e63-99ec-4d8f01b406e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.553355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86a062-d3b4-4e63-99ec-4d8f01b406e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.554118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84601861-379d-490d-8932-786926f6f985 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.555218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86a062-d3b4-4e63-99ec-4d8f01b406e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.557618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86a062-d3b4-4e63-99ec-4d8f01b406e1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.568051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4ab7e-fe07-4f8a-9253-5d62398fcb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.568664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4ab7e-fe07-4f8a-9253-5d62398fcb78 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.568952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4ab7e-fe07-4f8a-9253-5d62398fcb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.569228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4ab7e-fe07-4f8a-9253-5d62398fcb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.569876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4ab7e-fe07-4f8a-9253-5d62398fcb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.572238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4ab7e-fe07-4f8a-9253-5d62398fcb78 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.585140 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2990/6026] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:26.588590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86a062-d3b4-4e63-99ec-4d8f01b406e1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.642011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86a062-d3b4-4e63-99ec-4d8f01b406e1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.651249 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3037/6027] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:26 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:26.651853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156901e8-4920-4744-9c35-a74aef7de080 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.652107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4ab7e-fe07-4f8a-9253-5d62398fcb78 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.652667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156901e8-4920-4744-9c35-a74aef7de080 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.653059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156901e8-4920-4744-9c35-a74aef7de080 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.653346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156901e8-4920-4744-9c35-a74aef7de080 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-1905810276` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.653949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156901e8-4920-4744-9c35-a74aef7de080 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1905810276)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.657685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156901e8-4920-4744-9c35-a74aef7de080 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.660646 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2991/6028] 10.222.0.27 () {58 vars in 1206 bytes} [Wed Oct 19 01:12:26 2022] GET /identity/v3/regions/tempest-region-1905810276 => generated 180 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:26.661353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156901e8-4920-4744-9c35-a74aef7de080 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.691379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156901e8-4920-4744-9c35-a74aef7de080 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.710234 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:26.785299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a875c-2a3e-46f4-ae5e-58413129ed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.786130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a875c-2a3e-46f4-ae5e-58413129ed74 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.786482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a875c-2a3e-46f4-ae5e-58413129ed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.786674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a875c-2a3e-46f4-ae5e-58413129ed74 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.787313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a875c-2a3e-46f4-ae5e-58413129ed74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.789902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a875c-2a3e-46f4-ae5e-58413129ed74 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.797310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4ab7e-fe07-4f8a-9253-5d62398fcb78 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.805057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71740f7-000e-4133-9268-6e13118a72eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.806111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71740f7-000e-4133-9268-6e13118a72eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.806623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71740f7-000e-4133-9268-6e13118a72eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.807119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71740f7-000e-4133-9268-6e13118a72eb admin admin] PATH_INFO: `/v3/projects/6ad6f56334b7425ca161891119e7c161/users/da4ddb6b5cb8400ab4b461f40bd27b75/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.810565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71740f7-000e-4133-9268-6e13118a72eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad6f56334b7425ca161891119e7c161, user_id=da4ddb6b5cb8400ab4b461f40bd27b75, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.814236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71740f7-000e-4133-9268-6e13118a72eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.841154 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3038/6029] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:26 2022] PUT /identity/v3/projects/6ad6f56334b7425ca161891119e7c161/users/da4ddb6b5cb8400ab4b461f40bd27b75/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:26.841154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71740f7-000e-4133-9268-6e13118a72eb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.841444 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2992/6030] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:26 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:26.841444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a875c-2a3e-46f4-ae5e-58413129ed74 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:26.855824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a875c-2a3e-46f4-ae5e-58413129ed74 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.935790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c9958-8a24-4773-8bdf-275c4843a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:26.937071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c9958-8a24-4773-8bdf-275c4843a731 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.937358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c9958-8a24-4773-8bdf-275c4843a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.937634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c9958-8a24-4773-8bdf-275c4843a731 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.938426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c9958-8a24-4773-8bdf-275c4843a731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:26.940740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c9958-8a24-4773-8bdf-275c4843a731 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:26.957767 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2993/6031] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:26.957976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc8d84-1ed1-40c8-b268-699dab7c12cb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:26.958156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc8d84-1ed1-40c8-b268-699dab7c12cb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:26.958436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc8d84-1ed1-40c8-b268-699dab7c12cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:26.973473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71740f7-000e-4133-9268-6e13118a72eb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:26.995751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-15bc8d84-1ed1-40c8-b268-699dab7c12cb None None] MFA Rules not processed for user `da4ddb6b5cb8400ab4b461f40bd27b75`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:26.997084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-15bc8d84-1ed1-40c8-b268-699dab7c12cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:27.002142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:27.005738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:27.008882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:27.011405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints/8b56562ad24847748e26e649afc8a89d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:27.027149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8b56562ad24847748e26e649afc8a89d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:27.028268 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:27.028268 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:12:27.028268 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:27.030429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:27.060645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8b56562ad24847748e26e649afc8a89d', 'request_id': 'req-63f94cdd-6b67-4587-8ce6-18be48422c24'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:27.070970 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3039/6032] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:26 2022] DELETE /identity/v3/endpoints/8b56562ad24847748e26e649afc8a89d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:27.072425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:27.093571 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2994/6033] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:26 2022] POST /identity/v3/auth/tokens => generated 4075 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:27.095845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc8d84-1ed1-40c8-b268-699dab7c12cb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:27.122196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f94cdd-6b67-4587-8ce6-18be48422c24 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:27.135262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72ddae-e6b5-436f-ba01-2ce93acb5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:27.135985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72ddae-e6b5-436f-ba01-2ce93acb5c2d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:27.136423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72ddae-e6b5-436f-ba01-2ce93acb5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:27.136797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72ddae-e6b5-436f-ba01-2ce93acb5c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:27.137532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72ddae-e6b5-436f-ba01-2ce93acb5c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:27.140435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72ddae-e6b5-436f-ba01-2ce93acb5c2d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:27.149211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc8d84-1ed1-40c8-b268-699dab7c12cb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:27.163539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b62695-0740-4c9b-b2f3-1f431cf1bcf6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:27.164350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62695-0740-4c9b-b2f3-1f431cf1bcf6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:27.164911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62695-0740-4c9b-b2f3-1f431cf1bcf6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:27.165200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62695-0740-4c9b-b2f3-1f431cf1bcf6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-1905810276` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:27.168592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b62695-0740-4c9b-b2f3-1f431cf1bcf6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1905810276)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:27.169418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3040/6034] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:27.171025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72ddae-e6b5-436f-ba01-2ce93acb5c2d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:27.172155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b62695-0740-4c9b-b2f3-1f431cf1bcf6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:27.175163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab72ddae-e6b5-436f-ba01-2ce93acb5c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:27.200712 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-79b62695-0740-4c9b-b2f3-1f431cf1bcf6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1905810276. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:12:27.200712 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:12:27.200712 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:12:27.202014 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:27.220119 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2995/6035] 10.222.0.27 () {58 vars in 1209 bytes} [Wed Oct 19 01:12:27 2022] DELETE /identity/v3/regions/tempest-region-1905810276 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:27.221143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b62695-0740-4c9b-b2f3-1f431cf1bcf6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:27.251353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b62695-0740-4c9b-b2f3-1f431cf1bcf6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:27.256824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe697-46bc-417d-beab-63c822ce632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:27.258154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe697-46bc-417d-beab-63c822ce632b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:27.258438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe697-46bc-417d-beab-63c822ce632b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:27.258722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe697-46bc-417d-beab-63c822ce632b admin admin] PATH_INFO: `/v3/projects/592bc25d96fe4bcab4b256303e5de3b0/users/2f5f269893ea4a8c836ad30e97029059/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:27.280719 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:27.289301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe697-46bc-417d-beab-63c822ce632b admin admin] RBAC: Authorizing `identity:create_grant(project_id=592bc25d96fe4bcab4b256303e5de3b0, user_id=2f5f269893ea4a8c836ad30e97029059, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:27.294481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe697-46bc-417d-beab-63c822ce632b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:27.323684 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2996/6036] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:27 2022] PUT /identity/v3/projects/592bc25d96fe4bcab4b256303e5de3b0/users/2f5f269893ea4a8c836ad30e97029059/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:27.334849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe697-46bc-417d-beab-63c822ce632b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:27.363541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72ddae-e6b5-436f-ba01-2ce93acb5c2d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:27.478016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe697-46bc-417d-beab-63c822ce632b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:27.483149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2c95a-6137-45ce-b769-8fdf8b7b758d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:27.483793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c95a-6137-45ce-b769-8fdf8b7b758d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:27.484078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c95a-6137-45ce-b769-8fdf8b7b758d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:27.484360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c95a-6137-45ce-b769-8fdf8b7b758d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-105830736` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:27.485018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2c95a-6137-45ce-b769-8fdf8b7b758d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-105830736)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:27.485675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b29c3-a91b-4a23-bac3-6ca4a3bf2216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:27.486297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b29c3-a91b-4a23-bac3-6ca4a3bf2216 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:27.486577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b29c3-a91b-4a23-bac3-6ca4a3bf2216 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:27.486880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2c95a-6137-45ce-b769-8fdf8b7b758d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:27.486998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b29c3-a91b-4a23-bac3-6ca4a3bf2216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:27.502491 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-09f2c95a-6137-45ce-b769-8fdf8b7b758d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-105830736. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:12:27.502491 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:12:27.502491 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:12:27.526840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2997/6037] 10.222.0.27 () {58 vars in 1206 bytes} [Wed Oct 19 01:12:27 2022] DELETE /identity/v3/regions/tempest-region-105830736 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:27.530799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdcb8d-d9ab-4240-b3cd-ff498b0ea922 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:27.531136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdcb8d-d9ab-4240-b3cd-ff498b0ea922 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:27.532441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdcb8d-d9ab-4240-b3cd-ff498b0ea922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:27.616051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-56bdcb8d-d9ab-4240-b3cd-ff498b0ea922 None None] MFA Rules not processed for user `2f5f269893ea4a8c836ad30e97029059`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:27.619234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-56bdcb8d-d9ab-4240-b3cd-ff498b0ea922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:27.662101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b29c3-a91b-4a23-bac3-6ca4a3bf2216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:27.664337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b29c3-a91b-4a23-bac3-6ca4a3bf2216 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:27.703263 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3041/6038] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:27 2022] GET /identity/v3/auth/tokens => generated 4075 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:27.704143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b29c3-a91b-4a23-bac3-6ca4a3bf2216 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:27.735605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b29c3-a91b-4a23-bac3-6ca4a3bf2216 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:27.769785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323049-f88c-42f1-83b1-270527c3ac9d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:27.771286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323049-f88c-42f1-83b1-270527c3ac9d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:27.771570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323049-f88c-42f1-83b1-270527c3ac9d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:27.771850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da323049-f88c-42f1-83b1-270527c3ac9d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/services/db0c837cae7147c1bde5d247875ca8d5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:27.772446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da323049-f88c-42f1-83b1-270527c3ac9d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_service(service_id=db0c837cae7147c1bde5d247875ca8d5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:27.774449 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2998/6039] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:27 2022] POST /identity/v3/auth/tokens => generated 4020 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:27.781994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdcb8d-d9ab-4240-b3cd-ff498b0ea922 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:27.786521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da323049-f88c-42f1-83b1-270527c3ac9d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:27.877161 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3042/6040] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:27 2022] DELETE /identity/v3/services/db0c837cae7147c1bde5d247875ca8d5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:27.884861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323049-f88c-42f1-83b1-270527c3ac9d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:27.907139 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:27.954192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da323049-f88c-42f1-83b1-270527c3ac9d tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:27.959733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56590-41f8-4ba1-b94d-f0b53119fee4 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:27.961357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56590-41f8-4ba1-b94d-f0b53119fee4 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:27.961912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56590-41f8-4ba1-b94d-f0b53119fee4 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:27.962507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56590-41f8-4ba1-b94d-f0b53119fee4 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints/3f48005f620848979a31455ccbc53d67` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:27.968545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56590-41f8-4ba1-b94d-f0b53119fee4 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=3f48005f620848979a31455ccbc53d67)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:27.970789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56590-41f8-4ba1-b94d-f0b53119fee4 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:27.985732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1eb56590-41f8-4ba1-b94d-f0b53119fee4 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '3f48005f620848979a31455ccbc53d67', 'request_id': 'req-1eb56590-41f8-4ba1-b94d-f0b53119fee4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:28.010939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdcb8d-d9ab-4240-b3cd-ff498b0ea922 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:28.024501 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3043/6041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:27 2022] DELETE /identity/v3/endpoints/3f48005f620848979a31455ccbc53d67 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:28.028072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56590-41f8-4ba1-b94d-f0b53119fee4 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:28.072336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bdcb8-79f3-472c-910b-c50c8cebabb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:28.073039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bdcb8-79f3-472c-910b-c50c8cebabb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:28.073361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bdcb8-79f3-472c-910b-c50c8cebabb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:28.073646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bdcb8-79f3-472c-910b-c50c8cebabb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:28.074278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bdcb8-79f3-472c-910b-c50c8cebabb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:28.077652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bdcb8-79f3-472c-910b-c50c8cebabb0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:28.103314 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:28.121617 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 2999/6042] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:27 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:28.121617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bdcb8-79f3-472c-910b-c50c8cebabb0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:28.136856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56590-41f8-4ba1-b94d-f0b53119fee4 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:28.246831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bdcb8-79f3-472c-910b-c50c8cebabb0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:28.265026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f9089-986a-472b-a2ac-05d4b4a2b11f tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:28.265515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f9089-986a-472b-a2ac-05d4b4a2b11f tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:28.265802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f9089-986a-472b-a2ac-05d4b4a2b11f tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:28.269322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f9089-986a-472b-a2ac-05d4b4a2b11f tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-1610861741` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:28.270162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f9089-986a-472b-a2ac-05d4b4a2b11f tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1610861741)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:28.272029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f9089-986a-472b-a2ac-05d4b4a2b11f tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:28.286675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf94f-6f31-4bfe-9d4b-c2f79c4e3fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:28.288115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf94f-6f31-4bfe-9d4b-c2f79c4e3fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:28.288973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf94f-6f31-4bfe-9d4b-c2f79c4e3fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:28.289721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf94f-6f31-4bfe-9d4b-c2f79c4e3fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:28.293749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d13bf94f-6f31-4bfe-9d4b-c2f79c4e3fa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:28.311136 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3000/6043] 10.222.0.27 () {58 vars in 1209 bytes} [Wed Oct 19 01:12:28 2022] DELETE /identity/v3/regions/tempest-region-1610861741 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:28.314415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f9089-986a-472b-a2ac-05d4b4a2b11f tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:28.496387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bf94f-6f31-4bfe-9d4b-c2f79c4e3fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:28.509426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bf94f-6f31-4bfe-9d4b-c2f79c4e3fa9 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:28.583602 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3044/6044] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:28 2022] GET /identity/v3/auth/tokens => generated 3691 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:28.584634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf94f-6f31-4bfe-9d4b-c2f79c4e3fa9 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:28.612970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf94f-6f31-4bfe-9d4b-c2f79c4e3fa9 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:28.613641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f9089-986a-472b-a2ac-05d4b4a2b11f tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:28.630854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d62c-970b-4b78-afed-a4fb05b71a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:28.631919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d62c-970b-4b78-afed-a4fb05b71a00 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:28.632440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d62c-970b-4b78-afed-a4fb05b71a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:28.633186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d62c-970b-4b78-afed-a4fb05b71a00 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:28.633997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68d62c-970b-4b78-afed-a4fb05b71a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:28.638765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68d62c-970b-4b78-afed-a4fb05b71a00 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:28.671616 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:28.671840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f14dd-9320-49bb-921f-4287e845e426 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:28.672590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f14dd-9320-49bb-921f-4287e845e426 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:28.673011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f14dd-9320-49bb-921f-4287e845e426 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:28.673420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f14dd-9320-49bb-921f-4287e845e426 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/services/f330c35906964ca1a0b5b56b4cadc339` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:28.675712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f14dd-9320-49bb-921f-4287e845e426 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f330c35906964ca1a0b5b56b4cadc339)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:28.679000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f14dd-9320-49bb-921f-4287e845e426 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:28.696652 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3001/6045] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:28 2022] POST /identity/v3/users => generated 295 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:28.699920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d62c-970b-4b78-afed-a4fb05b71a00 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:28.731796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d62c-970b-4b78-afed-a4fb05b71a00 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:28.752214 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3045/6046] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:28 2022] DELETE /identity/v3/services/f330c35906964ca1a0b5b56b4cadc339 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:28.753371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f14dd-9320-49bb-921f-4287e845e426 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:28.780812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f14dd-9320-49bb-921f-4287e845e426 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:28.787503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53553880-f329-4e2c-b3cb-3f976736db78 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:28.788363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553880-f329-4e2c-b3cb-3f976736db78 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:28.789341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553880-f329-4e2c-b3cb-3f976736db78 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:28.789728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553880-f329-4e2c-b3cb-3f976736db78 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/endpoints/8d26f9f5dad048d087addaa3cd0edd12` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:28.790679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c016c61-b309-4c36-be32-f043850cc7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:28.791317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c016c61-b309-4c36-be32-f043850cc7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:28.791606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c016c61-b309-4c36-be32-f043850cc7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:28.791885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c016c61-b309-4c36-be32-f043850cc7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:28.792544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c016c61-b309-4c36-be32-f043850cc7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:28.794205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c016c61-b309-4c36-be32-f043850cc7e4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:28.797463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53553880-f329-4e2c-b3cb-3f976736db78 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8d26f9f5dad048d087addaa3cd0edd12)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:28.799579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53553880-f329-4e2c-b3cb-3f976736db78 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:28.812535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-53553880-f329-4e2c-b3cb-3f976736db78 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8d26f9f5dad048d087addaa3cd0edd12', 'request_id': 'req-53553880-f329-4e2c-b3cb-3f976736db78'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:28.832346 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3002/6047] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:28.833371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c016c61-b309-4c36-be32-f043850cc7e4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:28.849771 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3046/6048] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:28 2022] DELETE /identity/v3/endpoints/8d26f9f5dad048d087addaa3cd0edd12 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:28.855207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53553880-f329-4e2c-b3cb-3f976736db78 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:28.856389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c016c61-b309-4c36-be32-f043850cc7e4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:28.895622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7bc65-8b19-44c5-b400-d98d6902985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:28.896306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7bc65-8b19-44c5-b400-d98d6902985d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:28.896588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7bc65-8b19-44c5-b400-d98d6902985d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:28.898707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7bc65-8b19-44c5-b400-d98d6902985d admin admin] PATH_INFO: `/v3/projects/7b818f6d34c0453f9eeacbe7eabdf475/users/aa5f82e0c2ba43d7b8585818b4ed4351/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:28.909373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53553880-f329-4e2c-b3cb-3f976736db78 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:28.936021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fa70d-7df6-4302-b066-bbbed6be8f97 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:28.938647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fa70d-7df6-4302-b066-bbbed6be8f97 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:28.938647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fa70d-7df6-4302-b066-bbbed6be8f97 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:28.938647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fa70d-7df6-4302-b066-bbbed6be8f97 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/regions/tempest-region-2013189743` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:28.939169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fa70d-7df6-4302-b066-bbbed6be8f97 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2013189743)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:28.940833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fa70d-7df6-4302-b066-bbbed6be8f97 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:28.954369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7bc65-8b19-44c5-b400-d98d6902985d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b818f6d34c0453f9eeacbe7eabdf475, user_id=aa5f82e0c2ba43d7b8585818b4ed4351, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:28.957116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7bc65-8b19-44c5-b400-d98d6902985d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:28.998697 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3003/6049] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:28 2022] PUT /identity/v3/projects/7b818f6d34c0453f9eeacbe7eabdf475/users/aa5f82e0c2ba43d7b8585818b4ed4351/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:29.001116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7bc65-8b19-44c5-b400-d98d6902985d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:29.001554 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3047/6050] 10.222.0.27 () {58 vars in 1209 bytes} [Wed Oct 19 01:12:28 2022] DELETE /identity/v3/regions/tempest-region-2013189743 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:29.006013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fa70d-7df6-4302-b066-bbbed6be8f97 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:29.034650 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:29.077541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fa70d-7df6-4302-b066-bbbed6be8f97 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:29.258833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7bc65-8b19-44c5-b400-d98d6902985d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:29.287457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4851c7-db17-4222-9f2e-5bb410602bd6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975616c47625445c91f114e745a25b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389c64f02f0e42a1bde5ec433eca095c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:29.294417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4851c7-db17-4222-9f2e-5bb410602bd6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:29.294894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4851c7-db17-4222-9f2e-5bb410602bd6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:29.295253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4851c7-db17-4222-9f2e-5bb410602bd6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] PATH_INFO: `/v3/services/b90ff62d413946d7afa977cec13b3152` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:29.296032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4851c7-db17-4222-9f2e-5bb410602bd6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b90ff62d413946d7afa977cec13b3152)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:29.300993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4851c7-db17-4222-9f2e-5bb410602bd6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:29.344665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073122e1-7e72-440a-9155-41482665f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:29.345797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073122e1-7e72-440a-9155-41482665f18f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:29.346303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073122e1-7e72-440a-9155-41482665f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:29.346732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073122e1-7e72-440a-9155-41482665f18f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:29.347794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073122e1-7e72-440a-9155-41482665f18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:29.353140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073122e1-7e72-440a-9155-41482665f18f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:29.377941 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3048/6051] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:29 2022] DELETE /identity/v3/services/b90ff62d413946d7afa977cec13b3152 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:29.380466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4851c7-db17-4222-9f2e-5bb410602bd6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:29.382248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d4851c7-db17-4222-9f2e-5bb410602bd6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:29.387626 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3004/6052] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:29.392520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073122e1-7e72-440a-9155-41482665f18f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:29.424502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073122e1-7e72-440a-9155-41482665f18f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:29.458263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4851c7-db17-4222-9f2e-5bb410602bd6 tempest-EndPointsTestJSON-351511000 tempest-EndPointsTestJSON-351511000-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:29.465969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995c5d3-f8a4-429b-8a3f-ab56ffac7184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:29.467851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c5d3-f8a4-429b-8a3f-ab56ffac7184 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:29.468179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c5d3-f8a4-429b-8a3f-ab56ffac7184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:29.468594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c5d3-f8a4-429b-8a3f-ab56ffac7184 admin admin] PATH_INFO: `/v3/projects/7b818f6d34c0453f9eeacbe7eabdf475/users/aa5f82e0c2ba43d7b8585818b4ed4351/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:29.471069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995c5d3-f8a4-429b-8a3f-ab56ffac7184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b818f6d34c0453f9eeacbe7eabdf475, user_id=aa5f82e0c2ba43d7b8585818b4ed4351, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:29.483748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995c5d3-f8a4-429b-8a3f-ab56ffac7184 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:29.488900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:29.489575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:29.489962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:29.490242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] PATH_INFO: `/v3/users/fb4ab55969ca40e1bbfdc90f93ddc3bf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:29.500357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4ab55969ca40e1bbfdc90f93ddc3bf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:29.503947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:29.512912 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3005/6053] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:29 2022] PUT /identity/v3/projects/7b818f6d34c0453f9eeacbe7eabdf475/users/aa5f82e0c2ba43d7b8585818b4ed4351/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:29.530687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb7d44-b34e-466a-bf46-a4520375c6fc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:29.530977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb7d44-b34e-466a-bf46-a4520375c6fc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:29.531255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb7d44-b34e-466a-bf46-a4520375c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:29.591956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4ddb7d44-b34e-466a-bf46-a4520375c6fc None None] MFA Rules not processed for user `aa5f82e0c2ba43d7b8585818b4ed4351`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:29.593568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4ddb7d44-b34e-466a-bf46-a4520375c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:29.675885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4ab55969ca40e1bbfdc90f93ddc3bf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:29.704891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4ab55969ca40e1bbfdc90f93ddc3bf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:29.718613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4ab55969ca40e1bbfdc90f93ddc3bf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:29.722598 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:29.737121 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3006/6054] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:29.742696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4ab55969ca40e1bbfdc90f93ddc3bf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:29.742696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07132850-e3f3-42f3-85d4-b23171c04a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4ab55969ca40e1bbfdc90f93ddc3bf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:29.751845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb7d44-b34e-466a-bf46-a4520375c6fc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:29.753315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4ddb7d44-b34e-466a-bf46-a4520375c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:29.766038 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3049/6055] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:29 2022] DELETE /identity/v3/users/fb4ab55969ca40e1bbfdc90f93ddc3bf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:29.770534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daac52-f7af-457b-8b6b-78d5c90fba17 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:29.770821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daac52-f7af-457b-8b6b-78d5c90fba17 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:29.771107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daac52-f7af-457b-8b6b-78d5c90fba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:29.823811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c9daac52-f7af-457b-8b6b-78d5c90fba17 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:29.827604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c9daac52-f7af-457b-8b6b-78d5c90fba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:29.940006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb7d44-b34e-466a-bf46-a4520375c6fc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:29.959233 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:30.005659 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3050/6056] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:30.006708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daac52-f7af-457b-8b6b-78d5c90fba17 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:30.009282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c9daac52-f7af-457b-8b6b-78d5c90fba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:30.037631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daac52-f7af-457b-8b6b-78d5c90fba17 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:30.069410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:30.070910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:30.073777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:30.074337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] PATH_INFO: `/v3/users/1c848f5942ad4f378803247521eadb86` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:30.077744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c848f5942ad4f378803247521eadb86)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:30.085288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:30.121691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d298c-372b-41cf-802e-aee9354c5280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:30.125776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d298c-372b-41cf-802e-aee9354c5280 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:30.126074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d298c-372b-41cf-802e-aee9354c5280 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:30.126353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d298c-372b-41cf-802e-aee9354c5280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:30.136994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-563d298c-372b-41cf-802e-aee9354c5280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:30.192976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c848f5942ad4f378803247521eadb86'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:30.236185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c848f5942ad4f378803247521eadb86'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:30.257583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c848f5942ad4f378803247521eadb86'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:30.270673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c848f5942ad4f378803247521eadb86'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:30.272833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c848f5942ad4f378803247521eadb86'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:30.286633 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3051/6057] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:30 2022] DELETE /identity/v3/users/1c848f5942ad4f378803247521eadb86 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:30.287920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:30.290684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:30.302316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d298c-372b-41cf-802e-aee9354c5280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:30.303956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d298c-372b-41cf-802e-aee9354c5280 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:30.328240 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3007/6058] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:12:30.329517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802af35-6035-4344-8ec0-b721f102ef03 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:30.329803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802af35-6035-4344-8ec0-b721f102ef03 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:30.330077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802af35-6035-4344-8ec0-b721f102ef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:30.387472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9802af35-6035-4344-8ec0-b721f102ef03 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:30.392027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9802af35-6035-4344-8ec0-b721f102ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:30.461375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3906b8-2512-4883-af51-1c5f38e7b729 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:30.496721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:30.496721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:30.497143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:30.497143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:30.524690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:30.587016 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:30.644246 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3008/6059] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:30.653850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802af35-6035-4344-8ec0-b721f102ef03 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:30.692286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802af35-6035-4344-8ec0-b721f102ef03 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:30.706253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d75a3c-5c29-4d1f-9cb8-13dbe05b98ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:30.706906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d75a3c-5c29-4d1f-9cb8-13dbe05b98ce service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:30.707163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d75a3c-5c29-4d1f-9cb8-13dbe05b98ce service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:30.707439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d75a3c-5c29-4d1f-9cb8-13dbe05b98ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:30.743379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d75a3c-5c29-4d1f-9cb8-13dbe05b98ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:30.750650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d75a3c-5c29-4d1f-9cb8-13dbe05b98ce service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:30.764433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:30.767353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:30.792312 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3009/6060] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:30.802460 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3052/6061] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:31.918994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d75a3c-5c29-4d1f-9cb8-13dbe05b98ce service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:31.920515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-18d75a3c-5c29-4d1f-9cb8-13dbe05b98ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:31.972654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d75a3c-5c29-4d1f-9cb8-13dbe05b98ce service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:32.007871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:32.008534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:32.008857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:32.009266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] PATH_INFO: `/v3/projects/f60293036e5c4a04a30d92634799d191` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:32.011288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60293036e5c4a04a30d92634799d191)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:32.017723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:32.146631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:32.149212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:32.166783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52384109-a25c-475b-b8af-ae1b66e50bd0 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:32.172228 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:32.227599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60293036e5c4a04a30d92634799d191', 'request_id': 'req-09f4a95a-4689-4ba9-91a7-3b331d97f252'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.255971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60293036e5c4a04a30d92634799d191', 'request_id': 'req-09f4a95a-4689-4ba9-91a7-3b331d97f252'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.268355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60293036e5c4a04a30d92634799d191', 'request_id': 'req-09f4a95a-4689-4ba9-91a7-3b331d97f252'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.307378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] The token cache is being invalidate because project f60293036e5c4a04a30d92634799d191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:32.310186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.312169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.334148 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3010/6062] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:31 2022] DELETE /identity/v3/projects/f60293036e5c4a04a30d92634799d191 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:32.339185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:32.347578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:32.359170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:32.361135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:32.362154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:32.362596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] PATH_INFO: `/v3/projects/ed3bec8bd6c04a6e8ae0c17820eefcd2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:32.367890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3bec8bd6c04a6e8ae0c17820eefcd2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:32.372290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:32.394980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4a95a-4689-4ba9-91a7-3b331d97f252 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:32.421105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:32.422969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:32.424640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:32.426081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] PATH_INFO: `/v3/users/2a67bdccf9d44659b3cdfc506f702dad` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:32.434079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a67bdccf9d44659b3cdfc506f702dad)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:32.441299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:32.559842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3bec8bd6c04a6e8ae0c17820eefcd2', 'request_id': 'req-ae56955d-681d-42cd-a55f-62723b193645'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.560447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a67bdccf9d44659b3cdfc506f702dad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.582171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3bec8bd6c04a6e8ae0c17820eefcd2', 'request_id': 'req-ae56955d-681d-42cd-a55f-62723b193645'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.589077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a67bdccf9d44659b3cdfc506f702dad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.599777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a67bdccf9d44659b3cdfc506f702dad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.601454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3bec8bd6c04a6e8ae0c17820eefcd2', 'request_id': 'req-ae56955d-681d-42cd-a55f-62723b193645'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.615187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a67bdccf9d44659b3cdfc506f702dad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.618303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a67bdccf9d44659b3cdfc506f702dad'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.633090 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3011/6063] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:32 2022] DELETE /identity/v3/users/2a67bdccf9d44659b3cdfc506f702dad => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:32.649942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] The token cache is being invalidate because project ed3bec8bd6c04a6e8ae0c17820eefcd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:32.650242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.657399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:32.660041 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3053/6064] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:32 2022] DELETE /identity/v3/projects/ed3bec8bd6c04a6e8ae0c17820eefcd2 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:32.664996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:32.667123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:32.771405 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:32.836001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a472f31-a899-4946-a80e-e47121065c5d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:32.848229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:32.849385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:32.849870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:32.850141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] PATH_INFO: `/v3/users/975616c47625445c91f114e745a25b59` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:32.852374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975616c47625445c91f114e745a25b59)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:32.857622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:32.972089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975616c47625445c91f114e745a25b59'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:33.013856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975616c47625445c91f114e745a25b59'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:33.026584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975616c47625445c91f114e745a25b59'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:33.059939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975616c47625445c91f114e745a25b59'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:33.062378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975616c47625445c91f114e745a25b59'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:33.082639 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3012/6065] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:32 2022] DELETE /identity/v3/users/975616c47625445c91f114e745a25b59 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:33.658965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:33.661045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:33.885590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56955d-681d-42cd-a55f-62723b193645 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:33.986399 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:34.011880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:34.012556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:34.012899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:34.013257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] PATH_INFO: `/v3/projects/a3c707e069d3491eb2dbf1c4bab0d179` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:34.014565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c707e069d3491eb2dbf1c4bab0d179)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:34.018473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:34.123551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c707e069d3491eb2dbf1c4bab0d179', 'request_id': 'req-8d2142ea-d47f-498a-bef2-76266a4ffcad'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.145773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c707e069d3491eb2dbf1c4bab0d179', 'request_id': 'req-8d2142ea-d47f-498a-bef2-76266a4ffcad'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.165241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c707e069d3491eb2dbf1c4bab0d179', 'request_id': 'req-8d2142ea-d47f-498a-bef2-76266a4ffcad'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.185393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] The token cache is being invalidate because project a3c707e069d3491eb2dbf1c4bab0d179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:34.185693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.186377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8d2142ea-d47f-498a-bef2-76266a4ffcad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.198940 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3054/6066] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:33 2022] DELETE /identity/v3/projects/a3c707e069d3491eb2dbf1c4bab0d179 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:34.212197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:34.212197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:34.258514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a362c-5672-4d2c-b22f-b5de8e3ea699 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:34.258951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a362c-5672-4d2c-b22f-b5de8e3ea699 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:34.259333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a362c-5672-4d2c-b22f-b5de8e3ea699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:34.284593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a534aa-28c0-44e4-ab72-d9c0f16daad1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:34.329076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0a2a362c-5672-4d2c-b22f-b5de8e3ea699 None None] MFA Rules not processed for user `2d97060e766f4e1f982d64b425ddd184`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:34.346302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0a2a362c-5672-4d2c-b22f-b5de8e3ea699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:34.395270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:34.399742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:34.400991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:34.401569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] PATH_INFO: `/v3/users/ecae519fa11f43fd9c82e0b1d09315eb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:34.403927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecae519fa11f43fd9c82e0b1d09315eb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:34.413509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:34.536468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecae519fa11f43fd9c82e0b1d09315eb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.542621 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:34.555683 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3055/6067] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:34.559414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a362c-5672-4d2c-b22f-b5de8e3ea699 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:34.562812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0a2a362c-5672-4d2c-b22f-b5de8e3ea699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:34.580322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecae519fa11f43fd9c82e0b1d09315eb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.601658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecae519fa11f43fd9c82e0b1d09315eb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.615763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecae519fa11f43fd9c82e0b1d09315eb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.617871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecae519fa11f43fd9c82e0b1d09315eb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.633373 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3013/6068] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:34 2022] DELETE /identity/v3/users/ecae519fa11f43fd9c82e0b1d09315eb => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:34.639884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a362c-5672-4d2c-b22f-b5de8e3ea699 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:34.828964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:34.829631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:34.830091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:34.830524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] PATH_INFO: `/v3/projects/389c64f02f0e42a1bde5ec433eca095c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:34.831952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] RBAC: Authorizing `identity:delete_project(project_id=389c64f02f0e42a1bde5ec433eca095c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:34.834112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:34.836082 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:34.958676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389c64f02f0e42a1bde5ec433eca095c', 'request_id': 'req-55a93059-4587-42bf-b771-508e97c2376f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.976887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389c64f02f0e42a1bde5ec433eca095c', 'request_id': 'req-55a93059-4587-42bf-b771-508e97c2376f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:34.984577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389c64f02f0e42a1bde5ec433eca095c', 'request_id': 'req-55a93059-4587-42bf-b771-508e97c2376f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.014814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] The token cache is being invalidate because project 389c64f02f0e42a1bde5ec433eca095c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:35.015678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.017580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-55a93059-4587-42bf-b771-508e97c2376f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.026244 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3056/6069] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:34 2022] DELETE /identity/v3/projects/389c64f02f0e42a1bde5ec433eca095c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:35.027806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:35.029405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:35.034773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d322e10-35c6-4dde-9fae-6306def69e9f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:35.035063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d322e10-35c6-4dde-9fae-6306def69e9f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:35.035345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d322e10-35c6-4dde-9fae-6306def69e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:35.065290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322ce0-2bbf-415d-ab31-d36bccdff6aa admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:35.124209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5d322e10-35c6-4dde-9fae-6306def69e9f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:35.129556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5d322e10-35c6-4dde-9fae-6306def69e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:35.224123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:35.224806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:35.225094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:35.225374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] PATH_INFO: `/v3/projects/3524ebe051e44e2d9b8abbdde60295a9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:35.227559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3524ebe051e44e2d9b8abbdde60295a9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:35.237947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:35.258927 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3057/6070] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:35.260354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d322e10-35c6-4dde-9fae-6306def69e9f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:35.262374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5d322e10-35c6-4dde-9fae-6306def69e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:35.306925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d322e10-35c6-4dde-9fae-6306def69e9f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:35.330945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:35.331817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:35.334124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:35.335008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] PATH_INFO: `/v3/users/b67c81c105654dac996312942d5f9ce5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:35.340320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67c81c105654dac996312942d5f9ce5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:35.346580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:35.370587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3524ebe051e44e2d9b8abbdde60295a9', 'request_id': 'req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.385372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3524ebe051e44e2d9b8abbdde60295a9', 'request_id': 'req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.403908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3524ebe051e44e2d9b8abbdde60295a9', 'request_id': 'req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.463382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] The token cache is being invalidate because project 3524ebe051e44e2d9b8abbdde60295a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:35.463704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.468216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adefe88c-937f-40e9-a3b7-b5e4547a4dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.473583 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3014/6071] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:35 2022] DELETE /identity/v3/projects/3524ebe051e44e2d9b8abbdde60295a9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:35.481279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e584d1e-fe6b-4358-9ff0-9e0c5aad112c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:35.482297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e584d1e-fe6b-4358-9ff0-9e0c5aad112c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:35.484349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e584d1e-fe6b-4358-9ff0-9e0c5aad112c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:35.496976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67c81c105654dac996312942d5f9ce5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.529834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67c81c105654dac996312942d5f9ce5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.544530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0e584d1e-fe6b-4358-9ff0-9e0c5aad112c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:35.546182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0e584d1e-fe6b-4358-9ff0-9e0c5aad112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:35.561223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67c81c105654dac996312942d5f9ce5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.572539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67c81c105654dac996312942d5f9ce5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.574736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1fbf176b-1b22-4cf2-a733-211ced6fe09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67c81c105654dac996312942d5f9ce5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:35.588809 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3058/6072] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:35 2022] DELETE /identity/v3/users/b67c81c105654dac996312942d5f9ce5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:35.588809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7c713-d736-4144-830a-1c9d25099f1e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:35.588809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7c713-d736-4144-830a-1c9d25099f1e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:35.588809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7c713-d736-4144-830a-1c9d25099f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:35.613916 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:35.638384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bef7c713-d736-4144-830a-1c9d25099f1e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:35.639638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bef7c713-d736-4144-830a-1c9d25099f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:35.653733 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:35.705672 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3015/6073] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:35.715460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e36130-66bd-4536-b587-164112efa5cc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:35.718571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e36130-66bd-4536-b587-164112efa5cc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:35.718900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e36130-66bd-4536-b587-164112efa5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:35.750302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-73e36130-66bd-4536-b587-164112efa5cc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:35.751737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-73e36130-66bd-4536-b587-164112efa5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:35.819325 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3059/6074] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:35.820741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7c713-d736-4144-830a-1c9d25099f1e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:35.844934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7c713-d736-4144-830a-1c9d25099f1e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:35.868580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:35.869334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:35.869831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:35.870208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:35.870973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:35.871376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:35.873196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:35.888931 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3016/6075] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:35.890217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202603a4-3866-4469-b45d-c9c17024b372 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:35.891762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202603a4-3866-4469-b45d-c9c17024b372 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:35.892700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202603a4-3866-4469-b45d-c9c17024b372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:35.899464 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3060/6076] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:35.900531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:35.902510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:35.937026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-202603a4-3866-4469-b45d-c9c17024b372 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:35.938274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-202603a4-3866-4469-b45d-c9c17024b372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:35.960936 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3017/6077] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:35.960936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202603a4-3866-4469-b45d-c9c17024b372 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:35.979349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202603a4-3866-4469-b45d-c9c17024b372 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:35.991438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306233-8de8-489e-a6ca-dd909a3d66a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:35.994237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306233-8de8-489e-a6ca-dd909a3d66a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:35.997695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306233-8de8-489e-a6ca-dd909a3d66a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:35.997981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306233-8de8-489e-a6ca-dd909a3d66a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:35.998799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91306233-8de8-489e-a6ca-dd909a3d66a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.000904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91306233-8de8-489e-a6ca-dd909a3d66a7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.011723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e26c3-9c6b-4f1a-811f-eb59a0493695 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:36.020807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571b870-bf39-4af1-ad90-57ba7507f32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:36.024755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571b870-bf39-4af1-ad90-57ba7507f32c service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.025310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571b870-bf39-4af1-ad90-57ba7507f32c service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.025944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571b870-bf39-4af1-ad90-57ba7507f32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:36.041857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571b870-bf39-4af1-ad90-57ba7507f32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.044290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571b870-bf39-4af1-ad90-57ba7507f32c service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.058765 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3061/6078] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:36.059938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571b870-bf39-4af1-ad90-57ba7507f32c service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:36.075506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571b870-bf39-4af1-ad90-57ba7507f32c service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:36.093152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bee1b-5f63-4649-9109-0935701f16c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:36.094395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bee1b-5f63-4649-9109-0935701f16c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.094893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bee1b-5f63-4649-9109-0935701f16c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.095487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bee1b-5f63-4649-9109-0935701f16c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:36.097160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bee1b-5f63-4649-9109-0935701f16c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:36.098304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bee1b-5f63-4649-9109-0935701f16c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.099881 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3018/6079] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:35 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:36.102286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bee1b-5f63-4649-9109-0935701f16c7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.105584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306233-8de8-489e-a6ca-dd909a3d66a7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:36.137058 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3062/6080] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:36.140607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bee1b-5f63-4649-9109-0935701f16c7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:36.156771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bee1b-5f63-4649-9109-0935701f16c7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:36.278532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73615f6-09b6-4147-993e-ce4a3749de8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:36.279210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73615f6-09b6-4147-993e-ce4a3749de8f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.279492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73615f6-09b6-4147-993e-ce4a3749de8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.279768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73615f6-09b6-4147-993e-ce4a3749de8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:36.280406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73615f6-09b6-4147-993e-ce4a3749de8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.282955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73615f6-09b6-4147-993e-ce4a3749de8f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.300675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306233-8de8-489e-a6ca-dd909a3d66a7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:36.314301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab953c05-ebec-4f05-ad49-a1c9643f5cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:36.314942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab953c05-ebec-4f05-ad49-a1c9643f5cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.315222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab953c05-ebec-4f05-ad49-a1c9643f5cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.315489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab953c05-ebec-4f05-ad49-a1c9643f5cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:36.316192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab953c05-ebec-4f05-ad49-a1c9643f5cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.324543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab953c05-ebec-4f05-ad49-a1c9643f5cf2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.374947 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3063/6081] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:36 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:36.377070 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3019/6082] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:36 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:36.377844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73615f6-09b6-4147-993e-ce4a3749de8f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:36.378570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab953c05-ebec-4f05-ad49-a1c9643f5cf2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:36.389731 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:36.418285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab953c05-ebec-4f05-ad49-a1c9643f5cf2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:36.587831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73615f6-09b6-4147-993e-ce4a3749de8f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:36.602764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cb9d0-1523-49d6-9a7f-b8d7b42abec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:36.605570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cb9d0-1523-49d6-9a7f-b8d7b42abec2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.605989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cb9d0-1523-49d6-9a7f-b8d7b42abec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.606398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cb9d0-1523-49d6-9a7f-b8d7b42abec2 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:36.607312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cb9d0-1523-49d6-9a7f-b8d7b42abec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.613484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cb9d0-1523-49d6-9a7f-b8d7b42abec2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.617696 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:36.637229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851b34-96b7-4fc0-b98b-2362a2ceb83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:36.637859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851b34-96b7-4fc0-b98b-2362a2ceb83a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.638139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851b34-96b7-4fc0-b98b-2362a2ceb83a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.638490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851b34-96b7-4fc0-b98b-2362a2ceb83a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:36.639516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851b34-96b7-4fc0-b98b-2362a2ceb83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.641522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851b34-96b7-4fc0-b98b-2362a2ceb83a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.672215 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3020/6083] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:36.673750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851b34-96b7-4fc0-b98b-2362a2ceb83a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:36.675638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-60851b34-96b7-4fc0-b98b-2362a2ceb83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:36.688701 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3064/6084] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:36 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:36.693212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cb9d0-1523-49d6-9a7f-b8d7b42abec2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:36.695258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851b34-96b7-4fc0-b98b-2362a2ceb83a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:36.700463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:36.701081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.701360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.701631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] PATH_INFO: `/v3/projects/ac2546ccf89145aa87a9fc9231a2a7e6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:36.703744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2546ccf89145aa87a9fc9231a2a7e6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.705722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.718391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cb9d0-1523-49d6-9a7f-b8d7b42abec2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:36.733028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062c99f-1a53-437f-ba31-0b5ba559ab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:36.733821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062c99f-1a53-437f-ba31-0b5ba559ab34 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.734218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062c99f-1a53-437f-ba31-0b5ba559ab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.734598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062c99f-1a53-437f-ba31-0b5ba559ab34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:36.735646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062c99f-1a53-437f-ba31-0b5ba559ab34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.738164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062c99f-1a53-437f-ba31-0b5ba559ab34 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.766705 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3065/6085] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:36.767395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062c99f-1a53-437f-ba31-0b5ba559ab34 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:36.793988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062c99f-1a53-437f-ba31-0b5ba559ab34 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:36.828373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'request_id': 'req-062fde4b-da39-46cc-9652-a5939578167c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:36.843333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'request_id': 'req-062fde4b-da39-46cc-9652-a5939578167c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:36.859194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'request_id': 'req-062fde4b-da39-46cc-9652-a5939578167c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:36.889999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] The token cache is being invalidate because project ac2546ccf89145aa87a9fc9231a2a7e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:36.891011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:36.894262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:36.902950 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3021/6086] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:36 2022] DELETE /identity/v3/projects/ac2546ccf89145aa87a9fc9231a2a7e6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:36.904542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:36.909298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:36.944738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3586d7-89d8-4d46-b919-39f8e938a07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:36.945523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3586d7-89d8-4d46-b919-39f8e938a07c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.945910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3586d7-89d8-4d46-b919-39f8e938a07c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.946308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3586d7-89d8-4d46-b919-39f8e938a07c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:36.947453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3586d7-89d8-4d46-b919-39f8e938a07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:36.951262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3586d7-89d8-4d46-b919-39f8e938a07c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:36.978595 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3066/6087] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:36.983772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f2c81-e94e-403e-8d49-77eb84fc11f5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:36.986388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f2c81-e94e-403e-8d49-77eb84fc11f5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:36.988757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f2c81-e94e-403e-8d49-77eb84fc11f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.036919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-683f2c81-e94e-403e-8d49-77eb84fc11f5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:37.039871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-683f2c81-e94e-403e-8d49-77eb84fc11f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:37.058849 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3067/6088] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:37.061756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f2c81-e94e-403e-8d49-77eb84fc11f5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:37.066392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-683f2c81-e94e-403e-8d49-77eb84fc11f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:37.087691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fde4b-da39-46cc-9652-a5939578167c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:37.096255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f2c81-e94e-403e-8d49-77eb84fc11f5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:37.104171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f260f0-12a9-4790-9826-d3bbb19fcd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:37.107908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f260f0-12a9-4790-9826-d3bbb19fcd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.108368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f260f0-12a9-4790-9826-d3bbb19fcd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.108833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f260f0-12a9-4790-9826-d3bbb19fcd5b admin admin] PATH_INFO: `/v3/projects/3a9b07a7b702454c8e17b3aec0ca75f5/users/3e98d4eddbd74ee58016eeb3d8b4a8f8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.109836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21cfff-793c-4290-b467-a6177c32db0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:37.111045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21cfff-793c-4290-b467-a6177c32db0f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.111045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21cfff-793c-4290-b467-a6177c32db0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.111045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21cfff-793c-4290-b467-a6177c32db0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.111960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21cfff-793c-4290-b467-a6177c32db0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:37.115392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21cfff-793c-4290-b467-a6177c32db0f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:37.144491 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3068/6089] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:37.148499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5530fb-1328-42f4-96ee-9cb1f4885da2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.148856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5530fb-1328-42f4-96ee-9cb1f4885da2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.149957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5530fb-1328-42f4-96ee-9cb1f4885da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.155253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f260f0-12a9-4790-9826-d3bbb19fcd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9b07a7b702454c8e17b3aec0ca75f5, user_id=3e98d4eddbd74ee58016eeb3d8b4a8f8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:37.160791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f260f0-12a9-4790-9826-d3bbb19fcd5b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:37.183350 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3022/6090] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:36 2022] PUT /identity/v3/projects/3a9b07a7b702454c8e17b3aec0ca75f5/users/3e98d4eddbd74ee58016eeb3d8b4a8f8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:37.185160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f260f0-12a9-4790-9826-d3bbb19fcd5b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:37.201157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9b5530fb-1328-42f4-96ee-9cb1f4885da2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:37.202711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9b5530fb-1328-42f4-96ee-9cb1f4885da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:37.300293 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:37.325393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f260f0-12a9-4790-9826-d3bbb19fcd5b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:37.347233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad145c-85e1-466e-af7d-e7bcadaf752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:37.348223 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3069/6091] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:37.348554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad145c-85e1-466e-af7d-e7bcadaf752b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.348939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad145c-85e1-466e-af7d-e7bcadaf752b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.349222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad145c-85e1-466e-af7d-e7bcadaf752b admin admin] PATH_INFO: `/v3/projects/cea19527cd164a4bb1c797649f2d8533/users/b8c0fbb546b841f1b6c8d1ab6b302cc6/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.349851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240964c-04d1-49d3-8254-ee83b289bc58 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.350258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240964c-04d1-49d3-8254-ee83b289bc58 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.350539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240964c-04d1-49d3-8254-ee83b289bc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.364813 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:37.385580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad145c-85e1-466e-af7d-e7bcadaf752b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea19527cd164a4bb1c797649f2d8533, user_id=b8c0fbb546b841f1b6c8d1ab6b302cc6, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:37.389104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad145c-85e1-466e-af7d-e7bcadaf752b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:37.407501 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3023/6092] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:37 2022] PUT /identity/v3/projects/cea19527cd164a4bb1c797649f2d8533/users/b8c0fbb546b841f1b6c8d1ab6b302cc6/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:37.408483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad145c-85e1-466e-af7d-e7bcadaf752b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:37.438396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d240964c-04d1-49d3-8254-ee83b289bc58 None None] MFA Rules not processed for user `3e98d4eddbd74ee58016eeb3d8b4a8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:37.439636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d240964c-04d1-49d3-8254-ee83b289bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:37.640543 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3070/6093] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:37.640543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a1eee-d685-4837-a9e9-d7124db23a8e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.640543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a1eee-d685-4837-a9e9-d7124db23a8e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.642825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a1eee-d685-4837-a9e9-d7124db23a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.649330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad145c-85e1-466e-af7d-e7bcadaf752b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:37.666252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547b168-02f2-4536-b171-05d1a32724c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:37.668212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547b168-02f2-4536-b171-05d1a32724c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.669737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547b168-02f2-4536-b171-05d1a32724c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.670368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547b168-02f2-4536-b171-05d1a32724c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.671787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547b168-02f2-4536-b171-05d1a32724c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:37.673461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547b168-02f2-4536-b171-05d1a32724c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:37.678054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547b168-02f2-4536-b171-05d1a32724c3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:37.717161 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3024/6094] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:37.717902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547b168-02f2-4536-b171-05d1a32724c3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:37.729377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-589a1eee-d685-4837-a9e9-d7124db23a8e None None] MFA Rules not processed for user `b8c0fbb546b841f1b6c8d1ab6b302cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:37.730608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-589a1eee-d685-4837-a9e9-d7124db23a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:37.741096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547b168-02f2-4536-b171-05d1a32724c3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:37.753257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce924c-e2b8-4239-a3d9-4ed792acbfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:37.753998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce924c-e2b8-4239-a3d9-4ed792acbfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.755519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce924c-e2b8-4239-a3d9-4ed792acbfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.756338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce924c-e2b8-4239-a3d9-4ed792acbfb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.762974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce924c-e2b8-4239-a3d9-4ed792acbfb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:37.772811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce924c-e2b8-4239-a3d9-4ed792acbfb2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:37.837869 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3025/6095] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:37 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:37.838628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce924c-e2b8-4239-a3d9-4ed792acbfb2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:37.872815 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3071/6096] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:37.873820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a1eee-d685-4837-a9e9-d7124db23a8e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:37.887308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a1eee-d685-4837-a9e9-d7124db23a8e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:37.970292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce924c-e2b8-4239-a3d9-4ed792acbfb2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:37.978628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0a58-2219-4984-a6ec-9f3ef43db0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:37.979558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0a58-2219-4984-a6ec-9f3ef43db0dd admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.979750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c636-3cf4-446b-950a-323dc602ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:37.980042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0a58-2219-4984-a6ec-9f3ef43db0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.980383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c636-3cf4-446b-950a-323dc602ff63 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:37.980485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0a58-2219-4984-a6ec-9f3ef43db0dd admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.980693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c636-3cf4-446b-950a-323dc602ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:37.980977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834c636-3cf4-446b-950a-323dc602ff63 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:37.981614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834c636-3cf4-446b-950a-323dc602ff63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:37.981785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0a58-2219-4984-a6ec-9f3ef43db0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:37.983534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834c636-3cf4-446b-950a-323dc602ff63 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:37.983894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0a58-2219-4984-a6ec-9f3ef43db0dd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.032729 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3072/6097] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:37 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:38.034488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0a58-2219-4984-a6ec-9f3ef43db0dd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.042133 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3026/6098] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:37 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:38.042883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c636-3cf4-446b-950a-323dc602ff63 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.058752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0a58-2219-4984-a6ec-9f3ef43db0dd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.069928 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:38.110389 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:38.153810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834c636-3cf4-446b-950a-323dc602ff63 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.157785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656f38d-ae71-41ff-bbf7-936cff62d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.158882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323b4d1-3f99-4f1b-bafe-cca2a82cec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.159211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f38d-ae71-41ff-bbf7-936cff62d306 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.159501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323b4d1-3f99-4f1b-bafe-cca2a82cec43 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.159785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323b4d1-3f99-4f1b-bafe-cca2a82cec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.160062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323b4d1-3f99-4f1b-bafe-cca2a82cec43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.160357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f38d-ae71-41ff-bbf7-936cff62d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.160745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323b4d1-3f99-4f1b-bafe-cca2a82cec43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.161112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f38d-ae71-41ff-bbf7-936cff62d306 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.162023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656f38d-ae71-41ff-bbf7-936cff62d306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.162388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323b4d1-3f99-4f1b-bafe-cca2a82cec43 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.165198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656f38d-ae71-41ff-bbf7-936cff62d306 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.183746 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3027/6099] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:38.184380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323b4d1-3f99-4f1b-bafe-cca2a82cec43 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.205318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323b4d1-3f99-4f1b-bafe-cca2a82cec43 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.208595 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3073/6100] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:38 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:38.211003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656f38d-ae71-41ff-bbf7-936cff62d306 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.211414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c480a59-e4d0-4154-828d-5eeb5b3c0d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.212041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c480a59-e4d0-4154-828d-5eeb5b3c0d20 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.212389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c480a59-e4d0-4154-828d-5eeb5b3c0d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.212777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c480a59-e4d0-4154-828d-5eeb5b3c0d20 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.213391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c480a59-e4d0-4154-828d-5eeb5b3c0d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.215348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c480a59-e4d0-4154-828d-5eeb5b3c0d20 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.240046 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3028/6101] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:38 2022] POST /identity/v3/users => generated 285 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:38.241282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c480a59-e4d0-4154-828d-5eeb5b3c0d20 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.252860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c480a59-e4d0-4154-828d-5eeb5b3c0d20 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.293841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656f38d-ae71-41ff-bbf7-936cff62d306 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.302839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206be4a2-36d1-4258-9c9f-6092ab79bb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.304530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206be4a2-36d1-4258-9c9f-6092ab79bb0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.305736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206be4a2-36d1-4258-9c9f-6092ab79bb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.306526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206be4a2-36d1-4258-9c9f-6092ab79bb0b admin admin] PATH_INFO: `/v3/projects/ae3dd282894448cbb31e095951e293bd/users/35e8d8bbd912429aa9d39c6e3d8c0d5d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.326058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10061f0a-8574-4be7-9e52-5d3c53ccc96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.326602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10061f0a-8574-4be7-9e52-5d3c53ccc96a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.327068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10061f0a-8574-4be7-9e52-5d3c53ccc96a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.327353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10061f0a-8574-4be7-9e52-5d3c53ccc96a admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.328254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10061f0a-8574-4be7-9e52-5d3c53ccc96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.330615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10061f0a-8574-4be7-9e52-5d3c53ccc96a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.334778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206be4a2-36d1-4258-9c9f-6092ab79bb0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3dd282894448cbb31e095951e293bd, user_id=35e8d8bbd912429aa9d39c6e3d8c0d5d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.342906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206be4a2-36d1-4258-9c9f-6092ab79bb0b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.361837 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3029/6102] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:38 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:38.362794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10061f0a-8574-4be7-9e52-5d3c53ccc96a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.377362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10061f0a-8574-4be7-9e52-5d3c53ccc96a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.377557 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3074/6103] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:38 2022] PUT /identity/v3/projects/ae3dd282894448cbb31e095951e293bd/users/35e8d8bbd912429aa9d39c6e3d8c0d5d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:38.378776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206be4a2-36d1-4258-9c9f-6092ab79bb0b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.455083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edd3c9-f7c4-4f3d-881a-0e2ec983e725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.455838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edd3c9-f7c4-4f3d-881a-0e2ec983e725 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.466721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edd3c9-f7c4-4f3d-881a-0e2ec983e725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.467643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edd3c9-f7c4-4f3d-881a-0e2ec983e725 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.470025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edd3c9-f7c4-4f3d-881a-0e2ec983e725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.475443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edd3c9-f7c4-4f3d-881a-0e2ec983e725 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.520358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206be4a2-36d1-4258-9c9f-6092ab79bb0b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.534742 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3030/6104] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:38.537850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edd3c9-f7c4-4f3d-881a-0e2ec983e725 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.540862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da62350-b8bc-4e77-805e-120f43bcb924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.541880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da62350-b8bc-4e77-805e-120f43bcb924 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.543845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da62350-b8bc-4e77-805e-120f43bcb924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.544451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da62350-b8bc-4e77-805e-120f43bcb924 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.547731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da62350-b8bc-4e77-805e-120f43bcb924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.552220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da62350-b8bc-4e77-805e-120f43bcb924 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.558859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edd3c9-f7c4-4f3d-881a-0e2ec983e725 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.573565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ca9f-9346-4625-86c9-f47a2c9970cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.574306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ca9f-9346-4625-86c9-f47a2c9970cd admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.574640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ca9f-9346-4625-86c9-f47a2c9970cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.574937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ca9f-9346-4625-86c9-f47a2c9970cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.588715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634ca9f-9346-4625-86c9-f47a2c9970cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.592158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634ca9f-9346-4625-86c9-f47a2c9970cd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.596997 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3075/6105] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:38.597975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da62350-b8bc-4e77-805e-120f43bcb924 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.624541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da62350-b8bc-4e77-805e-120f43bcb924 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.630574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509f259-5d43-4a19-90ff-15c7071d8343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.631202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f259-5d43-4a19-90ff-15c7071d8343 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.631485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f259-5d43-4a19-90ff-15c7071d8343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.631760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f259-5d43-4a19-90ff-15c7071d8343 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.632422 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3031/6106] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:38.632553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509f259-5d43-4a19-90ff-15c7071d8343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.634117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509f259-5d43-4a19-90ff-15c7071d8343 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.635212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ca9f-9346-4625-86c9-f47a2c9970cd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.676605 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3076/6107] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:38.677608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509f259-5d43-4a19-90ff-15c7071d8343 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.679206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ca9f-9346-4625-86c9-f47a2c9970cd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.694068 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:38.712738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4848403-5bac-4d19-9180-03f288e0de75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.713137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509f259-5d43-4a19-90ff-15c7071d8343 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.713356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4848403-5bac-4d19-9180-03f288e0de75 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.713744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4848403-5bac-4d19-9180-03f288e0de75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.717484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4848403-5bac-4d19-9180-03f288e0de75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.717668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4848403-5bac-4d19-9180-03f288e0de75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.719287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4848403-5bac-4d19-9180-03f288e0de75 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.733068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4a0f0-a9b9-458a-bc24-b6a8822cb1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.733757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4a0f0-a9b9-458a-bc24-b6a8822cb1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.734039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4a0f0-a9b9-458a-bc24-b6a8822cb1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.734315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4a0f0-a9b9-458a-bc24-b6a8822cb1ed admin admin] PATH_INFO: `/v3/projects/ae3dd282894448cbb31e095951e293bd/users/35e8d8bbd912429aa9d39c6e3d8c0d5d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.740730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4a0f0-a9b9-458a-bc24-b6a8822cb1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3dd282894448cbb31e095951e293bd, user_id=35e8d8bbd912429aa9d39c6e3d8c0d5d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.743730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4a0f0-a9b9-458a-bc24-b6a8822cb1ed admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:38.754402 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3032/6108] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:38.755453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4848403-5bac-4d19-9180-03f288e0de75 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.775083 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3077/6109] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:38 2022] PUT /identity/v3/projects/ae3dd282894448cbb31e095951e293bd/users/35e8d8bbd912429aa9d39c6e3d8c0d5d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:38.775924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4a0f0-a9b9-458a-bc24-b6a8822cb1ed admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:38.778494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4848403-5bac-4d19-9180-03f288e0de75 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.847394 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:38.955778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc3541-6873-4ffc-990b-3dffe4563dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.956470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc3541-6873-4ffc-990b-3dffe4563dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.956808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc3541-6873-4ffc-990b-3dffe4563dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.957071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc3541-6873-4ffc-990b-3dffe4563dc7 admin admin] PATH_INFO: `/v3/projects/1ecddf040c5c40679e560fcc57c1967c/users/b0eefeab267e4de3b4f923e56830a7a7/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.960859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4a0f0-a9b9-458a-bc24-b6a8822cb1ed admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:38.974663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e9f51-f015-4089-8cb1-4f6dad8eb8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:38.976164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e9f51-f015-4089-8cb1-4f6dad8eb8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:38.976450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e9f51-f015-4089-8cb1-4f6dad8eb8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:38.976759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e9f51-f015-4089-8cb1-4f6dad8eb8b5 admin admin] PATH_INFO: `/v3/projects/70df3bcbea2140d7929dd61554997673/users/43a6ca4ffbf84d18a59f2f4954811639/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:38.988805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc3541-6873-4ffc-990b-3dffe4563dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecddf040c5c40679e560fcc57c1967c, user_id=b0eefeab267e4de3b4f923e56830a7a7, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:38.992083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc3541-6873-4ffc-990b-3dffe4563dc7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:39.010030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e9f51-f015-4089-8cb1-4f6dad8eb8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70df3bcbea2140d7929dd61554997673, user_id=43a6ca4ffbf84d18a59f2f4954811639, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:39.016085 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3033/6110] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:38 2022] PUT /identity/v3/projects/1ecddf040c5c40679e560fcc57c1967c/users/b0eefeab267e4de3b4f923e56830a7a7/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:39.016946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e9f51-f015-4089-8cb1-4f6dad8eb8b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:39.018852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a1729-1aa2-44fe-8e98-1492eef74518 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:39.019285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a1729-1aa2-44fe-8e98-1492eef74518 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:39.019568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a1729-1aa2-44fe-8e98-1492eef74518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:39.049210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3078/6111] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:38 2022] PUT /identity/v3/projects/70df3bcbea2140d7929dd61554997673/users/43a6ca4ffbf84d18a59f2f4954811639/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:39.049210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b481e-a350-489d-a1ff-331507e5f6c6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:39.049210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b481e-a350-489d-a1ff-331507e5f6c6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:39.049210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b481e-a350-489d-a1ff-331507e5f6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:39.095976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d26a1729-1aa2-44fe-8e98-1492eef74518 None None] MFA Rules not processed for user `35e8d8bbd912429aa9d39c6e3d8c0d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:39.097222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d26a1729-1aa2-44fe-8e98-1492eef74518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:39.119305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fc5b481e-a350-489d-a1ff-331507e5f6c6 None None] MFA Rules not processed for user `b0eefeab267e4de3b4f923e56830a7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:39.120540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fc5b481e-a350-489d-a1ff-331507e5f6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:39.259846 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3034/6112] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:39.265194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157e824-ecf4-4983-8a4f-51f24e277416 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:39.265508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157e824-ecf4-4983-8a4f-51f24e277416 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:39.266409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157e824-ecf4-4983-8a4f-51f24e277416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:39.282119 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3079/6113] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:39.284593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b481e-a350-489d-a1ff-331507e5f6c6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:39.308732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b481e-a350-489d-a1ff-331507e5f6c6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:39.323079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750865f5-ad77-4f10-b6c8-88858e243229 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:39.323734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750865f5-ad77-4f10-b6c8-88858e243229 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:39.324019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750865f5-ad77-4f10-b6c8-88858e243229 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:39.324296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750865f5-ad77-4f10-b6c8-88858e243229 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:39.325064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750865f5-ad77-4f10-b6c8-88858e243229 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:39.326739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750865f5-ad77-4f10-b6c8-88858e243229 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:39.337477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2157e824-ecf4-4983-8a4f-51f24e277416 None None] MFA Rules not processed for user `43a6ca4ffbf84d18a59f2f4954811639`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:39.338693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2157e824-ecf4-4983-8a4f-51f24e277416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:39.375674 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3080/6114] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:12:39 2022] POST /identity/v3/domains => generated 274 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:39.375674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750865f5-ad77-4f10-b6c8-88858e243229 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:39.379826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-750865f5-ad77-4f10-b6c8-88858e243229 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:39.493457 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:39.509181 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3035/6115] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:39.509329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750865f5-ad77-4f10-b6c8-88858e243229 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:39.510296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157e824-ecf4-4983-8a4f-51f24e277416 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:39.526463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc378351-2894-49fa-b454-23a24a6d7d7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:39.527373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc378351-2894-49fa-b454-23a24a6d7d7e service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:39.527663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc378351-2894-49fa-b454-23a24a6d7d7e service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:39.527943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc378351-2894-49fa-b454-23a24a6d7d7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:39.533707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157e824-ecf4-4983-8a4f-51f24e277416 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:39.566011 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:39.635906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc378351-2894-49fa-b454-23a24a6d7d7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:39.648838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc378351-2894-49fa-b454-23a24a6d7d7e service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:39.672689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9829de-6eff-4dc6-b953-e7500d679562 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:39.672884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9829de-6eff-4dc6-b953-e7500d679562 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:39.673391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9829de-6eff-4dc6-b953-e7500d679562 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:39.675053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9829de-6eff-4dc6-b953-e7500d679562 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:39.675838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9829de-6eff-4dc6-b953-e7500d679562 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:39.677986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9829de-6eff-4dc6-b953-e7500d679562 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:39.678150 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3081/6116] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:39.681965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc378351-2894-49fa-b454-23a24a6d7d7e service glance] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:39.761206 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3036/6117] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:39 2022] POST /identity/v3/users => generated 347 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:39.764996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9829de-6eff-4dc6-b953-e7500d679562 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:39.786593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9829de-6eff-4dc6-b953-e7500d679562 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:39.800652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1cb48-e551-4275-992f-ac6d0c009515 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:39.801387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1cb48-e551-4275-992f-ac6d0c009515 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:39.801675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1cb48-e551-4275-992f-ac6d0c009515 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:39.801970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1cb48-e551-4275-992f-ac6d0c009515 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:39.802647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1cb48-e551-4275-992f-ac6d0c009515 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:39.806240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1cb48-e551-4275-992f-ac6d0c009515 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:39.846076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc378351-2894-49fa-b454-23a24a6d7d7e service glance] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:39.861503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e1a06-601a-4b5a-9403-ec68fca829f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:39.862155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e1a06-601a-4b5a-9403-ec68fca829f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:39.862441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e1a06-601a-4b5a-9403-ec68fca829f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:39.862788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e1a06-601a-4b5a-9403-ec68fca829f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:39.863438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e1a06-601a-4b5a-9403-ec68fca829f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:39.868398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e1a06-601a-4b5a-9403-ec68fca829f3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:39.868568 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3037/6118] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:39 2022] POST /identity/v3/users => generated 322 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:39.869758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1cb48-e551-4275-992f-ac6d0c009515 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:39.895167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1cb48-e551-4275-992f-ac6d0c009515 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:39.905460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0bd18-927c-4ebf-868a-8129d3e28711 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:39.906122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0bd18-927c-4ebf-868a-8129d3e28711 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:39.906427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0bd18-927c-4ebf-868a-8129d3e28711 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:39.906675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0bd18-927c-4ebf-868a-8129d3e28711 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/users/16f8132e1ce74723982c42edb734e0bf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:39.931833 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3082/6119] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:39 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:39.935697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e1a06-601a-4b5a-9403-ec68fca829f3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:39.971824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0bd18-927c-4ebf-868a-8129d3e28711 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:get_user(user_id=16f8132e1ce74723982c42edb734e0bf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:39.974270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0bd18-927c-4ebf-868a-8129d3e28711 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:39.984148 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3038/6120] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:12:39 2022] GET /identity/v3/users/16f8132e1ce74723982c42edb734e0bf => generated 347 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:39.986075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0bd18-927c-4ebf-868a-8129d3e28711 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:40.017928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0bd18-927c-4ebf-868a-8129d3e28711 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:40.140614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:40.141278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:40.141564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:40.141841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:40.142564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Adding query filter params (domain_id=5810acbd36604cdebc202f1de8eae392) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:40.142866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:40.148205 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:12:40.148205 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:12:40.148205 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:12:40.149694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:40.180845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e1a06-601a-4b5a-9403-ec68fca829f3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:40.191869 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3039/6121] 10.222.0.27 () {58 vars in 1207 bytes} [Wed Oct 19 01:12:39 2022] GET /identity/v3/users?domain_id=5810acbd36604cdebc202f1de8eae392 => generated 484 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:40.193662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:40.201764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6f225-4e52-4fa4-b904-58439ae28dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:40.202468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f225-4e52-4fa4-b904-58439ae28dca admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:40.202751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f225-4e52-4fa4-b904-58439ae28dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:40.203029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f225-4e52-4fa4-b904-58439ae28dca admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:40.204056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6f225-4e52-4fa4-b904-58439ae28dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:40.206048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6f225-4e52-4fa4-b904-58439ae28dca admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:40.223438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d17e6-649b-4881-9655-a1fbd8d5dd99 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:40.236687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93fbe-2c1b-4e9c-b536-ccbf8158bcdc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:40.237356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93fbe-2c1b-4e9c-b536-ccbf8158bcdc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:40.237812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93fbe-2c1b-4e9c-b536-ccbf8158bcdc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:40.238092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93fbe-2c1b-4e9c-b536-ccbf8158bcdc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:40.240175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93fbe-2c1b-4e9c-b536-ccbf8158bcdc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:40.242927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93fbe-2c1b-4e9c-b536-ccbf8158bcdc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:40.267243 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3083/6122] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:39 2022] POST /identity/v3/users => generated 298 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:40.271386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6f225-4e52-4fa4-b904-58439ae28dca admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:40.299766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6f225-4e52-4fa4-b904-58439ae28dca admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:40.313091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2ebf6-4e42-42cf-8002-64ff59681285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:40.313738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2ebf6-4e42-42cf-8002-64ff59681285 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:40.314165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2ebf6-4e42-42cf-8002-64ff59681285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:40.314461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2ebf6-4e42-42cf-8002-64ff59681285 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:40.315323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2ebf6-4e42-42cf-8002-64ff59681285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:40.320022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2ebf6-4e42-42cf-8002-64ff59681285 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:40.333293 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:40.353079 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3084/6123] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:40.354089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2ebf6-4e42-42cf-8002-64ff59681285 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:40.379583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2ebf6-4e42-42cf-8002-64ff59681285 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:40.393219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bdc3d-ff64-46cb-b551-6333abb9d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:40.393976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bdc3d-ff64-46cb-b551-6333abb9d788 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:40.394273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bdc3d-ff64-46cb-b551-6333abb9d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:40.394552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bdc3d-ff64-46cb-b551-6333abb9d788 admin admin] PATH_INFO: `/v3/projects/82d68a1ba83f46ed92a512e22eefdb30/users/125a076c2d8a4e0eb3b87a4c0329cd87/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:40.425415 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3040/6124] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:40 2022] GET /identity/v3/users => generated 10000 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 179 bytes (1 switches on core 0) Oct 19 01:12:40.427695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93fbe-2c1b-4e9c-b536-ccbf8158bcdc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:40.430379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2bd93fbe-2c1b-4e9c-b536-ccbf8158bcdc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:40.440555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bdc3d-ff64-46cb-b551-6333abb9d788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d68a1ba83f46ed92a512e22eefdb30, user_id=125a076c2d8a4e0eb3b87a4c0329cd87, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:40.448441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bdc3d-ff64-46cb-b551-6333abb9d788 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:40.450697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93fbe-2c1b-4e9c-b536-ccbf8158bcdc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:40.464284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:40.465999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:40.466574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:40.467071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] PATH_INFO: `/v3/users/ba2f1fbe02094d5480ea55ee97c57b34` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:40.469356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2f1fbe02094d5480ea55ee97c57b34)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:40.472476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:40.477335 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3085/6125] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:40 2022] PUT /identity/v3/projects/82d68a1ba83f46ed92a512e22eefdb30/users/125a076c2d8a4e0eb3b87a4c0329cd87/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:40.479452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bdc3d-ff64-46cb-b551-6333abb9d788 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:40.590298 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:40.607547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2f1fbe02094d5480ea55ee97c57b34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:40.631641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2f1fbe02094d5480ea55ee97c57b34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:40.647013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2f1fbe02094d5480ea55ee97c57b34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:40.661613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2f1fbe02094d5480ea55ee97c57b34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:40.663650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2f1fbe02094d5480ea55ee97c57b34'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:40.674234 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3041/6126] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:40 2022] DELETE /identity/v3/users/ba2f1fbe02094d5480ea55ee97c57b34 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:40.677036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:40.685282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:40.790527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bdc3d-ff64-46cb-b551-6333abb9d788 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:40.869766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01cde3-2aaa-4b25-9af2-41f7f9540a9c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:40.877062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4aa83-92a2-4107-88e9-37561eb42d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:40.877828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4aa83-92a2-4107-88e9-37561eb42d1f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:40.878638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4aa83-92a2-4107-88e9-37561eb42d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:40.878859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4aa83-92a2-4107-88e9-37561eb42d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:40.879870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4aa83-92a2-4107-88e9-37561eb42d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:40.884608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4aa83-92a2-4107-88e9-37561eb42d1f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:40.914064 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3042/6127] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:40.923346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4dfb8-577d-484b-bb3b-47280bd411ad None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:40.925205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4dfb8-577d-484b-bb3b-47280bd411ad None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:40.926828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4dfb8-577d-484b-bb3b-47280bd411ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:40.982299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-31a4dfb8-577d-484b-bb3b-47280bd411ad None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:40.985950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-31a4dfb8-577d-484b-bb3b-47280bd411ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:41.027795 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3043/6128] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:41.028821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4dfb8-577d-484b-bb3b-47280bd411ad None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:41.037200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af71982-f0ff-42ab-8e41-e68d418786e4 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:41.037840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af71982-f0ff-42ab-8e41-e68d418786e4 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:41.038174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af71982-f0ff-42ab-8e41-e68d418786e4 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:41.038462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af71982-f0ff-42ab-8e41-e68d418786e4 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:41.039182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af71982-f0ff-42ab-8e41-e68d418786e4 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1524923658) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:41.039484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af71982-f0ff-42ab-8e41-e68d418786e4 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:41.041443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af71982-f0ff-42ab-8e41-e68d418786e4 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:41.043011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4dfb8-577d-484b-bb3b-47280bd411ad None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:41.059101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fcf3-8217-4a20-ad73-7d71fad432cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:41.060021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fcf3-8217-4a20-ad73-7d71fad432cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:41.060509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fcf3-8217-4a20-ad73-7d71fad432cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:41.061311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fcf3-8217-4a20-ad73-7d71fad432cf admin admin] PATH_INFO: `/v3/projects/82d68a1ba83f46ed92a512e22eefdb30/users/125a076c2d8a4e0eb3b87a4c0329cd87/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:41.063560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39fcf3-8217-4a20-ad73-7d71fad432cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d68a1ba83f46ed92a512e22eefdb30, user_id=125a076c2d8a4e0eb3b87a4c0329cd87, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:41.066613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39fcf3-8217-4a20-ad73-7d71fad432cf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:41.101954 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3044/6129] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:41 2022] PUT /identity/v3/projects/82d68a1ba83f46ed92a512e22eefdb30/users/125a076c2d8a4e0eb3b87a4c0329cd87/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:41.102931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fcf3-8217-4a20-ad73-7d71fad432cf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:41.105150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4d39fcf3-8217-4a20-ad73-7d71fad432cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:41.162871 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3086/6130] 10.222.0.27 () {58 vars in 1189 bytes} [Wed Oct 19 01:12:40 2022] GET /identity/v3/users?name=tempest-test_user-1524923658 => generated 475 bytes in 685 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:41.164945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e26ea-0f21-4b8e-979e-2b02f1cb3b1d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:41.171815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e26ea-0f21-4b8e-979e-2b02f1cb3b1d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:41.172106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e26ea-0f21-4b8e-979e-2b02f1cb3b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:41.220646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fcf3-8217-4a20-ad73-7d71fad432cf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:41.233308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce061b9-a347-43d1-b532-b2fbcbb78c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:41.234650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce061b9-a347-43d1-b532-b2fbcbb78c1a service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:41.234956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce061b9-a347-43d1-b532-b2fbcbb78c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:41.235236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce061b9-a347-43d1-b532-b2fbcbb78c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:41.261191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8a5e26ea-0f21-4b8e-979e-2b02f1cb3b1d None None] MFA Rules not processed for user `125a076c2d8a4e0eb3b87a4c0329cd87`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:41.262691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8a5e26ea-0f21-4b8e-979e-2b02f1cb3b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:41.357745 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:41.397871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce061b9-a347-43d1-b532-b2fbcbb78c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:41.403378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce061b9-a347-43d1-b532-b2fbcbb78c1a service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:41.426294 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3045/6131] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:41.427435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce061b9-a347-43d1-b532-b2fbcbb78c1a service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:41.437190 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:41.440002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bce061b9-a347-43d1-b532-b2fbcbb78c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:41.459045 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3087/6132] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:41.485184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e26ea-0f21-4b8e-979e-2b02f1cb3b1d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:41.489311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8a5e26ea-0f21-4b8e-979e-2b02f1cb3b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:41.577336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce061b9-a347-43d1-b532-b2fbcbb78c1a service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:41.590334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e235-8fd6-496f-b463-44301f400c8c tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:41.591082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e235-8fd6-496f-b463-44301f400c8c tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:41.591759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e235-8fd6-496f-b463-44301f400c8c tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:41.591759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e235-8fd6-496f-b463-44301f400c8c tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:41.592720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36e235-8fd6-496f-b463-44301f400c8c tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:41.594289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36e235-8fd6-496f-b463-44301f400c8c tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:41.597937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36e235-8fd6-496f-b463-44301f400c8c tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:41.658296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e26ea-0f21-4b8e-979e-2b02f1cb3b1d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:41.660149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3046/6133] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 01:12:41 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:41.662219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e235-8fd6-496f-b463-44301f400c8c tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:41.666654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57cf2b-75f8-4861-9746-458310a1556f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:41.667188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57cf2b-75f8-4861-9746-458310a1556f service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:41.667476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57cf2b-75f8-4861-9746-458310a1556f service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:41.667754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57cf2b-75f8-4861-9746-458310a1556f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:41.675499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fd57cf2b-75f8-4861-9746-458310a1556f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:41.687475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e235-8fd6-496f-b463-44301f400c8c tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:41.702092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:41.702878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:41.703337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:41.705669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/users/b3602bb57cb447d2a354e4132b9cbb75` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:41.745948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b3602bb57cb447d2a354e4132b9cbb75)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:41.752070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:41.862305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3602bb57cb447d2a354e4132b9cbb75'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:41.891985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3602bb57cb447d2a354e4132b9cbb75'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:41.908911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3602bb57cb447d2a354e4132b9cbb75'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:41.909668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57cf2b-75f8-4861-9746-458310a1556f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:41.919610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57cf2b-75f8-4861-9746-458310a1556f service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:41.922456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3602bb57cb447d2a354e4132b9cbb75'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:41.927159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3602bb57cb447d2a354e4132b9cbb75'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:41.945148 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3047/6134] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:41 2022] DELETE /identity/v3/users/b3602bb57cb447d2a354e4132b9cbb75 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:41.946170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:41.948724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:41.958794 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3088/6135] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:42.068650 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:42.126599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484f0d2-fa40-4d37-bc1e-e1789a5a32bc tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:42.146673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:42.146673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:42.146673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:42.146945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/users/16f8132e1ce74723982c42edb734e0bf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:42.146945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:delete_user(user_id=16f8132e1ce74723982c42edb734e0bf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:42.146945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:42.260053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f8132e1ce74723982c42edb734e0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.294975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f8132e1ce74723982c42edb734e0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.305966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f8132e1ce74723982c42edb734e0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.314954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f8132e1ce74723982c42edb734e0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.322061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f8132e1ce74723982c42edb734e0bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.331346 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3048/6136] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:41 2022] DELETE /identity/v3/users/16f8132e1ce74723982c42edb734e0bf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:42.336432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57cf2b-75f8-4861-9746-458310a1556f service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:42.362645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57cf2b-75f8-4861-9746-458310a1556f service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:42.595177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:42.596325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:42.596873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:42.597567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/domains/5810acbd36604cdebc202f1de8eae392` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:42.602308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5810acbd36604cdebc202f1de8eae392)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:42.604808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:42.664284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5810acbd36604cdebc202f1de8eae392'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.665408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5810acbd36604cdebc202f1de8eae392'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.738184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5810acbd36604cdebc202f1de8eae392'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.739065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5810acbd36604cdebc202f1de8eae392'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.749098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:42.751831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:42.759876 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3089/6137] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:12:42 2022] PATCH /identity/v3/domains/5810acbd36604cdebc202f1de8eae392 => generated 275 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:42.769260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246923-d835-4a2c-a5b7-10eb6f93c0eb tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:42.874661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e8d8bbd912429aa9d39c6e3d8c0d5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae3dd282894448cbb31e095951e293bd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:42.876741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:42.878354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:42.878849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] PATH_INFO: `/v3/domains/5810acbd36604cdebc202f1de8eae392` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:42.903702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5810acbd36604cdebc202f1de8eae392)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:42.906323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:42.954445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5810acbd36604cdebc202f1de8eae392'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:42.975320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5810acbd36604cdebc202f1de8eae392'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.080241 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:43.110106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5810acbd36604cdebc202f1de8eae392', 'request_id': 'req-7e7313a9-d4e3-426d-82b0-18071793adef'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.121033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5810acbd36604cdebc202f1de8eae392', 'request_id': 'req-7e7313a9-d4e3-426d-82b0-18071793adef'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.130689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5810acbd36604cdebc202f1de8eae392', 'request_id': 'req-7e7313a9-d4e3-426d-82b0-18071793adef'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.153836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] The token cache is being invalidate because project 5810acbd36604cdebc202f1de8eae392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:43.156821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.157691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.168433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5810acbd36604cdebc202f1de8eae392', 'request_id': 'req-7e7313a9-d4e3-426d-82b0-18071793adef'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.169291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5810acbd36604cdebc202f1de8eae392', 'request_id': 'req-7e7313a9-d4e3-426d-82b0-18071793adef'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.170028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5810acbd36604cdebc202f1de8eae392', 'request_id': 'req-7e7313a9-d4e3-426d-82b0-18071793adef'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.181852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:43.182962 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3049/6138] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:12:42 2022] DELETE /identity/v3/domains/5810acbd36604cdebc202f1de8eae392 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:43.185929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:43.191376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:43.193707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:43.211288 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:43.342505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7313a9-d4e3-426d-82b0-18071793adef tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:43.355965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:43.356661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:43.356946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:43.357555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] PATH_INFO: `/v3/users/3e98d4eddbd74ee58016eeb3d8b4a8f8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:43.362213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e98d4eddbd74ee58016eeb3d8b4a8f8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:43.379288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:43.386929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e9452-92ab-40bd-a35e-0006f2d9f749 tempest-UsersV3TestJSON-915190738 tempest-UsersV3TestJSON-915190738-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:43.399097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:43.399798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:43.400071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:43.400412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] PATH_INFO: `/v3/projects/e43e312fe1784fa3a33e8d73d7855496` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:43.401705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43e312fe1784fa3a33e8d73d7855496)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:43.406696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:43.521343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e98d4eddbd74ee58016eeb3d8b4a8f8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.551388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43e312fe1784fa3a33e8d73d7855496', 'request_id': 'req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.564940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e98d4eddbd74ee58016eeb3d8b4a8f8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.568260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43e312fe1784fa3a33e8d73d7855496', 'request_id': 'req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.586212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43e312fe1784fa3a33e8d73d7855496', 'request_id': 'req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.586514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e98d4eddbd74ee58016eeb3d8b4a8f8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.604534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e98d4eddbd74ee58016eeb3d8b4a8f8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.607128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-61996e36-7a2a-470e-bcda-253650e891c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e98d4eddbd74ee58016eeb3d8b4a8f8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.608402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] The token cache is being invalidate because project e43e312fe1784fa3a33e8d73d7855496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:43.608728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.611492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:43.614792 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3090/6139] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:43 2022] DELETE /identity/v3/projects/e43e312fe1784fa3a33e8d73d7855496 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:43.621085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:43.622977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:43.628788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3050/6140] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:43 2022] DELETE /identity/v3/users/3e98d4eddbd74ee58016eeb3d8b4a8f8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:43.635975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd00a2e-534d-426b-846c-19911aa5ceac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:43.636715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd00a2e-534d-426b-846c-19911aa5ceac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:43.638493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd00a2e-534d-426b-846c-19911aa5ceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:43.739684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3fd00a2e-534d-426b-846c-19911aa5ceac None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:43.747598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3fd00a2e-534d-426b-846c-19911aa5ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:43.773650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a504a-5a81-4df2-b4cf-f32d5a090f96 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:43.799646 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:43.915226 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3051/6141] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:43.918785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd00a2e-534d-426b-846c-19911aa5ceac None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:43.922170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3fd00a2e-534d-426b-846c-19911aa5ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:43.935410 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:43.971129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:43.973977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:43.973977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:43.973977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] PATH_INFO: `/v3/users/da4ddb6b5cb8400ab4b461f40bd27b75` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:43.978838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4ddb6b5cb8400ab4b461f40bd27b75)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:43.985818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:44.120702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd00a2e-534d-426b-846c-19911aa5ceac None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:44.124758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4ddb6b5cb8400ab4b461f40bd27b75'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:44.135945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f82e0c2ba43d7b8585818b4ed4351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b818f6d34c0453f9eeacbe7eabdf475', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:44.136583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:44.136895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:44.137174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:44.137864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:44.138140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:44.139766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:44.156291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4ddb6b5cb8400ab4b461f40bd27b75'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:44.172519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4ddb6b5cb8400ab4b461f40bd27b75'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:44.189937 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3052/6142] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:44.194431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:44.200612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4ddb6b5cb8400ab4b461f40bd27b75'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:44.202380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:44.204190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4ddb6b5cb8400ab4b461f40bd27b75'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:44.224090 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3091/6143] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:43 2022] DELETE /identity/v3/users/da4ddb6b5cb8400ab4b461f40bd27b75 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:44.226963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:44.229228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:44.372447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a058d-6b64-43a4-bed9-fcfbecfc2248 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:44.379306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7ef18-314a-4c9d-af77-a0e00b8a6f5a tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f82e0c2ba43d7b8585818b4ed4351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b818f6d34c0453f9eeacbe7eabdf475', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:44.381595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ef18-314a-4c9d-af77-a0e00b8a6f5a tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:44.382220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ef18-314a-4c9d-af77-a0e00b8a6f5a tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:44.382773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ef18-314a-4c9d-af77-a0e00b8a6f5a tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:44.383848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7ef18-314a-4c9d-af77-a0e00b8a6f5a tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:44.386742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7ef18-314a-4c9d-af77-a0e00b8a6f5a tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:44.406577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8e75d-76a1-4464-8976-c37be4579e24 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:44.449421 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3092/6144] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:44 2022] POST /identity/v3/projects => generated 347 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:44.455881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7ef18-314a-4c9d-af77-a0e00b8a6f5a tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:44.580332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:44.582850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:44.584351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:44.584351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:44.588568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:44.638806 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:44.681486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7ef18-314a-4c9d-af77-a0e00b8a6f5a tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:44.688984 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:44.731332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f82e0c2ba43d7b8585818b4ed4351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b818f6d34c0453f9eeacbe7eabdf475', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:44.733739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:44.738567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:44.740112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:44.747034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:44.748842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:44.754179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:44.800203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:44.802665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:44.817514 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3093/6145] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:44.818751 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3053/6146] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:45.390871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:45.391024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:45.392551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:45.393099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:45.418967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d52247-fb70-4c7b-acd2-fc7d3b2aa4ca service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:45.559088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877ee15-572a-4f06-8455-d640333fee35 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:45.570485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:45.571190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:45.571435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:45.571714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] PATH_INFO: `/v3/projects/6ad6f56334b7425ca161891119e7c161` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:45.573469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad6f56334b7425ca161891119e7c161)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:45.578385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:45.584351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae0ea-dd66-4ff2-ac96-832521bb62bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:45.585784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae0ea-dd66-4ff2-ac96-832521bb62bf service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:45.586307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae0ea-dd66-4ff2-ac96-832521bb62bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:45.586841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae0ea-dd66-4ff2-ac96-832521bb62bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:45.589840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e9cae0ea-dd66-4ff2-ac96-832521bb62bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:45.608835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae0ea-dd66-4ff2-ac96-832521bb62bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:45.610214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae0ea-dd66-4ff2-ac96-832521bb62bf service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:45.634720 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3054/6147] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:12:45.635630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae0ea-dd66-4ff2-ac96-832521bb62bf service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:45.652989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae0ea-dd66-4ff2-ac96-832521bb62bf service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:45.664917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad6f56334b7425ca161891119e7c161', 'request_id': 'req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.705363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad6f56334b7425ca161891119e7c161', 'request_id': 'req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.717152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad6f56334b7425ca161891119e7c161', 'request_id': 'req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.732662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] The token cache is being invalidate because project 6ad6f56334b7425ca161891119e7c161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:45.733042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.733790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.738683 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3094/6148] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:45 2022] DELETE /identity/v3/projects/6ad6f56334b7425ca161891119e7c161 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:45.738683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:45.738683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:45.825299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f82e0c2ba43d7b8585818b4ed4351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b818f6d34c0453f9eeacbe7eabdf475', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:45.826531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:45.826918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:45.827486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] PATH_INFO: `/v3/projects/906cf4cd46ca435a9a70e215fe219e3b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:45.828818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Authorizing `identity:delete_project(project_id=906cf4cd46ca435a9a70e215fe219e3b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:45.831154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:45.861803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec0e7-34ea-4e53-bf1b-48e14b7f8823 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:45.867258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:45.867899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:45.868176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:45.868442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] PATH_INFO: `/v3/projects/3a9b07a7b702454c8e17b3aec0ca75f5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:45.869808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9b07a7b702454c8e17b3aec0ca75f5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:45.872109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:45.898190 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:45.936102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906cf4cd46ca435a9a70e215fe219e3b', 'request_id': 'req-4300c5d2-740e-4ef3-88a6-b541143a9ca4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.953363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906cf4cd46ca435a9a70e215fe219e3b', 'request_id': 'req-4300c5d2-740e-4ef3-88a6-b541143a9ca4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.954899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9b07a7b702454c8e17b3aec0ca75f5', 'request_id': 'req-5a59e2e5-a5d4-4438-9386-3982ea19e83e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.966795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9b07a7b702454c8e17b3aec0ca75f5', 'request_id': 'req-5a59e2e5-a5d4-4438-9386-3982ea19e83e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.976470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9b07a7b702454c8e17b3aec0ca75f5', 'request_id': 'req-5a59e2e5-a5d4-4438-9386-3982ea19e83e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.977060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906cf4cd46ca435a9a70e215fe219e3b', 'request_id': 'req-4300c5d2-740e-4ef3-88a6-b541143a9ca4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.981530 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:45.996878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] The token cache is being invalidate because project 3a9b07a7b702454c8e17b3aec0ca75f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:45.997315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:45.998397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5a59e2e5-a5d4-4438-9386-3982ea19e83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:46.004387 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3095/6149] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:45 2022] DELETE /identity/v3/projects/3a9b07a7b702454c8e17b3aec0ca75f5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:46.004387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e5453-3505-47ce-9017-4b409abb830a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:46.004387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e5453-3505-47ce-9017-4b409abb830a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:46.004387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e5453-3505-47ce-9017-4b409abb830a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:46.004852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] The token cache is being invalidate because project 906cf4cd46ca435a9a70e215fe219e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:46.004852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:46.005217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:46.007270 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3055/6150] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:45 2022] DELETE /identity/v3/projects/906cf4cd46ca435a9a70e215fe219e3b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:46.012426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:46.013875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:46.039497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-866e5453-3505-47ce-9017-4b409abb830a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:46.041088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-866e5453-3505-47ce-9017-4b409abb830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:46.115798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300c5d2-740e-4ef3-88a6-b541143a9ca4 tempest-RoutersIpV6AdminTest-1137644598 tempest-RoutersIpV6AdminTest-1137644598-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:46.121558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:46.128010 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3096/6151] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:46.128010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e5453-3505-47ce-9017-4b409abb830a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:46.129384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:46.129868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:46.130086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-866e5453-3505-47ce-9017-4b409abb830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:46.130481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] PATH_INFO: `/v3/users/35e8d8bbd912429aa9d39c6e3d8c0d5d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:46.133543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e8d8bbd912429aa9d39c6e3d8c0d5d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:46.135683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:46.214705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e5453-3505-47ce-9017-4b409abb830a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:46.220315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:46.221301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:46.221585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:46.221860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:46.223719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:46.238636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e8d8bbd912429aa9d39c6e3d8c0d5d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:46.271064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e8d8bbd912429aa9d39c6e3d8c0d5d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:46.313308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e8d8bbd912429aa9d39c6e3d8c0d5d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:46.332769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e8d8bbd912429aa9d39c6e3d8c0d5d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:46.335653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb07e0f9-614c-4ceb-afb1-3438fbe9e6f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e8d8bbd912429aa9d39c6e3d8c0d5d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:46.353342 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3056/6152] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:46 2022] DELETE /identity/v3/users/35e8d8bbd912429aa9d39c6e3d8c0d5d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:46.355011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e90374-d015-413d-8119-1e0e40db07a3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:46.356129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e90374-d015-413d-8119-1e0e40db07a3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:46.360151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e90374-d015-413d-8119-1e0e40db07a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:46.470572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:46.473163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-09e90374-d015-413d-8119-1e0e40db07a3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:46.474414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09e90374-d015-413d-8119-1e0e40db07a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:46.478173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:46.567546 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:46.598483 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3097/6153] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:46.617537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:46.624130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:46.635584 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3057/6154] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:46.642320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e90374-d015-413d-8119-1e0e40db07a3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:46.656178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e90374-d015-413d-8119-1e0e40db07a3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:46.664043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469284bf-7cbf-4229-b2e7-62d81839c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:46.665347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469284bf-7cbf-4229-b2e7-62d81839c563 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:46.665649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469284bf-7cbf-4229-b2e7-62d81839c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:46.665938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469284bf-7cbf-4229-b2e7-62d81839c563 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:46.666668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469284bf-7cbf-4229-b2e7-62d81839c563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:46.666976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469284bf-7cbf-4229-b2e7-62d81839c563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:46.669336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469284bf-7cbf-4229-b2e7-62d81839c563 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:46.706870 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3058/6155] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:46.711130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469284bf-7cbf-4229-b2e7-62d81839c563 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:46.719372 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:46.748838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469284bf-7cbf-4229-b2e7-62d81839c563 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:46.766720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665d101-5cfc-4264-b0e2-603d3b14b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:46.767354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665d101-5cfc-4264-b0e2-603d3b14b055 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:46.767638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665d101-5cfc-4264-b0e2-603d3b14b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:46.768042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665d101-5cfc-4264-b0e2-603d3b14b055 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:46.768727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665d101-5cfc-4264-b0e2-603d3b14b055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:46.776344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665d101-5cfc-4264-b0e2-603d3b14b055 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:46.827466 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3059/6156] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:46 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:46.831256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665d101-5cfc-4264-b0e2-603d3b14b055 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:46.877561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611298-c324-4c09-888b-ff3414b4c540 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:46.957932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665d101-5cfc-4264-b0e2-603d3b14b055 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:46.974804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54c86f-5ef6-4b32-8c0e-bf312fc02a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:46.976451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c86f-5ef6-4b32-8c0e-bf312fc02a94 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:46.976818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c86f-5ef6-4b32-8c0e-bf312fc02a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:46.977105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c86f-5ef6-4b32-8c0e-bf312fc02a94 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:46.977760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54c86f-5ef6-4b32-8c0e-bf312fc02a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:46.981078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54c86f-5ef6-4b32-8c0e-bf312fc02a94 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:47.023196 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3060/6157] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:46 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:47.024457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983ce5a-f652-4a9c-858c-0864c4f8a365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:47.026876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ce5a-f652-4a9c-858c-0864c4f8a365 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:47.027270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ce5a-f652-4a9c-858c-0864c4f8a365 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:47.027650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ce5a-f652-4a9c-858c-0864c4f8a365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:47.031326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54c86f-5ef6-4b32-8c0e-bf312fc02a94 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:47.033155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a983ce5a-f652-4a9c-858c-0864c4f8a365 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:47.070164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54c86f-5ef6-4b32-8c0e-bf312fc02a94 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:47.083925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd69461-c56b-42e8-a1dc-689be8770786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:47.084703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd69461-c56b-42e8-a1dc-689be8770786 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:47.085005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd69461-c56b-42e8-a1dc-689be8770786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:47.085330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd69461-c56b-42e8-a1dc-689be8770786 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:47.086113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd69461-c56b-42e8-a1dc-689be8770786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:47.091155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd69461-c56b-42e8-a1dc-689be8770786 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:47.129326 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3061/6158] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:47.133369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd69461-c56b-42e8-a1dc-689be8770786 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:47.162721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd69461-c56b-42e8-a1dc-689be8770786 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:47.174117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275c750-e8e9-4c9d-b6c8-ef99e5d91f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:47.174753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275c750-e8e9-4c9d-b6c8-ef99e5d91f1d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:47.175896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275c750-e8e9-4c9d-b6c8-ef99e5d91f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:47.176186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275c750-e8e9-4c9d-b6c8-ef99e5d91f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:47.178412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275c750-e8e9-4c9d-b6c8-ef99e5d91f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:47.183914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275c750-e8e9-4c9d-b6c8-ef99e5d91f1d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:47.194995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983ce5a-f652-4a9c-858c-0864c4f8a365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:47.198750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983ce5a-f652-4a9c-858c-0864c4f8a365 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:47.212770 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3062/6159] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:12:47.216906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275c750-e8e9-4c9d-b6c8-ef99e5d91f1d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:47.221066 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3098/6160] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:47.248925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275c750-e8e9-4c9d-b6c8-ef99e5d91f1d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:47.266600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b18c10-0fba-450a-939c-73179801bf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:47.267631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b18c10-0fba-450a-939c-73179801bf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:47.270270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b18c10-0fba-450a-939c-73179801bf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:47.270484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b18c10-0fba-450a-939c-73179801bf32 admin admin] PATH_INFO: `/v3/projects/0b5703b4f4cc4a6985347d13e4fb144f/users/9c1e7872c95843fda91a63f79dabf9c5/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:47.313554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b18c10-0fba-450a-939c-73179801bf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5703b4f4cc4a6985347d13e4fb144f, user_id=9c1e7872c95843fda91a63f79dabf9c5, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:47.320875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b18c10-0fba-450a-939c-73179801bf32 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:47.355004 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3063/6161] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:47 2022] PUT /identity/v3/projects/0b5703b4f4cc4a6985347d13e4fb144f/users/9c1e7872c95843fda91a63f79dabf9c5/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:47.367780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945fe7-92bf-4087-88c9-031e51a1c645 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:47.367780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945fe7-92bf-4087-88c9-031e51a1c645 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:47.368057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945fe7-92bf-4087-88c9-031e51a1c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:47.429969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7d945fe7-92bf-4087-88c9-031e51a1c645 None None] MFA Rules not processed for user `9c1e7872c95843fda91a63f79dabf9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:47.431191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d945fe7-92bf-4087-88c9-031e51a1c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:47.529386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b18c10-0fba-450a-939c-73179801bf32 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:47.531546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f2b18c10-0fba-450a-939c-73179801bf32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:47.545142 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:47.566361 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3099/6162] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:47.571477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945fe7-92bf-4087-88c9-031e51a1c645 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:47.737984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945fe7-92bf-4087-88c9-031e51a1c645 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:47.757268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e46c91-ca70-4506-bcd1-7b51ec78dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:47.758052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b18c10-0fba-450a-939c-73179801bf32 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:47.758200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e46c91-ca70-4506-bcd1-7b51ec78dca3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:47.758334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e46c91-ca70-4506-bcd1-7b51ec78dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:47.758668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e46c91-ca70-4506-bcd1-7b51ec78dca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:47.759354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e46c91-ca70-4506-bcd1-7b51ec78dca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:47.765829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e46c91-ca70-4506-bcd1-7b51ec78dca3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:47.771286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:47.771939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:47.772354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:47.773219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] PATH_INFO: `/v3/projects/ae3dd282894448cbb31e095951e293bd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:47.779354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3dd282894448cbb31e095951e293bd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:47.782381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:47.870806 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:47.878987 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3100/6163] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:47 2022] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:47.882723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e46c91-ca70-4506-bcd1-7b51ec78dca3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:47.921693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3dd282894448cbb31e095951e293bd', 'request_id': 'req-adb69a16-99d4-4ab5-94f7-e51a45b81f43'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:47.940939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3dd282894448cbb31e095951e293bd', 'request_id': 'req-adb69a16-99d4-4ab5-94f7-e51a45b81f43'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:47.969311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3dd282894448cbb31e095951e293bd', 'request_id': 'req-adb69a16-99d4-4ab5-94f7-e51a45b81f43'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:47.992125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] The token cache is being invalidate because project ae3dd282894448cbb31e095951e293bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:47.992592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:47.997104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-adb69a16-99d4-4ab5-94f7-e51a45b81f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:48.000514 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3064/6164] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:47 2022] DELETE /identity/v3/projects/ae3dd282894448cbb31e095951e293bd => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:48.006709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fe6a4-18f6-4ac0-b109-0e3cc6c380fc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:48.007493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fe6a4-18f6-4ac0-b109-0e3cc6c380fc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:48.007936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fe6a4-18f6-4ac0-b109-0e3cc6c380fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:48.097785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e46c91-ca70-4506-bcd1-7b51ec78dca3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:48.099826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3e1fe6a4-18f6-4ac0-b109-0e3cc6c380fc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:48.101677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3e1fe6a4-18f6-4ac0-b109-0e3cc6c380fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:48.262229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290a53-d46e-4ca2-b006-b8fc0d565e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:48.262889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290a53-d46e-4ca2-b006-b8fc0d565e28 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:48.263232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290a53-d46e-4ca2-b006-b8fc0d565e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:48.263512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290a53-d46e-4ca2-b006-b8fc0d565e28 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:48.265705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290a53-d46e-4ca2-b006-b8fc0d565e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:48.266346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290a53-d46e-4ca2-b006-b8fc0d565e28 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:48.297971 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3065/6165] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:12:48.302172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e381bda-e608-4eb4-b402-088f9533d8e5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:48.304991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e381bda-e608-4eb4-b402-088f9533d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:48.305519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e381bda-e608-4eb4-b402-088f9533d8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:48.331102 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3101/6166] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:47 2022] POST /identity/v3/users => generated 296 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:48.334398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290a53-d46e-4ca2-b006-b8fc0d565e28 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:48.336665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85290a53-d46e-4ca2-b006-b8fc0d565e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:48.380701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290a53-d46e-4ca2-b006-b8fc0d565e28 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:48.385837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8e381bda-e608-4eb4-b402-088f9533d8e5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:48.387127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8e381bda-e608-4eb4-b402-088f9533d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:48.403207 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3066/6167] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:48.403207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e381bda-e608-4eb4-b402-088f9533d8e5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:48.403513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f274ff-ea40-49fa-928c-dbb8dbfcec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:48.403513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f274ff-ea40-49fa-928c-dbb8dbfcec93 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:48.403708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f274ff-ea40-49fa-928c-dbb8dbfcec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:48.404264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f274ff-ea40-49fa-928c-dbb8dbfcec93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:48.404599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f274ff-ea40-49fa-928c-dbb8dbfcec93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:48.405233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8e381bda-e608-4eb4-b402-088f9533d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:48.406231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f274ff-ea40-49fa-928c-dbb8dbfcec93 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:48.451811 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3102/6168] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:48.451811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f274ff-ea40-49fa-928c-dbb8dbfcec93 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:48.468961 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:48.485203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f274ff-ea40-49fa-928c-dbb8dbfcec93 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:48.498747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25b0c0-299b-42c3-8b47-d4f06df9101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:48.499160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25b0c0-299b-42c3-8b47-d4f06df9101e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:48.499456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25b0c0-299b-42c3-8b47-d4f06df9101e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:48.502947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25b0c0-299b-42c3-8b47-d4f06df9101e admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:48.507922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25b0c0-299b-42c3-8b47-d4f06df9101e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:48.512046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25b0c0-299b-42c3-8b47-d4f06df9101e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:48.520826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25b0c0-299b-42c3-8b47-d4f06df9101e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:48.536511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e381bda-e608-4eb4-b402-088f9533d8e5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:48.548153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367ce4d-50ee-4e2b-9f21-c655c5ee8ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:48.549223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367ce4d-50ee-4e2b-9f21-c655c5ee8ddb service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:48.549516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367ce4d-50ee-4e2b-9f21-c655c5ee8ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:48.551635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367ce4d-50ee-4e2b-9f21-c655c5ee8ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:48.556953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0367ce4d-50ee-4e2b-9f21-c655c5ee8ddb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:48.565106 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3103/6169] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:48.565106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25b0c0-299b-42c3-8b47-d4f06df9101e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:48.604191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25b0c0-299b-42c3-8b47-d4f06df9101e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:48.624354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8d66c-7249-4a19-bc51-f943f25e6d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:48.625095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8d66c-7249-4a19-bc51-f943f25e6d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:48.625379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8d66c-7249-4a19-bc51-f943f25e6d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:48.625752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8d66c-7249-4a19-bc51-f943f25e6d9f admin admin] PATH_INFO: `/v3/projects/3a094dc66bd8441ebc1472d0dbd8fac4/users/0987202eeb7d421c8a4db8335d0e64b8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:48.657577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8d66c-7249-4a19-bc51-f943f25e6d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a094dc66bd8441ebc1472d0dbd8fac4, user_id=0987202eeb7d421c8a4db8335d0e64b8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:48.675654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8d66c-7249-4a19-bc51-f943f25e6d9f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:48.736457 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3104/6170] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:48 2022] PUT /identity/v3/projects/3a094dc66bd8441ebc1472d0dbd8fac4/users/0987202eeb7d421c8a4db8335d0e64b8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:48.736457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8d66c-7249-4a19-bc51-f943f25e6d9f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:48.777425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367ce4d-50ee-4e2b-9f21-c655c5ee8ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:48.781875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367ce4d-50ee-4e2b-9f21-c655c5ee8ddb service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:48.790646 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:48.824341 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3067/6171] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:48.825753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367ce4d-50ee-4e2b-9f21-c655c5ee8ddb service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:48.874558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367ce4d-50ee-4e2b-9f21-c655c5ee8ddb service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:48.942865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8d66c-7249-4a19-bc51-f943f25e6d9f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:48.969409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363132d-5af5-4bab-9a33-dd013c717b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:48.970206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363132d-5af5-4bab-9a33-dd013c717b77 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:48.970735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363132d-5af5-4bab-9a33-dd013c717b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:48.971113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363132d-5af5-4bab-9a33-dd013c717b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:48.971869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363132d-5af5-4bab-9a33-dd013c717b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:48.973945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363132d-5af5-4bab-9a33-dd013c717b77 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:49.117918 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3105/6172] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:48 2022] POST /identity/v3/projects => generated 385 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:49.119484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363132d-5af5-4bab-9a33-dd013c717b77 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:49.125392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf6d9-79f5-46bc-a7d8-24e1f5d0e55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:49.126252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf6d9-79f5-46bc-a7d8-24e1f5d0e55f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:49.126605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf6d9-79f5-46bc-a7d8-24e1f5d0e55f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:49.126894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf6d9-79f5-46bc-a7d8-24e1f5d0e55f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:49.128519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acf6d9-79f5-46bc-a7d8-24e1f5d0e55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:49.133553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acf6d9-79f5-46bc-a7d8-24e1f5d0e55f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:49.160359 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3068/6173] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:49.165305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf6d9-79f5-46bc-a7d8-24e1f5d0e55f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:49.239106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf6d9-79f5-46bc-a7d8-24e1f5d0e55f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:49.352120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363132d-5af5-4bab-9a33-dd013c717b77 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:49.377305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd13790-d598-4a57-a76c-7143675e4033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:49.378110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd13790-d598-4a57-a76c-7143675e4033 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:49.378402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd13790-d598-4a57-a76c-7143675e4033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:49.378677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd13790-d598-4a57-a76c-7143675e4033 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:49.379509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd13790-d598-4a57-a76c-7143675e4033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:49.393103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd13790-d598-4a57-a76c-7143675e4033 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:49.434050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d921512-8ed8-4090-8de1-fc4f38d64d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:49.435439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921512-8ed8-4090-8de1-fc4f38d64d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:49.435999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921512-8ed8-4090-8de1-fc4f38d64d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:49.436497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921512-8ed8-4090-8de1-fc4f38d64d38 admin admin] PATH_INFO: `/v3/projects/3a094dc66bd8441ebc1472d0dbd8fac4/users/0987202eeb7d421c8a4db8335d0e64b8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:49.439173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d921512-8ed8-4090-8de1-fc4f38d64d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a094dc66bd8441ebc1472d0dbd8fac4, user_id=0987202eeb7d421c8a4db8335d0e64b8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:49.443330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d921512-8ed8-4090-8de1-fc4f38d64d38 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:49.463492 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3069/6174] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:49 2022] PUT /identity/v3/projects/3a094dc66bd8441ebc1472d0dbd8fac4/users/0987202eeb7d421c8a4db8335d0e64b8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:49.474035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a875f-9ab9-42e3-9842-dc00fa5ec14b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:49.474371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a875f-9ab9-42e3-9842-dc00fa5ec14b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:49.474587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a875f-9ab9-42e3-9842-dc00fa5ec14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:49.493490 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3106/6175] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:49 2022] POST /identity/v3/users => generated 293 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:49.497975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd13790-d598-4a57-a76c-7143675e4033 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:49.551367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b48a875f-9ab9-42e3-9842-dc00fa5ec14b None None] MFA Rules not processed for user `0987202eeb7d421c8a4db8335d0e64b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:49.552630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b48a875f-9ab9-42e3-9842-dc00fa5ec14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:49.568452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd13790-d598-4a57-a76c-7143675e4033 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:49.790910 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:49.810555 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3070/6176] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:49.819822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a875f-9ab9-42e3-9842-dc00fa5ec14b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:49.821459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b48a875f-9ab9-42e3-9842-dc00fa5ec14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:49.888882 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:49.890590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152f5df-8018-41fc-a156-34161c2b9de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:49.891396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152f5df-8018-41fc-a156-34161c2b9de9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:49.891825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152f5df-8018-41fc-a156-34161c2b9de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:49.892248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152f5df-8018-41fc-a156-34161c2b9de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:49.893104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152f5df-8018-41fc-a156-34161c2b9de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:49.896138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152f5df-8018-41fc-a156-34161c2b9de9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:49.925719 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3107/6177] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:49.926962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152f5df-8018-41fc-a156-34161c2b9de9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:49.950929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152f5df-8018-41fc-a156-34161c2b9de9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:49.967090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd689999-6da9-45b8-afd4-63537d632a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:49.967983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd689999-6da9-45b8-afd4-63537d632a91 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:49.968554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd689999-6da9-45b8-afd4-63537d632a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:49.968997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd689999-6da9-45b8-afd4-63537d632a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:49.969785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd689999-6da9-45b8-afd4-63537d632a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:49.971554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd689999-6da9-45b8-afd4-63537d632a91 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:50.010790 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3108/6178] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:50.014895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd689999-6da9-45b8-afd4-63537d632a91 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:50.035421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd689999-6da9-45b8-afd4-63537d632a91 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:50.052270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001ef79-0919-44c5-8c1c-fba692b2332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:50.053001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ef79-0919-44c5-8c1c-fba692b2332e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:50.053320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ef79-0919-44c5-8c1c-fba692b2332e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:50.053685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ef79-0919-44c5-8c1c-fba692b2332e admin admin] PATH_INFO: `/v3/projects/b3326c3e026b4a51a34643992c915337/users/e236296117934a7abf11f8e41ede8640/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:50.054245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a875f-9ab9-42e3-9842-dc00fa5ec14b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:50.070446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e8674-b50b-492c-bdcd-66802057cd33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:50.071081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e8674-b50b-492c-bdcd-66802057cd33 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:50.071361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e8674-b50b-492c-bdcd-66802057cd33 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:50.071878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e8674-b50b-492c-bdcd-66802057cd33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:50.087384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001ef79-0919-44c5-8c1c-fba692b2332e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3326c3e026b4a51a34643992c915337, user_id=e236296117934a7abf11f8e41ede8640, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:50.093247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001ef79-0919-44c5-8c1c-fba692b2332e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:50.105284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e8674-b50b-492c-bdcd-66802057cd33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:50.106924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e8674-b50b-492c-bdcd-66802057cd33 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:50.132418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3109/6179] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:50 2022] PUT /identity/v3/projects/b3326c3e026b4a51a34643992c915337/users/e236296117934a7abf11f8e41ede8640/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:50.154849 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3071/6180] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:12:50.157125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae04e8-0ff9-487e-8094-a3af9c7671a4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:50.158339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae04e8-0ff9-487e-8094-a3af9c7671a4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:50.158768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae04e8-0ff9-487e-8094-a3af9c7671a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:50.284248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a9ae04e8-0ff9-487e-8094-a3af9c7671a4 None None] MFA Rules not processed for user `e236296117934a7abf11f8e41ede8640`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:50.285531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a9ae04e8-0ff9-487e-8094-a3af9c7671a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:50.549645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e8674-b50b-492c-bdcd-66802057cd33 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:50.565836 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3110/6181] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:50.590057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e8674-b50b-492c-bdcd-66802057cd33 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:50.763648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da433e7-9cff-4501-8ef3-575bacbb46d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:50.764344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da433e7-9cff-4501-8ef3-575bacbb46d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:50.764654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da433e7-9cff-4501-8ef3-575bacbb46d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:50.764942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da433e7-9cff-4501-8ef3-575bacbb46d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:50.767585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da433e7-9cff-4501-8ef3-575bacbb46d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:50.770532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da433e7-9cff-4501-8ef3-575bacbb46d2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:50.853464 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3072/6182] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:50 2022] POST /identity/v3/projects => generated 383 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:50.854886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae04e8-0ff9-487e-8094-a3af9c7671a4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:50.902024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae04e8-0ff9-487e-8094-a3af9c7671a4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:50.987220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da433e7-9cff-4501-8ef3-575bacbb46d2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:50.992070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0da433e7-9cff-4501-8ef3-575bacbb46d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:51.168007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286cfe6-e3c6-4bcb-a15d-031cd95059ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:51.168652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286cfe6-e3c6-4bcb-a15d-031cd95059ca admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:51.171418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286cfe6-e3c6-4bcb-a15d-031cd95059ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:51.185219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286cfe6-e3c6-4bcb-a15d-031cd95059ca admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:51.185955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286cfe6-e3c6-4bcb-a15d-031cd95059ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:51.187881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286cfe6-e3c6-4bcb-a15d-031cd95059ca admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:51.250303 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3111/6183] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:50 2022] POST /identity/v3/users => generated 298 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:51.251002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286cfe6-e3c6-4bcb-a15d-031cd95059ca admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:51.262981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da433e7-9cff-4501-8ef3-575bacbb46d2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:51.274090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb54546-3382-4b29-8f4b-69053b47bdd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:51.275510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54546-3382-4b29-8f4b-69053b47bdd6 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:51.277160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54546-3382-4b29-8f4b-69053b47bdd6 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:51.277553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54546-3382-4b29-8f4b-69053b47bdd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:51.285494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5eb54546-3382-4b29-8f4b-69053b47bdd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:51.292289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286cfe6-e3c6-4bcb-a15d-031cd95059ca admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:51.307129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:51.310057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:51.310344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:51.310622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] PATH_INFO: `/v3/users/9c1e7872c95843fda91a63f79dabf9c5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:51.313860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1e7872c95843fda91a63f79dabf9c5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:51.317785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:51.372989 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:51.388967 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:51.504959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb54546-3382-4b29-8f4b-69053b47bdd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:51.507671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1e7872c95843fda91a63f79dabf9c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:51.508261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb54546-3382-4b29-8f4b-69053b47bdd6 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:51.557801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1e7872c95843fda91a63f79dabf9c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:51.574666 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3073/6184] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:12:51.575414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb54546-3382-4b29-8f4b-69053b47bdd6 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:51.594276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1e7872c95843fda91a63f79dabf9c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:51.618883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1e7872c95843fda91a63f79dabf9c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:51.620991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f8dafa5-17df-4abc-bec1-70aae0e9a4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1e7872c95843fda91a63f79dabf9c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:51.631559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb54546-3382-4b29-8f4b-69053b47bdd6 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:51.638319 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3112/6185] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:51 2022] DELETE /identity/v3/users/9c1e7872c95843fda91a63f79dabf9c5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:51.651028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09088dd-91cc-4a2b-a835-dc3495824381 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:51.651363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09088dd-91cc-4a2b-a835-dc3495824381 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:51.652445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09088dd-91cc-4a2b-a835-dc3495824381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:51.655777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9516d7b-d75d-463f-a158-e45b554a68fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:51.656406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9516d7b-d75d-463f-a158-e45b554a68fa admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:51.656707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9516d7b-d75d-463f-a158-e45b554a68fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:51.656978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9516d7b-d75d-463f-a158-e45b554a68fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:51.657621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9516d7b-d75d-463f-a158-e45b554a68fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:51.659221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9516d7b-d75d-463f-a158-e45b554a68fa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:51.699019 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3074/6186] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:51.700065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9516d7b-d75d-463f-a158-e45b554a68fa admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:51.707555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d9516d7b-d75d-463f-a158-e45b554a68fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:51.716984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b09088dd-91cc-4a2b-a835-dc3495824381 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:51.718206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b09088dd-91cc-4a2b-a835-dc3495824381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:51.739931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9516d7b-d75d-463f-a158-e45b554a68fa admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:51.834764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56d2a4-9490-4c84-a5e9-969e216370b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:51.835500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56d2a4-9490-4c84-a5e9-969e216370b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:51.835834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56d2a4-9490-4c84-a5e9-969e216370b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:51.836118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56d2a4-9490-4c84-a5e9-969e216370b3 admin admin] PATH_INFO: `/v3/projects/d2dacecabdcf4a52b127650cc01041d6/users/142d48b202e14c5e8f2120a8e368699b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:51.888170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56d2a4-9490-4c84-a5e9-969e216370b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2dacecabdcf4a52b127650cc01041d6, user_id=142d48b202e14c5e8f2120a8e368699b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:51.894081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56d2a4-9490-4c84-a5e9-969e216370b3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:51.919336 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3113/6187] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:51.930699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09088dd-91cc-4a2b-a835-dc3495824381 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:51.932172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b09088dd-91cc-4a2b-a835-dc3495824381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:51.948865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3075/6188] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:51 2022] PUT /identity/v3/projects/d2dacecabdcf4a52b127650cc01041d6/users/142d48b202e14c5e8f2120a8e368699b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:51.950125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56d2a4-9490-4c84-a5e9-969e216370b3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:52.088290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09088dd-91cc-4a2b-a835-dc3495824381 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:52.166808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56d2a4-9490-4c84-a5e9-969e216370b3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:52.192080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df582e-4a33-4526-8ada-7f81528c2b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:52.193399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df582e-4a33-4526-8ada-7f81528c2b44 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:52.193799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df582e-4a33-4526-8ada-7f81528c2b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:52.196195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df582e-4a33-4526-8ada-7f81528c2b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:52.197151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df582e-4a33-4526-8ada-7f81528c2b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:52.199783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df582e-4a33-4526-8ada-7f81528c2b44 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:52.231598 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3076/6189] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:52.234875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df582e-4a33-4526-8ada-7f81528c2b44 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:52.243810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c099c-73e2-4a01-8d0d-0659a57a3d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:52.244538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c099c-73e2-4a01-8d0d-0659a57a3d51 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:52.244913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c099c-73e2-4a01-8d0d-0659a57a3d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:52.245256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c099c-73e2-4a01-8d0d-0659a57a3d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:52.256174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df582e-4a33-4526-8ada-7f81528c2b44 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:52.262669 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:52.276882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c099c-73e2-4a01-8d0d-0659a57a3d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:52.278393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c099c-73e2-4a01-8d0d-0659a57a3d51 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:52.285568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605abdd-6e05-42c7-8b85-f36be8615287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:52.286243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605abdd-6e05-42c7-8b85-f36be8615287 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:52.286583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605abdd-6e05-42c7-8b85-f36be8615287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:52.286922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605abdd-6e05-42c7-8b85-f36be8615287 admin admin] PATH_INFO: `/v3/projects/d2dacecabdcf4a52b127650cc01041d6/users/142d48b202e14c5e8f2120a8e368699b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:52.293551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605abdd-6e05-42c7-8b85-f36be8615287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2dacecabdcf4a52b127650cc01041d6, user_id=142d48b202e14c5e8f2120a8e368699b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:52.305310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605abdd-6e05-42c7-8b85-f36be8615287 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:52.323271 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3114/6190] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:12:52.342157 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3077/6191] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:52 2022] PUT /identity/v3/projects/d2dacecabdcf4a52b127650cc01041d6/users/142d48b202e14c5e8f2120a8e368699b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:52.353794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fad26-e09d-48d3-a6f5-0c736d87c980 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:52.354076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fad26-e09d-48d3-a6f5-0c736d87c980 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:52.354723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fad26-e09d-48d3-a6f5-0c736d87c980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:52.414864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bb0fad26-e09d-48d3-a6f5-0c736d87c980 None None] MFA Rules not processed for user `142d48b202e14c5e8f2120a8e368699b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:52.416139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bb0fad26-e09d-48d3-a6f5-0c736d87c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:52.572967 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3115/6192] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:52.577859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605abdd-6e05-42c7-8b85-f36be8615287 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:52.599114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605abdd-6e05-42c7-8b85-f36be8615287 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:52.605098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d4f5-75ce-412c-932e-79976b6a4005 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:52.606133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d4f5-75ce-412c-932e-79976b6a4005 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:52.606649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d4f5-75ce-412c-932e-79976b6a4005 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:52.606935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d4f5-75ce-412c-932e-79976b6a4005 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:52.607644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828d4f5-75ce-412c-932e-79976b6a4005 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:52.616895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828d4f5-75ce-412c-932e-79976b6a4005 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:52.634401 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:52.673241 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3078/6193] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:52 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:52.677416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fad26-e09d-48d3-a6f5-0c736d87c980 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:52.690791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fad26-e09d-48d3-a6f5-0c736d87c980 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:52.778678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f96a8-776e-4d55-b4f3-789cecc84302 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:52.779664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f96a8-776e-4d55-b4f3-789cecc84302 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:52.780059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f96a8-776e-4d55-b4f3-789cecc84302 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:52.780457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f96a8-776e-4d55-b4f3-789cecc84302 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags/tempest-tag-1685102620` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:52.781874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f96a8-776e-4d55-b4f3-789cecc84302 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=87d0c095dfaf4ee1b6c5a884f1aab5e3, value=tempest-tag-1685102620)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:52.790844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f96a8-776e-4d55-b4f3-789cecc84302 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:52.967790 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-f60f96a8-776e-4d55-b4f3-789cecc84302 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1685102620. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:12:52.967790 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:12:52.967790 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:52.993149 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3116/6194] 10.222.0.27 () {60 vars in 1333 bytes} [Wed Oct 19 01:12:52 2022] PUT /identity/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags/tempest-tag-1685102620 => generated 0 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 19 01:12:52.994771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d4f5-75ce-412c-932e-79976b6a4005 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:53.012005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d4f5-75ce-412c-932e-79976b6a4005 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:53.023549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ba705-9de8-479c-aee2-8921e0fc373e tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:53.024513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ba705-9de8-479c-aee2-8921e0fc373e tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:53.024841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ba705-9de8-479c-aee2-8921e0fc373e tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:53.025150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ba705-9de8-479c-aee2-8921e0fc373e tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags/tempest-tag-1685102620` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:53.065406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ba705-9de8-479c-aee2-8921e0fc373e tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=87d0c095dfaf4ee1b6c5a884f1aab5e3, value=tempest-tag-1685102620)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:53.067926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ba705-9de8-479c-aee2-8921e0fc373e tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:53.095771 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3079/6195] 10.222.0.27 () {58 vars in 1314 bytes} [Wed Oct 19 01:12:52 2022] GET /identity/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags/tempest-tag-1685102620 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:53.097200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f96a8-776e-4d55-b4f3-789cecc84302 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:53.109947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f96a8-776e-4d55-b4f3-789cecc84302 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:53.115725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb8c8-6fcd-412f-84c7-31203d608188 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:53.117020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb8c8-6fcd-412f-84c7-31203d608188 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:53.117382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb8c8-6fcd-412f-84c7-31203d608188 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:53.117735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fb8c8-6fcd-412f-84c7-31203d608188 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:53.119071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fb8c8-6fcd-412f-84c7-31203d608188 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=87d0c095dfaf4ee1b6c5a884f1aab5e3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:53.121347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fb8c8-6fcd-412f-84c7-31203d608188 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:53.205495 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:53.230571 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3117/6196] 10.222.0.27 () {60 vars in 1265 bytes} [Wed Oct 19 01:12:53 2022] PUT /identity/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags => generated 140 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:53.234480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ba705-9de8-479c-aee2-8921e0fc373e tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:53.253488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ba705-9de8-479c-aee2-8921e0fc373e tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:53.271595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1ee10-a410-4224-bbaf-73245be3aca0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:53.274709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1ee10-a410-4224-bbaf-73245be3aca0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:53.276452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1ee10-a410-4224-bbaf-73245be3aca0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:53.276887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1ee10-a410-4224-bbaf-73245be3aca0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:53.315973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1ee10-a410-4224-bbaf-73245be3aca0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=87d0c095dfaf4ee1b6c5a884f1aab5e3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:53.319232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1ee10-a410-4224-bbaf-73245be3aca0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:53.355065 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3080/6197] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 01:12:53 2022] GET /identity/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags => generated 140 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:53.359418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb8c8-6fcd-412f-84c7-31203d608188 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:53.388137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fb8c8-6fcd-412f-84c7-31203d608188 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:53.413992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1dd0f-baba-4acc-a315-996567127d46 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:53.415383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1dd0f-baba-4acc-a315-996567127d46 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:53.416077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1dd0f-baba-4acc-a315-996567127d46 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:53.416870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1dd0f-baba-4acc-a315-996567127d46 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags/tempest-tag-297439617` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:53.420444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1dd0f-baba-4acc-a315-996567127d46 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=87d0c095dfaf4ee1b6c5a884f1aab5e3, value=tempest-tag-297439617)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:53.423929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1dd0f-baba-4acc-a315-996567127d46 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:53.514702 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-93f1dd0f-baba-4acc-a315-996567127d46 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-297439617. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:12:53.514702 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:12:53.514702 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:12:53.555167 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3118/6198] 10.222.0.27 () {58 vars in 1314 bytes} [Wed Oct 19 01:12:53 2022] DELETE /identity/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags/tempest-tag-297439617 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:53.559396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1ee10-a410-4224-bbaf-73245be3aca0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:53.595387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1ee10-a410-4224-bbaf-73245be3aca0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:53.604149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633f357-ed17-4ad9-8586-0131fab49eb0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:53.605118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633f357-ed17-4ad9-8586-0131fab49eb0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:53.605607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633f357-ed17-4ad9-8586-0131fab49eb0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:53.606058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633f357-ed17-4ad9-8586-0131fab49eb0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags/tempest-tag-297439617` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:53.630051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633f357-ed17-4ad9-8586-0131fab49eb0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=87d0c095dfaf4ee1b6c5a884f1aab5e3, value=tempest-tag-297439617)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:53.636728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633f357-ed17-4ad9-8586-0131fab49eb0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-f633f357-ed17-4ad9-8586-0131fab49eb0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Could not find project tag: tempest-tag-297439617.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-297439617. Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 19 01:12:53.673147 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 19 01:12:53.674179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:12:53.674179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:12:53.674179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 19 01:12:53.674179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 19 01:12:53.674179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-297439617. Oct 19 01:12:53.674179 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:12:53.674808 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3081/6199] 10.222.0.27 () {58 vars in 1311 bytes} [Wed Oct 19 01:12:53 2022] GET /identity/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags/tempest-tag-297439617 => generated 106 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:12:53.679747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1dd0f-baba-4acc-a315-996567127d46 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:53.701513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1dd0f-baba-4acc-a315-996567127d46 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:53.718435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee936c5-db9a-4181-a93f-baf09d6cbf2a tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:53.719112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee936c5-db9a-4181-a93f-baf09d6cbf2a tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:53.719380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee936c5-db9a-4181-a93f-baf09d6cbf2a tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:53.719655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee936c5-db9a-4181-a93f-baf09d6cbf2a tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:53.720835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee936c5-db9a-4181-a93f-baf09d6cbf2a tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=87d0c095dfaf4ee1b6c5a884f1aab5e3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:53.723062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee936c5-db9a-4181-a93f-baf09d6cbf2a tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:53.813994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3119/6200] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:12:53 2022] DELETE /identity/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:53.818211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633f357-ed17-4ad9-8586-0131fab49eb0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:53.836996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633f357-ed17-4ad9-8586-0131fab49eb0 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:53.855847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91585aba-7ce1-4388-8756-76ab048bec05 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:53.856944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91585aba-7ce1-4388-8756-76ab048bec05 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:53.857289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91585aba-7ce1-4388-8756-76ab048bec05 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:53.859834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91585aba-7ce1-4388-8756-76ab048bec05 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:53.895686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91585aba-7ce1-4388-8756-76ab048bec05 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=87d0c095dfaf4ee1b6c5a884f1aab5e3)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:53.899384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91585aba-7ce1-4388-8756-76ab048bec05 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:53.927533 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3082/6201] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 01:12:53 2022] GET /identity/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3/tags => generated 66 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 19 01:12:53.931883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee936c5-db9a-4181-a93f-baf09d6cbf2a tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:53.955305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee936c5-db9a-4181-a93f-baf09d6cbf2a tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:53.968447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '142d48b202e14c5e8f2120a8e368699b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2dacecabdcf4a52b127650cc01041d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:53.970430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:53.970954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:53.972036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] PATH_INFO: `/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:53.974259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorizing `identity:delete_project(project_id=87d0c095dfaf4ee1b6c5a884f1aab5e3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:53.978210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:54.086358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d0c095dfaf4ee1b6c5a884f1aab5e3', 'request_id': 'req-4bef744d-120f-4c2d-837f-fe46f6bd5109'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.107886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d0c095dfaf4ee1b6c5a884f1aab5e3', 'request_id': 'req-4bef744d-120f-4c2d-837f-fe46f6bd5109'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.125101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d0c095dfaf4ee1b6c5a884f1aab5e3', 'request_id': 'req-4bef744d-120f-4c2d-837f-fe46f6bd5109'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.155794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] The token cache is being invalidate because project 87d0c095dfaf4ee1b6c5a884f1aab5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:54.156151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.162120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.174899 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3120/6202] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:53 2022] DELETE /identity/v3/projects/87d0c095dfaf4ee1b6c5a884f1aab5e3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:54.179963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91585aba-7ce1-4388-8756-76ab048bec05 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:54.182547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-91585aba-7ce1-4388-8756-76ab048bec05 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:54.284239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:54.285849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:54.436717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91585aba-7ce1-4388-8756-76ab048bec05 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:54.558101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef744d-120f-4c2d-837f-fe46f6bd5109 tempest-IdentityV3ProjectTagsTest-94957202 tempest-IdentityV3ProjectTagsTest-94957202-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:54.578443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:54.579235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:54.583194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:54.583748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] PATH_INFO: `/v3/projects/0b5703b4f4cc4a6985347d13e4fb144f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:54.587351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5703b4f4cc4a6985347d13e4fb144f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:54.590809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:54.593772 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:54.615013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:54.617189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:54.617699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:54.618824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] PATH_INFO: `/v3/users/e236296117934a7abf11f8e41ede8640` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:54.621020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e236296117934a7abf11f8e41ede8640)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:54.623911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:54.644178 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:54.746597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5703b4f4cc4a6985347d13e4fb144f', 'request_id': 'req-dd538f13-940a-43ab-877a-26d4cb009a8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.750181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e236296117934a7abf11f8e41ede8640'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.769289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5703b4f4cc4a6985347d13e4fb144f', 'request_id': 'req-dd538f13-940a-43ab-877a-26d4cb009a8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.780657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e236296117934a7abf11f8e41ede8640'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.795826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5703b4f4cc4a6985347d13e4fb144f', 'request_id': 'req-dd538f13-940a-43ab-877a-26d4cb009a8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.808699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e236296117934a7abf11f8e41ede8640'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.825979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e236296117934a7abf11f8e41ede8640'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.833153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9ef4dced-172c-48e5-b405-8eab39e9a1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e236296117934a7abf11f8e41ede8640'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.837744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] The token cache is being invalidate because project 0b5703b4f4cc4a6985347d13e4fb144f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:54.838739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.842465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:54.849463 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3121/6203] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:54 2022] DELETE /identity/v3/projects/0b5703b4f4cc4a6985347d13e4fb144f => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:54.851342 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3083/6204] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:54 2022] DELETE /identity/v3/users/e236296117934a7abf11f8e41ede8640 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:54.855773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:54.857722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:54.858471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27025f-2ec9-4219-a8d0-b220eb2ac4cf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:54.859257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27025f-2ec9-4219-a8d0-b220eb2ac4cf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:54.859257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27025f-2ec9-4219-a8d0-b220eb2ac4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:54.946190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0a27025f-2ec9-4219-a8d0-b220eb2ac4cf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:54.947904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a27025f-2ec9-4219-a8d0-b220eb2ac4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:55.063374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd538f13-940a-43ab-877a-26d4cb009a8b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:55.118892 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3084/6205] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:55.172069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27025f-2ec9-4219-a8d0-b220eb2ac4cf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:55.174134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a27025f-2ec9-4219-a8d0-b220eb2ac4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:55.278080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:55.280162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:55.282291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:55.283135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] PATH_INFO: `/v3/users/0987202eeb7d421c8a4db8335d0e64b8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:55.286188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0987202eeb7d421c8a4db8335d0e64b8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:55.289745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:55.324008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27025f-2ec9-4219-a8d0-b220eb2ac4cf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:55.335856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe2fc-580b-4677-82b9-3068ede9b2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:55.336513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe2fc-580b-4677-82b9-3068ede9b2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:55.336808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe2fc-580b-4677-82b9-3068ede9b2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:55.337097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe2fc-580b-4677-82b9-3068ede9b2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:55.372394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfe2fc-580b-4677-82b9-3068ede9b2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:55.377589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfe2fc-580b-4677-82b9-3068ede9b2c7 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:55.391380 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:55.436286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0987202eeb7d421c8a4db8335d0e64b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:55.437115 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3085/6206] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:12:55.457539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0987202eeb7d421c8a4db8335d0e64b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:55.520486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0987202eeb7d421c8a4db8335d0e64b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:55.557748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0987202eeb7d421c8a4db8335d0e64b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:55.561826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0987202eeb7d421c8a4db8335d0e64b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:55.589077 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3122/6207] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:54 2022] DELETE /identity/v3/users/0987202eeb7d421c8a4db8335d0e64b8 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:56.711963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe2fc-580b-4677-82b9-3068ede9b2c7 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:56.713683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-00bfe2fc-580b-4677-82b9-3068ede9b2c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:56.770959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe2fc-580b-4677-82b9-3068ede9b2c7 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:56.841006 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:56.943936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:56.944784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:56.945171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:56.945546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] PATH_INFO: `/v3/projects/b3326c3e026b4a51a34643992c915337` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:56.947111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3326c3e026b4a51a34643992c915337)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:56.953598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:56.982482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:56.984533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:57.034695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd68f65-204a-4d81-aa2d-16f8ae7cd32c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:57.043223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:57.044872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:57.045619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:57.046468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] PATH_INFO: `/v3/projects/3a094dc66bd8441ebc1472d0dbd8fac4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:57.048874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a094dc66bd8441ebc1472d0dbd8fac4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:57.051141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:57.068772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3326c3e026b4a51a34643992c915337', 'request_id': 'req-af171672-27cf-42d7-8853-b7472c9c3ae8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.086549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3326c3e026b4a51a34643992c915337', 'request_id': 'req-af171672-27cf-42d7-8853-b7472c9c3ae8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.096127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3326c3e026b4a51a34643992c915337', 'request_id': 'req-af171672-27cf-42d7-8853-b7472c9c3ae8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.125109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] The token cache is being invalidate because project b3326c3e026b4a51a34643992c915337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:57.127184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.128697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.134230 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3086/6208] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:56 2022] DELETE /identity/v3/projects/b3326c3e026b4a51a34643992c915337 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:57.140799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:57.144476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:57.180113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a094dc66bd8441ebc1472d0dbd8fac4', 'request_id': 'req-58c89e14-06ac-4a98-a626-363e1d5b14f0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.196262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a094dc66bd8441ebc1472d0dbd8fac4', 'request_id': 'req-58c89e14-06ac-4a98-a626-363e1d5b14f0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.207694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a094dc66bd8441ebc1472d0dbd8fac4', 'request_id': 'req-58c89e14-06ac-4a98-a626-363e1d5b14f0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.229754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] The token cache is being invalidate because project 3a094dc66bd8441ebc1472d0dbd8fac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:57.230358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.231599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-58c89e14-06ac-4a98-a626-363e1d5b14f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.235408 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3123/6209] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:56 2022] DELETE /identity/v3/projects/3a094dc66bd8441ebc1472d0dbd8fac4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:57.251225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84778efe-4b2b-4702-910e-c3a4a8688a3c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:57.255338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84778efe-4b2b-4702-910e-c3a4a8688a3c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:57.255629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84778efe-4b2b-4702-910e-c3a4a8688a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:57.316501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171672-27cf-42d7-8853-b7472c9c3ae8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:57.347701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-84778efe-4b2b-4702-910e-c3a4a8688a3c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:57.349289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-84778efe-4b2b-4702-910e-c3a4a8688a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:57.438409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:57.439721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:57.440968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:57.441423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] PATH_INFO: `/v3/users/142d48b202e14c5e8f2120a8e368699b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:57.443135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=142d48b202e14c5e8f2120a8e368699b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:57.446173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:57.449418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3124/6210] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:57.454411 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:57.462266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f5e8-2e0a-421b-a82e-07b64bbb1a92 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:57.462920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f5e8-2e0a-421b-a82e-07b64bbb1a92 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:57.464239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f5e8-2e0a-421b-a82e-07b64bbb1a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:57.538011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ff56f5e8-2e0a-421b-a82e-07b64bbb1a92 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:57.543676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ff56f5e8-2e0a-421b-a82e-07b64bbb1a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:57.552099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142d48b202e14c5e8f2120a8e368699b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.567413 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3125/6211] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:57.568498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f5e8-2e0a-421b-a82e-07b64bbb1a92 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:57.581902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142d48b202e14c5e8f2120a8e368699b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.602463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142d48b202e14c5e8f2120a8e368699b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.616697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142d48b202e14c5e8f2120a8e368699b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.617530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f5e8-2e0a-421b-a82e-07b64bbb1a92 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:57.618988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142d48b202e14c5e8f2120a8e368699b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:57.627703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff85a6-f3d9-461d-892a-0daef701cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:57.630540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff85a6-f3d9-461d-892a-0daef701cae8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:57.632370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff85a6-f3d9-461d-892a-0daef701cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:57.632370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff85a6-f3d9-461d-892a-0daef701cae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:57.634249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff85a6-f3d9-461d-892a-0daef701cae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:12:57.634249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff85a6-f3d9-461d-892a-0daef701cae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:57.635546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3087/6212] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:12:57 2022] DELETE /identity/v3/users/142d48b202e14c5e8f2120a8e368699b => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:57.637473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff85a6-f3d9-461d-892a-0daef701cae8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:57.656061 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3126/6213] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:12:57.656908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:57.658604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:57.835733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0971f-2599-499c-a233-6dddb6272f7b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:57.854670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ad4da-0f77-49d5-be2e-dbaab269388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:57.857290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ad4da-0f77-49d5-be2e-dbaab269388b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:57.857831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ad4da-0f77-49d5-be2e-dbaab269388b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:57.858558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ad4da-0f77-49d5-be2e-dbaab269388b admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:57.859539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ad4da-0f77-49d5-be2e-dbaab269388b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:57.862007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ad4da-0f77-49d5-be2e-dbaab269388b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:57.938354 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3088/6214] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:57 2022] POST /identity/v3/projects => generated 385 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:57.941409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff85a6-f3d9-461d-892a-0daef701cae8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:57.950363 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:57.962749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff85a6-f3d9-461d-892a-0daef701cae8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:58.149443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf729ec-9958-4f82-b886-855c7a4a34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:58.150089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf729ec-9958-4f82-b886-855c7a4a34cf admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:58.150564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf729ec-9958-4f82-b886-855c7a4a34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:58.150843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf729ec-9958-4f82-b886-855c7a4a34cf admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:58.151500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf729ec-9958-4f82-b886-855c7a4a34cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:58.153519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf729ec-9958-4f82-b886-855c7a4a34cf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:58.199014 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3127/6215] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:57 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:12:58.203466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ad4da-0f77-49d5-be2e-dbaab269388b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:58.234989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ad4da-0f77-49d5-be2e-dbaab269388b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:58.241285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef51b6c-2363-4568-9b84-acc87242c6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:58.242124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef51b6c-2363-4568-9b84-acc87242c6ba admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:58.242564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef51b6c-2363-4568-9b84-acc87242c6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:58.243793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef51b6c-2363-4568-9b84-acc87242c6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:58.245509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef51b6c-2363-4568-9b84-acc87242c6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:58.249133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef51b6c-2363-4568-9b84-acc87242c6ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:58.298904 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3089/6216] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:58.301971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf729ec-9958-4f82-b886-855c7a4a34cf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:58.321480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf729ec-9958-4f82-b886-855c7a4a34cf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:58.339061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7e899-608a-4686-bdd0-9ea24450a5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:58.340275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7e899-608a-4686-bdd0-9ea24450a5fa admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:58.340776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7e899-608a-4686-bdd0-9ea24450a5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:58.341210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7e899-608a-4686-bdd0-9ea24450a5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:58.342043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7e899-608a-4686-bdd0-9ea24450a5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:58.343860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7e899-608a-4686-bdd0-9ea24450a5fa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:58.379425 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3128/6217] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:58.390279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef51b6c-2363-4568-9b84-acc87242c6ba admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:58.436984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef51b6c-2363-4568-9b84-acc87242c6ba admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:58.456300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2496ec-fb55-495a-a2eb-0c506a8a7960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:58.457053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2496ec-fb55-495a-a2eb-0c506a8a7960 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:58.457340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2496ec-fb55-495a-a2eb-0c506a8a7960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:58.457619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2496ec-fb55-495a-a2eb-0c506a8a7960 admin admin] PATH_INFO: `/v3/projects/cbdeb17f9d6046899e4380f0559693e1/users/36dc1a37366f43099de6d8f345581c0b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:58.496723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2496ec-fb55-495a-a2eb-0c506a8a7960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdeb17f9d6046899e4380f0559693e1, user_id=36dc1a37366f43099de6d8f345581c0b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:58.501327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2496ec-fb55-495a-a2eb-0c506a8a7960 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:58.561891 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3090/6218] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:58 2022] PUT /identity/v3/projects/cbdeb17f9d6046899e4380f0559693e1/users/36dc1a37366f43099de6d8f345581c0b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:58.573978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70378-c644-4aa5-a753-9c104f4ffc3e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:58.574555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70378-c644-4aa5-a753-9c104f4ffc3e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:58.575007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70378-c644-4aa5-a753-9c104f4ffc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:58.665582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-58e70378-c644-4aa5-a753-9c104f4ffc3e None None] MFA Rules not processed for user `36dc1a37366f43099de6d8f345581c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:58.666887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-58e70378-c644-4aa5-a753-9c104f4ffc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:58.860819 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3129/6219] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:12:58.861687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2496ec-fb55-495a-a2eb-0c506a8a7960 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:58.957575 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:59.043480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2496ec-fb55-495a-a2eb-0c506a8a7960 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:59.060303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885c63d-c7d1-4abc-acc4-1e977b19e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:59.060997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c63d-c7d1-4abc-acc4-1e977b19e20a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:59.061341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c63d-c7d1-4abc-acc4-1e977b19e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:59.061570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c63d-c7d1-4abc-acc4-1e977b19e20a admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:59.062213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885c63d-c7d1-4abc-acc4-1e977b19e20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:59.064179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885c63d-c7d1-4abc-acc4-1e977b19e20a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:59.134778 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3091/6220] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:12:58 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:59.138494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70378-c644-4aa5-a753-9c104f4ffc3e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:59.161873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70378-c644-4aa5-a753-9c104f4ffc3e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:59.327894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac61a9-838a-4e96-8e91-95096e51893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:59.328540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac61a9-838a-4e96-8e91-95096e51893f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:59.329949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac61a9-838a-4e96-8e91-95096e51893f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:59.330236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac61a9-838a-4e96-8e91-95096e51893f admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:59.330911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac61a9-838a-4e96-8e91-95096e51893f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:59.333811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac61a9-838a-4e96-8e91-95096e51893f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:59.398529 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3130/6221] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:12:59 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:12:59.400187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885c63d-c7d1-4abc-acc4-1e977b19e20a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:59.413141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885c63d-c7d1-4abc-acc4-1e977b19e20a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:59.427118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a04c10-bb37-4dbd-bc32-75a133c16e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:59.428569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a04c10-bb37-4dbd-bc32-75a133c16e19 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:59.429668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a04c10-bb37-4dbd-bc32-75a133c16e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:59.430133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a04c10-bb37-4dbd-bc32-75a133c16e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:59.431895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a04c10-bb37-4dbd-bc32-75a133c16e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:59.438940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a04c10-bb37-4dbd-bc32-75a133c16e19 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:59.498943 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3092/6222] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:12:59.502859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac61a9-838a-4e96-8e91-95096e51893f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:59.509649 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:59.526141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac61a9-838a-4e96-8e91-95096e51893f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:59.544874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a04c10-bb37-4dbd-bc32-75a133c16e19 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:59.546656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e2a04c10-bb37-4dbd-bc32-75a133c16e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:59.565395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2aa41-cdf1-4706-bfce-07389c8d136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:59.566091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2aa41-cdf1-4706-bfce-07389c8d136e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:59.566374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2aa41-cdf1-4706-bfce-07389c8d136e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:59.566653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2aa41-cdf1-4706-bfce-07389c8d136e admin admin] PATH_INFO: `/v3/projects/b5f51cac39aa439a952d283a926625bd/users/10af5a5c966a4888845d927e63a31901/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:59.586720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a04c10-bb37-4dbd-bc32-75a133c16e19 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:12:59.609306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:12:59.610034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:59.610320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:59.610602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] PATH_INFO: `/v3/projects/d2dacecabdcf4a52b127650cc01041d6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:59.614819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2dacecabdcf4a52b127650cc01041d6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:59.622807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:59.632243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2aa41-cdf1-4706-bfce-07389c8d136e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f51cac39aa439a952d283a926625bd, user_id=10af5a5c966a4888845d927e63a31901, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:12:59.635185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2aa41-cdf1-4706-bfce-07389c8d136e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:12:59.666617 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3131/6223] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:12:59 2022] PUT /identity/v3/projects/b5f51cac39aa439a952d283a926625bd/users/10af5a5c966a4888845d927e63a31901/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:12:59.670259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2aa41-cdf1-4706-bfce-07389c8d136e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:12:59.729217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2dacecabdcf4a52b127650cc01041d6', 'request_id': 'req-d6b696dd-796e-40ce-aff4-4c6dae95337b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:59.741619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2dacecabdcf4a52b127650cc01041d6', 'request_id': 'req-d6b696dd-796e-40ce-aff4-4c6dae95337b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:59.750701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2dacecabdcf4a52b127650cc01041d6', 'request_id': 'req-d6b696dd-796e-40ce-aff4-4c6dae95337b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:59.793278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] The token cache is being invalidate because project d2dacecabdcf4a52b127650cc01041d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:12:59.793589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:59.794366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d6b696dd-796e-40ce-aff4-4c6dae95337b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:12:59.796133 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3093/6224] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:12:59 2022] DELETE /identity/v3/projects/d2dacecabdcf4a52b127650cc01041d6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:12:59.801440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bca3-e0c8-4bc2-bf16-a80b0ea62526 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:12:59.802098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bca3-e0c8-4bc2-bf16-a80b0ea62526 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:12:59.802505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bca3-e0c8-4bc2-bf16-a80b0ea62526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:12:59.864361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6482bca3-e0c8-4bc2-bf16-a80b0ea62526 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:12:59.866916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6482bca3-e0c8-4bc2-bf16-a80b0ea62526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:12:59.876882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2aa41-cdf1-4706-bfce-07389c8d136e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:00.030403 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3094/6225] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:00.040453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bf139-ae49-45b5-87bc-fff32800ac77 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.041059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bf139-ae49-45b5-87bc-fff32800ac77 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.041059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bf139-ae49-45b5-87bc-fff32800ac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.065672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c180-c86a-45db-8b3c-6080bd812839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:00.066396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c180-c86a-45db-8b3c-6080bd812839 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.066650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c180-c86a-45db-8b3c-6080bd812839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.066915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c180-c86a-45db-8b3c-6080bd812839 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.075276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66c180-c86a-45db-8b3c-6080bd812839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:00.076995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66c180-c86a-45db-8b3c-6080bd812839 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:00.089478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dc4bf139-ae49-45b5-87bc-fff32800ac77 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:00.090722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dc4bf139-ae49-45b5-87bc-fff32800ac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:00.114840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3095/6226] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:13:00.116808 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3132/6227] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:00.119850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bf139-ae49-45b5-87bc-fff32800ac77 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:00.120908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c180-c86a-45db-8b3c-6080bd812839 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:00.127997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5f66c180-c86a-45db-8b3c-6080bd812839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:00.132474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bf139-ae49-45b5-87bc-fff32800ac77 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:00.138582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30a5d5-c36e-4e37-b826-4b29d9199f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:00.139204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30a5d5-c36e-4e37-b826-4b29d9199f19 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.139489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30a5d5-c36e-4e37-b826-4b29d9199f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.139769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30a5d5-c36e-4e37-b826-4b29d9199f19 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.140430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30a5d5-c36e-4e37-b826-4b29d9199f19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:13:00.140783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30a5d5-c36e-4e37-b826-4b29d9199f19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:00.143341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30a5d5-c36e-4e37-b826-4b29d9199f19 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:00.159926 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3096/6228] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:13:00.161127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c180-c86a-45db-8b3c-6080bd812839 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:00.166079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30a5d5-c36e-4e37-b826-4b29d9199f19 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:00.177646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d06d-d2d9-4b22-891e-a3908aedabd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:00.179196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d06d-d2d9-4b22-891e-a3908aedabd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.179636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d06d-d2d9-4b22-891e-a3908aedabd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.180077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d06d-d2d9-4b22-891e-a3908aedabd5 admin admin] PATH_INFO: `/v3/projects/b5f51cac39aa439a952d283a926625bd/users/10af5a5c966a4888845d927e63a31901/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.182629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30a5d5-c36e-4e37-b826-4b29d9199f19 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:00.185395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019d06d-d2d9-4b22-891e-a3908aedabd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f51cac39aa439a952d283a926625bd, user_id=10af5a5c966a4888845d927e63a31901, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:00.189860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019d06d-d2d9-4b22-891e-a3908aedabd5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:00.197653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78e285-b579-49e1-a5d2-bed001a2081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:00.201181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78e285-b579-49e1-a5d2-bed001a2081e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.202236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78e285-b579-49e1-a5d2-bed001a2081e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.202618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78e285-b579-49e1-a5d2-bed001a2081e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.204027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78e285-b579-49e1-a5d2-bed001a2081e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:00.211567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78e285-b579-49e1-a5d2-bed001a2081e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:00.227875 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3133/6229] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:00 2022] PUT /identity/v3/projects/b5f51cac39aa439a952d283a926625bd/users/10af5a5c966a4888845d927e63a31901/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:00.229601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c668b-6915-41d7-9bd2-e3dc1f63cbf2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.232886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c668b-6915-41d7-9bd2-e3dc1f63cbf2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.234451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c668b-6915-41d7-9bd2-e3dc1f63cbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.234660 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:00.301355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a30c668b-6915-41d7-9bd2-e3dc1f63cbf2 None None] MFA Rules not processed for user `10af5a5c966a4888845d927e63a31901`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:00.302805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a30c668b-6915-41d7-9bd2-e3dc1f63cbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:00.312826 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3097/6230] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:13:00 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:00.315156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78e285-b579-49e1-a5d2-bed001a2081e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:00.473880 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:00.483985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78e285-b579-49e1-a5d2-bed001a2081e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:00.499403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2c41-3d2e-4690-a116-b460c0b89364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:00.500298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2c41-3d2e-4690-a116-b460c0b89364 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.500298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2c41-3d2e-4690-a116-b460c0b89364 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.500591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2c41-3d2e-4690-a116-b460c0b89364 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.502746 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3134/6231] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:00.503261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd2c41-3d2e-4690-a116-b460c0b89364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:00.506957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd2c41-3d2e-4690-a116-b460c0b89364 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:00.515466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c668b-6915-41d7-9bd2-e3dc1f63cbf2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:00.517123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a30c668b-6915-41d7-9bd2-e3dc1f63cbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:00.551844 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3098/6232] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:00 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:00.556321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2c41-3d2e-4690-a116-b460c0b89364 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:00.579573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2c41-3d2e-4690-a116-b460c0b89364 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:00.598574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ae55b-32ef-4e80-9c40-4797d575a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:00.599386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ae55b-32ef-4e80-9c40-4797d575a176 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.600212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ae55b-32ef-4e80-9c40-4797d575a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.600676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ae55b-32ef-4e80-9c40-4797d575a176 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.601163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ae55b-32ef-4e80-9c40-4797d575a176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:00.606550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ae55b-32ef-4e80-9c40-4797d575a176 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:00.626247 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3099/6233] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:00.641907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ae55b-32ef-4e80-9c40-4797d575a176 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:00.658670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c668b-6915-41d7-9bd2-e3dc1f63cbf2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:00.679334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ae55b-32ef-4e80-9c40-4797d575a176 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:00.693304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b127d9-73de-4e40-91a0-d31beed72391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:00.694621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b127d9-73de-4e40-91a0-d31beed72391 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.694621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b127d9-73de-4e40-91a0-d31beed72391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.694621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b127d9-73de-4e40-91a0-d31beed72391 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.695121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b127d9-73de-4e40-91a0-d31beed72391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:00.698411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b127d9-73de-4e40-91a0-d31beed72391 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:00.730020 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3100/6234] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:00.738452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b127d9-73de-4e40-91a0-d31beed72391 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:00.758153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b127d9-73de-4e40-91a0-d31beed72391 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:00.777397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658449b6-e1a8-4e46-ae28-741b313e19af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:00.778096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658449b6-e1a8-4e46-ae28-741b313e19af admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.778377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658449b6-e1a8-4e46-ae28-741b313e19af admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.778655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658449b6-e1a8-4e46-ae28-741b313e19af admin admin] PATH_INFO: `/v3/projects/1852062eb2af423ca07461e9434ce984/users/897f664d36c14bdba0782eb11ae41979/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.802710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6a89-ab8d-4860-90d5-8a900e492678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:00.803400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6a89-ab8d-4860-90d5-8a900e492678 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.803772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6a89-ab8d-4860-90d5-8a900e492678 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.804145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6a89-ab8d-4860-90d5-8a900e492678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:00.810418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e93f6a89-ab8d-4860-90d5-8a900e492678 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:00.849300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658449b6-e1a8-4e46-ae28-741b313e19af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1852062eb2af423ca07461e9434ce984, user_id=897f664d36c14bdba0782eb11ae41979, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:00.854546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658449b6-e1a8-4e46-ae28-741b313e19af admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:00.949461 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3101/6235] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:00 2022] PUT /identity/v3/projects/1852062eb2af423ca07461e9434ce984/users/897f664d36c14bdba0782eb11ae41979/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:00.951017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479c5c0-c9a8-41d0-bf7b-11605e810bef None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:00.951305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479c5c0-c9a8-41d0-bf7b-11605e810bef None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:00.951582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479c5c0-c9a8-41d0-bf7b-11605e810bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:01.070564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d479c5c0-c9a8-41d0-bf7b-11605e810bef None None] MFA Rules not processed for user `897f664d36c14bdba0782eb11ae41979`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:01.071797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d479c5c0-c9a8-41d0-bf7b-11605e810bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:01.090690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6a89-ab8d-4860-90d5-8a900e492678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:01.092164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6a89-ab8d-4860-90d5-8a900e492678 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:01.128296 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3135/6236] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:13:01.292321 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3102/6237] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:01.297642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6a89-ab8d-4860-90d5-8a900e492678 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:01.324536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6a89-ab8d-4860-90d5-8a900e492678 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:01.566258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912dd10-2c45-4e70-99fb-eb81776ac56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:01.567698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912dd10-2c45-4e70-99fb-eb81776ac56c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:01.568061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912dd10-2c45-4e70-99fb-eb81776ac56c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:01.568442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912dd10-2c45-4e70-99fb-eb81776ac56c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:01.569218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912dd10-2c45-4e70-99fb-eb81776ac56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:01.574432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912dd10-2c45-4e70-99fb-eb81776ac56c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:01.602479 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:01.648316 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3136/6238] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:13:01 2022] POST /identity/v3/projects => generated 365 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:01.649672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479c5c0-c9a8-41d0-bf7b-11605e810bef None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:01.674179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479c5c0-c9a8-41d0-bf7b-11605e810bef None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:01.721856 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:01.806707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52db2-5df9-49bf-91d2-b08721abf162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:01.807692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52db2-5df9-49bf-91d2-b08721abf162 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:01.808384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52db2-5df9-49bf-91d2-b08721abf162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:01.809373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52db2-5df9-49bf-91d2-b08721abf162 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:01.810403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf52db2-5df9-49bf-91d2-b08721abf162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:01.814094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf52db2-5df9-49bf-91d2-b08721abf162 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:01.866213 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3103/6239] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:01 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:13:01.873006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912dd10-2c45-4e70-99fb-eb81776ac56c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:01.892955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912dd10-2c45-4e70-99fb-eb81776ac56c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:01.900600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef779e-08a7-4220-a278-6111836a3430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:01.901327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef779e-08a7-4220-a278-6111836a3430 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:01.901720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef779e-08a7-4220-a278-6111836a3430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:01.902001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef779e-08a7-4220-a278-6111836a3430 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:01.902930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef779e-08a7-4220-a278-6111836a3430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:01.905771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef779e-08a7-4220-a278-6111836a3430 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:01.980830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52db2-5df9-49bf-91d2-b08721abf162 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:01.981399 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3137/6240] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:01.999625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52db2-5df9-49bf-91d2-b08721abf162 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:02.022384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe60554-2995-40ab-a48b-bdc7cc02b1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:02.028877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe60554-2995-40ab-a48b-bdc7cc02b1be admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:02.028877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe60554-2995-40ab-a48b-bdc7cc02b1be admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:02.028877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe60554-2995-40ab-a48b-bdc7cc02b1be admin admin] PATH_INFO: `/v3/projects/ddd528d927d743e3aef8bfc91265bee8/users/1d7e52d5c4894689ab9454671f7b6bc0/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:02.070347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe60554-2995-40ab-a48b-bdc7cc02b1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd528d927d743e3aef8bfc91265bee8, user_id=1d7e52d5c4894689ab9454671f7b6bc0, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:02.074093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe60554-2995-40ab-a48b-bdc7cc02b1be admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:02.118074 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3104/6241] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:01 2022] PUT /identity/v3/projects/ddd528d927d743e3aef8bfc91265bee8/users/1d7e52d5c4894689ab9454671f7b6bc0/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:02.119528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef779e-08a7-4220-a278-6111836a3430 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:02.137074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef779e-08a7-4220-a278-6111836a3430 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:02.220897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e90e2-5df1-45e7-8254-6d8f7879b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:02.221910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e90e2-5df1-45e7-8254-6d8f7879b9ee admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:02.222560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e90e2-5df1-45e7-8254-6d8f7879b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:02.223061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e90e2-5df1-45e7-8254-6d8f7879b9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:02.224043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e90e2-5df1-45e7-8254-6d8f7879b9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:02.227102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e90e2-5df1-45e7-8254-6d8f7879b9ee admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:02.275408 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3138/6242] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:02.279204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe60554-2995-40ab-a48b-bdc7cc02b1be admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:02.294111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe60554-2995-40ab-a48b-bdc7cc02b1be admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:02.320550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c0cf6-fe03-4cea-9e9d-ee277c5130d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:02.320550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c0cf6-fe03-4cea-9e9d-ee277c5130d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:02.320550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c0cf6-fe03-4cea-9e9d-ee277c5130d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:02.320550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c0cf6-fe03-4cea-9e9d-ee277c5130d8 admin admin] PATH_INFO: `/v3/projects/ddd528d927d743e3aef8bfc91265bee8/users/1d7e52d5c4894689ab9454671f7b6bc0/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:02.321098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c0cf6-fe03-4cea-9e9d-ee277c5130d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd528d927d743e3aef8bfc91265bee8, user_id=1d7e52d5c4894689ab9454671f7b6bc0, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:02.325658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c0cf6-fe03-4cea-9e9d-ee277c5130d8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:02.376925 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3105/6243] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:02 2022] PUT /identity/v3/projects/ddd528d927d743e3aef8bfc91265bee8/users/1d7e52d5c4894689ab9454671f7b6bc0/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:02.378223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c123be-cdf1-4e73-b2c5-4fe4392ded48 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:02.378698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c123be-cdf1-4e73-b2c5-4fe4392ded48 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:02.378797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c123be-cdf1-4e73-b2c5-4fe4392ded48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:02.463969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-87c123be-cdf1-4e73-b2c5-4fe4392ded48 None None] MFA Rules not processed for user `1d7e52d5c4894689ab9454671f7b6bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:02.465287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-87c123be-cdf1-4e73-b2c5-4fe4392ded48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:02.708728 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3139/6244] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:13:02.720951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c0cf6-fe03-4cea-9e9d-ee277c5130d8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:02.771879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c0cf6-fe03-4cea-9e9d-ee277c5130d8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:02.804946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecaf44-4c03-4b09-a45c-1d983b0a0c90 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:02.809548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecaf44-4c03-4b09-a45c-1d983b0a0c90 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:02.810212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecaf44-4c03-4b09-a45c-1d983b0a0c90 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:02.810571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecaf44-4c03-4b09-a45c-1d983b0a0c90 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:02.823978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecaf44-4c03-4b09-a45c-1d983b0a0c90 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:02.838544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecaf44-4c03-4b09-a45c-1d983b0a0c90 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:02.939813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c123be-cdf1-4e73-b2c5-4fe4392ded48 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:02.943126 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3106/6245] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:13:02 2022] POST /identity/v3/projects => generated 328 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:02.955742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c123be-cdf1-4e73-b2c5-4fe4392ded48 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:03.217028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8248e8-bf98-4de9-bb08-a2a202245443 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:03.217679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8248e8-bf98-4de9-bb08-a2a202245443 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:03.217965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8248e8-bf98-4de9-bb08-a2a202245443 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:03.218251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8248e8-bf98-4de9-bb08-a2a202245443 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:03.218915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8248e8-bf98-4de9-bb08-a2a202245443 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:03.221348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8248e8-bf98-4de9-bb08-a2a202245443 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:03.289395 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:03.307455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecaf44-4c03-4b09-a45c-1d983b0a0c90 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:03.309739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-03ecaf44-4c03-4b09-a45c-1d983b0a0c90 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:03.319670 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3140/6246] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:02 2022] POST /identity/v3/users => generated 416 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:03.338198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8248e8-bf98-4de9-bb08-a2a202245443 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:03.362995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8248e8-bf98-4de9-bb08-a2a202245443 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:03.377420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a210d-ad16-4c20-939e-40859167f144 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:03.378287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a210d-ad16-4c20-939e-40859167f144 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:03.379973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a210d-ad16-4c20-939e-40859167f144 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:03.388164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a210d-ad16-4c20-939e-40859167f144 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:03.389256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a210d-ad16-4c20-939e-40859167f144 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:03.391078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a210d-ad16-4c20-939e-40859167f144 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:03.432488 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3141/6247] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:03 2022] POST /identity/v3/roles => generated 243 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:03.435653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a210d-ad16-4c20-939e-40859167f144 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:03.472231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a210d-ad16-4c20-939e-40859167f144 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:03.479720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2b959-a04e-4ddd-a3ac-551c05e363f3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:03.480652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2b959-a04e-4ddd-a3ac-551c05e363f3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:03.481126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2b959-a04e-4ddd-a3ac-551c05e363f3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:03.481570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2b959-a04e-4ddd-a3ac-551c05e363f3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:03.482611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2b959-a04e-4ddd-a3ac-551c05e363f3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:03.484392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2b959-a04e-4ddd-a3ac-551c05e363f3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:03.517469 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3142/6248] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:03 2022] POST /identity/v3/roles => generated 247 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:03.523499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2b959-a04e-4ddd-a3ac-551c05e363f3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:03.560645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2b959-a04e-4ddd-a3ac-551c05e363f3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:03.561356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecaf44-4c03-4b09-a45c-1d983b0a0c90 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:03.574520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:03.574756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37524c48-75bf-4a47-9728-ca8b6008bc84 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:03.575926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37524c48-75bf-4a47-9728-ca8b6008bc84 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:03.576277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37524c48-75bf-4a47-9728-ca8b6008bc84 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:03.576399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:03.576567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37524c48-75bf-4a47-9728-ca8b6008bc84 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/7b1b431b39934744a1afd0a2e1085b1a/users/18a93620933c4caeada0cf97e6eb3d29/roles/a565ffbb84c34950af4512e6c9a49fcb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:03.576703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:03.576915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] PATH_INFO: `/v3/users/b8c0fbb546b841f1b6c8d1ab6b302cc6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:03.579653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c0fbb546b841f1b6c8d1ab6b302cc6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:03.586084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:03.622352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37524c48-75bf-4a47-9728-ca8b6008bc84 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7b1b431b39934744a1afd0a2e1085b1a, user_id=18a93620933c4caeada0cf97e6eb3d29, role_id=a565ffbb84c34950af4512e6c9a49fcb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:03.640899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37524c48-75bf-4a47-9728-ca8b6008bc84 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:03.686089 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3143/6249] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:03 2022] PUT /identity/v3/projects/7b1b431b39934744a1afd0a2e1085b1a/users/18a93620933c4caeada0cf97e6eb3d29/roles/a565ffbb84c34950af4512e6c9a49fcb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:03.692481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37524c48-75bf-4a47-9728-ca8b6008bc84 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:03.707728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c0fbb546b841f1b6c8d1ab6b302cc6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:03.715338 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:03.727332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c0fbb546b841f1b6c8d1ab6b302cc6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:03.739333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c0fbb546b841f1b6c8d1ab6b302cc6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:03.750305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c0fbb546b841f1b6c8d1ab6b302cc6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:03.751037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3381049b-5f27-489f-ab43-57d2c5fbd008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c0fbb546b841f1b6c8d1ab6b302cc6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:03.759850 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3107/6250] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:03 2022] DELETE /identity/v3/users/b8c0fbb546b841f1b6c8d1ab6b302cc6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:03.764522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabad6c6-abb7-4e6d-9dfb-353f933ca06e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:03.764855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabad6c6-abb7-4e6d-9dfb-353f933ca06e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:03.765286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabad6c6-abb7-4e6d-9dfb-353f933ca06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:03.804137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dabad6c6-abb7-4e6d-9dfb-353f933ca06e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:03.811300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dabad6c6-abb7-4e6d-9dfb-353f933ca06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:03.899039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37524c48-75bf-4a47-9728-ca8b6008bc84 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:04.047522 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3108/6251] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:04.107639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabad6c6-abb7-4e6d-9dfb-353f933ca06e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:04.109270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dabad6c6-abb7-4e6d-9dfb-353f933ca06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:04.122649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0668a5-78e3-4b2c-b2b6-997a8fd9b398 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:04.123647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0668a5-78e3-4b2c-b2b6-997a8fd9b398 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:04.124095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0668a5-78e3-4b2c-b2b6-997a8fd9b398 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:04.124533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0668a5-78e3-4b2c-b2b6-997a8fd9b398 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/7b1b431b39934744a1afd0a2e1085b1a/users/18a93620933c4caeada0cf97e6eb3d29/roles/5718f960ab2d4f16a7abd8bdd701129a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:04.130257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0668a5-78e3-4b2c-b2b6-997a8fd9b398 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7b1b431b39934744a1afd0a2e1085b1a, user_id=18a93620933c4caeada0cf97e6eb3d29, role_id=5718f960ab2d4f16a7abd8bdd701129a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:04.133359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0668a5-78e3-4b2c-b2b6-997a8fd9b398 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:04.168433 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3144/6252] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:03 2022] PUT /identity/v3/projects/7b1b431b39934744a1afd0a2e1085b1a/users/18a93620933c4caeada0cf97e6eb3d29/roles/5718f960ab2d4f16a7abd8bdd701129a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:04.172119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0668a5-78e3-4b2c-b2b6-997a8fd9b398 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:04.174452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cb0668a5-78e3-4b2c-b2b6-997a8fd9b398 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:04.270767 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:04.277861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabad6c6-abb7-4e6d-9dfb-353f933ca06e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:04.321166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0668a5-78e3-4b2c-b2b6-997a8fd9b398 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:04.327910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17be316-8215-4a9c-a245-7cce1ec9acff tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:04.328608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17be316-8215-4a9c-a245-7cce1ec9acff tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:04.328925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17be316-8215-4a9c-a245-7cce1ec9acff tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:04.329205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17be316-8215-4a9c-a245-7cce1ec9acff tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:04.329886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17be316-8215-4a9c-a245-7cce1ec9acff tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:04.337765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17be316-8215-4a9c-a245-7cce1ec9acff tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:04.382520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbbd2c-6c95-4082-a0c3-97d88fd64db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:04.383801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbbd2c-6c95-4082-a0c3-97d88fd64db1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:04.384241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbbd2c-6c95-4082-a0c3-97d88fd64db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:04.384740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbbd2c-6c95-4082-a0c3-97d88fd64db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:04.431138 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:04.431538 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3145/6253] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:04 2022] GET /identity/v3/users => generated 9494 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:13:04.438075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5586083-89a3-45f4-9d1c-d0a8380b6f59 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:04.438437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5586083-89a3-45f4-9d1c-d0a8380b6f59 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:04.438652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5586083-89a3-45f4-9d1c-d0a8380b6f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:04.505867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbbd2c-6c95-4082-a0c3-97d88fd64db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:04.529564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f5586083-89a3-45f4-9d1c-d0a8380b6f59 None None] MFA Rules not processed for user `18a93620933c4caeada0cf97e6eb3d29`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:04.530817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f5586083-89a3-45f4-9d1c-d0a8380b6f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:04.534071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbbd2c-6c95-4082-a0c3-97d88fd64db1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:04.578115 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3109/6254] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:13:04.679949 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3146/6255] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:13:04.695179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805803c8-ccff-4475-bb32-e267adc29962 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:04.695179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805803c8-ccff-4475-bb32-e267adc29962 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:04.695179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805803c8-ccff-4475-bb32-e267adc29962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:04.739902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-805803c8-ccff-4475-bb32-e267adc29962 None None] MFA Rules not processed for user `18a93620933c4caeada0cf97e6eb3d29`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:04.741282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-805803c8-ccff-4475-bb32-e267adc29962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:04.767171 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3110/6256] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:04.773058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5586083-89a3-45f4-9d1c-d0a8380b6f59 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:04.784868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5586083-89a3-45f4-9d1c-d0a8380b6f59 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:04.800093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534120d9-a295-48e4-a4e6-b154b5989bb2 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a93620933c4caeada0cf97e6eb3d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b1b431b39934744a1afd0a2e1085b1a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335930880', 'tempest-DelegatedRole-582995807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:04.801142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534120d9-a295-48e4-a4e6-b154b5989bb2 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:04.801460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534120d9-a295-48e4-a4e6-b154b5989bb2 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:04.801977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534120d9-a295-48e4-a4e6-b154b5989bb2 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:04.802720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534120d9-a295-48e4-a4e6-b154b5989bb2 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] RBAC: Authorizing `identity:create_trust()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:04.803919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534120d9-a295-48e4-a4e6-b154b5989bb2 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:05.097141 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3147/6257] 10.222.0.27 () {60 vars in 1174 bytes} [Wed Oct 19 01:13:04 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:05.101569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805803c8-ccff-4475-bb32-e267adc29962 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:05.122451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805803c8-ccff-4475-bb32-e267adc29962 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:05.151369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:05.152036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:05.152327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:05.152612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:05.153295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:05.154330 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:13:05.154330 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:13:05.154330 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:13:05.155519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:05.170672 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3111/6258] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 01:13:05 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:05.176329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534120d9-a295-48e4-a4e6-b154b5989bb2 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:05.192438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534120d9-a295-48e4-a4e6-b154b5989bb2 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:05.206365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a93620933c4caeada0cf97e6eb3d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b1b431b39934744a1afd0a2e1085b1a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335930880', 'tempest-DelegatedRole-582995807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:05.207433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:05.209032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:05.209564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] PATH_INFO: `/v3/OS-TRUST/trusts/2e9307303c55474eaa846a173b45bfdd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:05.258992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] RBAC: Authorizing `identity:delete_trust(trust_id=2e9307303c55474eaa846a173b45bfdd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:05.264107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:05.325441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2e9307303c55474eaa846a173b45bfdd', 'request_id': 'req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:05.326735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2e9307303c55474eaa846a173b45bfdd', 'request_id': 'req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:05.328963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '2e9307303c55474eaa846a173b45bfdd', 'request_id': 'req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:05.383133 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3148/6259] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:13:05 2022] DELETE /identity/v3/OS-TRUST/trusts/2e9307303c55474eaa846a173b45bfdd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:05.387233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:05.389171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:05.407371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f486c-d84c-4433-95a2-2d590aed715d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:05.419744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389701ab-b231-44cf-ae23-c62d47b019e8 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a93620933c4caeada0cf97e6eb3d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b1b431b39934744a1afd0a2e1085b1a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1335930880', 'tempest-DelegatedRole-582995807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:05.422877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389701ab-b231-44cf-ae23-c62d47b019e8 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:05.424003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389701ab-b231-44cf-ae23-c62d47b019e8 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:05.424714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389701ab-b231-44cf-ae23-c62d47b019e8 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] PATH_INFO: `/v3/OS-TRUST/trusts/2e9307303c55474eaa846a173b45bfdd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-389701ab-b231-44cf-ae23-c62d47b019e8 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Could not find trust: 2e9307303c55474eaa846a173b45bfdd.: keystone.exception.TrustNotFound: Could not find trust: 2e9307303c55474eaa846a173b45bfdd. Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 19 01:13:05.489114 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 2e9307303c55474eaa846a173b45bfdd. Oct 19 01:13:05.490548 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:05.491622 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3112/6260] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:13:05 2022] GET /identity/v3/OS-TRUST/trusts/2e9307303c55474eaa846a173b45bfdd => generated 111 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:13:05.495593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:05.497279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:05.526233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c6a43-7b3e-476e-af8b-d675d34e23fd tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:05.534874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:05.535658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:05.536008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:05.536356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/5718f960ab2d4f16a7abd8bdd701129a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:05.538222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5718f960ab2d4f16a7abd8bdd701129a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:05.539926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:05.550082 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:05.643347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role 5718f960ab2d4f16a7abd8bdd701129a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:05.643946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:05.648388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:05.654211 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3149/6261] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:05 2022] DELETE /identity/v3/roles/5718f960ab2d4f16a7abd8bdd701129a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:05.670909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389701ab-b231-44cf-ae23-c62d47b019e8 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:05.672948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-389701ab-b231-44cf-ae23-c62d47b019e8 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:05.685050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:05.686471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:05.698868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389701ab-b231-44cf-ae23-c62d47b019e8 tempest-TrustsV3TestJSON-950553966 tempest-user-1463137804] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:05.842273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44659f68-e768-4ee6-9bc5-11886a59aedf tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:05.857312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:05.858292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:05.860662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:05.861218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] PATH_INFO: `/v3/projects/cea19527cd164a4bb1c797649f2d8533` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:05.862900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea19527cd164a4bb1c797649f2d8533)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:05.869886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:05.896190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:05.897387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:05.897886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:05.898174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/a565ffbb84c34950af4512e6c9a49fcb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:05.901576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a565ffbb84c34950af4512e6c9a49fcb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:05.905534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:06.022625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea19527cd164a4bb1c797649f2d8533', 'request_id': 'req-3674fbcf-8009-4988-8ed1-deb475b09723'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.035780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role a565ffbb84c34950af4512e6c9a49fcb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:06.036222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.037295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.041224 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3113/6262] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:05 2022] DELETE /identity/v3/roles/a565ffbb84c34950af4512e6c9a49fcb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:06.042145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea19527cd164a4bb1c797649f2d8533', 'request_id': 'req-3674fbcf-8009-4988-8ed1-deb475b09723'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.053819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea19527cd164a4bb1c797649f2d8533', 'request_id': 'req-3674fbcf-8009-4988-8ed1-deb475b09723'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.054369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:06.056503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:06.083236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] The token cache is being invalidate because project cea19527cd164a4bb1c797649f2d8533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:06.083539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.089006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.090184 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3150/6263] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:05 2022] DELETE /identity/v3/projects/cea19527cd164a4bb1c797649f2d8533 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:06.096434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:06.102465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:06.277477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07890b1a-b90d-45ca-ac19-24ad756f6037 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:06.289023 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:06.296971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:06.297569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:06.297863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:06.298149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users/18a93620933c4caeada0cf97e6eb3d29` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:06.298746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674fbcf-8009-4988-8ed1-deb475b09723 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:06.300074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18a93620933c4caeada0cf97e6eb3d29)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:06.301852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:06.320160 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:06.438678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a93620933c4caeada0cf97e6eb3d29'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.459176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a93620933c4caeada0cf97e6eb3d29'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.476552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a93620933c4caeada0cf97e6eb3d29'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.479238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:06.480991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:06.482570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:06.483183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] PATH_INFO: `/v3/users/43a6ca4ffbf84d18a59f2f4954811639` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:06.487009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a6ca4ffbf84d18a59f2f4954811639)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:06.493220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:06.512891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a93620933c4caeada0cf97e6eb3d29'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.518047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a93620933c4caeada0cf97e6eb3d29'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.540926 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3114/6264] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:06 2022] DELETE /identity/v3/users/18a93620933c4caeada0cf97e6eb3d29 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:06.544213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:06.551236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:06.620866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a6ca4ffbf84d18a59f2f4954811639'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.650109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a6ca4ffbf84d18a59f2f4954811639'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.668548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a6ca4ffbf84d18a59f2f4954811639'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.686963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a6ca4ffbf84d18a59f2f4954811639'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.687733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a6ca4ffbf84d18a59f2f4954811639'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:06.707305 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3151/6265] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:06 2022] DELETE /identity/v3/users/43a6ca4ffbf84d18a59f2f4954811639 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:06.710468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:06.710468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:06.726446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d472644-9900-4083-9748-c73263dbcc3b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:06.881419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:06.882961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:06.883411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:06.883838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] PATH_INFO: `/v3/users/5ac399b59740442a93081bb1a78297b4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:06.885574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac399b59740442a93081bb1a78297b4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:06.887781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:06.917471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c09186-03a7-4677-86e8-b33a776eab3e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:06.936609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:06.939221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:06.942661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:06.943078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/7b1b431b39934744a1afd0a2e1085b1a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:06.948154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7b1b431b39934744a1afd0a2e1085b1a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:06.958380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:07.013125 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:07.036107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac399b59740442a93081bb1a78297b4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.054608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac399b59740442a93081bb1a78297b4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.071410 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:07.075508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac399b59740442a93081bb1a78297b4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.093458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac399b59740442a93081bb1a78297b4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.094622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac399b59740442a93081bb1a78297b4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.116054 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3115/6266] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:06 2022] DELETE /identity/v3/users/5ac399b59740442a93081bb1a78297b4 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:07.132136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1b431b39934744a1afd0a2e1085b1a', 'request_id': 'req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.142443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1b431b39934744a1afd0a2e1085b1a', 'request_id': 'req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.152923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1b431b39934744a1afd0a2e1085b1a', 'request_id': 'req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.169611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] The token cache is being invalidate because project 7b1b431b39934744a1afd0a2e1085b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:07.169906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.170606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:07.177012 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3152/6267] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:06 2022] DELETE /identity/v3/projects/7b1b431b39934744a1afd0a2e1085b1a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:07.178581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:07.180752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:07.341275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935664d5-907e-4012-ba03-0132a73d7382 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:07.358800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3761bae-90a4-4d8b-ab8d-170c449299a8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:07.360909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3761bae-90a4-4d8b-ab8d-170c449299a8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:07.361204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3761bae-90a4-4d8b-ab8d-170c449299a8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:07.361488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3761bae-90a4-4d8b-ab8d-170c449299a8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:07.362142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3761bae-90a4-4d8b-ab8d-170c449299a8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:07.367024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3761bae-90a4-4d8b-ab8d-170c449299a8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:07.440594 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3116/6268] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:13:07 2022] POST /identity/v3/projects => generated 329 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:07.441253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:07.442896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:07.616893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7a3a3-74d8-4936-8de1-e40cfb5c621e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:07.755952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce5bd-a19a-4008-83cf-f16130dff808 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:07.756581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce5bd-a19a-4008-83cf-f16130dff808 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:07.756858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce5bd-a19a-4008-83cf-f16130dff808 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:07.757191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce5bd-a19a-4008-83cf-f16130dff808 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:07.757862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce5bd-a19a-4008-83cf-f16130dff808 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:07.762113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce5bd-a19a-4008-83cf-f16130dff808 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:07.821364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3761bae-90a4-4d8b-ab8d-170c449299a8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:07.822949 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3153/6269] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:07 2022] POST /identity/v3/users => generated 413 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:07.827291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce5bd-a19a-4008-83cf-f16130dff808 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:07.828585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e3761bae-90a4-4d8b-ab8d-170c449299a8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:07.903738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce5bd-a19a-4008-83cf-f16130dff808 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:07.924506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc1892-1b2d-489c-9a9c-04fd1701453e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:07.925296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc1892-1b2d-489c-9a9c-04fd1701453e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:07.925583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc1892-1b2d-489c-9a9c-04fd1701453e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:07.927520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc1892-1b2d-489c-9a9c-04fd1701453e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:07.928395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc1892-1b2d-489c-9a9c-04fd1701453e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:07.931266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc1892-1b2d-489c-9a9c-04fd1701453e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:07.968027 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3154/6270] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:07 2022] POST /identity/v3/roles => generated 243 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:07.971466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc1892-1b2d-489c-9a9c-04fd1701453e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:08.028305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc1892-1b2d-489c-9a9c-04fd1701453e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:08.043140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07fb28-6aa8-40fb-9df7-dc1d8b4671a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:08.045169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07fb28-6aa8-40fb-9df7-dc1d8b4671a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:08.047595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07fb28-6aa8-40fb-9df7-dc1d8b4671a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:08.048040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07fb28-6aa8-40fb-9df7-dc1d8b4671a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:08.051155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07fb28-6aa8-40fb-9df7-dc1d8b4671a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:08.060157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07fb28-6aa8-40fb-9df7-dc1d8b4671a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:08.159432 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3155/6271] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:07 2022] POST /identity/v3/roles => generated 247 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:08.160593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07fb28-6aa8-40fb-9df7-dc1d8b4671a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:08.184762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3761bae-90a4-4d8b-ab8d-170c449299a8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:08.219876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:08.220549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:08.220890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:08.221172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] PATH_INFO: `/v3/projects/70df3bcbea2140d7929dd61554997673` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:08.221714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07fb28-6aa8-40fb-9df7-dc1d8b4671a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:08.232735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70df3bcbea2140d7929dd61554997673)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:08.241365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:08.252257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d105f75-6ad3-423d-b173-6fc70a887524 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:08.252847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d105f75-6ad3-423d-b173-6fc70a887524 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:08.253137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d105f75-6ad3-423d-b173-6fc70a887524 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:08.253425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d105f75-6ad3-423d-b173-6fc70a887524 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/5a1f0adcdfe54be796804f56fbf4694a/users/12292473f27c4a67a4b82328ac114df5/roles/1d87528896de4264a1701f7125fe6ac5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:08.317945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d105f75-6ad3-423d-b173-6fc70a887524 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5a1f0adcdfe54be796804f56fbf4694a, user_id=12292473f27c4a67a4b82328ac114df5, role_id=1d87528896de4264a1701f7125fe6ac5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:08.325390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d105f75-6ad3-423d-b173-6fc70a887524 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:08.345238 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=6,keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:08.362405 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3156/6272] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:08 2022] PUT /identity/v3/projects/5a1f0adcdfe54be796804f56fbf4694a/users/12292473f27c4a67a4b82328ac114df5/roles/1d87528896de4264a1701f7125fe6ac5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:08.367071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d105f75-6ad3-423d-b173-6fc70a887524 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:08.369834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4d105f75-6ad3-423d-b173-6fc70a887524 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:08.417216 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:08.439514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70df3bcbea2140d7929dd61554997673', 'request_id': 'req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:08.464976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70df3bcbea2140d7929dd61554997673', 'request_id': 'req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:08.481697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70df3bcbea2140d7929dd61554997673', 'request_id': 'req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:08.530100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] The token cache is being invalidate because project 70df3bcbea2140d7929dd61554997673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:08.532450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:08.535814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:08.542498 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3117/6273] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:07 2022] DELETE /identity/v3/projects/70df3bcbea2140d7929dd61554997673 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:08.547060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:08.550334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:08.590185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d105f75-6ad3-423d-b173-6fc70a887524 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:08.777677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:08.778537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:08.778927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:08.780214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] PATH_INFO: `/v3/projects/39c10fa11e244a629264dd733478c21b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:08.781153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3073-d0a9-43cb-a67b-2d8dd3071cc2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:08.786189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39c10fa11e244a629264dd733478c21b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:08.789738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:08.795528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b2fa-f716-4d89-9d7d-f1a9c48a72fd tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:08.796486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b2fa-f716-4d89-9d7d-f1a9c48a72fd tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:08.797450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b2fa-f716-4d89-9d7d-f1a9c48a72fd tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:08.798266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b2fa-f716-4d89-9d7d-f1a9c48a72fd tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/5a1f0adcdfe54be796804f56fbf4694a/users/12292473f27c4a67a4b82328ac114df5/roles/b1face4708a941e6ac72d201eb7513bb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:08.804727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33b2fa-f716-4d89-9d7d-f1a9c48a72fd tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5a1f0adcdfe54be796804f56fbf4694a, user_id=12292473f27c4a67a4b82328ac114df5, role_id=b1face4708a941e6ac72d201eb7513bb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:08.808286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33b2fa-f716-4d89-9d7d-f1a9c48a72fd tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:08.838992 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3118/6274] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:08 2022] PUT /identity/v3/projects/5a1f0adcdfe54be796804f56fbf4694a/users/12292473f27c4a67a4b82328ac114df5/roles/b1face4708a941e6ac72d201eb7513bb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:08.840799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b2fa-f716-4d89-9d7d-f1a9c48a72fd tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:08.847215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7a33b2fa-f716-4d89-9d7d-f1a9c48a72fd tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:08.924163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c10fa11e244a629264dd733478c21b', 'request_id': 'req-5203580e-a66c-47d1-9ebc-67e3fb1e1052'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:08.950860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c10fa11e244a629264dd733478c21b', 'request_id': 'req-5203580e-a66c-47d1-9ebc-67e3fb1e1052'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:08.962507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c10fa11e244a629264dd733478c21b', 'request_id': 'req-5203580e-a66c-47d1-9ebc-67e3fb1e1052'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:08.984817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] The token cache is being invalidate because project 39c10fa11e244a629264dd733478c21b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:08.985196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:08.987912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.010827 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3157/6275] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:08 2022] DELETE /identity/v3/projects/39c10fa11e244a629264dd733478c21b => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:09.014692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:09.016645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:09.086349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b2fa-f716-4d89-9d7d-f1a9c48a72fd tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:09.109050 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:09.186495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203580e-a66c-47d1-9ebc-67e3fb1e1052 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:09.200028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db280a22-c2a2-4095-a08d-0395c7401938 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:09.201565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db280a22-c2a2-4095-a08d-0395c7401938 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:09.202026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db280a22-c2a2-4095-a08d-0395c7401938 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:09.203073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db280a22-c2a2-4095-a08d-0395c7401938 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:09.204569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db280a22-c2a2-4095-a08d-0395c7401938 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:09.207567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db280a22-c2a2-4095-a08d-0395c7401938 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:09.235936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:09.236594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:09.236917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:09.237183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] PATH_INFO: `/v3/users/125a076c2d8a4e0eb3b87a4c0329cd87` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:09.241677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125a076c2d8a4e0eb3b87a4c0329cd87)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:09.243646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:09.265442 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:09.311656 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3158/6276] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:09 2022] GET /identity/v3/users => generated 8927 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:09.312841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db280a22-c2a2-4095-a08d-0395c7401938 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:09.319436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db280a22-c2a2-4095-a08d-0395c7401938 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:09.379454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db280a22-c2a2-4095-a08d-0395c7401938 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:09.403769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:09.405455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:09.405719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:09.405995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] PATH_INFO: `/v3/users/edaa34227d894985aa2a8b20ae71a5a7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:09.411396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125a076c2d8a4e0eb3b87a4c0329cd87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.412833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] RBAC: Authorizing `identity:delete_user(user_id=edaa34227d894985aa2a8b20ae71a5a7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:09.415128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:09.497339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125a076c2d8a4e0eb3b87a4c0329cd87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.526737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125a076c2d8a4e0eb3b87a4c0329cd87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.543556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125a076c2d8a4e0eb3b87a4c0329cd87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.544698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74dc2dd8-323b-4824-bd97-cbc348f2c8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125a076c2d8a4e0eb3b87a4c0329cd87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.562798 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3119/6277] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:08 2022] DELETE /identity/v3/users/125a076c2d8a4e0eb3b87a4c0329cd87 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:09.564549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7a3a2-f41c-4ae7-ab84-0b5070bba32e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:09.569570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7a3a2-f41c-4ae7-ab84-0b5070bba32e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:09.570944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7a3a2-f41c-4ae7-ab84-0b5070bba32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:09.592575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edaa34227d894985aa2a8b20ae71a5a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.629859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edaa34227d894985aa2a8b20ae71a5a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.639817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edaa34227d894985aa2a8b20ae71a5a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.650813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edaa34227d894985aa2a8b20ae71a5a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.651742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-594f4a45-9cc5-46cb-81a1-4a2789354add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edaa34227d894985aa2a8b20ae71a5a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:09.660390 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3159/6278] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:09 2022] DELETE /identity/v3/users/edaa34227d894985aa2a8b20ae71a5a7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:09.706649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6db7a3a2-f41c-4ae7-ab84-0b5070bba32e None None] MFA Rules not processed for user `12292473f27c4a67a4b82328ac114df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:09.708235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6db7a3a2-f41c-4ae7-ab84-0b5070bba32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:09.918685 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3120/6279] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:09.928561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c179c7-80e0-4ac1-94a8-a885fe0effbf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:09.929208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c179c7-80e0-4ac1-94a8-a885fe0effbf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:09.929208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c179c7-80e0-4ac1-94a8-a885fe0effbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:09.973394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b9c179c7-80e0-4ac1-94a8-a885fe0effbf None None] MFA Rules not processed for user `12292473f27c4a67a4b82328ac114df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:09.977285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b9c179c7-80e0-4ac1-94a8-a885fe0effbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:09.996359 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3160/6280] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:10.001484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7a3a2-f41c-4ae7-ab84-0b5070bba32e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:10.031760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7a3a2-f41c-4ae7-ab84-0b5070bba32e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:10.052856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db4237-2778-46e7-a7cc-0407cd2d04ee tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12292473f27c4a67a4b82328ac114df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1f0adcdfe54be796804f56fbf4694a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-166628186', 'tempest-NotDelegatedRole-1302797687'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:10.053581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db4237-2778-46e7-a7cc-0407cd2d04ee tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:10.053866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db4237-2778-46e7-a7cc-0407cd2d04ee tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:10.055673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db4237-2778-46e7-a7cc-0407cd2d04ee tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:10.056263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db4237-2778-46e7-a7cc-0407cd2d04ee tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: Authorizing `identity:create_trust()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:10.060950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db4237-2778-46e7-a7cc-0407cd2d04ee tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:10.318746 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:10.342896 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3121/6281] 10.222.0.27 () {60 vars in 1174 bytes} [Wed Oct 19 01:13:09 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:10.344231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c179c7-80e0-4ac1-94a8-a885fe0effbf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:10.376383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c179c7-80e0-4ac1-94a8-a885fe0effbf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:10.388664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c45ab-e7ca-424e-a022-82fba9f5be1e tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12292473f27c4a67a4b82328ac114df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1f0adcdfe54be796804f56fbf4694a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-166628186', 'tempest-NotDelegatedRole-1302797687'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:10.388664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c45ab-e7ca-424e-a022-82fba9f5be1e tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:10.400645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c45ab-e7ca-424e-a022-82fba9f5be1e tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:10.402570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c45ab-e7ca-424e-a022-82fba9f5be1e tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:10.403441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c45ab-e7ca-424e-a022-82fba9f5be1e tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:10.408045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c45ab-e7ca-424e-a022-82fba9f5be1e tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:10.420614 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3161/6282] 10.222.0.27 () {58 vars in 1252 bytes} [Wed Oct 19 01:13:10 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=12292473f27c4a67a4b82328ac114df5 => generated 611 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:10.424862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db4237-2778-46e7-a7cc-0407cd2d04ee tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:10.435516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db4237-2778-46e7-a7cc-0407cd2d04ee tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:10.460530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12292473f27c4a67a4b82328ac114df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1f0adcdfe54be796804f56fbf4694a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-166628186', 'tempest-NotDelegatedRole-1302797687'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:10.464056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:10.464350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:10.464717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] PATH_INFO: `/v3/OS-TRUST/trusts/ea66ba67c9f047b880b5ad8e3387824a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:10.493193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: Authorizing `identity:delete_trust(trust_id=ea66ba67c9f047b880b5ad8e3387824a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:10.496442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:10.583173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ea66ba67c9f047b880b5ad8e3387824a', 'request_id': 'req-2f43600b-f045-47e6-ab2f-84ab9953ced2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:10.585532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ea66ba67c9f047b880b5ad8e3387824a', 'request_id': 'req-2f43600b-f045-47e6-ab2f-84ab9953ced2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:10.586259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ea66ba67c9f047b880b5ad8e3387824a', 'request_id': 'req-2f43600b-f045-47e6-ab2f-84ab9953ced2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:10.634312 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3122/6283] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:13:10 2022] DELETE /identity/v3/OS-TRUST/trusts/ea66ba67c9f047b880b5ad8e3387824a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:10.638539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c45ab-e7ca-424e-a022-82fba9f5be1e tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:10.641670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-578c45ab-e7ca-424e-a022-82fba9f5be1e tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:10.669581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c45ab-e7ca-424e-a022-82fba9f5be1e tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:10.681538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32327a61-8f80-4277-9c57-556ec9015041 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12292473f27c4a67a4b82328ac114df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a1f0adcdfe54be796804f56fbf4694a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-166628186', 'tempest-NotDelegatedRole-1302797687'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:10.682206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32327a61-8f80-4277-9c57-556ec9015041 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:10.682487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32327a61-8f80-4277-9c57-556ec9015041 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:10.682768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32327a61-8f80-4277-9c57-556ec9015041 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] PATH_INFO: `/v3/OS-TRUST/trusts/ea66ba67c9f047b880b5ad8e3387824a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-32327a61-8f80-4277-9c57-556ec9015041 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Could not find trust: ea66ba67c9f047b880b5ad8e3387824a.: keystone.exception.TrustNotFound: Could not find trust: ea66ba67c9f047b880b5ad8e3387824a. Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 19 01:13:10.706442 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: ea66ba67c9f047b880b5ad8e3387824a. Oct 19 01:13:10.707494 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:13:10.708514 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3162/6284] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:13:10 2022] GET /identity/v3/OS-TRUST/trusts/ea66ba67c9f047b880b5ad8e3387824a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:13:10.720647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:10.720647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:10.860018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43600b-f045-47e6-ab2f-84ab9953ced2 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:10.904918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:10.905760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:10.906082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:10.906410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/b1face4708a941e6ac72d201eb7513bb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:10.909126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b1face4708a941e6ac72d201eb7513bb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:10.910803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:10.955698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32327a61-8f80-4277-9c57-556ec9015041 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:10.959660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-32327a61-8f80-4277-9c57-556ec9015041 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:11.089981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role b1face4708a941e6ac72d201eb7513bb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:11.090349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:11.105858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:11.124555 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3123/6285] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:10 2022] DELETE /identity/v3/roles/b1face4708a941e6ac72d201eb7513bb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:11.130226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:11.137016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:11.246604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32327a61-8f80-4277-9c57-556ec9015041 tempest-TrustsV3TestJSON-1718123847 tempest-user-505997527] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:11.349096 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:11.388826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee6f99-424c-4d05-9ec5-1a33ab2e4f6a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:11.406679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:11.407552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:11.408506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:11.408924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/1d87528896de4264a1701f7125fe6ac5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:11.411482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1d87528896de4264a1701f7125fe6ac5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:11.414576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:11.449960 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:11.481877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role 1d87528896de4264a1701f7125fe6ac5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:11.482843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:11.484951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:11.491017 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3124/6286] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:11 2022] DELETE /identity/v3/roles/1d87528896de4264a1701f7125fe6ac5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:11.492314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:11.493295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:11.494113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:11.494785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:11.495319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] PATH_INFO: `/v3/projects/615bbef4099a4e17a7c32d0cddaf0f45` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:11.497246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:11.500998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=615bbef4099a4e17a7c32d0cddaf0f45)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:11.506324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:11.690467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615bbef4099a4e17a7c32d0cddaf0f45', 'request_id': 'req-0bf050f4-2c08-42f9-a826-38227075ef90'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:11.730680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615bbef4099a4e17a7c32d0cddaf0f45', 'request_id': 'req-0bf050f4-2c08-42f9-a826-38227075ef90'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:11.775030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615bbef4099a4e17a7c32d0cddaf0f45', 'request_id': 'req-0bf050f4-2c08-42f9-a826-38227075ef90'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:11.815322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b2c3-c0a3-43a9-8aa1-5da69e94ded5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:11.835338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] The token cache is being invalidate because project 615bbef4099a4e17a7c32d0cddaf0f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:11.837584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:11.839273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:11.846625 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3163/6287] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:10 2022] DELETE /identity/v3/projects/615bbef4099a4e17a7c32d0cddaf0f45 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:11.847863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:11.854052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:11.964240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:11.965083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:11.965368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:11.965640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] PATH_INFO: `/v3/projects/82d68a1ba83f46ed92a512e22eefdb30` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:11.970104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d68a1ba83f46ed92a512e22eefdb30)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:11.972324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:12.070541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf050f4-2c08-42f9-a826-38227075ef90 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:12.096462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d68a1ba83f46ed92a512e22eefdb30', 'request_id': 'req-6fed71ff-a358-4bbe-aca4-629373d92826'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.123329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d68a1ba83f46ed92a512e22eefdb30', 'request_id': 'req-6fed71ff-a358-4bbe-aca4-629373d92826'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.130928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d68a1ba83f46ed92a512e22eefdb30', 'request_id': 'req-6fed71ff-a358-4bbe-aca4-629373d92826'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.153779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] The token cache is being invalidate because project 82d68a1ba83f46ed92a512e22eefdb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:12.154067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.155763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6fed71ff-a358-4bbe-aca4-629373d92826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.159432 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3125/6288] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:11 2022] DELETE /identity/v3/projects/82d68a1ba83f46ed92a512e22eefdb30 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:12.160913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e71da-b6c0-4973-bc74-41d3bf930db9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:12.161198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e71da-b6c0-4973-bc74-41d3bf930db9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:12.161471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e71da-b6c0-4973-bc74-41d3bf930db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:12.210099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fb5e71da-b6c0-4973-bc74-41d3bf930db9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:12.211402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fb5e71da-b6c0-4973-bc74-41d3bf930db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:12.270431 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:12.374327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:12.374997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:12.375328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:12.375537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users/12292473f27c4a67a4b82328ac114df5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:12.382523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=12292473f27c4a67a4b82328ac114df5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:12.384501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:12.404612 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3126/6289] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:12.404612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34613f-9df7-4289-a446-32472e910021 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:12.404612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34613f-9df7-4289-a446-32472e910021 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:12.404612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34613f-9df7-4289-a446-32472e910021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:12.412540 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:12.469629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bf34613f-9df7-4289-a446-32472e910021 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:12.473314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bf34613f-9df7-4289-a446-32472e910021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:12.495283 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3127/6290] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:12.496541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827636c1-484a-4a9d-b3a4-1b6baef1142b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:12.496870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827636c1-484a-4a9d-b3a4-1b6baef1142b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:12.497141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827636c1-484a-4a9d-b3a4-1b6baef1142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:12.522863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12292473f27c4a67a4b82328ac114df5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.544427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-827636c1-484a-4a9d-b3a4-1b6baef1142b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:12.545617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-827636c1-484a-4a9d-b3a4-1b6baef1142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:12.551404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12292473f27c4a67a4b82328ac114df5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.568893 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3128/6291] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:12.570251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601b722-d50e-4af6-b2b5-f4f691b074ae None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:12.570553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601b722-d50e-4af6-b2b5-f4f691b074ae None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:12.570818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601b722-d50e-4af6-b2b5-f4f691b074ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:12.575874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12292473f27c4a67a4b82328ac114df5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.606048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12292473f27c4a67a4b82328ac114df5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.607851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12292473f27c4a67a4b82328ac114df5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:12.617547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8601b722-d50e-4af6-b2b5-f4f691b074ae None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:12.618082 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3164/6292] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:11 2022] DELETE /identity/v3/users/12292473f27c4a67a4b82328ac114df5 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:12.619187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:12.620027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8601b722-d50e-4af6-b2b5-f4f691b074ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:12.621004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:12.750878 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3129/6293] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:12.752042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601b722-d50e-4af6-b2b5-f4f691b074ae None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:12.754764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8601b722-d50e-4af6-b2b5-f4f691b074ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:12.868330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cfa63-0617-4de6-be1c-65c7360b42a5 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:12.890643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03624b58-04d9-4ed7-bcf0-c643b2b74d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:12.893497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03624b58-04d9-4ed7-bcf0-c643b2b74d7a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:12.896738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03624b58-04d9-4ed7-bcf0-c643b2b74d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:12.897262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03624b58-04d9-4ed7-bcf0-c643b2b74d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:12.899078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03624b58-04d9-4ed7-bcf0-c643b2b74d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:13:12.899609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03624b58-04d9-4ed7-bcf0-c643b2b74d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:12.903826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03624b58-04d9-4ed7-bcf0-c643b2b74d7a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:12.938430 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3165/6294] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:12.944563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03624b58-04d9-4ed7-bcf0-c643b2b74d7a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:12.967766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601b722-d50e-4af6-b2b5-f4f691b074ae None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:12.973512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:12.974209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:12.974494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:12.974776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/5a1f0adcdfe54be796804f56fbf4694a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:12.976409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a1f0adcdfe54be796804f56fbf4694a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:12.978433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:12.980176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03624b58-04d9-4ed7-bcf0-c643b2b74d7a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:12.994046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e23017-6be7-4d45-9343-2590e7c1eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:12.996047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e23017-6be7-4d45-9343-2590e7c1eeeb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:12.997367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e23017-6be7-4d45-9343-2590e7c1eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:12.998597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e23017-6be7-4d45-9343-2590e7c1eeeb admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:13.001911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e23017-6be7-4d45-9343-2590e7c1eeeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:13:13.002367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e23017-6be7-4d45-9343-2590e7c1eeeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:13.010720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e23017-6be7-4d45-9343-2590e7c1eeeb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:13.060700 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3166/6295] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:13.064057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e23017-6be7-4d45-9343-2590e7c1eeeb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:13.096157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e23017-6be7-4d45-9343-2590e7c1eeeb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:13.116838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1f0adcdfe54be796804f56fbf4694a', 'request_id': 'req-327aea59-4fd8-40ee-997d-818cf1cea848'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:13.128611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1f0adcdfe54be796804f56fbf4694a', 'request_id': 'req-327aea59-4fd8-40ee-997d-818cf1cea848'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:13.131163 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:13.155241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1f0adcdfe54be796804f56fbf4694a', 'request_id': 'req-327aea59-4fd8-40ee-997d-818cf1cea848'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:13.186164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] The token cache is being invalidate because project 5a1f0adcdfe54be796804f56fbf4694a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:13.186473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:13.187813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:13.195151 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3130/6296] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:12 2022] DELETE /identity/v3/projects/5a1f0adcdfe54be796804f56fbf4694a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:13.196088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:13.201018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:13.326167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40621d-9182-48cf-9505-38feb7234271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:13.326872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40621d-9182-48cf-9505-38feb7234271 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:13.327227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40621d-9182-48cf-9505-38feb7234271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:13.327576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40621d-9182-48cf-9505-38feb7234271 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:13.328359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40621d-9182-48cf-9505-38feb7234271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:13.330757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40621d-9182-48cf-9505-38feb7234271 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:13.351698 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:13.366951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aea59-4fd8-40ee-997d-818cf1cea848 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:13.380206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6e190-c8df-4bfd-b7c2-2f3f3b6c6cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:13.381394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6e190-c8df-4bfd-b7c2-2f3f3b6c6cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:13.381809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6e190-c8df-4bfd-b7c2-2f3f3b6c6cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:13.382092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6e190-c8df-4bfd-b7c2-2f3f3b6c6cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:13.382737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6e190-c8df-4bfd-b7c2-2f3f3b6c6cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:13.385261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6e190-c8df-4bfd-b7c2-2f3f3b6c6cf0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:13.408671 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3167/6297] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:13:13 2022] POST /identity/v3/projects => generated 389 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:13.408671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40621d-9182-48cf-9505-38feb7234271 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:13.408671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-af40621d-9182-48cf-9505-38feb7234271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:13.451191 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3131/6298] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:13:13 2022] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:13.451191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6e190-c8df-4bfd-b7c2-2f3f3b6c6cf0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:13.452809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1ff6e190-c8df-4bfd-b7c2-2f3f3b6c6cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:13.506031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40621d-9182-48cf-9505-38feb7234271 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:13.587692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6e190-c8df-4bfd-b7c2-2f3f3b6c6cf0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:13.593914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ca885-f530-43bf-b375-4c16d94cb9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:13.595840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ca885-f530-43bf-b375-4c16d94cb9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:13.596043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ca885-f530-43bf-b375-4c16d94cb9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:13.596417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ca885-f530-43bf-b375-4c16d94cb9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:13.597178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ca885-f530-43bf-b375-4c16d94cb9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:13.600780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ca885-f530-43bf-b375-4c16d94cb9c9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:13.617046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742eceb-5fc8-43a3-9090-2cfc67bdbd57 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:13.617678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742eceb-5fc8-43a3-9090-2cfc67bdbd57 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:13.618049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742eceb-5fc8-43a3-9090-2cfc67bdbd57 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:13.618418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742eceb-5fc8-43a3-9090-2cfc67bdbd57 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:13.619201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742eceb-5fc8-43a3-9090-2cfc67bdbd57 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:13.621102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742eceb-5fc8-43a3-9090-2cfc67bdbd57 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:13.644613 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3132/6299] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:13 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:13.648210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ca885-f530-43bf-b375-4c16d94cb9c9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:13.679426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ca885-f530-43bf-b375-4c16d94cb9c9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:13.693095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e0c31-7a0b-423b-8d33-17866475eea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:13.693432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e0c31-7a0b-423b-8d33-17866475eea9 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:13.693717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e0c31-7a0b-423b-8d33-17866475eea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:13.694086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e0c31-7a0b-423b-8d33-17866475eea9 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:13.694741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e0c31-7a0b-423b-8d33-17866475eea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:13.699699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e0c31-7a0b-423b-8d33-17866475eea9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:13.716485 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3168/6300] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:13:13 2022] POST /identity/v3/projects => generated 328 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:13.719940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742eceb-5fc8-43a3-9090-2cfc67bdbd57 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:13.757648 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3133/6301] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:13 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:13.758301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e0c31-7a0b-423b-8d33-17866475eea9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:13.784470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e0c31-7a0b-423b-8d33-17866475eea9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:13.891855 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=2,keystone:SELECT=91,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:13.899672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742eceb-5fc8-43a3-9090-2cfc67bdbd57 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:13.909273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cee3e-2eee-444b-b170-a35f25de44f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:13.910440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cee3e-2eee-444b-b170-a35f25de44f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:13.911416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cee3e-2eee-444b-b170-a35f25de44f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:13.914029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cee3e-2eee-444b-b170-a35f25de44f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:13.914971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cee3e-2eee-444b-b170-a35f25de44f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:13.918455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cee3e-2eee-444b-b170-a35f25de44f7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:13.936365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9135ac2-1ece-4986-8749-b5b97d25a8f1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:13.937041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9135ac2-1ece-4986-8749-b5b97d25a8f1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:13.937330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9135ac2-1ece-4986-8749-b5b97d25a8f1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:13.937611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9135ac2-1ece-4986-8749-b5b97d25a8f1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:13.938278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9135ac2-1ece-4986-8749-b5b97d25a8f1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:13.939335 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3169/6302] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:13.940258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9135ac2-1ece-4986-8749-b5b97d25a8f1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:13.945074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cee3e-2eee-444b-b170-a35f25de44f7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:13.956380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cee3e-2eee-444b-b170-a35f25de44f7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:13.969724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94399-3c0e-4c9c-951f-6d997a516a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:13.970629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94399-3c0e-4c9c-951f-6d997a516a4f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:13.970989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94399-3c0e-4c9c-951f-6d997a516a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:13.971339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94399-3c0e-4c9c-951f-6d997a516a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:13.972082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94399-3c0e-4c9c-951f-6d997a516a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:13.976826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94399-3c0e-4c9c-951f-6d997a516a4f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:14.003028 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3170/6303] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:14.008532 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3134/6304] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:13 2022] POST /identity/v3/users => generated 413 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:14.010077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9135ac2-1ece-4986-8749-b5b97d25a8f1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.017791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94399-3c0e-4c9c-951f-6d997a516a4f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.039592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9135ac2-1ece-4986-8749-b5b97d25a8f1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:14.055766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94399-3c0e-4c9c-951f-6d997a516a4f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:14.057807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b51a2-68f2-4870-851b-9bc325887ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:14.059220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b51a2-68f2-4870-851b-9bc325887ecd admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.060483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b51a2-68f2-4870-851b-9bc325887ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.062505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b51a2-68f2-4870-851b-9bc325887ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.063901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14748159-d15e-4152-9535-cd390dcebdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:14.064295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b51a2-68f2-4870-851b-9bc325887ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:14.064846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14748159-d15e-4152-9535-cd390dcebdfe admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.065427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14748159-d15e-4152-9535-cd390dcebdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.066504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14748159-d15e-4152-9535-cd390dcebdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.068112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b51a2-68f2-4870-851b-9bc325887ecd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:14.068558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14748159-d15e-4152-9535-cd390dcebdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:14.071461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14748159-d15e-4152-9535-cd390dcebdfe admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:14.076473 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:14.102992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3171/6305] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:14.106853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14748159-d15e-4152-9535-cd390dcebdfe admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.112199 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3135/6306] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:14.113958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b51a2-68f2-4870-851b-9bc325887ecd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.127444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b51a2-68f2-4870-851b-9bc325887ecd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:14.133051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14748159-d15e-4152-9535-cd390dcebdfe admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:14.135657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9b589-f63e-4d80-a15b-a08bf0b303b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:14.136568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9b589-f63e-4d80-a15b-a08bf0b303b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.137030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9b589-f63e-4d80-a15b-a08bf0b303b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.137554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9b589-f63e-4d80-a15b-a08bf0b303b0 admin admin] PATH_INFO: `/v3/projects/69300f41e0bb41c191a9576afafccd63/users/4e394c9876db468caaf058abac55f3fc/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.141757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb767fa-29a1-4b7c-b91b-8d42b6d4d027 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:14.143438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb767fa-29a1-4b7c-b91b-8d42b6d4d027 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.143839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb767fa-29a1-4b7c-b91b-8d42b6d4d027 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.144259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb767fa-29a1-4b7c-b91b-8d42b6d4d027 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.145055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb767fa-29a1-4b7c-b91b-8d42b6d4d027 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:14.146777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb767fa-29a1-4b7c-b91b-8d42b6d4d027 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:14.160410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9b589-f63e-4d80-a15b-a08bf0b303b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69300f41e0bb41c191a9576afafccd63, user_id=4e394c9876db468caaf058abac55f3fc, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:14.165108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9b589-f63e-4d80-a15b-a08bf0b303b0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:14.176079 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3172/6307] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:14 2022] POST /identity/v3/roles => generated 243 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:14.177104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb767fa-29a1-4b7c-b91b-8d42b6d4d027 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.187128 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3136/6308] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:14 2022] PUT /identity/v3/projects/69300f41e0bb41c191a9576afafccd63/users/4e394c9876db468caaf058abac55f3fc/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:14.187399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9b589-f63e-4d80-a15b-a08bf0b303b0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.211511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb767fa-29a1-4b7c-b91b-8d42b6d4d027 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:14.326542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9b589-f63e-4d80-a15b-a08bf0b303b0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:14.358049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76635462-7d5b-4335-83a6-24966b848390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:14.358600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635462-7d5b-4335-83a6-24966b848390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.358860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635462-7d5b-4335-83a6-24966b848390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.359136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635462-7d5b-4335-83a6-24966b848390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.359809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76635462-7d5b-4335-83a6-24966b848390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:14.361434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76635462-7d5b-4335-83a6-24966b848390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:14.398907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d81ed-43bc-42e7-99ce-d5f36029d1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:14.399891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d81ed-43bc-42e7-99ce-d5f36029d1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.400173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d81ed-43bc-42e7-99ce-d5f36029d1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.400539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d81ed-43bc-42e7-99ce-d5f36029d1aa admin admin] PATH_INFO: `/v3/projects/6427e911425448799551f73e680c0641/users/d14bbb9be09b487a99f14ac691387d87/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.403667 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3137/6309] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:14 2022] POST /identity/v3/roles => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:14.406170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070eb9c2-0caa-43e7-93d6-2350a75f7c2c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.406748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070eb9c2-0caa-43e7-93d6-2350a75f7c2c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.407537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070eb9c2-0caa-43e7-93d6-2350a75f7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.464941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d81ed-43bc-42e7-99ce-d5f36029d1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6427e911425448799551f73e680c0641, user_id=d14bbb9be09b487a99f14ac691387d87, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:14.470693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d81ed-43bc-42e7-99ce-d5f36029d1aa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:14.473867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-070eb9c2-0caa-43e7-93d6-2350a75f7c2c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:14.478318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-070eb9c2-0caa-43e7-93d6-2350a75f7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:14.498849 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3173/6310] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:14 2022] PUT /identity/v3/projects/6427e911425448799551f73e680c0641/users/d14bbb9be09b487a99f14ac691387d87/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:14.500033 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3138/6311] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:14.500499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d81ed-43bc-42e7-99ce-d5f36029d1aa admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.511247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070eb9c2-0caa-43e7-93d6-2350a75f7c2c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.513988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-070eb9c2-0caa-43e7-93d6-2350a75f7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:14.644761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d81ed-43bc-42e7-99ce-d5f36029d1aa admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:14.648185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070eb9c2-0caa-43e7-93d6-2350a75f7c2c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:14.651406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87514a-6b26-4ac2-a115-323baafbb5cb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:14.652086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87514a-6b26-4ac2-a115-323baafbb5cb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.652609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87514a-6b26-4ac2-a115-323baafbb5cb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.653066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87514a-6b26-4ac2-a115-323baafbb5cb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/e8a762d714f344188a48a836203361b2/users/2d286a4ec69e4854b8fb5e2f50117a3f/roles/c5391cf37df540e792bcb825bd060adc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.674875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87514a-6b26-4ac2-a115-323baafbb5cb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e8a762d714f344188a48a836203361b2, user_id=2d286a4ec69e4854b8fb5e2f50117a3f, role_id=c5391cf37df540e792bcb825bd060adc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:14.679575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87514a-6b26-4ac2-a115-323baafbb5cb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:14.706135 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3174/6312] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:14 2022] PUT /identity/v3/projects/e8a762d714f344188a48a836203361b2/users/2d286a4ec69e4854b8fb5e2f50117a3f/roles/c5391cf37df540e792bcb825bd060adc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:14.707177 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:14.709852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307495b-b993-487d-9d05-0d4f4ec57459 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.710463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307495b-b993-487d-9d05-0d4f4ec57459 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.711617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307495b-b993-487d-9d05-0d4f4ec57459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.725500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ed99d-fcbb-4dde-a57a-b655bfdbe8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:14.726316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ed99d-fcbb-4dde-a57a-b655bfdbe8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:14.726707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ed99d-fcbb-4dde-a57a-b655bfdbe8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:14.727174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ed99d-fcbb-4dde-a57a-b655bfdbe8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:14.729309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-436ed99d-fcbb-4dde-a57a-b655bfdbe8e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:14.754194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4307495b-b993-487d-9d05-0d4f4ec57459 None None] MFA Rules not processed for user `d14bbb9be09b487a99f14ac691387d87`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:14.757093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4307495b-b993-487d-9d05-0d4f4ec57459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:14.815609 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:14.830733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ed99d-fcbb-4dde-a57a-b655bfdbe8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:14.832736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ed99d-fcbb-4dde-a57a-b655bfdbe8e2 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:14.848487 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3175/6313] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:14.853647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307495b-b993-487d-9d05-0d4f4ec57459 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.853647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4307495b-b993-487d-9d05-0d4f4ec57459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:14.859066 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3139/6314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:14.862867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ed99d-fcbb-4dde-a57a-b655bfdbe8e2 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:14.884434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ed99d-fcbb-4dde-a57a-b655bfdbe8e2 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:15.005813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307495b-b993-487d-9d05-0d4f4ec57459 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:15.015902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee1f4-7385-40b2-8d7b-555c68098883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:15.016767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee1f4-7385-40b2-8d7b-555c68098883 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:15.017691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee1f4-7385-40b2-8d7b-555c68098883 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:15.019343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee1f4-7385-40b2-8d7b-555c68098883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:15.034435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557d60a-6664-42b4-9263-ea074efcb7f7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:15.035237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557d60a-6664-42b4-9263-ea074efcb7f7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:15.035524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557d60a-6664-42b4-9263-ea074efcb7f7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:15.035804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557d60a-6664-42b4-9263-ea074efcb7f7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/e8a762d714f344188a48a836203361b2/users/2d286a4ec69e4854b8fb5e2f50117a3f/roles/77ce9173433242b2826eb37ddd5fbd3a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:15.040457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557d60a-6664-42b4-9263-ea074efcb7f7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e8a762d714f344188a48a836203361b2, user_id=2d286a4ec69e4854b8fb5e2f50117a3f, role_id=77ce9173433242b2826eb37ddd5fbd3a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:15.043536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557d60a-6664-42b4-9263-ea074efcb7f7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:15.076190 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3140/6315] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:14 2022] PUT /identity/v3/projects/e8a762d714f344188a48a836203361b2/users/2d286a4ec69e4854b8fb5e2f50117a3f/roles/77ce9173433242b2826eb37ddd5fbd3a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:15.076967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557d60a-6664-42b4-9263-ea074efcb7f7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:15.088875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c557d60a-6664-42b4-9263-ea074efcb7f7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:15.171630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee1f4-7385-40b2-8d7b-555c68098883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:15.173193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee1f4-7385-40b2-8d7b-555c68098883 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:15.200360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3176/6316] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:15.201419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee1f4-7385-40b2-8d7b-555c68098883 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:15.225635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee1f4-7385-40b2-8d7b-555c68098883 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:15.251028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557d60a-6664-42b4-9263-ea074efcb7f7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:15.265642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df375cb6-7810-4619-a3bc-799bd1bd91f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:15.266398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df375cb6-7810-4619-a3bc-799bd1bd91f6 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:15.268779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df375cb6-7810-4619-a3bc-799bd1bd91f6 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:15.269084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df375cb6-7810-4619-a3bc-799bd1bd91f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:15.429738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca08f1b-58fe-4876-a455-fdb2ee3f4b80 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:15.432809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca08f1b-58fe-4876-a455-fdb2ee3f4b80 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:15.433104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca08f1b-58fe-4876-a455-fdb2ee3f4b80 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:15.436718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca08f1b-58fe-4876-a455-fdb2ee3f4b80 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:15.437443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca08f1b-58fe-4876-a455-fdb2ee3f4b80 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:15.445897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca08f1b-58fe-4876-a455-fdb2ee3f4b80 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:15.464860 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:15.499472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df375cb6-7810-4619-a3bc-799bd1bd91f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:15.501329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df375cb6-7810-4619-a3bc-799bd1bd91f6 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:15.519032 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3141/6317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:15.573752 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3177/6318] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:15 2022] GET /identity/v3/users => generated 8912 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:15.579888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003e44-10c5-412d-9ce2-16ae47dc2de6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:15.580242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003e44-10c5-412d-9ce2-16ae47dc2de6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:15.580571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003e44-10c5-412d-9ce2-16ae47dc2de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:15.744144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-61003e44-10c5-412d-9ce2-16ae47dc2de6 None None] MFA Rules not processed for user `2d286a4ec69e4854b8fb5e2f50117a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:15.755186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-61003e44-10c5-412d-9ce2-16ae47dc2de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:15.910084 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3142/6319] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:15.911883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059005-05cf-42a2-93c7-6ded9318e169 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:15.912214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059005-05cf-42a2-93c7-6ded9318e169 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:15.912497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059005-05cf-42a2-93c7-6ded9318e169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:15.939223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-97059005-05cf-42a2-93c7-6ded9318e169 None None] MFA Rules not processed for user `2d286a4ec69e4854b8fb5e2f50117a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:15.941014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-97059005-05cf-42a2-93c7-6ded9318e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:15.955645 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3178/6320] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:13:15.956109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61003e44-10c5-412d-9ce2-16ae47dc2de6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:15.969751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61003e44-10c5-412d-9ce2-16ae47dc2de6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:15.984179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e353be-6902-4447-a2a7-0e87587ac03a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d286a4ec69e4854b8fb5e2f50117a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a762d714f344188a48a836203361b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-417437105', 'tempest-DelegatedRole-885670426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:15.986367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e353be-6902-4447-a2a7-0e87587ac03a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:15.986973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e353be-6902-4447-a2a7-0e87587ac03a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:15.987267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e353be-6902-4447-a2a7-0e87587ac03a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:15.989153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e353be-6902-4447-a2a7-0e87587ac03a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorizing `identity:create_trust()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:15.991224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e353be-6902-4447-a2a7-0e87587ac03a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:16.176640 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3143/6321] 10.222.0.27 () {60 vars in 1174 bytes} [Wed Oct 19 01:13:15 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:13:16.183015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059005-05cf-42a2-93c7-6ded9318e169 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:16.208266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059005-05cf-42a2-93c7-6ded9318e169 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:16.239221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f07f0-f7f5-4311-aa16-3b3861fc8eef tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d286a4ec69e4854b8fb5e2f50117a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a762d714f344188a48a836203361b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-417437105', 'tempest-DelegatedRole-885670426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:16.240497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f07f0-f7f5-4311-aa16-3b3861fc8eef tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:16.242064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f07f0-f7f5-4311-aa16-3b3861fc8eef tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:16.243271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f07f0-f7f5-4311-aa16-3b3861fc8eef tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] PATH_INFO: `/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:16.261376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f07f0-f7f5-4311-aa16-3b3861fc8eef tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorizing `identity:get_trust(trust_id=6bb6ec3ae3594161b893af09d2baa41c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:16.264375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f07f0-f7f5-4311-aa16-3b3861fc8eef tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:16.272930 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:16.291892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e353be-6902-4447-a2a7-0e87587ac03a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:16.293760 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3179/6322] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:13:16 2022] GET /identity/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c => generated 858 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:16.322735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e353be-6902-4447-a2a7-0e87587ac03a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:16.333083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565ed04-8bcc-4890-a515-89900404dbc2 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d286a4ec69e4854b8fb5e2f50117a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a762d714f344188a48a836203361b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-417437105', 'tempest-DelegatedRole-885670426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:16.335376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565ed04-8bcc-4890-a515-89900404dbc2 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:16.335703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565ed04-8bcc-4890-a515-89900404dbc2 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:16.336032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565ed04-8bcc-4890-a515-89900404dbc2 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] PATH_INFO: `/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:16.352137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565ed04-8bcc-4890-a515-89900404dbc2 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6bb6ec3ae3594161b893af09d2baa41c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:16.353987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565ed04-8bcc-4890-a515-89900404dbc2 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:16.381934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f07f0-f7f5-4311-aa16-3b3861fc8eef tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:16.382155 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3144/6323] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 01:13:16 2022] GET /identity/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles => generated 370 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:16.399917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f07f0-f7f5-4311-aa16-3b3861fc8eef tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:16.416788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31d8d-134d-42cf-83ec-462b32816d8a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d286a4ec69e4854b8fb5e2f50117a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a762d714f344188a48a836203361b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-417437105', 'tempest-DelegatedRole-885670426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:16.416788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31d8d-134d-42cf-83ec-462b32816d8a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:16.416788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31d8d-134d-42cf-83ec-462b32816d8a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:16.417291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31d8d-134d-42cf-83ec-462b32816d8a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] PATH_INFO: `/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles/c5391cf37df540e792bcb825bd060adc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:16.425846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c31d8d-134d-42cf-83ec-462b32816d8a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6bb6ec3ae3594161b893af09d2baa41c, role_id=c5391cf37df540e792bcb825bd060adc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:16.429090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c31d8d-134d-42cf-83ec-462b32816d8a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:16.439579 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3180/6324] 10.222.0.27 () {58 vars in 1368 bytes} [Wed Oct 19 01:13:16 2022] GET /identity/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles/c5391cf37df540e792bcb825bd060adc => generated 243 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:16.446170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565ed04-8bcc-4890-a515-89900404dbc2 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:16.463006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565ed04-8bcc-4890-a515-89900404dbc2 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:16.471367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5f758-fe75-4b33-bd10-a260ac2c0811 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d286a4ec69e4854b8fb5e2f50117a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a762d714f344188a48a836203361b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-417437105', 'tempest-DelegatedRole-885670426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:16.472578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5f758-fe75-4b33-bd10-a260ac2c0811 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:16.473212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5f758-fe75-4b33-bd10-a260ac2c0811 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:16.473678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5f758-fe75-4b33-bd10-a260ac2c0811 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] PATH_INFO: `/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles/c5391cf37df540e792bcb825bd060adc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:16.483956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5f758-fe75-4b33-bd10-a260ac2c0811 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6bb6ec3ae3594161b893af09d2baa41c, role_id=c5391cf37df540e792bcb825bd060adc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:16.487058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5f758-fe75-4b33-bd10-a260ac2c0811 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:16.508178 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3145/6325] 10.222.0.27 () {58 vars in 1369 bytes} [Wed Oct 19 01:13:16 2022] HEAD /identity/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles/c5391cf37df540e792bcb825bd060adc => generated 0 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 19 01:13:16.512802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31d8d-134d-42cf-83ec-462b32816d8a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:16.528979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31d8d-134d-42cf-83ec-462b32816d8a tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:16.547212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c4985-8c6e-4a23-8974-afebfa9af534 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d286a4ec69e4854b8fb5e2f50117a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a762d714f344188a48a836203361b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-417437105', 'tempest-DelegatedRole-885670426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:16.548919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c4985-8c6e-4a23-8974-afebfa9af534 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:16.549409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c4985-8c6e-4a23-8974-afebfa9af534 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:16.550140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c4985-8c6e-4a23-8974-afebfa9af534 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] PATH_INFO: `/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles/77ce9173433242b2826eb37ddd5fbd3a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:16.577377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c4985-8c6e-4a23-8974-afebfa9af534 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6bb6ec3ae3594161b893af09d2baa41c, role_id=77ce9173433242b2826eb37ddd5fbd3a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:16.581194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c4985-8c6e-4a23-8974-afebfa9af534 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-224c4985-8c6e-4a23-8974-afebfa9af534 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Could not find role: 77ce9173433242b2826eb37ddd5fbd3a.: keystone.exception.RoleNotFound: Could not find role: 77ce9173433242b2826eb37ddd5fbd3a. Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 01:13:16.594953 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 77ce9173433242b2826eb37ddd5fbd3a. Oct 19 01:13:16.596071 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:13:16.600381 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3181/6326] 10.222.0.27 () {58 vars in 1368 bytes} [Wed Oct 19 01:13:16 2022] GET /identity/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles/77ce9173433242b2826eb37ddd5fbd3a => generated 110 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:13:16.601720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5f758-fe75-4b33-bd10-a260ac2c0811 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:16.618623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5f758-fe75-4b33-bd10-a260ac2c0811 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:16.623450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d286a4ec69e4854b8fb5e2f50117a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a762d714f344188a48a836203361b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-417437105', 'tempest-DelegatedRole-885670426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:16.624203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:16.624715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:16.627136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] PATH_INFO: `/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles/77ce9173433242b2826eb37ddd5fbd3a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:16.642997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6bb6ec3ae3594161b893af09d2baa41c, role_id=77ce9173433242b2826eb37ddd5fbd3a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:16.647315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:16.650851 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Could not find role: 77ce9173433242b2826eb37ddd5fbd3a.: keystone.exception.RoleNotFound: Could not find role: 77ce9173433242b2826eb37ddd5fbd3a. Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 01:13:16.666388 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 77ce9173433242b2826eb37ddd5fbd3a. Oct 19 01:13:16.667495 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:16.668726 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3146/6327] 10.222.0.27 () {58 vars in 1369 bytes} [Wed Oct 19 01:13:16 2022] HEAD /identity/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c/roles/77ce9173433242b2826eb37ddd5fbd3a => generated 0 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 19 01:13:16.672822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c4985-8c6e-4a23-8974-afebfa9af534 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:16.684599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c4985-8c6e-4a23-8974-afebfa9af534 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:16.689235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d286a4ec69e4854b8fb5e2f50117a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a762d714f344188a48a836203361b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-417437105', 'tempest-DelegatedRole-885670426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:16.690730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:16.692218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:16.692510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] PATH_INFO: `/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:16.717894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorizing `identity:delete_trust(trust_id=6bb6ec3ae3594161b893af09d2baa41c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:16.717894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:16.758896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6bb6ec3ae3594161b893af09d2baa41c', 'request_id': 'req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:16.759700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6bb6ec3ae3594161b893af09d2baa41c', 'request_id': 'req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:16.760338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6bb6ec3ae3594161b893af09d2baa41c', 'request_id': 'req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:16.793483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:16.798117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:16.806271 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3182/6328] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:13:16 2022] DELETE /identity/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:16.819711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e3a7d-5d6d-411a-a88e-0d170f110097 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:16.835167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38f2ef-be0d-4c92-90aa-6122faae3a28 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d286a4ec69e4854b8fb5e2f50117a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8a762d714f344188a48a836203361b2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-417437105', 'tempest-DelegatedRole-885670426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:16.836300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38f2ef-be0d-4c92-90aa-6122faae3a28 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:16.836899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38f2ef-be0d-4c92-90aa-6122faae3a28 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:16.837386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38f2ef-be0d-4c92-90aa-6122faae3a28 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] PATH_INFO: `/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-ec38f2ef-be0d-4c92-90aa-6122faae3a28 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Could not find trust: 6bb6ec3ae3594161b893af09d2baa41c.: keystone.exception.TrustNotFound: Could not find trust: 6bb6ec3ae3594161b893af09d2baa41c. Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 19 01:13:16.871217 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6bb6ec3ae3594161b893af09d2baa41c. Oct 19 01:13:16.872207 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:16.892072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:16.892986 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3147/6329] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:13:16 2022] GET /identity/v3/OS-TRUST/trusts/6bb6ec3ae3594161b893af09d2baa41c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:13:16.900049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:16.936671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7e6a-612f-4d91-be15-bd3d83936fa0 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:16.945356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:16.946535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:16.946983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:16.947390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/77ce9173433242b2826eb37ddd5fbd3a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:16.949070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=77ce9173433242b2826eb37ddd5fbd3a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:16.951004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:17.113747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role 77ce9173433242b2826eb37ddd5fbd3a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:17.116839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:17.123039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:17.145594 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3183/6330] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:16 2022] DELETE /identity/v3/roles/77ce9173433242b2826eb37ddd5fbd3a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:17.147074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38f2ef-be0d-4c92-90aa-6122faae3a28 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:17.149071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ec38f2ef-be0d-4c92-90aa-6122faae3a28 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:17.202746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38f2ef-be0d-4c92-90aa-6122faae3a28 tempest-TrustsV3TestJSON-929029936 tempest-user-452330951] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:17.431412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:17.432073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:17.432510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:17.432944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/c5391cf37df540e792bcb825bd060adc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:17.434388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c5391cf37df540e792bcb825bd060adc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:17.436716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:17.533439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role c5391cf37df540e792bcb825bd060adc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:17.535077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:17.538468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:17.542659 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3148/6331] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:17 2022] DELETE /identity/v3/roles/c5391cf37df540e792bcb825bd060adc => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:17.546821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:17.566065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9e07b-ceab-47c6-b146-a6b60fafe8a9 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:17.714996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:17.715916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:17.717027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:17.717311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users/2d286a4ec69e4854b8fb5e2f50117a3f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:17.721044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2d286a4ec69e4854b8fb5e2f50117a3f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:17.727081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:17.825341 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=11 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:17.828321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d286a4ec69e4854b8fb5e2f50117a3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:17.873852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d286a4ec69e4854b8fb5e2f50117a3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:17.899558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d286a4ec69e4854b8fb5e2f50117a3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:17.912022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d286a4ec69e4854b8fb5e2f50117a3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:17.913115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d286a4ec69e4854b8fb5e2f50117a3f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:17.920531 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3184/6332] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:17 2022] DELETE /identity/v3/users/2d286a4ec69e4854b8fb5e2f50117a3f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:17.924340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:17.927765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:17.944503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35104fd-30d3-4b85-a2bd-a716f70bef50 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:18.042097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:18.042097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:18.042372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:18.042688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/e8a762d714f344188a48a836203361b2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:18.044749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e8a762d714f344188a48a836203361b2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:18.047505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:18.189203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a762d714f344188a48a836203361b2', 'request_id': 'req-536fe90c-baa4-419f-bc68-7cf3885b627e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:18.206878 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:18.217289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a762d714f344188a48a836203361b2', 'request_id': 'req-536fe90c-baa4-419f-bc68-7cf3885b627e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:18.243946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a762d714f344188a48a836203361b2', 'request_id': 'req-536fe90c-baa4-419f-bc68-7cf3885b627e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:18.285179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] The token cache is being invalidate because project e8a762d714f344188a48a836203361b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:18.285545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:18.289441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:18.296830 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3149/6333] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:17 2022] DELETE /identity/v3/projects/e8a762d714f344188a48a836203361b2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:18.298365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:18.300445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:18.339102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df4969-2a9d-47ed-b9fd-ca1cf1afb82c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:18.507533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3914a58-0918-4078-bdc8-bad6654e93ee tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:18.508080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3914a58-0918-4078-bdc8-bad6654e93ee tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:18.508368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3914a58-0918-4078-bdc8-bad6654e93ee tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:18.508664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3914a58-0918-4078-bdc8-bad6654e93ee tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:18.509304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3914a58-0918-4078-bdc8-bad6654e93ee tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:18.511244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3914a58-0918-4078-bdc8-bad6654e93ee tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:18.576258 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3185/6334] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:13:18 2022] POST /identity/v3/projects => generated 329 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:18.580611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:18.582552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:18.601752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe90c-baa4-419f-bc68-7cf3885b627e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:18.732934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b3645-1730-4f78-b872-18ef83b8b18e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:18.733729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b3645-1730-4f78-b872-18ef83b8b18e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:18.734048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b3645-1730-4f78-b872-18ef83b8b18e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:18.735005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b3645-1730-4f78-b872-18ef83b8b18e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:18.735682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b3645-1730-4f78-b872-18ef83b8b18e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:18.739144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b3645-1730-4f78-b872-18ef83b8b18e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:18.789043 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3150/6335] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:18 2022] POST /identity/v3/users => generated 416 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:18.793193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3914a58-0918-4078-bdc8-bad6654e93ee tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:18.822815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3914a58-0918-4078-bdc8-bad6654e93ee tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:18.845219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c3fb8-9fbb-44c1-941c-7618e481d381 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:18.847830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3fb8-9fbb-44c1-941c-7618e481d381 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:18.848120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3fb8-9fbb-44c1-941c-7618e481d381 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:18.848393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3fb8-9fbb-44c1-941c-7618e481d381 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:18.850218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c3fb8-9fbb-44c1-941c-7618e481d381 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:18.858242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c3fb8-9fbb-44c1-941c-7618e481d381 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:18.896773 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3186/6336] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:18 2022] POST /identity/v3/roles => generated 244 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:18.900556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b3645-1730-4f78-b872-18ef83b8b18e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:18.920056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b3645-1730-4f78-b872-18ef83b8b18e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:18.933205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea93f10-2eb3-4644-8385-6489c087e71d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:18.934105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea93f10-2eb3-4644-8385-6489c087e71d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:18.934610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea93f10-2eb3-4644-8385-6489c087e71d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:18.935530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea93f10-2eb3-4644-8385-6489c087e71d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:18.936422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea93f10-2eb3-4644-8385-6489c087e71d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:18.941484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea93f10-2eb3-4644-8385-6489c087e71d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:18.977885 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3151/6337] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:18 2022] POST /identity/v3/roles => generated 247 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:18.982159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c3fb8-9fbb-44c1-941c-7618e481d381 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:19.007831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c3fb8-9fbb-44c1-941c-7618e481d381 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:19.035253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feb860-49a4-4a46-b6e2-48681be71ad7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:19.036010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feb860-49a4-4a46-b6e2-48681be71ad7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:19.036301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feb860-49a4-4a46-b6e2-48681be71ad7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:19.036889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feb860-49a4-4a46-b6e2-48681be71ad7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/75303d3186094c5e9a5be763c3801229/users/ccd9cf001f484a968ed7eb6891843ae7/roles/d5c9c327a6424dec8d8cdbae86e9b6a2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:19.090398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06feb860-49a4-4a46-b6e2-48681be71ad7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=75303d3186094c5e9a5be763c3801229, user_id=ccd9cf001f484a968ed7eb6891843ae7, role_id=d5c9c327a6424dec8d8cdbae86e9b6a2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:19.093942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06feb860-49a4-4a46-b6e2-48681be71ad7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:19.143995 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3187/6338] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:18 2022] PUT /identity/v3/projects/75303d3186094c5e9a5be763c3801229/users/ccd9cf001f484a968ed7eb6891843ae7/roles/d5c9c327a6424dec8d8cdbae86e9b6a2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:19.148393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea93f10-2eb3-4644-8385-6489c087e71d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:19.172405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea93f10-2eb3-4644-8385-6489c087e71d tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:19.382416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2985-cdb7-4401-9bbe-2d46c08705fb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:19.383161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2985-cdb7-4401-9bbe-2d46c08705fb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:19.383381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2985-cdb7-4401-9bbe-2d46c08705fb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:19.383664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2985-cdb7-4401-9bbe-2d46c08705fb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/75303d3186094c5e9a5be763c3801229/users/ccd9cf001f484a968ed7eb6891843ae7/roles/e229135c0721455693b69c8cb72d3334` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:19.390216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f2985-cdb7-4401-9bbe-2d46c08705fb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=75303d3186094c5e9a5be763c3801229, user_id=ccd9cf001f484a968ed7eb6891843ae7, role_id=e229135c0721455693b69c8cb72d3334)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:19.399435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f2985-cdb7-4401-9bbe-2d46c08705fb tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:19.454657 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3152/6339] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:19 2022] PUT /identity/v3/projects/75303d3186094c5e9a5be763c3801229/users/ccd9cf001f484a968ed7eb6891843ae7/roles/e229135c0721455693b69c8cb72d3334 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:19.460945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feb860-49a4-4a46-b6e2-48681be71ad7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:19.511149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feb860-49a4-4a46-b6e2-48681be71ad7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:19.730650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12da413-6242-475c-a1a7-e0d8a5b3e44b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:19.731320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da413-6242-475c-a1a7-e0d8a5b3e44b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:19.731560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da413-6242-475c-a1a7-e0d8a5b3e44b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:19.731834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da413-6242-475c-a1a7-e0d8a5b3e44b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:19.733215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12da413-6242-475c-a1a7-e0d8a5b3e44b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:19.738675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12da413-6242-475c-a1a7-e0d8a5b3e44b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:19.861971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac4b7d-4fca-4c8a-88aa-005f95a34dd0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:19.862567 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3188/6340] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:19 2022] GET /identity/v3/users => generated 8915 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:19.862855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac4b7d-4fca-4c8a-88aa-005f95a34dd0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:19.863350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac4b7d-4fca-4c8a-88aa-005f95a34dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:19.974403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0bac4b7d-4fca-4c8a-88aa-005f95a34dd0 None None] MFA Rules not processed for user `ccd9cf001f484a968ed7eb6891843ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:19.977669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0bac4b7d-4fca-4c8a-88aa-005f95a34dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:20.110784 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:20.188209 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3153/6341] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:20.201300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58ea0e-27d3-453c-9212-1d6755eb5b2a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:20.201595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58ea0e-27d3-453c-9212-1d6755eb5b2a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:20.201878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58ea0e-27d3-453c-9212-1d6755eb5b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:20.228038 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:20.247907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5a58ea0e-27d3-453c-9212-1d6755eb5b2a None None] MFA Rules not processed for user `ccd9cf001f484a968ed7eb6891843ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:20.251431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5a58ea0e-27d3-453c-9212-1d6755eb5b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:20.273713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac4b7d-4fca-4c8a-88aa-005f95a34dd0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:20.274084 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3189/6342] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:20.285842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac4b7d-4fca-4c8a-88aa-005f95a34dd0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:20.291033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccd9cf001f484a968ed7eb6891843ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75303d3186094c5e9a5be763c3801229', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1517695940', 'tempest-DelegatedRole-1720208609'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:20.291669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:20.291961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:20.292235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:20.293131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] RBAC: Authorizing `identity:create_trust()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:20.295994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 19 01:13:20.436118 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 19 01:13:20.437851 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 19 01:13:20.439152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 19 01:13:20.439152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 19 01:13:20.439152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 19 01:13:20.439152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 19 01:13:20.439152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 19 01:13:20.439152 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:20.444368 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3154/6343] 10.222.0.27 () {60 vars in 1174 bytes} [Wed Oct 19 01:13:20 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 168 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 01:13:20.447046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58ea0e-27d3-453c-9212-1d6755eb5b2a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:20.469007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58ea0e-27d3-453c-9212-1d6755eb5b2a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:20.511095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:20.514345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:20.515620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:20.518808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/e229135c0721455693b69c8cb72d3334` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:20.529983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e229135c0721455693b69c8cb72d3334)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:20.537507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:20.741974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role e229135c0721455693b69c8cb72d3334 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:20.742617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:20.743064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:20.749567 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3190/6344] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:20 2022] DELETE /identity/v3/roles/e229135c0721455693b69c8cb72d3334 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:20.768373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:20.768373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:20.777577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbba23-6e46-4396-a5fc-377349f1b5de tempest-TrustsV3TestJSON-1580504338 tempest-user-1332180074] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:20.950281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:20.951983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:20.954490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:20.954875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/d5c9c327a6424dec8d8cdbae86e9b6a2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:20.957513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d5c9c327a6424dec8d8cdbae86e9b6a2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:20.960744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:21.092994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role d5c9c327a6424dec8d8cdbae86e9b6a2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:21.093602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.094545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.097040 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3155/6345] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:20 2022] DELETE /identity/v3/roles/d5c9c327a6424dec8d8cdbae86e9b6a2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:21.101857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:21.123097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f6c7f-aa14-4450-8fb5-2060d79ea947 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:21.300283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:21.302047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:21.303124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:21.304264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users/ccd9cf001f484a968ed7eb6891843ae7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:21.313989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ccd9cf001f484a968ed7eb6891843ae7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:21.321113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:21.437473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd9cf001f484a968ed7eb6891843ae7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.456469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd9cf001f484a968ed7eb6891843ae7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.472924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd9cf001f484a968ed7eb6891843ae7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.490560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd9cf001f484a968ed7eb6891843ae7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.491734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd9cf001f484a968ed7eb6891843ae7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.501137 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3191/6346] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:21 2022] DELETE /identity/v3/users/ccd9cf001f484a968ed7eb6891843ae7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:21.505667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:21.507455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:21.531501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d306af-64f3-47ec-839a-83101d7f3d2e tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:21.638859 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:21.687979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:21.689810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:21.690378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:21.691623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/75303d3186094c5e9a5be763c3801229` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:21.696262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_project(project_id=75303d3186094c5e9a5be763c3801229)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:21.701818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:21.900800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75303d3186094c5e9a5be763c3801229', 'request_id': 'req-38e2c1f8-72bd-40d4-9656-6eb025f1969b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.920172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75303d3186094c5e9a5be763c3801229', 'request_id': 'req-38e2c1f8-72bd-40d4-9656-6eb025f1969b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.946648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75303d3186094c5e9a5be763c3801229', 'request_id': 'req-38e2c1f8-72bd-40d4-9656-6eb025f1969b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.988939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] The token cache is being invalidate because project 75303d3186094c5e9a5be763c3801229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:21.990181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:21.993319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:22.000202 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3156/6347] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:21 2022] DELETE /identity/v3/projects/75303d3186094c5e9a5be763c3801229 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:22.006360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:22.010141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:22.045124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c0ef-d9c6-4efe-b3e1-e6bc7ac232d7 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:22.152450 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:22.233443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5734f-d93e-48f4-b0fd-0e1ee5e56e10 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:22.234083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5734f-d93e-48f4-b0fd-0e1ee5e56e10 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:22.234371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5734f-d93e-48f4-b0fd-0e1ee5e56e10 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:22.234645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5734f-d93e-48f4-b0fd-0e1ee5e56e10 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:22.235296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5734f-d93e-48f4-b0fd-0e1ee5e56e10 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:22.253611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5734f-d93e-48f4-b0fd-0e1ee5e56e10 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:22.355318 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3192/6348] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:13:22 2022] POST /identity/v3/projects => generated 329 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:22.359573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:22.361802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:22.404472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2c1f8-72bd-40d4-9656-6eb025f1969b tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:22.613115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d05d-1fa4-4ba1-8a55-8b95a077c032 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:22.613801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d05d-1fa4-4ba1-8a55-8b95a077c032 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:22.615776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d05d-1fa4-4ba1-8a55-8b95a077c032 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:22.615776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d05d-1fa4-4ba1-8a55-8b95a077c032 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:22.615776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7d05d-1fa4-4ba1-8a55-8b95a077c032 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:22.617588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7d05d-1fa4-4ba1-8a55-8b95a077c032 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:22.665445 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3157/6349] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:22 2022] POST /identity/v3/users => generated 416 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:22.666641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5734f-d93e-48f4-b0fd-0e1ee5e56e10 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:22.681628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5734f-d93e-48f4-b0fd-0e1ee5e56e10 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:22.696892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80619abb-3f28-4f3c-9d72-ac77de0b4499 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:22.697529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80619abb-3f28-4f3c-9d72-ac77de0b4499 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:22.697812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80619abb-3f28-4f3c-9d72-ac77de0b4499 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:22.698088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80619abb-3f28-4f3c-9d72-ac77de0b4499 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:22.698764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80619abb-3f28-4f3c-9d72-ac77de0b4499 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:22.700377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80619abb-3f28-4f3c-9d72-ac77de0b4499 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:22.734066 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3193/6350] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:22 2022] POST /identity/v3/roles => generated 244 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:22.734391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d05d-1fa4-4ba1-8a55-8b95a077c032 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:22.755836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d05d-1fa4-4ba1-8a55-8b95a077c032 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:22.765059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c8245-4320-4f96-92ad-29489bc12732 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:22.765585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c8245-4320-4f96-92ad-29489bc12732 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:22.765871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c8245-4320-4f96-92ad-29489bc12732 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:22.766150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c8245-4320-4f96-92ad-29489bc12732 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:22.767057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c8245-4320-4f96-92ad-29489bc12732 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:22.769404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c8245-4320-4f96-92ad-29489bc12732 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:22.809977 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3158/6351] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:22 2022] POST /identity/v3/roles => generated 247 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:22.811145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80619abb-3f28-4f3c-9d72-ac77de0b4499 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:22.832467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80619abb-3f28-4f3c-9d72-ac77de0b4499 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:22.845455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d27916-1c91-4c09-8880-d79e8ffe48a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:22.846153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d27916-1c91-4c09-8880-d79e8ffe48a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:22.846448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d27916-1c91-4c09-8880-d79e8ffe48a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:22.846727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d27916-1c91-4c09-8880-d79e8ffe48a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/cf091563db0f4bc89e33476a2a4cfa74/users/b5733c85f11041539b52fefd83d6d259/roles/dbb4f703278f44f7a6aab10168863ed6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:22.874840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d27916-1c91-4c09-8880-d79e8ffe48a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cf091563db0f4bc89e33476a2a4cfa74, user_id=b5733c85f11041539b52fefd83d6d259, role_id=dbb4f703278f44f7a6aab10168863ed6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:22.877675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d27916-1c91-4c09-8880-d79e8ffe48a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:22.903284 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3194/6352] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:22 2022] PUT /identity/v3/projects/cf091563db0f4bc89e33476a2a4cfa74/users/b5733c85f11041539b52fefd83d6d259/roles/dbb4f703278f44f7a6aab10168863ed6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:22.907390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c8245-4320-4f96-92ad-29489bc12732 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:22.926443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c8245-4320-4f96-92ad-29489bc12732 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:23.094916 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:23.126230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a75a3-76be-42ff-a02c-f1126f25d595 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:23.126926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a75a3-76be-42ff-a02c-f1126f25d595 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:23.127211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a75a3-76be-42ff-a02c-f1126f25d595 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:23.127490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a75a3-76be-42ff-a02c-f1126f25d595 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/cf091563db0f4bc89e33476a2a4cfa74/users/b5733c85f11041539b52fefd83d6d259/roles/0c27669c567c4e6381ecd9bb70a8f19f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:23.134746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a75a3-76be-42ff-a02c-f1126f25d595 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cf091563db0f4bc89e33476a2a4cfa74, user_id=b5733c85f11041539b52fefd83d6d259, role_id=0c27669c567c4e6381ecd9bb70a8f19f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:23.137621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a75a3-76be-42ff-a02c-f1126f25d595 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:23.178335 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3159/6353] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:22 2022] PUT /identity/v3/projects/cf091563db0f4bc89e33476a2a4cfa74/users/b5733c85f11041539b52fefd83d6d259/roles/0c27669c567c4e6381ecd9bb70a8f19f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:23.182244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d27916-1c91-4c09-8880-d79e8ffe48a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:23.215849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d27916-1c91-4c09-8880-d79e8ffe48a1 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:23.431884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa3716-fc21-4530-b0fc-acc190b05dc8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:23.433296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa3716-fc21-4530-b0fc-acc190b05dc8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:23.434676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa3716-fc21-4530-b0fc-acc190b05dc8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:23.435046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa3716-fc21-4530-b0fc-acc190b05dc8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:23.437856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa3716-fc21-4530-b0fc-acc190b05dc8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:23.442597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa3716-fc21-4530-b0fc-acc190b05dc8 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:23.533772 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3195/6354] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:23 2022] GET /identity/v3/users => generated 8915 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:23.535572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104c6e1-0e45-4df5-92a1-84e5e2328caf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:23.535867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104c6e1-0e45-4df5-92a1-84e5e2328caf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:23.536846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104c6e1-0e45-4df5-92a1-84e5e2328caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:23.600700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d104c6e1-0e45-4df5-92a1-84e5e2328caf None None] MFA Rules not processed for user `b5733c85f11041539b52fefd83d6d259`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:23.602652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d104c6e1-0e45-4df5-92a1-84e5e2328caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:23.715335 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3160/6355] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:23.717155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f7673-a32f-4093-86e8-f3ac5bfa07eb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:23.717506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f7673-a32f-4093-86e8-f3ac5bfa07eb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:23.717774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f7673-a32f-4093-86e8-f3ac5bfa07eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:23.757598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e24f7673-a32f-4093-86e8-f3ac5bfa07eb None None] MFA Rules not processed for user `b5733c85f11041539b52fefd83d6d259`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:23.758858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e24f7673-a32f-4093-86e8-f3ac5bfa07eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:23.780008 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3196/6356] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:23.782135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104c6e1-0e45-4df5-92a1-84e5e2328caf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:23.794047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104c6e1-0e45-4df5-92a1-84e5e2328caf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:23.799874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378e1ca-8a15-488f-b18d-bc154fdd63e4 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5733c85f11041539b52fefd83d6d259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf091563db0f4bc89e33476a2a4cfa74', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2083929339', 'tempest-DelegatedRole-1730478985'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:23.800937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378e1ca-8a15-488f-b18d-bc154fdd63e4 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:23.801435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378e1ca-8a15-488f-b18d-bc154fdd63e4 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:23.803638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378e1ca-8a15-488f-b18d-bc154fdd63e4 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:23.804572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378e1ca-8a15-488f-b18d-bc154fdd63e4 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorizing `identity:create_trust()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:23.806573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378e1ca-8a15-488f-b18d-bc154fdd63e4 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:23.919317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f7673-a32f-4093-86e8-f3ac5bfa07eb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:23.932906 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3161/6357] 10.222.0.27 () {60 vars in 1174 bytes} [Wed Oct 19 01:13:23 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:23.946524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f7673-a32f-4093-86e8-f3ac5bfa07eb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:23.953951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd081a8-9382-48a1-abbf-4701292040f1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5733c85f11041539b52fefd83d6d259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf091563db0f4bc89e33476a2a4cfa74', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2083929339', 'tempest-DelegatedRole-1730478985'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:23.954903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd081a8-9382-48a1-abbf-4701292040f1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:23.955480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd081a8-9382-48a1-abbf-4701292040f1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:23.955971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd081a8-9382-48a1-abbf-4701292040f1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] PATH_INFO: `/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:23.965962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd081a8-9382-48a1-abbf-4701292040f1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorizing `identity:get_trust(trust_id=078672e8b636449180667bd994c468b9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:23.967896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd081a8-9382-48a1-abbf-4701292040f1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:23.985588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378e1ca-8a15-488f-b18d-bc154fdd63e4 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:23.997322 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3197/6358] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:13:23 2022] GET /identity/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9 => generated 834 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:13:24.000427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378e1ca-8a15-488f-b18d-bc154fdd63e4 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:24.007170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe46430-40fd-4df1-90ba-be5e3fd3835c tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5733c85f11041539b52fefd83d6d259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf091563db0f4bc89e33476a2a4cfa74', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2083929339', 'tempest-DelegatedRole-1730478985'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:24.008197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe46430-40fd-4df1-90ba-be5e3fd3835c tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:24.008812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe46430-40fd-4df1-90ba-be5e3fd3835c tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:24.009305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe46430-40fd-4df1-90ba-be5e3fd3835c tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] PATH_INFO: `/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:24.017206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe46430-40fd-4df1-90ba-be5e3fd3835c tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=078672e8b636449180667bd994c468b9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:24.019151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe46430-40fd-4df1-90ba-be5e3fd3835c tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:24.035213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd081a8-9382-48a1-abbf-4701292040f1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:24.050750 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3162/6359] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 01:13:23 2022] GET /identity/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles => generated 371 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:24.051797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd081a8-9382-48a1-abbf-4701292040f1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:24.071429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51862442-b614-4ffd-b9b1-1f0c01fce98a tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5733c85f11041539b52fefd83d6d259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf091563db0f4bc89e33476a2a4cfa74', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2083929339', 'tempest-DelegatedRole-1730478985'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:24.072110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51862442-b614-4ffd-b9b1-1f0c01fce98a tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:24.072391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51862442-b614-4ffd-b9b1-1f0c01fce98a tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:24.072689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51862442-b614-4ffd-b9b1-1f0c01fce98a tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] PATH_INFO: `/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles/dbb4f703278f44f7a6aab10168863ed6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:24.079520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51862442-b614-4ffd-b9b1-1f0c01fce98a tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorizing `identity:get_role_for_trust(trust_id=078672e8b636449180667bd994c468b9, role_id=dbb4f703278f44f7a6aab10168863ed6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:24.081084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51862442-b614-4ffd-b9b1-1f0c01fce98a tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:24.092505 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3198/6360] 10.222.0.27 () {58 vars in 1368 bytes} [Wed Oct 19 01:13:24 2022] GET /identity/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles/dbb4f703278f44f7a6aab10168863ed6 => generated 244 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:24.093945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe46430-40fd-4df1-90ba-be5e3fd3835c tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:24.110277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe46430-40fd-4df1-90ba-be5e3fd3835c tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:24.122171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6092e-7b56-49ca-ab6f-1bad52842bb9 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5733c85f11041539b52fefd83d6d259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf091563db0f4bc89e33476a2a4cfa74', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2083929339', 'tempest-DelegatedRole-1730478985'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:24.123041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6092e-7b56-49ca-ab6f-1bad52842bb9 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:24.123412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6092e-7b56-49ca-ab6f-1bad52842bb9 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:24.123796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6092e-7b56-49ca-ab6f-1bad52842bb9 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] PATH_INFO: `/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles/dbb4f703278f44f7a6aab10168863ed6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:24.140915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6092e-7b56-49ca-ab6f-1bad52842bb9 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorizing `identity:get_role_for_trust(trust_id=078672e8b636449180667bd994c468b9, role_id=dbb4f703278f44f7a6aab10168863ed6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:24.146391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6092e-7b56-49ca-ab6f-1bad52842bb9 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:24.171711 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3163/6361] 10.222.0.27 () {58 vars in 1369 bytes} [Wed Oct 19 01:13:24 2022] HEAD /identity/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles/dbb4f703278f44f7a6aab10168863ed6 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 19 01:13:24.172449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51862442-b614-4ffd-b9b1-1f0c01fce98a tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:24.185200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51862442-b614-4ffd-b9b1-1f0c01fce98a tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:24.191032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa164-c2f6-4b49-9716-c3e5b9450872 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5733c85f11041539b52fefd83d6d259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf091563db0f4bc89e33476a2a4cfa74', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2083929339', 'tempest-DelegatedRole-1730478985'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:24.193431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa164-c2f6-4b49-9716-c3e5b9450872 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:24.194240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa164-c2f6-4b49-9716-c3e5b9450872 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:24.194741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa164-c2f6-4b49-9716-c3e5b9450872 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] PATH_INFO: `/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles/0c27669c567c4e6381ecd9bb70a8f19f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:24.203505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fa164-c2f6-4b49-9716-c3e5b9450872 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorizing `identity:get_role_for_trust(trust_id=078672e8b636449180667bd994c468b9, role_id=0c27669c567c4e6381ecd9bb70a8f19f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:24.205657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fa164-c2f6-4b49-9716-c3e5b9450872 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-c08fa164-c2f6-4b49-9716-c3e5b9450872 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Could not find role: 0c27669c567c4e6381ecd9bb70a8f19f.: keystone.exception.RoleNotFound: Could not find role: 0c27669c567c4e6381ecd9bb70a8f19f. Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 01:13:24.229973 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0c27669c567c4e6381ecd9bb70a8f19f. Oct 19 01:13:24.231555 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:13:24.234081 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3199/6362] 10.222.0.27 () {58 vars in 1368 bytes} [Wed Oct 19 01:13:24 2022] GET /identity/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles/0c27669c567c4e6381ecd9bb70a8f19f => generated 110 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 19 01:13:24.239169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6092e-7b56-49ca-ab6f-1bad52842bb9 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:24.255471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6092e-7b56-49ca-ab6f-1bad52842bb9 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:24.269277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5733c85f11041539b52fefd83d6d259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf091563db0f4bc89e33476a2a4cfa74', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2083929339', 'tempest-DelegatedRole-1730478985'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:24.272254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:24.272743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:24.273138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] PATH_INFO: `/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles/0c27669c567c4e6381ecd9bb70a8f19f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:24.289715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorizing `identity:get_role_for_trust(trust_id=078672e8b636449180667bd994c468b9, role_id=0c27669c567c4e6381ecd9bb70a8f19f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:24.294911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Could not find role: 0c27669c567c4e6381ecd9bb70a8f19f.: keystone.exception.RoleNotFound: Could not find role: 0c27669c567c4e6381ecd9bb70a8f19f. Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 01:13:24.308564 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0c27669c567c4e6381ecd9bb70a8f19f. Oct 19 01:13:24.309712 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:24.311623 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3164/6363] 10.222.0.27 () {58 vars in 1369 bytes} [Wed Oct 19 01:13:24 2022] HEAD /identity/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9/roles/0c27669c567c4e6381ecd9bb70a8f19f => generated 0 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 19 01:13:24.315772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa164-c2f6-4b49-9716-c3e5b9450872 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:24.336274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa164-c2f6-4b49-9716-c3e5b9450872 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:24.346767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5733c85f11041539b52fefd83d6d259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf091563db0f4bc89e33476a2a4cfa74', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2083929339', 'tempest-DelegatedRole-1730478985'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:24.347430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:24.347714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:24.348002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] PATH_INFO: `/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:24.362242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorizing `identity:delete_trust(trust_id=078672e8b636449180667bd994c468b9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:24.368188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:24.390671 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:24.413027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '078672e8b636449180667bd994c468b9', 'request_id': 'req-904cfef5-9c17-4dab-b890-7624c8913f4b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:24.413857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '078672e8b636449180667bd994c468b9', 'request_id': 'req-904cfef5-9c17-4dab-b890-7624c8913f4b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:24.414660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '078672e8b636449180667bd994c468b9', 'request_id': 'req-904cfef5-9c17-4dab-b890-7624c8913f4b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:24.446046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:24.448074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:24.461022 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3200/6364] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:13:24 2022] DELETE /identity/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:24.461261 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:24.482728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145b0a8-ab7a-4cfb-86d9-bd177da05eb1 tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:24.504238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f308ccf-ce6f-42b2-844e-e37d6f8a6d3d tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5733c85f11041539b52fefd83d6d259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf091563db0f4bc89e33476a2a4cfa74', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2083929339', 'tempest-DelegatedRole-1730478985'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:24.504238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f308ccf-ce6f-42b2-844e-e37d6f8a6d3d tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:24.504238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f308ccf-ce6f-42b2-844e-e37d6f8a6d3d tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:24.504646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f308ccf-ce6f-42b2-844e-e37d6f8a6d3d tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] PATH_INFO: `/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-2f308ccf-ce6f-42b2-844e-e37d6f8a6d3d tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Could not find trust: 078672e8b636449180667bd994c468b9.: keystone.exception.TrustNotFound: Could not find trust: 078672e8b636449180667bd994c468b9. Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 19 01:13:24.535467 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 078672e8b636449180667bd994c468b9. Oct 19 01:13:24.537250 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:24.546632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:24.548657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:24.552718 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3165/6365] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:13:24 2022] GET /identity/v3/OS-TRUST/trusts/078672e8b636449180667bd994c468b9 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:13:24.585054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cfef5-9c17-4dab-b890-7624c8913f4b tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:24.622532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:24.623197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:24.623491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:24.623772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/0c27669c567c4e6381ecd9bb70a8f19f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:24.625267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0c27669c567c4e6381ecd9bb70a8f19f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:24.626919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:24.724827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role 0c27669c567c4e6381ecd9bb70a8f19f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:24.725152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:24.725854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:24.736569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f308ccf-ce6f-42b2-844e-e37d6f8a6d3d tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:24.737091 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3201/6366] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:24 2022] DELETE /identity/v3/roles/0c27669c567c4e6381ecd9bb70a8f19f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:13:24.738604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2f308ccf-ce6f-42b2-844e-e37d6f8a6d3d tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:24.791564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f308ccf-ce6f-42b2-844e-e37d6f8a6d3d tempest-TrustsV3TestJSON-1551730971 tempest-user-1096242458] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:24.874699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:24.875764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:24.876059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:24.876343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/dbb4f703278f44f7a6aab10168863ed6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:24.877984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dbb4f703278f44f7a6aab10168863ed6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:24.880447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:24.958243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role dbb4f703278f44f7a6aab10168863ed6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:24.960049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:24.962355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:24.970403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:24.982718 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3166/6367] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:24 2022] DELETE /identity/v3/roles/dbb4f703278f44f7a6aab10168863ed6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:24.987712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044a8b-8d00-4d8a-a966-3f68a6ecabb6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:25.126262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:25.129092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:25.130697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:25.131021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users/b5733c85f11041539b52fefd83d6d259` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:25.137396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b5733c85f11041539b52fefd83d6d259)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:25.142935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:25.324330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5733c85f11041539b52fefd83d6d259'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:25.421628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5733c85f11041539b52fefd83d6d259'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:25.452423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5733c85f11041539b52fefd83d6d259'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:25.503338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5733c85f11041539b52fefd83d6d259'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:25.503338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5733c85f11041539b52fefd83d6d259'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:25.527870 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3202/6368] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:24 2022] DELETE /identity/v3/users/b5733c85f11041539b52fefd83d6d259 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:25.532640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:25.534552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:25.572232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1b29f-995f-4cb3-8f2e-f12ffc9bb2e0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:25.737753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:25.738413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:25.738699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:25.739031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/cf091563db0f4bc89e33476a2a4cfa74` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:25.744356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cf091563db0f4bc89e33476a2a4cfa74)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:25.747902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:25.915131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf091563db0f4bc89e33476a2a4cfa74', 'request_id': 'req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:25.940806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf091563db0f4bc89e33476a2a4cfa74', 'request_id': 'req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:25.948958 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:25.966111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf091563db0f4bc89e33476a2a4cfa74', 'request_id': 'req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:26.005662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] The token cache is being invalidate because project cf091563db0f4bc89e33476a2a4cfa74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:26.006168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:26.008408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:26.011659 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3167/6369] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:25 2022] DELETE /identity/v3/projects/cf091563db0f4bc89e33476a2a4cfa74 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:13:26.019857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:26.022782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:26.047535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5864d9b-1d20-499c-aed7-fbdb6bdd37a6 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:26.100349 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:26.204607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea36514-ebda-4337-a2d3-e4c7cb3e0390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:26.205645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea36514-ebda-4337-a2d3-e4c7cb3e0390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:26.206140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea36514-ebda-4337-a2d3-e4c7cb3e0390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:26.206625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea36514-ebda-4337-a2d3-e4c7cb3e0390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:26.207677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea36514-ebda-4337-a2d3-e4c7cb3e0390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:26.215657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea36514-ebda-4337-a2d3-e4c7cb3e0390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:26.281919 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3203/6370] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:13:26 2022] POST /identity/v3/projects => generated 328 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:26.286720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:26.290927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:26.327502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679e2a-dd85-4aa8-baa9-4c202f80cf03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:26.575122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a05ea-b203-4be9-90ff-bf511494c5a3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:26.575766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a05ea-b203-4be9-90ff-bf511494c5a3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:26.576056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a05ea-b203-4be9-90ff-bf511494c5a3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:26.578623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a05ea-b203-4be9-90ff-bf511494c5a3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:26.579332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a05ea-b203-4be9-90ff-bf511494c5a3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:26.581354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a05ea-b203-4be9-90ff-bf511494c5a3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:26.646145 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3168/6371] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:26 2022] POST /identity/v3/users => generated 416 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:26.647497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea36514-ebda-4337-a2d3-e4c7cb3e0390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:26.672875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea36514-ebda-4337-a2d3-e4c7cb3e0390 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:26.684952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198676eb-53bc-4f41-99f3-e9dcb259839a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:26.685677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198676eb-53bc-4f41-99f3-e9dcb259839a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:26.686024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198676eb-53bc-4f41-99f3-e9dcb259839a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:26.688894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198676eb-53bc-4f41-99f3-e9dcb259839a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:26.690620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198676eb-53bc-4f41-99f3-e9dcb259839a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:26.691440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198676eb-53bc-4f41-99f3-e9dcb259839a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:26.741597 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3204/6372] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:26 2022] POST /identity/v3/roles => generated 244 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:26.742670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a05ea-b203-4be9-90ff-bf511494c5a3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:26.763049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a05ea-b203-4be9-90ff-bf511494c5a3 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:26.790218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b39023-027e-4e29-87a8-0151eb4e289c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:26.790892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39023-027e-4e29-87a8-0151eb4e289c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:26.798773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39023-027e-4e29-87a8-0151eb4e289c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:26.799312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39023-027e-4e29-87a8-0151eb4e289c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:26.801981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b39023-027e-4e29-87a8-0151eb4e289c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:26.803814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b39023-027e-4e29-87a8-0151eb4e289c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:26.844149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3169/6373] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:13:26 2022] POST /identity/v3/roles => generated 246 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:26.845479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198676eb-53bc-4f41-99f3-e9dcb259839a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:26.859903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198676eb-53bc-4f41-99f3-e9dcb259839a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:26.870616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790818f-521f-405f-8898-9d7f87934f03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:26.871407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790818f-521f-405f-8898-9d7f87934f03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:26.871758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790818f-521f-405f-8898-9d7f87934f03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:26.876806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790818f-521f-405f-8898-9d7f87934f03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/7b270bc9fc3149439876f6950ca3570b/users/8fa694bb95d246a2b2b33078aee03ac4/roles/f7e8f3dd13f2444c96786a8b65b6fcfa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:26.911870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790818f-521f-405f-8898-9d7f87934f03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7b270bc9fc3149439876f6950ca3570b, user_id=8fa694bb95d246a2b2b33078aee03ac4, role_id=f7e8f3dd13f2444c96786a8b65b6fcfa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:26.914690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790818f-521f-405f-8898-9d7f87934f03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:26.951935 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3205/6374] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:26 2022] PUT /identity/v3/projects/7b270bc9fc3149439876f6950ca3570b/users/8fa694bb95d246a2b2b33078aee03ac4/roles/f7e8f3dd13f2444c96786a8b65b6fcfa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:26.953385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b39023-027e-4e29-87a8-0151eb4e289c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:26.969411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b39023-027e-4e29-87a8-0151eb4e289c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:27.263608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106103-0dc9-49f0-9ae8-8586231c102a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:27.265068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106103-0dc9-49f0-9ae8-8586231c102a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:27.265519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106103-0dc9-49f0-9ae8-8586231c102a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:27.265956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106103-0dc9-49f0-9ae8-8586231c102a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/7b270bc9fc3149439876f6950ca3570b/users/8fa694bb95d246a2b2b33078aee03ac4/roles/0ddef50cbcff486ead484f16d309a783` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:27.271366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1106103-0dc9-49f0-9ae8-8586231c102a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7b270bc9fc3149439876f6950ca3570b, user_id=8fa694bb95d246a2b2b33078aee03ac4, role_id=0ddef50cbcff486ead484f16d309a783)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:27.277737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1106103-0dc9-49f0-9ae8-8586231c102a tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:27.307934 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3170/6375] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:26 2022] PUT /identity/v3/projects/7b270bc9fc3149439876f6950ca3570b/users/8fa694bb95d246a2b2b33078aee03ac4/roles/0ddef50cbcff486ead484f16d309a783 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:27.311662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790818f-521f-405f-8898-9d7f87934f03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:27.332671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790818f-521f-405f-8898-9d7f87934f03 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:27.479144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b26a7-29a3-4483-bd8c-72c416d1267c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:27.479787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b26a7-29a3-4483-bd8c-72c416d1267c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:27.480073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b26a7-29a3-4483-bd8c-72c416d1267c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:27.480355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b26a7-29a3-4483-bd8c-72c416d1267c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:27.481671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b26a7-29a3-4483-bd8c-72c416d1267c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:27.482960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b26a7-29a3-4483-bd8c-72c416d1267c tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:27.560861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3330dc8-7afa-4cdb-a4c6-6e7fce0c45c6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:27.561162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3330dc8-7afa-4cdb-a4c6-6e7fce0c45c6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:27.561441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3330dc8-7afa-4cdb-a4c6-6e7fce0c45c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:27.582271 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3206/6376] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:27 2022] GET /identity/v3/users => generated 8915 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:27.650992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f3330dc8-7afa-4cdb-a4c6-6e7fce0c45c6 None None] MFA Rules not processed for user `8fa694bb95d246a2b2b33078aee03ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:27.656110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f3330dc8-7afa-4cdb-a4c6-6e7fce0c45c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:27.812007 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:27.921923 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3171/6377] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:13:27.923891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0f9f-897c-481b-947f-2c4c0753ebb7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:27.924344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0f9f-897c-481b-947f-2c4c0753ebb7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:27.924429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0f9f-897c-481b-947f-2c4c0753ebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:27.986519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-32ab0f9f-897c-481b-947f-2c4c0753ebb7 None None] MFA Rules not processed for user `8fa694bb95d246a2b2b33078aee03ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:27.987811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-32ab0f9f-897c-481b-947f-2c4c0753ebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:28.024774 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3207/6378] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:28.025512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3330dc8-7afa-4cdb-a4c6-6e7fce0c45c6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:28.035456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3330dc8-7afa-4cdb-a4c6-6e7fce0c45c6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:28.053891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6c529-a43c-4387-ab45-3ca147897885 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa694bb95d246a2b2b33078aee03ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b270bc9fc3149439876f6950ca3570b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380976202', 'tempest-DelegatedRole-1890614536'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:28.054533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6c529-a43c-4387-ab45-3ca147897885 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:28.054810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6c529-a43c-4387-ab45-3ca147897885 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:28.055080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6c529-a43c-4387-ab45-3ca147897885 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:28.055768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6c529-a43c-4387-ab45-3ca147897885 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorizing `identity:create_trust()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:28.056961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6c529-a43c-4387-ab45-3ca147897885 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:28.289508 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3172/6379] 10.222.0.27 () {60 vars in 1174 bytes} [Wed Oct 19 01:13:28 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:28.290599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab0f9f-897c-481b-947f-2c4c0753ebb7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:28.302563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab0f9f-897c-481b-947f-2c4c0753ebb7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:28.312599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c00d0d-49d0-4c7c-b750-a8e47d207fb7 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa694bb95d246a2b2b33078aee03ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b270bc9fc3149439876f6950ca3570b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380976202', 'tempest-DelegatedRole-1890614536'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:28.313286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c00d0d-49d0-4c7c-b750-a8e47d207fb7 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:28.313566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c00d0d-49d0-4c7c-b750-a8e47d207fb7 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:28.313886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c00d0d-49d0-4c7c-b750-a8e47d207fb7 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] PATH_INFO: `/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:28.328106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c00d0d-49d0-4c7c-b750-a8e47d207fb7 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorizing `identity:get_trust(trust_id=9e4bf864928d487cbb3c2f96372fcb2e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:28.329624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c00d0d-49d0-4c7c-b750-a8e47d207fb7 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:28.347493 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3208/6380] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:13:28 2022] GET /identity/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e => generated 835 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:28.351437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6c529-a43c-4387-ab45-3ca147897885 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:28.362060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6c529-a43c-4387-ab45-3ca147897885 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:28.377343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1c38-6895-40b4-b701-8053f1ccdd7e tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa694bb95d246a2b2b33078aee03ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b270bc9fc3149439876f6950ca3570b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380976202', 'tempest-DelegatedRole-1890614536'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:28.378124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1c38-6895-40b4-b701-8053f1ccdd7e tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:28.378350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1c38-6895-40b4-b701-8053f1ccdd7e tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:28.378645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1c38-6895-40b4-b701-8053f1ccdd7e tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] PATH_INFO: `/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:28.390436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1c38-6895-40b4-b701-8053f1ccdd7e tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=9e4bf864928d487cbb3c2f96372fcb2e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:28.392291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1c38-6895-40b4-b701-8053f1ccdd7e tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:28.410750 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3173/6381] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 01:13:28 2022] GET /identity/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles => generated 371 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:28.415910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c00d0d-49d0-4c7c-b750-a8e47d207fb7 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:28.429872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c00d0d-49d0-4c7c-b750-a8e47d207fb7 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:28.441413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb44fea-12b6-4289-82eb-8dfd964a38b9 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa694bb95d246a2b2b33078aee03ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b270bc9fc3149439876f6950ca3570b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380976202', 'tempest-DelegatedRole-1890614536'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:28.442348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44fea-12b6-4289-82eb-8dfd964a38b9 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:28.442861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44fea-12b6-4289-82eb-8dfd964a38b9 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:28.443681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44fea-12b6-4289-82eb-8dfd964a38b9 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] PATH_INFO: `/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles/f7e8f3dd13f2444c96786a8b65b6fcfa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:28.457107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb44fea-12b6-4289-82eb-8dfd964a38b9 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9e4bf864928d487cbb3c2f96372fcb2e, role_id=f7e8f3dd13f2444c96786a8b65b6fcfa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:28.460898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb44fea-12b6-4289-82eb-8dfd964a38b9 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:28.477135 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3209/6382] 10.222.0.27 () {58 vars in 1368 bytes} [Wed Oct 19 01:13:28 2022] GET /identity/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles/f7e8f3dd13f2444c96786a8b65b6fcfa => generated 244 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:13:28.481527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1c38-6895-40b4-b701-8053f1ccdd7e tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:28.495056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1c38-6895-40b4-b701-8053f1ccdd7e tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:28.508126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee790-0c28-44b3-8802-743acb7f6455 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa694bb95d246a2b2b33078aee03ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b270bc9fc3149439876f6950ca3570b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380976202', 'tempest-DelegatedRole-1890614536'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:28.509263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee790-0c28-44b3-8802-743acb7f6455 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:28.509824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee790-0c28-44b3-8802-743acb7f6455 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:28.510308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee790-0c28-44b3-8802-743acb7f6455 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] PATH_INFO: `/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles/f7e8f3dd13f2444c96786a8b65b6fcfa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:28.524521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee790-0c28-44b3-8802-743acb7f6455 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9e4bf864928d487cbb3c2f96372fcb2e, role_id=f7e8f3dd13f2444c96786a8b65b6fcfa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:28.526562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee790-0c28-44b3-8802-743acb7f6455 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:28.535652 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3174/6383] 10.222.0.27 () {58 vars in 1369 bytes} [Wed Oct 19 01:13:28 2022] HEAD /identity/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles/f7e8f3dd13f2444c96786a8b65b6fcfa => generated 0 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 19 01:13:28.541403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb44fea-12b6-4289-82eb-8dfd964a38b9 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:28.559647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb44fea-12b6-4289-82eb-8dfd964a38b9 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:28.577886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469f5e2-d760-4eca-b6b8-1771afbd250f tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa694bb95d246a2b2b33078aee03ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b270bc9fc3149439876f6950ca3570b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380976202', 'tempest-DelegatedRole-1890614536'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:28.580598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469f5e2-d760-4eca-b6b8-1771afbd250f tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:28.584330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469f5e2-d760-4eca-b6b8-1771afbd250f tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:28.584861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469f5e2-d760-4eca-b6b8-1771afbd250f tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] PATH_INFO: `/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles/0ddef50cbcff486ead484f16d309a783` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:28.607069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469f5e2-d760-4eca-b6b8-1771afbd250f tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9e4bf864928d487cbb3c2f96372fcb2e, role_id=0ddef50cbcff486ead484f16d309a783)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:28.611269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469f5e2-d760-4eca-b6b8-1771afbd250f tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-4469f5e2-d760-4eca-b6b8-1771afbd250f tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Could not find role: 0ddef50cbcff486ead484f16d309a783.: keystone.exception.RoleNotFound: Could not find role: 0ddef50cbcff486ead484f16d309a783. Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 01:13:28.635608 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0ddef50cbcff486ead484f16d309a783. Oct 19 01:13:28.636577 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:13:28.641824 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3210/6384] 10.222.0.27 () {58 vars in 1368 bytes} [Wed Oct 19 01:13:28 2022] GET /identity/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles/0ddef50cbcff486ead484f16d309a783 => generated 110 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:13:28.642174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee790-0c28-44b3-8802-743acb7f6455 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:28.654177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee790-0c28-44b3-8802-743acb7f6455 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:28.684132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa694bb95d246a2b2b33078aee03ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b270bc9fc3149439876f6950ca3570b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380976202', 'tempest-DelegatedRole-1890614536'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:28.684840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:28.687614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:28.687957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] PATH_INFO: `/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles/0ddef50cbcff486ead484f16d309a783` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:28.704918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9e4bf864928d487cbb3c2f96372fcb2e, role_id=0ddef50cbcff486ead484f16d309a783)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:28.710753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Could not find role: 0ddef50cbcff486ead484f16d309a783.: keystone.exception.RoleNotFound: Could not find role: 0ddef50cbcff486ead484f16d309a783. Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 01:13:28.752136 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0ddef50cbcff486ead484f16d309a783. Oct 19 01:13:28.753319 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:28.762530 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3175/6385] 10.222.0.27 () {58 vars in 1369 bytes} [Wed Oct 19 01:13:28 2022] HEAD /identity/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e/roles/0ddef50cbcff486ead484f16d309a783 => generated 0 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 19 01:13:28.766419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469f5e2-d760-4eca-b6b8-1771afbd250f tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:28.775177 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:28.789932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469f5e2-d760-4eca-b6b8-1771afbd250f tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:28.833529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa694bb95d246a2b2b33078aee03ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b270bc9fc3149439876f6950ca3570b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380976202', 'tempest-DelegatedRole-1890614536'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:28.834371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:28.834655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:28.845624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] PATH_INFO: `/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:28.889272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorizing `identity:delete_trust(trust_id=9e4bf864928d487cbb3c2f96372fcb2e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:28.898414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:28.994198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9e4bf864928d487cbb3c2f96372fcb2e', 'request_id': 'req-3d2449de-d484-45d6-a977-2befa7b932d3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:28.995023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9e4bf864928d487cbb3c2f96372fcb2e', 'request_id': 'req-3d2449de-d484-45d6-a977-2befa7b932d3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:28.995831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '9e4bf864928d487cbb3c2f96372fcb2e', 'request_id': 'req-3d2449de-d484-45d6-a977-2befa7b932d3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:29.037615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3211/6386] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:13:28 2022] DELETE /identity/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:29.042913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:29.048531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:29.081640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225db9b-954b-41eb-b3a4-e11c4944eb99 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:29.091888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7eefc-4959-4240-8354-4e4224dcbc38 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fa694bb95d246a2b2b33078aee03ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b270bc9fc3149439876f6950ca3570b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-380976202', 'tempest-DelegatedRole-1890614536'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:29.092839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7eefc-4959-4240-8354-4e4224dcbc38 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:29.094712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7eefc-4959-4240-8354-4e4224dcbc38 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:29.095172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7eefc-4959-4240-8354-4e4224dcbc38 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] PATH_INFO: `/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-33c7eefc-4959-4240-8354-4e4224dcbc38 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Could not find trust: 9e4bf864928d487cbb3c2f96372fcb2e.: keystone.exception.TrustNotFound: Could not find trust: 9e4bf864928d487cbb3c2f96372fcb2e. Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 19 01:13:29.120302 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 9e4bf864928d487cbb3c2f96372fcb2e. Oct 19 01:13:29.121637 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:29.131625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:29.133874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:29.139863 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3176/6387] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:13:29 2022] GET /identity/v3/OS-TRUST/trusts/9e4bf864928d487cbb3c2f96372fcb2e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:13:29.162406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2449de-d484-45d6-a977-2befa7b932d3 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:29.168561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03df45-c9e7-45b3-ad9c-c3355cfe3ef0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:29.169241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03df45-c9e7-45b3-ad9c-c3355cfe3ef0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:29.169523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03df45-c9e7-45b3-ad9c-c3355cfe3ef0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:29.169799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03df45-c9e7-45b3-ad9c-c3355cfe3ef0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/0ddef50cbcff486ead484f16d309a783` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:29.171231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03df45-c9e7-45b3-ad9c-c3355cfe3ef0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0ddef50cbcff486ead484f16d309a783)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:29.173643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03df45-c9e7-45b3-ad9c-c3355cfe3ef0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:29.248544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e03df45-c9e7-45b3-ad9c-c3355cfe3ef0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role 0ddef50cbcff486ead484f16d309a783 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:29.249819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e03df45-c9e7-45b3-ad9c-c3355cfe3ef0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:29.251405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e03df45-c9e7-45b3-ad9c-c3355cfe3ef0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:29.260177 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3212/6388] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:29 2022] DELETE /identity/v3/roles/0ddef50cbcff486ead484f16d309a783 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:29.261684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7eefc-4959-4240-8354-4e4224dcbc38 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:29.264137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-33c7eefc-4959-4240-8354-4e4224dcbc38 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:29.322741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7eefc-4959-4240-8354-4e4224dcbc38 tempest-TrustsV3TestJSON-459875568 tempest-user-1070662618] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:29.519605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:29.520207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:29.521220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:29.521540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/roles/f7e8f3dd13f2444c96786a8b65b6fcfa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:29.526754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f7e8f3dd13f2444c96786a8b65b6fcfa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:29.528407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:29.578087 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:29.613730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b1ede-9455-4179-ae38-41503c1dad28 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:29.613730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b1ede-9455-4179-ae38-41503c1dad28 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:29.613730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b1ede-9455-4179-ae38-41503c1dad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:29.661695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-107b1ede-9455-4179-ae38-41503c1dad28 None None] MFA Rules not processed for user `2d97060e766f4e1f982d64b425ddd184`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:29.672101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-107b1ede-9455-4179-ae38-41503c1dad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:29.676282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invalidating the token cache because role f7e8f3dd13f2444c96786a8b65b6fcfa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:29.676574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:29.681251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:29.686689 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3177/6389] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:29 2022] DELETE /identity/v3/roles/f7e8f3dd13f2444c96786a8b65b6fcfa => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:29.691113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:29.693133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:29.802637 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3213/6390] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:29.963121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ef89f-97d5-46f2-a6f1-676900e368b0 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:29.990113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:29.990781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:29.991070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:29.991349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/users/8fa694bb95d246a2b2b33078aee03ac4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:29.997631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8fa694bb95d246a2b2b33078aee03ac4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:29.999994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:30.154171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa694bb95d246a2b2b33078aee03ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.208729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa694bb95d246a2b2b33078aee03ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.229135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa694bb95d246a2b2b33078aee03ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.261608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa694bb95d246a2b2b33078aee03ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.262384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa694bb95d246a2b2b33078aee03ac4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.282330 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3178/6391] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:29 2022] DELETE /identity/v3/users/8fa694bb95d246a2b2b33078aee03ac4 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:13:30.286241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b1ede-9455-4179-ae38-41503c1dad28 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:30.325430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b1ede-9455-4179-ae38-41503c1dad28 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:30.529998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e52d5c4894689ab9454671f7b6bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddd528d927d743e3aef8bfc91265bee8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:30.531998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:30.533850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:30.534247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] PATH_INFO: `/v3/projects/7b270bc9fc3149439876f6950ca3570b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:30.537479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7b270bc9fc3149439876f6950ca3570b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:30.543211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:30.673283 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:30.715050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b270bc9fc3149439876f6950ca3570b', 'request_id': 'req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.730306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b270bc9fc3149439876f6950ca3570b', 'request_id': 'req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.751242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b270bc9fc3149439876f6950ca3570b', 'request_id': 'req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.777471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] The token cache is being invalidate because project 7b270bc9fc3149439876f6950ca3570b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:30.777844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.781627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1e5b93af-1452-4bb9-9e71-b5d6217b4c98 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:30.788950 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3214/6392] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:30 2022] DELETE /identity/v3/projects/7b270bc9fc3149439876f6950ca3570b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:30.794127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:30.795628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:30.946200 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:30.992178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939bd5-f052-4a2d-84d2-af4f612911d2 tempest-TrustsV3TestJSON-21741837 tempest-TrustsV3TestJSON-21741837-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:31.185274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:31.186614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:31.187066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:31.187527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] PATH_INFO: `/v3/users/897f664d36c14bdba0782eb11ae41979` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:31.188933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897f664d36c14bdba0782eb11ae41979)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:31.191038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:31.338661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897f664d36c14bdba0782eb11ae41979'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:31.402856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897f664d36c14bdba0782eb11ae41979'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:31.440665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897f664d36c14bdba0782eb11ae41979'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:31.505552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897f664d36c14bdba0782eb11ae41979'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:31.513225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897f664d36c14bdba0782eb11ae41979'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:31.547807 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3179/6393] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:30 2022] DELETE /identity/v3/users/897f664d36c14bdba0782eb11ae41979 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:31.553738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1593d2e-59d6-4ce7-a352-5f18f2b5db08 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:31.554246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1593d2e-59d6-4ce7-a352-5f18f2b5db08 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:31.554331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1593d2e-59d6-4ce7-a352-5f18f2b5db08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:31.651210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f1593d2e-59d6-4ce7-a352-5f18f2b5db08 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:31.657440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1593d2e-59d6-4ce7-a352-5f18f2b5db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:31.863817 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3215/6394] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:32.183888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:32.185672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:32.395989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5e683-526a-4fe0-bb60-a903144bdf01 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:32.404642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691286-46f8-4df9-afbe-4857ca782b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:32.407619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691286-46f8-4df9-afbe-4857ca782b6a service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:32.408093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691286-46f8-4df9-afbe-4857ca782b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:32.409181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691286-46f8-4df9-afbe-4857ca782b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:32.434749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2691286-46f8-4df9-afbe-4857ca782b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:32.436398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2691286-46f8-4df9-afbe-4857ca782b6a service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:32.480032 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3180/6395] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:32.987660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1593d2e-59d6-4ce7-a352-5f18f2b5db08 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:32.990676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f1593d2e-59d6-4ce7-a352-5f18f2b5db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:33.062257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1593d2e-59d6-4ce7-a352-5f18f2b5db08 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:33.093726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c4aec-b811-4dfb-8c30-6d47c0f6b058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:33.094735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c4aec-b811-4dfb-8c30-6d47c0f6b058 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:33.100038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c4aec-b811-4dfb-8c30-6d47c0f6b058 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:33.100674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c4aec-b811-4dfb-8c30-6d47c0f6b058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:33.108835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1d1c4aec-b811-4dfb-8c30-6d47c0f6b058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:33.158706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c4aec-b811-4dfb-8c30-6d47c0f6b058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:33.168473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c4aec-b811-4dfb-8c30-6d47c0f6b058 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:33.190272 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3216/6396] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:34.527983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691286-46f8-4df9-afbe-4857ca782b6a service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:34.531076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e2691286-46f8-4df9-afbe-4857ca782b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:34.572209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691286-46f8-4df9-afbe-4857ca782b6a service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:34.595822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:34.597269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:34.597735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:34.599489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] PATH_INFO: `/v3/projects/1852062eb2af423ca07461e9434ce984` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:34.605380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1852062eb2af423ca07461e9434ce984)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:34.607327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:34.675329 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:34.789547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1852062eb2af423ca07461e9434ce984', 'request_id': 'req-79edf8c8-5b65-4519-bbd5-29740d6fca1c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:34.809440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1852062eb2af423ca07461e9434ce984', 'request_id': 'req-79edf8c8-5b65-4519-bbd5-29740d6fca1c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:34.826220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1852062eb2af423ca07461e9434ce984', 'request_id': 'req-79edf8c8-5b65-4519-bbd5-29740d6fca1c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:34.858186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] The token cache is being invalidate because project 1852062eb2af423ca07461e9434ce984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:34.858478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:34.861059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-79edf8c8-5b65-4519-bbd5-29740d6fca1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:34.862980 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3181/6397] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:34 2022] DELETE /identity/v3/projects/1852062eb2af423ca07461e9434ce984 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:34.867917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c4aec-b811-4dfb-8c30-6d47c0f6b058 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:34.894863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c4aec-b811-4dfb-8c30-6d47c0f6b058 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:35.030198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:35.030861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:35.031142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:35.031413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] PATH_INFO: `/v3/users/1d7e52d5c4894689ab9454671f7b6bc0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:35.038900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d7e52d5c4894689ab9454671f7b6bc0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:35.041537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:35.158045 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:35.161962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d7e52d5c4894689ab9454671f7b6bc0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:35.197650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d7e52d5c4894689ab9454671f7b6bc0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:35.213687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d7e52d5c4894689ab9454671f7b6bc0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:35.225800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d7e52d5c4894689ab9454671f7b6bc0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:35.226614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d7e52d5c4894689ab9454671f7b6bc0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:35.237169 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3217/6398] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:34 2022] DELETE /identity/v3/users/1d7e52d5c4894689ab9454671f7b6bc0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:35.403267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b4e72-bb17-4332-8bf6-47f808d79847 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:35.403908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b4e72-bb17-4332-8bf6-47f808d79847 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:35.404195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b4e72-bb17-4332-8bf6-47f808d79847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:35.473022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-da9b4e72-bb17-4332-8bf6-47f808d79847 None None] MFA Rules not processed for user `2052fd7bb1ee432cb3ca4ec07698292c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:35.475614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da9b4e72-bb17-4332-8bf6-47f808d79847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:35.710302 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3182/6399] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:36.214880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:36.218109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:36.529897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bce20-e0ef-443a-9906-38a4b2fbebb2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:36.562595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:36.563236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:36.563741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:36.564209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] PATH_INFO: `/v3/users/36dc1a37366f43099de6d8f345581c0b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:36.567775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] RBAC: Authorizing `identity:delete_user(user_id=36dc1a37366f43099de6d8f345581c0b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:36.570003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:36.646479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b4e72-bb17-4332-8bf6-47f808d79847 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:36.649611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da9b4e72-bb17-4332-8bf6-47f808d79847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:36.714093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b4e72-bb17-4332-8bf6-47f808d79847 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:36.737387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:36.738166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36dc1a37366f43099de6d8f345581c0b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:36.740159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:36.741518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:36.742235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] PATH_INFO: `/v3/projects/ddd528d927d743e3aef8bfc91265bee8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:36.745136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd528d927d743e3aef8bfc91265bee8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:36.749543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:36.782372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36dc1a37366f43099de6d8f345581c0b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:36.833843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36dc1a37366f43099de6d8f345581c0b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:36.870967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36dc1a37366f43099de6d8f345581c0b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:36.882426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54a9cd64-db94-4a71-a0ae-9a9619bb880e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36dc1a37366f43099de6d8f345581c0b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:36.921662 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3218/6400] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:36 2022] DELETE /identity/v3/users/36dc1a37366f43099de6d8f345581c0b => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:36.927524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234c61-e598-4935-af1f-eb6d5c0ba6d6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:36.929169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234c61-e598-4935-af1f-eb6d5c0ba6d6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:36.942875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234c61-e598-4935-af1f-eb6d5c0ba6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:37.019790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd528d927d743e3aef8bfc91265bee8', 'request_id': 'req-7001b543-5b42-4d3f-9d5b-052944ee89b5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:37.040716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd528d927d743e3aef8bfc91265bee8', 'request_id': 'req-7001b543-5b42-4d3f-9d5b-052944ee89b5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:37.055778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-23234c61-e598-4935-af1f-eb6d5c0ba6d6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:37.057112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-23234c61-e598-4935-af1f-eb6d5c0ba6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:37.069768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd528d927d743e3aef8bfc91265bee8', 'request_id': 'req-7001b543-5b42-4d3f-9d5b-052944ee89b5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:37.094474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] The token cache is being invalidate because project ddd528d927d743e3aef8bfc91265bee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:37.094823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:37.097937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7001b543-5b42-4d3f-9d5b-052944ee89b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:37.106136 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3183/6401] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:36 2022] DELETE /identity/v3/projects/ddd528d927d743e3aef8bfc91265bee8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:37.109063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6357-1fd1-4fbe-9f69-54c7e65469e4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:37.109063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6357-1fd1-4fbe-9f69-54c7e65469e4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:37.109283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6357-1fd1-4fbe-9f69-54c7e65469e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:37.157701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-716a6357-1fd1-4fbe-9f69-54c7e65469e4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:37.162190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-716a6357-1fd1-4fbe-9f69-54c7e65469e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:37.209875 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:37.262369 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:37.319400 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3184/6402] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:37.327545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0c07a-67cd-4d0b-a46f-caec4d335b16 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:37.328280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0c07a-67cd-4d0b-a46f-caec4d335b16 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:37.328874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0c07a-67cd-4d0b-a46f-caec4d335b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:37.350854 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3219/6403] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:37.362733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234c61-e598-4935-af1f-eb6d5c0ba6d6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:37.364898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-23234c61-e598-4935-af1f-eb6d5c0ba6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:37.410946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0dd0c07a-67cd-4d0b-a46f-caec4d335b16 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:37.415220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0dd0c07a-67cd-4d0b-a46f-caec4d335b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:37.436576 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3185/6404] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:37.438457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0c07a-67cd-4d0b-a46f-caec4d335b16 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:37.468186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0c07a-67cd-4d0b-a46f-caec4d335b16 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:37.477422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6ba14-87e0-40e3-a221-cd5c9902b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:37.478416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6ba14-87e0-40e3-a221-cd5c9902b6fd admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:37.478806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6ba14-87e0-40e3-a221-cd5c9902b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:37.479182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6ba14-87e0-40e3-a221-cd5c9902b6fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:37.480154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6ba14-87e0-40e3-a221-cd5c9902b6fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:13:37.481232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6ba14-87e0-40e3-a221-cd5c9902b6fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:37.491860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6ba14-87e0-40e3-a221-cd5c9902b6fd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:37.533514 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3186/6405] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:37.542007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234c61-e598-4935-af1f-eb6d5c0ba6d6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:37.544680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6ba14-87e0-40e3-a221-cd5c9902b6fd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:37.569975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6ba14-87e0-40e3-a221-cd5c9902b6fd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:37.588471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917846a-4416-48e5-b5ca-7dd2d63685f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:37.589354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917846a-4416-48e5-b5ca-7dd2d63685f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:37.589805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917846a-4416-48e5-b5ca-7dd2d63685f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:37.590242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917846a-4416-48e5-b5ca-7dd2d63685f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:37.593727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3088b0-d65b-4331-bae7-b475848b3014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:37.594437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3088b0-d65b-4331-bae7-b475848b3014 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:37.594860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3088b0-d65b-4331-bae7-b475848b3014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:37.595282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3088b0-d65b-4331-bae7-b475848b3014 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:37.596128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3088b0-d65b-4331-bae7-b475848b3014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:37.598750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3088b0-d65b-4331-bae7-b475848b3014 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:37.606945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917846a-4416-48e5-b5ca-7dd2d63685f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:37.609519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917846a-4416-48e5-b5ca-7dd2d63685f3 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:37.646231 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3220/6406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:13:37.698939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917846a-4416-48e5-b5ca-7dd2d63685f3 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:37.706862 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3187/6407] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:13:37 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:37.723158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917846a-4416-48e5-b5ca-7dd2d63685f3 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:37.952444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fae9b-cdc0-4ba8-a04b-6f6c387fef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:37.954658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fae9b-cdc0-4ba8-a04b-6f6c387fef87 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:37.954942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fae9b-cdc0-4ba8-a04b-6f6c387fef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:37.956257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fae9b-cdc0-4ba8-a04b-6f6c387fef87 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:37.957173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fae9b-cdc0-4ba8-a04b-6f6c387fef87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:37.962277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fae9b-cdc0-4ba8-a04b-6f6c387fef87 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:38.018244 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3221/6408] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:37 2022] POST /identity/v3/users => generated 285 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:13:38.022785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3088b0-d65b-4331-bae7-b475848b3014 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:38.040198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3088b0-d65b-4331-bae7-b475848b3014 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:38.055277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c5bbb-fab3-44f9-a23d-28a2d51fc7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:38.056200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c5bbb-fab3-44f9-a23d-28a2d51fc7ca admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:38.056751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c5bbb-fab3-44f9-a23d-28a2d51fc7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:38.057269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c5bbb-fab3-44f9-a23d-28a2d51fc7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:38.058161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c5bbb-fab3-44f9-a23d-28a2d51fc7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:38.065207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c5bbb-fab3-44f9-a23d-28a2d51fc7ca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:38.097019 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3188/6409] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:38.100493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fae9b-cdc0-4ba8-a04b-6f6c387fef87 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:38.118663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fae9b-cdc0-4ba8-a04b-6f6c387fef87 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:38.134317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650072b-7d1f-4989-a846-13b6354834a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:38.138612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650072b-7d1f-4989-a846-13b6354834a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:38.142365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650072b-7d1f-4989-a846-13b6354834a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:38.142728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650072b-7d1f-4989-a846-13b6354834a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:38.146022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650072b-7d1f-4989-a846-13b6354834a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:38.154528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650072b-7d1f-4989-a846-13b6354834a7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:38.195155 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3222/6410] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:38.214748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c5bbb-fab3-44f9-a23d-28a2d51fc7ca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:38.215635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78082-049a-4b4a-923e-8ff74f144af9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:38.217004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78082-049a-4b4a-923e-8ff74f144af9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:38.217298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78082-049a-4b4a-923e-8ff74f144af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:38.247945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c5bbb-fab3-44f9-a23d-28a2d51fc7ca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:38.271218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c72cd-f78d-4fe0-847c-4f7119cac1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:38.274494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c72cd-f78d-4fe0-847c-4f7119cac1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:38.275512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c72cd-f78d-4fe0-847c-4f7119cac1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:38.275802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c72cd-f78d-4fe0-847c-4f7119cac1c5 admin admin] PATH_INFO: `/v3/projects/f8f22c626c8947a39fda95250f4cf350/users/f7e42746d8ff46008fc04b6c6b9ecec4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:38.345799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c72cd-f78d-4fe0-847c-4f7119cac1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f22c626c8947a39fda95250f4cf350, user_id=f7e42746d8ff46008fc04b6c6b9ecec4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:38.348354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2ee78082-049a-4b4a-923e-8ff74f144af9 None None] MFA Rules not processed for user `4e394c9876db468caaf058abac55f3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:38.350372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c72cd-f78d-4fe0-847c-4f7119cac1c5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:38.351616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2ee78082-049a-4b4a-923e-8ff74f144af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:38.383688 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3189/6411] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:38 2022] PUT /identity/v3/projects/f8f22c626c8947a39fda95250f4cf350/users/f7e42746d8ff46008fc04b6c6b9ecec4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:38.392485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df651a-2cc4-4167-843e-2f8c43447492 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:38.392965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df651a-2cc4-4167-843e-2f8c43447492 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:38.393244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df651a-2cc4-4167-843e-2f8c43447492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:38.493542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d9df651a-2cc4-4167-843e-2f8c43447492 None None] MFA Rules not processed for user `f7e42746d8ff46008fc04b6c6b9ecec4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:38.495003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d9df651a-2cc4-4167-843e-2f8c43447492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:38.604864 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:38.650219 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3223/6412] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:38.653274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78082-049a-4b4a-923e-8ff74f144af9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:38.658928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2ee78082-049a-4b4a-923e-8ff74f144af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:38.718911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78082-049a-4b4a-923e-8ff74f144af9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:38.750439 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3190/6413] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:38.751403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df651a-2cc4-4167-843e-2f8c43447492 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:38.804676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df651a-2cc4-4167-843e-2f8c43447492 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:38.828142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2097edb-8d71-44d9-ae57-c163997fc4ee tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:38.829060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2097edb-8d71-44d9-ae57-c163997fc4ee tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:38.829524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2097edb-8d71-44d9-ae57-c163997fc4ee tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:38.829963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2097edb-8d71-44d9-ae57-c163997fc4ee tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/application_credentials` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:38.830996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2097edb-8d71-44d9-ae57-c163997fc4ee tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:create_application_credential(user_id=f7e42746d8ff46008fc04b6c6b9ecec4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:38.839027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2097edb-8d71-44d9-ae57-c163997fc4ee tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:38.978633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd579f3-374a-41cb-9ce6-b6df00ddb32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:38.979350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd579f3-374a-41cb-9ce6-b6df00ddb32b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:38.979638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd579f3-374a-41cb-9ce6-b6df00ddb32b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:38.980997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd579f3-374a-41cb-9ce6-b6df00ddb32b admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:38.981665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd579f3-374a-41cb-9ce6-b6df00ddb32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:38.985599 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:38.991588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd579f3-374a-41cb-9ce6-b6df00ddb32b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:39.117298 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3224/6414] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:13:38 2022] POST /identity/v3/projects => generated 389 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:39.121403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd579f3-374a-41cb-9ce6-b6df00ddb32b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:39.206060 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3191/6415] 10.222.0.27 () {60 vars in 1315 bytes} [Wed Oct 19 01:13:38 2022] POST /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/application_credentials => generated 921 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:39.207075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2097edb-8d71-44d9-ae57-c163997fc4ee tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:39.240844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2097edb-8d71-44d9-ae57-c163997fc4ee tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:39.323165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd579f3-374a-41cb-9ce6-b6df00ddb32b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:39.345836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c121b8-43e5-455c-9acc-2c5ce5df29d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:39.350202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c121b8-43e5-455c-9acc-2c5ce5df29d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:39.350780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c121b8-43e5-455c-9acc-2c5ce5df29d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:39.351626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c121b8-43e5-455c-9acc-2c5ce5df29d3 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:39.352308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c121b8-43e5-455c-9acc-2c5ce5df29d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:39.355883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c121b8-43e5-455c-9acc-2c5ce5df29d3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:39.436979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5581f04-691a-4ed2-ba6c-c866cd47fbdf tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:39.438024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5581f04-691a-4ed2-ba6c-c866cd47fbdf tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:39.438519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5581f04-691a-4ed2-ba6c-c866cd47fbdf tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:39.438989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5581f04-691a-4ed2-ba6c-c866cd47fbdf tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules/a80b65391174467fbd93a4aa7709f105` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:39.441151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5581f04-691a-4ed2-ba6c-c866cd47fbdf tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:delete_access_rule(user_id=f7e42746d8ff46008fc04b6c6b9ecec4, access_rule_id=a80b65391174467fbd93a4aa7709f105)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:39.446898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5581f04-691a-4ed2-ba6c-c866cd47fbdf tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:39.476050 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3225/6416] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:39 2022] POST /identity/v3/users => generated 301 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:39.478691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c121b8-43e5-455c-9acc-2c5ce5df29d3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:39.492924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c0c121b8-43e5-455c-9acc-2c5ce5df29d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-d5581f04-691a-4ed2-ba6c-c866cd47fbdf tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application session.delete(ref) Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application next(self.gen) Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application yield resource Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application next(self.gen) Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 01:13:39.522392 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise self.value Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application session.commit() Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.session.flush() Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 01:13:39.523686 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application compat.raise_( Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._synchronize( Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise AssertionError( Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 19 01:13:39.525044 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:13:39.526330 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:13:39.528022 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 19 01:13:39.528022 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 19 01:13:39.528022 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 19 01:13:39.528022 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 19 01:13:39.528022 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 19 01:13:39.528022 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:13:39.529390 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3192/6417] 10.222.0.27 () {58 vars in 1362 bytes} [Wed Oct 19 01:13:39 2022] DELETE /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules/a80b65391174467fbd93a4aa7709f105 => generated 89 bytes in 322 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 19 01:13:39.530580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5581f04-691a-4ed2-ba6c-c866cd47fbdf tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:39.542277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c121b8-43e5-455c-9acc-2c5ce5df29d3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:39.554071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:39.555111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:39.555350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5581f04-691a-4ed2-ba6c-c866cd47fbdf tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:39.555532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:39.555704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] PATH_INFO: `/v3/projects/cbdeb17f9d6046899e4380f0559693e1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:39.556938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbdeb17f9d6046899e4380f0559693e1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:39.559163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:39.569209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328952ae-fea4-412d-811c-95552bf7561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:39.569717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328952ae-fea4-412d-811c-95552bf7561c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:39.570005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328952ae-fea4-412d-811c-95552bf7561c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:39.570283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328952ae-fea4-412d-811c-95552bf7561c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:39.570936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328952ae-fea4-412d-811c-95552bf7561c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:39.572551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328952ae-fea4-412d-811c-95552bf7561c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:39.603596 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3193/6418] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:39.605003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328952ae-fea4-412d-811c-95552bf7561c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:39.627256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328952ae-fea4-412d-811c-95552bf7561c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:39.638038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fff143-b452-4c7e-a0c6-005eddf14f5f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:39.651749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fff143-b452-4c7e-a0c6-005eddf14f5f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:39.651749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fff143-b452-4c7e-a0c6-005eddf14f5f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:39.652000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fff143-b452-4c7e-a0c6-005eddf14f5f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/application_credentials/b91b8ed1fade4318be8debb1c26ea19c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:39.686692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbdeb17f9d6046899e4380f0559693e1', 'request_id': 'req-f6be7857-609a-4cd4-8081-5dc5906ac578'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:39.711503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbdeb17f9d6046899e4380f0559693e1', 'request_id': 'req-f6be7857-609a-4cd4-8081-5dc5906ac578'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:39.713264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fff143-b452-4c7e-a0c6-005eddf14f5f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f7e42746d8ff46008fc04b6c6b9ecec4, application_credential_id=b91b8ed1fade4318be8debb1c26ea19c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:39.717770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fff143-b452-4c7e-a0c6-005eddf14f5f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:39.724298 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:39.730157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbdeb17f9d6046899e4380f0559693e1', 'request_id': 'req-f6be7857-609a-4cd4-8081-5dc5906ac578'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:39.751690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] The token cache is being invalidate because project cbdeb17f9d6046899e4380f0559693e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:39.752080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:39.752919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:39.757437 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3226/6419] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:39 2022] DELETE /identity/v3/projects/cbdeb17f9d6046899e4380f0559693e1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:39.759463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:39.761596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:39.796385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3194/6420] 10.222.0.27 () {58 vars in 1395 bytes} [Wed Oct 19 01:13:39 2022] DELETE /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/application_credentials/b91b8ed1fade4318be8debb1c26ea19c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:39.797664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fff143-b452-4c7e-a0c6-005eddf14f5f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:39.809676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-22fff143-b452-4c7e-a0c6-005eddf14f5f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:39.858636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fff143-b452-4c7e-a0c6-005eddf14f5f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:39.876361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:39.877278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:39.877732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:39.878154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] PATH_INFO: `/v3/users/10af5a5c966a4888845d927e63a31901` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:39.881812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10af5a5c966a4888845d927e63a31901)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:39.882574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be7857-609a-4cd4-8081-5dc5906ac578 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:39.887893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:39.894411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b3cb6-2df4-4358-88e6-4116e4246bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:39.896999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b3cb6-2df4-4358-88e6-4116e4246bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:39.897791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b3cb6-2df4-4358-88e6-4116e4246bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:39.898220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b3cb6-2df4-4358-88e6-4116e4246bd1 admin admin] PATH_INFO: `/v3/projects/4c1e2d50044b41a8b01c244908329cc4/users/48bf307208d64c8597d11947ff951cf3/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:39.947742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b3cb6-2df4-4358-88e6-4116e4246bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1e2d50044b41a8b01c244908329cc4, user_id=48bf307208d64c8597d11947ff951cf3, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:39.954907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b3cb6-2df4-4358-88e6-4116e4246bd1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:39.998940 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3227/6421] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:39 2022] PUT /identity/v3/projects/4c1e2d50044b41a8b01c244908329cc4/users/48bf307208d64c8597d11947ff951cf3/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:40.000402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b3cb6-2df4-4358-88e6-4116e4246bd1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:40.003236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d90b3cb6-2df4-4358-88e6-4116e4246bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:40.014174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10af5a5c966a4888845d927e63a31901'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:40.045250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10af5a5c966a4888845d927e63a31901'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:40.064425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10af5a5c966a4888845d927e63a31901'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:40.066897 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=82,keystone:INSERT=5,keystone:DELETE=13 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:40.076586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10af5a5c966a4888845d927e63a31901'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:40.079958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10af5a5c966a4888845d927e63a31901'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:40.096167 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3195/6422] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:39 2022] DELETE /identity/v3/users/10af5a5c966a4888845d927e63a31901 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:40.099156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:40.101963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:40.165829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b3cb6-2df4-4358-88e6-4116e4246bd1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:40.267481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfbd84-6dae-42a6-9dc8-1f4677f6e8a0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:40.274946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f372f0-37be-4ab9-a081-d5538567992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:40.276040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f372f0-37be-4ab9-a081-d5538567992d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:40.276429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f372f0-37be-4ab9-a081-d5538567992d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:40.276841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f372f0-37be-4ab9-a081-d5538567992d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:40.277621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f372f0-37be-4ab9-a081-d5538567992d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:40.296545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f372f0-37be-4ab9-a081-d5538567992d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:40.334211 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3196/6423] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:40.338795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f372f0-37be-4ab9-a081-d5538567992d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:40.370640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aacdf-366b-44b3-9ff5-c8ca89c41e58 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:40.370640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aacdf-366b-44b3-9ff5-c8ca89c41e58 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:40.370640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aacdf-366b-44b3-9ff5-c8ca89c41e58 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:40.371411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aacdf-366b-44b3-9ff5-c8ca89c41e58 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:40.384052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f372f0-37be-4ab9-a081-d5538567992d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:40.393304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aacdf-366b-44b3-9ff5-c8ca89c41e58 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:list_access_rules(user_id=f7e42746d8ff46008fc04b6c6b9ecec4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:40.396451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aacdf-366b-44b3-9ff5-c8ca89c41e58 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:40.404250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe5a6-ebb8-470e-ae43-d07809e193b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:40.408323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe5a6-ebb8-470e-ae43-d07809e193b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:40.409918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe5a6-ebb8-470e-ae43-d07809e193b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:40.411607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe5a6-ebb8-470e-ae43-d07809e193b5 admin admin] PATH_INFO: `/v3/projects/4c1e2d50044b41a8b01c244908329cc4/users/48bf307208d64c8597d11947ff951cf3/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:40.415016 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3228/6424] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 01:13:39 2022] GET /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules => generated 369 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:40.419076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aacdf-366b-44b3-9ff5-c8ca89c41e58 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:40.421762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-072aacdf-366b-44b3-9ff5-c8ca89c41e58 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:40.422974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fe5a6-ebb8-470e-ae43-d07809e193b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1e2d50044b41a8b01c244908329cc4, user_id=48bf307208d64c8597d11947ff951cf3, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:40.432833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fe5a6-ebb8-470e-ae43-d07809e193b5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:40.453566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aacdf-366b-44b3-9ff5-c8ca89c41e58 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:40.470946 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3197/6425] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:40 2022] PUT /identity/v3/projects/4c1e2d50044b41a8b01c244908329cc4/users/48bf307208d64c8597d11947ff951cf3/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:40.537921 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:40.584230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b6717-a6d0-463f-9d6c-129a56b6f7ec tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:40.587580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b6717-a6d0-463f-9d6c-129a56b6f7ec tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:40.589158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b6717-a6d0-463f-9d6c-129a56b6f7ec tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:40.590833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b6717-a6d0-463f-9d6c-129a56b6f7ec tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules/a80b65391174467fbd93a4aa7709f105` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:40.593954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b6717-a6d0-463f-9d6c-129a56b6f7ec tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:delete_access_rule(user_id=f7e42746d8ff46008fc04b6c6b9ecec4, access_rule_id=a80b65391174467fbd93a4aa7709f105)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:40.595594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b6717-a6d0-463f-9d6c-129a56b6f7ec tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:40.658418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3229/6426] 10.222.0.27 () {58 vars in 1362 bytes} [Wed Oct 19 01:13:40 2022] DELETE /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules/a80b65391174467fbd93a4aa7709f105 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:40.659693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe5a6-ebb8-470e-ae43-d07809e193b5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:40.674096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe5a6-ebb8-470e-ae43-d07809e193b5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:40.686792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8cedd-4118-4aa5-8c20-57936d36b968 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:40.687770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8cedd-4118-4aa5-8c20-57936d36b968 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:40.688977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8cedd-4118-4aa5-8c20-57936d36b968 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:40.691989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8cedd-4118-4aa5-8c20-57936d36b968 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:40.694076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8cedd-4118-4aa5-8c20-57936d36b968 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:list_access_rules(user_id=f7e42746d8ff46008fc04b6c6b9ecec4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:40.695807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8cedd-4118-4aa5-8c20-57936d36b968 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:40.715281 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3198/6427] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 01:13:40 2022] GET /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules => generated 158 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:40.722492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b6717-a6d0-463f-9d6c-129a56b6f7ec tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:40.744668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b6717-a6d0-463f-9d6c-129a56b6f7ec tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:40.760236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc071c-1bea-41d8-b65f-47eb752b2dc6 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:40.760968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc071c-1bea-41d8-b65f-47eb752b2dc6 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:40.761251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc071c-1bea-41d8-b65f-47eb752b2dc6 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:40.761535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc071c-1bea-41d8-b65f-47eb752b2dc6 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/application_credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:40.762269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc071c-1bea-41d8-b65f-47eb752b2dc6 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:create_application_credential(user_id=f7e42746d8ff46008fc04b6c6b9ecec4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:40.763483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc071c-1bea-41d8-b65f-47eb752b2dc6 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:41.094524 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3230/6428] 10.222.0.27 () {60 vars in 1315 bytes} [Wed Oct 19 01:13:40 2022] POST /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/application_credentials => generated 921 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:41.096117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8cedd-4118-4aa5-8c20-57936d36b968 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:41.118570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8cedd-4118-4aa5-8c20-57936d36b968 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:41.125037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5ebdd-b396-483e-8f1e-d036cb47be50 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:41.126178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5ebdd-b396-483e-8f1e-d036cb47be50 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:41.126505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5ebdd-b396-483e-8f1e-d036cb47be50 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:41.126786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5ebdd-b396-483e-8f1e-d036cb47be50 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:41.128809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5ebdd-b396-483e-8f1e-d036cb47be50 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:list_access_rules(user_id=f7e42746d8ff46008fc04b6c6b9ecec4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:41.130955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5ebdd-b396-483e-8f1e-d036cb47be50 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:41.138615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3199/6429] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 01:13:41 2022] GET /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules => generated 369 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:41.143219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc071c-1bea-41d8-b65f-47eb752b2dc6 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:41.215639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5ebdd-b396-483e-8f1e-d036cb47be50 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:41.216151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc071c-1bea-41d8-b65f-47eb752b2dc6 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:41.231848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7fd5ebdd-b396-483e-8f1e-d036cb47be50 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:41.244343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1094e7-8d7d-425c-b5ff-e4af93055f9f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:41.245070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1094e7-8d7d-425c-b5ff-e4af93055f9f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:41.257705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1094e7-8d7d-425c-b5ff-e4af93055f9f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:41.258119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1094e7-8d7d-425c-b5ff-e4af93055f9f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/application_credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:41.263215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1094e7-8d7d-425c-b5ff-e4af93055f9f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:create_application_credential(user_id=f7e42746d8ff46008fc04b6c6b9ecec4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:41.268368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1094e7-8d7d-425c-b5ff-e4af93055f9f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:41.416729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5ebdd-b396-483e-8f1e-d036cb47be50 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:41.428143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:41.428953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:41.430020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:41.431300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] PATH_INFO: `/v3/projects/b5f51cac39aa439a952d283a926625bd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:41.434856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f51cac39aa439a952d283a926625bd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:41.441436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:41.597868 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3231/6430] 10.222.0.27 () {60 vars in 1315 bytes} [Wed Oct 19 01:13:41 2022] POST /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/application_credentials => generated 921 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:41.627835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1094e7-8d7d-425c-b5ff-e4af93055f9f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:41.649530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1094e7-8d7d-425c-b5ff-e4af93055f9f tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:41.666381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f51cac39aa439a952d283a926625bd', 'request_id': 'req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:41.699015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f51cac39aa439a952d283a926625bd', 'request_id': 'req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:41.702374 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:41.715849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f51cac39aa439a952d283a926625bd', 'request_id': 'req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:41.763061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] The token cache is being invalidate because project b5f51cac39aa439a952d283a926625bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:41.763357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:41.764975 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=1,keystone:INSERT=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:41.771389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85afccce-08c3-46ca-9be4-5d6bc7dde9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:41.777340 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3200/6431] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:41 2022] DELETE /identity/v3/projects/b5f51cac39aa439a952d283a926625bd => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:41.784790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea97ba-cea4-48f5-b443-d79aa4a55353 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:41.785882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea97ba-cea4-48f5-b443-d79aa4a55353 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:41.787707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea97ba-cea4-48f5-b443-d79aa4a55353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:41.821878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658648e-eb9e-4f76-9ed3-661ca0e38a44 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e42746d8ff46008fc04b6c6b9ecec4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8f22c626c8947a39fda95250f4cf350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:41.822730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658648e-eb9e-4f76-9ed3-661ca0e38a44 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:41.823402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658648e-eb9e-4f76-9ed3-661ca0e38a44 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:41.823791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658648e-eb9e-4f76-9ed3-661ca0e38a44 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules/12b74bf5895c4d3f8458beb5f23d6de2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:41.825376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658648e-eb9e-4f76-9ed3-661ca0e38a44 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorizing `identity:get_access_rule(user_id=f7e42746d8ff46008fc04b6c6b9ecec4, access_rule_id=12b74bf5895c4d3f8458beb5f23d6de2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:41.827916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658648e-eb9e-4f76-9ed3-661ca0e38a44 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:41.841023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-90ea97ba-cea4-48f5-b443-d79aa4a55353 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:41.842913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-90ea97ba-cea4-48f5-b443-d79aa4a55353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:41.849251 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3232/6432] 10.222.0.27 () {58 vars in 1359 bytes} [Wed Oct 19 01:13:41 2022] GET /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4/access_rules/12b74bf5895c4d3f8458beb5f23d6de2 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:41.851870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658648e-eb9e-4f76-9ed3-661ca0e38a44 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:41.857452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e658648e-eb9e-4f76-9ed3-661ca0e38a44 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:42.008686 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3201/6433] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:42.017896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ee8e9-f58f-418b-a4f2-8db02664fef7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:42.018495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ee8e9-f58f-418b-a4f2-8db02664fef7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:42.018844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ee8e9-f58f-418b-a4f2-8db02664fef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:42.047391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658648e-eb9e-4f76-9ed3-661ca0e38a44 tempest-AccessRulesV3Test-693578591 tempest-AccessRulesV3Test-693578591-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:42.063195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:42.063932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:42.064280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:42.065629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] PATH_INFO: `/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:42.069409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e42746d8ff46008fc04b6c6b9ecec4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:42.073222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a13ee8e9-f58f-418b-a4f2-8db02664fef7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:42.076862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:42.078351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a13ee8e9-f58f-418b-a4f2-8db02664fef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:42.113102 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3202/6434] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:42.117003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ee8e9-f58f-418b-a4f2-8db02664fef7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:42.141112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ee8e9-f58f-418b-a4f2-8db02664fef7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:42.154959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e923d1-9c76-494d-8b82-df9148e648c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:42.155647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e923d1-9c76-494d-8b82-df9148e648c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:42.155964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e923d1-9c76-494d-8b82-df9148e648c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:42.156272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e923d1-9c76-494d-8b82-df9148e648c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:42.162722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e923d1-9c76-494d-8b82-df9148e648c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:13:42.163056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e923d1-9c76-494d-8b82-df9148e648c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:42.169051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e923d1-9c76-494d-8b82-df9148e648c5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:42.186967 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3203/6435] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:42.190795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e923d1-9c76-494d-8b82-df9148e648c5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:42.204299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e923d1-9c76-494d-8b82-df9148e648c5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:42.205135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e42746d8ff46008fc04b6c6b9ecec4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:42.212489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71ccc3-27bd-4e33-bb59-3fdae01ba392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:42.213527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71ccc3-27bd-4e33-bb59-3fdae01ba392 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:42.214045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71ccc3-27bd-4e33-bb59-3fdae01ba392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:42.214579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71ccc3-27bd-4e33-bb59-3fdae01ba392 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:42.215740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71ccc3-27bd-4e33-bb59-3fdae01ba392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:42.218368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71ccc3-27bd-4e33-bb59-3fdae01ba392 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:42.290867 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3204/6436] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:13:42 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:13:42.292083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e42746d8ff46008fc04b6c6b9ecec4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:42.295038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71ccc3-27bd-4e33-bb59-3fdae01ba392 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:42.312010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e42746d8ff46008fc04b6c6b9ecec4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:42.325793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e42746d8ff46008fc04b6c6b9ecec4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:42.326669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4a36c571-a9a6-4339-a20f-5d03e2ab0365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e42746d8ff46008fc04b6c6b9ecec4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:42.341466 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3233/6437] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:41 2022] DELETE /identity/v3/users/f7e42746d8ff46008fc04b6c6b9ecec4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:13:42.347563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e3314-f961-4882-9f0d-116c8ba300df None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:42.348098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e3314-f961-4882-9f0d-116c8ba300df None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:42.348520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e3314-f961-4882-9f0d-116c8ba300df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:42.386053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fa9e3314-f961-4882-9f0d-116c8ba300df None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:42.391873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fa9e3314-f961-4882-9f0d-116c8ba300df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:42.549780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71ccc3-27bd-4e33-bb59-3fdae01ba392 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:42.570644 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:42.690575 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3234/6438] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:42.710900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e3314-f961-4882-9f0d-116c8ba300df None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:42.725580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fa9e3314-f961-4882-9f0d-116c8ba300df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:42.736193 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:42.761388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9b25e-ba51-4f95-81ea-adb567de4347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:42.762337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9b25e-ba51-4f95-81ea-adb567de4347 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:42.764189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9b25e-ba51-4f95-81ea-adb567de4347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:42.781313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9b25e-ba51-4f95-81ea-adb567de4347 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:42.781313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9b25e-ba51-4f95-81ea-adb567de4347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:42.781313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9b25e-ba51-4f95-81ea-adb567de4347 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:42.835419 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3205/6439] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:42 2022] POST /identity/v3/users => generated 290 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:42.846620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9b25e-ba51-4f95-81ea-adb567de4347 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:42.852140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-27e9b25e-ba51-4f95-81ea-adb567de4347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:42.891108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9b25e-ba51-4f95-81ea-adb567de4347 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:42.908840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e5cc-ffaa-4593-93ef-f7fb26160ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:42.911291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e5cc-ffaa-4593-93ef-f7fb26160ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:42.912873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e5cc-ffaa-4593-93ef-f7fb26160ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:42.921090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e3314-f961-4882-9f0d-116c8ba300df None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:42.927416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e5cc-ffaa-4593-93ef-f7fb26160ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:42.930869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6e5cc-ffaa-4593-93ef-f7fb26160ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:42.938151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9956601-2f23-4d34-a33b-4e6babe862fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:42.938797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9956601-2f23-4d34-a33b-4e6babe862fa service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:42.939079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9956601-2f23-4d34-a33b-4e6babe862fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:42.939357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9956601-2f23-4d34-a33b-4e6babe862fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:42.942115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6e5cc-ffaa-4593-93ef-f7fb26160ed0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:42.962949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9956601-2f23-4d34-a33b-4e6babe862fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:42.964429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9956601-2f23-4d34-a33b-4e6babe862fa service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:42.982350 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3235/6440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:42.992249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9956601-2f23-4d34-a33b-4e6babe862fa service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:42.993357 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3206/6441] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:43.008476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9956601-2f23-4d34-a33b-4e6babe862fa service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:43.022537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae67a5-3b3f-4605-bff2-9e77562d9487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:43.023169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae67a5-3b3f-4605-bff2-9e77562d9487 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:43.023456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae67a5-3b3f-4605-bff2-9e77562d9487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:43.023733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae67a5-3b3f-4605-bff2-9e77562d9487 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:43.024392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae67a5-3b3f-4605-bff2-9e77562d9487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:43.026871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae67a5-3b3f-4605-bff2-9e77562d9487 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:43.069933 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3236/6442] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:13:43.074201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e5cc-ffaa-4593-93ef-f7fb26160ed0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:43.095332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e5cc-ffaa-4593-93ef-f7fb26160ed0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:43.105823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ebc07-1700-44d3-93bd-3f94069ad4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:43.106521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ebc07-1700-44d3-93bd-3f94069ad4da admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:43.106804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ebc07-1700-44d3-93bd-3f94069ad4da admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:43.107087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ebc07-1700-44d3-93bd-3f94069ad4da admin admin] PATH_INFO: `/v3/projects/049244e002194913a6e11a22c9cb2584/users/9ec4eeae3e1c4fa3add01599389ae85a/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:43.201322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ebc07-1700-44d3-93bd-3f94069ad4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=049244e002194913a6e11a22c9cb2584, user_id=9ec4eeae3e1c4fa3add01599389ae85a, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:43.208039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ebc07-1700-44d3-93bd-3f94069ad4da admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:43.266783 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3207/6443] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:43 2022] PUT /identity/v3/projects/049244e002194913a6e11a22c9cb2584/users/9ec4eeae3e1c4fa3add01599389ae85a/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:43.278313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ba57e-cc47-4794-a12a-beb7efe7f6c0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:43.278603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ba57e-cc47-4794-a12a-beb7efe7f6c0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:43.278881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ba57e-cc47-4794-a12a-beb7efe7f6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:43.364466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-402ba57e-cc47-4794-a12a-beb7efe7f6c0 None None] MFA Rules not processed for user `9ec4eeae3e1c4fa3add01599389ae85a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:43.372356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-402ba57e-cc47-4794-a12a-beb7efe7f6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:43.536464 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3237/6444] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:43.569968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ebc07-1700-44d3-93bd-3f94069ad4da admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:43.571997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e92ebc07-1700-44d3-93bd-3f94069ad4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:43.745665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ebc07-1700-44d3-93bd-3f94069ad4da admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:43.751374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc019d3-3ccc-4714-bb4b-c295794849c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:43.752194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc019d3-3ccc-4714-bb4b-c295794849c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:43.752685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc019d3-3ccc-4714-bb4b-c295794849c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:43.753124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc019d3-3ccc-4714-bb4b-c295794849c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:43.764689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc019d3-3ccc-4714-bb4b-c295794849c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:43.766529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc019d3-3ccc-4714-bb4b-c295794849c5 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:43.798127 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3208/6445] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:43.810761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ba57e-cc47-4794-a12a-beb7efe7f6c0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:43.812884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-402ba57e-cc47-4794-a12a-beb7efe7f6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:44.045763 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:44.072535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ba57e-cc47-4794-a12a-beb7efe7f6c0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:44.094292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:44.095029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:44.095309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:44.095715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] PATH_INFO: `/v3/projects/f8f22c626c8947a39fda95250f4cf350` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:44.098749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f22c626c8947a39fda95250f4cf350)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:44.100895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:44.237312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f22c626c8947a39fda95250f4cf350', 'request_id': 'req-7d960e0d-386d-48a4-8537-a9ca11087a32'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:44.255323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f22c626c8947a39fda95250f4cf350', 'request_id': 'req-7d960e0d-386d-48a4-8537-a9ca11087a32'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:44.279228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f22c626c8947a39fda95250f4cf350', 'request_id': 'req-7d960e0d-386d-48a4-8537-a9ca11087a32'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:44.303362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] The token cache is being invalidate because project f8f22c626c8947a39fda95250f4cf350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:44.303664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:44.309381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d960e0d-386d-48a4-8537-a9ca11087a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:44.329184 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3238/6446] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:43 2022] DELETE /identity/v3/projects/f8f22c626c8947a39fda95250f4cf350 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:44.334659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415aefb-72a6-4d2d-a276-1bc2fffc9a5f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:44.334948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415aefb-72a6-4d2d-a276-1bc2fffc9a5f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:44.335230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415aefb-72a6-4d2d-a276-1bc2fffc9a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:44.413089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5415aefb-72a6-4d2d-a276-1bc2fffc9a5f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:44.414410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5415aefb-72a6-4d2d-a276-1bc2fffc9a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:44.579975 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3209/6447] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:44.588045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735220d-fed9-4002-aeca-f3c77ac46420 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:44.588342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735220d-fed9-4002-aeca-f3c77ac46420 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:44.588739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735220d-fed9-4002-aeca-f3c77ac46420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:44.613253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1735220d-fed9-4002-aeca-f3c77ac46420 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:44.615142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1735220d-fed9-4002-aeca-f3c77ac46420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:44.624834 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3239/6448] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:44.628762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415aefb-72a6-4d2d-a276-1bc2fffc9a5f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:44.642998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415aefb-72a6-4d2d-a276-1bc2fffc9a5f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:44.655253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ce46-0f42-4020-886f-d6a0357080f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:44.655892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ce46-0f42-4020-886f-d6a0357080f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:44.656326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ce46-0f42-4020-886f-d6a0357080f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:44.656605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ce46-0f42-4020-886f-d6a0357080f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:44.657294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993ce46-0f42-4020-886f-d6a0357080f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:13:44.657598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993ce46-0f42-4020-886f-d6a0357080f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:44.659542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993ce46-0f42-4020-886f-d6a0357080f2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:44.678413 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3210/6449] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:13:44.682342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735220d-fed9-4002-aeca-f3c77ac46420 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:44.695322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735220d-fed9-4002-aeca-f3c77ac46420 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:44.707825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be77581-eb79-4b5b-bc03-836ee228d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:44.708799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77581-eb79-4b5b-bc03-836ee228d153 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:44.711335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77581-eb79-4b5b-bc03-836ee228d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:44.712458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77581-eb79-4b5b-bc03-836ee228d153 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:44.713376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be77581-eb79-4b5b-bc03-836ee228d153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:44.716292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be77581-eb79-4b5b-bc03-836ee228d153 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:44.769229 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3240/6450] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:13:44 2022] POST /identity/v3/projects => generated 391 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:44.770313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ce46-0f42-4020-886f-d6a0357080f2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:44.787734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ce46-0f42-4020-886f-d6a0357080f2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:44.925386 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:44.990150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14827a08-9f85-4be7-b3dd-f741b695a441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:44.990940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14827a08-9f85-4be7-b3dd-f741b695a441 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:44.991318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14827a08-9f85-4be7-b3dd-f741b695a441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:44.991734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14827a08-9f85-4be7-b3dd-f741b695a441 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:44.992479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14827a08-9f85-4be7-b3dd-f741b695a441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:44.994766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14827a08-9f85-4be7-b3dd-f741b695a441 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:45.042696 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3211/6451] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:44 2022] POST /identity/v3/users => generated 296 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:45.045498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be77581-eb79-4b5b-bc03-836ee228d153 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:45.058354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be77581-eb79-4b5b-bc03-836ee228d153 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:45.095271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ceb0b-e8e7-430e-a3b3-aa515e052c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:45.104742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ceb0b-e8e7-430e-a3b3-aa515e052c52 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:45.105039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ceb0b-e8e7-430e-a3b3-aa515e052c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:45.105304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ceb0b-e8e7-430e-a3b3-aa515e052c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:45.106097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ceb0b-e8e7-430e-a3b3-aa515e052c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:45.107633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ceb0b-e8e7-430e-a3b3-aa515e052c52 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:45.145917 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3241/6452] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:45.146726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14827a08-9f85-4be7-b3dd-f741b695a441 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:45.161762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14827a08-9f85-4be7-b3dd-f741b695a441 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:45.172579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcb2d2-a7fc-43f5-8563-17311793cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:45.173244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb2d2-a7fc-43f5-8563-17311793cfaf admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:45.173526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb2d2-a7fc-43f5-8563-17311793cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:45.173800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb2d2-a7fc-43f5-8563-17311793cfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:45.174456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcb2d2-a7fc-43f5-8563-17311793cfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:45.179116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcb2d2-a7fc-43f5-8563-17311793cfaf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:45.213728 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3212/6453] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:45.215164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ceb0b-e8e7-430e-a3b3-aa515e052c52 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:45.232191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ceb0b-e8e7-430e-a3b3-aa515e052c52 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:45.242419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96926281-ecc2-40e5-a33b-fba0e600d77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:45.243115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96926281-ecc2-40e5-a33b-fba0e600d77c admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:45.243394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96926281-ecc2-40e5-a33b-fba0e600d77c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:45.243671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96926281-ecc2-40e5-a33b-fba0e600d77c admin admin] PATH_INFO: `/v3/projects/42ac42f61e14454baff6047e5b69184e/users/59b5e3b6abb045c796b77c0d4e7322c9/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:45.278242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96926281-ecc2-40e5-a33b-fba0e600d77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ac42f61e14454baff6047e5b69184e, user_id=59b5e3b6abb045c796b77c0d4e7322c9, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:45.283243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96926281-ecc2-40e5-a33b-fba0e600d77c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:45.330206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521bde-ed40-44d1-b540-8826f3355bac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:45.330399 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3242/6454] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:45 2022] PUT /identity/v3/projects/42ac42f61e14454baff6047e5b69184e/users/59b5e3b6abb045c796b77c0d4e7322c9/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:45.331057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521bde-ed40-44d1-b540-8826f3355bac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:45.331360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521bde-ed40-44d1-b540-8826f3355bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:45.435113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0a521bde-ed40-44d1-b540-8826f3355bac None None] MFA Rules not processed for user `59b5e3b6abb045c796b77c0d4e7322c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:45.437137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a521bde-ed40-44d1-b540-8826f3355bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:45.682029 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3213/6455] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:45.686697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96926281-ecc2-40e5-a33b-fba0e600d77c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:45.705703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96926281-ecc2-40e5-a33b-fba0e600d77c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:45.718491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a94dc-a245-4950-8443-efc9fdff2980 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:45.719172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a94dc-a245-4950-8443-efc9fdff2980 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:45.719457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a94dc-a245-4950-8443-efc9fdff2980 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:45.719729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a94dc-a245-4950-8443-efc9fdff2980 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:45.720404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a94dc-a245-4950-8443-efc9fdff2980 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:create_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:45.721612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a94dc-a245-4950-8443-efc9fdff2980 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:45.915522 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3243/6456] 10.222.0.27 () {60 vars in 1314 bytes} [Wed Oct 19 01:13:45 2022] POST /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials => generated 788 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:45.919515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521bde-ed40-44d1-b540-8826f3355bac None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:45.945171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521bde-ed40-44d1-b540-8826f3355bac None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:45.959773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093af97-04c9-4cb2-a81f-a86330f9d2d3 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:45.960741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093af97-04c9-4cb2-a81f-a86330f9d2d3 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:45.961212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093af97-04c9-4cb2-a81f-a86330f9d2d3 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:45.961670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093af97-04c9-4cb2-a81f-a86330f9d2d3 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/1a7d1bc4542e4cbe8d39ebe0a5a914be` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:45.981900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093af97-04c9-4cb2-a81f-a86330f9d2d3 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:get_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9, application_credential_id=1a7d1bc4542e4cbe8d39ebe0a5a914be)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:45.984063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093af97-04c9-4cb2-a81f-a86330f9d2d3 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:45.986033 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3214/6457] 10.222.0.27 () {58 vars in 1392 bytes} [Wed Oct 19 01:13:45 2022] GET /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/1a7d1bc4542e4cbe8d39ebe0a5a914be => generated 688 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:45.991248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9d63f-886f-4f67-bdd9-94b07bc4296d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:45.991528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9d63f-886f-4f67-bdd9-94b07bc4296d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:45.992072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9d63f-886f-4f67-bdd9-94b07bc4296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:46.028096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b0d9d63f-886f-4f67-bdd9-94b07bc4296d None None] MFA Rules not processed for user `59b5e3b6abb045c796b77c0d4e7322c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:46.030346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b0d9d63f-886f-4f67-bdd9-94b07bc4296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:46.063084 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:46.404739 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3244/6458] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3424 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 19 01:13:46.409487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093af97-04c9-4cb2-a81f-a86330f9d2d3 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:46.424967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093af97-04c9-4cb2-a81f-a86330f9d2d3 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:46.435015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c387e-6415-429c-9a2a-e8a557d356bd tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:46.435632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c387e-6415-429c-9a2a-e8a557d356bd tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:46.436291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c387e-6415-429c-9a2a-e8a557d356bd tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:46.436291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c387e-6415-429c-9a2a-e8a557d356bd tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/1a7d1bc4542e4cbe8d39ebe0a5a914be` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:46.439443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c387e-6415-429c-9a2a-e8a557d356bd tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:delete_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9, application_credential_id=1a7d1bc4542e4cbe8d39ebe0a5a914be)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:46.445684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c387e-6415-429c-9a2a-e8a557d356bd tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:46.507972 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3215/6459] 10.222.0.27 () {58 vars in 1395 bytes} [Wed Oct 19 01:13:46 2022] DELETE /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/1a7d1bc4542e4cbe8d39ebe0a5a914be => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:46.515152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9d63f-886f-4f67-bdd9-94b07bc4296d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:46.569586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9d63f-886f-4f67-bdd9-94b07bc4296d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:46.602733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a87ab-46ee-430b-9594-9c93ee049767 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:46.604230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a87ab-46ee-430b-9594-9c93ee049767 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:46.605084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a87ab-46ee-430b-9594-9c93ee049767 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:46.605387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a87ab-46ee-430b-9594-9c93ee049767 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:46.606085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a87ab-46ee-430b-9594-9c93ee049767 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:create_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:46.611228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a87ab-46ee-430b-9594-9c93ee049767 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:46.912234 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3245/6460] 10.222.0.27 () {60 vars in 1315 bytes} [Wed Oct 19 01:13:46 2022] POST /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials => generated 921 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:46.913675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c387e-6415-429c-9a2a-e8a557d356bd tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:46.927312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c387e-6415-429c-9a2a-e8a557d356bd tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:46.945346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d1e51-39ab-4490-88d4-db5c70f645dc tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:46.946086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d1e51-39ab-4490-88d4-db5c70f645dc tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:46.946386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d1e51-39ab-4490-88d4-db5c70f645dc tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:46.956434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d1e51-39ab-4490-88d4-db5c70f645dc tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/ad381a0736ca475eb808afc6324446d6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:47.011919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d1e51-39ab-4490-88d4-db5c70f645dc tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:delete_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9, application_credential_id=ad381a0736ca475eb808afc6324446d6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:47.011919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d1e51-39ab-4490-88d4-db5c70f645dc tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:47.057972 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3216/6461] 10.222.0.27 () {58 vars in 1395 bytes} [Wed Oct 19 01:13:46 2022] DELETE /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/ad381a0736ca475eb808afc6324446d6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:47.059291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a87ab-46ee-430b-9594-9c93ee049767 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:47.073539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a87ab-46ee-430b-9594-9c93ee049767 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:47.091299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32981a59-5f8b-41e3-b3ed-8f47d1a87dc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:47.091545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32981a59-5f8b-41e3-b3ed-8f47d1a87dc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:47.091775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32981a59-5f8b-41e3-b3ed-8f47d1a87dc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:47.092050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32981a59-5f8b-41e3-b3ed-8f47d1a87dc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:47.095319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32981a59-5f8b-41e3-b3ed-8f47d1a87dc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:create_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:47.098418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32981a59-5f8b-41e3-b3ed-8f47d1a87dc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:47.228299 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:47.257205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d1e51-39ab-4490-88d4-db5c70f645dc tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:47.257905 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3246/6462] 10.222.0.27 () {60 vars in 1315 bytes} [Wed Oct 19 01:13:47 2022] POST /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials => generated 812 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:47.273921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d1e51-39ab-4490-88d4-db5c70f645dc tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:47.292157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cec64f-1969-4ff7-b001-994bb494eb7f tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:47.293035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cec64f-1969-4ff7-b001-994bb494eb7f tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:47.293431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cec64f-1969-4ff7-b001-994bb494eb7f tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:47.296966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cec64f-1969-4ff7-b001-994bb494eb7f tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/20e869f6e3fd4788884c2f49f1e48976` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:47.348101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cec64f-1969-4ff7-b001-994bb494eb7f tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:delete_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9, application_credential_id=20e869f6e3fd4788884c2f49f1e48976)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:47.366227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cec64f-1969-4ff7-b001-994bb494eb7f tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:47.406599 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3217/6463] 10.222.0.27 () {58 vars in 1395 bytes} [Wed Oct 19 01:13:47 2022] DELETE /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/20e869f6e3fd4788884c2f49f1e48976 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:47.411888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32981a59-5f8b-41e3-b3ed-8f47d1a87dc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:47.424744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32981a59-5f8b-41e3-b3ed-8f47d1a87dc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:47.443430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e309f5-d642-42f2-861a-9e5f4395faf4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:47.444548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e309f5-d642-42f2-861a-9e5f4395faf4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:47.445102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e309f5-d642-42f2-861a-9e5f4395faf4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:47.446972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e309f5-d642-42f2-861a-9e5f4395faf4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:47.447899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e309f5-d642-42f2-861a-9e5f4395faf4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:create_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:47.451446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e309f5-d642-42f2-861a-9e5f4395faf4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:47.585200 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3247/6464] 10.222.0.27 () {60 vars in 1314 bytes} [Wed Oct 19 01:13:47 2022] POST /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials => generated 789 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:47.589401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cec64f-1969-4ff7-b001-994bb494eb7f tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:47.595140 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:47.604875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cec64f-1969-4ff7-b001-994bb494eb7f tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:47.617413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175769-6469-45cf-be6f-ccf7a85d13ee tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:47.618507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175769-6469-45cf-be6f-ccf7a85d13ee tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:47.618906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175769-6469-45cf-be6f-ccf7a85d13ee tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:47.619304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175769-6469-45cf-be6f-ccf7a85d13ee tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:47.620824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f175769-6469-45cf-be6f-ccf7a85d13ee tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:create_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:47.624185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f175769-6469-45cf-be6f-ccf7a85d13ee tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:47.806164 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3218/6465] 10.222.0.27 () {60 vars in 1314 bytes} [Wed Oct 19 01:13:47 2022] POST /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials => generated 789 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:47.806366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e309f5-d642-42f2-861a-9e5f4395faf4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:47.812282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e309f5-d642-42f2-861a-9e5f4395faf4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:47.820130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff57bc7-fe07-4754-9c0e-cc75c07272c0 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:47.821653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57bc7-fe07-4754-9c0e-cc75c07272c0 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:47.822219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57bc7-fe07-4754-9c0e-cc75c07272c0 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:47.822611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57bc7-fe07-4754-9c0e-cc75c07272c0 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:47.823350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff57bc7-fe07-4754-9c0e-cc75c07272c0 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:list_application_credentials(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:47.825805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff57bc7-fe07-4754-9c0e-cc75c07272c0 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:47.853445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3248/6466] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 01:13:47 2022] GET /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials => generated 1502 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:47.859183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175769-6469-45cf-be6f-ccf7a85d13ee tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:47.880428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175769-6469-45cf-be6f-ccf7a85d13ee tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:47.892992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dcb87-e8f2-4172-a19d-bf9b003f3ae4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:47.893778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dcb87-e8f2-4172-a19d-bf9b003f3ae4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:47.894183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dcb87-e8f2-4172-a19d-bf9b003f3ae4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:47.896810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dcb87-e8f2-4172-a19d-bf9b003f3ae4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/294ef411f3d1409cb7f97251db48b59b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:47.921786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dcb87-e8f2-4172-a19d-bf9b003f3ae4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:delete_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9, application_credential_id=294ef411f3d1409cb7f97251db48b59b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:47.926499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dcb87-e8f2-4172-a19d-bf9b003f3ae4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:47.984975 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3219/6467] 10.222.0.27 () {58 vars in 1395 bytes} [Wed Oct 19 01:13:47 2022] DELETE /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/294ef411f3d1409cb7f97251db48b59b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:47.985770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff57bc7-fe07-4754-9c0e-cc75c07272c0 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:47.997917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff57bc7-fe07-4754-9c0e-cc75c07272c0 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:48.020095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20822f83-a79d-4c8a-947f-a50315261361 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:48.020795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20822f83-a79d-4c8a-947f-a50315261361 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:48.021079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20822f83-a79d-4c8a-947f-a50315261361 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:48.021350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20822f83-a79d-4c8a-947f-a50315261361 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/2a0234993bed4120907660f5c408a584` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:48.057524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20822f83-a79d-4c8a-947f-a50315261361 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:delete_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9, application_credential_id=2a0234993bed4120907660f5c408a584)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:48.058978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20822f83-a79d-4c8a-947f-a50315261361 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:48.153914 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3249/6468] 10.222.0.27 () {58 vars in 1395 bytes} [Wed Oct 19 01:13:47 2022] DELETE /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/2a0234993bed4120907660f5c408a584 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:48.161228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dcb87-e8f2-4172-a19d-bf9b003f3ae4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:48.174647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dcb87-e8f2-4172-a19d-bf9b003f3ae4 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:48.184050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe339f9-ab99-4a02-a006-d436e7d571da tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:48.186514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe339f9-ab99-4a02-a006-d436e7d571da tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:48.186924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe339f9-ab99-4a02-a006-d436e7d571da tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:48.188977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe339f9-ab99-4a02-a006-d436e7d571da tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:48.189995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe339f9-ab99-4a02-a006-d436e7d571da tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:create_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:48.192666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe339f9-ab99-4a02-a006-d436e7d571da tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:48.383451 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3220/6469] 10.222.0.27 () {60 vars in 1314 bytes} [Wed Oct 19 01:13:48 2022] POST /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials => generated 789 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:48.384908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20822f83-a79d-4c8a-947f-a50315261361 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:48.403567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20822f83-a79d-4c8a-947f-a50315261361 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:48.427987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13255c5c-4f8f-458b-a617-4e889a9bd421 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:48.431283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255c5c-4f8f-458b-a617-4e889a9bd421 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:48.431600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255c5c-4f8f-458b-a617-4e889a9bd421 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:48.431979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255c5c-4f8f-458b-a617-4e889a9bd421 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:48.432553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13255c5c-4f8f-458b-a617-4e889a9bd421 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:create_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:48.433764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13255c5c-4f8f-458b-a617-4e889a9bd421 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:48.667489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3250/6470] 10.222.0.27 () {60 vars in 1314 bytes} [Wed Oct 19 01:13:48 2022] POST /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials => generated 789 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:48.672131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe339f9-ab99-4a02-a006-d436e7d571da tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:48.689794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe339f9-ab99-4a02-a006-d436e7d571da tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:48.704224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04daf9-d41b-4a39-96ed-ded90f81a94e tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:48.708734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04daf9-d41b-4a39-96ed-ded90f81a94e tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:48.709287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04daf9-d41b-4a39-96ed-ded90f81a94e tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:48.709769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04daf9-d41b-4a39-96ed-ded90f81a94e tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:48.710633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04daf9-d41b-4a39-96ed-ded90f81a94e tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Adding query filter params (name=tempest-application_credential-1346399652) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:13:48.712992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04daf9-d41b-4a39-96ed-ded90f81a94e tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:list_application_credentials(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:48.714912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04daf9-d41b-4a39-96ed-ded90f81a94e tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:48.744823 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3221/6471] 10.222.0.27 () {58 vars in 1386 bytes} [Wed Oct 19 01:13:48 2022] GET /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials?name=tempest-application_credential-1346399652 => generated 887 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:48.747337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13255c5c-4f8f-458b-a617-4e889a9bd421 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:48.761645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13255c5c-4f8f-458b-a617-4e889a9bd421 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:48.780335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f25046-4998-43c6-98f6-e203ebd1bbc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:48.781485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f25046-4998-43c6-98f6-e203ebd1bbc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:48.781993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f25046-4998-43c6-98f6-e203ebd1bbc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:48.782430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f25046-4998-43c6-98f6-e203ebd1bbc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/7b3aabe90ebe45369839a30e815baa0e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:48.804230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f25046-4998-43c6-98f6-e203ebd1bbc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:delete_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9, application_credential_id=7b3aabe90ebe45369839a30e815baa0e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:48.806651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f25046-4998-43c6-98f6-e203ebd1bbc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:48.830413 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3251/6472] 10.222.0.27 () {58 vars in 1395 bytes} [Wed Oct 19 01:13:48 2022] DELETE /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/7b3aabe90ebe45369839a30e815baa0e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:48.834838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04daf9-d41b-4a39-96ed-ded90f81a94e tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:48.851165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04daf9-d41b-4a39-96ed-ded90f81a94e tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:48.856157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4d60-9106-4d37-8763-820741fc2c74 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b5e3b6abb045c796b77c0d4e7322c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42ac42f61e14454baff6047e5b69184e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:48.857027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4d60-9106-4d37-8763-820741fc2c74 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:48.857485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4d60-9106-4d37-8763-820741fc2c74 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:48.857877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4d60-9106-4d37-8763-820741fc2c74 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/b0371c4c24e34bd9974f3545268bd7e8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:48.889222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f4d60-9106-4d37-8763-820741fc2c74 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorizing `identity:delete_application_credential(user_id=59b5e3b6abb045c796b77c0d4e7322c9, application_credential_id=b0371c4c24e34bd9974f3545268bd7e8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:48.898159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f4d60-9106-4d37-8763-820741fc2c74 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:48.967689 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3222/6473] 10.222.0.27 () {58 vars in 1395 bytes} [Wed Oct 19 01:13:48 2022] DELETE /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9/application_credentials/b0371c4c24e34bd9974f3545268bd7e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:48.973529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f25046-4998-43c6-98f6-e203ebd1bbc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:48.984959 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:49.198843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f25046-4998-43c6-98f6-e203ebd1bbc9 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:49.219722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:49.220842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:49.224710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:49.227423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] PATH_INFO: `/v3/users/59b5e3b6abb045c796b77c0d4e7322c9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:49.231245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b5e3b6abb045c796b77c0d4e7322c9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:49.236809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:49.354899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4d60-9106-4d37-8763-820741fc2c74 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:49.355579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b5e3b6abb045c796b77c0d4e7322c9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:49.356753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-156f4d60-9106-4d37-8763-820741fc2c74 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:49.399593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b5e3b6abb045c796b77c0d4e7322c9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:49.435196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b5e3b6abb045c796b77c0d4e7322c9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:49.472355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b5e3b6abb045c796b77c0d4e7322c9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:49.474984 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:49.476533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aadddf6a-1ca5-4b67-a675-ae992d7596b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b5e3b6abb045c796b77c0d4e7322c9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:49.518291 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3252/6474] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:48 2022] DELETE /identity/v3/users/59b5e3b6abb045c796b77c0d4e7322c9 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:49.526566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768f476-7e50-42dd-b6a2-52de00611c88 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:49.527867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768f476-7e50-42dd-b6a2-52de00611c88 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:49.529313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768f476-7e50-42dd-b6a2-52de00611c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:49.626003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7768f476-7e50-42dd-b6a2-52de00611c88 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:49.627283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7768f476-7e50-42dd-b6a2-52de00611c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:49.646600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4d60-9106-4d37-8763-820741fc2c74 tempest-ApplicationCredentialsV3Test-900747986 tempest-ApplicationCredentialsV3Test-900747986-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:49.781615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:49.782551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:49.782948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:49.783363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:49.791817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:49.845366 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3253/6475] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:49.904114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768f476-7e50-42dd-b6a2-52de00611c88 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:49.906111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7768f476-7e50-42dd-b6a2-52de00611c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:49.940894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768f476-7e50-42dd-b6a2-52de00611c88 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:49.958390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a6203-7b7f-4cd1-a291-7d782b1422d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:49.959074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a6203-7b7f-4cd1-a291-7d782b1422d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:49.959358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a6203-7b7f-4cd1-a291-7d782b1422d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:49.959636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a6203-7b7f-4cd1-a291-7d782b1422d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:50.032310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a6203-7b7f-4cd1-a291-7d782b1422d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:50.046575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:50.048667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:50.050485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a6203-7b7f-4cd1-a291-7d782b1422d4 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:50.084196 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3223/6476] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:50.084677 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3254/6477] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:52.781219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:52.783254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:52.810758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dd04a-b59e-4c82-8f17-b1ea1fc7abc6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:52.829801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:52.830744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:52.834304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:52.834926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] PATH_INFO: `/v3/projects/42ac42f61e14454baff6047e5b69184e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:52.842123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ac42f61e14454baff6047e5b69184e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:52.845667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:53.007206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ac42f61e14454baff6047e5b69184e', 'request_id': 'req-08fded0c-91fb-4acf-ad1d-2abfb65323e5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:53.019328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ac42f61e14454baff6047e5b69184e', 'request_id': 'req-08fded0c-91fb-4acf-ad1d-2abfb65323e5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:53.029612 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:53.034052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ac42f61e14454baff6047e5b69184e', 'request_id': 'req-08fded0c-91fb-4acf-ad1d-2abfb65323e5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:53.078068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] The token cache is being invalidate because project 42ac42f61e14454baff6047e5b69184e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:13:53.078765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:53.079810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-08fded0c-91fb-4acf-ad1d-2abfb65323e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:13:53.099097 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3224/6478] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:13:52 2022] DELETE /identity/v3/projects/42ac42f61e14454baff6047e5b69184e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:53.105390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561507e8-1e49-4214-995f-337da09b7718 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:53.105912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561507e8-1e49-4214-995f-337da09b7718 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:53.106001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561507e8-1e49-4214-995f-337da09b7718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:53.161725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-561507e8-1e49-4214-995f-337da09b7718 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:53.165205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-561507e8-1e49-4214-995f-337da09b7718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:53.181132 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:53.359335 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3255/6479] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:53.367624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc02a0-3625-4f6c-9066-9a516298162a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:53.367915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc02a0-3625-4f6c-9066-9a516298162a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:53.368202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc02a0-3625-4f6c-9066-9a516298162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:53.415979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-64dc02a0-3625-4f6c-9066-9a516298162a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:53.417519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-64dc02a0-3625-4f6c-9066-9a516298162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:53.438520 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3225/6480] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:53.442984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561507e8-1e49-4214-995f-337da09b7718 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:53.455585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561507e8-1e49-4214-995f-337da09b7718 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:53.472395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a5289-4cd6-4fdc-9721-cde52dddbea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:53.473734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a5289-4cd6-4fdc-9721-cde52dddbea3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:53.474025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a5289-4cd6-4fdc-9721-cde52dddbea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:53.474305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a5289-4cd6-4fdc-9721-cde52dddbea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:53.474964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a5289-4cd6-4fdc-9721-cde52dddbea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:13:53.475271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a5289-4cd6-4fdc-9721-cde52dddbea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:53.476909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a5289-4cd6-4fdc-9721-cde52dddbea3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:53.523730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc02a0-3625-4f6c-9066-9a516298162a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:53.526100 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3256/6481] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:13:53.540282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc02a0-3625-4f6c-9066-9a516298162a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:53.556989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa7047-3d06-4db6-a378-d737948e0369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:53.557627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa7047-3d06-4db6-a378-d737948e0369 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:53.557909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa7047-3d06-4db6-a378-d737948e0369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:53.558186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa7047-3d06-4db6-a378-d737948e0369 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:53.558830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa7047-3d06-4db6-a378-d737948e0369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:53.560789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa7047-3d06-4db6-a378-d737948e0369 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:53.629055 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3226/6482] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:13:53 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:53.629944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a5289-4cd6-4fdc-9721-cde52dddbea3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:53.642865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a5289-4cd6-4fdc-9721-cde52dddbea3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:53.751503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46dbe9-4394-4418-8fe8-9313dd7b5606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:53.752538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46dbe9-4394-4418-8fe8-9313dd7b5606 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:53.752862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46dbe9-4394-4418-8fe8-9313dd7b5606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:53.753142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46dbe9-4394-4418-8fe8-9313dd7b5606 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:53.754533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46dbe9-4394-4418-8fe8-9313dd7b5606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:53.760309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46dbe9-4394-4418-8fe8-9313dd7b5606 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:53.791127 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3257/6483] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:13:53 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:13:53.793554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa7047-3d06-4db6-a378-d737948e0369 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:53.811003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa7047-3d06-4db6-a378-d737948e0369 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:53.820163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9de1c-9dbd-4371-a21e-067e867d3f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:53.821707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9de1c-9dbd-4371-a21e-067e867d3f60 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:53.822213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9de1c-9dbd-4371-a21e-067e867d3f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:53.823271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9de1c-9dbd-4371-a21e-067e867d3f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:53.824198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9de1c-9dbd-4371-a21e-067e867d3f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:53.826194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9de1c-9dbd-4371-a21e-067e867d3f60 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:53.852943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46dbe9-4394-4418-8fe8-9313dd7b5606 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:53.866446 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3227/6484] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:53.869295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46dbe9-4394-4418-8fe8-9313dd7b5606 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:53.876398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aae6dc-0862-4432-b9bf-d25bf98496f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:53.880358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae6dc-0862-4432-b9bf-d25bf98496f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:53.881272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae6dc-0862-4432-b9bf-d25bf98496f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:53.881724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae6dc-0862-4432-b9bf-d25bf98496f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:53.882967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aae6dc-0862-4432-b9bf-d25bf98496f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:53.885545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aae6dc-0862-4432-b9bf-d25bf98496f8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:53.906464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9de1c-9dbd-4371-a21e-067e867d3f60 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:53.919285 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3258/6485] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:13:53.922443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9de1c-9dbd-4371-a21e-067e867d3f60 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:53.931402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccdc36-0309-40cc-9803-3d0f86fb0ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:53.932752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccdc36-0309-40cc-9803-3d0f86fb0ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:53.933200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccdc36-0309-40cc-9803-3d0f86fb0ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:53.933705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccdc36-0309-40cc-9803-3d0f86fb0ee2 admin admin] PATH_INFO: `/v3/projects/54186be99e5e4aa081e9590502c94d6e/users/5cf389c638874a17993ad45ed6349481/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:53.959141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccdc36-0309-40cc-9803-3d0f86fb0ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54186be99e5e4aa081e9590502c94d6e, user_id=5cf389c638874a17993ad45ed6349481, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:53.962247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccdc36-0309-40cc-9803-3d0f86fb0ee2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:53.996086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734afe73-33cb-46d0-b0ad-08162b4a6a8c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:53.996375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734afe73-33cb-46d0-b0ad-08162b4a6a8c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:53.996762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734afe73-33cb-46d0-b0ad-08162b4a6a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:53.999404 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3228/6486] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:13:53 2022] PUT /identity/v3/projects/54186be99e5e4aa081e9590502c94d6e/users/5cf389c638874a17993ad45ed6349481/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:13:54.113848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-734afe73-33cb-46d0-b0ad-08162b4a6a8c None None] MFA Rules not processed for user `5cf389c638874a17993ad45ed6349481`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:54.115398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-734afe73-33cb-46d0-b0ad-08162b4a6a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:54.353961 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3259/6487] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:54.355014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccdc36-0309-40cc-9803-3d0f86fb0ee2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:54.356928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0cccdc36-0309-40cc-9803-3d0f86fb0ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:54.513587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccdc36-0309-40cc-9803-3d0f86fb0ee2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:54.522061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22bd1c-353b-40f4-ae58-6fcc98ab8966 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:54.523096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22bd1c-353b-40f4-ae58-6fcc98ab8966 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:54.523435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22bd1c-353b-40f4-ae58-6fcc98ab8966 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:54.526019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22bd1c-353b-40f4-ae58-6fcc98ab8966 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:54.541629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22bd1c-353b-40f4-ae58-6fcc98ab8966 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:54.543367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22bd1c-353b-40f4-ae58-6fcc98ab8966 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:54.572989 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3229/6488] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:13:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:13:54.897761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148ffe8-2674-47bd-a263-a856da606557 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:54.898032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148ffe8-2674-47bd-a263-a856da606557 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:54.898407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148ffe8-2674-47bd-a263-a856da606557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:54.924794 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:54.999138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4148ffe8-2674-47bd-a263-a856da606557 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:55.008760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4148ffe8-2674-47bd-a263-a856da606557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:55.405490 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3260/6489] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:13:55.526917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22bd1c-353b-40f4-ae58-6fcc98ab8966 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:55.529141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd22bd1c-353b-40f4-ae58-6fcc98ab8966 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:55.790137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22bd1c-353b-40f4-ae58-6fcc98ab8966 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:55.795747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15752720-63ea-4788-88ab-9d0c5a0ae536 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:55.796461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15752720-63ea-4788-88ab-9d0c5a0ae536 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:55.796786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15752720-63ea-4788-88ab-9d0c5a0ae536 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:55.797065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15752720-63ea-4788-88ab-9d0c5a0ae536 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:55.838458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15752720-63ea-4788-88ab-9d0c5a0ae536 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:55.850845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15752720-63ea-4788-88ab-9d0c5a0ae536 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:55.865029 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3230/6490] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:13:56.551949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5464025-6a74-4899-b17d-123eb9733c43 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:56.552459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5464025-6a74-4899-b17d-123eb9733c43 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:56.552546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5464025-6a74-4899-b17d-123eb9733c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:56.581259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b5464025-6a74-4899-b17d-123eb9733c43 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:56.583410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b5464025-6a74-4899-b17d-123eb9733c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:56.593725 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3261/6491] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:13:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:56.606348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15752720-63ea-4788-88ab-9d0c5a0ae536 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:56.634537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15752720-63ea-4788-88ab-9d0c5a0ae536 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:56.651998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a0502-7e63-407f-beeb-8b90d74a1bd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:56.652838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a0502-7e63-407f-beeb-8b90d74a1bd9 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:56.653128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a0502-7e63-407f-beeb-8b90d74a1bd9 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:56.653410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a0502-7e63-407f-beeb-8b90d74a1bd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:56.669683 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:56.674476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a0502-7e63-407f-beeb-8b90d74a1bd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:56.681221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a0502-7e63-407f-beeb-8b90d74a1bd9 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:56.713986 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3231/6492] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:13:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:13:57.930172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03ece6-5de3-4bd7-8ab8-92ed09cabf81 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:57.930715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03ece6-5de3-4bd7-8ab8-92ed09cabf81 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:57.931135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03ece6-5de3-4bd7-8ab8-92ed09cabf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:58.020654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9c03ece6-5de3-4bd7-8ab8-92ed09cabf81 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:58.031249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9c03ece6-5de3-4bd7-8ab8-92ed09cabf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:58.112042 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3262/6493] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:58.127829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a0502-7e63-407f-beeb-8b90d74a1bd9 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:58.153754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a0502-7e63-407f-beeb-8b90d74a1bd9 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:58.167423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820a062-ea47-468e-8599-9d7c66e1555a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:58.168061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820a062-ea47-468e-8599-9d7c66e1555a service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:58.168343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820a062-ea47-468e-8599-9d7c66e1555a service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:58.168648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820a062-ea47-468e-8599-9d7c66e1555a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:58.212972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820a062-ea47-468e-8599-9d7c66e1555a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:58.220774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820a062-ea47-468e-8599-9d7c66e1555a service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:58.262461 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3232/6494] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:13:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:13:58.640612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f6db-3663-4214-b0ba-cdf04b5fd1c0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:58.641585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f6db-3663-4214-b0ba-cdf04b5fd1c0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:58.641994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f6db-3663-4214-b0ba-cdf04b5fd1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:58.677365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d193f6db-3663-4214-b0ba-cdf04b5fd1c0 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:58.682720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d193f6db-3663-4214-b0ba-cdf04b5fd1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:58.701261 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3263/6495] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:58.714507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820a062-ea47-468e-8599-9d7c66e1555a service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:58.737028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820a062-ea47-468e-8599-9d7c66e1555a service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:58.758843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c4b86-9d90-4111-ac01-17fb9adc6126 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:58.759940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c4b86-9d90-4111-ac01-17fb9adc6126 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:58.761834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c4b86-9d90-4111-ac01-17fb9adc6126 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:58.762839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c4b86-9d90-4111-ac01-17fb9adc6126 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:58.795184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c4b86-9d90-4111-ac01-17fb9adc6126 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:58.816875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c4b86-9d90-4111-ac01-17fb9adc6126 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:58.848307 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3233/6496] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:13:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:13:59.730713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6938f-9bd6-4c4f-8f91-6727abcaff98 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:59.731238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6938f-9bd6-4c4f-8f91-6727abcaff98 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:59.731238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6938f-9bd6-4c4f-8f91-6727abcaff98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:59.785983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-14e6938f-9bd6-4c4f-8f91-6727abcaff98 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:13:59.790148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-14e6938f-9bd6-4c4f-8f91-6727abcaff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:59.822584 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3264/6497] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:13:59.824055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c4b86-9d90-4111-ac01-17fb9adc6126 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:59.865704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c4b86-9d90-4111-ac01-17fb9adc6126 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:13:59.903793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826adb19-7387-486a-a650-d951111aa868 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:13:59.905173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6938f-9bd6-4c4f-8f91-6727abcaff98 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:13:59.905314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826adb19-7387-486a-a650-d951111aa868 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:59.905634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826adb19-7387-486a-a650-d951111aa868 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:59.906247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826adb19-7387-486a-a650-d951111aa868 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:13:59.907056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-14e6938f-9bd6-4c4f-8f91-6727abcaff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:13:59.930701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826adb19-7387-486a-a650-d951111aa868 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:13:59.935338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826adb19-7387-486a-a650-d951111aa868 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:13:59.961369 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3234/6498] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:13:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:13:59.965412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ca5c-64be-41fd-ae7b-65e64ef2b815 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:13:59.965624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ca5c-64be-41fd-ae7b-65e64ef2b815 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:13:59.968521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ca5c-64be-41fd-ae7b-65e64ef2b815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:00.061719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1147ca5c-64be-41fd-ae7b-65e64ef2b815 None None] MFA Rules not processed for user `48bf307208d64c8597d11947ff951cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:00.063534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1147ca5c-64be-41fd-ae7b-65e64ef2b815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:00.182959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6938f-9bd6-4c4f-8f91-6727abcaff98 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:00.197664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:00.198330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:00.198704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:00.198989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] PATH_INFO: `/v3/users/b0eefeab267e4de3b4f923e56830a7a7` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:00.200935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0eefeab267e4de3b4f923e56830a7a7)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:00.206897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:00.295192 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3235/6499] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:00.308966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ca5c-64be-41fd-ae7b-65e64ef2b815 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:00.311499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1147ca5c-64be-41fd-ae7b-65e64ef2b815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:00.356870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0eefeab267e4de3b4f923e56830a7a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:00.379683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0eefeab267e4de3b4f923e56830a7a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:00.394520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0eefeab267e4de3b4f923e56830a7a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:00.406450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0eefeab267e4de3b4f923e56830a7a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:00.407358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-65750b78-f32c-4e71-829d-adb9a12ac08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0eefeab267e4de3b4f923e56830a7a7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:00.415262 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:00.417279 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3265/6500] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:13:59 2022] DELETE /identity/v3/users/b0eefeab267e4de3b4f923e56830a7a7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:00.428235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593849e2-adaa-4eb1-8c81-174df24cedeb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:00.429452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593849e2-adaa-4eb1-8c81-174df24cedeb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:00.430148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593849e2-adaa-4eb1-8c81-174df24cedeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:00.526553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ca5c-64be-41fd-ae7b-65e64ef2b815 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:00.644396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-593849e2-adaa-4eb1-8c81-174df24cedeb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:00.645628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-593849e2-adaa-4eb1-8c81-174df24cedeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:00.693704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:00.694699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:00.695133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:00.695679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:00.708871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:00.723392 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3266/6501] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:00.724868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ee36-dfde-4c0e-ab8b-2e954c8b06ee None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:00.725154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ee36-dfde-4c0e-ab8b-2e954c8b06ee None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:00.725431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ee36-dfde-4c0e-ab8b-2e954c8b06ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:00.751561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1ef3ee36-dfde-4c0e-ab8b-2e954c8b06ee None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:00.753911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1ef3ee36-dfde-4c0e-ab8b-2e954c8b06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:00.757096 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:00.890420 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3267/6502] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:00.893293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ee36-dfde-4c0e-ab8b-2e954c8b06ee None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:00.904683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1ef3ee36-dfde-4c0e-ab8b-2e954c8b06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:00.907824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:00.909670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:00.971470 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3236/6503] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:00.976856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:00.991960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:01.141895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ee36-dfde-4c0e-ab8b-2e954c8b06ee None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:01.152578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798033-895b-4b48-bcb8-f74051f75e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:01.153245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798033-895b-4b48-bcb8-f74051f75e57 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:01.153528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798033-895b-4b48-bcb8-f74051f75e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:01.153810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798033-895b-4b48-bcb8-f74051f75e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:01.208515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65928c79-5e2a-4f0a-b4e7-00419db36f6a service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:01.208662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc798033-895b-4b48-bcb8-f74051f75e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:01.208662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc798033-895b-4b48-bcb8-f74051f75e57 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:01.225412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974021d-2b3c-4023-ab7a-dd336ab0cc81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:01.225995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974021d-2b3c-4023-ab7a-dd336ab0cc81 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:01.226279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974021d-2b3c-4023-ab7a-dd336ab0cc81 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:01.226550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974021d-2b3c-4023-ab7a-dd336ab0cc81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:01.239361 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3268/6504] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:01.274024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974021d-2b3c-4023-ab7a-dd336ab0cc81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:01.278317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974021d-2b3c-4023-ab7a-dd336ab0cc81 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:01.297884 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3237/6505] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:01.436608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798033-895b-4b48-bcb8-f74051f75e57 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:01.438223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cc798033-895b-4b48-bcb8-f74051f75e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:01.598707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974021d-2b3c-4023-ab7a-dd336ab0cc81 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:01.599889 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:01.600488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f974021d-2b3c-4023-ab7a-dd336ab0cc81 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:01.642028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974021d-2b3c-4023-ab7a-dd336ab0cc81 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:01.675814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:01.676323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:01.676611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:01.676913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] PATH_INFO: `/v3/users/5cf389c638874a17993ad45ed6349481` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:01.678764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf389c638874a17993ad45ed6349481)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:01.686272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:01.740484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798033-895b-4b48-bcb8-f74051f75e57 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:01.775995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd5229-d883-4fdb-8343-e1133388b7de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:01.776710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd5229-d883-4fdb-8343-e1133388b7de service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:01.776974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd5229-d883-4fdb-8343-e1133388b7de service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:01.777336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd5229-d883-4fdb-8343-e1133388b7de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:01.786630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e6fd5229-d883-4fdb-8343-e1133388b7de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:01.885426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf389c638874a17993ad45ed6349481'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:01.931641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf389c638874a17993ad45ed6349481'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:01.959204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf389c638874a17993ad45ed6349481'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:01.988655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf389c638874a17993ad45ed6349481'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:01.992293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5165f6ba-b53c-4447-9fef-cc1b5fb544c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf389c638874a17993ad45ed6349481'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:02.032173 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3238/6506] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:14:01 2022] DELETE /identity/v3/users/5cf389c638874a17993ad45ed6349481 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:02.043250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc6607-c18e-47eb-b6b4-2b912d543685 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:02.043542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc6607-c18e-47eb-b6b4-2b912d543685 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:02.059573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc6607-c18e-47eb-b6b4-2b912d543685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:02.098625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd5229-d883-4fdb-8343-e1133388b7de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:02.100250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd5229-d883-4fdb-8343-e1133388b7de service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:02.126831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6ebc6607-c18e-47eb-b6b4-2b912d543685 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:02.128189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6ebc6607-c18e-47eb-b6b4-2b912d543685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:02.131733 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3269/6507] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:02.156600 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:02.287155 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3239/6508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:02.326791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd5229-d883-4fdb-8343-e1133388b7de service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:02.353826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd5229-d883-4fdb-8343-e1133388b7de service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:02.498022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bfc4c-015b-47b4-bc9f-f037407dbc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:02.498891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bfc4c-015b-47b4-bc9f-f037407dbc48 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:02.499325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bfc4c-015b-47b4-bc9f-f037407dbc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:02.499745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bfc4c-015b-47b4-bc9f-f037407dbc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:02.521348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bfc4c-015b-47b4-bc9f-f037407dbc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:02.523170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bfc4c-015b-47b4-bc9f-f037407dbc48 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:02.551915 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3270/6509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:03.413446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc6607-c18e-47eb-b6b4-2b912d543685 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:03.415096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6ebc6607-c18e-47eb-b6b4-2b912d543685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:03.466718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc6607-c18e-47eb-b6b4-2b912d543685 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:03.494577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:03.496651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:03.497066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:03.501379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] PATH_INFO: `/v3/projects/54186be99e5e4aa081e9590502c94d6e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:03.506557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54186be99e5e4aa081e9590502c94d6e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:03.509130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:03.646464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54186be99e5e4aa081e9590502c94d6e', 'request_id': 'req-1b08b90c-505e-47fb-947e-0952ea6e9295'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:03.667501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54186be99e5e4aa081e9590502c94d6e', 'request_id': 'req-1b08b90c-505e-47fb-947e-0952ea6e9295'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:03.674636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bfc4c-015b-47b4-bc9f-f037407dbc48 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:03.677164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d3bfc4c-015b-47b4-bc9f-f037407dbc48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:03.684825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54186be99e5e4aa081e9590502c94d6e', 'request_id': 'req-1b08b90c-505e-47fb-947e-0952ea6e9295'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:03.706835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bfc4c-015b-47b4-bc9f-f037407dbc48 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:03.711612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] The token cache is being invalidate because project 54186be99e5e4aa081e9590502c94d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:14:03.712607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:03.716314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1b08b90c-505e-47fb-947e-0952ea6e9295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:03.727864 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3240/6510] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:14:03 2022] DELETE /identity/v3/projects/54186be99e5e4aa081e9590502c94d6e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:03.734436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d33262-3fd9-45b4-be2a-d00a4cb459ae None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:03.734755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d33262-3fd9-45b4-be2a-d00a4cb459ae None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:03.735040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d33262-3fd9-45b4-be2a-d00a4cb459ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:03.796466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f0d33262-3fd9-45b4-be2a-d00a4cb459ae None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:03.797919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f0d33262-3fd9-45b4-be2a-d00a4cb459ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:03.836059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:03.836982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:03.837417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:03.837844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] PATH_INFO: `/v3/projects/1ecddf040c5c40679e560fcc57c1967c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:03.841197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecddf040c5c40679e560fcc57c1967c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:03.843322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:03.926912 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:03.986265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecddf040c5c40679e560fcc57c1967c', 'request_id': 'req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:03.999932 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3241/6511] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:04.006165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f23bb2-e1d8-4c95-bf70-39adfb7ad3d4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:04.006504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f23bb2-e1d8-4c95-bf70-39adfb7ad3d4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:04.006739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f23bb2-e1d8-4c95-bf70-39adfb7ad3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:04.013533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecddf040c5c40679e560fcc57c1967c', 'request_id': 'req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:04.031421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecddf040c5c40679e560fcc57c1967c', 'request_id': 'req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:04.077866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] The token cache is being invalidate because project 1ecddf040c5c40679e560fcc57c1967c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:14:04.078120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:04.079262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e2f23bb2-e1d8-4c95-bf70-39adfb7ad3d4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:04.080525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e2f23bb2-e1d8-4c95-bf70-39adfb7ad3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:04.084855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad8b7991-d07c-4e9d-ad39-9d255ab16e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:04.093785 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3271/6512] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:14:03 2022] DELETE /identity/v3/projects/1ecddf040c5c40679e560fcc57c1967c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:14:04.099158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36cf38-f280-4b1b-abcc-7d29f2a365dc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:04.099681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36cf38-f280-4b1b-abcc-7d29f2a365dc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:04.100108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36cf38-f280-4b1b-abcc-7d29f2a365dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:04.204133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ae36cf38-f280-4b1b-abcc-7d29f2a365dc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:04.207110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae36cf38-f280-4b1b-abcc-7d29f2a365dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:04.236656 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:04.343714 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3242/6513] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:04.352009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f23bb2-e1d8-4c95-bf70-39adfb7ad3d4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:04.383827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f23bb2-e1d8-4c95-bf70-39adfb7ad3d4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:04.408086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b602282-d023-4d73-a2b9-bffb6e6e6a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:04.409007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b602282-d023-4d73-a2b9-bffb6e6e6a10 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:04.409992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b602282-d023-4d73-a2b9-bffb6e6e6a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:04.410421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b602282-d023-4d73-a2b9-bffb6e6e6a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:04.411230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b602282-d023-4d73-a2b9-bffb6e6e6a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:14:04.411712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b602282-d023-4d73-a2b9-bffb6e6e6a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:04.416565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b602282-d023-4d73-a2b9-bffb6e6e6a10 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:04.429715 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3272/6514] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:04.437447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c16b-e191-419b-8dff-77c1119fb6b1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:04.439048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c16b-e191-419b-8dff-77c1119fb6b1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:04.439657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c16b-e191-419b-8dff-77c1119fb6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:04.456352 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3243/6515] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:14:04.461617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b602282-d023-4d73-a2b9-bffb6e6e6a10 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:04.476637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fa03c16b-e191-419b-8dff-77c1119fb6b1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:04.478100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fa03c16b-e191-419b-8dff-77c1119fb6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:04.490850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b602282-d023-4d73-a2b9-bffb6e6e6a10 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:04.492067 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3273/6516] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:04.495151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03c16b-e191-419b-8dff-77c1119fb6b1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:04.511752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03c16b-e191-419b-8dff-77c1119fb6b1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:04.514648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6254c-28f8-4cb2-a59d-f01be20aa833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:04.515278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6254c-28f8-4cb2-a59d-f01be20aa833 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:04.515556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6254c-28f8-4cb2-a59d-f01be20aa833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:04.515847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6254c-28f8-4cb2-a59d-f01be20aa833 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:04.516474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6254c-28f8-4cb2-a59d-f01be20aa833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:04.517549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d393df-29ab-4350-8af2-5b076888521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:04.518257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d393df-29ab-4350-8af2-5b076888521e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:04.518779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6254c-28f8-4cb2-a59d-f01be20aa833 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:04.519029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d393df-29ab-4350-8af2-5b076888521e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:04.519029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d393df-29ab-4350-8af2-5b076888521e admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:04.520246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d393df-29ab-4350-8af2-5b076888521e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:14:04.520246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d393df-29ab-4350-8af2-5b076888521e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:04.522019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d393df-29ab-4350-8af2-5b076888521e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:04.538742 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3274/6517] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:14:04.544701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d393df-29ab-4350-8af2-5b076888521e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:04.570644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d393df-29ab-4350-8af2-5b076888521e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:04.582810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f1b13-d5c0-4982-b9c7-9b7b707e98db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:04.583807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1b13-d5c0-4982-b9c7-9b7b707e98db admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:04.584138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1b13-d5c0-4982-b9c7-9b7b707e98db admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:04.584631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1b13-d5c0-4982-b9c7-9b7b707e98db admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:04.587706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f1b13-d5c0-4982-b9c7-9b7b707e98db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:04.593716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f1b13-d5c0-4982-b9c7-9b7b707e98db admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:04.657391 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3275/6518] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:14:04 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:04.662173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f1b13-d5c0-4982-b9c7-9b7b707e98db admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:04.663044 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3244/6519] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:14:04 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:04.667014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6254c-28f8-4cb2-a59d-f01be20aa833 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:04.875585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6254c-28f8-4cb2-a59d-f01be20aa833 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:04.877914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f1b13-d5c0-4982-b9c7-9b7b707e98db admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:04.883581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4fce6-88b2-4f9f-bd17-bb5a8be621cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:04.884473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4fce6-88b2-4f9f-bd17-bb5a8be621cb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:04.884940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4fce6-88b2-4f9f-bd17-bb5a8be621cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:04.885433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4fce6-88b2-4f9f-bd17-bb5a8be621cb admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:04.886090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4fce6-88b2-4f9f-bd17-bb5a8be621cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:04.888241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4fce6-88b2-4f9f-bd17-bb5a8be621cb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:04.900312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d1501-5a9e-44f3-b924-cb9703fde01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:04.926529 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:04.930806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d1501-5a9e-44f3-b924-cb9703fde01c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:04.943436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d1501-5a9e-44f3-b924-cb9703fde01c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:04.943436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d1501-5a9e-44f3-b924-cb9703fde01c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:04.950228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d1501-5a9e-44f3-b924-cb9703fde01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:04.953943 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3276/6520] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:14:04 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:04.955024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4fce6-88b2-4f9f-bd17-bb5a8be621cb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:04.968469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2ee4fce6-88b2-4f9f-bd17-bb5a8be621cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:04.974350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d1501-5a9e-44f3-b924-cb9703fde01c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:05.023243 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3245/6521] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:14:04 2022] POST /identity/v3/users => generated 286 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:14:05.024758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d1501-5a9e-44f3-b924-cb9703fde01c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:05.039949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d1501-5a9e-44f3-b924-cb9703fde01c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:05.046745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb30d3c-e8c0-4504-9f5b-61540de2ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:05.047817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb30d3c-e8c0-4504-9f5b-61540de2ff2c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.061766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb30d3c-e8c0-4504-9f5b-61540de2ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.062972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb30d3c-e8c0-4504-9f5b-61540de2ff2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.064870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb30d3c-e8c0-4504-9f5b-61540de2ff2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:05.069749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb30d3c-e8c0-4504-9f5b-61540de2ff2c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:05.098928 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3246/6522] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:05.099938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb30d3c-e8c0-4504-9f5b-61540de2ff2c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:05.112858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb30d3c-e8c0-4504-9f5b-61540de2ff2c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:05.136355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4fce6-88b2-4f9f-bd17-bb5a8be621cb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:05.140927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c64f4-1a29-4eca-b961-142699cbf54b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:05.141632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c64f4-1a29-4eca-b961-142699cbf54b service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.141843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c64f4-1a29-4eca-b961-142699cbf54b service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.142114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c64f4-1a29-4eca-b961-142699cbf54b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.145035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c62c64f4-1a29-4eca-b961-142699cbf54b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:05.145175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370f38-1e7f-4dcd-9f8a-b674da26e3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:05.146792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370f38-1e7f-4dcd-9f8a-b674da26e3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.147999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370f38-1e7f-4dcd-9f8a-b674da26e3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.149297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370f38-1e7f-4dcd-9f8a-b674da26e3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.150156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04370f38-1e7f-4dcd-9f8a-b674da26e3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:05.153072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04370f38-1e7f-4dcd-9f8a-b674da26e3b5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:05.178622 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3247/6523] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:05.181526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370f38-1e7f-4dcd-9f8a-b674da26e3b5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:05.184083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-04370f38-1e7f-4dcd-9f8a-b674da26e3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:05.356434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c64f4-1a29-4eca-b961-142699cbf54b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:05.359306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c64f4-1a29-4eca-b961-142699cbf54b service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:05.369796 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:05.393824 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3277/6524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:05.395226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c64f4-1a29-4eca-b961-142699cbf54b service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:05.402747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370f38-1e7f-4dcd-9f8a-b674da26e3b5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:05.431693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c64f4-1a29-4eca-b961-142699cbf54b service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:05.436520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa34fc8-ef1a-45d8-9c3e-dc550b2134b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:05.437571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa34fc8-ef1a-45d8-9c3e-dc550b2134b2 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.437947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa34fc8-ef1a-45d8-9c3e-dc550b2134b2 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.438229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa34fc8-ef1a-45d8-9c3e-dc550b2134b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.443489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5aa34fc8-ef1a-45d8-9c3e-dc550b2134b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:05.447127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd005c-fc1e-49b2-be9d-2bf9c9d8f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:05.447763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd005c-fc1e-49b2-be9d-2bf9c9d8f946 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.448043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd005c-fc1e-49b2-be9d-2bf9c9d8f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.448317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd005c-fc1e-49b2-be9d-2bf9c9d8f946 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.450623 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd005c-fc1e-49b2-be9d-2bf9c9d8f946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:05.454092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd005c-fc1e-49b2-be9d-2bf9c9d8f946 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:05.489407 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3278/6525] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:05.490771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd005c-fc1e-49b2-be9d-2bf9c9d8f946 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:05.520273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd005c-fc1e-49b2-be9d-2bf9c9d8f946 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:05.538720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37c295-4dcd-4dff-a6fd-15ad5c74d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:05.539377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37c295-4dcd-4dff-a6fd-15ad5c74d818 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.539655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37c295-4dcd-4dff-a6fd-15ad5c74d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.540032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37c295-4dcd-4dff-a6fd-15ad5c74d818 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.540702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37c295-4dcd-4dff-a6fd-15ad5c74d818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:05.548036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37c295-4dcd-4dff-a6fd-15ad5c74d818 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:05.556519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa34fc8-ef1a-45d8-9c3e-dc550b2134b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:05.558355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa34fc8-ef1a-45d8-9c3e-dc550b2134b2 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:05.583181 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3279/6526] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:05.584017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37c295-4dcd-4dff-a6fd-15ad5c74d818 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:05.596693 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3248/6527] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:05.603674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa34fc8-ef1a-45d8-9c3e-dc550b2134b2 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:05.604547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37c295-4dcd-4dff-a6fd-15ad5c74d818 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:05.619406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1498c-98a7-4005-a1c8-6b0009e5f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:05.621450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1498c-98a7-4005-a1c8-6b0009e5f7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.621679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1498c-98a7-4005-a1c8-6b0009e5f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.623902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1498c-98a7-4005-a1c8-6b0009e5f7ff admin admin] PATH_INFO: `/v3/projects/cfdbf53a23b146f295309ddba63f7982/users/649c677e8fdb4773ad6fd30653871cd4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.643518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa34fc8-ef1a-45d8-9c3e-dc550b2134b2 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:05.661014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147c273-d51e-4964-87c7-6e2649f639f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:05.661679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c273-d51e-4964-87c7-6e2649f639f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.663569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c273-d51e-4964-87c7-6e2649f639f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.663871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c273-d51e-4964-87c7-6e2649f639f4 admin admin] PATH_INFO: `/v3/projects/eca50c3f612f42f4b860eff168d5b6db/users/2daa4c19dcdb4e179d6d204eb455a753/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.683588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1498c-98a7-4005-a1c8-6b0009e5f7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdbf53a23b146f295309ddba63f7982, user_id=649c677e8fdb4773ad6fd30653871cd4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:05.686366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1498c-98a7-4005-a1c8-6b0009e5f7ff admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:05.697241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147c273-d51e-4964-87c7-6e2649f639f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca50c3f612f42f4b860eff168d5b6db, user_id=2daa4c19dcdb4e179d6d204eb455a753, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:05.704483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147c273-d51e-4964-87c7-6e2649f639f4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:05.715125 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3280/6528] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:05 2022] PUT /identity/v3/projects/cfdbf53a23b146f295309ddba63f7982/users/649c677e8fdb4773ad6fd30653871cd4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:05.728947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a19871-b94f-427b-8988-7c55826feaf9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.730682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a19871-b94f-427b-8988-7c55826feaf9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.731305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a19871-b94f-427b-8988-7c55826feaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.744744 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3249/6529] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:05 2022] PUT /identity/v3/projects/eca50c3f612f42f4b860eff168d5b6db/users/2daa4c19dcdb4e179d6d204eb455a753/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:05.754287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1188f91-bb8a-4bea-b09d-3c917e0a7735 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:05.754780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1188f91-bb8a-4bea-b09d-3c917e0a7735 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:05.755125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1188f91-bb8a-4bea-b09d-3c917e0a7735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:05.823314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-22a19871-b94f-427b-8988-7c55826feaf9 None None] MFA Rules not processed for user `649c677e8fdb4773ad6fd30653871cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:05.824554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-22a19871-b94f-427b-8988-7c55826feaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:05.834869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f1188f91-bb8a-4bea-b09d-3c917e0a7735 None None] MFA Rules not processed for user `2daa4c19dcdb4e179d6d204eb455a753`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:05.836172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f1188f91-bb8a-4bea-b09d-3c917e0a7735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:05.916024 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:05.993600 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3281/6530] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:06.005700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a19871-b94f-427b-8988-7c55826feaf9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:06.008774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-22a19871-b94f-427b-8988-7c55826feaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:06.070087 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3250/6531] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:06.071096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1188f91-bb8a-4bea-b09d-3c917e0a7735 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:06.077469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f1188f91-bb8a-4bea-b09d-3c917e0a7735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:06.182964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a19871-b94f-427b-8988-7c55826feaf9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:06.194350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ba9bd-51a9-4ad2-8a5f-889fd9328bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:06.195359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ba9bd-51a9-4ad2-8a5f-889fd9328bcd service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:06.195614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ba9bd-51a9-4ad2-8a5f-889fd9328bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:06.195987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ba9bd-51a9-4ad2-8a5f-889fd9328bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:06.247703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ba9bd-51a9-4ad2-8a5f-889fd9328bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:06.249299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ba9bd-51a9-4ad2-8a5f-889fd9328bcd service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:06.272542 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3282/6532] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:14:06.300750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1188f91-bb8a-4bea-b09d-3c917e0a7735 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:06.313373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ba9bd-51a9-4ad2-8a5f-889fd9328bcd service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:06.320999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e11448-dda5-4f5b-9481-f6b848bf760e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:06.321645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11448-dda5-4f5b-9481-f6b848bf760e service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:06.321928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11448-dda5-4f5b-9481-f6b848bf760e service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:06.322212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11448-dda5-4f5b-9481-f6b848bf760e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:06.376839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e11448-dda5-4f5b-9481-f6b848bf760e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:06.379775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e11448-dda5-4f5b-9481-f6b848bf760e service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:06.424355 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3251/6533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:06.572333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ba9bd-51a9-4ad2-8a5f-889fd9328bcd service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:06.587957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:06.592816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:06.594028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:06.595315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] PATH_INFO: `/v3/users/649c677e8fdb4773ad6fd30653871cd4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:06.614094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] RBAC: Authorizing `identity:delete_user(user_id=649c677e8fdb4773ad6fd30653871cd4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:06.619273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:06.804180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649c677e8fdb4773ad6fd30653871cd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:06.840501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2801e-798a-4c05-900c-0cce6a9c73cb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:06.841743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2801e-798a-4c05-900c-0cce6a9c73cb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:06.842352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2801e-798a-4c05-900c-0cce6a9c73cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:06.844215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649c677e8fdb4773ad6fd30653871cd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:06.867942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649c677e8fdb4773ad6fd30653871cd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:06.910833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649c677e8fdb4773ad6fd30653871cd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:06.912048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-90c2a8e4-ed99-4816-88b0-acc38171ddad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649c677e8fdb4773ad6fd30653871cd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:06.928442 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3283/6534] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:14:06 2022] DELETE /identity/v3/users/649c677e8fdb4773ad6fd30653871cd4 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:14:06.933368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159b47-3550-4650-8ba7-2110657a7245 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:06.933659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159b47-3550-4650-8ba7-2110657a7245 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:06.933940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159b47-3550-4650-8ba7-2110657a7245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:06.935192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-66e2801e-798a-4c05-900c-0cce6a9c73cb None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:06.937443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-66e2801e-798a-4c05-900c-0cce6a9c73cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:06.963867 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:06.968486 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:06.982249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-59159b47-3550-4650-8ba7-2110657a7245 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:06.985146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-59159b47-3550-4650-8ba7-2110657a7245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:07.244211 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3252/6535] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:07.261572 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3284/6536] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:07.265693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2801e-798a-4c05-900c-0cce6a9c73cb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:07.267612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-66e2801e-798a-4c05-900c-0cce6a9c73cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:07.274882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159b47-3550-4650-8ba7-2110657a7245 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:07.279331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-59159b47-3550-4650-8ba7-2110657a7245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:07.498043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159b47-3550-4650-8ba7-2110657a7245 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:07.507864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e1746-74bf-4afb-8dd3-ccb4f5629c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:07.509818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e1746-74bf-4afb-8dd3-ccb4f5629c5b service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:07.509818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e1746-74bf-4afb-8dd3-ccb4f5629c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:07.509818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e1746-74bf-4afb-8dd3-ccb4f5629c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:07.535397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2801e-798a-4c05-900c-0cce6a9c73cb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:07.551089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076ee98-a464-4197-b2bc-184f47b11d26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:07.552652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076ee98-a464-4197-b2bc-184f47b11d26 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:07.553240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076ee98-a464-4197-b2bc-184f47b11d26 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:07.553425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076ee98-a464-4197-b2bc-184f47b11d26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:07.560838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e1746-74bf-4afb-8dd3-ccb4f5629c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:07.562544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e1746-74bf-4afb-8dd3-ccb4f5629c5b service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:07.576031 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3285/6537] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:07.577910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076ee98-a464-4197-b2bc-184f47b11d26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:07.579663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076ee98-a464-4197-b2bc-184f47b11d26 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:07.605055 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3253/6538] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:08.145033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f16b9-0954-43b7-91f0-59882e2056fe None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:08.145632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f16b9-0954-43b7-91f0-59882e2056fe None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:08.145632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f16b9-0954-43b7-91f0-59882e2056fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:08.235171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6d0f16b9-0954-43b7-91f0-59882e2056fe None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:08.236429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6d0f16b9-0954-43b7-91f0-59882e2056fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:08.268285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076ee98-a464-4197-b2bc-184f47b11d26 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:08.269410 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3286/6539] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:08.288060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076ee98-a464-4197-b2bc-184f47b11d26 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:08.306527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b0601-829d-4e76-a067-26b0d04fc248 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:08.307510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b0601-829d-4e76-a067-26b0d04fc248 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:08.308026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b0601-829d-4e76-a067-26b0d04fc248 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:08.308707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b0601-829d-4e76-a067-26b0d04fc248 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:08.347383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b0601-829d-4e76-a067-26b0d04fc248 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:08.349810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b0601-829d-4e76-a067-26b0d04fc248 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:08.371904 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3254/6540] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:14:08.719721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f16b9-0954-43b7-91f0-59882e2056fe None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:08.722699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6d0f16b9-0954-43b7-91f0-59882e2056fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:08.790340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f16b9-0954-43b7-91f0-59882e2056fe None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:08.813642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:08.820179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:08.820487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:08.820789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] PATH_INFO: `/v3/projects/cfdbf53a23b146f295309ddba63f7982` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:08.822059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfdbf53a23b146f295309ddba63f7982)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:08.825757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:09.083545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdbf53a23b146f295309ddba63f7982', 'request_id': 'req-2ecda190-f974-4234-a7f4-062ae65cfc38'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:09.104283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdbf53a23b146f295309ddba63f7982', 'request_id': 'req-2ecda190-f974-4234-a7f4-062ae65cfc38'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:09.114264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdbf53a23b146f295309ddba63f7982', 'request_id': 'req-2ecda190-f974-4234-a7f4-062ae65cfc38'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:09.178017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] The token cache is being invalidate because project cfdbf53a23b146f295309ddba63f7982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:14:09.178640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:09.185507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2ecda190-f974-4234-a7f4-062ae65cfc38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:09.192249 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3287/6541] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:14:08 2022] DELETE /identity/v3/projects/cfdbf53a23b146f295309ddba63f7982 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:09.200371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbf2f-7c39-4e94-9c9b-3b8f8ac7c83f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:09.200371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbf2f-7c39-4e94-9c9b-3b8f8ac7c83f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:09.200371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbf2f-7c39-4e94-9c9b-3b8f8ac7c83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:09.218119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d327c-e418-401f-b975-7f1c68359e55 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:09.218399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d327c-e418-401f-b975-7f1c68359e55 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:09.218673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d327c-e418-401f-b975-7f1c68359e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:09.255765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3e4cbf2f-7c39-4e94-9c9b-3b8f8ac7c83f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:09.257075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3e4cbf2f-7c39-4e94-9c9b-3b8f8ac7c83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:09.272907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ac1d327c-e418-401f-b975-7f1c68359e55 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:09.283723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ac1d327c-e418-401f-b975-7f1c68359e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:09.358855 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:09.383233 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3255/6542] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:09.391845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93acc3-c5e9-4a9f-8388-30a0979c9875 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:09.392171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93acc3-c5e9-4a9f-8388-30a0979c9875 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:09.392899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93acc3-c5e9-4a9f-8388-30a0979c9875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:09.433200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0c93acc3-c5e9-4a9f-8388-30a0979c9875 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:09.434441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0c93acc3-c5e9-4a9f-8388-30a0979c9875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:09.457287 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3256/6543] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:09.457498 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3288/6544] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:09.464974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93acc3-c5e9-4a9f-8388-30a0979c9875 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:09.469082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d327c-e418-401f-b975-7f1c68359e55 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:09.470551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ac1d327c-e418-401f-b975-7f1c68359e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:09.486673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93acc3-c5e9-4a9f-8388-30a0979c9875 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:09.511942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f7f6e-396f-4000-b130-f66c4f94b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:09.512965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f7f6e-396f-4000-b130-f66c4f94b992 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:09.513475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f7f6e-396f-4000-b130-f66c4f94b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:09.513960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f7f6e-396f-4000-b130-f66c4f94b992 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:09.515061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f7f6e-396f-4000-b130-f66c4f94b992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:14:09.516902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f7f6e-396f-4000-b130-f66c4f94b992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:09.519508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f7f6e-396f-4000-b130-f66c4f94b992 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:09.563130 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3257/6545] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:14:09.567979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f7f6e-396f-4000-b130-f66c4f94b992 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:09.588324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f7f6e-396f-4000-b130-f66c4f94b992 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:09.596586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b3b65-bb36-4e5e-b0f7-7b03a32cfe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:09.597493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b3b65-bb36-4e5e-b0f7-7b03a32cfe77 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:09.598257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b3b65-bb36-4e5e-b0f7-7b03a32cfe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:09.598740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b3b65-bb36-4e5e-b0f7-7b03a32cfe77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:09.599607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b3b65-bb36-4e5e-b0f7-7b03a32cfe77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:09.601791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b3b65-bb36-4e5e-b0f7-7b03a32cfe77 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:09.672607 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:09.693703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d327c-e418-401f-b975-7f1c68359e55 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:09.710973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2466b02-06c3-4c39-8439-600de7aae31a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:09.712332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2466b02-06c3-4c39-8439-600de7aae31a service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:09.714627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2466b02-06c3-4c39-8439-600de7aae31a service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:09.715246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2466b02-06c3-4c39-8439-600de7aae31a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:09.716306 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3258/6546] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:14:09 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:09.718695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b3b65-bb36-4e5e-b0f7-7b03a32cfe77 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:09.739971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2466b02-06c3-4c39-8439-600de7aae31a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:09.744366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2466b02-06c3-4c39-8439-600de7aae31a service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:09.768099 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3289/6547] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:14:09.908080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b3b65-bb36-4e5e-b0f7-7b03a32cfe77 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:09.926642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffbbf-5dae-4c4a-9191-ff365bad484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:09.947037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffbbf-5dae-4c4a-9191-ff365bad484c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:09.948043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffbbf-5dae-4c4a-9191-ff365bad484c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:09.948541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffbbf-5dae-4c4a-9191-ff365bad484c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:09.951165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecffbbf-5dae-4c4a-9191-ff365bad484c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:09.967093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecffbbf-5dae-4c4a-9191-ff365bad484c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:10.073926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2466b02-06c3-4c39-8439-600de7aae31a service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:10.074144 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3259/6548] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:14:09 2022] POST /identity/v3/users => generated 288 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:10.101042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2466b02-06c3-4c39-8439-600de7aae31a service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:10.117171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9a5bd-bb43-41b0-a31e-c6b70a130735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:10.117809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9a5bd-bb43-41b0-a31e-c6b70a130735 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:10.118374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9a5bd-bb43-41b0-a31e-c6b70a130735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:10.118648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9a5bd-bb43-41b0-a31e-c6b70a130735 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:10.119303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9a5bd-bb43-41b0-a31e-c6b70a130735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:10.121622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9a5bd-bb43-41b0-a31e-c6b70a130735 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:10.159840 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3290/6549] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:14:10.163611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffbbf-5dae-4c4a-9191-ff365bad484c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:10.182240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffbbf-5dae-4c4a-9191-ff365bad484c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:10.206829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82f4aa-6c24-4f41-b523-b26f85d873e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:10.207502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f4aa-6c24-4f41-b523-b26f85d873e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:10.207760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f4aa-6c24-4f41-b523-b26f85d873e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:10.208034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f4aa-6c24-4f41-b523-b26f85d873e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:10.208736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82f4aa-6c24-4f41-b523-b26f85d873e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:10.210360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82f4aa-6c24-4f41-b523-b26f85d873e8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:10.231334 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3260/6550] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:10.236078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9a5bd-bb43-41b0-a31e-c6b70a130735 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:10.265402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9a5bd-bb43-41b0-a31e-c6b70a130735 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:10.282713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b674c1-a472-412e-b462-f954200dc4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:10.286072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b674c1-a472-412e-b462-f954200dc4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:10.288813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b674c1-a472-412e-b462-f954200dc4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:10.289318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b674c1-a472-412e-b462-f954200dc4b5 admin admin] PATH_INFO: `/v3/projects/be4dc61aad674342855e701484fc5de8/users/9dd04587dfb945c1816c657b89cbfb18/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:10.354111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b674c1-a472-412e-b462-f954200dc4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4dc61aad674342855e701484fc5de8, user_id=9dd04587dfb945c1816c657b89cbfb18, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:10.372998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b674c1-a472-412e-b462-f954200dc4b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:10.414205 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3291/6551] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:10 2022] PUT /identity/v3/projects/be4dc61aad674342855e701484fc5de8/users/9dd04587dfb945c1816c657b89cbfb18/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:10.415321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c042b12-f117-450e-b495-f3fa02a565f9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:10.416197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c042b12-f117-450e-b495-f3fa02a565f9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:10.416835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c042b12-f117-450e-b495-f3fa02a565f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:10.425197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc23f5-453b-42b4-a49a-86b5ddd6d109 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:10.425551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc23f5-453b-42b4-a49a-86b5ddd6d109 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:10.426201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc23f5-453b-42b4-a49a-86b5ddd6d109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:10.490747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9c042b12-f117-450e-b495-f3fa02a565f9 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:10.492000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9c042b12-f117-450e-b495-f3fa02a565f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:10.611739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-85cc23f5-453b-42b4-a49a-86b5ddd6d109 None None] MFA Rules not processed for user `9dd04587dfb945c1816c657b89cbfb18`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:10.613655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85cc23f5-453b-42b4-a49a-86b5ddd6d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:10.653043 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3261/6552] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:10.691622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c042b12-f117-450e-b495-f3fa02a565f9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:10.837636 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3292/6553] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:10.850620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc23f5-453b-42b4-a49a-86b5ddd6d109 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:10.853259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85cc23f5-453b-42b4-a49a-86b5ddd6d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:10.917755 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:11.050805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc23f5-453b-42b4-a49a-86b5ddd6d109 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:11.055727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac4f8c-a1e0-41da-9be7-c5f113495d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:11.056439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac4f8c-a1e0-41da-9be7-c5f113495d57 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:11.056919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac4f8c-a1e0-41da-9be7-c5f113495d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:11.057408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac4f8c-a1e0-41da-9be7-c5f113495d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:11.093284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c042b12-f117-450e-b495-f3fa02a565f9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:11.125610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb998dc-203b-44dd-99d1-c1c2b1bb57ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:11.126119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac4f8c-a1e0-41da-9be7-c5f113495d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:11.126629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb998dc-203b-44dd-99d1-c1c2b1bb57ae service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:11.127084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb998dc-203b-44dd-99d1-c1c2b1bb57ae service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:11.127519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb998dc-203b-44dd-99d1-c1c2b1bb57ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:11.131121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac4f8c-a1e0-41da-9be7-c5f113495d57 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:11.169567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb998dc-203b-44dd-99d1-c1c2b1bb57ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:11.171170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb998dc-203b-44dd-99d1-c1c2b1bb57ae service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:11.204683 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3293/6554] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:14:11.222864 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3262/6555] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:11.726020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb06564-e679-4a88-ade3-e34d90181027 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:11.726594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb06564-e679-4a88-ade3-e34d90181027 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:11.726594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb06564-e679-4a88-ade3-e34d90181027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:11.774447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-afb06564-e679-4a88-ade3-e34d90181027 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:11.775726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-afb06564-e679-4a88-ade3-e34d90181027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:11.803491 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3294/6556] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:11.823964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb998dc-203b-44dd-99d1-c1c2b1bb57ae service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:11.841055 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:11.854665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb998dc-203b-44dd-99d1-c1c2b1bb57ae service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:11.886975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2c65-1194-4a12-b726-adbf07544860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:11.888606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2c65-1194-4a12-b726-adbf07544860 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:11.889315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2c65-1194-4a12-b726-adbf07544860 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:11.890096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2c65-1194-4a12-b726-adbf07544860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:11.938535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee2c65-1194-4a12-b726-adbf07544860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:11.952336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee2c65-1194-4a12-b726-adbf07544860 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:12.038590 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3263/6557] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:12.801963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d898e4-622b-47d5-9ada-0c89e3a076cb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:12.802574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d898e4-622b-47d5-9ada-0c89e3a076cb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:12.802574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d898e4-622b-47d5-9ada-0c89e3a076cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:12.847415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-35d898e4-622b-47d5-9ada-0c89e3a076cb None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:12.849096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-35d898e4-622b-47d5-9ada-0c89e3a076cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:12.869233 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3295/6558] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:12.890764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2c65-1194-4a12-b726-adbf07544860 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:12.922252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2c65-1194-4a12-b726-adbf07544860 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:12.940002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1c051-b447-405f-a407-36051d0a0dd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:12.941418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c051-b447-405f-a407-36051d0a0dd3 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:12.942107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c051-b447-405f-a407-36051d0a0dd3 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:12.942981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c051-b447-405f-a407-36051d0a0dd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:12.963024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1c051-b447-405f-a407-36051d0a0dd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:12.981923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1c051-b447-405f-a407-36051d0a0dd3 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:13.014540 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3264/6559] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:14.555938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99ac6-0f83-4cfd-a14f-c7f3722fbc84 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:14.556947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99ac6-0f83-4cfd-a14f-c7f3722fbc84 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:14.557468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99ac6-0f83-4cfd-a14f-c7f3722fbc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:14.608650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b3e99ac6-0f83-4cfd-a14f-c7f3722fbc84 None None] MFA Rules not processed for user `9dd04587dfb945c1816c657b89cbfb18`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:14.613781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b3e99ac6-0f83-4cfd-a14f-c7f3722fbc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:14.655070 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3296/6560] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:16.361473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7733d8-2166-44bc-b599-227e70d9c5a9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:16.363093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7733d8-2166-44bc-b599-227e70d9c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:16.363790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7733d8-2166-44bc-b599-227e70d9c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:16.454975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ee7733d8-2166-44bc-b599-227e70d9c5a9 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:16.461211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ee7733d8-2166-44bc-b599-227e70d9c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:16.509283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e99ac6-0f83-4cfd-a14f-c7f3722fbc84 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:16.510154 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3265/6561] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:16.537514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e99ac6-0f83-4cfd-a14f-c7f3722fbc84 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:16.553861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cad8d2-ae79-4709-9356-c6364d554c90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:16.554494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cad8d2-ae79-4709-9356-c6364d554c90 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:16.554779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cad8d2-ae79-4709-9356-c6364d554c90 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:16.555459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cad8d2-ae79-4709-9356-c6364d554c90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:16.578450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cad8d2-ae79-4709-9356-c6364d554c90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:16.580292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cad8d2-ae79-4709-9356-c6364d554c90 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:16.613521 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3297/6562] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:14:17.010413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6a3b1-cfe6-40d6-bb2a-765f738d5c3f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:17.010650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6a3b1-cfe6-40d6-bb2a-765f738d5c3f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:17.011076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6a3b1-cfe6-40d6-bb2a-765f738d5c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:17.089789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6cf6a3b1-cfe6-40d6-bb2a-765f738d5c3f None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:17.094576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6cf6a3b1-cfe6-40d6-bb2a-765f738d5c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:17.118199 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3266/6563] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 19 01:14:17.146396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cad8d2-ae79-4709-9356-c6364d554c90 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:17.179871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cad8d2-ae79-4709-9356-c6364d554c90 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:17.207216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149e115-673c-4741-8715-00992375a1ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:17.209352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149e115-673c-4741-8715-00992375a1ef service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:17.210836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149e115-673c-4741-8715-00992375a1ef service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:17.211936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149e115-673c-4741-8715-00992375a1ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:17.322636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149e115-673c-4741-8715-00992375a1ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:17.324276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149e115-673c-4741-8715-00992375a1ef service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:17.390117 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3298/6564] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:17.718723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e30c11-1ad4-4162-add5-bb2cb48cf590 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:17.719607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e30c11-1ad4-4162-add5-bb2cb48cf590 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:17.720726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e30c11-1ad4-4162-add5-bb2cb48cf590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:17.761489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f8e30c11-1ad4-4162-add5-bb2cb48cf590 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:17.762765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8e30c11-1ad4-4162-add5-bb2cb48cf590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:17.788756 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3267/6565] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:17.817023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149e115-673c-4741-8715-00992375a1ef service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:17.837258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149e115-673c-4741-8715-00992375a1ef service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:17.858612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5c1d-90f7-47b3-b373-7d4c87afec61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:17.861256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5c1d-90f7-47b3-b373-7d4c87afec61 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:17.863495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5c1d-90f7-47b3-b373-7d4c87afec61 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:17.863945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5c1d-90f7-47b3-b373-7d4c87afec61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:17.891182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a5c1d-90f7-47b3-b373-7d4c87afec61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:17.917166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a5c1d-90f7-47b3-b373-7d4c87afec61 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:17.974441 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3299/6566] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:18.451350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a830bf-2e08-4ea2-8cb2-de6c466e66d4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:18.452080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a830bf-2e08-4ea2-8cb2-de6c466e66d4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:18.452585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a830bf-2e08-4ea2-8cb2-de6c466e66d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:18.537888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-70a830bf-2e08-4ea2-8cb2-de6c466e66d4 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:18.544808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-70a830bf-2e08-4ea2-8cb2-de6c466e66d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:18.587291 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3268/6567] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:18.601558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5c1d-90f7-47b3-b373-7d4c87afec61 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:18.626502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5c1d-90f7-47b3-b373-7d4c87afec61 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:18.639436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661fb02-d795-43aa-bffc-c021cca7e592 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:18.643737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661fb02-d795-43aa-bffc-c021cca7e592 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:18.644780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661fb02-d795-43aa-bffc-c021cca7e592 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:18.645708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661fb02-d795-43aa-bffc-c021cca7e592 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:18.686020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661fb02-d795-43aa-bffc-c021cca7e592 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:18.699536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661fb02-d795-43aa-bffc-c021cca7e592 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:18.715784 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3300/6568] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:19.124551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d24916-3698-459d-834b-62df42c89c74 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:19.125182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d24916-3698-459d-834b-62df42c89c74 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:19.125846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d24916-3698-459d-834b-62df42c89c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:19.200989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f6d24916-3698-459d-834b-62df42c89c74 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:19.204967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f6d24916-3698-459d-834b-62df42c89c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:19.236182 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3269/6569] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:19.250575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661fb02-d795-43aa-bffc-c021cca7e592 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:19.269733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661fb02-d795-43aa-bffc-c021cca7e592 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:19.286160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717831ba-8fe0-4717-8263-d1027f1eaee2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:19.286961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717831ba-8fe0-4717-8263-d1027f1eaee2 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:19.287341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717831ba-8fe0-4717-8263-d1027f1eaee2 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:19.287717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717831ba-8fe0-4717-8263-d1027f1eaee2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:19.299276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717831ba-8fe0-4717-8263-d1027f1eaee2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:19.301376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717831ba-8fe0-4717-8263-d1027f1eaee2 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:19.322701 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3301/6570] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:19.588364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d60ca3-d143-4154-b549-32bb5edc6f76 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:19.588679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d60ca3-d143-4154-b549-32bb5edc6f76 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:19.589746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d60ca3-d143-4154-b549-32bb5edc6f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:19.617439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-20d60ca3-d143-4154-b549-32bb5edc6f76 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:19.619868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-20d60ca3-d143-4154-b549-32bb5edc6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:19.653612 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3270/6571] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:19.654135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717831ba-8fe0-4717-8263-d1027f1eaee2 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:19.682999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717831ba-8fe0-4717-8263-d1027f1eaee2 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:19.708151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452f52-38b7-40ff-86dc-aaec533955f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:19.708822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452f52-38b7-40ff-86dc-aaec533955f8 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:19.709102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452f52-38b7-40ff-86dc-aaec533955f8 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:19.709373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452f52-38b7-40ff-86dc-aaec533955f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:19.737248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7452f52-38b7-40ff-86dc-aaec533955f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:19.738931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7452f52-38b7-40ff-86dc-aaec533955f8 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:19.779630 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3302/6572] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:14:20.025053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d60ca3-d143-4154-b549-32bb5edc6f76 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:20.027299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-20d60ca3-d143-4154-b549-32bb5edc6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:20.210043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d60ca3-d143-4154-b549-32bb5edc6f76 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:20.215827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:20.217503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:20.218014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:20.218536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] PATH_INFO: `/v3/users/2daa4c19dcdb4e179d6d204eb455a753` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:20.220070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2daa4c19dcdb4e179d6d204eb455a753)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:20.222879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:20.307710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2daa4c19dcdb4e179d6d204eb455a753'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:20.336189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2daa4c19dcdb4e179d6d204eb455a753'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:20.351309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2daa4c19dcdb4e179d6d204eb455a753'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:20.366899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2daa4c19dcdb4e179d6d204eb455a753'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:20.368440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2daa4c19dcdb4e179d6d204eb455a753'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:20.378984 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3271/6573] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:14:20 2022] DELETE /identity/v3/users/2daa4c19dcdb4e179d6d204eb455a753 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:20.383471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf637f-a87f-4a90-85f4-cef9f9cf29a7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:20.384027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf637f-a87f-4a90-85f4-cef9f9cf29a7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:20.384027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf637f-a87f-4a90-85f4-cef9f9cf29a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:20.432899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cdcf637f-a87f-4a90-85f4-cef9f9cf29a7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:20.456090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cdcf637f-a87f-4a90-85f4-cef9f9cf29a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:20.605872 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3303/6574] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:20.616708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:20.618983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:20.664271 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:20.754768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d1fad-ca94-42f2-a5e2-1b0852791b83 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:20.767803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6467edd-9475-4fb8-a4da-4c3ecfa76977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:20.772805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467edd-9475-4fb8-a4da-4c3ecfa76977 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:20.773160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467edd-9475-4fb8-a4da-4c3ecfa76977 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:20.773530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467edd-9475-4fb8-a4da-4c3ecfa76977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:20.817580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467edd-9475-4fb8-a4da-4c3ecfa76977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:20.819383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467edd-9475-4fb8-a4da-4c3ecfa76977 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:20.857499 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3272/6575] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:21.772441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf637f-a87f-4a90-85f4-cef9f9cf29a7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:21.773987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cdcf637f-a87f-4a90-85f4-cef9f9cf29a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:21.795539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf637f-a87f-4a90-85f4-cef9f9cf29a7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:21.807324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:21.808178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:21.808651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:21.809116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] PATH_INFO: `/v3/projects/eca50c3f612f42f4b860eff168d5b6db` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:21.816813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca50c3f612f42f4b860eff168d5b6db)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:21.822320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:21.876658 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:21.990072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca50c3f612f42f4b860eff168d5b6db', 'request_id': 'req-906169e9-8efb-4f17-8c06-d917b5cd7abd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:22.004318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca50c3f612f42f4b860eff168d5b6db', 'request_id': 'req-906169e9-8efb-4f17-8c06-d917b5cd7abd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:22.011965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca50c3f612f42f4b860eff168d5b6db', 'request_id': 'req-906169e9-8efb-4f17-8c06-d917b5cd7abd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:22.038729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] The token cache is being invalidate because project eca50c3f612f42f4b860eff168d5b6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:14:22.039304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:22.040124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-906169e9-8efb-4f17-8c06-d917b5cd7abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:22.041983 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3304/6576] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:14:21 2022] DELETE /identity/v3/projects/eca50c3f612f42f4b860eff168d5b6db => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:22.046926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123d501-f80b-4ba0-a9df-904581154f82 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:22.047817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123d501-f80b-4ba0-a9df-904581154f82 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:22.048246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123d501-f80b-4ba0-a9df-904581154f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:22.093151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c123d501-f80b-4ba0-a9df-904581154f82 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:22.094386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c123d501-f80b-4ba0-a9df-904581154f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:22.215246 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3273/6577] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:22.226025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794539f-858c-4b2c-ad22-1b5b66ef1b54 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:22.226311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794539f-858c-4b2c-ad22-1b5b66ef1b54 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:22.226588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794539f-858c-4b2c-ad22-1b5b66ef1b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:22.273404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5794539f-858c-4b2c-ad22-1b5b66ef1b54 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:22.274570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5794539f-858c-4b2c-ad22-1b5b66ef1b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:22.291339 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3305/6578] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:22.295860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123d501-f80b-4ba0-a9df-904581154f82 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:22.309197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123d501-f80b-4ba0-a9df-904581154f82 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:22.322853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75baa-0c30-4a48-ad11-c8b71021e207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:22.323869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75baa-0c30-4a48-ad11-c8b71021e207 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:22.325305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75baa-0c30-4a48-ad11-c8b71021e207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:22.325828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75baa-0c30-4a48-ad11-c8b71021e207 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:22.327337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75baa-0c30-4a48-ad11-c8b71021e207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:14:22.329161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75baa-0c30-4a48-ad11-c8b71021e207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:22.333917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75baa-0c30-4a48-ad11-c8b71021e207 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:22.360215 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3274/6579] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:14:22.367037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794539f-858c-4b2c-ad22-1b5b66ef1b54 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:22.380514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794539f-858c-4b2c-ad22-1b5b66ef1b54 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:22.386293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503a25f-5e14-4080-b98d-2d16dbede436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:22.387635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503a25f-5e14-4080-b98d-2d16dbede436 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:22.388434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503a25f-5e14-4080-b98d-2d16dbede436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:22.388940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503a25f-5e14-4080-b98d-2d16dbede436 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:22.389797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503a25f-5e14-4080-b98d-2d16dbede436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:22.392794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503a25f-5e14-4080-b98d-2d16dbede436 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:22.492253 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3306/6580] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:14:22 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:22.496739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75baa-0c30-4a48-ad11-c8b71021e207 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:22.510030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75baa-0c30-4a48-ad11-c8b71021e207 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:22.640804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3f26f-303b-4cab-8af4-e1f58114ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:22.641924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3f26f-303b-4cab-8af4-e1f58114ce87 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:22.643944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3f26f-303b-4cab-8af4-e1f58114ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:22.644417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3f26f-303b-4cab-8af4-e1f58114ce87 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:22.645649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3f26f-303b-4cab-8af4-e1f58114ce87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:22.656023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3f26f-303b-4cab-8af4-e1f58114ce87 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:22.713343 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3275/6581] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:14:22 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:22.715633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503a25f-5e14-4080-b98d-2d16dbede436 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:22.730534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503a25f-5e14-4080-b98d-2d16dbede436 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:22.750645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0a28-f04e-462e-8fd3-05fad07de985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:22.751080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0a28-f04e-462e-8fd3-05fad07de985 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:22.751362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0a28-f04e-462e-8fd3-05fad07de985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:22.751639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0a28-f04e-462e-8fd3-05fad07de985 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:22.752356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad0a28-f04e-462e-8fd3-05fad07de985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:22.754074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad0a28-f04e-462e-8fd3-05fad07de985 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:22.806580 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3307/6582] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:22.811103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3f26f-303b-4cab-8af4-e1f58114ce87 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:22.830269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3f26f-303b-4cab-8af4-e1f58114ce87 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:22.843125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb3407-94d5-4867-942e-0f25c2f27bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:22.845106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb3407-94d5-4867-942e-0f25c2f27bbe admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:22.847242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb3407-94d5-4867-942e-0f25c2f27bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:22.847463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb3407-94d5-4867-942e-0f25c2f27bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:22.848609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb3407-94d5-4867-942e-0f25c2f27bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:22.854809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb3407-94d5-4867-942e-0f25c2f27bbe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:22.887911 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3276/6583] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:22.889335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0a28-f04e-462e-8fd3-05fad07de985 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:22.910520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0a28-f04e-462e-8fd3-05fad07de985 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:22.925432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fbd72-d9a2-4b34-89ca-de64a521eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:22.927674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fbd72-d9a2-4b34-89ca-de64a521eabb admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:22.928420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fbd72-d9a2-4b34-89ca-de64a521eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:22.929917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fbd72-d9a2-4b34-89ca-de64a521eabb admin admin] PATH_INFO: `/v3/projects/fb1473c918cc4af5ab898e4c37409c1a/users/7500d974f70c44b5b2d8c025ebc56ab8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:22.976934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fbd72-d9a2-4b34-89ca-de64a521eabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1473c918cc4af5ab898e4c37409c1a, user_id=7500d974f70c44b5b2d8c025ebc56ab8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:22.985160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fbd72-d9a2-4b34-89ca-de64a521eabb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:23.023380 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3308/6584] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:22 2022] PUT /identity/v3/projects/fb1473c918cc4af5ab898e4c37409c1a/users/7500d974f70c44b5b2d8c025ebc56ab8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:23.035645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ac346-e95a-4538-b359-7d4341fc55a9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:23.035931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ac346-e95a-4538-b359-7d4341fc55a9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:23.036219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ac346-e95a-4538-b359-7d4341fc55a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:23.127832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-238ac346-e95a-4538-b359-7d4341fc55a9 None None] MFA Rules not processed for user `7500d974f70c44b5b2d8c025ebc56ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:23.129340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-238ac346-e95a-4538-b359-7d4341fc55a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:23.170864 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:23.322373 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3277/6585] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:23.328250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fbd72-d9a2-4b34-89ca-de64a521eabb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:23.547169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fbd72-d9a2-4b34-89ca-de64a521eabb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:23.554807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021b209-a70f-4fbb-a65f-026bc1eaca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:23.555951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021b209-a70f-4fbb-a65f-026bc1eaca66 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:23.556388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021b209-a70f-4fbb-a65f-026bc1eaca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:23.556895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021b209-a70f-4fbb-a65f-026bc1eaca66 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:23.557822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021b209-a70f-4fbb-a65f-026bc1eaca66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:23.560224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021b209-a70f-4fbb-a65f-026bc1eaca66 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:23.597976 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3309/6586] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:14:23 2022] POST /identity/v3/projects => generated 385 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:23.601817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ac346-e95a-4538-b359-7d4341fc55a9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:23.619607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ac346-e95a-4538-b359-7d4341fc55a9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:23.775974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423d963-9c95-4b18-b536-3c8ffd995ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:23.776614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423d963-9c95-4b18-b536-3c8ffd995ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:23.776912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423d963-9c95-4b18-b536-3c8ffd995ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:23.777182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423d963-9c95-4b18-b536-3c8ffd995ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:23.784417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423d963-9c95-4b18-b536-3c8ffd995ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:23.786733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423d963-9c95-4b18-b536-3c8ffd995ec1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:23.909511 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3278/6587] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:14:23 2022] POST /identity/v3/users => generated 299 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:23.912862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021b209-a70f-4fbb-a65f-026bc1eaca66 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:23.929139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021b209-a70f-4fbb-a65f-026bc1eaca66 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:23.951606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312764af-fd7f-4656-b60c-9487954d46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:23.952253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312764af-fd7f-4656-b60c-9487954d46e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:23.952536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312764af-fd7f-4656-b60c-9487954d46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:23.952841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312764af-fd7f-4656-b60c-9487954d46e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:23.963081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312764af-fd7f-4656-b60c-9487954d46e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:23.965318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312764af-fd7f-4656-b60c-9487954d46e0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:24.005435 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3310/6588] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:24.009245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423d963-9c95-4b18-b536-3c8ffd995ec1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:24.026583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423d963-9c95-4b18-b536-3c8ffd995ec1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:24.058246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54492bdf-57a8-4727-bc86-5a1f6823260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:24.059158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54492bdf-57a8-4727-bc86-5a1f6823260f admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:24.059592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54492bdf-57a8-4727-bc86-5a1f6823260f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:24.060042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54492bdf-57a8-4727-bc86-5a1f6823260f admin admin] PATH_INFO: `/v3/projects/0d634885ce474db99194b3baebef4dba/users/7c9db08dc1404fcfadc75502c7fe2ba6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:24.108169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54492bdf-57a8-4727-bc86-5a1f6823260f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d634885ce474db99194b3baebef4dba, user_id=7c9db08dc1404fcfadc75502c7fe2ba6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:24.130709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312764af-fd7f-4656-b60c-9487954d46e0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:24.131908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-312764af-fd7f-4656-b60c-9487954d46e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:24.136075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54492bdf-57a8-4727-bc86-5a1f6823260f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:24.155300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312764af-fd7f-4656-b60c-9487954d46e0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:24.166955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:24.167613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:24.168075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:24.168504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] PATH_INFO: `/v3/users/2f5f269893ea4a8c836ad30e97029059` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:24.169862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5f269893ea4a8c836ad30e97029059)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:24.171965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:24.184642 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3279/6589] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:24 2022] PUT /identity/v3/projects/0d634885ce474db99194b3baebef4dba/users/7c9db08dc1404fcfadc75502c7fe2ba6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:24.185644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54492bdf-57a8-4727-bc86-5a1f6823260f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:24.186291 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:24.326196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5f269893ea4a8c836ad30e97029059'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:24.367593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5f269893ea4a8c836ad30e97029059'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:24.368428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54492bdf-57a8-4727-bc86-5a1f6823260f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:24.384777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5f269893ea4a8c836ad30e97029059'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:24.394339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9825534-02b1-4aff-afda-bca9f50624c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:24.395070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9825534-02b1-4aff-afda-bca9f50624c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:24.395468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9825534-02b1-4aff-afda-bca9f50624c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:24.396484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9825534-02b1-4aff-afda-bca9f50624c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:24.397317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9825534-02b1-4aff-afda-bca9f50624c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:24.408073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9825534-02b1-4aff-afda-bca9f50624c5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:24.409917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5f269893ea4a8c836ad30e97029059'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:24.412180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4d595e17-89ee-464c-a08d-c5ba22c90989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5f269893ea4a8c836ad30e97029059'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:24.423080 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3311/6590] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:14:24 2022] DELETE /identity/v3/users/2f5f269893ea4a8c836ad30e97029059 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:14:24.434925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27a09-95a6-4ec9-900a-24f7140ca472 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:24.438557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27a09-95a6-4ec9-900a-24f7140ca472 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:24.438557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27a09-95a6-4ec9-900a-24f7140ca472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:24.442847 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3280/6591] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:24.444101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9825534-02b1-4aff-afda-bca9f50624c5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:24.455036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e9825534-02b1-4aff-afda-bca9f50624c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:24.495000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9825534-02b1-4aff-afda-bca9f50624c5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:24.504918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a7a27a09-95a6-4ec9-900a-24f7140ca472 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:24.510500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7a27a09-95a6-4ec9-900a-24f7140ca472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:24.534390 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:24.686176 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3312/6592] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:24.698367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7625a-08ba-4a34-a419-3e5febf06213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:24.699068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7625a-08ba-4a34-a419-3e5febf06213 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:24.699351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7625a-08ba-4a34-a419-3e5febf06213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:24.699633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7625a-08ba-4a34-a419-3e5febf06213 admin admin] PATH_INFO: `/v3/projects/0d634885ce474db99194b3baebef4dba/users/7c9db08dc1404fcfadc75502c7fe2ba6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:24.701695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7625a-08ba-4a34-a419-3e5febf06213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d634885ce474db99194b3baebef4dba, user_id=7c9db08dc1404fcfadc75502c7fe2ba6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:24.704772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7625a-08ba-4a34-a419-3e5febf06213 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:24.716986 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3281/6593] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:24 2022] PUT /identity/v3/projects/0d634885ce474db99194b3baebef4dba/users/7c9db08dc1404fcfadc75502c7fe2ba6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:24.718012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27a09-95a6-4ec9-900a-24f7140ca472 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:24.720764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7a27a09-95a6-4ec9-900a-24f7140ca472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:24.728325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c658118-bf38-419d-a4e5-fbae5a02f588 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:24.728684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c658118-bf38-419d-a4e5-fbae5a02f588 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:24.728909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c658118-bf38-419d-a4e5-fbae5a02f588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:24.766507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9c658118-bf38-419d-a4e5-fbae5a02f588 None None] MFA Rules not processed for user `7c9db08dc1404fcfadc75502c7fe2ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:24.768895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9c658118-bf38-419d-a4e5-fbae5a02f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:24.876219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27a09-95a6-4ec9-900a-24f7140ca472 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:24.959229 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3282/6594] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:24.972908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c658118-bf38-419d-a4e5-fbae5a02f588 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:24.993038 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:25.029313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbdcb9-96d0-4be4-a74d-baae91b75487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:25.033575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbdcb9-96d0-4be4-a74d-baae91b75487 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:25.036367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbdcb9-96d0-4be4-a74d-baae91b75487 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:25.037890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbdcb9-96d0-4be4-a74d-baae91b75487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:25.112764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c658118-bf38-419d-a4e5-fbae5a02f588 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:25.123136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796f1eb-21bf-4de7-8c30-8d0f0f4a9f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:25.123775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f1eb-21bf-4de7-8c30-8d0f0f4a9f83 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:25.124065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f1eb-21bf-4de7-8c30-8d0f0f4a9f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:25.124634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f1eb-21bf-4de7-8c30-8d0f0f4a9f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:25.126531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f796f1eb-21bf-4de7-8c30-8d0f0f4a9f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:25.214959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbdcb9-96d0-4be4-a74d-baae91b75487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:25.216742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbdcb9-96d0-4be4-a74d-baae91b75487 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:25.230221 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3313/6595] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:14:25.242747 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:25.260356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796f1eb-21bf-4de7-8c30-8d0f0f4a9f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:25.263130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796f1eb-21bf-4de7-8c30-8d0f0f4a9f83 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:25.276658 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3283/6596] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:14:26.506990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbdcb9-96d0-4be4-a74d-baae91b75487 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:26.508586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9ddbdcb9-96d0-4be4-a74d-baae91b75487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:26.546709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbdcb9-96d0-4be4-a74d-baae91b75487 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:26.560043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:26.563613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:26.563900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:26.564172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] PATH_INFO: `/v3/projects/592bc25d96fe4bcab4b256303e5de3b0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:26.565564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=592bc25d96fe4bcab4b256303e5de3b0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:26.570297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:26.713143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592bc25d96fe4bcab4b256303e5de3b0', 'request_id': 'req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:26.726700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592bc25d96fe4bcab4b256303e5de3b0', 'request_id': 'req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:26.734330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592bc25d96fe4bcab4b256303e5de3b0', 'request_id': 'req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:26.768615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] The token cache is being invalidate because project 592bc25d96fe4bcab4b256303e5de3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:14:26.770134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:26.770542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:26.776542 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3314/6597] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:14:26 2022] DELETE /identity/v3/projects/592bc25d96fe4bcab4b256303e5de3b0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:26.779607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796f1eb-21bf-4de7-8c30-8d0f0f4a9f83 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:26.796914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796f1eb-21bf-4de7-8c30-8d0f0f4a9f83 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:26.818582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:26.819450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:26.936952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce232e-d6f3-4d6c-ad23-79cd3b8cc8bb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:26.942059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:26.942904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:26.943235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:26.943524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:26.946028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:26.991400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:26.995210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:26.997640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:26.999569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] PATH_INFO: `/v3/users/aa5f82e0c2ba43d7b8585818b4ed4351` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:27.001880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5f82e0c2ba43d7b8585818b4ed4351)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:27.005526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:27.037257 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:27.144886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:27.146755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:27.169397 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3315/6598] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:14:27.186711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5f82e0c2ba43d7b8585818b4ed4351'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:27.209723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5f82e0c2ba43d7b8585818b4ed4351'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:27.222357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5f82e0c2ba43d7b8585818b4ed4351'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:27.247930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5f82e0c2ba43d7b8585818b4ed4351'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:27.248886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2941911-59ab-413e-9b6f-1140338bf475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5f82e0c2ba43d7b8585818b4ed4351'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:27.259595 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3284/6599] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:14:26 2022] DELETE /identity/v3/users/aa5f82e0c2ba43d7b8585818b4ed4351 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:14:27.628777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:27.630263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:27.668914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898ab09-539f-4b2a-93de-9789b95fcbf9 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:27.874747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:27.876158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:27.877767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:27.878189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] PATH_INFO: `/v3/projects/7b818f6d34c0453f9eeacbe7eabdf475` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:27.880147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b818f6d34c0453f9eeacbe7eabdf475)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:27.882875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:28.011269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b818f6d34c0453f9eeacbe7eabdf475', 'request_id': 'req-275e045a-7e61-4b0c-a011-76c8c3a9724e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:28.027778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b818f6d34c0453f9eeacbe7eabdf475', 'request_id': 'req-275e045a-7e61-4b0c-a011-76c8c3a9724e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:28.074648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b818f6d34c0453f9eeacbe7eabdf475', 'request_id': 'req-275e045a-7e61-4b0c-a011-76c8c3a9724e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:28.102377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] The token cache is being invalidate because project 7b818f6d34c0453f9eeacbe7eabdf475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:14:28.102919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:28.103616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:28.106563 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3316/6600] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:14:27 2022] DELETE /identity/v3/projects/7b818f6d34c0453f9eeacbe7eabdf475 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:28.111913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9e007-f6bf-4e1a-8bde-b98da038d450 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:28.112441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9e007-f6bf-4e1a-8bde-b98da038d450 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:28.112441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9e007-f6bf-4e1a-8bde-b98da038d450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:28.158807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4ab9e007-f6bf-4e1a-8bde-b98da038d450 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:28.161925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4ab9e007-f6bf-4e1a-8bde-b98da038d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:28.303554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:28.305350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:28.370139 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3285/6601] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:28.371807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee94df5-2646-4c12-a8a4-d5bdc90642d8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:28.372166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee94df5-2646-4c12-a8a4-d5bdc90642d8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:28.372556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee94df5-2646-4c12-a8a4-d5bdc90642d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:28.462442 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:28.490314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3ee94df5-2646-4c12-a8a4-d5bdc90642d8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:28.500070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3ee94df5-2646-4c12-a8a4-d5bdc90642d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:28.519685 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3286/6602] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:28.524483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee94df5-2646-4c12-a8a4-d5bdc90642d8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:28.532020 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:28.541193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee94df5-2646-4c12-a8a4-d5bdc90642d8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:28.547540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5566d-1cba-4902-a11f-ccf9cf214c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:28.551392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5566d-1cba-4902-a11f-ccf9cf214c6e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:28.559871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5566d-1cba-4902-a11f-ccf9cf214c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:28.560218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5566d-1cba-4902-a11f-ccf9cf214c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:28.561171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5566d-1cba-4902-a11f-ccf9cf214c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:14:28.561926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5566d-1cba-4902-a11f-ccf9cf214c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:28.563979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5566d-1cba-4902-a11f-ccf9cf214c6e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:28.604493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e045a-7e61-4b0c-a011-76c8c3a9724e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:28.616112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d4cf2-c968-4205-99a7-51851c814901 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:28.616909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d4cf2-c968-4205-99a7-51851c814901 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:28.617131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d4cf2-c968-4205-99a7-51851c814901 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:28.617406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d4cf2-c968-4205-99a7-51851c814901 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:28.617759 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3287/6603] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:14:28.619836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5566d-1cba-4902-a11f-ccf9cf214c6e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:28.623290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-436d4cf2-c968-4205-99a7-51851c814901 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:28.652674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d4cf2-c968-4205-99a7-51851c814901 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:28.657163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d4cf2-c968-4205-99a7-51851c814901 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:28.664706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5566d-1cba-4902-a11f-ccf9cf214c6e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:28.678626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17b931-94ec-4a20-aff1-dce006f514b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:28.679280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17b931-94ec-4a20-aff1-dce006f514b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:28.679550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17b931-94ec-4a20-aff1-dce006f514b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:28.679827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17b931-94ec-4a20-aff1-dce006f514b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:28.680486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17b931-94ec-4a20-aff1-dce006f514b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:28.688866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17b931-94ec-4a20-aff1-dce006f514b4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:28.696357 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3317/6604] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:28.751515 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3288/6605] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:14:28 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:28.756081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d4cf2-c968-4205-99a7-51851c814901 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:28.779457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d4cf2-c968-4205-99a7-51851c814901 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:28.870811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1927f2-4a4f-4bed-a88b-e44683dff40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:28.871809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1927f2-4a4f-4bed-a88b-e44683dff40e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:28.872456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1927f2-4a4f-4bed-a88b-e44683dff40e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:28.873389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1927f2-4a4f-4bed-a88b-e44683dff40e admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:28.874109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1927f2-4a4f-4bed-a88b-e44683dff40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:28.877228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1927f2-4a4f-4bed-a88b-e44683dff40e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:28.908131 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3318/6606] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:14:28 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:28.912995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17b931-94ec-4a20-aff1-dce006f514b4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:28.926728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17b931-94ec-4a20-aff1-dce006f514b4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:28.936209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a87c2-a54a-409e-aada-ce63e4712431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:28.937237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a87c2-a54a-409e-aada-ce63e4712431 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:28.937669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a87c2-a54a-409e-aada-ce63e4712431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:28.938298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a87c2-a54a-409e-aada-ce63e4712431 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:28.939128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a87c2-a54a-409e-aada-ce63e4712431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:28.943394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a87c2-a54a-409e-aada-ce63e4712431 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:28.965208 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3289/6607] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:28.969495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1927f2-4a4f-4bed-a88b-e44683dff40e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:28.983904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1927f2-4a4f-4bed-a88b-e44683dff40e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:28.990353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb77923-3f48-4c37-bbe8-f8667252aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:28.991403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb77923-3f48-4c37-bbe8-f8667252aee6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:28.992147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb77923-3f48-4c37-bbe8-f8667252aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:28.992594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb77923-3f48-4c37-bbe8-f8667252aee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:28.993952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb77923-3f48-4c37-bbe8-f8667252aee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:28.996211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb77923-3f48-4c37-bbe8-f8667252aee6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:29.010320 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3319/6608] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:29.013945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a87c2-a54a-409e-aada-ce63e4712431 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:29.026600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a87c2-a54a-409e-aada-ce63e4712431 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:29.050795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821710a0-e233-4f0f-af69-684d16c43389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:29.052011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821710a0-e233-4f0f-af69-684d16c43389 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:29.052448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821710a0-e233-4f0f-af69-684d16c43389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:29.052913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821710a0-e233-4f0f-af69-684d16c43389 admin admin] PATH_INFO: `/v3/projects/952dc4f138254204bca33cec4b0f7b0b/users/03fcda874deb4fba9079186248bf70f2/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:29.093084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821710a0-e233-4f0f-af69-684d16c43389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952dc4f138254204bca33cec4b0f7b0b, user_id=03fcda874deb4fba9079186248bf70f2, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:29.096577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821710a0-e233-4f0f-af69-684d16c43389 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:29.120702 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3290/6609] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:29 2022] PUT /identity/v3/projects/952dc4f138254204bca33cec4b0f7b0b/users/03fcda874deb4fba9079186248bf70f2/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:29.132078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c8ae7-28f5-4294-9146-d481aa876a66 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:29.132727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c8ae7-28f5-4294-9146-d481aa876a66 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:29.133155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c8ae7-28f5-4294-9146-d481aa876a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:29.197313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d59c8ae7-28f5-4294-9146-d481aa876a66 None None] MFA Rules not processed for user `03fcda874deb4fba9079186248bf70f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:29.198755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d59c8ae7-28f5-4294-9146-d481aa876a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:29.364536 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3320/6610] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:29.441781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821710a0-e233-4f0f-af69-684d16c43389 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:29.443996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-821710a0-e233-4f0f-af69-684d16c43389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:29.628255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821710a0-e233-4f0f-af69-684d16c43389 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:29.641295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649df40d-f0c7-4423-8c0b-30575cfb6381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:29.642006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649df40d-f0c7-4423-8c0b-30575cfb6381 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:29.642432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649df40d-f0c7-4423-8c0b-30575cfb6381 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:29.643785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649df40d-f0c7-4423-8c0b-30575cfb6381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:29.661445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649df40d-f0c7-4423-8c0b-30575cfb6381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:29.663150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649df40d-f0c7-4423-8c0b-30575cfb6381 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:29.689181 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3291/6611] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:39.351543 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:39.675166 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:40.223703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c8ae7-28f5-4294-9146-d481aa876a66 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:40.459459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c8ae7-28f5-4294-9146-d481aa876a66 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:40.474696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cd00c-4b55-4a6a-819c-77afaff6a726 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:40.475795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cd00c-4b55-4a6a-819c-77afaff6a726 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:40.476308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cd00c-4b55-4a6a-819c-77afaff6a726 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:40.477558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cd00c-4b55-4a6a-819c-77afaff6a726 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:40.478606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cd2cd00c-4b55-4a6a-819c-77afaff6a726 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:40.503872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cd00c-4b55-4a6a-819c-77afaff6a726 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:40.505702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cd00c-4b55-4a6a-819c-77afaff6a726 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:40.535196 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3321/6612] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:41.232108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649df40d-f0c7-4423-8c0b-30575cfb6381 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:41.235017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-649df40d-f0c7-4423-8c0b-30575cfb6381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:41.258441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649df40d-f0c7-4423-8c0b-30575cfb6381 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:41.271036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b9cf9-f715-41d9-bf90-7946e8182372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:41.271680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b9cf9-f715-41d9-bf90-7946e8182372 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:41.271960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b9cf9-f715-41d9-bf90-7946e8182372 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:41.272235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b9cf9-f715-41d9-bf90-7946e8182372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:41.277075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cc5b9cf9-f715-41d9-bf90-7946e8182372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:41.313544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b9cf9-f715-41d9-bf90-7946e8182372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:41.316000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b9cf9-f715-41d9-bf90-7946e8182372 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:41.339585 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3292/6613] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:42.025958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cd00c-4b55-4a6a-819c-77afaff6a726 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:42.041938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cd00c-4b55-4a6a-819c-77afaff6a726 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:42.055738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:42.056365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:42.056684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:42.056958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:42.065629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:42.401006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:42.404540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:42.436804 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3322/6614] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:44.325546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235baa0-3aea-4d2a-92c2-5015b739b039 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:44.326088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235baa0-3aea-4d2a-92c2-5015b739b039 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:44.326088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235baa0-3aea-4d2a-92c2-5015b739b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:44.386343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b235baa0-3aea-4d2a-92c2-5015b739b039 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:44.387710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b235baa0-3aea-4d2a-92c2-5015b739b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:44.575481 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3293/6615] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:44.591631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:44.594674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:44.836719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601787b-d0c9-4e41-9192-5fc6a7856ced service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:44.842635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45552dea-6bdd-4504-90e2-bec15c6e4b63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:44.843551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45552dea-6bdd-4504-90e2-bec15c6e4b63 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:44.844031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45552dea-6bdd-4504-90e2-bec15c6e4b63 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:44.844546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45552dea-6bdd-4504-90e2-bec15c6e4b63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:44.859120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45552dea-6bdd-4504-90e2-bec15c6e4b63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:44.864335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45552dea-6bdd-4504-90e2-bec15c6e4b63 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:44.886370 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3323/6616] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:46.029674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed15c-e6d2-4fff-be84-7278da5d6038 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:46.030186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed15c-e6d2-4fff-be84-7278da5d6038 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:46.030297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed15c-e6d2-4fff-be84-7278da5d6038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:46.077009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b3bed15c-e6d2-4fff-be84-7278da5d6038 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:46.082944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b3bed15c-e6d2-4fff-be84-7278da5d6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:46.119695 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3294/6617] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:46.127316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45552dea-6bdd-4504-90e2-bec15c6e4b63 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:46.136081 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:46.144735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45552dea-6bdd-4504-90e2-bec15c6e4b63 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:46.150591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f99a3-988f-4878-9321-2297950ae5f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:46.151324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f99a3-988f-4878-9321-2297950ae5f6 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:46.151756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f99a3-988f-4878-9321-2297950ae5f6 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:46.152107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f99a3-988f-4878-9321-2297950ae5f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:46.165049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f99a3-988f-4878-9321-2297950ae5f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:46.167328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f99a3-988f-4878-9321-2297950ae5f6 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:46.201161 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3324/6618] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:46.802910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b022202-897d-4c02-a901-7197879cf354 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:46.803198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b022202-897d-4c02-a901-7197879cf354 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:46.803808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b022202-897d-4c02-a901-7197879cf354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:46.846629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2b022202-897d-4c02-a901-7197879cf354 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:46.848043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2b022202-897d-4c02-a901-7197879cf354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:46.866770 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3295/6619] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:46.880470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f99a3-988f-4878-9321-2297950ae5f6 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:46.924510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f99a3-988f-4878-9321-2297950ae5f6 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:46.936119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0a4d7-ab37-4230-a4d3-3ec7909643aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:46.937475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0a4d7-ab37-4230-a4d3-3ec7909643aa service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:46.937972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0a4d7-ab37-4230-a4d3-3ec7909643aa service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:46.938702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0a4d7-ab37-4230-a4d3-3ec7909643aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:46.965668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0a4d7-ab37-4230-a4d3-3ec7909643aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:46.967645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0a4d7-ab37-4230-a4d3-3ec7909643aa service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:46.990285 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3325/6620] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:47.661622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4654239-71ce-402f-9e24-7e63f966a2be None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:47.662459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4654239-71ce-402f-9e24-7e63f966a2be None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:47.662940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4654239-71ce-402f-9e24-7e63f966a2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:47.703634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f4654239-71ce-402f-9e24-7e63f966a2be None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:47.707204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f4654239-71ce-402f-9e24-7e63f966a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:47.726728 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3296/6621] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:47.745964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0a4d7-ab37-4230-a4d3-3ec7909643aa service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:47.795173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0a4d7-ab37-4230-a4d3-3ec7909643aa service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:47.818647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55be9f-ace9-4f54-a34f-d3d35f9f1f23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:47.819673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55be9f-ace9-4f54-a34f-d3d35f9f1f23 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:47.820104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55be9f-ace9-4f54-a34f-d3d35f9f1f23 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:47.820526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55be9f-ace9-4f54-a34f-d3d35f9f1f23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:47.845672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55be9f-ace9-4f54-a34f-d3d35f9f1f23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:47.847666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55be9f-ace9-4f54-a34f-d3d35f9f1f23 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:47.876172 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3326/6622] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:14:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:48.606906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4654239-71ce-402f-9e24-7e63f966a2be None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:48.608423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f4654239-71ce-402f-9e24-7e63f966a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:48.652079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4654239-71ce-402f-9e24-7e63f966a2be None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:48.676931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bee83d-0d0d-4f0a-8bd1-a31707c52629 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:48.677567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bee83d-0d0d-4f0a-8bd1-a31707c52629 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:48.678066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bee83d-0d0d-4f0a-8bd1-a31707c52629 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:48.678506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bee83d-0d0d-4f0a-8bd1-a31707c52629 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:48.681591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-25bee83d-0d0d-4f0a-8bd1-a31707c52629 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:48.744144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bee83d-0d0d-4f0a-8bd1-a31707c52629 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:48.746321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bee83d-0d0d-4f0a-8bd1-a31707c52629 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:48.788456 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3297/6623] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:49.227166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55be9f-ace9-4f54-a34f-d3d35f9f1f23 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:49.229717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea55be9f-ace9-4f54-a34f-d3d35f9f1f23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:49.321793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55be9f-ace9-4f54-a34f-d3d35f9f1f23 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:49.337514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:49.338448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:49.338923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:49.339357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] PATH_INFO: `/v3/users/7500d974f70c44b5b2d8c025ebc56ab8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:49.345744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7500d974f70c44b5b2d8c025ebc56ab8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:49.348011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:49.486617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7500d974f70c44b5b2d8c025ebc56ab8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:49.528416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7500d974f70c44b5b2d8c025ebc56ab8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:49.551826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7500d974f70c44b5b2d8c025ebc56ab8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:49.575827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7500d974f70c44b5b2d8c025ebc56ab8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:49.577099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7500d974f70c44b5b2d8c025ebc56ab8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:49.600026 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3327/6624] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:14:49 2022] DELETE /identity/v3/users/7500d974f70c44b5b2d8c025ebc56ab8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:49.602116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccdc51-8468-461f-9ce0-bb8eb19ca191 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:49.602405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccdc51-8468-461f-9ce0-bb8eb19ca191 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:49.602685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccdc51-8468-461f-9ce0-bb8eb19ca191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:49.640209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b2ccdc51-8468-461f-9ce0-bb8eb19ca191 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:49.642595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b2ccdc51-8468-461f-9ce0-bb8eb19ca191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:49.862045 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3298/6625] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:49.989457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:49.991391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:50.156929 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:50.205230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569823-a1f6-49d7-8fac-48209e85d572 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:50.224796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d933c-ebb7-4851-b82b-4b93944b5546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:50.225592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d933c-ebb7-4851-b82b-4b93944b5546 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:50.231709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d933c-ebb7-4851-b82b-4b93944b5546 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:50.232404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d933c-ebb7-4851-b82b-4b93944b5546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:50.289414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d933c-ebb7-4851-b82b-4b93944b5546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:50.293160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d933c-ebb7-4851-b82b-4b93944b5546 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:50.309401 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3328/6626] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:50.628158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccdc51-8468-461f-9ce0-bb8eb19ca191 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:50.629693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b2ccdc51-8468-461f-9ce0-bb8eb19ca191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:50.923901 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:50.997445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccdc51-8468-461f-9ce0-bb8eb19ca191 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:51.016676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50d490-c5db-4c04-b9d7-942dbdf04342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:51.017420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50d490-c5db-4c04-b9d7-942dbdf04342 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:51.017575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50d490-c5db-4c04-b9d7-942dbdf04342 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:51.017858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50d490-c5db-4c04-b9d7-942dbdf04342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:51.023163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5e50d490-c5db-4c04-b9d7-942dbdf04342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:51.076055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50d490-c5db-4c04-b9d7-942dbdf04342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:51.077729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50d490-c5db-4c04-b9d7-942dbdf04342 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:51.141091 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3299/6627] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:14:51.722753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d933c-ebb7-4851-b82b-4b93944b5546 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:51.724881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c55d933c-ebb7-4851-b82b-4b93944b5546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:51.752302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d933c-ebb7-4851-b82b-4b93944b5546 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:51.766159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:51.767258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:51.767778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:51.768405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] PATH_INFO: `/v3/projects/fb1473c918cc4af5ab898e4c37409c1a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:51.770574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1473c918cc4af5ab898e4c37409c1a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:51.772776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:51.915475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1473c918cc4af5ab898e4c37409c1a', 'request_id': 'req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:51.933859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1473c918cc4af5ab898e4c37409c1a', 'request_id': 'req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:51.946090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1473c918cc4af5ab898e4c37409c1a', 'request_id': 'req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:51.991702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] The token cache is being invalidate because project fb1473c918cc4af5ab898e4c37409c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:14:51.992131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:51.995152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:52.003388 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3329/6628] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:14:51 2022] DELETE /identity/v3/projects/fb1473c918cc4af5ab898e4c37409c1a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:52.005211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50d490-c5db-4c04-b9d7-942dbdf04342 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:52.021518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50d490-c5db-4c04-b9d7-942dbdf04342 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:52.197013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:52.198120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:52.198667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:52.199337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] PATH_INFO: `/v3/users/7c9db08dc1404fcfadc75502c7fe2ba6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:52.201284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9db08dc1404fcfadc75502c7fe2ba6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:52.203958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:52.365287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9db08dc1404fcfadc75502c7fe2ba6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:52.405330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9db08dc1404fcfadc75502c7fe2ba6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:52.425032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9db08dc1404fcfadc75502c7fe2ba6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:52.443190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9db08dc1404fcfadc75502c7fe2ba6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:52.445924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9db08dc1404fcfadc75502c7fe2ba6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:52.467017 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3300/6629] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:14:52 2022] DELETE /identity/v3/users/7c9db08dc1404fcfadc75502c7fe2ba6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:53.008008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:53.009668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:53.039487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee66b3-9601-497b-8c2e-7fbc03ea20d4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:53.325915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:53.326890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:53.327365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:53.327582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] PATH_INFO: `/v3/projects/0d634885ce474db99194b3baebef4dba` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:53.330631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d634885ce474db99194b3baebef4dba)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:53.333836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:53.466433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d634885ce474db99194b3baebef4dba', 'request_id': 'req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:53.487743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d634885ce474db99194b3baebef4dba', 'request_id': 'req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:53.518578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:53.520328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:53.524801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d634885ce474db99194b3baebef4dba', 'request_id': 'req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:53.556769 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:53.583564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] The token cache is being invalidate because project 0d634885ce474db99194b3baebef4dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:14:53.583866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:53.588087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-46ce0295-7bd8-4ada-bb82-e3a93f9b1d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:53.597519 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3330/6630] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:14:53 2022] DELETE /identity/v3/projects/0d634885ce474db99194b3baebef4dba => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:53.603106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d90d2-c772-4bf6-adaf-2210fa60bac8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:53.603655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d90d2-c772-4bf6-adaf-2210fa60bac8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:53.604091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d90d2-c772-4bf6-adaf-2210fa60bac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:53.661261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3dbdd-8398-410f-b8ba-8799fae53d3b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:53.693740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-471d90d2-c772-4bf6-adaf-2210fa60bac8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:53.698084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-471d90d2-c772-4bf6-adaf-2210fa60bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:53.757594 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:53.894909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bc588-f9f3-4ec0-92c9-93d64c18d080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:53.897802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc588-f9f3-4ec0-92c9-93d64c18d080 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:53.897802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc588-f9f3-4ec0-92c9-93d64c18d080 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:53.897802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc588-f9f3-4ec0-92c9-93d64c18d080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:53.902049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-191bc588-f9f3-4ec0-92c9-93d64c18d080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:53.926482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bc588-f9f3-4ec0-92c9-93d64c18d080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:53.926482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bc588-f9f3-4ec0-92c9-93d64c18d080 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:53.952351 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3301/6631] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:53.975998 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3331/6632] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:53.986914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f67323-df62-4c50-bf16-7b2b46cb0906 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:53.988952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f67323-df62-4c50-bf16-7b2b46cb0906 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:53.989308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f67323-df62-4c50-bf16-7b2b46cb0906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:54.144416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a3f67323-df62-4c50-bf16-7b2b46cb0906 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:54.145691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a3f67323-df62-4c50-bf16-7b2b46cb0906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:54.193615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3302/6633] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:54.195597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d90d2-c772-4bf6-adaf-2210fa60bac8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:54.218776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d90d2-c772-4bf6-adaf-2210fa60bac8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:54.242572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce9734-ddd9-431f-959d-84c31c2f6cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:54.243279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9734-ddd9-431f-959d-84c31c2f6cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:54.243562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9734-ddd9-431f-959d-84c31c2f6cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:54.243837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9734-ddd9-431f-959d-84c31c2f6cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:54.244561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce9734-ddd9-431f-959d-84c31c2f6cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:14:54.244890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce9734-ddd9-431f-959d-84c31c2f6cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:54.246599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce9734-ddd9-431f-959d-84c31c2f6cb0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:54.295938 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3332/6634] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:14:54.300760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f67323-df62-4c50-bf16-7b2b46cb0906 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:54.321015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f67323-df62-4c50-bf16-7b2b46cb0906 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:54.350953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf73eee-f72b-4244-a96c-91c23a0a5940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:54.354057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73eee-f72b-4244-a96c-91c23a0a5940 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:54.354461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73eee-f72b-4244-a96c-91c23a0a5940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:54.354854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73eee-f72b-4244-a96c-91c23a0a5940 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:54.355616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf73eee-f72b-4244-a96c-91c23a0a5940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:54.357928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf73eee-f72b-4244-a96c-91c23a0a5940 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:54.425583 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3303/6635] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:14:54 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:54.431488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce9734-ddd9-431f-959d-84c31c2f6cb0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:54.452333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce9734-ddd9-431f-959d-84c31c2f6cb0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:54.713245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346725c-18a6-4c6c-892b-b02b60219986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:54.725041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346725c-18a6-4c6c-892b-b02b60219986 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:54.754036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346725c-18a6-4c6c-892b-b02b60219986 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:54.762412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346725c-18a6-4c6c-892b-b02b60219986 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:54.785195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346725c-18a6-4c6c-892b-b02b60219986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:54.787434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346725c-18a6-4c6c-892b-b02b60219986 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:54.831578 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3333/6636] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:14:54 2022] POST /identity/v3/users => generated 285 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:54.832532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf73eee-f72b-4244-a96c-91c23a0a5940 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:54.861247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf73eee-f72b-4244-a96c-91c23a0a5940 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:54.890537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c37aa7-8e74-402b-aab9-b7c96f6c9f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:54.891245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37aa7-8e74-402b-aab9-b7c96f6c9f40 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:54.892445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37aa7-8e74-402b-aab9-b7c96f6c9f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:54.892843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37aa7-8e74-402b-aab9-b7c96f6c9f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:54.893579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c37aa7-8e74-402b-aab9-b7c96f6c9f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:54.895311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c37aa7-8e74-402b-aab9-b7c96f6c9f40 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:54.965796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346725c-18a6-4c6c-892b-b02b60219986 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:54.970713 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3304/6637] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:14:54.990998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346725c-18a6-4c6c-892b-b02b60219986 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:55.006026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4bfad-bc40-4445-b432-778932d398f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:55.006853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4bfad-bc40-4445-b432-778932d398f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:55.007250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4bfad-bc40-4445-b432-778932d398f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:55.009922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4bfad-bc40-4445-b432-778932d398f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:55.010715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4bfad-bc40-4445-b432-778932d398f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:55.014022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4bfad-bc40-4445-b432-778932d398f0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:55.057368 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3334/6638] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:14:55.058606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c37aa7-8e74-402b-aab9-b7c96f6c9f40 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:55.082257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c37aa7-8e74-402b-aab9-b7c96f6c9f40 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:55.109477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba41261-6085-4fe3-98e7-28f218f23b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:55.110590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41261-6085-4fe3-98e7-28f218f23b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:55.113444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41261-6085-4fe3-98e7-28f218f23b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:55.114018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41261-6085-4fe3-98e7-28f218f23b6c admin admin] PATH_INFO: `/v3/projects/593c68d33d7a4d12b53208a645c7b311/users/3f87559c1328480bb365905eb6e09e67/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:55.184020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba41261-6085-4fe3-98e7-28f218f23b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=593c68d33d7a4d12b53208a645c7b311, user_id=3f87559c1328480bb365905eb6e09e67, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:55.199876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba41261-6085-4fe3-98e7-28f218f23b6c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:55.238574 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3305/6639] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:55 2022] PUT /identity/v3/projects/593c68d33d7a4d12b53208a645c7b311/users/3f87559c1328480bb365905eb6e09e67/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:55.352840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658ab6f-fa60-4cc9-92a8-b8bbde5c4975 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:55.353386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658ab6f-fa60-4cc9-92a8-b8bbde5c4975 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:55.353386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658ab6f-fa60-4cc9-92a8-b8bbde5c4975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:55.490301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9658ab6f-fa60-4cc9-92a8-b8bbde5c4975 None None] MFA Rules not processed for user `3f87559c1328480bb365905eb6e09e67`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:55.499751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9658ab6f-fa60-4cc9-92a8-b8bbde5c4975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:55.658769 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:55.692435 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3335/6640] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:55.692871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba41261-6085-4fe3-98e7-28f218f23b6c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:55.875429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba41261-6085-4fe3-98e7-28f218f23b6c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:55.898632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09219af6-10a4-43b9-8710-b327145f4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:55.900786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09219af6-10a4-43b9-8710-b327145f4005 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:55.901283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09219af6-10a4-43b9-8710-b327145f4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:55.903438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09219af6-10a4-43b9-8710-b327145f4005 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:55.905498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09219af6-10a4-43b9-8710-b327145f4005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:55.916328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09219af6-10a4-43b9-8710-b327145f4005 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:56.002512 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3306/6641] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:14:55 2022] POST /identity/v3/projects => generated 369 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:14:56.006672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658ab6f-fa60-4cc9-92a8-b8bbde5c4975 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:56.026322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658ab6f-fa60-4cc9-92a8-b8bbde5c4975 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:56.199919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78194de-528c-4f70-a02c-4b94fc90035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:56.200790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78194de-528c-4f70-a02c-4b94fc90035f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:56.201098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78194de-528c-4f70-a02c-4b94fc90035f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:56.201352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78194de-528c-4f70-a02c-4b94fc90035f admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:56.203306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78194de-528c-4f70-a02c-4b94fc90035f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:56.207391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78194de-528c-4f70-a02c-4b94fc90035f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:56.252610 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3336/6642] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:14:56 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:56.253914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09219af6-10a4-43b9-8710-b327145f4005 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:56.274130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09219af6-10a4-43b9-8710-b327145f4005 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:56.322500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b19a9b-5c10-40e6-9738-fdcbb001574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:56.326555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b19a9b-5c10-40e6-9738-fdcbb001574e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:56.328250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b19a9b-5c10-40e6-9738-fdcbb001574e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:56.328671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b19a9b-5c10-40e6-9738-fdcbb001574e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:56.331285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b19a9b-5c10-40e6-9738-fdcbb001574e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:56.338431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b19a9b-5c10-40e6-9738-fdcbb001574e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:56.352303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78194de-528c-4f70-a02c-4b94fc90035f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:56.354694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f78194de-528c-4f70-a02c-4b94fc90035f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:56.378195 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3307/6643] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:14:56.379607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b19a9b-5c10-40e6-9738-fdcbb001574e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:56.389379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78194de-528c-4f70-a02c-4b94fc90035f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:56.399281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b19a9b-5c10-40e6-9738-fdcbb001574e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:56.405786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:56.406763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:56.411079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:56.411687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] PATH_INFO: `/v3/users/9dd04587dfb945c1816c657b89cbfb18` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:56.413881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d2330-8b64-4f72-94fb-a7ad7c6ebb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:56.414695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d2330-8b64-4f72-94fb-a7ad7c6ebb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:56.415875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd04587dfb945c1816c657b89cbfb18)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:56.416298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d2330-8b64-4f72-94fb-a7ad7c6ebb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:56.417025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d2330-8b64-4f72-94fb-a7ad7c6ebb28 admin admin] PATH_INFO: `/v3/projects/e0c693fbf95b46ffb4e97585e313e577/users/bf2b04522f8f454bbebfc04105e3e8a6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:56.423073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:56.514080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d2330-8b64-4f72-94fb-a7ad7c6ebb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c693fbf95b46ffb4e97585e313e577, user_id=bf2b04522f8f454bbebfc04105e3e8a6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:56.533391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d2330-8b64-4f72-94fb-a7ad7c6ebb28 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:56.576524 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3308/6644] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:56 2022] PUT /identity/v3/projects/e0c693fbf95b46ffb4e97585e313e577/users/bf2b04522f8f454bbebfc04105e3e8a6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:56.581119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d2330-8b64-4f72-94fb-a7ad7c6ebb28 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:56.619269 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:56.628306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd04587dfb945c1816c657b89cbfb18'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:56.656241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd04587dfb945c1816c657b89cbfb18'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:56.677576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd04587dfb945c1816c657b89cbfb18'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:56.707873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd04587dfb945c1816c657b89cbfb18'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:56.708653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dd3efc6a-673a-4b4d-8c1e-8bb4ecf6e5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd04587dfb945c1816c657b89cbfb18'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:56.726246 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3337/6645] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:14:56 2022] DELETE /identity/v3/users/9dd04587dfb945c1816c657b89cbfb18 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:14:56.730588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc3296-b054-4106-b2f1-d8c9e01fd3df None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:56.731748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc3296-b054-4106-b2f1-d8c9e01fd3df None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:56.732036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc3296-b054-4106-b2f1-d8c9e01fd3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:56.775961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d2330-8b64-4f72-94fb-a7ad7c6ebb28 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:56.779164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d8fc3296-b054-4106-b2f1-d8c9e01fd3df None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:56.782034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d8fc3296-b054-4106-b2f1-d8c9e01fd3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:56.905802 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:56.913946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10629a3-8846-4dc8-be05-93e27a62c60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:56.914771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10629a3-8846-4dc8-be05-93e27a62c60e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:56.916974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10629a3-8846-4dc8-be05-93e27a62c60e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:56.916974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10629a3-8846-4dc8-be05-93e27a62c60e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:56.918643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10629a3-8846-4dc8-be05-93e27a62c60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:56.935517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10629a3-8846-4dc8-be05-93e27a62c60e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:56.957303 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3338/6646] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:14:56.975561 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3309/6647] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:56.976015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc3296-b054-4106-b2f1-d8c9e01fd3df None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:56.977489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d8fc3296-b054-4106-b2f1-d8c9e01fd3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:56.998551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc3296-b054-4106-b2f1-d8c9e01fd3df None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:57.004277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10629a3-8846-4dc8-be05-93e27a62c60e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:57.011879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a10629a3-8846-4dc8-be05-93e27a62c60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:57.035874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc9008-b656-407d-98e0-ab360f206efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:57.036515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc9008-b656-407d-98e0-ab360f206efa admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:57.040384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc9008-b656-407d-98e0-ab360f206efa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:57.041120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc9008-b656-407d-98e0-ab360f206efa admin admin] PATH_INFO: `/v3/projects/e0c693fbf95b46ffb4e97585e313e577/users/bf2b04522f8f454bbebfc04105e3e8a6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:57.045787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc9008-b656-407d-98e0-ab360f206efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c693fbf95b46ffb4e97585e313e577, user_id=bf2b04522f8f454bbebfc04105e3e8a6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:57.048566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc9008-b656-407d-98e0-ab360f206efa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:57.112202 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3339/6648] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:56 2022] PUT /identity/v3/projects/e0c693fbf95b46ffb4e97585e313e577/users/bf2b04522f8f454bbebfc04105e3e8a6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:57.122324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04c24a-8541-4893-80d4-9c988b636053 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:57.122656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04c24a-8541-4893-80d4-9c988b636053 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:57.122934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04c24a-8541-4893-80d4-9c988b636053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:57.216265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cd04c24a-8541-4893-80d4-9c988b636053 None None] MFA Rules not processed for user `bf2b04522f8f454bbebfc04105e3e8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:57.222479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cd04c24a-8541-4893-80d4-9c988b636053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:57.231928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10629a3-8846-4dc8-be05-93e27a62c60e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:57.377373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3a503-9a19-4140-bf7e-45b15eb2a7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:57.378050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3a503-9a19-4140-bf7e-45b15eb2a7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:57.378336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3a503-9a19-4140-bf7e-45b15eb2a7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:57.378613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3a503-9a19-4140-bf7e-45b15eb2a7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:57.418161 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3340/6649] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:57.442318 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:57.495008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04c24a-8541-4893-80d4-9c988b636053 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:57.496216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cd04c24a-8541-4893-80d4-9c988b636053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:57.526280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3a503-9a19-4140-bf7e-45b15eb2a7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:57.530496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04c24a-8541-4893-80d4-9c988b636053 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:57.532434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3a503-9a19-4140-bf7e-45b15eb2a7f7 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:57.540419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ba33c-04a9-4288-935e-d8829f677cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:57.541101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba33c-04a9-4288-935e-d8829f677cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:57.541416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba33c-04a9-4288-935e-d8829f677cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:57.541720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba33c-04a9-4288-935e-d8829f677cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:57.555314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ba33c-04a9-4288-935e-d8829f677cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:57.556811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ba33c-04a9-4288-935e-d8829f677cc5 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:57.564730 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3310/6650] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:57.579883 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3341/6651] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:14:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:14:58.658427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3a503-9a19-4140-bf7e-45b15eb2a7f7 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:58.661087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eed3a503-9a19-4140-bf7e-45b15eb2a7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:58.704982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3a503-9a19-4140-bf7e-45b15eb2a7f7 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:58.748375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:58.759654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:58.760454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:58.761266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] PATH_INFO: `/v3/projects/be4dc61aad674342855e701484fc5de8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:58.766883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4dc61aad674342855e701484fc5de8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:58.777555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:58.919630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4dc61aad674342855e701484fc5de8', 'request_id': 'req-0abe4390-1ecc-4a6c-b026-aa114b177478'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:58.933994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4dc61aad674342855e701484fc5de8', 'request_id': 'req-0abe4390-1ecc-4a6c-b026-aa114b177478'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:58.951563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4dc61aad674342855e701484fc5de8', 'request_id': 'req-0abe4390-1ecc-4a6c-b026-aa114b177478'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:58.975253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] The token cache is being invalidate because project be4dc61aad674342855e701484fc5de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:14:58.975801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:58.976759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0abe4390-1ecc-4a6c-b026-aa114b177478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:14:58.979064 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3311/6652] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:14:58 2022] DELETE /identity/v3/projects/be4dc61aad674342855e701484fc5de8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:14:58.984235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5a823-18e3-4b15-ba20-7d190119e63f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:58.985202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5a823-18e3-4b15-ba20-7d190119e63f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:58.986656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5a823-18e3-4b15-ba20-7d190119e63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:59.033951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-42e5a823-18e3-4b15-ba20-7d190119e63f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:59.041589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-42e5a823-18e3-4b15-ba20-7d190119e63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:59.191394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6506a-bfc6-4678-a51a-9903090589a6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:59.191932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6506a-bfc6-4678-a51a-9903090589a6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:59.192172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6506a-bfc6-4678-a51a-9903090589a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:59.193536 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3342/6653] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:59.245777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1af6506a-bfc6-4678-a51a-9903090589a6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:14:59.248821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1af6506a-bfc6-4678-a51a-9903090589a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:14:59.261885 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3312/6654] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:14:59.265669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5a823-18e3-4b15-ba20-7d190119e63f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:59.278491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5a823-18e3-4b15-ba20-7d190119e63f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:59.288330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ab4dd-bcbd-454b-92a3-2e8abda32697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:59.289412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ab4dd-bcbd-454b-92a3-2e8abda32697 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:59.289858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ab4dd-bcbd-454b-92a3-2e8abda32697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:59.290321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ab4dd-bcbd-454b-92a3-2e8abda32697 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:59.291232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ab4dd-bcbd-454b-92a3-2e8abda32697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:14:59.291965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ab4dd-bcbd-454b-92a3-2e8abda32697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:59.294369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ab4dd-bcbd-454b-92a3-2e8abda32697 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:59.311114 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3343/6655] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:14:59.315727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6506a-bfc6-4678-a51a-9903090589a6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:59.338074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6506a-bfc6-4678-a51a-9903090589a6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:59.344108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9c2f6-758b-4209-9fb3-0c7c55881204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:59.345594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9c2f6-758b-4209-9fb3-0c7c55881204 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:59.346300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9c2f6-758b-4209-9fb3-0c7c55881204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:59.346858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9c2f6-758b-4209-9fb3-0c7c55881204 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:59.347798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9c2f6-758b-4209-9fb3-0c7c55881204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:59.350973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9c2f6-758b-4209-9fb3-0c7c55881204 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:59.411199 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3313/6656] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:14:59 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:14:59.414065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ab4dd-bcbd-454b-92a3-2e8abda32697 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:59.428703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ab4dd-bcbd-454b-92a3-2e8abda32697 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:59.537362 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:59.581022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b526db-c800-4ac3-91ed-6360ee73ebc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:59.581703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b526db-c800-4ac3-91ed-6360ee73ebc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:59.581986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b526db-c800-4ac3-91ed-6360ee73ebc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:59.582269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b526db-c800-4ac3-91ed-6360ee73ebc2 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:59.589039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b526db-c800-4ac3-91ed-6360ee73ebc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:59.591245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b526db-c800-4ac3-91ed-6360ee73ebc2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:59.657554 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3344/6657] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:14:59 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:14:59.661487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9c2f6-758b-4209-9fb3-0c7c55881204 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:59.676755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9c2f6-758b-4209-9fb3-0c7c55881204 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:59.697667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7484c-0053-4c7d-be8c-1f860e5245e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:59.698310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7484c-0053-4c7d-be8c-1f860e5245e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:59.698596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7484c-0053-4c7d-be8c-1f860e5245e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:59.698859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7484c-0053-4c7d-be8c-1f860e5245e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:59.699525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7484c-0053-4c7d-be8c-1f860e5245e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:59.701331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7484c-0053-4c7d-be8c-1f860e5245e0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:59.727041 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3314/6658] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:59.728953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b526db-c800-4ac3-91ed-6360ee73ebc2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:59.771242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b526db-c800-4ac3-91ed-6360ee73ebc2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:59.787082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8edd4-ffdd-42fe-8a6e-3aa3a94d3e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:59.788549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8edd4-ffdd-42fe-8a6e-3aa3a94d3e45 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:59.789027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8edd4-ffdd-42fe-8a6e-3aa3a94d3e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:59.789501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8edd4-ffdd-42fe-8a6e-3aa3a94d3e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:14:59.792058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8edd4-ffdd-42fe-8a6e-3aa3a94d3e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:14:59.796839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8edd4-ffdd-42fe-8a6e-3aa3a94d3e45 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:14:59.832877 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3345/6659] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:14:59.835786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7484c-0053-4c7d-be8c-1f860e5245e0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:14:59.877788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7484c-0053-4c7d-be8c-1f860e5245e0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:14:59.916656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f6689-3d90-466a-ab06-179e19e7cfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:14:59.917422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f6689-3d90-466a-ab06-179e19e7cfd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:14:59.917753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f6689-3d90-466a-ab06-179e19e7cfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:14:59.918057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f6689-3d90-466a-ab06-179e19e7cfd9 admin admin] PATH_INFO: `/v3/projects/0e5a9b3a2c314ad0b2b2f40dc8fe15b1/users/677e2e6bd7ce41f682abcfd261b37d60/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:00.003121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f6689-3d90-466a-ab06-179e19e7cfd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5a9b3a2c314ad0b2b2f40dc8fe15b1, user_id=677e2e6bd7ce41f682abcfd261b37d60, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:00.005879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f6689-3d90-466a-ab06-179e19e7cfd9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:00.040382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3315/6660] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:14:59 2022] PUT /identity/v3/projects/0e5a9b3a2c314ad0b2b2f40dc8fe15b1/users/677e2e6bd7ce41f682abcfd261b37d60/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:00.053531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a833d-0b1c-40d5-a6d2-03784771837e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:00.054069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a833d-0b1c-40d5-a6d2-03784771837e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:00.054069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a833d-0b1c-40d5-a6d2-03784771837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:00.104954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cc2a833d-0b1c-40d5-a6d2-03784771837e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:00.106192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cc2a833d-0b1c-40d5-a6d2-03784771837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:00.279643 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3346/6661] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:00.346647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f6689-3d90-466a-ab06-179e19e7cfd9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:00.356717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b59f6689-3d90-466a-ab06-179e19e7cfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:00.473907 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:00.553558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f6689-3d90-466a-ab06-179e19e7cfd9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:00.565356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62500064-ecc4-4200-9123-e01a1f11b79b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:00.566250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62500064-ecc4-4200-9123-e01a1f11b79b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:00.566533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62500064-ecc4-4200-9123-e01a1f11b79b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:00.566814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62500064-ecc4-4200-9123-e01a1f11b79b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:00.604524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62500064-ecc4-4200-9123-e01a1f11b79b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:00.606052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62500064-ecc4-4200-9123-e01a1f11b79b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:00.639275 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3316/6662] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:04.168960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a833d-0b1c-40d5-a6d2-03784771837e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:04.171085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cc2a833d-0b1c-40d5-a6d2-03784771837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:04.191747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a833d-0b1c-40d5-a6d2-03784771837e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:04.199450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:04.200592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:04.201068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:04.201506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] PATH_INFO: `/v3/users/3f87559c1328480bb365905eb6e09e67` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:04.205315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f87559c1328480bb365905eb6e09e67)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:04.207540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:04.316341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f87559c1328480bb365905eb6e09e67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:04.336606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f87559c1328480bb365905eb6e09e67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:04.348070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f87559c1328480bb365905eb6e09e67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:04.363431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f87559c1328480bb365905eb6e09e67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:04.364548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f87559c1328480bb365905eb6e09e67'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:04.377001 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3347/6663] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:15:04 2022] DELETE /identity/v3/users/3f87559c1328480bb365905eb6e09e67 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:04.377908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eec8b8-c1f5-42d3-83f7-b3467f8e4114 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:04.378372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eec8b8-c1f5-42d3-83f7-b3467f8e4114 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:04.378608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eec8b8-c1f5-42d3-83f7-b3467f8e4114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:04.413298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-64eec8b8-c1f5-42d3-83f7-b3467f8e4114 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:04.414842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-64eec8b8-c1f5-42d3-83f7-b3467f8e4114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:04.529417 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3317/6664] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:04.540355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:04.542960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:04.639412 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:04.673329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd25b1-7bb4-453c-b40c-22785da76383 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:04.679524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cda6d-c3df-4df0-b002-8ee899f54d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:04.680396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cda6d-c3df-4df0-b002-8ee899f54d69 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:04.680711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cda6d-c3df-4df0-b002-8ee899f54d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:04.680992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cda6d-c3df-4df0-b002-8ee899f54d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:04.694673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cda6d-c3df-4df0-b002-8ee899f54d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:04.698732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cda6d-c3df-4df0-b002-8ee899f54d69 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:04.712269 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3348/6665] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:05.100207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fea752-3e7c-412b-98de-c6729a660eb4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:05.100680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fea752-3e7c-412b-98de-c6729a660eb4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:05.101212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fea752-3e7c-412b-98de-c6729a660eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:05.158814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c8fea752-3e7c-412b-98de-c6729a660eb4 None None] MFA Rules not processed for user `677e2e6bd7ce41f682abcfd261b37d60`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:05.160368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c8fea752-3e7c-412b-98de-c6729a660eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:05.285526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cda6d-c3df-4df0-b002-8ee899f54d69 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:05.287856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6e4cda6d-c3df-4df0-b002-8ee899f54d69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:05.322223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cda6d-c3df-4df0-b002-8ee899f54d69 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:05.362178 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3318/6666] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:05.366409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fea752-3e7c-412b-98de-c6729a660eb4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:05.369008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c8fea752-3e7c-412b-98de-c6729a660eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:05.372337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:05.374498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:05.378904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:05.379428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] PATH_INFO: `/v3/projects/593c68d33d7a4d12b53208a645c7b311` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:05.382653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=593c68d33d7a4d12b53208a645c7b311)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:05.395614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:05.403527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fea752-3e7c-412b-98de-c6729a660eb4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:05.416182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c515de-334f-43cc-a3ce-2668efe148fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:05.416903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c515de-334f-43cc-a3ce-2668efe148fc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:05.417185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c515de-334f-43cc-a3ce-2668efe148fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:05.417461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c515de-334f-43cc-a3ce-2668efe148fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:05.418103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c515de-334f-43cc-a3ce-2668efe148fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:05.425809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c515de-334f-43cc-a3ce-2668efe148fc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:05.483861 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3319/6667] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:15:05 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:15:05.487144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c515de-334f-43cc-a3ce-2668efe148fc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:05.554673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593c68d33d7a4d12b53208a645c7b311', 'request_id': 'req-56cc01cc-0090-4515-8481-557150bc5486'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:05.576274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593c68d33d7a4d12b53208a645c7b311', 'request_id': 'req-56cc01cc-0090-4515-8481-557150bc5486'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:05.584236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593c68d33d7a4d12b53208a645c7b311', 'request_id': 'req-56cc01cc-0090-4515-8481-557150bc5486'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:05.607397 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:05.610370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] The token cache is being invalidate because project 593c68d33d7a4d12b53208a645c7b311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:15:05.610673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:05.611441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:05.628270 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3349/6668] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:15:05 2022] DELETE /identity/v3/projects/593c68d33d7a4d12b53208a645c7b311 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:05.633371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c515de-334f-43cc-a3ce-2668efe148fc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:05.633540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:05.635458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:05.770537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afb157-cf66-4acd-a5f7-0e30d422dbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:05.771167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afb157-cf66-4acd-a5f7-0e30d422dbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:05.771443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afb157-cf66-4acd-a5f7-0e30d422dbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:05.771712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afb157-cf66-4acd-a5f7-0e30d422dbe5 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:05.772348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afb157-cf66-4acd-a5f7-0e30d422dbe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:05.774335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afb157-cf66-4acd-a5f7-0e30d422dbe5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:05.827916 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3320/6669] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:15:05 2022] POST /identity/v3/users => generated 296 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:05.833486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afb157-cf66-4acd-a5f7-0e30d422dbe5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:05.836259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-23afb157-cf66-4acd-a5f7-0e30d422dbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:05.865669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc01cc-0090-4515-8481-557150bc5486 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:05.866953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afb157-cf66-4acd-a5f7-0e30d422dbe5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:05.878572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:05.879814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:05.880672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:05.885645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] PATH_INFO: `/v3/users/bf2b04522f8f454bbebfc04105e3e8a6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:05.888079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2b04522f8f454bbebfc04105e3e8a6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:05.891368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:05.892293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac5a7e-cf69-4f1c-a009-b59af5ea49ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:05.896358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac5a7e-cf69-4f1c-a009-b59af5ea49ef admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:05.897993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac5a7e-cf69-4f1c-a009-b59af5ea49ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:05.898381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac5a7e-cf69-4f1c-a009-b59af5ea49ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:05.900268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac5a7e-cf69-4f1c-a009-b59af5ea49ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:05.903174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac5a7e-cf69-4f1c-a009-b59af5ea49ef admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:05.938599 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3321/6670] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:05.943478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac5a7e-cf69-4f1c-a009-b59af5ea49ef admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:05.974446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac5a7e-cf69-4f1c-a009-b59af5ea49ef admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:05.989578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec370-cc89-44dc-bf30-31176f5dff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:05.994833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec370-cc89-44dc-bf30-31176f5dff8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:05.995176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec370-cc89-44dc-bf30-31176f5dff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:05.995942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec370-cc89-44dc-bf30-31176f5dff8b admin admin] PATH_INFO: `/v3/projects/572faad5fea04d88999587571da68746/users/dc3592528aab497381593a283f384ece/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:06.028122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2b04522f8f454bbebfc04105e3e8a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:06.039224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceec370-cc89-44dc-bf30-31176f5dff8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=572faad5fea04d88999587571da68746, user_id=dc3592528aab497381593a283f384ece, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:06.048362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceec370-cc89-44dc-bf30-31176f5dff8b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:06.055496 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:06.057668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2b04522f8f454bbebfc04105e3e8a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:06.074671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2b04522f8f454bbebfc04105e3e8a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:06.080165 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3322/6671] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:15:05 2022] PUT /identity/v3/projects/572faad5fea04d88999587571da68746/users/dc3592528aab497381593a283f384ece/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:06.086325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec370-cc89-44dc-bf30-31176f5dff8b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:06.088508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2b04522f8f454bbebfc04105e3e8a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:06.089906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2b04522f8f454bbebfc04105e3e8a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:06.112251 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3350/6672] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:15:05 2022] DELETE /identity/v3/users/bf2b04522f8f454bbebfc04105e3e8a6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:06.211814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec370-cc89-44dc-bf30-31176f5dff8b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:06.325727 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:06.338526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f6442-80bd-4a89-97c4-158de1c595c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:06.339176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f6442-80bd-4a89-97c4-158de1c595c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:06.339474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f6442-80bd-4a89-97c4-158de1c595c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:06.339839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f6442-80bd-4a89-97c4-158de1c595c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:06.340522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f6442-80bd-4a89-97c4-158de1c595c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:06.348953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f6442-80bd-4a89-97c4-158de1c595c1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:06.366520 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3323/6673] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:06.370266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:06.371831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:06.408484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78bb50-9f1a-44c5-83b0-d3cce877202f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:06.428516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1887bd-7dd6-4873-8aff-e9722019c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:06.429239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1887bd-7dd6-4873-8aff-e9722019c5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:06.429524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1887bd-7dd6-4873-8aff-e9722019c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:06.435522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1887bd-7dd6-4873-8aff-e9722019c5ca admin admin] PATH_INFO: `/v3/projects/572faad5fea04d88999587571da68746/users/dc3592528aab497381593a283f384ece/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:06.447248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1887bd-7dd6-4873-8aff-e9722019c5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=572faad5fea04d88999587571da68746, user_id=dc3592528aab497381593a283f384ece, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:06.460213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1887bd-7dd6-4873-8aff-e9722019c5ca admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:06.501638 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3351/6674] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:15:06 2022] PUT /identity/v3/projects/572faad5fea04d88999587571da68746/users/dc3592528aab497381593a283f384ece/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:06.935252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f6442-80bd-4a89-97c4-158de1c595c1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:06.939571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1d5f6442-80bd-4a89-97c4-158de1c595c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:06.982590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f6442-80bd-4a89-97c4-158de1c595c1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:07.158207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:07.159950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:07.159950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:07.160222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] PATH_INFO: `/v3/projects/e0c693fbf95b46ffb4e97585e313e577` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:07.162450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c693fbf95b46ffb4e97585e313e577)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:07.166206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:07.302141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c693fbf95b46ffb4e97585e313e577', 'request_id': 'req-9369d813-7833-424c-b4d4-69763ec5e9cc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:07.325470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c693fbf95b46ffb4e97585e313e577', 'request_id': 'req-9369d813-7833-424c-b4d4-69763ec5e9cc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:07.344336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c693fbf95b46ffb4e97585e313e577', 'request_id': 'req-9369d813-7833-424c-b4d4-69763ec5e9cc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:07.368317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] The token cache is being invalidate because project e0c693fbf95b46ffb4e97585e313e577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:15:07.369179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:07.370349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9369d813-7833-424c-b4d4-69763ec5e9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:07.372596 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3324/6675] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:15:06 2022] DELETE /identity/v3/projects/e0c693fbf95b46ffb4e97585e313e577 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:07.378090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b077-d55f-4928-8d63-df1e6119e90b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:07.379670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b077-d55f-4928-8d63-df1e6119e90b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:07.380114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b077-d55f-4928-8d63-df1e6119e90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:07.435763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-20f7b077-d55f-4928-8d63-df1e6119e90b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:07.437318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-20f7b077-d55f-4928-8d63-df1e6119e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:07.543992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3352/6676] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:07.554620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62501e-c202-424e-aa84-1d64a4e9a357 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:07.554942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62501e-c202-424e-aa84-1d64a4e9a357 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:07.555232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62501e-c202-424e-aa84-1d64a4e9a357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:07.578422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2f62501e-c202-424e-aa84-1d64a4e9a357 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:07.579773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2f62501e-c202-424e-aa84-1d64a4e9a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:07.592607 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3325/6677] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:15:07.595015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b077-d55f-4928-8d63-df1e6119e90b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:07.623570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b077-d55f-4928-8d63-df1e6119e90b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:07.630534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88834e9b-d1ee-4b6e-a377-17ac27d31e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:07.631206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88834e9b-d1ee-4b6e-a377-17ac27d31e11 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:07.631875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88834e9b-d1ee-4b6e-a377-17ac27d31e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:07.632065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88834e9b-d1ee-4b6e-a377-17ac27d31e11 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:07.633137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88834e9b-d1ee-4b6e-a377-17ac27d31e11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:15:07.633447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88834e9b-d1ee-4b6e-a377-17ac27d31e11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:07.636329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88834e9b-d1ee-4b6e-a377-17ac27d31e11 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:07.657540 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3353/6678] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:15:07.659489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62501e-c202-424e-aa84-1d64a4e9a357 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:07.671134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62501e-c202-424e-aa84-1d64a4e9a357 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:07.688783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a280f-ed78-43b4-9b6c-70d21f5e1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:07.689522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a280f-ed78-43b4-9b6c-70d21f5e1467 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:07.689817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a280f-ed78-43b4-9b6c-70d21f5e1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:07.690099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a280f-ed78-43b4-9b6c-70d21f5e1467 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:07.691084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a280f-ed78-43b4-9b6c-70d21f5e1467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:07.693408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a280f-ed78-43b4-9b6c-70d21f5e1467 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:07.792391 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3326/6679] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:15:07 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:07.796418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88834e9b-d1ee-4b6e-a377-17ac27d31e11 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:07.815639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88834e9b-d1ee-4b6e-a377-17ac27d31e11 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:07.950032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4ce23-3783-47e6-8d26-7fe97ab2d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:07.950749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4ce23-3783-47e6-8d26-7fe97ab2d9bc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:07.950950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4ce23-3783-47e6-8d26-7fe97ab2d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:07.951235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4ce23-3783-47e6-8d26-7fe97ab2d9bc admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:07.951854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4ce23-3783-47e6-8d26-7fe97ab2d9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:07.954756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4ce23-3783-47e6-8d26-7fe97ab2d9bc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:07.996903 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3354/6680] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:15:07 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:07.998711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a280f-ed78-43b4-9b6c-70d21f5e1467 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:08.020382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a280f-ed78-43b4-9b6c-70d21f5e1467 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:08.032054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9a44a-4564-49cf-a9ec-0ac19a5fdea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:08.032967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a44a-4564-49cf-a9ec-0ac19a5fdea2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:08.033248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a44a-4564-49cf-a9ec-0ac19a5fdea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:08.033504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a44a-4564-49cf-a9ec-0ac19a5fdea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:08.034348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9a44a-4564-49cf-a9ec-0ac19a5fdea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:08.036168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9a44a-4564-49cf-a9ec-0ac19a5fdea2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:08.066426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4ce23-3783-47e6-8d26-7fe97ab2d9bc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:08.067930 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3327/6681] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:08.084377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4ce23-3783-47e6-8d26-7fe97ab2d9bc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:08.104059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c91cf-39be-4f1e-abc6-557894857b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:08.105081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c91cf-39be-4f1e-abc6-557894857b88 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:08.105318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c91cf-39be-4f1e-abc6-557894857b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:08.105592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c91cf-39be-4f1e-abc6-557894857b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:08.106245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c91cf-39be-4f1e-abc6-557894857b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:08.107855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c91cf-39be-4f1e-abc6-557894857b88 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:08.133577 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3355/6682] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:08.138108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9a44a-4564-49cf-a9ec-0ac19a5fdea2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:08.154402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9a44a-4564-49cf-a9ec-0ac19a5fdea2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:08.169839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b2218-7e58-42c2-af58-dcc3f1430820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:08.170923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b2218-7e58-42c2-af58-dcc3f1430820 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:08.171371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b2218-7e58-42c2-af58-dcc3f1430820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:08.171811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b2218-7e58-42c2-af58-dcc3f1430820 admin admin] PATH_INFO: `/v3/projects/33faca87dce04f8babaf8cd60da277a2/users/6f02ed281bd84d96959add22dba653c4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:08.208023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b2218-7e58-42c2-af58-dcc3f1430820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33faca87dce04f8babaf8cd60da277a2, user_id=6f02ed281bd84d96959add22dba653c4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:08.211539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b2218-7e58-42c2-af58-dcc3f1430820 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:08.248560 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3328/6683] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:15:08 2022] PUT /identity/v3/projects/33faca87dce04f8babaf8cd60da277a2/users/6f02ed281bd84d96959add22dba653c4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:08.259115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77ed5-00a2-45b8-927a-5b9c7af3b1b9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:08.259458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77ed5-00a2-45b8-927a-5b9c7af3b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:08.259674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77ed5-00a2-45b8-927a-5b9c7af3b1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:08.350388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-98b77ed5-00a2-45b8-927a-5b9c7af3b1b9 None None] MFA Rules not processed for user `6f02ed281bd84d96959add22dba653c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:08.352768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-98b77ed5-00a2-45b8-927a-5b9c7af3b1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:08.410278 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:08.517526 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3356/6684] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:15:08.523018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b2218-7e58-42c2-af58-dcc3f1430820 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:08.574896 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:08.648303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b2218-7e58-42c2-af58-dcc3f1430820 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:08.654364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a49017-974b-43f1-bea0-f0db9f7f8e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:08.655046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49017-974b-43f1-bea0-f0db9f7f8e14 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:08.655329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49017-974b-43f1-bea0-f0db9f7f8e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:08.655603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49017-974b-43f1-bea0-f0db9f7f8e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:08.656236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a49017-974b-43f1-bea0-f0db9f7f8e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:08.659461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a49017-974b-43f1-bea0-f0db9f7f8e14 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:08.710243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b77ed5-00a2-45b8-927a-5b9c7af3b1b9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:08.721023 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3329/6685] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:15:08 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:08.740061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b77ed5-00a2-45b8-927a-5b9c7af3b1b9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:08.833246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965beb0e-81fb-4719-85a7-d69d9b86a298 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:08.834286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965beb0e-81fb-4719-85a7-d69d9b86a298 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:08.834662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965beb0e-81fb-4719-85a7-d69d9b86a298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:08.924293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-965beb0e-81fb-4719-85a7-d69d9b86a298 None None] MFA Rules not processed for user `dc3592528aab497381593a283f384ece`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:08.927920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-965beb0e-81fb-4719-85a7-d69d9b86a298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:08.943197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e4212-1cf8-4f83-8cc8-fe66b8858325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:08.944195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4212-1cf8-4f83-8cc8-fe66b8858325 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:08.944483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4212-1cf8-4f83-8cc8-fe66b8858325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:08.944785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4212-1cf8-4f83-8cc8-fe66b8858325 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:08.945430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e4212-1cf8-4f83-8cc8-fe66b8858325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:08.947363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e4212-1cf8-4f83-8cc8-fe66b8858325 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:08.992404 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3357/6686] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:15:08 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:08.996029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e4212-1cf8-4f83-8cc8-fe66b8858325 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:09.023270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e4212-1cf8-4f83-8cc8-fe66b8858325 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:09.037198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250bead-08f6-40ff-bb9e-07c38d1b8935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:09.038867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250bead-08f6-40ff-bb9e-07c38d1b8935 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:09.039159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250bead-08f6-40ff-bb9e-07c38d1b8935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:09.039434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250bead-08f6-40ff-bb9e-07c38d1b8935 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:09.040313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250bead-08f6-40ff-bb9e-07c38d1b8935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:09.041972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250bead-08f6-40ff-bb9e-07c38d1b8935 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:09.059303 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3330/6687] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:15:09.075943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc937178-b833-4218-bb83-a55e2b197cb5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:09.077201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc937178-b833-4218-bb83-a55e2b197cb5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:09.078031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc937178-b833-4218-bb83-a55e2b197cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:09.097361 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3358/6688] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:09.098352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250bead-08f6-40ff-bb9e-07c38d1b8935 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:09.115767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250bead-08f6-40ff-bb9e-07c38d1b8935 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:09.136610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553c133-78c1-4a39-a73b-19940ae30cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:09.137356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553c133-78c1-4a39-a73b-19940ae30cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:09.137491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553c133-78c1-4a39-a73b-19940ae30cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:09.137714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553c133-78c1-4a39-a73b-19940ae30cf8 admin admin] PATH_INFO: `/v3/projects/3b54c2cd9baf47ba8012214820ddd0e9/users/d9491230b6f1490bb9e8b091d494a50b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:09.159673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553c133-78c1-4a39-a73b-19940ae30cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b54c2cd9baf47ba8012214820ddd0e9, user_id=d9491230b6f1490bb9e8b091d494a50b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:09.162782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cc937178-b833-4218-bb83-a55e2b197cb5 None None] MFA Rules not processed for user `677e2e6bd7ce41f682abcfd261b37d60`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:09.162976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553c133-78c1-4a39-a73b-19940ae30cf8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:09.163388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cc937178-b833-4218-bb83-a55e2b197cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:09.193695 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3359/6689] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:15:09 2022] PUT /identity/v3/projects/3b54c2cd9baf47ba8012214820ddd0e9/users/d9491230b6f1490bb9e8b091d494a50b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:09.200233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553c133-78c1-4a39-a73b-19940ae30cf8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:09.368054 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3331/6690] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:09.381885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc937178-b833-4218-bb83-a55e2b197cb5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:09.383720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cc937178-b833-4218-bb83-a55e2b197cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:09.405497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553c133-78c1-4a39-a73b-19940ae30cf8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:09.418308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95fd0d-9001-452b-9ae4-68af851b5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:09.421473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95fd0d-9001-452b-9ae4-68af851b5534 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:09.422793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95fd0d-9001-452b-9ae4-68af851b5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:09.423462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95fd0d-9001-452b-9ae4-68af851b5534 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:09.425153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95fd0d-9001-452b-9ae4-68af851b5534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:09.428122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95fd0d-9001-452b-9ae4-68af851b5534 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:09.443638 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3360/6691] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:09.447834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95fd0d-9001-452b-9ae4-68af851b5534 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:09.465270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95fd0d-9001-452b-9ae4-68af851b5534 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:09.478104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff19a4-e008-4576-8222-1c3311b3f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:09.479308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff19a4-e008-4576-8222-1c3311b3f27d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:09.479308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff19a4-e008-4576-8222-1c3311b3f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:09.479713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff19a4-e008-4576-8222-1c3311b3f27d admin admin] PATH_INFO: `/v3/projects/3b54c2cd9baf47ba8012214820ddd0e9/users/d9491230b6f1490bb9e8b091d494a50b/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:09.482345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff19a4-e008-4576-8222-1c3311b3f27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b54c2cd9baf47ba8012214820ddd0e9, user_id=d9491230b6f1490bb9e8b091d494a50b, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:09.488683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff19a4-e008-4576-8222-1c3311b3f27d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:09.492739 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:09.505293 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:09.535566 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3361/6692] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:15:09 2022] PUT /identity/v3/projects/3b54c2cd9baf47ba8012214820ddd0e9/users/d9491230b6f1490bb9e8b091d494a50b/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:09.549117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674fb0b-08d7-4461-9aad-0db3eb336c7c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:09.549980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674fb0b-08d7-4461-9aad-0db3eb336c7c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:09.550469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674fb0b-08d7-4461-9aad-0db3eb336c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:09.585063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc937178-b833-4218-bb83-a55e2b197cb5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:09.592224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7674fb0b-08d7-4461-9aad-0db3eb336c7c None None] MFA Rules not processed for user `d9491230b6f1490bb9e8b091d494a50b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:09.593754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7674fb0b-08d7-4461-9aad-0db3eb336c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:09.706928 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3362/6693] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:09.718327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:09.718573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674fb0b-08d7-4461-9aad-0db3eb336c7c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:09.719543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:09.720265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:09.720265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:09.721188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7674fb0b-08d7-4461-9aad-0db3eb336c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:09.722485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:09.831200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:09.836924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:09.874551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674fb0b-08d7-4461-9aad-0db3eb336c7c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:09.883690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5334d4-4b30-4ddd-9efd-b910676ce171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:09.884354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5334d4-4b30-4ddd-9efd-b910676ce171 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:09.884641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5334d4-4b30-4ddd-9efd-b910676ce171 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:09.884922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5334d4-4b30-4ddd-9efd-b910676ce171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:09.887069 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3332/6694] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:09.905370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5334d4-4b30-4ddd-9efd-b910676ce171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:09.908547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5334d4-4b30-4ddd-9efd-b910676ce171 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:09.936208 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3363/6695] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:10.401492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:10.403151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:10.597250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b7cb4-5149-45f8-94f1-8b8695f47017 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:10.608446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:10.612678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:10.612922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:10.614632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] PATH_INFO: `/v3/users/d14bbb9be09b487a99f14ac691387d87` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:10.616521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14bbb9be09b487a99f14ac691387d87)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:10.621392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:10.661591 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:10.737987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14bbb9be09b487a99f14ac691387d87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:10.760396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14bbb9be09b487a99f14ac691387d87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:10.773587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14bbb9be09b487a99f14ac691387d87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:10.786999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14bbb9be09b487a99f14ac691387d87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:10.787857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14bbb9be09b487a99f14ac691387d87'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:10.796431 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3333/6696] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:15:10 2022] DELETE /identity/v3/users/d14bbb9be09b487a99f14ac691387d87 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:10.801564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0034202-43ab-4180-92fa-a6ca5626c957 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:10.802072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0034202-43ab-4180-92fa-a6ca5626c957 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:10.802307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0034202-43ab-4180-92fa-a6ca5626c957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:10.848072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b0034202-43ab-4180-92fa-a6ca5626c957 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:10.852923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b0034202-43ab-4180-92fa-a6ca5626c957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:10.978329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3364/6697] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:15:11.040220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:11.041770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:11.192460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bf213-f3d9-4c2e-86de-4328cebb8737 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:11.197530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74343d04-e411-4f43-bed4-cb80dbb270a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:11.198266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74343d04-e411-4f43-bed4-cb80dbb270a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:11.198646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74343d04-e411-4f43-bed4-cb80dbb270a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:11.199016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74343d04-e411-4f43-bed4-cb80dbb270a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:11.220055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74343d04-e411-4f43-bed4-cb80dbb270a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:11.221983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74343d04-e411-4f43-bed4-cb80dbb270a8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:11.279447 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3334/6698] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:15:12.198026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620802a1-e3b5-4049-add3-abbec5479cc5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:12.198482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620802a1-e3b5-4049-add3-abbec5479cc5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:12.198588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620802a1-e3b5-4049-add3-abbec5479cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:12.234953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-620802a1-e3b5-4049-add3-abbec5479cc5 None None] MFA Rules not processed for user `4e394c9876db468caaf058abac55f3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:12.236373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-620802a1-e3b5-4049-add3-abbec5479cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:12.304031 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:12.358392 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3365/6699] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:12.368455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867a728-c6b6-4c9b-9fb9-b98da65606f8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:12.369050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867a728-c6b6-4c9b-9fb9-b98da65606f8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:12.369050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867a728-c6b6-4c9b-9fb9-b98da65606f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:12.412207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3867a728-c6b6-4c9b-9fb9-b98da65606f8 None None] MFA Rules not processed for user `4e394c9876db468caaf058abac55f3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:12.413638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3867a728-c6b6-4c9b-9fb9-b98da65606f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:12.453341 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3335/6700] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:12.493129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620802a1-e3b5-4049-add3-abbec5479cc5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:12.494621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-620802a1-e3b5-4049-add3-abbec5479cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:12.538979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620802a1-e3b5-4049-add3-abbec5479cc5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:12.576461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:12.576592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:12.579749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:12.580161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] PATH_INFO: `/v3/projects/6427e911425448799551f73e680c0641` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:12.582214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6427e911425448799551f73e680c0641)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:12.586662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:12.713209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6427e911425448799551f73e680c0641', 'request_id': 'req-613d13fc-b109-4cbb-9a40-bf6d2af30114'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:12.737962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6427e911425448799551f73e680c0641', 'request_id': 'req-613d13fc-b109-4cbb-9a40-bf6d2af30114'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:12.765401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6427e911425448799551f73e680c0641', 'request_id': 'req-613d13fc-b109-4cbb-9a40-bf6d2af30114'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:12.798168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] The token cache is being invalidate because project 6427e911425448799551f73e680c0641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:15:12.798560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:12.803083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-613d13fc-b109-4cbb-9a40-bf6d2af30114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:12.805324 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3366/6701] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:15:12 2022] DELETE /identity/v3/projects/6427e911425448799551f73e680c0641 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:12.810416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69769dd4-97c9-4292-90d2-8d6ded2659ce None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:12.810812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69769dd4-97c9-4292-90d2-8d6ded2659ce None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:12.811042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69769dd4-97c9-4292-90d2-8d6ded2659ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:12.855908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-69769dd4-97c9-4292-90d2-8d6ded2659ce None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:12.858916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-69769dd4-97c9-4292-90d2-8d6ded2659ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:13.024877 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3336/6702] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:13.030939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b64b3-2368-474d-a1bc-31d86665708a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:13.031279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b64b3-2368-474d-a1bc-31d86665708a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:13.031562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b64b3-2368-474d-a1bc-31d86665708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:13.063577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ef5b64b3-2368-474d-a1bc-31d86665708a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:13.065642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ef5b64b3-2368-474d-a1bc-31d86665708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:13.076480 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3367/6703] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:13.080773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69769dd4-97c9-4292-90d2-8d6ded2659ce None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:13.097582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69769dd4-97c9-4292-90d2-8d6ded2659ce None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:13.103096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f86a1-77a8-4a9a-b46f-719b202485dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:13.103720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f86a1-77a8-4a9a-b46f-719b202485dc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:13.104072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f86a1-77a8-4a9a-b46f-719b202485dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:13.104268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f86a1-77a8-4a9a-b46f-719b202485dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:13.104973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f86a1-77a8-4a9a-b46f-719b202485dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:15:13.105319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f86a1-77a8-4a9a-b46f-719b202485dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:13.107017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f86a1-77a8-4a9a-b46f-719b202485dc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:13.122130 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3337/6704] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:15:13.126793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b64b3-2368-474d-a1bc-31d86665708a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:13.139973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b64b3-2368-474d-a1bc-31d86665708a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:13.160584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe349-dc38-4d65-9b49-736db49e8275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:13.161406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe349-dc38-4d65-9b49-736db49e8275 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:13.161694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe349-dc38-4d65-9b49-736db49e8275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:13.161972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe349-dc38-4d65-9b49-736db49e8275 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:13.162620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbe349-dc38-4d65-9b49-736db49e8275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:13.164557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbe349-dc38-4d65-9b49-736db49e8275 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:13.220606 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3368/6705] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:15:13 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:13.223552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f86a1-77a8-4a9a-b46f-719b202485dc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:13.242944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f86a1-77a8-4a9a-b46f-719b202485dc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:13.268153 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:13.414461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca5a4e-1485-41ea-8da5-10403afb58c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:13.415848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca5a4e-1485-41ea-8da5-10403afb58c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:13.416460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca5a4e-1485-41ea-8da5-10403afb58c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:13.416992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca5a4e-1485-41ea-8da5-10403afb58c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:13.419186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca5a4e-1485-41ea-8da5-10403afb58c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:13.428535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca5a4e-1485-41ea-8da5-10403afb58c7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:13.471385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3338/6706] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:15:13 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:13.472123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe349-dc38-4d65-9b49-736db49e8275 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:13.483021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe349-dc38-4d65-9b49-736db49e8275 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:13.501445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803acaa8-714f-48dd-adcd-8a41faed9f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:13.502086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803acaa8-714f-48dd-adcd-8a41faed9f20 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:13.502431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803acaa8-714f-48dd-adcd-8a41faed9f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:13.502774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803acaa8-714f-48dd-adcd-8a41faed9f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:13.503514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803acaa8-714f-48dd-adcd-8a41faed9f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:13.505233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803acaa8-714f-48dd-adcd-8a41faed9f20 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:13.535038 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3369/6707] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:15:13.537859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca5a4e-1485-41ea-8da5-10403afb58c7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:13.558729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca5a4e-1485-41ea-8da5-10403afb58c7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:13.572047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31b8f9-161d-4f8d-9da6-e7d0a39791fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:13.573993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31b8f9-161d-4f8d-9da6-e7d0a39791fb admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:13.574499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31b8f9-161d-4f8d-9da6-e7d0a39791fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:13.575247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31b8f9-161d-4f8d-9da6-e7d0a39791fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:13.578915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31b8f9-161d-4f8d-9da6-e7d0a39791fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:13.582475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31b8f9-161d-4f8d-9da6-e7d0a39791fb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:13.618951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803acaa8-714f-48dd-adcd-8a41faed9f20 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:13.621417 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3339/6708] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:13.629702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803acaa8-714f-48dd-adcd-8a41faed9f20 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:13.648900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf0f2-d0d8-4a89-a639-1498d63cc2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:13.649596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf0f2-d0d8-4a89-a639-1498d63cc2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:13.649878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf0f2-d0d8-4a89-a639-1498d63cc2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:13.650156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf0f2-d0d8-4a89-a639-1498d63cc2ea admin admin] PATH_INFO: `/v3/projects/63d4b22dd49346e0a85704f9303e0d67/users/5710570fffb14a2d8fe36d3a789e5b78/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:13.678389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cf0f2-d0d8-4a89-a639-1498d63cc2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d4b22dd49346e0a85704f9303e0d67, user_id=5710570fffb14a2d8fe36d3a789e5b78, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:13.681948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cf0f2-d0d8-4a89-a639-1498d63cc2ea admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:13.712223 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3370/6709] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:15:13 2022] PUT /identity/v3/projects/63d4b22dd49346e0a85704f9303e0d67/users/5710570fffb14a2d8fe36d3a789e5b78/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:15:13.726681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75c07-dfd1-4f7d-8f2a-23d96a8d075d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:13.727093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75c07-dfd1-4f7d-8f2a-23d96a8d075d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:13.727384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75c07-dfd1-4f7d-8f2a-23d96a8d075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:13.809355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5ff75c07-dfd1-4f7d-8f2a-23d96a8d075d None None] MFA Rules not processed for user `5710570fffb14a2d8fe36d3a789e5b78`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:13.810612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5ff75c07-dfd1-4f7d-8f2a-23d96a8d075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:13.917043 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3340/6710] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:13.931983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf0f2-d0d8-4a89-a639-1498d63cc2ea admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:13.933796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5b5cf0f2-d0d8-4a89-a639-1498d63cc2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:14.123253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf0f2-d0d8-4a89-a639-1498d63cc2ea admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:14.148478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc516e6d-2b8f-4e79-8cc4-4d6f05ff9c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:14.150100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc516e6d-2b8f-4e79-8cc4-4d6f05ff9c3d service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:14.150625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc516e6d-2b8f-4e79-8cc4-4d6f05ff9c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:14.151064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc516e6d-2b8f-4e79-8cc4-4d6f05ff9c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:14.162003 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:14.168461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc516e6d-2b8f-4e79-8cc4-4d6f05ff9c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:14.176389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc516e6d-2b8f-4e79-8cc4-4d6f05ff9c3d service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:14.216752 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3371/6711] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:20.901702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75c07-dfd1-4f7d-8f2a-23d96a8d075d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:21.000633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75c07-dfd1-4f7d-8f2a-23d96a8d075d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:21.006221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:21.007109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:21.007460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:21.007808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] PATH_INFO: `/v3/users/5710570fffb14a2d8fe36d3a789e5b78` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:21.009063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5710570fffb14a2d8fe36d3a789e5b78)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:21.011147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:21.053593 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:21.128351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5710570fffb14a2d8fe36d3a789e5b78'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:21.147975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5710570fffb14a2d8fe36d3a789e5b78'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:21.158450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5710570fffb14a2d8fe36d3a789e5b78'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:21.168758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5710570fffb14a2d8fe36d3a789e5b78'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:21.169877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5710570fffb14a2d8fe36d3a789e5b78'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:21.182819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e994-1b7c-4485-a5f9-a3271f0a8e55 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:21.183751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e994-1b7c-4485-a5f9-a3271f0a8e55 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:21.184218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e994-1b7c-4485-a5f9-a3271f0a8e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:21.193505 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3341/6712] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:15:20 2022] DELETE /identity/v3/users/5710570fffb14a2d8fe36d3a789e5b78 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:21.209903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ea79e994-1b7c-4485-a5f9-a3271f0a8e55 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:21.211423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea79e994-1b7c-4485-a5f9-a3271f0a8e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:21.291856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3372/6713] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:21.304425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:21.316938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:21.521658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2faf8-fb18-4471-839f-0efba5534d9e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:21.530207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80260d91-c923-4f76-93c8-04b43957d46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:21.537587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80260d91-c923-4f76-93c8-04b43957d46e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:21.538054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80260d91-c923-4f76-93c8-04b43957d46e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:21.538369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80260d91-c923-4f76-93c8-04b43957d46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:21.565659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80260d91-c923-4f76-93c8-04b43957d46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:21.571687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80260d91-c923-4f76-93c8-04b43957d46e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:21.609947 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3342/6714] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:24.302455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79e994-1b7c-4485-a5f9-a3271f0a8e55 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:24.304477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea79e994-1b7c-4485-a5f9-a3271f0a8e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:24.332791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79e994-1b7c-4485-a5f9-a3271f0a8e55 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:24.350157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:24.351339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:24.351847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:24.352345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] PATH_INFO: `/v3/projects/63d4b22dd49346e0a85704f9303e0d67` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:24.354071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d4b22dd49346e0a85704f9303e0d67)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:24.356374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:24.446552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d4b22dd49346e0a85704f9303e0d67', 'request_id': 'req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:24.478943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d4b22dd49346e0a85704f9303e0d67', 'request_id': 'req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:24.513592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d4b22dd49346e0a85704f9303e0d67', 'request_id': 'req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:24.541488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] The token cache is being invalidate because project 63d4b22dd49346e0a85704f9303e0d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:15:24.542113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:24.543186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5e81b4c6-cbe2-4cd0-9282-38d6933356cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:24.545713 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3373/6715] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:15:24 2022] DELETE /identity/v3/projects/63d4b22dd49346e0a85704f9303e0d67 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:24.827331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80260d91-c923-4f76-93c8-04b43957d46e service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:24.831658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-80260d91-c923-4f76-93c8-04b43957d46e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:24.863305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80260d91-c923-4f76-93c8-04b43957d46e service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:25.128251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:25.128966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:25.129248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:25.129529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] PATH_INFO: `/v3/users/9ec4eeae3e1c4fa3add01599389ae85a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:25.133687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec4eeae3e1c4fa3add01599389ae85a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:25.136313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:25.231356 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:25.239793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec4eeae3e1c4fa3add01599389ae85a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:25.277257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec4eeae3e1c4fa3add01599389ae85a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:25.310229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec4eeae3e1c4fa3add01599389ae85a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:25.338480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec4eeae3e1c4fa3add01599389ae85a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:25.339804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec4eeae3e1c4fa3add01599389ae85a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:25.356389 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3343/6716] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:15:24 2022] DELETE /identity/v3/users/9ec4eeae3e1c4fa3add01599389ae85a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:25.362494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cf296-95fc-49c4-924c-18d79c2d803a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:25.363037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cf296-95fc-49c4-924c-18d79c2d803a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:25.363493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cf296-95fc-49c4-924c-18d79c2d803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:25.413966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1d9cf296-95fc-49c4-924c-18d79c2d803a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:25.415646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1d9cf296-95fc-49c4-924c-18d79c2d803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:25.513399 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3374/6717] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:25.553466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:25.555643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:25.757163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744d053-b92d-40c6-8bf8-9518071bdb1b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:25.779424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ec8d2-39e0-401e-ab2b-2bd1355bde56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:25.794182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ec8d2-39e0-401e-ab2b-2bd1355bde56 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:25.794732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ec8d2-39e0-401e-ab2b-2bd1355bde56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:25.795126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ec8d2-39e0-401e-ab2b-2bd1355bde56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:25.844237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ec8d2-39e0-401e-ab2b-2bd1355bde56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:25.848903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ec8d2-39e0-401e-ab2b-2bd1355bde56 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:25.884890 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3344/6718] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:28.214288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cf296-95fc-49c4-924c-18d79c2d803a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:28.216448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1d9cf296-95fc-49c4-924c-18d79c2d803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:28.268812 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:28.360189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ec8d2-39e0-401e-ab2b-2bd1355bde56 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:28.361796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c99ec8d2-39e0-401e-ab2b-2bd1355bde56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:28.396904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ec8d2-39e0-401e-ab2b-2bd1355bde56 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:28.409491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:28.410151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:28.410546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:28.410696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] PATH_INFO: `/v3/projects/049244e002194913a6e11a22c9cb2584` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:28.412066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049244e002194913a6e11a22c9cb2584)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:28.419155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:28.478007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cf296-95fc-49c4-924c-18d79c2d803a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:28.484654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:28.485411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:28.485695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:28.485971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:28.489338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:28.516320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:28.518124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:28.533475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049244e002194913a6e11a22c9cb2584', 'request_id': 'req-4b4c226d-ef53-43a5-b4e9-6967727299d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:28.540105 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3375/6719] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:28.545920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049244e002194913a6e11a22c9cb2584', 'request_id': 'req-4b4c226d-ef53-43a5-b4e9-6967727299d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:28.554863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049244e002194913a6e11a22c9cb2584', 'request_id': 'req-4b4c226d-ef53-43a5-b4e9-6967727299d4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:28.571706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] The token cache is being invalidate because project 049244e002194913a6e11a22c9cb2584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:15:28.572228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:28.573162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:28.575602 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3345/6720] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:15:28 2022] DELETE /identity/v3/projects/049244e002194913a6e11a22c9cb2584 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:30.201528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:30.204313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:30.231992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc58876-0489-4a3b-9850-937cbfee3ca2 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:30.245094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:30.246538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:30.366160 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:30.389219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:30.390757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:30.394467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:30.395004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] PATH_INFO: `/v3/users/03fcda874deb4fba9079186248bf70f2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:30.397250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fcda874deb4fba9079186248bf70f2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:30.401586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:30.406276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c226d-ef53-43a5-b4e9-6967727299d4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:30.420080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d2741-17ea-43cb-b602-1b168beb1af0 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9491230b6f1490bb9e8b091d494a50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b54c2cd9baf47ba8012214820ddd0e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:30.421603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d2741-17ea-43cb-b602-1b168beb1af0 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:30.422386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d2741-17ea-43cb-b602-1b168beb1af0 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:30.422821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d2741-17ea-43cb-b602-1b168beb1af0 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:30.424038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d2741-17ea-43cb-b602-1b168beb1af0 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:15:30.424505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d2741-17ea-43cb-b602-1b168beb1af0 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:30.427070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d2741-17ea-43cb-b602-1b168beb1af0 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:30.448375 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3346/6721] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:15:30.449628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d2741-17ea-43cb-b602-1b168beb1af0 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:30.478516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d2741-17ea-43cb-b602-1b168beb1af0 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:30.493644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3128-e747-4ccd-9e6c-f4704da2822d tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9491230b6f1490bb9e8b091d494a50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b54c2cd9baf47ba8012214820ddd0e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:30.494278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3128-e747-4ccd-9e6c-f4704da2822d tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:30.494597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3128-e747-4ccd-9e6c-f4704da2822d tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:30.494886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3128-e747-4ccd-9e6c-f4704da2822d tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:30.495822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb3128-e747-4ccd-9e6c-f4704da2822d tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:30.497539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fcda874deb4fba9079186248bf70f2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:30.497835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb3128-e747-4ccd-9e6c-f4704da2822d tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:30.521984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fcda874deb4fba9079186248bf70f2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:30.538524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fcda874deb4fba9079186248bf70f2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:30.553375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fcda874deb4fba9079186248bf70f2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:30.554527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fcda874deb4fba9079186248bf70f2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:30.564114 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3376/6722] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:15:30 2022] DELETE /identity/v3/users/03fcda874deb4fba9079186248bf70f2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:30.564738 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3347/6723] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:15:30 2022] POST /identity/v3/projects => generated 348 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:30.565930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:30.569363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:30.570425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c23ca2-9c1b-487e-947d-310e1825c254 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:30.570727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c23ca2-9c1b-487e-947d-310e1825c254 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:30.570986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c23ca2-9c1b-487e-947d-310e1825c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:30.612917 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:30.621042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c1c23ca2-9c1b-487e-947d-310e1825c254 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:30.622009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c1c23ca2-9c1b-487e-947d-310e1825c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:30.692216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695eaee-bf27-4540-83f0-2a31a9a0b8c5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:30.703531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9491230b6f1490bb9e8b091d494a50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b54c2cd9baf47ba8012214820ddd0e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:30.704224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:30.704515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:30.704819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:30.705484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:15:30.705792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:30.707411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:30.732864 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3377/6724] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:15:30.767235 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3348/6725] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:30.792006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:30.793910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:30.997001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5370cf-0d27-4b6a-a10f-723a76fcb735 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:31.010862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fff153-d21d-4cde-84a4-9516f046c40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:31.011506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fff153-d21d-4cde-84a4-9516f046c40f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:31.011790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fff153-d21d-4cde-84a4-9516f046c40f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:31.012067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fff153-d21d-4cde-84a4-9516f046c40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:31.039896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fff153-d21d-4cde-84a4-9516f046c40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:31.041460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fff153-d21d-4cde-84a4-9516f046c40f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:31.068597 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3378/6726] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:31.541506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c23ca2-9c1b-487e-947d-310e1825c254 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:31.544069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c1c23ca2-9c1b-487e-947d-310e1825c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:31.562809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c23ca2-9c1b-487e-947d-310e1825c254 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:31.570744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:31.572992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:31.573475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:31.573978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] PATH_INFO: `/v3/projects/952dc4f138254204bca33cec4b0f7b0b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:31.575641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=952dc4f138254204bca33cec4b0f7b0b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:31.578893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:31.638976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952dc4f138254204bca33cec4b0f7b0b', 'request_id': 'req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:31.651297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952dc4f138254204bca33cec4b0f7b0b', 'request_id': 'req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:31.658704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952dc4f138254204bca33cec4b0f7b0b', 'request_id': 'req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:31.679392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] The token cache is being invalidate because project 952dc4f138254204bca33cec4b0f7b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:15:31.680066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:31.682266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d8ccbff4-89e4-4cf9-b183-5dc660a7b4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:31.684841 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3349/6727] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:15:31 2022] DELETE /identity/v3/projects/952dc4f138254204bca33cec4b0f7b0b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:31.689673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9f046-78ad-4a64-90ea-70239f645997 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:31.692248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9f046-78ad-4a64-90ea-70239f645997 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:31.692723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9f046-78ad-4a64-90ea-70239f645997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:31.727989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b2c9f046-78ad-4a64-90ea-70239f645997 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:31.729653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b2c9f046-78ad-4a64-90ea-70239f645997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:31.860582 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3379/6728] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:31.868398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcb89-283b-4498-aec4-e4de7e2dcafe None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:31.868817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcb89-283b-4498-aec4-e4de7e2dcafe None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:31.869028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcb89-283b-4498-aec4-e4de7e2dcafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:31.909227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-659fcb89-283b-4498-aec4-e4de7e2dcafe None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:31.910783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-659fcb89-283b-4498-aec4-e4de7e2dcafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:31.930640 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3350/6729] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:31.938790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9f046-78ad-4a64-90ea-70239f645997 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:31.973403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9f046-78ad-4a64-90ea-70239f645997 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:31.991956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9bfc5-cd0b-4052-8d9a-7c2c06220279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:31.993260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9bfc5-cd0b-4052-8d9a-7c2c06220279 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:31.993707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9bfc5-cd0b-4052-8d9a-7c2c06220279 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:31.994166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9bfc5-cd0b-4052-8d9a-7c2c06220279 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:31.995094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9bfc5-cd0b-4052-8d9a-7c2c06220279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:15:31.995563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9bfc5-cd0b-4052-8d9a-7c2c06220279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:31.998355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9bfc5-cd0b-4052-8d9a-7c2c06220279 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:32.035600 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3380/6730] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:15:32.036404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcb89-283b-4498-aec4-e4de7e2dcafe None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:32.057585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcb89-283b-4498-aec4-e4de7e2dcafe None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:32.074698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934be25-9259-4cb8-8154-584002365d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:32.074698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934be25-9259-4cb8-8154-584002365d04 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:32.074698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934be25-9259-4cb8-8154-584002365d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:32.074698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934be25-9259-4cb8-8154-584002365d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:32.075545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934be25-9259-4cb8-8154-584002365d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:32.078195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934be25-9259-4cb8-8154-584002365d04 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:32.152814 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3351/6731] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:15:32 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:32.157568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9bfc5-cd0b-4052-8d9a-7c2c06220279 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:32.170694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934be25-9259-4cb8-8154-584002365d04 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:32.179146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8934be25-9259-4cb8-8154-584002365d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:32.180520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9bfc5-cd0b-4052-8d9a-7c2c06220279 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:32.252325 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:32.343873 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:32.370521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17b3e-053e-4932-96c3-58b7835eb387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:32.371448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17b3e-053e-4932-96c3-58b7835eb387 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:32.372938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17b3e-053e-4932-96c3-58b7835eb387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:32.373326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17b3e-053e-4932-96c3-58b7835eb387 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:32.374138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a17b3e-053e-4932-96c3-58b7835eb387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:32.376422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a17b3e-053e-4932-96c3-58b7835eb387 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:32.385935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934be25-9259-4cb8-8154-584002365d04 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:32.395514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9491230b6f1490bb9e8b091d494a50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b54c2cd9baf47ba8012214820ddd0e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:32.395828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:32.396220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:32.396608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] PATH_INFO: `/v3/projects/322518cd71234d70a188b2a55f41e5e1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:32.398850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Authorizing `identity:delete_project(project_id=322518cd71234d70a188b2a55f41e5e1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:32.400901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:32.426016 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3381/6732] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:15:32 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:15:32.427849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17b3e-053e-4932-96c3-58b7835eb387 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:32.453301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17b3e-053e-4932-96c3-58b7835eb387 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:32.460966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f7595-7c58-41a3-a447-54df6f8f1ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:32.462000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f7595-7c58-41a3-a447-54df6f8f1ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:32.462283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f7595-7c58-41a3-a447-54df6f8f1ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:32.462566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f7595-7c58-41a3-a447-54df6f8f1ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:32.463222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f7595-7c58-41a3-a447-54df6f8f1ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:32.465561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f7595-7c58-41a3-a447-54df6f8f1ae9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:32.485473 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3382/6733] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:32.489479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f7595-7c58-41a3-a447-54df6f8f1ae9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:32.503816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f7595-7c58-41a3-a447-54df6f8f1ae9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:32.517324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322518cd71234d70a188b2a55f41e5e1', 'request_id': 'req-14991645-fc7e-433d-8e77-3c3389697c90'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:32.529131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322518cd71234d70a188b2a55f41e5e1', 'request_id': 'req-14991645-fc7e-433d-8e77-3c3389697c90'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:32.544123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322518cd71234d70a188b2a55f41e5e1', 'request_id': 'req-14991645-fc7e-433d-8e77-3c3389697c90'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:32.569802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] The token cache is being invalidate because project 322518cd71234d70a188b2a55f41e5e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:15:32.570106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:32.571735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:32.577714 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3352/6734] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:15:32 2022] DELETE /identity/v3/projects/322518cd71234d70a188b2a55f41e5e1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:32.595081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:32.596744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:32.620341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e44836-7099-4f52-b874-e6393bd4e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:32.621473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e44836-7099-4f52-b874-e6393bd4e2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:32.621983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e44836-7099-4f52-b874-e6393bd4e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:32.623001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e44836-7099-4f52-b874-e6393bd4e2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:32.623927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e44836-7099-4f52-b874-e6393bd4e2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:32.626647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e44836-7099-4f52-b874-e6393bd4e2c6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:32.641016 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3383/6735] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:32.645877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e44836-7099-4f52-b874-e6393bd4e2c6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:32.648282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-77e44836-7099-4f52-b874-e6393bd4e2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:32.668254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e44836-7099-4f52-b874-e6393bd4e2c6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:32.674592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e62b77-18c5-44dd-b611-efa28db7b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:32.675953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e62b77-18c5-44dd-b611-efa28db7b0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:32.676375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e62b77-18c5-44dd-b611-efa28db7b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:32.676795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e62b77-18c5-44dd-b611-efa28db7b0c9 admin admin] PATH_INFO: `/v3/projects/dcda6192e206452c813e671e8f57545c/users/41b0926ceb5a4829a08677282ba26907/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:32.699716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e62b77-18c5-44dd-b611-efa28db7b0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcda6192e206452c813e671e8f57545c, user_id=41b0926ceb5a4829a08677282ba26907, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:32.703122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e62b77-18c5-44dd-b611-efa28db7b0c9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:32.717560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14991645-fc7e-433d-8e77-3c3389697c90 tempest-RoutersAdminTest-188186979 tempest-RoutersAdminTest-188186979-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:32.722780 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3384/6736] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:15:32 2022] PUT /identity/v3/projects/dcda6192e206452c813e671e8f57545c/users/41b0926ceb5a4829a08677282ba26907/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:32.732760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0645a-7720-4f26-87f9-f368bd67a0a5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:32.733068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0645a-7720-4f26-87f9-f368bd67a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:32.733520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0645a-7720-4f26-87f9-f368bd67a0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:32.809700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5bd0645a-7720-4f26-87f9-f368bd67a0a5 None None] MFA Rules not processed for user `41b0926ceb5a4829a08677282ba26907`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:32.814491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5bd0645a-7720-4f26-87f9-f368bd67a0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:32.883464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:32.884504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:32.884828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:32.885339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:32.887479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:32.917777 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:32.987668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:32.989391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:33.002698 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3353/6737] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:15:33.003734 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3385/6738] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:33.017220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:33.022585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:33.066216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aac90d-3a52-4b62-be7a-33ee2ac67e16 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:33.092123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e409246-651a-435e-b4fd-b22198da8396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:33.092123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e409246-651a-435e-b4fd-b22198da8396 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:33.092123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e409246-651a-435e-b4fd-b22198da8396 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:33.092123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e409246-651a-435e-b4fd-b22198da8396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:33.120384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e409246-651a-435e-b4fd-b22198da8396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:33.122560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e409246-651a-435e-b4fd-b22198da8396 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:33.172050 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3354/6739] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:37.362950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0645a-7720-4f26-87f9-f368bd67a0a5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:37.386763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0645a-7720-4f26-87f9-f368bd67a0a5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:37.400692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24849035-09a2-4fb9-8a68-4f13f96f3a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:37.401629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849035-09a2-4fb9-8a68-4f13f96f3a9c service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:37.402137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849035-09a2-4fb9-8a68-4f13f96f3a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:37.402972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849035-09a2-4fb9-8a68-4f13f96f3a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:37.407221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-24849035-09a2-4fb9-8a68-4f13f96f3a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:37.422715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24849035-09a2-4fb9-8a68-4f13f96f3a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:37.424438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24849035-09a2-4fb9-8a68-4f13f96f3a9c service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:37.438632 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3386/6740] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:43.158075 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=26 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:47.432795 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:49.306989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e409246-651a-435e-b4fd-b22198da8396 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:49.308476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9e409246-651a-435e-b4fd-b22198da8396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:49.526301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e409246-651a-435e-b4fd-b22198da8396 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:49.550599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:49.551258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:49.551561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:49.551897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:49.557464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:49.605921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:49.607562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:49.660482 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3355/6741] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:51.627199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85268af-4751-4b6d-83f0-e7b1ef760fba None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:51.627682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85268af-4751-4b6d-83f0-e7b1ef760fba None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:51.627961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85268af-4751-4b6d-83f0-e7b1ef760fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:51.686708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b85268af-4751-4b6d-83f0-e7b1ef760fba None None] MFA Rules not processed for user `2052fd7bb1ee432cb3ca4ec07698292c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:51.695846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b85268af-4751-4b6d-83f0-e7b1ef760fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:51.888059 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3387/6742] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:54.864311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:54.866117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:55.005065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3cc3-72e4-4486-94ee-c8da133cf26b service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:55.012202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4b2d6-08fd-49e4-9e8f-3c81ac52876c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:55.013168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4b2d6-08fd-49e4-9e8f-3c81ac52876c service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:55.013609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4b2d6-08fd-49e4-9e8f-3c81ac52876c service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:55.014246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4b2d6-08fd-49e4-9e8f-3c81ac52876c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:55.016694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e1f4b2d6-08fd-49e4-9e8f-3c81ac52876c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:55.042026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4b2d6-08fd-49e4-9e8f-3c81ac52876c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:55.051019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4b2d6-08fd-49e4-9e8f-3c81ac52876c service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:55.077772 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3356/6743] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:15:55.848474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85268af-4751-4b6d-83f0-e7b1ef760fba None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:55.850733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b85268af-4751-4b6d-83f0-e7b1ef760fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:56.093479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85268af-4751-4b6d-83f0-e7b1ef760fba None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:56.119514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:56.121521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:56.122017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:56.122474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] PATH_INFO: `/v3/users/677e2e6bd7ce41f682abcfd261b37d60` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:56.124585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677e2e6bd7ce41f682abcfd261b37d60)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:56.138431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:56.274698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677e2e6bd7ce41f682abcfd261b37d60'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:56.309077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677e2e6bd7ce41f682abcfd261b37d60'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:56.329910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677e2e6bd7ce41f682abcfd261b37d60'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:56.347687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677e2e6bd7ce41f682abcfd261b37d60'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:56.349283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677e2e6bd7ce41f682abcfd261b37d60'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:56.396673 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3388/6744] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:15:55 2022] DELETE /identity/v3/users/677e2e6bd7ce41f682abcfd261b37d60 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:56.955968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4b2d6-08fd-49e4-9e8f-3c81ac52876c service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:56.968483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4b2d6-08fd-49e4-9e8f-3c81ac52876c service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:57.119941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:57.120727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:57.121199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:57.121604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] PATH_INFO: `/v3/projects/0e5a9b3a2c314ad0b2b2f40dc8fe15b1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:57.125398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5a9b3a2c314ad0b2b2f40dc8fe15b1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:57.127450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:57.156775 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:57.215312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'request_id': 'req-bc5702fc-7de4-4364-94cb-6c2f641206f2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.229203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'request_id': 'req-bc5702fc-7de4-4364-94cb-6c2f641206f2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.239470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'request_id': 'req-bc5702fc-7de4-4364-94cb-6c2f641206f2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.282609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] The token cache is being invalidate because project 0e5a9b3a2c314ad0b2b2f40dc8fe15b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:15:57.284333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.285418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.289306 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3357/6745] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:15:56 2022] DELETE /identity/v3/projects/0e5a9b3a2c314ad0b2b2f40dc8fe15b1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:57.292888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:57.297637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:57.317677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20be591-6f32-48ff-9346-c17745f8e753 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:57.349114 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:57.412937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:57.413692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:57.414237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:57.414762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] PATH_INFO: `/v3/users/dc3592528aab497381593a283f384ece` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:57.416925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3592528aab497381593a283f384ece)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:57.420035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:57.547330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3592528aab497381593a283f384ece'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.574702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3592528aab497381593a283f384ece'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.590446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3592528aab497381593a283f384ece'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.603831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3592528aab497381593a283f384ece'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.604922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-aa2a0c93-26c1-4aeb-ad3c-b3a1f976e7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3592528aab497381593a283f384ece'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:57.622494 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3389/6746] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:15:57 2022] DELETE /identity/v3/users/dc3592528aab497381593a283f384ece => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:58.581963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:58.584590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:58.612434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5702fc-7de4-4364-94cb-6c2f641206f2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:58.754583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:58.754583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:58.754583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:58.754583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] PATH_INFO: `/v3/projects/572faad5fea04d88999587571da68746` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:58.756324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572faad5fea04d88999587571da68746)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:58.758704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:58.879372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572faad5fea04d88999587571da68746', 'request_id': 'req-806fb7f6-8693-4fd4-a989-f648dc126a35'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:58.898848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572faad5fea04d88999587571da68746', 'request_id': 'req-806fb7f6-8693-4fd4-a989-f648dc126a35'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:58.908288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572faad5fea04d88999587571da68746', 'request_id': 'req-806fb7f6-8693-4fd4-a989-f648dc126a35'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:58.926221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] The token cache is being invalidate because project 572faad5fea04d88999587571da68746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:15:58.928131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:58.929434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-806fb7f6-8693-4fd4-a989-f648dc126a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:15:58.934833 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3358/6747] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:15:58 2022] DELETE /identity/v3/projects/572faad5fea04d88999587571da68746 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:58.940794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8198-5a71-4e43-9345-4dd9af619a1a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:58.941362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8198-5a71-4e43-9345-4dd9af619a1a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:58.941482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8198-5a71-4e43-9345-4dd9af619a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:58.991194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-790e8198-5a71-4e43-9345-4dd9af619a1a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:58.992741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-790e8198-5a71-4e43-9345-4dd9af619a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:59.147644 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3390/6748] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:59.157098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fbaeb-6345-44c7-a533-93ce4444a5e1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:59.157707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fbaeb-6345-44c7-a533-93ce4444a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:59.158150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fbaeb-6345-44c7-a533-93ce4444a5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:59.188799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b78fbaeb-6345-44c7-a533-93ce4444a5e1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:59.190276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b78fbaeb-6345-44c7-a533-93ce4444a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:59.206711 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3359/6749] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:15:59.210049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e8198-5a71-4e43-9345-4dd9af619a1a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:59.224861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e8198-5a71-4e43-9345-4dd9af619a1a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:59.230397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85902a4b-d8b2-4d76-bfdd-37c55127a686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:59.232991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85902a4b-d8b2-4d76-bfdd-37c55127a686 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:59.233548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85902a4b-d8b2-4d76-bfdd-37c55127a686 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:59.233836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85902a4b-d8b2-4d76-bfdd-37c55127a686 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:59.234819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85902a4b-d8b2-4d76-bfdd-37c55127a686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:15:59.235548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85902a4b-d8b2-4d76-bfdd-37c55127a686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:59.237855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85902a4b-d8b2-4d76-bfdd-37c55127a686 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:59.253780 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3391/6750] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:15:59.258515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fbaeb-6345-44c7-a533-93ce4444a5e1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:59.272700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fbaeb-6345-44c7-a533-93ce4444a5e1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:59.281121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd031ca2-f33b-45b2-a6bc-2c563b7cc674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:59.282487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd031ca2-f33b-45b2-a6bc-2c563b7cc674 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:59.282487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd031ca2-f33b-45b2-a6bc-2c563b7cc674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:59.282487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd031ca2-f33b-45b2-a6bc-2c563b7cc674 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:59.282986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd031ca2-f33b-45b2-a6bc-2c563b7cc674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:59.304064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd031ca2-f33b-45b2-a6bc-2c563b7cc674 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:59.356479 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3360/6751] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:15:59 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:15:59.357640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85902a4b-d8b2-4d76-bfdd-37c55127a686 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:59.369138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85902a4b-d8b2-4d76-bfdd-37c55127a686 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:59.406864 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:59.477915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f74444-b297-42f2-8621-56451676adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:59.479933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74444-b297-42f2-8621-56451676adc8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:59.480326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74444-b297-42f2-8621-56451676adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:59.480741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74444-b297-42f2-8621-56451676adc8 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:59.484281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f74444-b297-42f2-8621-56451676adc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:59.488873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f74444-b297-42f2-8621-56451676adc8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:59.528278 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3392/6752] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:15:59 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:15:59.532700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd031ca2-f33b-45b2-a6bc-2c563b7cc674 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:59.551140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd031ca2-f33b-45b2-a6bc-2c563b7cc674 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:59.559361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78ed2b-1c91-40ae-9075-25281c3c01f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:59.559996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78ed2b-1c91-40ae-9075-25281c3c01f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:59.560274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78ed2b-1c91-40ae-9075-25281c3c01f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:59.561228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78ed2b-1c91-40ae-9075-25281c3c01f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:59.561879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78ed2b-1c91-40ae-9075-25281c3c01f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:59.565270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78ed2b-1c91-40ae-9075-25281c3c01f6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:59.567373 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:59.591766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f74444-b297-42f2-8621-56451676adc8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:59.597020 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3361/6753] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:59.601514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f74444-b297-42f2-8621-56451676adc8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:59.608461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adc055-528f-4546-9dc8-3ecafea88a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:59.609304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc055-528f-4546-9dc8-3ecafea88a68 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:59.609851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc055-528f-4546-9dc8-3ecafea88a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:59.610298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adc055-528f-4546-9dc8-3ecafea88a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:59.611411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adc055-528f-4546-9dc8-3ecafea88a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:59.613232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adc055-528f-4546-9dc8-3ecafea88a68 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:59.634559 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3393/6754] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:15:59.639277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78ed2b-1c91-40ae-9075-25281c3c01f6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:59.653969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78ed2b-1c91-40ae-9075-25281c3c01f6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:15:59.664542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48a6bd-ccc1-49dd-aa14-22268ad5e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:15:59.665635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48a6bd-ccc1-49dd-aa14-22268ad5e0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:59.666169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48a6bd-ccc1-49dd-aa14-22268ad5e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:59.666613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48a6bd-ccc1-49dd-aa14-22268ad5e0eb admin admin] PATH_INFO: `/v3/projects/205951844790437eaeea6227de261d84/users/85b82ff847ec4bb8843cef3853b33d09/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:59.691377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48a6bd-ccc1-49dd-aa14-22268ad5e0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=205951844790437eaeea6227de261d84, user_id=85b82ff847ec4bb8843cef3853b33d09, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:15:59.696532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48a6bd-ccc1-49dd-aa14-22268ad5e0eb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:15:59.719340 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3362/6755] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:15:59 2022] PUT /identity/v3/projects/205951844790437eaeea6227de261d84/users/85b82ff847ec4bb8843cef3853b33d09/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:15:59.724223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6d81-b217-4d51-bcca-82ecd51cd4d6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:15:59.724564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6d81-b217-4d51-bcca-82ecd51cd4d6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:15:59.724808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6d81-b217-4d51-bcca-82ecd51cd4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:15:59.778344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bc7e6d81-b217-4d51-bcca-82ecd51cd4d6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:15:59.780339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc7e6d81-b217-4d51-bcca-82ecd51cd4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:15:59.901068 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3394/6756] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:15:59.921834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48a6bd-ccc1-49dd-aa14-22268ad5e0eb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:15:59.923701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eb48a6bd-ccc1-49dd-aa14-22268ad5e0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:00.056295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48a6bd-ccc1-49dd-aa14-22268ad5e0eb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:00.060526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4309d-b9b0-4c91-8cbc-a1f754324197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:00.061673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4309d-b9b0-4c91-8cbc-a1f754324197 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:00.062544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4309d-b9b0-4c91-8cbc-a1f754324197 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:00.063074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4309d-b9b0-4c91-8cbc-a1f754324197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:00.076830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4309d-b9b0-4c91-8cbc-a1f754324197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:00.078773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4309d-b9b0-4c91-8cbc-a1f754324197 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:00.107147 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3363/6757] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:16:06.413432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8545-13ee-4fea-84f7-10467f596f01 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:06.414029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8545-13ee-4fea-84f7-10467f596f01 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:06.414029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8545-13ee-4fea-84f7-10467f596f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:06.435968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b2bc8545-13ee-4fea-84f7-10467f596f01 None None] MFA Rules not processed for user `2d97060e766f4e1f982d64b425ddd184`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:06.437594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b2bc8545-13ee-4fea-84f7-10467f596f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:06.503421 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3395/6758] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:10.040048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93fe84-2f3a-4dd2-9d01-e10f779bea0c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:10.040576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93fe84-2f3a-4dd2-9d01-e10f779bea0c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:10.040576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93fe84-2f3a-4dd2-9d01-e10f779bea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:10.100654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0a93fe84-2f3a-4dd2-9d01-e10f779bea0c None None] MFA Rules not processed for user `85b82ff847ec4bb8843cef3853b33d09`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:10.102009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a93fe84-2f3a-4dd2-9d01-e10f779bea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:10.199914 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3364/6759] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:10.201220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc8545-13ee-4fea-84f7-10467f596f01 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:10.222507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc8545-13ee-4fea-84f7-10467f596f01 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:10.227410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7dbea-7cb7-42ee-b7bb-deafc8ade301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:10.228035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7dbea-7cb7-42ee-b7bb-deafc8ade301 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:10.228319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7dbea-7cb7-42ee-b7bb-deafc8ade301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:10.228588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7dbea-7cb7-42ee-b7bb-deafc8ade301 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:10.229275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7dbea-7cb7-42ee-b7bb-deafc8ade301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:10.231190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7dbea-7cb7-42ee-b7bb-deafc8ade301 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:10.268428 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3396/6760] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:16:10 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:16:10.272428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93fe84-2f3a-4dd2-9d01-e10f779bea0c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:10.286558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93fe84-2f3a-4dd2-9d01-e10f779bea0c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:10.352520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc200784-3750-4ffa-b141-0e647831dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:10.353446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200784-3750-4ffa-b141-0e647831dbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:10.353756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200784-3750-4ffa-b141-0e647831dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:10.354029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200784-3750-4ffa-b141-0e647831dbe9 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:10.354880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc200784-3750-4ffa-b141-0e647831dbe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:10.356932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc200784-3750-4ffa-b141-0e647831dbe9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:10.367841 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:10.385581 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3365/6761] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:16:10 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:16:10.386773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7dbea-7cb7-42ee-b7bb-deafc8ade301 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:10.399264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7dbea-7cb7-42ee-b7bb-deafc8ade301 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:10.404294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2d738-04b0-4951-869d-5b59d285ee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:10.405112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2d738-04b0-4951-869d-5b59d285ee43 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:10.405897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2d738-04b0-4951-869d-5b59d285ee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:10.405897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2d738-04b0-4951-869d-5b59d285ee43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:10.406426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2d738-04b0-4951-869d-5b59d285ee43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:10.408135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2d738-04b0-4951-869d-5b59d285ee43 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:10.418899 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3397/6762] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:16:10.423424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc200784-3750-4ffa-b141-0e647831dbe9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:10.433915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc200784-3750-4ffa-b141-0e647831dbe9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:10.439730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea1438-a9f4-4863-9f30-8815daface7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:10.440409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea1438-a9f4-4863-9f30-8815daface7f admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:10.440727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea1438-a9f4-4863-9f30-8815daface7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:10.440997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea1438-a9f4-4863-9f30-8815daface7f admin admin] PATH_INFO: `/v3/projects/9af39100791e4975a675cac0d34e6818/users/25f9802b02aa49e398943b2fdfa92fd4/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:10.458289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea1438-a9f4-4863-9f30-8815daface7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af39100791e4975a675cac0d34e6818, user_id=25f9802b02aa49e398943b2fdfa92fd4, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:10.461036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea1438-a9f4-4863-9f30-8815daface7f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:10.474761 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3366/6763] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:16:10 2022] PUT /identity/v3/projects/9af39100791e4975a675cac0d34e6818/users/25f9802b02aa49e398943b2fdfa92fd4/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:16:10.479855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2d738-04b0-4951-869d-5b59d285ee43 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:10.492903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2d738-04b0-4951-869d-5b59d285ee43 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:10.532432 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:10.582767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8a655-9d27-452e-a3fd-5cac814c7d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:10.583861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8a655-9d27-452e-a3fd-5cac814c7d96 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:10.584363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8a655-9d27-452e-a3fd-5cac814c7d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:10.585774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8a655-9d27-452e-a3fd-5cac814c7d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:10.586678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8a655-9d27-452e-a3fd-5cac814c7d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:10.588524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8a655-9d27-452e-a3fd-5cac814c7d96 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:10.602373 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3398/6764] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:16:10.606399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea1438-a9f4-4863-9f30-8815daface7f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:10.618640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea1438-a9f4-4863-9f30-8815daface7f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:10.626613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859b6b-4d2b-4e30-9c3a-a0d58104e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:10.627301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859b6b-4d2b-4e30-9c3a-a0d58104e2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:10.627587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859b6b-4d2b-4e30-9c3a-a0d58104e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:10.628788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859b6b-4d2b-4e30-9c3a-a0d58104e2bf admin admin] PATH_INFO: `/v3/projects/9af39100791e4975a675cac0d34e6818/users/25f9802b02aa49e398943b2fdfa92fd4/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:10.630524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6859b6b-4d2b-4e30-9c3a-a0d58104e2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af39100791e4975a675cac0d34e6818, user_id=25f9802b02aa49e398943b2fdfa92fd4, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:10.633840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6859b6b-4d2b-4e30-9c3a-a0d58104e2bf admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:10.652682 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3367/6765] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:16:10 2022] PUT /identity/v3/projects/9af39100791e4975a675cac0d34e6818/users/25f9802b02aa49e398943b2fdfa92fd4/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:16:20.596346 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=19 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:20.643197 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=3,keystone:SELECT=17 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:24.342392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cf83e-768e-471d-82a6-ffdd11f28e6b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:24.342974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cf83e-768e-471d-82a6-ffdd11f28e6b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:24.342974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cf83e-768e-471d-82a6-ffdd11f28e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:24.406932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2a8cf83e-768e-471d-82a6-ffdd11f28e6b None None] MFA Rules not processed for user `25f9802b02aa49e398943b2fdfa92fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:24.408467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2a8cf83e-768e-471d-82a6-ffdd11f28e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:24.589313 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3399/6766] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:24.593793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859b6b-4d2b-4e30-9c3a-a0d58104e2bf admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:24.595769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c6859b6b-4d2b-4e30-9c3a-a0d58104e2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:24.701771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cf83e-768e-471d-82a6-ffdd11f28e6b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:24.725317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859b6b-4d2b-4e30-9c3a-a0d58104e2bf admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:24.733819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15bc42-4ea6-4780-83b0-6947433748bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:24.734502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15bc42-4ea6-4780-83b0-6947433748bf service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:24.734962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15bc42-4ea6-4780-83b0-6947433748bf service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:24.735241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15bc42-4ea6-4780-83b0-6947433748bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:24.747432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15bc42-4ea6-4780-83b0-6947433748bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:24.751359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15bc42-4ea6-4780-83b0-6947433748bf service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:24.767782 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3368/6767] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:16:24.855974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cf83e-768e-471d-82a6-ffdd11f28e6b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:24.866934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cee81-57c3-4e8d-a40b-067c1c9a7716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:24.867872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cee81-57c3-4e8d-a40b-067c1c9a7716 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:24.868334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cee81-57c3-4e8d-a40b-067c1c9a7716 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:24.868871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cee81-57c3-4e8d-a40b-067c1c9a7716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:24.873214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9b4cee81-57c3-4e8d-a40b-067c1c9a7716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:24.900233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be93182-4ed3-4b63-bb02-760e6ff09e2d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:24.900527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be93182-4ed3-4b63-bb02-760e6ff09e2d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:24.900866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be93182-4ed3-4b63-bb02-760e6ff09e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:24.957572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6be93182-4ed3-4b63-bb02-760e6ff09e2d None None] MFA Rules not processed for user `85b82ff847ec4bb8843cef3853b33d09`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:24.958816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6be93182-4ed3-4b63-bb02-760e6ff09e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:25.079378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cee81-57c3-4e8d-a40b-067c1c9a7716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:25.080199 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3369/6768] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:25.080941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cee81-57c3-4e8d-a40b-067c1c9a7716 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:25.102770 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3400/6769] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:16:26.077544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be93182-4ed3-4b63-bb02-760e6ff09e2d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:26.109770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be93182-4ed3-4b63-bb02-760e6ff09e2d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:26.124951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:26.125603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:26.126009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:26.126289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:26.128210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:26.143082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:26.144551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:26.158471 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3370/6770] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:16:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:16:31.636487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beff56-31fe-4c45-a43e-3d1cfd20dfe7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:31.637552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beff56-31fe-4c45-a43e-3d1cfd20dfe7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:31.637552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beff56-31fe-4c45-a43e-3d1cfd20dfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:31.662110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d8beff56-31fe-4c45-a43e-3d1cfd20dfe7 None None] MFA Rules not processed for user `2d97060e766f4e1f982d64b425ddd184`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:31.663379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d8beff56-31fe-4c45-a43e-3d1cfd20dfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:31.689479 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:31.742748 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3401/6771] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:36.153156 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=65 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:36.965273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:36.967829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:37.126194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aebce-7776-4073-91bb-664908a3ede3 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:37.131597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:37.132517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:37.133029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:37.133463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] PATH_INFO: `/v3/users/6f02ed281bd84d96959add22dba653c4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:37.134818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f02ed281bd84d96959add22dba653c4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:37.137179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:37.255601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f02ed281bd84d96959add22dba653c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:37.298235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f02ed281bd84d96959add22dba653c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:37.313191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f02ed281bd84d96959add22dba653c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:37.322721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f02ed281bd84d96959add22dba653c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:37.325508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f02ed281bd84d96959add22dba653c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:37.351333 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3371/6772] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:16:36 2022] DELETE /identity/v3/users/6f02ed281bd84d96959add22dba653c4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:16:37.353121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72749da-0ca0-4e27-a89f-987716579560 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:37.353613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72749da-0ca0-4e27-a89f-987716579560 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:37.353737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72749da-0ca0-4e27-a89f-987716579560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:37.382602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f72749da-0ca0-4e27-a89f-987716579560 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:37.385460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f72749da-0ca0-4e27-a89f-987716579560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:37.496666 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3402/6773] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:37.505145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:37.506696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:37.609075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f047b-99c0-4308-bf2c-aa0981a43661 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:37.613982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7f750-ac17-4469-9180-7e773678fffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:37.614772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7f750-ac17-4469-9180-7e773678fffa service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:37.615956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7f750-ac17-4469-9180-7e773678fffa service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:37.616280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7f750-ac17-4469-9180-7e773678fffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:37.632121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7f750-ac17-4469-9180-7e773678fffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:37.634076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7f750-ac17-4469-9180-7e773678fffa service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:37.666549 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3372/6774] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:16:38.540043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72749da-0ca0-4e27-a89f-987716579560 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:38.542008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f72749da-0ca0-4e27-a89f-987716579560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:38.572600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72749da-0ca0-4e27-a89f-987716579560 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:38.582127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:38.583263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:38.583907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:38.584401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] PATH_INFO: `/v3/projects/33faca87dce04f8babaf8cd60da277a2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:38.586338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33faca87dce04f8babaf8cd60da277a2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:38.593066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:38.697701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33faca87dce04f8babaf8cd60da277a2', 'request_id': 'req-adbb18af-72ed-4be6-a97b-b1fc862a7f41'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.709600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33faca87dce04f8babaf8cd60da277a2', 'request_id': 'req-adbb18af-72ed-4be6-a97b-b1fc862a7f41'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.717227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33faca87dce04f8babaf8cd60da277a2', 'request_id': 'req-adbb18af-72ed-4be6-a97b-b1fc862a7f41'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.735090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] The token cache is being invalidate because project 33faca87dce04f8babaf8cd60da277a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:16:38.735306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.735966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.738131 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3403/6775] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:16:38 2022] DELETE /identity/v3/projects/33faca87dce04f8babaf8cd60da277a2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:16:38.741841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7f750-ac17-4469-9180-7e773678fffa service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:38.755263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7f750-ac17-4469-9180-7e773678fffa service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:38.789802 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:38.863868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:38.864959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:38.865246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:38.865523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] PATH_INFO: `/v3/users/d9491230b6f1490bb9e8b091d494a50b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:38.866725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9491230b6f1490bb9e8b091d494a50b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:38.868671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:38.925617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9491230b6f1490bb9e8b091d494a50b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.940837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9491230b6f1490bb9e8b091d494a50b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.959058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9491230b6f1490bb9e8b091d494a50b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.973158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9491230b6f1490bb9e8b091d494a50b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.973979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bdfa4320-9732-4fcd-bf62-94188f6a1a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9491230b6f1490bb9e8b091d494a50b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:38.983008 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3373/6776] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:16:38 2022] DELETE /identity/v3/users/d9491230b6f1490bb9e8b091d494a50b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:16:39.272275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:39.274017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:39.296824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb18af-72ed-4be6-a97b-b1fc862a7f41 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:39.382196 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:39.405720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:39.406574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:39.406865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:39.407146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] PATH_INFO: `/v3/projects/3b54c2cd9baf47ba8012214820ddd0e9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:39.409713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b54c2cd9baf47ba8012214820ddd0e9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:39.411771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:39.505022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b54c2cd9baf47ba8012214820ddd0e9', 'request_id': 'req-40fc1712-3e62-42a3-bf38-178b71e1ec8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:39.532701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b54c2cd9baf47ba8012214820ddd0e9', 'request_id': 'req-40fc1712-3e62-42a3-bf38-178b71e1ec8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:39.570311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b54c2cd9baf47ba8012214820ddd0e9', 'request_id': 'req-40fc1712-3e62-42a3-bf38-178b71e1ec8b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:39.597102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] The token cache is being invalidate because project 3b54c2cd9baf47ba8012214820ddd0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:16:39.597886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:39.598979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-40fc1712-3e62-42a3-bf38-178b71e1ec8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:16:39.602606 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3404/6777] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:16:39 2022] DELETE /identity/v3/projects/3b54c2cd9baf47ba8012214820ddd0e9 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:16:39.609470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59024ceb-01f9-454c-b608-ad69460cb14f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:39.609787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59024ceb-01f9-454c-b608-ad69460cb14f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:39.610029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59024ceb-01f9-454c-b608-ad69460cb14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:39.631880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-59024ceb-01f9-454c-b608-ad69460cb14f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:39.633183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-59024ceb-01f9-454c-b608-ad69460cb14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:39.713057 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3374/6778] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:39.720465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc0c23-95e6-4d28-8bf7-2abcdf7079b4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:39.720858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc0c23-95e6-4d28-8bf7-2abcdf7079b4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:39.721361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc0c23-95e6-4d28-8bf7-2abcdf7079b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:39.747873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f6cc0c23-95e6-4d28-8bf7-2abcdf7079b4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:39.749250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f6cc0c23-95e6-4d28-8bf7-2abcdf7079b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:39.758301 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3405/6779] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:39.765010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59024ceb-01f9-454c-b608-ad69460cb14f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:39.780609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59024ceb-01f9-454c-b608-ad69460cb14f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:39.786957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c848bf-5aec-448c-99ba-9c5988f93889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:39.787835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c848bf-5aec-448c-99ba-9c5988f93889 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:39.788542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c848bf-5aec-448c-99ba-9c5988f93889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:39.789371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c848bf-5aec-448c-99ba-9c5988f93889 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:39.790487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c848bf-5aec-448c-99ba-9c5988f93889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:16:39.791045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c848bf-5aec-448c-99ba-9c5988f93889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:39.793112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c848bf-5aec-448c-99ba-9c5988f93889 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:39.813743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3375/6780] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:16:39.818024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc0c23-95e6-4d28-8bf7-2abcdf7079b4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:39.830879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc0c23-95e6-4d28-8bf7-2abcdf7079b4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:39.837489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9da9a-873c-4d9c-840f-f9642e827443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:39.838363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9da9a-873c-4d9c-840f-f9642e827443 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:39.838889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9da9a-873c-4d9c-840f-f9642e827443 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:39.839329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9da9a-873c-4d9c-840f-f9642e827443 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:39.840647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9da9a-873c-4d9c-840f-f9642e827443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:39.847684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9da9a-873c-4d9c-840f-f9642e827443 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:39.956139 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3406/6781] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:16:39 2022] POST /identity/v3/projects => generated 395 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:16:39.960369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c848bf-5aec-448c-99ba-9c5988f93889 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:39.994419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c848bf-5aec-448c-99ba-9c5988f93889 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:40.064037 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:40.169421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf23b1-1d10-4a9a-86e7-f1878f3c185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:40.170332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf23b1-1d10-4a9a-86e7-f1878f3c185b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:40.170567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf23b1-1d10-4a9a-86e7-f1878f3c185b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:40.171039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf23b1-1d10-4a9a-86e7-f1878f3c185b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:40.171792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf23b1-1d10-4a9a-86e7-f1878f3c185b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:40.178004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf23b1-1d10-4a9a-86e7-f1878f3c185b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:40.226879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3376/6782] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:16:39 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:16:40.228201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9da9a-873c-4d9c-840f-f9642e827443 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:40.243441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9da9a-873c-4d9c-840f-f9642e827443 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:40.249862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7469a0-dc56-4709-9142-ff5a68273b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:40.250804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7469a0-dc56-4709-9142-ff5a68273b3c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:40.251189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7469a0-dc56-4709-9142-ff5a68273b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:40.251568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7469a0-dc56-4709-9142-ff5a68273b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:40.252401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7469a0-dc56-4709-9142-ff5a68273b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:40.254254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7469a0-dc56-4709-9142-ff5a68273b3c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:40.270802 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3407/6783] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:16:40.274132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf23b1-1d10-4a9a-86e7-f1878f3c185b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:40.287521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf23b1-1d10-4a9a-86e7-f1878f3c185b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:40.295259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75ab25-a916-4138-94d4-2fbbecd6e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:40.296366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75ab25-a916-4138-94d4-2fbbecd6e199 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:40.296934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75ab25-a916-4138-94d4-2fbbecd6e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:40.298202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75ab25-a916-4138-94d4-2fbbecd6e199 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:40.299236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75ab25-a916-4138-94d4-2fbbecd6e199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:40.304160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75ab25-a916-4138-94d4-2fbbecd6e199 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:40.320374 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3377/6784] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:16:40.325093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7469a0-dc56-4709-9142-ff5a68273b3c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:40.339692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7469a0-dc56-4709-9142-ff5a68273b3c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:40.347305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0db13-125b-4f04-b850-231848d35717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:40.348947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0db13-125b-4f04-b850-231848d35717 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:40.349480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0db13-125b-4f04-b850-231848d35717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:40.349994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0db13-125b-4f04-b850-231848d35717 admin admin] PATH_INFO: `/v3/projects/e005927e15a24b95bc50339a127b8a52/users/26811aeedf60462fb8181ce6c456dbcc/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:40.385570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0db13-125b-4f04-b850-231848d35717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e005927e15a24b95bc50339a127b8a52, user_id=26811aeedf60462fb8181ce6c456dbcc, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:40.389768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0db13-125b-4f04-b850-231848d35717 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:40.413372 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3408/6785] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:16:40 2022] PUT /identity/v3/projects/e005927e15a24b95bc50339a127b8a52/users/26811aeedf60462fb8181ce6c456dbcc/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:16:40.425048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d750-ec6b-4065-b929-dd03efe79ddf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:40.425587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d750-ec6b-4065-b929-dd03efe79ddf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:40.425971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d750-ec6b-4065-b929-dd03efe79ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:40.457158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b689d750-ec6b-4065-b929-dd03efe79ddf None None] MFA Rules not processed for user `26811aeedf60462fb8181ce6c456dbcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:40.458911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b689d750-ec6b-4065-b929-dd03efe79ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:40.551505 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3378/6786] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:40.571800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0db13-125b-4f04-b850-231848d35717 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:40.575068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eae0db13-125b-4f04-b850-231848d35717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:40.645854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0db13-125b-4f04-b850-231848d35717 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:40.651186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c7b84-03b2-41ee-8124-759b09bbc228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:40.651978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c7b84-03b2-41ee-8124-759b09bbc228 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:40.652330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c7b84-03b2-41ee-8124-759b09bbc228 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:40.652820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c7b84-03b2-41ee-8124-759b09bbc228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:40.663392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c7b84-03b2-41ee-8124-759b09bbc228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:40.665149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c7b84-03b2-41ee-8124-759b09bbc228 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:40.675478 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3409/6787] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:16:40 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:16:43.947492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cff10-30ae-466b-8f30-8e17f3257557 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:43.948025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cff10-30ae-466b-8f30-8e17f3257557 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:43.948904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cff10-30ae-466b-8f30-8e17f3257557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:44.003796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-145cff10-30ae-466b-8f30-8e17f3257557 None None] MFA Rules not processed for user `85b82ff847ec4bb8843cef3853b33d09`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:44.006426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-145cff10-30ae-466b-8f30-8e17f3257557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:44.168382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3379/6788] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:50.671304 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:54.157080 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:55.150483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf80bc-7c1c-4ec6-acc3-be6fceb5688d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:55.150483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf80bc-7c1c-4ec6-acc3-be6fceb5688d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:55.150483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf80bc-7c1c-4ec6-acc3-be6fceb5688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:55.283286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6aaf80bc-7c1c-4ec6-acc3-be6fceb5688d None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:16:55.284760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6aaf80bc-7c1c-4ec6-acc3-be6fceb5688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:55.358171 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3410/6789] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:16:55.406602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cff10-30ae-466b-8f30-8e17f3257557 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:16:55.408144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-145cff10-30ae-466b-8f30-8e17f3257557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:16:55.507210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cff10-30ae-466b-8f30-8e17f3257557 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:16:55.512611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce26033-190b-4583-b4a2-5732e7bc7159 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:16:55.513342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce26033-190b-4583-b4a2-5732e7bc7159 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:16:55.513635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce26033-190b-4583-b4a2-5732e7bc7159 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:16:55.513935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce26033-190b-4583-b4a2-5732e7bc7159 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:16:55.522536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce26033-190b-4583-b4a2-5732e7bc7159 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:16:55.524125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce26033-190b-4583-b4a2-5732e7bc7159 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:16:55.533760 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3380/6790] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:16:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:17:01.341541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf80bc-7c1c-4ec6-acc3-be6fceb5688d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:01.452456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf80bc-7c1c-4ec6-acc3-be6fceb5688d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:01.460021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:01.461041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:01.461549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:01.462054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] PATH_INFO: `/v3/users/26811aeedf60462fb8181ce6c456dbcc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:01.463472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26811aeedf60462fb8181ce6c456dbcc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:01.466935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:01.570063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26811aeedf60462fb8181ce6c456dbcc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:01.588058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26811aeedf60462fb8181ce6c456dbcc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:01.601657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26811aeedf60462fb8181ce6c456dbcc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:01.611190 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:01.634967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26811aeedf60462fb8181ce6c456dbcc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:01.638442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26811aeedf60462fb8181ce6c456dbcc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:01.659617 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3411/6791] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:17:01 2022] DELETE /identity/v3/users/26811aeedf60462fb8181ce6c456dbcc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:01.664388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67cbf4-6445-4994-8efb-690c6677a9b7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:01.665484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67cbf4-6445-4994-8efb-690c6677a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:01.668829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67cbf4-6445-4994-8efb-690c6677a9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:01.710187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fb67cbf4-6445-4994-8efb-690c6677a9b7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:01.711822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fb67cbf4-6445-4994-8efb-690c6677a9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:01.843619 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3381/6792] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:01.853414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:01.855772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:01.965582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827e282-0c46-4e04-bc90-98ea17b607a3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:01.974074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72955721-a232-4d97-b7bb-5ad049a4ad0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:01.974943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72955721-a232-4d97-b7bb-5ad049a4ad0c service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:01.975301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72955721-a232-4d97-b7bb-5ad049a4ad0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:01.975643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72955721-a232-4d97-b7bb-5ad049a4ad0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:01.992241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72955721-a232-4d97-b7bb-5ad049a4ad0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:01.994209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72955721-a232-4d97-b7bb-5ad049a4ad0c service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:02.009438 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3412/6793] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:02.303337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67cbf4-6445-4994-8efb-690c6677a9b7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:02.305029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fb67cbf4-6445-4994-8efb-690c6677a9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:02.330423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67cbf4-6445-4994-8efb-690c6677a9b7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:02.347079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:02.347753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:02.348040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:02.348318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] PATH_INFO: `/v3/projects/e005927e15a24b95bc50339a127b8a52` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:02.350102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e005927e15a24b95bc50339a127b8a52)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:02.353447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:02.449273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e005927e15a24b95bc50339a127b8a52', 'request_id': 'req-23dd676d-7b2f-4e93-a594-ed083d510e5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:02.471571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e005927e15a24b95bc50339a127b8a52', 'request_id': 'req-23dd676d-7b2f-4e93-a594-ed083d510e5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:02.485060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e005927e15a24b95bc50339a127b8a52', 'request_id': 'req-23dd676d-7b2f-4e93-a594-ed083d510e5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:02.504052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] The token cache is being invalidate because project e005927e15a24b95bc50339a127b8a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:17:02.504354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:02.505133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23dd676d-7b2f-4e93-a594-ed083d510e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:02.507871 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3382/6794] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:17:02 2022] DELETE /identity/v3/projects/e005927e15a24b95bc50339a127b8a52 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:02.513627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ca5f-09be-4b58-85d1-7c7efa1e61a3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:02.514226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ca5f-09be-4b58-85d1-7c7efa1e61a3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:02.514226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ca5f-09be-4b58-85d1-7c7efa1e61a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:02.557239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3003ca5f-09be-4b58-85d1-7c7efa1e61a3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:02.558534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3003ca5f-09be-4b58-85d1-7c7efa1e61a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:02.676370 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3413/6795] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:02.677834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7326-4d2f-4d0c-be4c-ebde262e12cd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:02.678788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7326-4d2f-4d0c-be4c-ebde262e12cd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:02.679350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7326-4d2f-4d0c-be4c-ebde262e12cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:02.692491 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:02.732287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-198a7326-4d2f-4d0c-be4c-ebde262e12cd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:02.733845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-198a7326-4d2f-4d0c-be4c-ebde262e12cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:02.752481 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3383/6796] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:17:02.757399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003ca5f-09be-4b58-85d1-7c7efa1e61a3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:02.779192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003ca5f-09be-4b58-85d1-7c7efa1e61a3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:02.788300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef546da-12f3-42b7-ab90-d6dc3496d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:02.788977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef546da-12f3-42b7-ab90-d6dc3496d8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:02.789374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef546da-12f3-42b7-ab90-d6dc3496d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:02.789665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef546da-12f3-42b7-ab90-d6dc3496d8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:02.790656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef546da-12f3-42b7-ab90-d6dc3496d8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:17:02.791067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef546da-12f3-42b7-ab90-d6dc3496d8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:02.794561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef546da-12f3-42b7-ab90-d6dc3496d8b8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:02.841459 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3414/6797] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:17:02.842758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7326-4d2f-4d0c-be4c-ebde262e12cd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:02.859905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7326-4d2f-4d0c-be4c-ebde262e12cd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:02.871656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d6eae-f774-4f96-abf8-c9f887c53c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:02.872422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6eae-f774-4f96-abf8-c9f887c53c2f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:02.873844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6eae-f774-4f96-abf8-c9f887c53c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:02.874307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6eae-f774-4f96-abf8-c9f887c53c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:02.875160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d6eae-f774-4f96-abf8-c9f887c53c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:02.881231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d6eae-f774-4f96-abf8-c9f887c53c2f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:02.946621 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3384/6798] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:17:02 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:02.951971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef546da-12f3-42b7-ab90-d6dc3496d8b8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:02.971694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef546da-12f3-42b7-ab90-d6dc3496d8b8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:03.072922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313310-ed5e-4d14-896d-9e2dae1a16d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:03.073979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313310-ed5e-4d14-896d-9e2dae1a16d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:03.073979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313310-ed5e-4d14-896d-9e2dae1a16d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:03.075436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313310-ed5e-4d14-896d-9e2dae1a16d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:03.079014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0313310-ed5e-4d14-896d-9e2dae1a16d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:03.086548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0313310-ed5e-4d14-896d-9e2dae1a16d0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:03.137524 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3415/6799] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:17:02 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:03.142938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d6eae-f774-4f96-abf8-c9f887c53c2f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:03.157644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d6eae-f774-4f96-abf8-c9f887c53c2f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:03.171911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fdf38-29e5-491f-bd67-a0b78873087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:03.174392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fdf38-29e5-491f-bd67-a0b78873087b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:03.174897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fdf38-29e5-491f-bd67-a0b78873087b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:03.175399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fdf38-29e5-491f-bd67-a0b78873087b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:03.177733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fdf38-29e5-491f-bd67-a0b78873087b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:03.183372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fdf38-29e5-491f-bd67-a0b78873087b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:03.207583 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3385/6800] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:03.210584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313310-ed5e-4d14-896d-9e2dae1a16d0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:03.233826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313310-ed5e-4d14-896d-9e2dae1a16d0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:03.257231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614268f1-7950-410e-8d7c-898ac60ed31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:03.258166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614268f1-7950-410e-8d7c-898ac60ed31e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:03.258621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614268f1-7950-410e-8d7c-898ac60ed31e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:03.259137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614268f1-7950-410e-8d7c-898ac60ed31e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:03.259989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614268f1-7950-410e-8d7c-898ac60ed31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:03.261885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614268f1-7950-410e-8d7c-898ac60ed31e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:03.279356 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:03.292724 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3416/6801] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:03.297376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fdf38-29e5-491f-bd67-a0b78873087b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:03.316165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fdf38-29e5-491f-bd67-a0b78873087b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:03.324923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8c617-c36d-48a3-9ed8-0b65d59f9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:03.325860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8c617-c36d-48a3-9ed8-0b65d59f9124 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:03.326307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8c617-c36d-48a3-9ed8-0b65d59f9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:03.326849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8c617-c36d-48a3-9ed8-0b65d59f9124 admin admin] PATH_INFO: `/v3/projects/e6a0eeee92584780b53434f23def6785/users/94e761dad2044ac985214d7a9b926f7d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:03.351974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8c617-c36d-48a3-9ed8-0b65d59f9124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a0eeee92584780b53434f23def6785, user_id=94e761dad2044ac985214d7a9b926f7d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:03.358035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8c617-c36d-48a3-9ed8-0b65d59f9124 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:03.385449 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3386/6802] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:03 2022] PUT /identity/v3/projects/e6a0eeee92584780b53434f23def6785/users/94e761dad2044ac985214d7a9b926f7d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:03.396506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165734a-cd58-41a1-a264-fd3382279fd6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:03.396843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165734a-cd58-41a1-a264-fd3382279fd6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:03.397090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165734a-cd58-41a1-a264-fd3382279fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:03.482359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6165734a-cd58-41a1-a264-fd3382279fd6 None None] MFA Rules not processed for user `94e761dad2044ac985214d7a9b926f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:03.487674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6165734a-cd58-41a1-a264-fd3382279fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:03.683903 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3417/6803] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:03.694927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8c617-c36d-48a3-9ed8-0b65d59f9124 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:03.697042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-65c8c617-c36d-48a3-9ed8-0b65d59f9124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:03.835350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8c617-c36d-48a3-9ed8-0b65d59f9124 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:03.844201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9666-b2db-401c-9fd0-cf4a0e2e7137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:03.845197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9666-b2db-401c-9fd0-cf4a0e2e7137 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:03.846973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9666-b2db-401c-9fd0-cf4a0e2e7137 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:03.846973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9666-b2db-401c-9fd0-cf4a0e2e7137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:03.859956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a9666-b2db-401c-9fd0-cf4a0e2e7137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:03.861717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a9666-b2db-401c-9fd0-cf4a0e2e7137 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:03.874746 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3387/6804] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:06.503850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165734a-cd58-41a1-a264-fd3382279fd6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:06.505455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6165734a-cd58-41a1-a264-fd3382279fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:06.627391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165734a-cd58-41a1-a264-fd3382279fd6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:06.636090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb7fa2-9d43-4e21-b483-9627fd2a8fa3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:06.637372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb7fa2-9d43-4e21-b483-9627fd2a8fa3 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:06.637822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb7fa2-9d43-4e21-b483-9627fd2a8fa3 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:06.638363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb7fa2-9d43-4e21-b483-9627fd2a8fa3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:06.640945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-14cb7fa2-9d43-4e21-b483-9627fd2a8fa3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:06.658715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb7fa2-9d43-4e21-b483-9627fd2a8fa3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:06.660862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb7fa2-9d43-4e21-b483-9627fd2a8fa3 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:06.704661 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3418/6805] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:08.324173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9666-b2db-401c-9fd0-cf4a0e2e7137 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:08.349967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9666-b2db-401c-9fd0-cf4a0e2e7137 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:08.371584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a729228-e80a-4387-b8f4-eee0d19d66f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:08.372635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a729228-e80a-4387-b8f4-eee0d19d66f7 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:08.373228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a729228-e80a-4387-b8f4-eee0d19d66f7 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:08.373770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a729228-e80a-4387-b8f4-eee0d19d66f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:08.377001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8a729228-e80a-4387-b8f4-eee0d19d66f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:08.409209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a729228-e80a-4387-b8f4-eee0d19d66f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:08.412074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a729228-e80a-4387-b8f4-eee0d19d66f7 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:08.459559 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3388/6806] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:14.568303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb7fa2-9d43-4e21-b483-9627fd2a8fa3 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:14.704491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb7fa2-9d43-4e21-b483-9627fd2a8fa3 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:14.709908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:14.713518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:14.714240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:14.714740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] PATH_INFO: `/v3/users/94e761dad2044ac985214d7a9b926f7d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:14.716397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e761dad2044ac985214d7a9b926f7d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:14.718718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:14.769570 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:14.858799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e761dad2044ac985214d7a9b926f7d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:14.891988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e761dad2044ac985214d7a9b926f7d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:14.915429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e761dad2044ac985214d7a9b926f7d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:14.930562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e761dad2044ac985214d7a9b926f7d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:14.931561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e761dad2044ac985214d7a9b926f7d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:14.953827 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3419/6807] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:17:14 2022] DELETE /identity/v3/users/94e761dad2044ac985214d7a9b926f7d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:14.955422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0b66e-006f-4893-bf71-38c8d0923880 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:14.955923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0b66e-006f-4893-bf71-38c8d0923880 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:14.956039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0b66e-006f-4893-bf71-38c8d0923880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:15.014522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ccb0b66e-006f-4893-bf71-38c8d0923880 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:15.017572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ccb0b66e-006f-4893-bf71-38c8d0923880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:15.158049 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3389/6808] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:17:15.168069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:15.169672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:15.284316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3bb3d-d208-4d8b-8bc7-17adada351b2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:15.288306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aaadf-4c43-4ae7-a5bf-f267a7cf80d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:15.289151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aaadf-4c43-4ae7-a5bf-f267a7cf80d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:15.289442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aaadf-4c43-4ae7-a5bf-f267a7cf80d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:15.289721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aaadf-4c43-4ae7-a5bf-f267a7cf80d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:15.301223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aaadf-4c43-4ae7-a5bf-f267a7cf80d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:15.303104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aaadf-4c43-4ae7-a5bf-f267a7cf80d8 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:15.321092 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3420/6809] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:15.640736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0b66e-006f-4893-bf71-38c8d0923880 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:15.642538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ccb0b66e-006f-4893-bf71-38c8d0923880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:15.657547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0b66e-006f-4893-bf71-38c8d0923880 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:15.674931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:15.681641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:15.687557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:15.688077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] PATH_INFO: `/v3/projects/e6a0eeee92584780b53434f23def6785` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:15.691231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a0eeee92584780b53434f23def6785)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:15.693356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:15.751876 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:15.846287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a0eeee92584780b53434f23def6785', 'request_id': 'req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:15.872340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a0eeee92584780b53434f23def6785', 'request_id': 'req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:15.884965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a0eeee92584780b53434f23def6785', 'request_id': 'req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:15.898193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] The token cache is being invalidate because project e6a0eeee92584780b53434f23def6785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:17:15.898557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:15.899631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-cc6c29e3-21e6-4df5-a1c8-4ddae88614de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:15.902259 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3390/6810] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:17:15 2022] DELETE /identity/v3/projects/e6a0eeee92584780b53434f23def6785 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:15.907204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ebce-ab22-42ec-a27f-c49e2d2e4f60 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:15.908019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ebce-ab22-42ec-a27f-c49e2d2e4f60 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:15.908473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ebce-ab22-42ec-a27f-c49e2d2e4f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:15.939796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a549ebce-ab22-42ec-a27f-c49e2d2e4f60 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:15.941196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a549ebce-ab22-42ec-a27f-c49e2d2e4f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:16.051189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4ba25-ae55-4b8d-a31f-7605c9ff817f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:16.053429 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3421/6811] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:16.053553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4ba25-ae55-4b8d-a31f-7605c9ff817f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:16.053794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4ba25-ae55-4b8d-a31f-7605c9ff817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:16.133293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7cd4ba25-ae55-4b8d-a31f-7605c9ff817f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:16.135163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7cd4ba25-ae55-4b8d-a31f-7605c9ff817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:16.165865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3391/6812] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:16.171700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549ebce-ab22-42ec-a27f-c49e2d2e4f60 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:16.189486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549ebce-ab22-42ec-a27f-c49e2d2e4f60 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:16.203361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b08dc6-04ea-4f3a-a075-5b8ad849d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:16.205287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b08dc6-04ea-4f3a-a075-5b8ad849d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:16.205689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b08dc6-04ea-4f3a-a075-5b8ad849d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:16.205980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b08dc6-04ea-4f3a-a075-5b8ad849d0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:16.207376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b08dc6-04ea-4f3a-a075-5b8ad849d0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:17:16.207799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b08dc6-04ea-4f3a-a075-5b8ad849d0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:16.212016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b08dc6-04ea-4f3a-a075-5b8ad849d0a1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:16.229327 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3422/6813] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:17:16.233842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4ba25-ae55-4b8d-a31f-7605c9ff817f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:16.245270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4ba25-ae55-4b8d-a31f-7605c9ff817f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:16.258393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f4409-c579-49b1-bc3d-e899f4670465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:16.259165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f4409-c579-49b1-bc3d-e899f4670465 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:16.259547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f4409-c579-49b1-bc3d-e899f4670465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:16.261647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f4409-c579-49b1-bc3d-e899f4670465 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:16.262605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f4409-c579-49b1-bc3d-e899f4670465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:16.264935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f4409-c579-49b1-bc3d-e899f4670465 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:16.350095 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3392/6814] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:17:16 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:16.355178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b08dc6-04ea-4f3a-a075-5b8ad849d0a1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:16.372011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b08dc6-04ea-4f3a-a075-5b8ad849d0a1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:16.436774 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:16.493448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a172e83-835c-462b-9273-07787a1acd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:16.494088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a172e83-835c-462b-9273-07787a1acd3d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:16.494928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a172e83-835c-462b-9273-07787a1acd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:16.495362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a172e83-835c-462b-9273-07787a1acd3d admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:16.495938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a172e83-835c-462b-9273-07787a1acd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:16.498029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a172e83-835c-462b-9273-07787a1acd3d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:16.526048 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3423/6815] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:17:16 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:16.530071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f4409-c579-49b1-bc3d-e899f4670465 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:16.543620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f4409-c579-49b1-bc3d-e899f4670465 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:16.551240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41fa5-20e9-4586-ae5a-7311293afe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:16.552886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41fa5-20e9-4586-ae5a-7311293afe4b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:16.553435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41fa5-20e9-4586-ae5a-7311293afe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:16.553921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41fa5-20e9-4586-ae5a-7311293afe4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:16.554814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c41fa5-20e9-4586-ae5a-7311293afe4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:16.556683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c41fa5-20e9-4586-ae5a-7311293afe4b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:16.570385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3393/6816] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:16.574271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a172e83-835c-462b-9273-07787a1acd3d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:16.592799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a172e83-835c-462b-9273-07787a1acd3d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:16.607517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508a2e-6bde-4272-b2a0-1461b002ac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:16.608252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508a2e-6bde-4272-b2a0-1461b002ac69 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:16.608615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508a2e-6bde-4272-b2a0-1461b002ac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:16.608981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508a2e-6bde-4272-b2a0-1461b002ac69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:16.610122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61508a2e-6bde-4272-b2a0-1461b002ac69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:16.612665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61508a2e-6bde-4272-b2a0-1461b002ac69 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:16.647609 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3424/6817] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:16.649270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41fa5-20e9-4586-ae5a-7311293afe4b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:16.663948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41fa5-20e9-4586-ae5a-7311293afe4b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:16.670379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c8b63-2786-40ec-90c5-efc6afcc8f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:16.671534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c8b63-2786-40ec-90c5-efc6afcc8f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:16.671991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c8b63-2786-40ec-90c5-efc6afcc8f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:16.672455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c8b63-2786-40ec-90c5-efc6afcc8f01 admin admin] PATH_INFO: `/v3/projects/d9902a3a41a042ee900d794adeb0485b/users/80869e27d9024d6eb6a75e0cc0d28b2f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:16.692034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c8b63-2786-40ec-90c5-efc6afcc8f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9902a3a41a042ee900d794adeb0485b, user_id=80869e27d9024d6eb6a75e0cc0d28b2f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:16.695127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c8b63-2786-40ec-90c5-efc6afcc8f01 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:16.716077 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3394/6818] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:16 2022] PUT /identity/v3/projects/d9902a3a41a042ee900d794adeb0485b/users/80869e27d9024d6eb6a75e0cc0d28b2f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:16.728025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f296-7c05-4fdd-9fdb-b18c4a975aa1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:16.728310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f296-7c05-4fdd-9fdb-b18c4a975aa1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:16.728587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f296-7c05-4fdd-9fdb-b18c4a975aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:16.762971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5526f296-7c05-4fdd-9fdb-b18c4a975aa1 None None] MFA Rules not processed for user `80869e27d9024d6eb6a75e0cc0d28b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:16.764233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5526f296-7c05-4fdd-9fdb-b18c4a975aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:16.861411 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3425/6819] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:16.873556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c8b63-2786-40ec-90c5-efc6afcc8f01 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:16.875493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a31c8b63-2786-40ec-90c5-efc6afcc8f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:16.950769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c8b63-2786-40ec-90c5-efc6afcc8f01 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:16.955365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2413b-15c8-48dc-affb-a47c58591db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:16.956806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2413b-15c8-48dc-affb-a47c58591db9 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:16.957123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2413b-15c8-48dc-affb-a47c58591db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:16.957396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2413b-15c8-48dc-affb-a47c58591db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:16.969928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2413b-15c8-48dc-affb-a47c58591db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:16.972309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2413b-15c8-48dc-affb-a47c58591db9 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:16.984273 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3395/6820] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:22.954047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f296-7c05-4fdd-9fdb-b18c4a975aa1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:22.955498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5526f296-7c05-4fdd-9fdb-b18c4a975aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:23.068989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f296-7c05-4fdd-9fdb-b18c4a975aa1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:23.074781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:23.076269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:23.076269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:23.076269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] PATH_INFO: `/v3/users/41b0926ceb5a4829a08677282ba26907` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:23.077325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b0926ceb5a4829a08677282ba26907)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:23.079299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:23.134909 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:23.143659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b0926ceb5a4829a08677282ba26907'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.162694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b0926ceb5a4829a08677282ba26907'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.172351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b0926ceb5a4829a08677282ba26907'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.181410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b0926ceb5a4829a08677282ba26907'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.183359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b0926ceb5a4829a08677282ba26907'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.191281 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3426/6821] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:17:22 2022] DELETE /identity/v3/users/41b0926ceb5a4829a08677282ba26907 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:23.196140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c77ce-56a2-4dbe-ae6c-5eceba1c0d5e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:23.196588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c77ce-56a2-4dbe-ae6c-5eceba1c0d5e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:23.197178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c77ce-56a2-4dbe-ae6c-5eceba1c0d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:23.221799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-986c77ce-56a2-4dbe-ae6c-5eceba1c0d5e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:23.223540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-986c77ce-56a2-4dbe-ae6c-5eceba1c0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:23.297514 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:23.318886 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3396/6822] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:23.331965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:23.333522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:23.404778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7d934-7666-4c65-b274-b0310046e79c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:23.409779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbbd1-c4f9-4ec7-b756-c29ce5ae3ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:23.410505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbbd1-c4f9-4ec7-b756-c29ce5ae3ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:23.411039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbbd1-c4f9-4ec7-b756-c29ce5ae3ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:23.411474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbbd1-c4f9-4ec7-b756-c29ce5ae3ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:23.422486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bbbd1-c4f9-4ec7-b756-c29ce5ae3ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:23.424051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bbbd1-c4f9-4ec7-b756-c29ce5ae3ca2 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:23.436612 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3427/6823] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:23.653188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c77ce-56a2-4dbe-ae6c-5eceba1c0d5e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:23.654805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-986c77ce-56a2-4dbe-ae6c-5eceba1c0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:23.670233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c77ce-56a2-4dbe-ae6c-5eceba1c0d5e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:23.677590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:23.678426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:23.678880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:23.679147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] PATH_INFO: `/v3/projects/dcda6192e206452c813e671e8f57545c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:23.680792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcda6192e206452c813e671e8f57545c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:23.684071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:23.742436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcda6192e206452c813e671e8f57545c', 'request_id': 'req-81641060-3f5c-4a82-b376-f3a4f6a904f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.753819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcda6192e206452c813e671e8f57545c', 'request_id': 'req-81641060-3f5c-4a82-b376-f3a4f6a904f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.761744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcda6192e206452c813e671e8f57545c', 'request_id': 'req-81641060-3f5c-4a82-b376-f3a4f6a904f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.777363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] The token cache is being invalidate because project dcda6192e206452c813e671e8f57545c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:17:23.777654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.778435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-81641060-3f5c-4a82-b376-f3a4f6a904f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:23.780079 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3397/6824] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:17:23 2022] DELETE /identity/v3/projects/dcda6192e206452c813e671e8f57545c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:23.784886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38696-458b-4758-91ef-037de468c884 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:23.785250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38696-458b-4758-91ef-037de468c884 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:23.785719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38696-458b-4758-91ef-037de468c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:23.821074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-58f38696-458b-4758-91ef-037de468c884 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:23.822809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-58f38696-458b-4758-91ef-037de468c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:23.936096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e4e45-1306-44a1-b2e0-e1ba050348b9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:23.936391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e4e45-1306-44a1-b2e0-e1ba050348b9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:23.936693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e4e45-1306-44a1-b2e0-e1ba050348b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:23.947147 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3428/6825] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:23.962311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c71e4e45-1306-44a1-b2e0-e1ba050348b9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:23.963578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c71e4e45-1306-44a1-b2e0-e1ba050348b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:23.974028 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3398/6826] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:23.979579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f38696-458b-4758-91ef-037de468c884 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:23.992185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f38696-458b-4758-91ef-037de468c884 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:24.007317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3b3f-3a70-4294-9e32-65478dd71e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:24.007960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3b3f-3a70-4294-9e32-65478dd71e70 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:24.008242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3b3f-3a70-4294-9e32-65478dd71e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:24.012827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3b3f-3a70-4294-9e32-65478dd71e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:24.013716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc3b3f-3a70-4294-9e32-65478dd71e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:17:24.014101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc3b3f-3a70-4294-9e32-65478dd71e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:24.016938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc3b3f-3a70-4294-9e32-65478dd71e70 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:24.045653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e4e45-1306-44a1-b2e0-e1ba050348b9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:24.052304 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3429/6827] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:17:24.061738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e4e45-1306-44a1-b2e0-e1ba050348b9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:24.073241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880277b-720a-49fa-af3d-55edd31b9246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:24.073884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880277b-720a-49fa-af3d-55edd31b9246 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:24.074166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880277b-720a-49fa-af3d-55edd31b9246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:24.074444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880277b-720a-49fa-af3d-55edd31b9246 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:24.075098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880277b-720a-49fa-af3d-55edd31b9246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:24.078560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880277b-720a-49fa-af3d-55edd31b9246 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:24.154525 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3399/6828] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:17:24 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:24.158381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3b3f-3a70-4294-9e32-65478dd71e70 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:24.172322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3b3f-3a70-4294-9e32-65478dd71e70 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:24.303987 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:24.334515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed9c2c-1e16-43e4-aa4f-171fb550d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:24.335767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed9c2c-1e16-43e4-aa4f-171fb550d916 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:24.338814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed9c2c-1e16-43e4-aa4f-171fb550d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:24.338814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed9c2c-1e16-43e4-aa4f-171fb550d916 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:24.339400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed9c2c-1e16-43e4-aa4f-171fb550d916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:24.342107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed9c2c-1e16-43e4-aa4f-171fb550d916 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:24.382080 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3430/6829] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:17:24 2022] POST /identity/v3/users => generated 281 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:17:24.386594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880277b-720a-49fa-af3d-55edd31b9246 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:24.403441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880277b-720a-49fa-af3d-55edd31b9246 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:24.410942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c863-671f-4e73-a3f8-0afcddbdb953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:24.413914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c863-671f-4e73-a3f8-0afcddbdb953 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:24.414482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c863-671f-4e73-a3f8-0afcddbdb953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:24.414989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c863-671f-4e73-a3f8-0afcddbdb953 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:24.417392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c863-671f-4e73-a3f8-0afcddbdb953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:24.421154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c863-671f-4e73-a3f8-0afcddbdb953 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:24.443696 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3400/6830] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:24.447465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed9c2c-1e16-43e4-aa4f-171fb550d916 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:24.458587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed9c2c-1e16-43e4-aa4f-171fb550d916 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:24.464379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5d80-2cdd-4f6a-8483-ef43d1b974c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:24.464580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5d80-2cdd-4f6a-8483-ef43d1b974c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:24.464833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5d80-2cdd-4f6a-8483-ef43d1b974c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:24.465104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5d80-2cdd-4f6a-8483-ef43d1b974c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:24.465749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5d80-2cdd-4f6a-8483-ef43d1b974c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:24.468207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5d80-2cdd-4f6a-8483-ef43d1b974c5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:24.481895 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3431/6831] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:24.486703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c863-671f-4e73-a3f8-0afcddbdb953 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:24.498992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c863-671f-4e73-a3f8-0afcddbdb953 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:24.507732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73da12e-b08e-4a2c-9f60-172792ed827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:24.508425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73da12e-b08e-4a2c-9f60-172792ed827d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:24.508741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73da12e-b08e-4a2c-9f60-172792ed827d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:24.509024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73da12e-b08e-4a2c-9f60-172792ed827d admin admin] PATH_INFO: `/v3/projects/6d09410d47f548049e5d001bf8a97bf9/users/642edf92163f477fa7c92679776c1ec7/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:24.529311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73da12e-b08e-4a2c-9f60-172792ed827d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d09410d47f548049e5d001bf8a97bf9, user_id=642edf92163f477fa7c92679776c1ec7, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:24.531778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73da12e-b08e-4a2c-9f60-172792ed827d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:24.551017 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3401/6832] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:24 2022] PUT /identity/v3/projects/6d09410d47f548049e5d001bf8a97bf9/users/642edf92163f477fa7c92679776c1ec7/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:24.561934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759f5d5-7aa3-4133-b61a-a0c4b05f0918 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:24.562199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759f5d5-7aa3-4133-b61a-a0c4b05f0918 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:24.562480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759f5d5-7aa3-4133-b61a-a0c4b05f0918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:24.598475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3759f5d5-7aa3-4133-b61a-a0c4b05f0918 None None] MFA Rules not processed for user `642edf92163f477fa7c92679776c1ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:24.599846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3759f5d5-7aa3-4133-b61a-a0c4b05f0918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:24.702222 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3432/6833] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:24.715249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73da12e-b08e-4a2c-9f60-172792ed827d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:24.718852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c73da12e-b08e-4a2c-9f60-172792ed827d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:24.843052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73da12e-b08e-4a2c-9f60-172792ed827d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:24.848014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b031a-4f33-4f06-8e69-c8f393b232bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:24.848745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b031a-4f33-4f06-8e69-c8f393b232bf service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:24.849037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b031a-4f33-4f06-8e69-c8f393b232bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:24.849318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b031a-4f33-4f06-8e69-c8f393b232bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:24.868852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b031a-4f33-4f06-8e69-c8f393b232bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:24.870910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b031a-4f33-4f06-8e69-c8f393b232bf service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:24.882193 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3402/6834] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:17:27.110969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759f5d5-7aa3-4133-b61a-a0c4b05f0918 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:27.112558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3759f5d5-7aa3-4133-b61a-a0c4b05f0918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:27.268202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759f5d5-7aa3-4133-b61a-a0c4b05f0918 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:27.289047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:27.296298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:27.296656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:27.297034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] PATH_INFO: `/v3/users/85b82ff847ec4bb8843cef3853b33d09` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:27.300189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b82ff847ec4bb8843cef3853b33d09)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:27.302401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:27.417763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b82ff847ec4bb8843cef3853b33d09'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:27.427654 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:27.437783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b82ff847ec4bb8843cef3853b33d09'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:27.450722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b82ff847ec4bb8843cef3853b33d09'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:27.461466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b82ff847ec4bb8843cef3853b33d09'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:27.462674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b82ff847ec4bb8843cef3853b33d09'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:27.475559 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3433/6835] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:17:27 2022] DELETE /identity/v3/users/85b82ff847ec4bb8843cef3853b33d09 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:27.924478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b031a-4f33-4f06-8e69-c8f393b232bf service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:27.938893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b031a-4f33-4f06-8e69-c8f393b232bf service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:27.956672 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:28.024480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:28.026521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:28.026915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:28.027308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] PATH_INFO: `/v3/projects/205951844790437eaeea6227de261d84` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:28.028700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205951844790437eaeea6227de261d84)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:28.030767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:28.109999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205951844790437eaeea6227de261d84', 'request_id': 'req-8fb10c48-b28c-4469-9eff-40c922a64907'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.121737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205951844790437eaeea6227de261d84', 'request_id': 'req-8fb10c48-b28c-4469-9eff-40c922a64907'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.132045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205951844790437eaeea6227de261d84', 'request_id': 'req-8fb10c48-b28c-4469-9eff-40c922a64907'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.147825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] The token cache is being invalidate because project 205951844790437eaeea6227de261d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:17:28.148119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.148851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.151451 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3403/6836] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:17:27 2022] DELETE /identity/v3/projects/205951844790437eaeea6227de261d84 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:28.155402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:28.157472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:28.173353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda6515-fed9-4c0d-94de-e83df792dfeb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:28.265790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412663db-d044-460e-b363-083397704119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:28.266540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412663db-d044-460e-b363-083397704119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:28.266934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412663db-d044-460e-b363-083397704119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:28.267310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412663db-d044-460e-b363-083397704119 admin admin] PATH_INFO: `/v3/users/25f9802b02aa49e398943b2fdfa92fd4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:28.268782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412663db-d044-460e-b363-083397704119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f9802b02aa49e398943b2fdfa92fd4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:28.271301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412663db-d044-460e-b363-083397704119 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:28.350636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-412663db-d044-460e-b363-083397704119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f9802b02aa49e398943b2fdfa92fd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.367948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-412663db-d044-460e-b363-083397704119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f9802b02aa49e398943b2fdfa92fd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.378225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-412663db-d044-460e-b363-083397704119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f9802b02aa49e398943b2fdfa92fd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.388971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-412663db-d044-460e-b363-083397704119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f9802b02aa49e398943b2fdfa92fd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.389730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-412663db-d044-460e-b363-083397704119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f9802b02aa49e398943b2fdfa92fd4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.398009 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3434/6837] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:17:28 2022] DELETE /identity/v3/users/25f9802b02aa49e398943b2fdfa92fd4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:17:28.745070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:28.746782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:28.768594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb10c48-b28c-4469-9eff-40c922a64907 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:28.849698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:28.849698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:28.849698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:28.849698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] PATH_INFO: `/v3/projects/9af39100791e4975a675cac0d34e6818` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:28.850748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af39100791e4975a675cac0d34e6818)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:28.851808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:28.906576 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:28.910733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af39100791e4975a675cac0d34e6818', 'request_id': 'req-d83d90f1-0572-4ff7-8966-b5a01cf214c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.921473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af39100791e4975a675cac0d34e6818', 'request_id': 'req-d83d90f1-0572-4ff7-8966-b5a01cf214c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.929949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af39100791e4975a675cac0d34e6818', 'request_id': 'req-d83d90f1-0572-4ff7-8966-b5a01cf214c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.955494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] The token cache is being invalidate because project 9af39100791e4975a675cac0d34e6818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:17:28.956143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.956935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d83d90f1-0572-4ff7-8966-b5a01cf214c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:28.972677 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3404/6838] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:17:28 2022] DELETE /identity/v3/projects/9af39100791e4975a675cac0d34e6818 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:31.886870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bba9e-5b53-4a84-b7c4-1ab632afae4e None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:31.888061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bba9e-5b53-4a84-b7c4-1ab632afae4e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:31.888604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bba9e-5b53-4a84-b7c4-1ab632afae4e None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:31.890788 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3435/6839] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 01:17:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 01:17:31.896505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f093ad-98f3-451a-85cb-b40748af9039 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:31.897345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f093ad-98f3-451a-85cb-b40748af9039 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:31.897345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f093ad-98f3-451a-85cb-b40748af9039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:31.926547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-97f093ad-98f3-451a-85cb-b40748af9039 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:31.928052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-97f093ad-98f3-451a-85cb-b40748af9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:31.999464 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3405/6840] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:17:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:32.023573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bba9e-5b53-4a84-b7c4-1ab632afae4e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:32.026648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9b0bba9e-5b53-4a84-b7c4-1ab632afae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:32.070503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bba9e-5b53-4a84-b7c4-1ab632afae4e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:32.078056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6715c4-e2ab-4557-af05-346b9c3d6afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:32.078624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6715c4-e2ab-4557-af05-346b9c3d6afb service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:32.078906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6715c4-e2ab-4557-af05-346b9c3d6afb service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:32.079183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6715c4-e2ab-4557-af05-346b9c3d6afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:32.098251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6715c4-e2ab-4557-af05-346b9c3d6afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:32.099976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6715c4-e2ab-4557-af05-346b9c3d6afb service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:32.126226 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3436/6841] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:33.713261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f093ad-98f3-451a-85cb-b40748af9039 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:33.716227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-97f093ad-98f3-451a-85cb-b40748af9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:33.851953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f093ad-98f3-451a-85cb-b40748af9039 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:33.858953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:33.859623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:33.860130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:33.860514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] PATH_INFO: `/v3/users/80869e27d9024d6eb6a75e0cc0d28b2f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:33.865629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80869e27d9024d6eb6a75e0cc0d28b2f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:33.868423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:33.936584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80869e27d9024d6eb6a75e0cc0d28b2f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:33.953086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80869e27d9024d6eb6a75e0cc0d28b2f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:33.964650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80869e27d9024d6eb6a75e0cc0d28b2f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:33.981994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80869e27d9024d6eb6a75e0cc0d28b2f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:33.982862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80869e27d9024d6eb6a75e0cc0d28b2f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:33.990840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3406/6842] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:17:33 2022] DELETE /identity/v3/users/80869e27d9024d6eb6a75e0cc0d28b2f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:33.995674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e11b8-0f82-484c-abc6-8a51a763c038 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:33.996206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e11b8-0f82-484c-abc6-8a51a763c038 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:33.996445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e11b8-0f82-484c-abc6-8a51a763c038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:34.018043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d93e11b8-0f82-484c-abc6-8a51a763c038 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:34.019335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d93e11b8-0f82-484c-abc6-8a51a763c038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:34.102493 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:34.147489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3437/6843] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:34.170591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:34.172488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:34.179826 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:34.302387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d43e8-3f6c-4767-8fc4-c17d9af18b01 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:34.308645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71b58b-65c3-4a87-bc31-be91ef5428f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:34.309342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71b58b-65c3-4a87-bc31-be91ef5428f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:34.309628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71b58b-65c3-4a87-bc31-be91ef5428f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:34.310130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71b58b-65c3-4a87-bc31-be91ef5428f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:34.322595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71b58b-65c3-4a87-bc31-be91ef5428f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:34.324197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71b58b-65c3-4a87-bc31-be91ef5428f6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:34.342873 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3407/6844] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:34.789786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e11b8-0f82-484c-abc6-8a51a763c038 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:34.791751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d93e11b8-0f82-484c-abc6-8a51a763c038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:34.804865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e11b8-0f82-484c-abc6-8a51a763c038 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:34.809808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:34.810595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:34.811155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:34.811656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] PATH_INFO: `/v3/projects/d9902a3a41a042ee900d794adeb0485b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:34.813086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9902a3a41a042ee900d794adeb0485b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:34.815478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:34.880016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9902a3a41a042ee900d794adeb0485b', 'request_id': 'req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:34.890616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9902a3a41a042ee900d794adeb0485b', 'request_id': 'req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:34.903442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9902a3a41a042ee900d794adeb0485b', 'request_id': 'req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:34.917157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] The token cache is being invalidate because project d9902a3a41a042ee900d794adeb0485b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:17:34.917515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:34.918263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9ee33587-6808-4336-9a6f-ce0ec12d3ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:34.920109 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3438/6845] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:17:34 2022] DELETE /identity/v3/projects/d9902a3a41a042ee900d794adeb0485b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:17:34.925191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230039d7-ede0-4ba1-9bfa-b983275d8ab8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:34.926045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230039d7-ede0-4ba1-9bfa-b983275d8ab8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:34.926605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230039d7-ede0-4ba1-9bfa-b983275d8ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:34.961090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-230039d7-ede0-4ba1-9bfa-b983275d8ab8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:34.966102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-230039d7-ede0-4ba1-9bfa-b983275d8ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:35.060788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3408/6846] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:35.065661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa82f1b-41ba-47f1-acd5-a348850678a4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:35.066164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa82f1b-41ba-47f1-acd5-a348850678a4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:35.066274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa82f1b-41ba-47f1-acd5-a348850678a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:35.092723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3aa82f1b-41ba-47f1-acd5-a348850678a4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:35.094170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3aa82f1b-41ba-47f1-acd5-a348850678a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:35.102554 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3439/6847] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:17:35.107178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230039d7-ede0-4ba1-9bfa-b983275d8ab8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:35.117523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230039d7-ede0-4ba1-9bfa-b983275d8ab8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:35.125578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61f16-6bac-4654-924a-83f9213d61dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:35.126944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61f16-6bac-4654-924a-83f9213d61dc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:35.127453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61f16-6bac-4654-924a-83f9213d61dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:35.127922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61f16-6bac-4654-924a-83f9213d61dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:35.128984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61f16-6bac-4654-924a-83f9213d61dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:17:35.128984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61f16-6bac-4654-924a-83f9213d61dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:35.131421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61f16-6bac-4654-924a-83f9213d61dc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:35.148794 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3409/6848] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:17:35.153022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa82f1b-41ba-47f1-acd5-a348850678a4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:35.167414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa82f1b-41ba-47f1-acd5-a348850678a4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:35.172754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464c9f0-4202-444a-b5c8-1d86088c5e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:35.173483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464c9f0-4202-444a-b5c8-1d86088c5e03 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:35.174016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464c9f0-4202-444a-b5c8-1d86088c5e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:35.174503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464c9f0-4202-444a-b5c8-1d86088c5e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:35.175212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464c9f0-4202-444a-b5c8-1d86088c5e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:35.177231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464c9f0-4202-444a-b5c8-1d86088c5e03 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:35.212838 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3440/6849] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:17:35 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:35.216281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61f16-6bac-4654-924a-83f9213d61dc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:35.227144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61f16-6bac-4654-924a-83f9213d61dc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:35.287993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9237f-e383-4742-91b3-a896aa25e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:35.288658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9237f-e383-4742-91b3-a896aa25e84c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:35.288933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9237f-e383-4742-91b3-a896aa25e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:35.289206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9237f-e383-4742-91b3-a896aa25e84c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:35.289842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9237f-e383-4742-91b3-a896aa25e84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:35.291859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9237f-e383-4742-91b3-a896aa25e84c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:35.316778 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3410/6850] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:17:35 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:17:35.318256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464c9f0-4202-444a-b5c8-1d86088c5e03 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:35.329435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464c9f0-4202-444a-b5c8-1d86088c5e03 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:35.334108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b542c-cd29-409e-94c2-92b0390c57eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:35.334708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b542c-cd29-409e-94c2-92b0390c57eb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:35.334985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b542c-cd29-409e-94c2-92b0390c57eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:35.335256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b542c-cd29-409e-94c2-92b0390c57eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:35.335891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b542c-cd29-409e-94c2-92b0390c57eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:35.337822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b542c-cd29-409e-94c2-92b0390c57eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:35.348100 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3441/6851] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:35.352204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9237f-e383-4742-91b3-a896aa25e84c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:35.363743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9237f-e383-4742-91b3-a896aa25e84c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:35.369353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31271eea-2c8d-4792-b7f9-0888e03a9080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:35.370277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31271eea-2c8d-4792-b7f9-0888e03a9080 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:35.370697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31271eea-2c8d-4792-b7f9-0888e03a9080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:35.371155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31271eea-2c8d-4792-b7f9-0888e03a9080 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:35.371981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31271eea-2c8d-4792-b7f9-0888e03a9080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:35.373870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31271eea-2c8d-4792-b7f9-0888e03a9080 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:35.385621 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3411/6852] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:35.390846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b542c-cd29-409e-94c2-92b0390c57eb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:35.410531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b542c-cd29-409e-94c2-92b0390c57eb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:35.417965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec87fa2-26f8-4536-b550-a65ba96ab494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:35.418749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec87fa2-26f8-4536-b550-a65ba96ab494 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:35.419272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec87fa2-26f8-4536-b550-a65ba96ab494 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:35.419566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec87fa2-26f8-4536-b550-a65ba96ab494 admin admin] PATH_INFO: `/v3/projects/60b95f2fb2374e90b66234cd3e5613ba/users/2446fe1cf86545e794ba23e2bbbebcd6/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:35.441090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec87fa2-26f8-4536-b550-a65ba96ab494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b95f2fb2374e90b66234cd3e5613ba, user_id=2446fe1cf86545e794ba23e2bbbebcd6, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:35.444039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec87fa2-26f8-4536-b550-a65ba96ab494 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:35.464861 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3442/6853] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:35 2022] PUT /identity/v3/projects/60b95f2fb2374e90b66234cd3e5613ba/users/2446fe1cf86545e794ba23e2bbbebcd6/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:35.472332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f430c-0fa1-47e6-89c8-19563be058e3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:35.472550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f430c-0fa1-47e6-89c8-19563be058e3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:35.472878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f430c-0fa1-47e6-89c8-19563be058e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:35.504326 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:35.520172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-419f430c-0fa1-47e6-89c8-19563be058e3 None None] MFA Rules not processed for user `2446fe1cf86545e794ba23e2bbbebcd6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:35.521513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-419f430c-0fa1-47e6-89c8-19563be058e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:35.625748 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3412/6854] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:35.648492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec87fa2-26f8-4536-b550-a65ba96ab494 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:35.648492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bec87fa2-26f8-4536-b550-a65ba96ab494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:35.731804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec87fa2-26f8-4536-b550-a65ba96ab494 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:35.738147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd6287-1ad8-4090-bb1e-1c41ab704cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:35.739388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd6287-1ad8-4090-bb1e-1c41ab704cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:35.739765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd6287-1ad8-4090-bb1e-1c41ab704cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:35.740360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd6287-1ad8-4090-bb1e-1c41ab704cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:35.751939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd6287-1ad8-4090-bb1e-1c41ab704cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:35.753606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd6287-1ad8-4090-bb1e-1c41ab704cf3 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:35.764817 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3443/6855] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:44.306159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da4c1e-7774-468d-8ef6-295308da076c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:44.306613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da4c1e-7774-468d-8ef6-295308da076c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:44.306730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da4c1e-7774-468d-8ef6-295308da076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:44.337961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-42da4c1e-7774-468d-8ef6-295308da076c None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:44.340579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-42da4c1e-7774-468d-8ef6-295308da076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:44.464779 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3413/6856] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:17:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:44.466528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd6287-1ad8-4090-bb1e-1c41ab704cf3 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:44.470045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fcdd6287-1ad8-4090-bb1e-1c41ab704cf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:44.478316 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:44.581046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd6287-1ad8-4090-bb1e-1c41ab704cf3 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:44.588779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8c5d-c461-46b8-948b-a0005f8d1614 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:44.589862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8c5d-c461-46b8-948b-a0005f8d1614 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:44.589862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8c5d-c461-46b8-948b-a0005f8d1614 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:44.590248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8c5d-c461-46b8-948b-a0005f8d1614 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:44.600982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8c5d-c461-46b8-948b-a0005f8d1614 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:44.602625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8c5d-c461-46b8-948b-a0005f8d1614 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:44.617542 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3444/6857] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:17:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:17:46.424441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da4c1e-7774-468d-8ef6-295308da076c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:46.425938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-42da4c1e-7774-468d-8ef6-295308da076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:46.528566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da4c1e-7774-468d-8ef6-295308da076c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:46.535625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73223dc4-91e0-4bf5-87ce-fb0b87c30f88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:46.536703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73223dc4-91e0-4bf5-87ce-fb0b87c30f88 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:46.537242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73223dc4-91e0-4bf5-87ce-fb0b87c30f88 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:46.537743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73223dc4-91e0-4bf5-87ce-fb0b87c30f88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:46.539942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-73223dc4-91e0-4bf5-87ce-fb0b87c30f88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:46.558880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73223dc4-91e0-4bf5-87ce-fb0b87c30f88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:46.561084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73223dc4-91e0-4bf5-87ce-fb0b87c30f88 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:46.585077 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3414/6858] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:48.841187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8c5d-c461-46b8-948b-a0005f8d1614 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:48.969933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8c5d-c461-46b8-948b-a0005f8d1614 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:48.976280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:48.977746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:48.978398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:48.979040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] PATH_INFO: `/v3/users/2446fe1cf86545e794ba23e2bbbebcd6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:48.981025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2446fe1cf86545e794ba23e2bbbebcd6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:48.983525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:49.113233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2446fe1cf86545e794ba23e2bbbebcd6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:49.154577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2446fe1cf86545e794ba23e2bbbebcd6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:49.168558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2446fe1cf86545e794ba23e2bbbebcd6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:49.182840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2446fe1cf86545e794ba23e2bbbebcd6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:49.183844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2446fe1cf86545e794ba23e2bbbebcd6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:49.205173 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3445/6859] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:17:48 2022] DELETE /identity/v3/users/2446fe1cf86545e794ba23e2bbbebcd6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:49.213583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da217e1b-ad8c-4e2e-b5e3-845b4859e958 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:49.214581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da217e1b-ad8c-4e2e-b5e3-845b4859e958 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:49.216676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da217e1b-ad8c-4e2e-b5e3-845b4859e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:49.258415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-da217e1b-ad8c-4e2e-b5e3-845b4859e958 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:49.266390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da217e1b-ad8c-4e2e-b5e3-845b4859e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:49.337982 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:49.395545 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3415/6860] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:49.418651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:49.420155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:49.445334 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:49.547565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87475c-0b12-4a46-bee5-bca2fe43a9d1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:49.556455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721d8da-0048-4539-961d-03b871cb7ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:49.556455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721d8da-0048-4539-961d-03b871cb7ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:49.556776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721d8da-0048-4539-961d-03b871cb7ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:49.558338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721d8da-0048-4539-961d-03b871cb7ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:49.589368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721d8da-0048-4539-961d-03b871cb7ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:49.590991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721d8da-0048-4539-961d-03b871cb7ae1 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:49.620266 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3446/6861] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:49.928224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da217e1b-ad8c-4e2e-b5e3-845b4859e958 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:49.929975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da217e1b-ad8c-4e2e-b5e3-845b4859e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:49.958296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da217e1b-ad8c-4e2e-b5e3-845b4859e958 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:49.973535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:49.974200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:49.976489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:49.976818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] PATH_INFO: `/v3/projects/60b95f2fb2374e90b66234cd3e5613ba` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:49.982736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b95f2fb2374e90b66234cd3e5613ba)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:49.986326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:50.101301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b95f2fb2374e90b66234cd3e5613ba', 'request_id': 'req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:50.118124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b95f2fb2374e90b66234cd3e5613ba', 'request_id': 'req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:50.131154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b95f2fb2374e90b66234cd3e5613ba', 'request_id': 'req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:50.146918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] The token cache is being invalidate because project 60b95f2fb2374e90b66234cd3e5613ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:17:50.147557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:50.148416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a44ea1f-cb24-424d-bba1-2495b06a3a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:50.151174 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3416/6862] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:17:49 2022] DELETE /identity/v3/projects/60b95f2fb2374e90b66234cd3e5613ba => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:50.155791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f0be-de00-4419-b687-9177648840bb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:50.156297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f0be-de00-4419-b687-9177648840bb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:50.156420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f0be-de00-4419-b687-9177648840bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:50.185695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-da10f0be-de00-4419-b687-9177648840bb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:50.187211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-da10f0be-de00-4419-b687-9177648840bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:50.271375 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3447/6863] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:50.282336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf2265-e8c3-4621-b6f0-7d1c07893f2e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:50.282913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf2265-e8c3-4621-b6f0-7d1c07893f2e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:50.282913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf2265-e8c3-4621-b6f0-7d1c07893f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:50.326597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2faf2265-e8c3-4621-b6f0-7d1c07893f2e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:50.327869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2faf2265-e8c3-4621-b6f0-7d1c07893f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:50.363323 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3417/6864] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:50.366146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f0be-de00-4419-b687-9177648840bb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:50.379811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f0be-de00-4419-b687-9177648840bb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:50.389095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590ca1f-98c6-4cc3-9bee-2c4cc7b923ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:50.390286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590ca1f-98c6-4cc3-9bee-2c4cc7b923ec admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:50.391205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590ca1f-98c6-4cc3-9bee-2c4cc7b923ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:50.391708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590ca1f-98c6-4cc3-9bee-2c4cc7b923ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:50.415751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590ca1f-98c6-4cc3-9bee-2c4cc7b923ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:17:50.417616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590ca1f-98c6-4cc3-9bee-2c4cc7b923ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:50.423792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590ca1f-98c6-4cc3-9bee-2c4cc7b923ec admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:50.461404 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3448/6865] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:17:50.468082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf2265-e8c3-4621-b6f0-7d1c07893f2e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:50.484096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf2265-e8c3-4621-b6f0-7d1c07893f2e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:50.501544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754ccb9-01dd-4f17-b7bb-7d94877f0762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:50.502552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754ccb9-01dd-4f17-b7bb-7d94877f0762 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:50.502839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754ccb9-01dd-4f17-b7bb-7d94877f0762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:50.503187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754ccb9-01dd-4f17-b7bb-7d94877f0762 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:50.503850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754ccb9-01dd-4f17-b7bb-7d94877f0762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:50.506949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754ccb9-01dd-4f17-b7bb-7d94877f0762 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:50.552894 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3418/6866] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:17:50 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:50.557818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590ca1f-98c6-4cc3-9bee-2c4cc7b923ec admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:50.572702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590ca1f-98c6-4cc3-9bee-2c4cc7b923ec admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:50.647760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6374cd-2851-430c-b7f0-5cedcc280b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:50.648547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6374cd-2851-430c-b7f0-5cedcc280b44 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:50.648865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6374cd-2851-430c-b7f0-5cedcc280b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:50.649195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6374cd-2851-430c-b7f0-5cedcc280b44 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:50.649838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6374cd-2851-430c-b7f0-5cedcc280b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:50.651832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6374cd-2851-430c-b7f0-5cedcc280b44 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:50.680533 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3449/6867] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:17:50 2022] POST /identity/v3/users => generated 282 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:50.684944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754ccb9-01dd-4f17-b7bb-7d94877f0762 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:50.705477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754ccb9-01dd-4f17-b7bb-7d94877f0762 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:50.711094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc394b-229f-418c-a60e-d16699d2c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:50.711767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc394b-229f-418c-a60e-d16699d2c1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:50.712053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc394b-229f-418c-a60e-d16699d2c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:50.712329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc394b-229f-418c-a60e-d16699d2c1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:50.713022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc394b-229f-418c-a60e-d16699d2c1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:50.714629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc394b-229f-418c-a60e-d16699d2c1f3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:50.728474 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3419/6868] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:50.732664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6374cd-2851-430c-b7f0-5cedcc280b44 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:50.743863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6374cd-2851-430c-b7f0-5cedcc280b44 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:50.749119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706e45b-769e-45d9-986a-690afda22a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:50.749739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e45b-769e-45d9-986a-690afda22a3b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:50.750025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e45b-769e-45d9-986a-690afda22a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:50.750306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e45b-769e-45d9-986a-690afda22a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:50.751081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706e45b-769e-45d9-986a-690afda22a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:50.752769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706e45b-769e-45d9-986a-690afda22a3b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:50.770107 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3450/6869] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:50.771242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc394b-229f-418c-a60e-d16699d2c1f3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:50.784223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc394b-229f-418c-a60e-d16699d2c1f3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:50.791660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ba99e-79b1-4661-ae04-daf910d6b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:50.792657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ba99e-79b1-4661-ae04-daf910d6b68e admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:50.792977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ba99e-79b1-4661-ae04-daf910d6b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:50.793261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ba99e-79b1-4661-ae04-daf910d6b68e admin admin] PATH_INFO: `/v3/projects/bf2a8385cbaa481b8ab20940ef6af1f8/users/04d06e2852bc4313ad4d4579ad048961/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:50.814721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ba99e-79b1-4661-ae04-daf910d6b68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2a8385cbaa481b8ab20940ef6af1f8, user_id=04d06e2852bc4313ad4d4579ad048961, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:50.817629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ba99e-79b1-4661-ae04-daf910d6b68e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:50.856271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fbe72-36f2-43a7-afcb-4609e3ef9596 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:50.856904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fbe72-36f2-43a7-afcb-4609e3ef9596 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:50.857286 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3420/6870] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:50 2022] PUT /identity/v3/projects/bf2a8385cbaa481b8ab20940ef6af1f8/users/04d06e2852bc4313ad4d4579ad048961/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:17:50.857552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fbe72-36f2-43a7-afcb-4609e3ef9596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:50.895877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2d2fbe72-36f2-43a7-afcb-4609e3ef9596 None None] MFA Rules not processed for user `04d06e2852bc4313ad4d4579ad048961`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:50.897233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2d2fbe72-36f2-43a7-afcb-4609e3ef9596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:50.911540 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:51.056284 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3451/6871] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:17:51.057829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ba99e-79b1-4661-ae04-daf910d6b68e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:51.163263 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:51.176947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ba99e-79b1-4661-ae04-daf910d6b68e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:51.213155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df2b30-6860-46ad-8d5c-344d47be5422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:51.213529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df2b30-6860-46ad-8d5c-344d47be5422 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:51.213905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df2b30-6860-46ad-8d5c-344d47be5422 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:51.214274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df2b30-6860-46ad-8d5c-344d47be5422 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:51.215192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df2b30-6860-46ad-8d5c-344d47be5422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:51.224996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df2b30-6860-46ad-8d5c-344d47be5422 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:51.277730 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3421/6872] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:17:51 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:51.280499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fbe72-36f2-43a7-afcb-4609e3ef9596 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:51.318547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fbe72-36f2-43a7-afcb-4609e3ef9596 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:51.397971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efadee-8e50-4f97-9918-a6afb9c9e07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:51.398795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efadee-8e50-4f97-9918-a6afb9c9e07d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:51.398923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efadee-8e50-4f97-9918-a6afb9c9e07d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:51.399193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efadee-8e50-4f97-9918-a6afb9c9e07d admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:51.399855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efadee-8e50-4f97-9918-a6afb9c9e07d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:51.401858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efadee-8e50-4f97-9918-a6afb9c9e07d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:51.451308 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3452/6873] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:17:51 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:51.453149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df2b30-6860-46ad-8d5c-344d47be5422 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:51.476385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df2b30-6860-46ad-8d5c-344d47be5422 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:51.484675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af872b4f-bd2b-4a65-b831-6d87a9783e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:51.485615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af872b4f-bd2b-4a65-b831-6d87a9783e47 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:51.486008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af872b4f-bd2b-4a65-b831-6d87a9783e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:51.486429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af872b4f-bd2b-4a65-b831-6d87a9783e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:51.487215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af872b4f-bd2b-4a65-b831-6d87a9783e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:51.489171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af872b4f-bd2b-4a65-b831-6d87a9783e47 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:51.507938 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3422/6874] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:51.513611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efadee-8e50-4f97-9918-a6afb9c9e07d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:51.530354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efadee-8e50-4f97-9918-a6afb9c9e07d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:51.538852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f918b-add5-48a3-b3c3-c32c0610f7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:51.539554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f918b-add5-48a3-b3c3-c32c0610f7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:51.540381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f918b-add5-48a3-b3c3-c32c0610f7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:51.541176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f918b-add5-48a3-b3c3-c32c0610f7fb admin admin] PATH_INFO: `/v3/projects/5eea753e8c5c4019b777c3cbe8521d6f/users/9680e890ce874874976de42f8127e6bd/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:51.567030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f918b-add5-48a3-b3c3-c32c0610f7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eea753e8c5c4019b777c3cbe8521d6f, user_id=9680e890ce874874976de42f8127e6bd, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:51.570214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f918b-add5-48a3-b3c3-c32c0610f7fb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:51.592287 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3453/6875] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:51 2022] PUT /identity/v3/projects/5eea753e8c5c4019b777c3cbe8521d6f/users/9680e890ce874874976de42f8127e6bd/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:51.593585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af872b4f-bd2b-4a65-b831-6d87a9783e47 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:51.611763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af872b4f-bd2b-4a65-b831-6d87a9783e47 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:51.707636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9507b9-d00f-4ee9-86c1-0b03e0f33fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:51.708279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9507b9-d00f-4ee9-86c1-0b03e0f33fbc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:51.708562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9507b9-d00f-4ee9-86c1-0b03e0f33fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:51.708874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9507b9-d00f-4ee9-86c1-0b03e0f33fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:51.710019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9507b9-d00f-4ee9-86c1-0b03e0f33fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:51.712347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9507b9-d00f-4ee9-86c1-0b03e0f33fbc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:51.724963 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3423/6876] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:51.730233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f918b-add5-48a3-b3c3-c32c0610f7fb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:51.764488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f918b-add5-48a3-b3c3-c32c0610f7fb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:51.789338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9333-4c2d-4aba-b462-2b63e1dd9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:51.791441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9333-4c2d-4aba-b462-2b63e1dd9c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:51.792007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9333-4c2d-4aba-b462-2b63e1dd9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:51.792601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9333-4c2d-4aba-b462-2b63e1dd9c1d admin admin] PATH_INFO: `/v3/projects/5eea753e8c5c4019b777c3cbe8521d6f/users/9680e890ce874874976de42f8127e6bd/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:51.795526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9333-4c2d-4aba-b462-2b63e1dd9c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eea753e8c5c4019b777c3cbe8521d6f, user_id=9680e890ce874874976de42f8127e6bd, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:51.799346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9333-4c2d-4aba-b462-2b63e1dd9c1d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:51.826121 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3454/6877] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:51 2022] PUT /identity/v3/projects/5eea753e8c5c4019b777c3cbe8521d6f/users/9680e890ce874874976de42f8127e6bd/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:51.837067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae45ad7-88a8-4471-95f0-8f20de753adf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:51.838004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae45ad7-88a8-4471-95f0-8f20de753adf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:51.838357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae45ad7-88a8-4471-95f0-8f20de753adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:51.877607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0ae45ad7-88a8-4471-95f0-8f20de753adf None None] MFA Rules not processed for user `9680e890ce874874976de42f8127e6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:51.878890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0ae45ad7-88a8-4471-95f0-8f20de753adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:52.001477 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3424/6878] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:52.013324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9333-4c2d-4aba-b462-2b63e1dd9c1d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:52.015154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-774d9333-4c2d-4aba-b462-2b63e1dd9c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:52.136673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9333-4c2d-4aba-b462-2b63e1dd9c1d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:52.140812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dda81-2bec-400d-ad22-9623e7216b69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:52.141557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dda81-2bec-400d-ad22-9623e7216b69 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:52.141933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dda81-2bec-400d-ad22-9623e7216b69 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:52.142304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dda81-2bec-400d-ad22-9623e7216b69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:52.154162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dda81-2bec-400d-ad22-9623e7216b69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:52.155697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dda81-2bec-400d-ad22-9623e7216b69 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:52.181073 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3455/6879] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:52.298485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae45ad7-88a8-4471-95f0-8f20de753adf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:52.314088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae45ad7-88a8-4471-95f0-8f20de753adf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:52.320971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10750389-a8f9-4331-bb9f-c070342c7520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:52.321899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10750389-a8f9-4331-bb9f-c070342c7520 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:52.322234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10750389-a8f9-4331-bb9f-c070342c7520 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:52.322515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10750389-a8f9-4331-bb9f-c070342c7520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:52.392099 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:52.407922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10750389-a8f9-4331-bb9f-c070342c7520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:52.409426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10750389-a8f9-4331-bb9f-c070342c7520 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:52.422296 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3425/6880] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:53.214371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dda81-2bec-400d-ad22-9623e7216b69 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:53.228543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a01dda81-2bec-400d-ad22-9623e7216b69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:53.239818 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:53.355967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dda81-2bec-400d-ad22-9623e7216b69 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:53.370821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:53.371698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:53.373117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:53.373117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] PATH_INFO: `/v3/users/2052fd7bb1ee432cb3ca4ec07698292c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:53.373753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2052fd7bb1ee432cb3ca4ec07698292c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:53.376336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:53.450128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2052fd7bb1ee432cb3ca4ec07698292c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:53.467625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2052fd7bb1ee432cb3ca4ec07698292c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:53.480635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2052fd7bb1ee432cb3ca4ec07698292c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:53.505308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2052fd7bb1ee432cb3ca4ec07698292c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:53.506401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2052fd7bb1ee432cb3ca4ec07698292c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:53.520690 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3456/6881] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:17:53 2022] DELETE /identity/v3/users/2052fd7bb1ee432cb3ca4ec07698292c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:53.524037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051554ca-d210-4c87-9436-61f788f9b6b5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:53.524726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051554ca-d210-4c87-9436-61f788f9b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:53.524886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051554ca-d210-4c87-9436-61f788f9b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:53.579356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-051554ca-d210-4c87-9436-61f788f9b6b5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:53.580934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-051554ca-d210-4c87-9436-61f788f9b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:53.659059 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3426/6882] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:17:53.671397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:53.673356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:53.815879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd814037-24ef-4e44-80e2-e97a7f4507d2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:53.824867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17b098-31cc-4c7f-bc7a-a0c96d18453b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:53.825616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17b098-31cc-4c7f-bc7a-a0c96d18453b service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:53.827335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17b098-31cc-4c7f-bc7a-a0c96d18453b service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:53.827728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17b098-31cc-4c7f-bc7a-a0c96d18453b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:53.850892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17b098-31cc-4c7f-bc7a-a0c96d18453b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:53.853630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17b098-31cc-4c7f-bc7a-a0c96d18453b service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:53.874285 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3457/6883] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:17:54.160016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051554ca-d210-4c87-9436-61f788f9b6b5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:54.161496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-051554ca-d210-4c87-9436-61f788f9b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:54.201952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051554ca-d210-4c87-9436-61f788f9b6b5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:54.215193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:54.216100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:54.216561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:54.217053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] PATH_INFO: `/v3/projects/44453298a7d04311bd64354938bf2431` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:54.220509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44453298a7d04311bd64354938bf2431)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:54.222693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:54.357680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44453298a7d04311bd64354938bf2431', 'request_id': 'req-5141b4a3-8265-4b44-b8db-39cc4d855c13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.368293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44453298a7d04311bd64354938bf2431', 'request_id': 'req-5141b4a3-8265-4b44-b8db-39cc4d855c13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.376177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44453298a7d04311bd64354938bf2431', 'request_id': 'req-5141b4a3-8265-4b44-b8db-39cc4d855c13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.390874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] The token cache is being invalidate because project 44453298a7d04311bd64354938bf2431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:17:54.391232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.392524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.394556 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3427/6884] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:17:54 2022] DELETE /identity/v3/projects/44453298a7d04311bd64354938bf2431 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:54.398537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17b098-31cc-4c7f-bc7a-a0c96d18453b service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:54.414964 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17b098-31cc-4c7f-bc7a-a0c96d18453b service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:54.448360 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:54.527702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:54.527938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:54.528213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:54.528588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] PATH_INFO: `/v3/users/0e9884a2aa304ed6b241e20dcbc852ff` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:54.547537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e9884a2aa304ed6b241e20dcbc852ff)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:54.550389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:54.605434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e9884a2aa304ed6b241e20dcbc852ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.621861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e9884a2aa304ed6b241e20dcbc852ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.631370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e9884a2aa304ed6b241e20dcbc852ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.640230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e9884a2aa304ed6b241e20dcbc852ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.641699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-36252a2a-4a32-4315-bd1a-82fa165c0448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e9884a2aa304ed6b241e20dcbc852ff'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:54.652865 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3458/6885] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:17:54 2022] DELETE /identity/v3/users/0e9884a2aa304ed6b241e20dcbc852ff => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:54.876786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:54.879416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:54.911024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141b4a3-8265-4b44-b8db-39cc4d855c13 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:55.042618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:55.052111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.052470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.052928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] PATH_INFO: `/v3/projects/8c8fc0312ad4431da003046209628ef5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:55.070646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8fc0312ad4431da003046209628ef5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:55.077530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:55.094599 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:55.211252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8fc0312ad4431da003046209628ef5', 'request_id': 'req-068f97dd-83b1-4830-9287-061d29601992'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:55.233969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8fc0312ad4431da003046209628ef5', 'request_id': 'req-068f97dd-83b1-4830-9287-061d29601992'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:55.261952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8fc0312ad4431da003046209628ef5', 'request_id': 'req-068f97dd-83b1-4830-9287-061d29601992'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:55.295651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] The token cache is being invalidate because project 8c8fc0312ad4431da003046209628ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:17:55.296239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:55.297232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-068f97dd-83b1-4830-9287-061d29601992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:17:55.299797 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3428/6886] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:17:54 2022] DELETE /identity/v3/projects/8c8fc0312ad4431da003046209628ef5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:55.305195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd53d-67e9-4a6b-84b6-e577a8fff636 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.305679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd53d-67e9-4a6b-84b6-e577a8fff636 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.306139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd53d-67e9-4a6b-84b6-e577a8fff636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:55.360952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d24cd53d-67e9-4a6b-84b6-e577a8fff636 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:55.367520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d24cd53d-67e9-4a6b-84b6-e577a8fff636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:55.529045 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3459/6887] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:55.541932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933d94-ccda-4036-9299-85add00782a6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.542155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933d94-ccda-4036-9299-85add00782a6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.542397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09933d94-ccda-4036-9299-85add00782a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:55.572506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-09933d94-ccda-4036-9299-85add00782a6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:55.574277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09933d94-ccda-4036-9299-85add00782a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:55.584424 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3429/6888] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:55.589162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cd53d-67e9-4a6b-84b6-e577a8fff636 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:55.599692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cd53d-67e9-4a6b-84b6-e577a8fff636 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:55.605921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab492-6306-4d2b-b05e-00761497455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:55.606561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab492-6306-4d2b-b05e-00761497455a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.606841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab492-6306-4d2b-b05e-00761497455a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.607218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab492-6306-4d2b-b05e-00761497455a admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:55.608030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab492-6306-4d2b-b05e-00761497455a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:17:55.608335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab492-6306-4d2b-b05e-00761497455a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:55.609991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab492-6306-4d2b-b05e-00761497455a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:55.631639 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3460/6889] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:17:55.635348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933d94-ccda-4036-9299-85add00782a6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:55.652930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09933d94-ccda-4036-9299-85add00782a6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:55.658814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b03f6-046c-4383-a176-df8c1aba0113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:55.659809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b03f6-046c-4383-a176-df8c1aba0113 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.659809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b03f6-046c-4383-a176-df8c1aba0113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.660099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b03f6-046c-4383-a176-df8c1aba0113 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:55.660827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b03f6-046c-4383-a176-df8c1aba0113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:55.663003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b03f6-046c-4383-a176-df8c1aba0113 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:55.705285 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3430/6890] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:17:55 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:55.709567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab492-6306-4d2b-b05e-00761497455a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:55.723051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab492-6306-4d2b-b05e-00761497455a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:55.755682 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:55.811555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90297877-19f4-4878-b474-9c557b880be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:55.812455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90297877-19f4-4878-b474-9c557b880be9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.812778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90297877-19f4-4878-b474-9c557b880be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.814663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90297877-19f4-4878-b474-9c557b880be9 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:55.815344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90297877-19f4-4878-b474-9c557b880be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:55.817350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90297877-19f4-4878-b474-9c557b880be9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:55.843268 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3461/6891] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:17:55 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:55.847553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b03f6-046c-4383-a176-df8c1aba0113 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:55.859721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b03f6-046c-4383-a176-df8c1aba0113 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:55.864743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff172ba-64d9-454c-8be4-7ac0065d1f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:55.865437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff172ba-64d9-454c-8be4-7ac0065d1f38 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.865792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff172ba-64d9-454c-8be4-7ac0065d1f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.866076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff172ba-64d9-454c-8be4-7ac0065d1f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:55.866724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff172ba-64d9-454c-8be4-7ac0065d1f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:55.868940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff172ba-64d9-454c-8be4-7ac0065d1f38 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:55.880664 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3431/6892] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:55.885124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90297877-19f4-4878-b474-9c557b880be9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:55.897739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90297877-19f4-4878-b474-9c557b880be9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:55.904462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8fcf0-da66-46ac-8ede-ecce3c16a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:55.905257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8fcf0-da66-46ac-8ede-ecce3c16a6df admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.905670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8fcf0-da66-46ac-8ede-ecce3c16a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.906087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8fcf0-da66-46ac-8ede-ecce3c16a6df admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:55.906810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8fcf0-da66-46ac-8ede-ecce3c16a6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:55.908521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8fcf0-da66-46ac-8ede-ecce3c16a6df admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:55.924729 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3462/6893] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:55.927651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff172ba-64d9-454c-8be4-7ac0065d1f38 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:55.942165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff172ba-64d9-454c-8be4-7ac0065d1f38 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:55.947972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1467a3-d63b-484f-aac1-cfaed2be9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:55.948764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1467a3-d63b-484f-aac1-cfaed2be9fff admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.949117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1467a3-d63b-484f-aac1-cfaed2be9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.949603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1467a3-d63b-484f-aac1-cfaed2be9fff admin admin] PATH_INFO: `/v3/projects/1eabce6bc9744aa9b56f5d3a24900020/users/0d12c0ca2333460bbf044ceb5178affb/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:55.965705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1467a3-d63b-484f-aac1-cfaed2be9fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eabce6bc9744aa9b56f5d3a24900020, user_id=0d12c0ca2333460bbf044ceb5178affb, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:55.968399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1467a3-d63b-484f-aac1-cfaed2be9fff admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:55.986859 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3432/6894] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:55 2022] PUT /identity/v3/projects/1eabce6bc9744aa9b56f5d3a24900020/users/0d12c0ca2333460bbf044ceb5178affb/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:17:55.998729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0034a-8270-46fc-ba39-979591b57fa6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:55.998931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0034a-8270-46fc-ba39-979591b57fa6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:55.999226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0034a-8270-46fc-ba39-979591b57fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:56.030063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-53d0034a-8270-46fc-ba39-979591b57fa6 None None] MFA Rules not processed for user `0d12c0ca2333460bbf044ceb5178affb`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:56.031301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-53d0034a-8270-46fc-ba39-979591b57fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:56.120579 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3463/6895] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:56.124987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1467a3-d63b-484f-aac1-cfaed2be9fff admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:56.208840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1467a3-d63b-484f-aac1-cfaed2be9fff admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:56.219692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a1b13-1b0a-492c-a09b-1e7dac876780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:56.220330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a1b13-1b0a-492c-a09b-1e7dac876780 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:56.220610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a1b13-1b0a-492c-a09b-1e7dac876780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:56.221125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a1b13-1b0a-492c-a09b-1e7dac876780 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:56.221789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a1b13-1b0a-492c-a09b-1e7dac876780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:56.224737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a1b13-1b0a-492c-a09b-1e7dac876780 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:56.274348 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3433/6896] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:17:56 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:56.275262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0034a-8270-46fc-ba39-979591b57fa6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:56.288386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0034a-8270-46fc-ba39-979591b57fa6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:56.381050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0edefc-488d-4113-9d4a-fb9a4546c72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:56.381785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0edefc-488d-4113-9d4a-fb9a4546c72f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:56.382070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0edefc-488d-4113-9d4a-fb9a4546c72f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:56.382347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0edefc-488d-4113-9d4a-fb9a4546c72f admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:56.382988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0edefc-488d-4113-9d4a-fb9a4546c72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:56.386538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0edefc-488d-4113-9d4a-fb9a4546c72f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:56.421087 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3464/6897] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:17:56 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:17:56.424688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a1b13-1b0a-492c-a09b-1e7dac876780 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:56.441383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a1b13-1b0a-492c-a09b-1e7dac876780 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:56.449100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1d518-0efc-4636-885d-9ebdddc52825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:56.450161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1d518-0efc-4636-885d-9ebdddc52825 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:56.450849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1d518-0efc-4636-885d-9ebdddc52825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:56.451413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1d518-0efc-4636-885d-9ebdddc52825 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:56.452305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1d518-0efc-4636-885d-9ebdddc52825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:56.455270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1d518-0efc-4636-885d-9ebdddc52825 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:56.476294 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3434/6898] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:56.481156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0edefc-488d-4113-9d4a-fb9a4546c72f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:56.497402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0edefc-488d-4113-9d4a-fb9a4546c72f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:56.502930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e439-f56a-4c31-acee-4df78f6a5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:56.503966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e439-f56a-4c31-acee-4df78f6a5218 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:56.504256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e439-f56a-4c31-acee-4df78f6a5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:56.504538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e439-f56a-4c31-acee-4df78f6a5218 admin admin] PATH_INFO: `/v3/projects/17366d0c57f4405884904e0aa5e16b5c/users/46f86c902e15480fa7837b3463e2bc27/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:56.549180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711e439-f56a-4c31-acee-4df78f6a5218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17366d0c57f4405884904e0aa5e16b5c, user_id=46f86c902e15480fa7837b3463e2bc27, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:56.554430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711e439-f56a-4c31-acee-4df78f6a5218 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:56.566509 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:56.591339 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3465/6899] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:56 2022] PUT /identity/v3/projects/17366d0c57f4405884904e0aa5e16b5c/users/46f86c902e15480fa7837b3463e2bc27/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:56.595839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1d518-0efc-4636-885d-9ebdddc52825 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:56.604118 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:56.611830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1d518-0efc-4636-885d-9ebdddc52825 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:56.807513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82674abb-4eb3-4bcb-8566-73cb63abeb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:56.808316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674abb-4eb3-4bcb-8566-73cb63abeb09 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:56.808523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674abb-4eb3-4bcb-8566-73cb63abeb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:56.808718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674abb-4eb3-4bcb-8566-73cb63abeb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:56.809379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82674abb-4eb3-4bcb-8566-73cb63abeb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:56.811407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82674abb-4eb3-4bcb-8566-73cb63abeb09 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:56.836865 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3435/6900] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:17:56.841415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e439-f56a-4c31-acee-4df78f6a5218 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:56.864329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e439-f56a-4c31-acee-4df78f6a5218 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:56.873370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ce727-4204-4066-a346-5f3953bc7db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:56.874380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ce727-4204-4066-a346-5f3953bc7db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:56.875021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ce727-4204-4066-a346-5f3953bc7db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:56.875520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ce727-4204-4066-a346-5f3953bc7db0 admin admin] PATH_INFO: `/v3/projects/17366d0c57f4405884904e0aa5e16b5c/users/46f86c902e15480fa7837b3463e2bc27/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:56.878219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ce727-4204-4066-a346-5f3953bc7db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17366d0c57f4405884904e0aa5e16b5c, user_id=46f86c902e15480fa7837b3463e2bc27, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:56.881211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ce727-4204-4066-a346-5f3953bc7db0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:56.912816 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3466/6901] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:17:56 2022] PUT /identity/v3/projects/17366d0c57f4405884904e0aa5e16b5c/users/46f86c902e15480fa7837b3463e2bc27/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:17:56.920381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7abfe-5c9e-42b5-a55b-03efe5bf6b9b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:56.922481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7abfe-5c9e-42b5-a55b-03efe5bf6b9b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:56.924958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7abfe-5c9e-42b5-a55b-03efe5bf6b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:56.979951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ded7abfe-5c9e-42b5-a55b-03efe5bf6b9b None None] MFA Rules not processed for user `46f86c902e15480fa7837b3463e2bc27`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:17:56.981323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ded7abfe-5c9e-42b5-a55b-03efe5bf6b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:57.094860 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3436/6902] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:17:57.109612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ce727-4204-4066-a346-5f3953bc7db0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:17:57.111316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-685ce727-4204-4066-a346-5f3953bc7db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:17:57.242122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ce727-4204-4066-a346-5f3953bc7db0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:17:57.248132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d6b6-6fb6-4275-b771-91578d4acf35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:17:57.248332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d6b6-6fb6-4275-b771-91578d4acf35 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:17:57.248529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d6b6-6fb6-4275-b771-91578d4acf35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:17:57.248878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d6b6-6fb6-4275-b771-91578d4acf35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:17:57.394074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0d6b6-6fb6-4275-b771-91578d4acf35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:17:57.395780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0d6b6-6fb6-4275-b771-91578d4acf35 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:17:57.421284 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3467/6903] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:17:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:00.871103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7abfe-5c9e-42b5-a55b-03efe5bf6b9b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:00.886275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7abfe-5c9e-42b5-a55b-03efe5bf6b9b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:00.892361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be3694-df1a-426e-a131-1a0564e1d75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:00.894197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be3694-df1a-426e-a131-1a0564e1d75a service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:00.894197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be3694-df1a-426e-a131-1a0564e1d75a service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:00.894197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be3694-df1a-426e-a131-1a0564e1d75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:00.907401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be3694-df1a-426e-a131-1a0564e1d75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:00.909210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be3694-df1a-426e-a131-1a0564e1d75a service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:00.922222 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3437/6904] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:06.008818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d6b6-6fb6-4275-b771-91578d4acf35 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:06.028793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d6b6-6fb6-4275-b771-91578d4acf35 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:06.040548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:06.041179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:06.041643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:06.042300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:06.049156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:06.343556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:06.345738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:06.378461 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3468/6905] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:10.915694 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=67 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:13.252007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce9d3-da67-43e0-a2d2-fad231418215 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:13.253266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce9d3-da67-43e0-a2d2-fad231418215 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:13.254251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce9d3-da67-43e0-a2d2-fad231418215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:13.293385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-06bce9d3-da67-43e0-a2d2-fad231418215 None None] MFA Rules not processed for user `0d12c0ca2333460bbf044ceb5178affb`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:13.295524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-06bce9d3-da67-43e0-a2d2-fad231418215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:13.309704 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3438/6906] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:13.755878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:13.757559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:13.785624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0098c-5282-483d-81f4-dec1104d1261 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:13.803026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:13.803987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:13.809317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:13.809918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] PATH_INFO: `/v3/users/2d97060e766f4e1f982d64b425ddd184` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:13.812507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d97060e766f4e1f982d64b425ddd184)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:13.815005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:13.866091 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:13.904024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d97060e766f4e1f982d64b425ddd184'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:13.920948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d97060e766f4e1f982d64b425ddd184'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:13.933613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d97060e766f4e1f982d64b425ddd184'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:13.947366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d97060e766f4e1f982d64b425ddd184'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:13.948317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8b6af7d-59e0-4f62-94e6-a3eb1676ccd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d97060e766f4e1f982d64b425ddd184'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:13.959514 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3469/6907] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:18:13 2022] DELETE /identity/v3/users/2d97060e766f4e1f982d64b425ddd184 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:14.685643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce9d3-da67-43e0-a2d2-fad231418215 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:14.713046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce9d3-da67-43e0-a2d2-fad231418215 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:14.887367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:14.889173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:14.889546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:14.889711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] PATH_INFO: `/v3/projects/235a5608bd9142dcbfb621873d3999a7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:14.893160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=235a5608bd9142dcbfb621873d3999a7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:14.902056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:15.094431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235a5608bd9142dcbfb621873d3999a7', 'request_id': 'req-1a88a879-7342-4406-b832-431a25b31a0a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:15.109870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235a5608bd9142dcbfb621873d3999a7', 'request_id': 'req-1a88a879-7342-4406-b832-431a25b31a0a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:15.127305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235a5608bd9142dcbfb621873d3999a7', 'request_id': 'req-1a88a879-7342-4406-b832-431a25b31a0a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:15.143052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] The token cache is being invalidate because project 235a5608bd9142dcbfb621873d3999a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:18:15.143425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:15.144191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1a88a879-7342-4406-b832-431a25b31a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:15.146279 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3439/6908] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:18:14 2022] DELETE /identity/v3/projects/235a5608bd9142dcbfb621873d3999a7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:15.151675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d39cd-bebc-4c5f-84d5-8d14c3aef874 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:15.152639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d39cd-bebc-4c5f-84d5-8d14c3aef874 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:15.154254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d39cd-bebc-4c5f-84d5-8d14c3aef874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:15.268858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6e3d39cd-bebc-4c5f-84d5-8d14c3aef874 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:15.270216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6e3d39cd-bebc-4c5f-84d5-8d14c3aef874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:15.438120 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3470/6909] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:18:15.448716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522a143-b2ad-4333-89b3-1f8dc68ffc6e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:15.449687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522a143-b2ad-4333-89b3-1f8dc68ffc6e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:15.455886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522a143-b2ad-4333-89b3-1f8dc68ffc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:15.518981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9522a143-b2ad-4333-89b3-1f8dc68ffc6e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:15.526860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9522a143-b2ad-4333-89b3-1f8dc68ffc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:15.543131 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3440/6910] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:15.543992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d39cd-bebc-4c5f-84d5-8d14c3aef874 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:15.568217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d39cd-bebc-4c5f-84d5-8d14c3aef874 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:15.578240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25cd80-5a43-4412-a7e3-a7c73b3e0f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:15.579158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25cd80-5a43-4412-a7e3-a7c73b3e0f6f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:15.579754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25cd80-5a43-4412-a7e3-a7c73b3e0f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:15.580147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25cd80-5a43-4412-a7e3-a7c73b3e0f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:15.581082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25cd80-5a43-4412-a7e3-a7c73b3e0f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:18:15.581615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25cd80-5a43-4412-a7e3-a7c73b3e0f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:15.583442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25cd80-5a43-4412-a7e3-a7c73b3e0f6f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:15.610515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522a143-b2ad-4333-89b3-1f8dc68ffc6e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:15.615825 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3471/6911] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:18:15.625276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522a143-b2ad-4333-89b3-1f8dc68ffc6e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:15.636553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53ba3f-d744-41ad-8985-ea99aac91d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:15.639078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53ba3f-d744-41ad-8985-ea99aac91d14 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:15.640519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53ba3f-d744-41ad-8985-ea99aac91d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:15.641244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53ba3f-d744-41ad-8985-ea99aac91d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:15.642831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53ba3f-d744-41ad-8985-ea99aac91d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:15.649784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53ba3f-d744-41ad-8985-ea99aac91d14 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:15.687550 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3441/6912] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:18:15 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:15.696969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25cd80-5a43-4412-a7e3-a7c73b3e0f6f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:15.716014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25cd80-5a43-4412-a7e3-a7c73b3e0f6f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:15.828423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f9023-630b-4b82-9bda-59601aeb32c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:15.829556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9023-630b-4b82-9bda-59601aeb32c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:15.830069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9023-630b-4b82-9bda-59601aeb32c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:15.830588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9023-630b-4b82-9bda-59601aeb32c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:15.831837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f9023-630b-4b82-9bda-59601aeb32c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:15.834563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f9023-630b-4b82-9bda-59601aeb32c1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:15.886136 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3472/6913] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:18:15 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:15.889815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53ba3f-d744-41ad-8985-ea99aac91d14 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:15.903978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53ba3f-d744-41ad-8985-ea99aac91d14 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:15.924778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae15ddf-94a5-4cdc-899a-ea0eb2d210d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:15.925671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15ddf-94a5-4cdc-899a-ea0eb2d210d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:15.926177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15ddf-94a5-4cdc-899a-ea0eb2d210d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:15.926879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15ddf-94a5-4cdc-899a-ea0eb2d210d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:15.927625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae15ddf-94a5-4cdc-899a-ea0eb2d210d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:15.937053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae15ddf-94a5-4cdc-899a-ea0eb2d210d2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:15.956675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f9023-630b-4b82-9bda-59601aeb32c1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:15.957897 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3442/6914] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:15.985162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f9023-630b-4b82-9bda-59601aeb32c1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:16.000363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9cc0a-b9d0-4987-b21b-8466276eb2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:16.001232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9cc0a-b9d0-4987-b21b-8466276eb2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:16.001674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9cc0a-b9d0-4987-b21b-8466276eb2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:16.002274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9cc0a-b9d0-4987-b21b-8466276eb2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:16.003226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9cc0a-b9d0-4987-b21b-8466276eb2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:16.005311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9cc0a-b9d0-4987-b21b-8466276eb2d5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:16.032766 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3473/6915] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:16.035883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae15ddf-94a5-4cdc-899a-ea0eb2d210d2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:16.057458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae15ddf-94a5-4cdc-899a-ea0eb2d210d2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:16.066189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d9e5-5392-4b5a-93f4-7b08fd6d7bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:16.067414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d9e5-5392-4b5a-93f4-7b08fd6d7bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:16.068003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d9e5-5392-4b5a-93f4-7b08fd6d7bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:16.068452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d9e5-5392-4b5a-93f4-7b08fd6d7bdc admin admin] PATH_INFO: `/v3/projects/5a867629c8954f369fe6a31d699131ae/users/f486ab1581c34819a271e7ec8d3886f1/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:16.106136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143d9e5-5392-4b5a-93f4-7b08fd6d7bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a867629c8954f369fe6a31d699131ae, user_id=f486ab1581c34819a271e7ec8d3886f1, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:16.109951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143d9e5-5392-4b5a-93f4-7b08fd6d7bdc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:16.132309 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3443/6916] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:16 2022] PUT /identity/v3/projects/5a867629c8954f369fe6a31d699131ae/users/f486ab1581c34819a271e7ec8d3886f1/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:16.137304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8616c2-b7ed-4ddc-a2f8-780fe857957c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:16.137521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8616c2-b7ed-4ddc-a2f8-780fe857957c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:16.137828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8616c2-b7ed-4ddc-a2f8-780fe857957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:16.180305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7a8616c2-b7ed-4ddc-a2f8-780fe857957c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:16.183730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7a8616c2-b7ed-4ddc-a2f8-780fe857957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:16.194763 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:16.351887 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3474/6917] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:18:16.373596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d9e5-5392-4b5a-93f4-7b08fd6d7bdc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:16.380530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6143d9e5-5392-4b5a-93f4-7b08fd6d7bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:16.447218 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:16.576267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d9e5-5392-4b5a-93f4-7b08fd6d7bdc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:16.591430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b6d11-e99f-4eb1-b6bd-2ec938dec6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:16.593204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6d11-e99f-4eb1-b6bd-2ec938dec6da service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:16.594956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6d11-e99f-4eb1-b6bd-2ec938dec6da service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:16.595248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6d11-e99f-4eb1-b6bd-2ec938dec6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:16.614426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b6d11-e99f-4eb1-b6bd-2ec938dec6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:16.616434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b6d11-e99f-4eb1-b6bd-2ec938dec6da service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:16.631390 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3444/6918] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:22.186455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8616c2-b7ed-4ddc-a2f8-780fe857957c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:22.188311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7a8616c2-b7ed-4ddc-a2f8-780fe857957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:22.206666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8616c2-b7ed-4ddc-a2f8-780fe857957c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:22.221693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:22.222571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:22.223340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:22.223808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] PATH_INFO: `/v3/users/04d06e2852bc4313ad4d4579ad048961` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:22.227169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d06e2852bc4313ad4d4579ad048961)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:22.231929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:22.308348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d06e2852bc4313ad4d4579ad048961'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:22.327090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d06e2852bc4313ad4d4579ad048961'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:22.342464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d06e2852bc4313ad4d4579ad048961'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:22.356329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d06e2852bc4313ad4d4579ad048961'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:22.357864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d06e2852bc4313ad4d4579ad048961'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:22.369937 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3475/6919] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:18:22 2022] DELETE /identity/v3/users/04d06e2852bc4313ad4d4579ad048961 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:22.376227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65909-b461-433c-b69c-8931b5fcaac0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:22.376784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65909-b461-433c-b69c-8931b5fcaac0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:22.376911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65909-b461-433c-b69c-8931b5fcaac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:22.407167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d7b65909-b461-433c-b69c-8931b5fcaac0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:22.408613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d7b65909-b461-433c-b69c-8931b5fcaac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:22.541813 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3445/6920] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:22.614977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:22.618205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:22.737025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54beb5e-c5aa-4481-8a8e-eecba2c49db0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:22.747383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774635a1-43c1-4d74-bdd9-3d20a5d17c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:22.748382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774635a1-43c1-4d74-bdd9-3d20a5d17c56 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:22.748686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774635a1-43c1-4d74-bdd9-3d20a5d17c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:22.750430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774635a1-43c1-4d74-bdd9-3d20a5d17c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:22.774951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774635a1-43c1-4d74-bdd9-3d20a5d17c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:22.776569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774635a1-43c1-4d74-bdd9-3d20a5d17c56 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:22.798369 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3476/6921] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:24.513315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b65909-b461-433c-b69c-8931b5fcaac0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:24.514892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d7b65909-b461-433c-b69c-8931b5fcaac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:24.536282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b65909-b461-433c-b69c-8931b5fcaac0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:24.545862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:24.546894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:24.547470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:24.547922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] PATH_INFO: `/v3/projects/bf2a8385cbaa481b8ab20940ef6af1f8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:24.554247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2a8385cbaa481b8ab20940ef6af1f8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:24.556790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:24.659004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2a8385cbaa481b8ab20940ef6af1f8', 'request_id': 'req-905763db-ea07-4c27-b5d4-dcd88a4d1448'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:24.675375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2a8385cbaa481b8ab20940ef6af1f8', 'request_id': 'req-905763db-ea07-4c27-b5d4-dcd88a4d1448'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:24.699310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2a8385cbaa481b8ab20940ef6af1f8', 'request_id': 'req-905763db-ea07-4c27-b5d4-dcd88a4d1448'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:24.717424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] The token cache is being invalidate because project bf2a8385cbaa481b8ab20940ef6af1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:18:24.718271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:24.720173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:24.724058 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3446/6922] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:18:24 2022] DELETE /identity/v3/projects/bf2a8385cbaa481b8ab20940ef6af1f8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:24.729022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774635a1-43c1-4d74-bdd9-3d20a5d17c56 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:24.739498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774635a1-43c1-4d74-bdd9-3d20a5d17c56 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:24.760962 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:24.853892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:24.856235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:24.857448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:24.858283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] PATH_INFO: `/v3/users/9680e890ce874874976de42f8127e6bd` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:24.860859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9680e890ce874874976de42f8127e6bd)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:24.864412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:24.964336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9680e890ce874874976de42f8127e6bd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:24.990917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9680e890ce874874976de42f8127e6bd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:25.002830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9680e890ce874874976de42f8127e6bd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:25.014353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9680e890ce874874976de42f8127e6bd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:25.015602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-490eef95-504e-4ee1-8ed5-8e6bd533a774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9680e890ce874874976de42f8127e6bd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:25.055629 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3477/6923] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:18:24 2022] DELETE /identity/v3/users/9680e890ce874874976de42f8127e6bd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:18:25.624086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:25.625871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:25.654543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905763db-ea07-4c27-b5d4-dcd88a4d1448 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:25.761855 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:25.833846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:25.834822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:25.838186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:25.838713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] PATH_INFO: `/v3/projects/5eea753e8c5c4019b777c3cbe8521d6f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:25.843227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eea753e8c5c4019b777c3cbe8521d6f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:25.847075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:25.953073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eea753e8c5c4019b777c3cbe8521d6f', 'request_id': 'req-4403b24a-d97c-4b3c-9e4e-b36758db9558'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:25.972729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eea753e8c5c4019b777c3cbe8521d6f', 'request_id': 'req-4403b24a-d97c-4b3c-9e4e-b36758db9558'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:25.980214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eea753e8c5c4019b777c3cbe8521d6f', 'request_id': 'req-4403b24a-d97c-4b3c-9e4e-b36758db9558'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:26.004817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] The token cache is being invalidate because project 5eea753e8c5c4019b777c3cbe8521d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:18:26.005410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:26.006477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4403b24a-d97c-4b3c-9e4e-b36758db9558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:26.008926 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3447/6924] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:18:25 2022] DELETE /identity/v3/projects/5eea753e8c5c4019b777c3cbe8521d6f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:26.014225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a13ea-2b1b-4b4b-b1e7-af741688f262 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:26.014762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a13ea-2b1b-4b4b-b1e7-af741688f262 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:26.014762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a13ea-2b1b-4b4b-b1e7-af741688f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:26.061228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-856a13ea-2b1b-4b4b-b1e7-af741688f262 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:26.064322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-856a13ea-2b1b-4b4b-b1e7-af741688f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:26.204645 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3478/6925] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:26.212580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f4e2-6603-44c0-bd61-c25fc6fc653c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:26.213060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f4e2-6603-44c0-bd61-c25fc6fc653c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:26.213650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f4e2-6603-44c0-bd61-c25fc6fc653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:26.242180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0db5f4e2-6603-44c0-bd61-c25fc6fc653c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:26.242716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0db5f4e2-6603-44c0-bd61-c25fc6fc653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:26.252777 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3448/6926] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:18:26.257693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a13ea-2b1b-4b4b-b1e7-af741688f262 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:26.270852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a13ea-2b1b-4b4b-b1e7-af741688f262 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:26.276877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2eb7d-ec58-41d6-93fa-f3fde00ec58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:26.277513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2eb7d-ec58-41d6-93fa-f3fde00ec58b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:26.277796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2eb7d-ec58-41d6-93fa-f3fde00ec58b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:26.278067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2eb7d-ec58-41d6-93fa-f3fde00ec58b admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:26.278728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2eb7d-ec58-41d6-93fa-f3fde00ec58b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:18:26.279068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2eb7d-ec58-41d6-93fa-f3fde00ec58b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:26.281320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2eb7d-ec58-41d6-93fa-f3fde00ec58b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:26.297317 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3479/6927] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:18:26.302810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f4e2-6603-44c0-bd61-c25fc6fc653c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:26.315725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f4e2-6603-44c0-bd61-c25fc6fc653c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:26.336537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82089c2a-1bbc-4497-8357-615bac32d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:26.338770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82089c2a-1bbc-4497-8357-615bac32d920 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:26.339097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82089c2a-1bbc-4497-8357-615bac32d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:26.342272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82089c2a-1bbc-4497-8357-615bac32d920 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:26.342471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82089c2a-1bbc-4497-8357-615bac32d920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:26.344392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82089c2a-1bbc-4497-8357-615bac32d920 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:26.380672 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3449/6928] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:18:26 2022] POST /identity/v3/projects => generated 363 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:26.385256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2eb7d-ec58-41d6-93fa-f3fde00ec58b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:26.396235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2eb7d-ec58-41d6-93fa-f3fde00ec58b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:26.431415 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:26.470967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdaa71-7077-439c-a452-772c80358627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:26.471790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdaa71-7077-439c-a452-772c80358627 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:26.472245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdaa71-7077-439c-a452-772c80358627 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:26.472555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdaa71-7077-439c-a452-772c80358627 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:26.473323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdaa71-7077-439c-a452-772c80358627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:26.475679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdaa71-7077-439c-a452-772c80358627 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:26.505359 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3480/6929] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:18:26 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:26.511427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82089c2a-1bbc-4497-8357-615bac32d920 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:26.526599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82089c2a-1bbc-4497-8357-615bac32d920 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:26.534271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10d9d1-cc9f-4131-b9f9-06acfa90e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:26.535048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10d9d1-cc9f-4131-b9f9-06acfa90e7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:26.535431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10d9d1-cc9f-4131-b9f9-06acfa90e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:26.535799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10d9d1-cc9f-4131-b9f9-06acfa90e7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:26.536707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10d9d1-cc9f-4131-b9f9-06acfa90e7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:26.539425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10d9d1-cc9f-4131-b9f9-06acfa90e7d1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:26.557938 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3450/6930] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:26.559330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdaa71-7077-439c-a452-772c80358627 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:26.572141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdaa71-7077-439c-a452-772c80358627 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:26.579401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f80de9-40c4-4e39-89a0-473fad68a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:26.581394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f80de9-40c4-4e39-89a0-473fad68a7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:26.581792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f80de9-40c4-4e39-89a0-473fad68a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:26.582230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f80de9-40c4-4e39-89a0-473fad68a7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:26.582988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f80de9-40c4-4e39-89a0-473fad68a7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:26.586016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f80de9-40c4-4e39-89a0-473fad68a7f4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:26.602823 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3481/6931] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:26.604917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10d9d1-cc9f-4131-b9f9-06acfa90e7d1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:26.618146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10d9d1-cc9f-4131-b9f9-06acfa90e7d1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:26.624450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a94d9-1378-4300-a319-f6798f1a1755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:26.625543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a94d9-1378-4300-a319-f6798f1a1755 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:26.625926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a94d9-1378-4300-a319-f6798f1a1755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:26.626300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a94d9-1378-4300-a319-f6798f1a1755 admin admin] PATH_INFO: `/v3/projects/b34eed7e7a7e4998abac16a5c1a19659/users/c6fb61f3adbd4ea0af4d92d0dbaea497/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:26.646348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a94d9-1378-4300-a319-f6798f1a1755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34eed7e7a7e4998abac16a5c1a19659, user_id=c6fb61f3adbd4ea0af4d92d0dbaea497, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:26.650921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a94d9-1378-4300-a319-f6798f1a1755 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:26.682675 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3451/6932] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:26 2022] PUT /identity/v3/projects/b34eed7e7a7e4998abac16a5c1a19659/users/c6fb61f3adbd4ea0af4d92d0dbaea497/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:18:26.686329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fdfbf-f75c-41fd-bbdf-a0e742c50a28 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:26.686821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fdfbf-f75c-41fd-bbdf-a0e742c50a28 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:26.687267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fdfbf-f75c-41fd-bbdf-a0e742c50a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:26.750262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ba2fdfbf-f75c-41fd-bbdf-a0e742c50a28 None None] MFA Rules not processed for user `c6fb61f3adbd4ea0af4d92d0dbaea497`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:26.752137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ba2fdfbf-f75c-41fd-bbdf-a0e742c50a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:26.872747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a94d9-1378-4300-a319-f6798f1a1755 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:26.873336 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3482/6933] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:26.983142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a94d9-1378-4300-a319-f6798f1a1755 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:27.000695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e9f0-8e6a-492b-a8c1-00dfc6f2a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:27.002062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e9f0-8e6a-492b-a8c1-00dfc6f2a07b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:27.002496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e9f0-8e6a-492b-a8c1-00dfc6f2a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:27.002786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916e9f0-8e6a-492b-a8c1-00dfc6f2a07b admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:27.003499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916e9f0-8e6a-492b-a8c1-00dfc6f2a07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:27.007753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916e9f0-8e6a-492b-a8c1-00dfc6f2a07b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:27.032901 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:27.043420 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3452/6934] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:18:26 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:18:27.055859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fdfbf-f75c-41fd-bbdf-a0e742c50a28 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:27.075709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fdfbf-f75c-41fd-bbdf-a0e742c50a28 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:27.158243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2563a3-1262-4b4a-b66e-f9a2f1db11fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:27.158929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2563a3-1262-4b4a-b66e-f9a2f1db11fc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:27.159220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2563a3-1262-4b4a-b66e-f9a2f1db11fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:27.159600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2563a3-1262-4b4a-b66e-f9a2f1db11fc admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:27.160318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2563a3-1262-4b4a-b66e-f9a2f1db11fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:27.163026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2563a3-1262-4b4a-b66e-f9a2f1db11fc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:27.200324 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3483/6935] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:18:27 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:27.200539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e9f0-8e6a-492b-a8c1-00dfc6f2a07b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:27.219628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916e9f0-8e6a-492b-a8c1-00dfc6f2a07b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:27.229964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119754-28c9-42bd-bbe6-153fd76d685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:27.230788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119754-28c9-42bd-bbe6-153fd76d685d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:27.230995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119754-28c9-42bd-bbe6-153fd76d685d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:27.231517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119754-28c9-42bd-bbe6-153fd76d685d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:27.232465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9119754-28c9-42bd-bbe6-153fd76d685d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:27.234739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9119754-28c9-42bd-bbe6-153fd76d685d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:27.251762 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3453/6936] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:27.253048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2563a3-1262-4b4a-b66e-f9a2f1db11fc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:27.270411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2563a3-1262-4b4a-b66e-f9a2f1db11fc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:27.282454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e68c2b-ae8a-41d6-aec4-8c5c31e688c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:27.283217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e68c2b-ae8a-41d6-aec4-8c5c31e688c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:27.283559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e68c2b-ae8a-41d6-aec4-8c5c31e688c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:27.283847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e68c2b-ae8a-41d6-aec4-8c5c31e688c7 admin admin] PATH_INFO: `/v3/projects/22ac2dff045341f98f548c87c32acada/users/6f66e63de5be42de9fe2e135bcc48397/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:27.364741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e68c2b-ae8a-41d6-aec4-8c5c31e688c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ac2dff045341f98f548c87c32acada, user_id=6f66e63de5be42de9fe2e135bcc48397, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:27.374575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e68c2b-ae8a-41d6-aec4-8c5c31e688c7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:27.429553 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3484/6937] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:27 2022] PUT /identity/v3/projects/22ac2dff045341f98f548c87c32acada/users/6f66e63de5be42de9fe2e135bcc48397/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:27.435213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119754-28c9-42bd-bbe6-153fd76d685d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:27.451542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119754-28c9-42bd-bbe6-153fd76d685d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:27.589421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363c09a-140c-4559-8ef9-190ebdd59f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:27.590083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363c09a-140c-4559-8ef9-190ebdd59f09 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:27.590365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363c09a-140c-4559-8ef9-190ebdd59f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:27.590639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363c09a-140c-4559-8ef9-190ebdd59f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:27.591424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363c09a-140c-4559-8ef9-190ebdd59f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:27.593112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363c09a-140c-4559-8ef9-190ebdd59f09 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:27.609399 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3454/6938] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:27.613808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e68c2b-ae8a-41d6-aec4-8c5c31e688c7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:27.624804 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:27.634860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e68c2b-ae8a-41d6-aec4-8c5c31e688c7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:27.642161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e1c5-20d7-41c2-9c8f-5e1f3dc5c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:27.642821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e1c5-20d7-41c2-9c8f-5e1f3dc5c339 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:27.643250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e1c5-20d7-41c2-9c8f-5e1f3dc5c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:27.643588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e1c5-20d7-41c2-9c8f-5e1f3dc5c339 admin admin] PATH_INFO: `/v3/projects/22ac2dff045341f98f548c87c32acada/users/6f66e63de5be42de9fe2e135bcc48397/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:27.647157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79e1c5-20d7-41c2-9c8f-5e1f3dc5c339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ac2dff045341f98f548c87c32acada, user_id=6f66e63de5be42de9fe2e135bcc48397, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:27.652086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79e1c5-20d7-41c2-9c8f-5e1f3dc5c339 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:27.670356 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3485/6939] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:27 2022] PUT /identity/v3/projects/22ac2dff045341f98f548c87c32acada/users/6f66e63de5be42de9fe2e135bcc48397/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:27.681781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c70357-c585-4fc7-8551-e6dc33e07430 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:27.683356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c70357-c585-4fc7-8551-e6dc33e07430 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:27.683860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c70357-c585-4fc7-8551-e6dc33e07430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:27.751382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b7c70357-c585-4fc7-8551-e6dc33e07430 None None] MFA Rules not processed for user `6f66e63de5be42de9fe2e135bcc48397`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:27.753003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b7c70357-c585-4fc7-8551-e6dc33e07430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:27.893329 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3455/6940] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:27.907394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e1c5-20d7-41c2-9c8f-5e1f3dc5c339 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:27.910368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e79e1c5-20d7-41c2-9c8f-5e1f3dc5c339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:27.998985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e1c5-20d7-41c2-9c8f-5e1f3dc5c339 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:28.008472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c60d54-e7aa-4e8a-806f-9cc528fec0ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:28.010037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c60d54-e7aa-4e8a-806f-9cc528fec0ef service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:28.010557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c60d54-e7aa-4e8a-806f-9cc528fec0ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:28.010974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c60d54-e7aa-4e8a-806f-9cc528fec0ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:28.028313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c60d54-e7aa-4e8a-806f-9cc528fec0ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:28.030153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c60d54-e7aa-4e8a-806f-9cc528fec0ef service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:28.057219 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3486/6941] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:28.206529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c70357-c585-4fc7-8551-e6dc33e07430 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:28.229539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c70357-c585-4fc7-8551-e6dc33e07430 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:28.238020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f082cef-2ad6-4645-b723-6564215ed4fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:28.238908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f082cef-2ad6-4645-b723-6564215ed4fa service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:28.239344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f082cef-2ad6-4645-b723-6564215ed4fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:28.239865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f082cef-2ad6-4645-b723-6564215ed4fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:28.402720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f082cef-2ad6-4645-b723-6564215ed4fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:28.404203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f082cef-2ad6-4645-b723-6564215ed4fa service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:28.433249 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3456/6942] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:28.691245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04a1d6-a46d-4b3f-a4f9-2e9a402831d1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:28.691664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04a1d6-a46d-4b3f-a4f9-2e9a402831d1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:28.691798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04a1d6-a46d-4b3f-a4f9-2e9a402831d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:28.751617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7b04a1d6-a46d-4b3f-a4f9-2e9a402831d1 None None] MFA Rules not processed for user `f486ab1581c34819a271e7ec8d3886f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:28.754038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7b04a1d6-a46d-4b3f-a4f9-2e9a402831d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:28.839743 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3487/6943] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:28.851463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044e0fa-29b8-4413-9ba2-eb8a52054c5b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:28.851960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044e0fa-29b8-4413-9ba2-eb8a52054c5b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:28.851960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044e0fa-29b8-4413-9ba2-eb8a52054c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:28.865954 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:28.873537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c044e0fa-29b8-4413-9ba2-eb8a52054c5b None None] MFA Rules not processed for user `f486ab1581c34819a271e7ec8d3886f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:28.874769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c044e0fa-29b8-4413-9ba2-eb8a52054c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:28.883766 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3457/6944] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:28.894663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04a1d6-a46d-4b3f-a4f9-2e9a402831d1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:28.896113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7b04a1d6-a46d-4b3f-a4f9-2e9a402831d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:29.014729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04a1d6-a46d-4b3f-a4f9-2e9a402831d1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:29.020868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fcb58-7914-4a5f-9e47-11e7532432a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:29.021509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fcb58-7914-4a5f-9e47-11e7532432a6 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:29.021794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fcb58-7914-4a5f-9e47-11e7532432a6 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:29.022077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fcb58-7914-4a5f-9e47-11e7532432a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:29.031280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fcb58-7914-4a5f-9e47-11e7532432a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:29.033853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fcb58-7914-4a5f-9e47-11e7532432a6 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:29.045729 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3488/6945] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:31.873365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044e0fa-29b8-4413-9ba2-eb8a52054c5b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:32.015250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044e0fa-29b8-4413-9ba2-eb8a52054c5b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:32.021940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:32.023376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:32.023845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:32.024408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] PATH_INFO: `/v3/users/c6fb61f3adbd4ea0af4d92d0dbaea497` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:32.026340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fb61f3adbd4ea0af4d92d0dbaea497)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:32.029320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:32.158052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fb61f3adbd4ea0af4d92d0dbaea497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:32.195650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fb61f3adbd4ea0af4d92d0dbaea497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:32.208807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fb61f3adbd4ea0af4d92d0dbaea497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:32.218995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fb61f3adbd4ea0af4d92d0dbaea497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:32.221427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fb61f3adbd4ea0af4d92d0dbaea497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:32.251082 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3458/6946] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:18:31 2022] DELETE /identity/v3/users/c6fb61f3adbd4ea0af4d92d0dbaea497 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:32.258496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f79e-d022-4b31-a493-3e3a33c8c28a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:32.259006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f79e-d022-4b31-a493-3e3a33c8c28a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:32.259089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f79e-d022-4b31-a493-3e3a33c8c28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:32.304173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5ff4f79e-d022-4b31-a493-3e3a33c8c28a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:32.309542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5ff4f79e-d022-4b31-a493-3e3a33c8c28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:32.323359 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:32.505254 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3489/6947] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:32.535909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:32.537417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:32.705660 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bfb90-599c-4639-ba1d-808cff24b3a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:32.731342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779db54-5b7f-4dd8-a433-3d07799877a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:32.736999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779db54-5b7f-4dd8-a433-3d07799877a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:32.737695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779db54-5b7f-4dd8-a433-3d07799877a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:32.738144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779db54-5b7f-4dd8-a433-3d07799877a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:32.761712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779db54-5b7f-4dd8-a433-3d07799877a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:32.763109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779db54-5b7f-4dd8-a433-3d07799877a5 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:32.783281 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3459/6948] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:33.898865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4f79e-d022-4b31-a493-3e3a33c8c28a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:33.902150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5ff4f79e-d022-4b31-a493-3e3a33c8c28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:33.919156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4f79e-d022-4b31-a493-3e3a33c8c28a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:33.947220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:33.951288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:33.954073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:33.956249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] PATH_INFO: `/v3/projects/b34eed7e7a7e4998abac16a5c1a19659` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:33.961494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34eed7e7a7e4998abac16a5c1a19659)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:33.963457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:34.081086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34eed7e7a7e4998abac16a5c1a19659', 'request_id': 'req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.107647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34eed7e7a7e4998abac16a5c1a19659', 'request_id': 'req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.120857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34eed7e7a7e4998abac16a5c1a19659', 'request_id': 'req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.147879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] The token cache is being invalidate because project b34eed7e7a7e4998abac16a5c1a19659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:18:34.148183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.151046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.154103 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3490/6949] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:18:33 2022] DELETE /identity/v3/projects/b34eed7e7a7e4998abac16a5c1a19659 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:34.157798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779db54-5b7f-4dd8-a433-3d07799877a5 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:34.171791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779db54-5b7f-4dd8-a433-3d07799877a5 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:34.208750 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:34.265082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:34.266746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:34.267102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:34.270236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] PATH_INFO: `/v3/users/6f66e63de5be42de9fe2e135bcc48397` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:34.274159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f66e63de5be42de9fe2e135bcc48397)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:34.277003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:34.371552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f66e63de5be42de9fe2e135bcc48397'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.393811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f66e63de5be42de9fe2e135bcc48397'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.408036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f66e63de5be42de9fe2e135bcc48397'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.425569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f66e63de5be42de9fe2e135bcc48397'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.426521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4fe7a2ea-0b5d-4710-8bce-7887e92e8b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f66e63de5be42de9fe2e135bcc48397'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:34.442891 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3460/6950] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:18:34 2022] DELETE /identity/v3/users/6f66e63de5be42de9fe2e135bcc48397 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:35.692737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:35.695490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:35.711405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d9a80-23da-4c78-80d1-c3ee6ece6adf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:35.809929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:35.810767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:35.810941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:35.812175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] PATH_INFO: `/v3/projects/22ac2dff045341f98f548c87c32acada` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:35.813999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ac2dff045341f98f548c87c32acada)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:35.816384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:35.876381 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:35.912331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ac2dff045341f98f548c87c32acada', 'request_id': 'req-29d021af-3c19-4e35-9df9-98ef463db7f2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:35.931376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ac2dff045341f98f548c87c32acada', 'request_id': 'req-29d021af-3c19-4e35-9df9-98ef463db7f2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:35.942455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ac2dff045341f98f548c87c32acada', 'request_id': 'req-29d021af-3c19-4e35-9df9-98ef463db7f2'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:35.957039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] The token cache is being invalidate because project 22ac2dff045341f98f548c87c32acada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:18:35.957341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:35.958259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-29d021af-3c19-4e35-9df9-98ef463db7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:35.960546 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3491/6951] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:18:35 2022] DELETE /identity/v3/projects/22ac2dff045341f98f548c87c32acada => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:35.965823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e0778-6051-4a6a-ada1-20044af08137 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:35.967070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e0778-6051-4a6a-ada1-20044af08137 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:35.967540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e0778-6051-4a6a-ada1-20044af08137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:36.000125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-842e0778-6051-4a6a-ada1-20044af08137 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:36.002215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-842e0778-6051-4a6a-ada1-20044af08137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:36.140949 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3461/6952] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:36.149827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f275e8-6217-4562-afa2-772da23b9bd3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:36.150119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f275e8-6217-4562-afa2-772da23b9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:36.150446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f275e8-6217-4562-afa2-772da23b9bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:36.207211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-76f275e8-6217-4562-afa2-772da23b9bd3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:36.211829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-76f275e8-6217-4562-afa2-772da23b9bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:36.242841 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3492/6953] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:36.247461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e0778-6051-4a6a-ada1-20044af08137 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:36.264572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e0778-6051-4a6a-ada1-20044af08137 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:36.273441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff56bc8-44ef-4c38-8a21-2c5fc520c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:36.274083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff56bc8-44ef-4c38-8a21-2c5fc520c81d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:36.274370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff56bc8-44ef-4c38-8a21-2c5fc520c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:36.274721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff56bc8-44ef-4c38-8a21-2c5fc520c81d admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:36.275391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff56bc8-44ef-4c38-8a21-2c5fc520c81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:18:36.275714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff56bc8-44ef-4c38-8a21-2c5fc520c81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:36.277554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff56bc8-44ef-4c38-8a21-2c5fc520c81d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:36.310386 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3462/6954] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:18:36.315276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f275e8-6217-4562-afa2-772da23b9bd3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:36.335525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f275e8-6217-4562-afa2-772da23b9bd3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:36.342034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb478-2af5-409a-a86e-c1f7a0e944ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:36.343956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb478-2af5-409a-a86e-c1f7a0e944ea admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:36.344452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb478-2af5-409a-a86e-c1f7a0e944ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:36.345066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb478-2af5-409a-a86e-c1f7a0e944ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:36.346009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901eb478-2af5-409a-a86e-c1f7a0e944ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:36.348738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901eb478-2af5-409a-a86e-c1f7a0e944ea admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:36.404172 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3493/6955] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:18:36 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:36.408117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff56bc8-44ef-4c38-8a21-2c5fc520c81d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:36.419486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff56bc8-44ef-4c38-8a21-2c5fc520c81d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:36.456999 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:36.524363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ab4a2-bb8a-4e3a-8de0-60efe1530728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:36.525244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ab4a2-bb8a-4e3a-8de0-60efe1530728 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:36.525755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ab4a2-bb8a-4e3a-8de0-60efe1530728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:36.526033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ab4a2-bb8a-4e3a-8de0-60efe1530728 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:36.527740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ab4a2-bb8a-4e3a-8de0-60efe1530728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:36.530258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ab4a2-bb8a-4e3a-8de0-60efe1530728 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:36.573437 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3463/6956] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:18:36 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:36.575519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb478-2af5-409a-a86e-c1f7a0e944ea admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:36.593705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb478-2af5-409a-a86e-c1f7a0e944ea admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:36.606020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0440ad-5ef3-461f-b10c-fb5824ffcfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:36.606677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0440ad-5ef3-461f-b10c-fb5824ffcfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:36.606965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0440ad-5ef3-461f-b10c-fb5824ffcfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:36.607247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0440ad-5ef3-461f-b10c-fb5824ffcfd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:36.608202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0440ad-5ef3-461f-b10c-fb5824ffcfd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:36.610047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0440ad-5ef3-461f-b10c-fb5824ffcfd9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:36.639858 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3494/6957] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:18:36.642655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ab4a2-bb8a-4e3a-8de0-60efe1530728 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:36.670535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ab4a2-bb8a-4e3a-8de0-60efe1530728 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:36.677536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787179c-2d0f-4b3a-9cd4-4ca23e974d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:36.678327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787179c-2d0f-4b3a-9cd4-4ca23e974d72 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:36.678926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787179c-2d0f-4b3a-9cd4-4ca23e974d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:36.679275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787179c-2d0f-4b3a-9cd4-4ca23e974d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:36.680002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787179c-2d0f-4b3a-9cd4-4ca23e974d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:36.682319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787179c-2d0f-4b3a-9cd4-4ca23e974d72 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:36.888671 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3464/6958] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:36.890888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0440ad-5ef3-461f-b10c-fb5824ffcfd9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:36.902489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0440ad-5ef3-461f-b10c-fb5824ffcfd9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:36.909473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c6abb-f17e-4808-b8f1-3c9c84a841a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:36.910895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c6abb-f17e-4808-b8f1-3c9c84a841a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:36.910895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c6abb-f17e-4808-b8f1-3c9c84a841a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:36.910895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c6abb-f17e-4808-b8f1-3c9c84a841a9 admin admin] PATH_INFO: `/v3/projects/35a3ad54e0c44ccc97e4faacedaee51c/users/8076ef01306548b699648ca92a23e4fc/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:36.930924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c6abb-f17e-4808-b8f1-3c9c84a841a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a3ad54e0c44ccc97e4faacedaee51c, user_id=8076ef01306548b699648ca92a23e4fc, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:36.933922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c6abb-f17e-4808-b8f1-3c9c84a841a9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:36.950674 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3495/6959] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:36 2022] PUT /identity/v3/projects/35a3ad54e0c44ccc97e4faacedaee51c/users/8076ef01306548b699648ca92a23e4fc/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:36.961124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6155cf1-cef1-4c3c-b1b2-02deb041be51 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:36.961409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6155cf1-cef1-4c3c-b1b2-02deb041be51 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:36.961688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6155cf1-cef1-4c3c-b1b2-02deb041be51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:36.991472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d6155cf1-cef1-4c3c-b1b2-02deb041be51 None None] MFA Rules not processed for user `8076ef01306548b699648ca92a23e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:36.993053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d6155cf1-cef1-4c3c-b1b2-02deb041be51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:37.104341 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3465/6960] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:37.105272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c6abb-f17e-4808-b8f1-3c9c84a841a9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:37.191881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c6abb-f17e-4808-b8f1-3c9c84a841a9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:37.199747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe13a3-df9a-4dc6-8be9-7a2a745c5a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:37.199747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe13a3-df9a-4dc6-8be9-7a2a745c5a72 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:37.199747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe13a3-df9a-4dc6-8be9-7a2a745c5a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:37.199747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe13a3-df9a-4dc6-8be9-7a2a745c5a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:37.200496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe13a3-df9a-4dc6-8be9-7a2a745c5a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:37.202832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe13a3-df9a-4dc6-8be9-7a2a745c5a72 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:37.244949 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3496/6961] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:18:37 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:18:37.246496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6155cf1-cef1-4c3c-b1b2-02deb041be51 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:37.258392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6155cf1-cef1-4c3c-b1b2-02deb041be51 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:37.332948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66b085-7f7f-4d75-926d-1bda2596dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:37.333570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66b085-7f7f-4d75-926d-1bda2596dd4e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:37.333849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66b085-7f7f-4d75-926d-1bda2596dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:37.334122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66b085-7f7f-4d75-926d-1bda2596dd4e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:37.335295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66b085-7f7f-4d75-926d-1bda2596dd4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:37.337475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66b085-7f7f-4d75-926d-1bda2596dd4e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:37.364081 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3466/6962] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:18:37 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:18:37.368811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe13a3-df9a-4dc6-8be9-7a2a745c5a72 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:37.386573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe13a3-df9a-4dc6-8be9-7a2a745c5a72 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:37.393028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94389-41f6-4ddf-95a7-e2393189eb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:37.393911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94389-41f6-4ddf-95a7-e2393189eb44 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:37.394189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94389-41f6-4ddf-95a7-e2393189eb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:37.394579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94389-41f6-4ddf-95a7-e2393189eb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:37.395427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94389-41f6-4ddf-95a7-e2393189eb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:37.397319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94389-41f6-4ddf-95a7-e2393189eb44 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:37.413967 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3497/6963] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:37.417564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66b085-7f7f-4d75-926d-1bda2596dd4e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:37.431987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66b085-7f7f-4d75-926d-1bda2596dd4e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:37.438916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14cff2-cc7d-4b9d-b033-a44db692a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:37.439788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14cff2-cc7d-4b9d-b033-a44db692a090 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:37.440170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14cff2-cc7d-4b9d-b033-a44db692a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:37.440802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14cff2-cc7d-4b9d-b033-a44db692a090 admin admin] PATH_INFO: `/v3/projects/e55418aa642a48c499adaeb918b845b7/users/24596d5c2703435c94eb4f6f737cf659/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:37.461661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14cff2-cc7d-4b9d-b033-a44db692a090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55418aa642a48c499adaeb918b845b7, user_id=24596d5c2703435c94eb4f6f737cf659, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:37.464900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14cff2-cc7d-4b9d-b033-a44db692a090 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:37.482272 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3467/6964] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:37 2022] PUT /identity/v3/projects/e55418aa642a48c499adaeb918b845b7/users/24596d5c2703435c94eb4f6f737cf659/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:37.486596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94389-41f6-4ddf-95a7-e2393189eb44 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:37.498017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94389-41f6-4ddf-95a7-e2393189eb44 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:37.542613 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:37.590804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc1030-7b8c-408b-961a-2e7b6a120f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:37.591480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1030-7b8c-408b-961a-2e7b6a120f70 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:37.591819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1030-7b8c-408b-961a-2e7b6a120f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:37.593946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1030-7b8c-408b-961a-2e7b6a120f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:37.593946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc1030-7b8c-408b-961a-2e7b6a120f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:37.596743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc1030-7b8c-408b-961a-2e7b6a120f70 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:37.608418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3498/6965] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:37.613699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14cff2-cc7d-4b9d-b033-a44db692a090 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:37.619636 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:37.628930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14cff2-cc7d-4b9d-b033-a44db692a090 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:37.635301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9041-8dbf-4b4c-97e6-5d0e8bb14a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:37.636105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9041-8dbf-4b4c-97e6-5d0e8bb14a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:37.636453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9041-8dbf-4b4c-97e6-5d0e8bb14a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:37.636873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9041-8dbf-4b4c-97e6-5d0e8bb14a89 admin admin] PATH_INFO: `/v3/projects/e55418aa642a48c499adaeb918b845b7/users/24596d5c2703435c94eb4f6f737cf659/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:37.642363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a9041-8dbf-4b4c-97e6-5d0e8bb14a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55418aa642a48c499adaeb918b845b7, user_id=24596d5c2703435c94eb4f6f737cf659, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:37.647373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a9041-8dbf-4b4c-97e6-5d0e8bb14a89 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:37.659314 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3468/6966] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:37 2022] PUT /identity/v3/projects/e55418aa642a48c499adaeb918b845b7/users/24596d5c2703435c94eb4f6f737cf659/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:37.673421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed9f8a-6c63-49aa-a68d-069b51b98a05 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:37.673819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed9f8a-6c63-49aa-a68d-069b51b98a05 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:37.674170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed9f8a-6c63-49aa-a68d-069b51b98a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:37.708150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f2ed9f8a-6c63-49aa-a68d-069b51b98a05 None None] MFA Rules not processed for user `24596d5c2703435c94eb4f6f737cf659`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:37.709945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f2ed9f8a-6c63-49aa-a68d-069b51b98a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:37.801761 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3499/6967] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:37.813092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9041-8dbf-4b4c-97e6-5d0e8bb14a89 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:37.814829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6d9a9041-8dbf-4b4c-97e6-5d0e8bb14a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:37.888606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9041-8dbf-4b4c-97e6-5d0e8bb14a89 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:37.892700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa86cff-7632-4f76-83f4-d84d32539292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:37.893327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa86cff-7632-4f76-83f4-d84d32539292 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:37.893609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa86cff-7632-4f76-83f4-d84d32539292 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:37.893906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa86cff-7632-4f76-83f4-d84d32539292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:37.904192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa86cff-7632-4f76-83f4-d84d32539292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:37.905743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa86cff-7632-4f76-83f4-d84d32539292 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:37.917521 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3469/6968] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:18:39.767382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed9f8a-6c63-49aa-a68d-069b51b98a05 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:39.844941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed9f8a-6c63-49aa-a68d-069b51b98a05 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:39.852039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:39.852952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:39.853303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:39.853652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] PATH_INFO: `/v3/users/8076ef01306548b699648ca92a23e4fc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:39.856175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8076ef01306548b699648ca92a23e4fc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:39.858436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:39.927034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8076ef01306548b699648ca92a23e4fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:39.938523 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:39.947042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8076ef01306548b699648ca92a23e4fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:39.967792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8076ef01306548b699648ca92a23e4fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:39.980056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8076ef01306548b699648ca92a23e4fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:39.980994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8076ef01306548b699648ca92a23e4fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:39.990228 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3500/6969] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:18:39 2022] DELETE /identity/v3/users/8076ef01306548b699648ca92a23e4fc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:18:39.996031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223df750-0b5a-440e-bcae-d07128366195 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:40.000436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223df750-0b5a-440e-bcae-d07128366195 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:40.000813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223df750-0b5a-440e-bcae-d07128366195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:40.025341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-223df750-0b5a-440e-bcae-d07128366195 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:40.026564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-223df750-0b5a-440e-bcae-d07128366195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:40.104344 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3470/6970] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:40.114521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:40.116268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:40.206321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcfd50-a6af-4eb4-aa63-74986cb5298c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:40.218467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb626fa-e8e2-4ad2-9ec6-b35edd4272e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:40.219382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb626fa-e8e2-4ad2-9ec6-b35edd4272e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:40.219863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb626fa-e8e2-4ad2-9ec6-b35edd4272e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:40.220305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb626fa-e8e2-4ad2-9ec6-b35edd4272e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:40.232304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb626fa-e8e2-4ad2-9ec6-b35edd4272e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:40.235350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb626fa-e8e2-4ad2-9ec6-b35edd4272e1 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:40.251368 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3501/6971] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:40.631418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223df750-0b5a-440e-bcae-d07128366195 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:40.632867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-223df750-0b5a-440e-bcae-d07128366195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:40.650830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223df750-0b5a-440e-bcae-d07128366195 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:40.659676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:40.660335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:40.660795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:40.661012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] PATH_INFO: `/v3/projects/35a3ad54e0c44ccc97e4faacedaee51c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:40.662165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a3ad54e0c44ccc97e4faacedaee51c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:40.665144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:40.737420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a3ad54e0c44ccc97e4faacedaee51c', 'request_id': 'req-24419bdf-0a4f-4523-876a-1e26545e6005'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.746464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a3ad54e0c44ccc97e4faacedaee51c', 'request_id': 'req-24419bdf-0a4f-4523-876a-1e26545e6005'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.757799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a3ad54e0c44ccc97e4faacedaee51c', 'request_id': 'req-24419bdf-0a4f-4523-876a-1e26545e6005'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.772552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] The token cache is being invalidate because project 35a3ad54e0c44ccc97e4faacedaee51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:18:40.772945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.773675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.775580 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3471/6972] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:18:40 2022] DELETE /identity/v3/projects/35a3ad54e0c44ccc97e4faacedaee51c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:40.780408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb626fa-e8e2-4ad2-9ec6-b35edd4272e1 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:40.792789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb626fa-e8e2-4ad2-9ec6-b35edd4272e1 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:40.862617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:40.863321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:40.863606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:40.863886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] PATH_INFO: `/v3/users/24596d5c2703435c94eb4f6f737cf659` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:40.865127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24596d5c2703435c94eb4f6f737cf659)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:40.867700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:40.922442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24596d5c2703435c94eb4f6f737cf659'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.936648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24596d5c2703435c94eb4f6f737cf659'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.946927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24596d5c2703435c94eb4f6f737cf659'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.953270 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:40.956078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24596d5c2703435c94eb4f6f737cf659'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.957127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cdfd2773-2e36-49cd-a9ab-bb1451a9b474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24596d5c2703435c94eb4f6f737cf659'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:40.966207 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3502/6973] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:18:40 2022] DELETE /identity/v3/users/24596d5c2703435c94eb4f6f737cf659 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:41.313783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:41.315369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:41.337757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24419bdf-0a4f-4523-876a-1e26545e6005 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:41.353443 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:41.421849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:41.422499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:41.422780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:41.423057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] PATH_INFO: `/v3/projects/e55418aa642a48c499adaeb918b845b7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:41.424298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e55418aa642a48c499adaeb918b845b7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:41.426311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:41.483480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e55418aa642a48c499adaeb918b845b7', 'request_id': 'req-431a4518-cc93-4c2a-97dc-b6537558de29'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:41.493840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e55418aa642a48c499adaeb918b845b7', 'request_id': 'req-431a4518-cc93-4c2a-97dc-b6537558de29'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:41.501360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e55418aa642a48c499adaeb918b845b7', 'request_id': 'req-431a4518-cc93-4c2a-97dc-b6537558de29'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:41.516525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] The token cache is being invalidate because project e55418aa642a48c499adaeb918b845b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:18:41.517263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:41.517947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-431a4518-cc93-4c2a-97dc-b6537558de29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:41.520495 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3472/6974] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:18:41 2022] DELETE /identity/v3/projects/e55418aa642a48c499adaeb918b845b7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:41.525858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16248398-d480-4e3a-9703-c6c4844a8cea None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:41.526356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16248398-d480-4e3a-9703-c6c4844a8cea None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:41.527126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16248398-d480-4e3a-9703-c6c4844a8cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:41.550978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-16248398-d480-4e3a-9703-c6c4844a8cea None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:41.552479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-16248398-d480-4e3a-9703-c6c4844a8cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:41.653857 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3503/6975] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:41.661976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fc5d8-efb2-4cf7-92ea-ebb34f4736e4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:41.662354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fc5d8-efb2-4cf7-92ea-ebb34f4736e4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:41.662640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fc5d8-efb2-4cf7-92ea-ebb34f4736e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:41.686137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-288fc5d8-efb2-4cf7-92ea-ebb34f4736e4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:41.687342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-288fc5d8-efb2-4cf7-92ea-ebb34f4736e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:41.701832 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3473/6976] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:41.703006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16248398-d480-4e3a-9703-c6c4844a8cea None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:41.717063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16248398-d480-4e3a-9703-c6c4844a8cea None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:41.730050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481836bd-4ac2-4d85-9a2b-6c429fba39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:41.731024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481836bd-4ac2-4d85-9a2b-6c429fba39d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:41.731762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481836bd-4ac2-4d85-9a2b-6c429fba39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:41.731762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481836bd-4ac2-4d85-9a2b-6c429fba39d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:41.732559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481836bd-4ac2-4d85-9a2b-6c429fba39d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:18:41.733528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481836bd-4ac2-4d85-9a2b-6c429fba39d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:41.734694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481836bd-4ac2-4d85-9a2b-6c429fba39d7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:41.752531 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3504/6977] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:18:41.754015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fc5d8-efb2-4cf7-92ea-ebb34f4736e4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:41.766817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fc5d8-efb2-4cf7-92ea-ebb34f4736e4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:41.777374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33ed99-1929-45d0-9d1c-a7e8fdeba91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:41.778818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33ed99-1929-45d0-9d1c-a7e8fdeba91d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:41.779247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33ed99-1929-45d0-9d1c-a7e8fdeba91d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:41.780129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33ed99-1929-45d0-9d1c-a7e8fdeba91d admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:41.780990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33ed99-1929-45d0-9d1c-a7e8fdeba91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:41.789467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33ed99-1929-45d0-9d1c-a7e8fdeba91d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:41.821538 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3474/6978] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:18:41 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:41.825555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481836bd-4ac2-4d85-9a2b-6c429fba39d7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:41.837163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481836bd-4ac2-4d85-9a2b-6c429fba39d7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:41.899308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b19ef-e7e5-4da1-9165-dc7f37d27666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:41.899927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b19ef-e7e5-4da1-9165-dc7f37d27666 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:41.900212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b19ef-e7e5-4da1-9165-dc7f37d27666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:41.900490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b19ef-e7e5-4da1-9165-dc7f37d27666 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:41.901156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b19ef-e7e5-4da1-9165-dc7f37d27666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:41.903083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b19ef-e7e5-4da1-9165-dc7f37d27666 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:41.925053 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3505/6979] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:18:41 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:18:41.930003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33ed99-1929-45d0-9d1c-a7e8fdeba91d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:41.940682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33ed99-1929-45d0-9d1c-a7e8fdeba91d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:41.946172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8cb6-841f-4b6d-a5f0-6a28f7f4d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:41.946786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8cb6-841f-4b6d-a5f0-6a28f7f4d52e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:41.947068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8cb6-841f-4b6d-a5f0-6a28f7f4d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:41.947344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8cb6-841f-4b6d-a5f0-6a28f7f4d52e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:41.947988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec8cb6-841f-4b6d-a5f0-6a28f7f4d52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:41.949614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec8cb6-841f-4b6d-a5f0-6a28f7f4d52e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:41.960743 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3475/6980] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:18:41.964794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b19ef-e7e5-4da1-9165-dc7f37d27666 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:41.975184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b19ef-e7e5-4da1-9165-dc7f37d27666 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:41.979842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4401d0-1da3-4226-b235-915f3b438d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:41.980450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4401d0-1da3-4226-b235-915f3b438d26 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:41.980774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4401d0-1da3-4226-b235-915f3b438d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:41.981051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4401d0-1da3-4226-b235-915f3b438d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:41.981970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4401d0-1da3-4226-b235-915f3b438d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:41.983414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4401d0-1da3-4226-b235-915f3b438d26 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:41.995045 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3506/6981] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:41.999172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8cb6-841f-4b6d-a5f0-6a28f7f4d52e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:42.010188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8cb6-841f-4b6d-a5f0-6a28f7f4d52e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:42.015252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc147c6-99c2-499f-b48b-5e453b14f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:42.015941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc147c6-99c2-499f-b48b-5e453b14f844 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.016222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc147c6-99c2-499f-b48b-5e453b14f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.016983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc147c6-99c2-499f-b48b-5e453b14f844 admin admin] PATH_INFO: `/v3/projects/15e6f8b289564295b783cb868001bdb6/users/71ae796071c84145aa5cb2e23180ea06/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:42.032275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc147c6-99c2-499f-b48b-5e453b14f844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e6f8b289564295b783cb868001bdb6, user_id=71ae796071c84145aa5cb2e23180ea06, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:42.035040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc147c6-99c2-499f-b48b-5e453b14f844 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:42.056406 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3476/6982] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:41 2022] PUT /identity/v3/projects/15e6f8b289564295b783cb868001bdb6/users/71ae796071c84145aa5cb2e23180ea06/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:42.067251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d99941-31a1-4513-aae3-e9c1c7c56daf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.067550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d99941-31a1-4513-aae3-e9c1c7c56daf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.067858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d99941-31a1-4513-aae3-e9c1c7c56daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:42.109421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e5d99941-31a1-4513-aae3-e9c1c7c56daf None None] MFA Rules not processed for user `71ae796071c84145aa5cb2e23180ea06`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:42.110711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e5d99941-31a1-4513-aae3-e9c1c7c56daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:42.171880 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:42.198139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc147c6-99c2-499f-b48b-5e453b14f844 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:42.198461 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3507/6983] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:42.257870 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:42.282616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc147c6-99c2-499f-b48b-5e453b14f844 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:42.288832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcabe44-392b-4790-9ee9-a8787b26ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:42.289592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcabe44-392b-4790-9ee9-a8787b26ee31 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.289982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcabe44-392b-4790-9ee9-a8787b26ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.290362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcabe44-392b-4790-9ee9-a8787b26ee31 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:42.291147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcabe44-392b-4790-9ee9-a8787b26ee31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:42.293353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcabe44-392b-4790-9ee9-a8787b26ee31 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:42.325406 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3477/6984] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:18:42 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:18:42.329369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d99941-31a1-4513-aae3-e9c1c7c56daf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:42.341550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d99941-31a1-4513-aae3-e9c1c7c56daf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:42.413098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99269-ad20-4917-aff0-996ad12b0933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:42.414321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99269-ad20-4917-aff0-996ad12b0933 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.414753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99269-ad20-4917-aff0-996ad12b0933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.415052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99269-ad20-4917-aff0-996ad12b0933 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:42.415708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea99269-ad20-4917-aff0-996ad12b0933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:42.417734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea99269-ad20-4917-aff0-996ad12b0933 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:42.444522 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3508/6985] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:18:42 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:42.448789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcabe44-392b-4790-9ee9-a8787b26ee31 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:42.460187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcabe44-392b-4790-9ee9-a8787b26ee31 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:42.466833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d02a-3831-40b1-a856-d7b7c369415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:42.467582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d02a-3831-40b1-a856-d7b7c369415a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.467940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d02a-3831-40b1-a856-d7b7c369415a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.468240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d02a-3831-40b1-a856-d7b7c369415a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:42.469071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604d02a-3831-40b1-a856-d7b7c369415a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:42.471224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604d02a-3831-40b1-a856-d7b7c369415a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:42.492873 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3478/6986] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:42.496912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99269-ad20-4917-aff0-996ad12b0933 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:42.508442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99269-ad20-4917-aff0-996ad12b0933 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:42.514457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbc9ea-28c7-417e-8597-f81b4aefb8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:42.515926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbc9ea-28c7-417e-8597-f81b4aefb8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.516282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbc9ea-28c7-417e-8597-f81b4aefb8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.516644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbc9ea-28c7-417e-8597-f81b4aefb8e0 admin admin] PATH_INFO: `/v3/projects/38611555b5734f83a3d65768647a7a18/users/29f1cb896e3448dfa14515f65d102214/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:42.534293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbc9ea-28c7-417e-8597-f81b4aefb8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38611555b5734f83a3d65768647a7a18, user_id=29f1cb896e3448dfa14515f65d102214, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:42.537989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbc9ea-28c7-417e-8597-f81b4aefb8e0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:42.564429 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3509/6987] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:42 2022] PUT /identity/v3/projects/38611555b5734f83a3d65768647a7a18/users/29f1cb896e3448dfa14515f65d102214/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:42.568242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d02a-3831-40b1-a856-d7b7c369415a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:42.579486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d02a-3831-40b1-a856-d7b7c369415a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:42.644135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff6ed5-6381-49a2-8bcb-da7eaf2822fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:42.644810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6ed5-6381-49a2-8bcb-da7eaf2822fe admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.645092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6ed5-6381-49a2-8bcb-da7eaf2822fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.645368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6ed5-6381-49a2-8bcb-da7eaf2822fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:42.646016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff6ed5-6381-49a2-8bcb-da7eaf2822fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:42.648165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff6ed5-6381-49a2-8bcb-da7eaf2822fe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:42.660292 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3479/6988] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:42.665225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbc9ea-28c7-417e-8597-f81b4aefb8e0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:42.679996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbc9ea-28c7-417e-8597-f81b4aefb8e0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:42.687091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c1f75-5ce7-47b8-baf0-1301c6c8712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:42.690470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c1f75-5ce7-47b8-baf0-1301c6c8712e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.690794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c1f75-5ce7-47b8-baf0-1301c6c8712e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.691217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c1f75-5ce7-47b8-baf0-1301c6c8712e admin admin] PATH_INFO: `/v3/projects/38611555b5734f83a3d65768647a7a18/users/29f1cb896e3448dfa14515f65d102214/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:42.693870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c1f75-5ce7-47b8-baf0-1301c6c8712e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38611555b5734f83a3d65768647a7a18, user_id=29f1cb896e3448dfa14515f65d102214, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:42.697873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c1f75-5ce7-47b8-baf0-1301c6c8712e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:42.711998 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3510/6989] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:42 2022] PUT /identity/v3/projects/38611555b5734f83a3d65768647a7a18/users/29f1cb896e3448dfa14515f65d102214/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:42.724418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc5ae-1f7c-4451-a977-39858d33d0ac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.724418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc5ae-1f7c-4451-a977-39858d33d0ac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.725414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc5ae-1f7c-4451-a977-39858d33d0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:42.756504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d5cfc5ae-1f7c-4451-a977-39858d33d0ac None None] MFA Rules not processed for user `29f1cb896e3448dfa14515f65d102214`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:42.758088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d5cfc5ae-1f7c-4451-a977-39858d33d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:42.842983 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3480/6990] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:42.854996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c1f75-5ce7-47b8-baf0-1301c6c8712e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:42.856992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3b7c1f75-5ce7-47b8-baf0-1301c6c8712e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:42.944295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c1f75-5ce7-47b8-baf0-1301c6c8712e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:42.948269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6602b-819c-42ea-8f2d-2d0a036e5fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:42.951517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6602b-819c-42ea-8f2d-2d0a036e5fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:42.951517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6602b-819c-42ea-8f2d-2d0a036e5fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:42.951517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6602b-819c-42ea-8f2d-2d0a036e5fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:43.016472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6602b-819c-42ea-8f2d-2d0a036e5fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:43.018364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6602b-819c-42ea-8f2d-2d0a036e5fc2 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:43.024045 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:43.031450 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3511/6991] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:44.133251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc5ae-1f7c-4451-a977-39858d33d0ac None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:44.135539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d5cfc5ae-1f7c-4451-a977-39858d33d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:44.195078 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:44.232729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc5ae-1f7c-4451-a977-39858d33d0ac None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:44.237743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:44.239229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:44.240062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:44.240062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] PATH_INFO: `/v3/users/642edf92163f477fa7c92679776c1ec7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:44.241633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642edf92163f477fa7c92679776c1ec7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:44.244379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:44.309791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642edf92163f477fa7c92679776c1ec7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.324944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642edf92163f477fa7c92679776c1ec7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.333384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642edf92163f477fa7c92679776c1ec7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.342118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642edf92163f477fa7c92679776c1ec7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.342785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642edf92163f477fa7c92679776c1ec7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.349203 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3481/6992] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:18:44 2022] DELETE /identity/v3/users/642edf92163f477fa7c92679776c1ec7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:44.354838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef023-dc28-4e73-aa82-c838efeffdb4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:44.355336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef023-dc28-4e73-aa82-c838efeffdb4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:44.355419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef023-dc28-4e73-aa82-c838efeffdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:44.375688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-751ef023-dc28-4e73-aa82-c838efeffdb4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:44.377141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-751ef023-dc28-4e73-aa82-c838efeffdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:44.441869 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3512/6993] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:44.454152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:44.455926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:44.518477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4dbb4-f786-42ce-ac46-ef40797527b7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:44.523281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7284b-e541-4552-950c-a3b118fdabd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:44.524155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7284b-e541-4552-950c-a3b118fdabd1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:44.524435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7284b-e541-4552-950c-a3b118fdabd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:44.524736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7284b-e541-4552-950c-a3b118fdabd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:44.534509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7284b-e541-4552-950c-a3b118fdabd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:44.535962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7284b-e541-4552-950c-a3b118fdabd1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:44.545880 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3482/6994] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:44.731012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ef023-dc28-4e73-aa82-c838efeffdb4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:44.733194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-751ef023-dc28-4e73-aa82-c838efeffdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:44.748207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ef023-dc28-4e73-aa82-c838efeffdb4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:44.753133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:44.753864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:44.754214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:44.754566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] PATH_INFO: `/v3/projects/6d09410d47f548049e5d001bf8a97bf9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:44.755985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d09410d47f548049e5d001bf8a97bf9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:44.757993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:44.809481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d09410d47f548049e5d001bf8a97bf9', 'request_id': 'req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.817528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d09410d47f548049e5d001bf8a97bf9', 'request_id': 'req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.823945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d09410d47f548049e5d001bf8a97bf9', 'request_id': 'req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.836022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] The token cache is being invalidate because project 6d09410d47f548049e5d001bf8a97bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:18:44.836420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.837117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7a73a6d0-9596-4421-8ef2-9b88a00d12d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:44.838902 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3513/6995] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:18:44 2022] DELETE /identity/v3/projects/6d09410d47f548049e5d001bf8a97bf9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:44.843540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb3244-01d4-4435-9faa-33b1a55ebb16 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:44.843784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb3244-01d4-4435-9faa-33b1a55ebb16 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:44.844062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb3244-01d4-4435-9faa-33b1a55ebb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:44.866536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c8fb3244-01d4-4435-9faa-33b1a55ebb16 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:44.867744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c8fb3244-01d4-4435-9faa-33b1a55ebb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:44.918638 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:44.929941 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3483/6996] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:44.937832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd8ddd-24a0-412c-b02d-e37e321ba15d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:44.938189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd8ddd-24a0-412c-b02d-e37e321ba15d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:44.938533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd8ddd-24a0-412c-b02d-e37e321ba15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:44.960008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8fdd8ddd-24a0-412c-b02d-e37e321ba15d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:44.961310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8fdd8ddd-24a0-412c-b02d-e37e321ba15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:44.969432 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3514/6997] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:44.973652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb3244-01d4-4435-9faa-33b1a55ebb16 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:44.983948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb3244-01d4-4435-9faa-33b1a55ebb16 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:44.988655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a34e1-6036-43e6-9ffa-d558fed4e12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:44.989265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a34e1-6036-43e6-9ffa-d558fed4e12c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:44.989547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a34e1-6036-43e6-9ffa-d558fed4e12c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:44.989825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a34e1-6036-43e6-9ffa-d558fed4e12c admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:44.990979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a34e1-6036-43e6-9ffa-d558fed4e12c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:18:44.991338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a34e1-6036-43e6-9ffa-d558fed4e12c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:44.993013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a34e1-6036-43e6-9ffa-d558fed4e12c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:45.005061 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3484/6998] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:18:45.010024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd8ddd-24a0-412c-b02d-e37e321ba15d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:45.019886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd8ddd-24a0-412c-b02d-e37e321ba15d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:45.025093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0803-52c4-414f-823f-917a576f3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:45.025724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0803-52c4-414f-823f-917a576f3374 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:45.026008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0803-52c4-414f-823f-917a576f3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:45.026288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0803-52c4-414f-823f-917a576f3374 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:45.026920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa0803-52c4-414f-823f-917a576f3374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:45.028884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa0803-52c4-414f-823f-917a576f3374 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:45.067808 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3515/6999] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:18:45 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:45.070235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a34e1-6036-43e6-9ffa-d558fed4e12c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:45.080441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a34e1-6036-43e6-9ffa-d558fed4e12c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:45.142548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588be26-609e-4f90-917d-acb995cd8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:45.143179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588be26-609e-4f90-917d-acb995cd8f55 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:45.143338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588be26-609e-4f90-917d-acb995cd8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:45.143607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588be26-609e-4f90-917d-acb995cd8f55 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:45.144302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588be26-609e-4f90-917d-acb995cd8f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:45.146263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588be26-609e-4f90-917d-acb995cd8f55 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:45.168862 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3485/7000] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:18:45 2022] POST /identity/v3/users => generated 278 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:45.173073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0803-52c4-414f-823f-917a576f3374 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:45.184675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0803-52c4-414f-823f-917a576f3374 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:45.189647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e71fa0-41e2-4fc5-95e2-1e098f1baa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:45.190258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71fa0-41e2-4fc5-95e2-1e098f1baa0f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:45.190537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71fa0-41e2-4fc5-95e2-1e098f1baa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:45.190809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71fa0-41e2-4fc5-95e2-1e098f1baa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:45.191450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e71fa0-41e2-4fc5-95e2-1e098f1baa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:45.193072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e71fa0-41e2-4fc5-95e2-1e098f1baa0f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:45.204124 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3516/7001] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:45.208014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588be26-609e-4f90-917d-acb995cd8f55 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:45.218472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588be26-609e-4f90-917d-acb995cd8f55 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:45.223481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e724d9-af4a-4783-8bc6-398f1d4e3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:45.224074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e724d9-af4a-4783-8bc6-398f1d4e3317 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:45.224348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e724d9-af4a-4783-8bc6-398f1d4e3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:45.225165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e724d9-af4a-4783-8bc6-398f1d4e3317 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:45.225866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e724d9-af4a-4783-8bc6-398f1d4e3317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:45.227441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e724d9-af4a-4783-8bc6-398f1d4e3317 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:45.238023 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3486/7002] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:45.243027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e71fa0-41e2-4fc5-95e2-1e098f1baa0f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:45.253198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e71fa0-41e2-4fc5-95e2-1e098f1baa0f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:45.258459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d836-e1d2-457c-803e-da2b22bf50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:45.259110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d836-e1d2-457c-803e-da2b22bf50c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:45.259385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d836-e1d2-457c-803e-da2b22bf50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:45.259655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d836-e1d2-457c-803e-da2b22bf50c5 admin admin] PATH_INFO: `/v3/projects/61dd7134e98a40429f7052aba14df742/users/43b0aa480b844e3593d9f9f0dd331641/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:45.276495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07d836-e1d2-457c-803e-da2b22bf50c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61dd7134e98a40429f7052aba14df742, user_id=43b0aa480b844e3593d9f9f0dd331641, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:45.279322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07d836-e1d2-457c-803e-da2b22bf50c5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:45.293721 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3517/7003] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:45 2022] PUT /identity/v3/projects/61dd7134e98a40429f7052aba14df742/users/43b0aa480b844e3593d9f9f0dd331641/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:45.305395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f93067-5bb3-4b28-865a-fc256a2d1257 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:45.305971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f93067-5bb3-4b28-865a-fc256a2d1257 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:45.306250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f93067-5bb3-4b28-865a-fc256a2d1257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:45.351958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-35f93067-5bb3-4b28-865a-fc256a2d1257 None None] MFA Rules not processed for user `43b0aa480b844e3593d9f9f0dd331641`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:45.353281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-35f93067-5bb3-4b28-865a-fc256a2d1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:45.430591 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3487/7004] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:45.441805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d836-e1d2-457c-803e-da2b22bf50c5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:45.444456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d07d836-e1d2-457c-803e-da2b22bf50c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:45.472283 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:45.520219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d836-e1d2-457c-803e-da2b22bf50c5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:45.530615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6859-4560-4243-8453-404ca45557a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:45.531390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6859-4560-4243-8453-404ca45557a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:45.531760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6859-4560-4243-8453-404ca45557a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:45.532116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6859-4560-4243-8453-404ca45557a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:45.541882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd6859-4560-4243-8453-404ca45557a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:45.543355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd6859-4560-4243-8453-404ca45557a3 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:45.552576 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3518/7005] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:46.779888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f93067-5bb3-4b28-865a-fc256a2d1257 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:46.781386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-35f93067-5bb3-4b28-865a-fc256a2d1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:46.849217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f93067-5bb3-4b28-865a-fc256a2d1257 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:46.853351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd44916-2a6d-460e-bfb0-695e8697f7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:46.853964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44916-2a6d-460e-bfb0-695e8697f7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:46.854241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44916-2a6d-460e-bfb0-695e8697f7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:46.854512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44916-2a6d-460e-bfb0-695e8697f7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:46.856229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cfd44916-2a6d-460e-bfb0-695e8697f7c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:46.866190 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:46.930574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd44916-2a6d-460e-bfb0-695e8697f7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:46.932167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd44916-2a6d-460e-bfb0-695e8697f7c9 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:46.944004 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3488/7006] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:18:53.175115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6859-4560-4243-8453-404ca45557a3 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:53.178231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ecdd6859-4560-4243-8453-404ca45557a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:53.360994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6859-4560-4243-8453-404ca45557a3 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:53.371864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:53.372679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:53.373212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:53.373684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] PATH_INFO: `/v3/users/f486ab1581c34819a271e7ec8d3886f1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:53.374942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f486ab1581c34819a271e7ec8d3886f1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:53.377126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:53.487452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f486ab1581c34819a271e7ec8d3886f1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:53.504519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f486ab1581c34819a271e7ec8d3886f1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:53.535476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f486ab1581c34819a271e7ec8d3886f1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:53.557767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f486ab1581c34819a271e7ec8d3886f1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:53.558885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-db7bcf67-484e-4d47-8f61-f6667853ea6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f486ab1581c34819a271e7ec8d3886f1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:53.572719 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3519/7007] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:18:53 2022] DELETE /identity/v3/users/f486ab1581c34819a271e7ec8d3886f1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:53.855098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd44916-2a6d-460e-bfb0-695e8697f7c9 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:53.871659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd44916-2a6d-460e-bfb0-695e8697f7c9 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:53.978445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:53.979181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:53.979474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:53.979754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] PATH_INFO: `/v3/projects/5a867629c8954f369fe6a31d699131ae` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:53.981041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a867629c8954f369fe6a31d699131ae)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:53.983147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:54.075527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a867629c8954f369fe6a31d699131ae', 'request_id': 'req-ad35ff15-fec4-4c6a-b3a8-89b381255b18'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:54.089605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a867629c8954f369fe6a31d699131ae', 'request_id': 'req-ad35ff15-fec4-4c6a-b3a8-89b381255b18'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:54.101311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a867629c8954f369fe6a31d699131ae', 'request_id': 'req-ad35ff15-fec4-4c6a-b3a8-89b381255b18'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:54.153427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] The token cache is being invalidate because project 5a867629c8954f369fe6a31d699131ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:18:54.154100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:54.155048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ad35ff15-fec4-4c6a-b3a8-89b381255b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:18:54.159791 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3489/7008] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:18:53 2022] DELETE /identity/v3/projects/5a867629c8954f369fe6a31d699131ae => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:54.162327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2662e-bfe4-489e-a02c-b7eafce59fdd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:54.162841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2662e-bfe4-489e-a02c-b7eafce59fdd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:54.163646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2662e-bfe4-489e-a02c-b7eafce59fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:54.212661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c1b2662e-bfe4-489e-a02c-b7eafce59fdd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:54.214844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1b2662e-bfe4-489e-a02c-b7eafce59fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:54.270320 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:54.333564 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3520/7009] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:54.342438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5304-7bd5-4b33-ada0-bc76b4856adc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:54.342724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5304-7bd5-4b33-ada0-bc76b4856adc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:54.343055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5304-7bd5-4b33-ada0-bc76b4856adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:54.384569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cc2d5304-7bd5-4b33-ada0-bc76b4856adc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:54.389663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cc2d5304-7bd5-4b33-ada0-bc76b4856adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:54.408599 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3490/7010] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:54.413840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2662e-bfe4-489e-a02c-b7eafce59fdd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:54.433289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2662e-bfe4-489e-a02c-b7eafce59fdd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:54.440656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ca39c-236b-42ca-a97d-405a32d4e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:54.441920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ca39c-236b-42ca-a97d-405a32d4e106 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:54.442436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ca39c-236b-42ca-a97d-405a32d4e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:54.442910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ca39c-236b-42ca-a97d-405a32d4e106 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:54.446649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ca39c-236b-42ca-a97d-405a32d4e106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:18:54.447254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ca39c-236b-42ca-a97d-405a32d4e106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:54.449489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ca39c-236b-42ca-a97d-405a32d4e106 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:54.464721 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3521/7011] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:18:54.469717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5304-7bd5-4b33-ada0-bc76b4856adc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:54.479956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5304-7bd5-4b33-ada0-bc76b4856adc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:54.484795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b405353-eeba-435a-b405-68abe3acbd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:54.485403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b405353-eeba-435a-b405-68abe3acbd19 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:54.485684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b405353-eeba-435a-b405-68abe3acbd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:54.485958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b405353-eeba-435a-b405-68abe3acbd19 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:54.486631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b405353-eeba-435a-b405-68abe3acbd19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:54.488589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b405353-eeba-435a-b405-68abe3acbd19 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:54.524301 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3491/7012] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:18:54 2022] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:18:54.528932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ca39c-236b-42ca-a97d-405a32d4e106 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:54.541952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ca39c-236b-42ca-a97d-405a32d4e106 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:54.615169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd235-96ed-4d27-ae72-55065d7e0b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:54.615972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd235-96ed-4d27-ae72-55065d7e0b81 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:54.616354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd235-96ed-4d27-ae72-55065d7e0b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:54.616763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd235-96ed-4d27-ae72-55065d7e0b81 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:54.617509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bd235-96ed-4d27-ae72-55065d7e0b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:54.619615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bd235-96ed-4d27-ae72-55065d7e0b81 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:54.649087 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3522/7013] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:18:54 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:18:54.650313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b405353-eeba-435a-b405-68abe3acbd19 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:54.662740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b405353-eeba-435a-b405-68abe3acbd19 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:54.667823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6751dc-3e45-48d3-babf-ccb76e504be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:54.668441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6751dc-3e45-48d3-babf-ccb76e504be5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:54.668752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6751dc-3e45-48d3-babf-ccb76e504be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:54.669024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6751dc-3e45-48d3-babf-ccb76e504be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:54.669783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6751dc-3e45-48d3-babf-ccb76e504be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:54.671424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6751dc-3e45-48d3-babf-ccb76e504be5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:54.672971 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:54.689216 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3492/7014] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:18:54.690045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd235-96ed-4d27-ae72-55065d7e0b81 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:54.706677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd235-96ed-4d27-ae72-55065d7e0b81 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:54.713311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952865f-59c3-4a9e-9b71-1e054424cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:54.714100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952865f-59c3-4a9e-9b71-1e054424cd66 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:54.714380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952865f-59c3-4a9e-9b71-1e054424cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:54.714650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952865f-59c3-4a9e-9b71-1e054424cd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:54.715291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952865f-59c3-4a9e-9b71-1e054424cd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:54.716924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952865f-59c3-4a9e-9b71-1e054424cd66 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:54.734387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6751dc-3e45-48d3-babf-ccb76e504be5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:54.744506 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3523/7015] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:18:54.745408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6751dc-3e45-48d3-babf-ccb76e504be5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:54.750142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06575a5e-0f71-4ac0-984c-feee356bd1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:54.750817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575a5e-0f71-4ac0-984c-feee356bd1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:54.751107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575a5e-0f71-4ac0-984c-feee356bd1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:54.751368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575a5e-0f71-4ac0-984c-feee356bd1b9 admin admin] PATH_INFO: `/v3/projects/ee9420b773e6484188aa45a2aed1bc0e/users/48518217acf44665a9ce74d4a30391bf/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:54.773638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06575a5e-0f71-4ac0-984c-feee356bd1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9420b773e6484188aa45a2aed1bc0e, user_id=48518217acf44665a9ce74d4a30391bf, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:54.776322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06575a5e-0f71-4ac0-984c-feee356bd1b9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:54.798980 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3493/7016] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:18:54 2022] PUT /identity/v3/projects/ee9420b773e6484188aa45a2aed1bc0e/users/48518217acf44665a9ce74d4a30391bf/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:18:54.804992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6bc8a-b744-4b39-bf24-b98897d865da None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:54.805278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6bc8a-b744-4b39-bf24-b98897d865da None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:54.805547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6bc8a-b744-4b39-bf24-b98897d865da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:54.851379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a7e6bc8a-b744-4b39-bf24-b98897d865da None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:18:54.852822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a7e6bc8a-b744-4b39-bf24-b98897d865da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:54.950574 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3524/7017] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:18:54.956172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06575a5e-0f71-4ac0-984c-feee356bd1b9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:18:54.959676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-06575a5e-0f71-4ac0-984c-feee356bd1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:18:55.036928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06575a5e-0f71-4ac0-984c-feee356bd1b9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:18:55.043461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d82504-264b-434e-bc6a-a37f7b85ef48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:18:55.044609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82504-264b-434e-bc6a-a37f7b85ef48 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:18:55.045103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82504-264b-434e-bc6a-a37f7b85ef48 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:18:55.046425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82504-264b-434e-bc6a-a37f7b85ef48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:18:55.066642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d82504-264b-434e-bc6a-a37f7b85ef48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:18:55.070323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d82504-264b-434e-bc6a-a37f7b85ef48 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:18:55.092980 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3494/7018] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:01.275785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccda76-7bf7-4ce5-bed9-58a16b0ba674 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:01.276294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccda76-7bf7-4ce5-bed9-58a16b0ba674 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:01.276532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccda76-7bf7-4ce5-bed9-58a16b0ba674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:01.318790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-93ccda76-7bf7-4ce5-bed9-58a16b0ba674 None None] MFA Rules not processed for user `48518217acf44665a9ce74d4a30391bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:01.321286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-93ccda76-7bf7-4ce5-bed9-58a16b0ba674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:01.408421 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:01.472668 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3525/7019] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:01.479976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aee17-14be-4f8f-9fe3-99d163df8027 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:01.481248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aee17-14be-4f8f-9fe3-99d163df8027 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:01.481690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aee17-14be-4f8f-9fe3-99d163df8027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:01.522690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8a1aee17-14be-4f8f-9fe3-99d163df8027 None None] MFA Rules not processed for user `48518217acf44665a9ce74d4a30391bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:01.523951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8a1aee17-14be-4f8f-9fe3-99d163df8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:01.545514 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3495/7020] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:01.558014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccda76-7bf7-4ce5-bed9-58a16b0ba674 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:01.559973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-93ccda76-7bf7-4ce5-bed9-58a16b0ba674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:01.686528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccda76-7bf7-4ce5-bed9-58a16b0ba674 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:01.693350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c8e34-57e6-4ff6-a3eb-de8c641368b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:01.694270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c8e34-57e6-4ff6-a3eb-de8c641368b2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:01.694627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c8e34-57e6-4ff6-a3eb-de8c641368b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:01.695002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c8e34-57e6-4ff6-a3eb-de8c641368b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:01.703960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c8e34-57e6-4ff6-a3eb-de8c641368b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:01.705636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c8e34-57e6-4ff6-a3eb-de8c641368b2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:01.716965 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3526/7021] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:01.753133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aee17-14be-4f8f-9fe3-99d163df8027 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:01.754803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8a1aee17-14be-4f8f-9fe3-99d163df8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:01.844793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aee17-14be-4f8f-9fe3-99d163df8027 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:01.848787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39609d97-a9ea-453d-a3d8-c286e1771bd2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:01.849385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39609d97-a9ea-453d-a3d8-c286e1771bd2 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:01.849385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39609d97-a9ea-453d-a3d8-c286e1771bd2 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:01.850231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39609d97-a9ea-453d-a3d8-c286e1771bd2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:01.852323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-39609d97-a9ea-453d-a3d8-c286e1771bd2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:01.871987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39609d97-a9ea-453d-a3d8-c286e1771bd2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:01.873618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39609d97-a9ea-453d-a3d8-c286e1771bd2 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:01.895214 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3496/7022] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:09.029495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c8e34-57e6-4ff6-a3eb-de8c641368b2 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:09.060314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c8e34-57e6-4ff6-a3eb-de8c641368b2 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:09.073316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759a024-c587-4b1e-953f-2e4abd356f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:09.073954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a024-c587-4b1e-953f-2e4abd356f9b service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:09.074237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a024-c587-4b1e-953f-2e4abd356f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:09.074513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a024-c587-4b1e-953f-2e4abd356f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:09.088407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4759a024-c587-4b1e-953f-2e4abd356f9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:09.117876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759a024-c587-4b1e-953f-2e4abd356f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:09.124381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759a024-c587-4b1e-953f-2e4abd356f9b service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:09.141600 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3527/7023] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:11.881686 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=72,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:14.307510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a87e16-fe48-406f-83f4-f7d7b4ffbfd3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:14.308097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a87e16-fe48-406f-83f4-f7d7b4ffbfd3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:14.308097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a87e16-fe48-406f-83f4-f7d7b4ffbfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:14.343636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-07a87e16-fe48-406f-83f4-f7d7b4ffbfd3 None None] MFA Rules not processed for user `48518217acf44665a9ce74d4a30391bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:14.347175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-07a87e16-fe48-406f-83f4-f7d7b4ffbfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:14.365524 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3497/7024] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:14.451230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f1f4b-015e-49ed-9ab0-98e5f6e64535 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:14.451746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f1f4b-015e-49ed-9ab0-98e5f6e64535 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:14.451746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f1f4b-015e-49ed-9ab0-98e5f6e64535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:14.474374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9a4f1f4b-015e-49ed-9ab0-98e5f6e64535 None None] MFA Rules not processed for user `48518217acf44665a9ce74d4a30391bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:14.476304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9a4f1f4b-015e-49ed-9ab0-98e5f6e64535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:14.487838 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3528/7025] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:14.525125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828cb21-b106-4daa-86d4-856b922d8e56 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:14.525416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828cb21-b106-4daa-86d4-856b922d8e56 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:14.525693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828cb21-b106-4daa-86d4-856b922d8e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:14.559325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3828cb21-b106-4daa-86d4-856b922d8e56 None None] MFA Rules not processed for user `48518217acf44665a9ce74d4a30391bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:14.575474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3828cb21-b106-4daa-86d4-856b922d8e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:14.612973 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3498/7026] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:14.644665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d787c-fb26-451f-b520-da2f9ebb42a6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:14.644935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d787c-fb26-451f-b520-da2f9ebb42a6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:14.646643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d787c-fb26-451f-b520-da2f9ebb42a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:14.685176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fc2d787c-fb26-451f-b520-da2f9ebb42a6 None None] MFA Rules not processed for user `48518217acf44665a9ce74d4a30391bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:14.688185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fc2d787c-fb26-451f-b520-da2f9ebb42a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:14.709137 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3529/7027] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:14.744397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c346ac-ec0b-4f8d-a023-f63c6847738b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:14.744779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c346ac-ec0b-4f8d-a023-f63c6847738b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:14.745057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c346ac-ec0b-4f8d-a023-f63c6847738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:14.792701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d8c346ac-ec0b-4f8d-a023-f63c6847738b None None] MFA Rules not processed for user `48518217acf44665a9ce74d4a30391bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:14.793168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d8c346ac-ec0b-4f8d-a023-f63c6847738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:14.807288 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3499/7028] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:15.072307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8a43a-ac73-4012-a868-707e6bebdd61 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:15.072813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8a43a-ac73-4012-a868-707e6bebdd61 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:15.072926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8a43a-ac73-4012-a868-707e6bebdd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:15.136941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0cd8a43a-ac73-4012-a868-707e6bebdd61 None None] MFA Rules not processed for user `0d12c0ca2333460bbf044ceb5178affb`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:15.138352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0cd8a43a-ac73-4012-a868-707e6bebdd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:15.274721 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3530/7029] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:15.770610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c346ac-ec0b-4f8d-a023-f63c6847738b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:15.783498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c346ac-ec0b-4f8d-a023-f63c6847738b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:15.788736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ea1bc-32e7-498c-8209-964a52a8b15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:15.789544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea1bc-32e7-498c-8209-964a52a8b15e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:15.789818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea1bc-32e7-498c-8209-964a52a8b15e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:15.790327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea1bc-32e7-498c-8209-964a52a8b15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:15.792228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-459ea1bc-32e7-498c-8209-964a52a8b15e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:15.806313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea1bc-32e7-498c-8209-964a52a8b15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:15.807944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea1bc-32e7-498c-8209-964a52a8b15e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:15.820600 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3500/7030] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:18.993115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8a43a-ac73-4012-a868-707e6bebdd61 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:18.994630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0cd8a43a-ac73-4012-a868-707e6bebdd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:19.022020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8a43a-ac73-4012-a868-707e6bebdd61 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:19.034461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:19.035128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:19.035413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:19.035754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] PATH_INFO: `/v3/users/71ae796071c84145aa5cb2e23180ea06` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:19.037808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ae796071c84145aa5cb2e23180ea06)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:19.039779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:19.165899 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:19.192566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ae796071c84145aa5cb2e23180ea06'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:19.236830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ae796071c84145aa5cb2e23180ea06'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:19.259397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ae796071c84145aa5cb2e23180ea06'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:19.274214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ae796071c84145aa5cb2e23180ea06'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:19.288002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ae796071c84145aa5cb2e23180ea06'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:19.299100 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3531/7031] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:19:18 2022] DELETE /identity/v3/users/71ae796071c84145aa5cb2e23180ea06 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:19.304443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa387f5-0838-4e82-ab42-1ba07b0983b0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:19.305691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa387f5-0838-4e82-ab42-1ba07b0983b0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:19.306204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa387f5-0838-4e82-ab42-1ba07b0983b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:19.348339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-faa387f5-0838-4e82-ab42-1ba07b0983b0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:19.349753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-faa387f5-0838-4e82-ab42-1ba07b0983b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:19.438120 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3501/7032] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:19.497018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:19.498668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:19.586003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b41907-de0c-4afc-98ce-676d14bc17e5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:19.597852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3808ca-d3a8-4be7-8a5a-0124d8903357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:19.599572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3808ca-d3a8-4be7-8a5a-0124d8903357 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:19.600037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3808ca-d3a8-4be7-8a5a-0124d8903357 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:19.600610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3808ca-d3a8-4be7-8a5a-0124d8903357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:19.615909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3808ca-d3a8-4be7-8a5a-0124d8903357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:19.617775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3808ca-d3a8-4be7-8a5a-0124d8903357 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:19.633049 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3532/7033] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:21.246646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa387f5-0838-4e82-ab42-1ba07b0983b0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:21.248766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-faa387f5-0838-4e82-ab42-1ba07b0983b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:21.262843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa387f5-0838-4e82-ab42-1ba07b0983b0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:21.268192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:21.269225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:21.269619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:21.270071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] PATH_INFO: `/v3/projects/15e6f8b289564295b783cb868001bdb6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:21.272022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e6f8b289564295b783cb868001bdb6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:21.275575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:21.359622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e6f8b289564295b783cb868001bdb6', 'request_id': 'req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.371327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e6f8b289564295b783cb868001bdb6', 'request_id': 'req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.380079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e6f8b289564295b783cb868001bdb6', 'request_id': 'req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.395790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] The token cache is being invalidate because project 15e6f8b289564295b783cb868001bdb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:19:21.396978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.397963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.400702 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3502/7034] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:19:21 2022] DELETE /identity/v3/projects/15e6f8b289564295b783cb868001bdb6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:21.404688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3808ca-d3a8-4be7-8a5a-0124d8903357 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:21.415994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3808ca-d3a8-4be7-8a5a-0124d8903357 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:21.480933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:21.481718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:21.482073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:21.482355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] PATH_INFO: `/v3/users/29f1cb896e3448dfa14515f65d102214` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:21.483589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f1cb896e3448dfa14515f65d102214)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:21.485474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:21.564356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f1cb896e3448dfa14515f65d102214'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.578071 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:21.587816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f1cb896e3448dfa14515f65d102214'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.599812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f1cb896e3448dfa14515f65d102214'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.614491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f1cb896e3448dfa14515f65d102214'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.615242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc5085ab-60d8-4553-b182-6735c9ebb441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f1cb896e3448dfa14515f65d102214'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:21.622068 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3533/7035] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:19:21 2022] DELETE /identity/v3/users/29f1cb896e3448dfa14515f65d102214 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:22.720559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:22.724780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:22.742099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5ce0-01a1-4c92-b0cf-4760e3919ba6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:22.848049 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:22.864607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:22.865289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:22.865568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:22.865843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] PATH_INFO: `/v3/projects/38611555b5734f83a3d65768647a7a18` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:22.868590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38611555b5734f83a3d65768647a7a18)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:22.870539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:22.978593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38611555b5734f83a3d65768647a7a18', 'request_id': 'req-28965a0d-8343-437e-bf24-a720153ad0a6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:22.991996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38611555b5734f83a3d65768647a7a18', 'request_id': 'req-28965a0d-8343-437e-bf24-a720153ad0a6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:23.001516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38611555b5734f83a3d65768647a7a18', 'request_id': 'req-28965a0d-8343-437e-bf24-a720153ad0a6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:23.026589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] The token cache is being invalidate because project 38611555b5734f83a3d65768647a7a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:19:23.027018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:23.033409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-28965a0d-8343-437e-bf24-a720153ad0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:23.035126 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3503/7036] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:19:22 2022] DELETE /identity/v3/projects/38611555b5734f83a3d65768647a7a18 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:23.040297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8730-38b5-4cf2-974e-6c88d728264d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:23.040882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8730-38b5-4cf2-974e-6c88d728264d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:23.040974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8730-38b5-4cf2-974e-6c88d728264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:23.071311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4f2d8730-38b5-4cf2-974e-6c88d728264d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:23.073531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4f2d8730-38b5-4cf2-974e-6c88d728264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:23.243210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3534/7037] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:23.250805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1603-390a-47d8-96fc-fd6fe5dd2188 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:23.251091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1603-390a-47d8-96fc-fd6fe5dd2188 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:23.251365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1603-390a-47d8-96fc-fd6fe5dd2188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:23.294757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-716d1603-390a-47d8-96fc-fd6fe5dd2188 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:23.296014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-716d1603-390a-47d8-96fc-fd6fe5dd2188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:23.320352 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3504/7038] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:23.322171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8730-38b5-4cf2-974e-6c88d728264d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:23.333695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8730-38b5-4cf2-974e-6c88d728264d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:23.339018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bdeeb-14bd-43aa-9f5c-32248f83f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:23.339660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bdeeb-14bd-43aa-9f5c-32248f83f73e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:23.339947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bdeeb-14bd-43aa-9f5c-32248f83f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:23.340227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bdeeb-14bd-43aa-9f5c-32248f83f73e admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:23.341193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bdeeb-14bd-43aa-9f5c-32248f83f73e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:19:23.341506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bdeeb-14bd-43aa-9f5c-32248f83f73e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:23.343151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bdeeb-14bd-43aa-9f5c-32248f83f73e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:23.374779 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3535/7039] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:19:23.380700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d1603-390a-47d8-96fc-fd6fe5dd2188 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:23.393435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d1603-390a-47d8-96fc-fd6fe5dd2188 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:23.425783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdcd11-eea0-4ec1-b607-d0bfdec80efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:23.427091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdcd11-eea0-4ec1-b607-d0bfdec80efc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:23.427563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdcd11-eea0-4ec1-b607-d0bfdec80efc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:23.427846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdcd11-eea0-4ec1-b607-d0bfdec80efc admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:23.428687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdcd11-eea0-4ec1-b607-d0bfdec80efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:23.430756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdcd11-eea0-4ec1-b607-d0bfdec80efc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:23.496698 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3505/7040] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:19:23 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:19:23.499572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bdeeb-14bd-43aa-9f5c-32248f83f73e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:23.521962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bdeeb-14bd-43aa-9f5c-32248f83f73e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:23.714397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bc1c9-5ae8-4d86-a29b-b8816135a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:23.715870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc1c9-5ae8-4d86-a29b-b8816135a276 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:23.716314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc1c9-5ae8-4d86-a29b-b8816135a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:23.716781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc1c9-5ae8-4d86-a29b-b8816135a276 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:23.717600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bc1c9-5ae8-4d86-a29b-b8816135a276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:23.720344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bc1c9-5ae8-4d86-a29b-b8816135a276 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:23.771536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdcd11-eea0-4ec1-b607-d0bfdec80efc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:23.772543 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3536/7041] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:19:23 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:19:23.789058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdcd11-eea0-4ec1-b607-d0bfdec80efc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:23.795529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed665f9-8409-4478-9be6-21152fe7e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:23.797413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed665f9-8409-4478-9be6-21152fe7e39c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:23.797906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed665f9-8409-4478-9be6-21152fe7e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:23.798428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed665f9-8409-4478-9be6-21152fe7e39c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:23.799249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed665f9-8409-4478-9be6-21152fe7e39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:23.801815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed665f9-8409-4478-9be6-21152fe7e39c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:23.826471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bc1c9-5ae8-4d86-a29b-b8816135a276 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:23.837701 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3506/7042] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:19:23.842717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bc1c9-5ae8-4d86-a29b-b8816135a276 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:23.852960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41170a23-5cce-45ac-b7bf-484da0a138f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:23.854789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41170a23-5cce-45ac-b7bf-484da0a138f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:23.856590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41170a23-5cce-45ac-b7bf-484da0a138f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:23.858139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41170a23-5cce-45ac-b7bf-484da0a138f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:23.859208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41170a23-5cce-45ac-b7bf-484da0a138f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:23.861057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41170a23-5cce-45ac-b7bf-484da0a138f2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:23.883964 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3537/7043] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:19:23.885546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed665f9-8409-4478-9be6-21152fe7e39c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:23.898329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed665f9-8409-4478-9be6-21152fe7e39c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:23.903771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66c6d-c8b7-4672-b0a5-49e6f24acbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:23.904919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66c6d-c8b7-4672-b0a5-49e6f24acbf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:23.905413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66c6d-c8b7-4672-b0a5-49e6f24acbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:23.905836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66c6d-c8b7-4672-b0a5-49e6f24acbf1 admin admin] PATH_INFO: `/v3/projects/1965ae304376455dbeaf58570c61ae57/users/4ebb8016e72c444282f24bff7218d19c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:23.926141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae66c6d-c8b7-4672-b0a5-49e6f24acbf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1965ae304376455dbeaf58570c61ae57, user_id=4ebb8016e72c444282f24bff7218d19c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:23.930383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae66c6d-c8b7-4672-b0a5-49e6f24acbf1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:23.956669 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3507/7044] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:19:23 2022] PUT /identity/v3/projects/1965ae304376455dbeaf58570c61ae57/users/4ebb8016e72c444282f24bff7218d19c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:19:23.969126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252fbf5-7234-453d-8e6f-ace6ac266533 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:23.969412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252fbf5-7234-453d-8e6f-ace6ac266533 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:23.969719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252fbf5-7234-453d-8e6f-ace6ac266533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:24.010257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e252fbf5-7234-453d-8e6f-ace6ac266533 None None] MFA Rules not processed for user `4ebb8016e72c444282f24bff7218d19c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:24.011703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e252fbf5-7234-453d-8e6f-ace6ac266533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:24.053437 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:24.119361 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3538/7045] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:24.123876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66c6d-c8b7-4672-b0a5-49e6f24acbf1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:24.216215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66c6d-c8b7-4672-b0a5-49e6f24acbf1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:24.222110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43793d-d261-4284-9049-e929bcde4163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:24.223332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43793d-d261-4284-9049-e929bcde4163 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:24.223951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43793d-d261-4284-9049-e929bcde4163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:24.224598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43793d-d261-4284-9049-e929bcde4163 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:24.225670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43793d-d261-4284-9049-e929bcde4163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:24.227757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43793d-d261-4284-9049-e929bcde4163 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:24.273208 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3508/7046] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:19:24 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:19:24.276546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252fbf5-7234-453d-8e6f-ace6ac266533 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:24.310184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252fbf5-7234-453d-8e6f-ace6ac266533 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:24.403472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c08470-7fed-4819-adf6-a0e328a741dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:24.404164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c08470-7fed-4819-adf6-a0e328a741dc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:24.404451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c08470-7fed-4819-adf6-a0e328a741dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:24.404760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c08470-7fed-4819-adf6-a0e328a741dc admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:24.405416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c08470-7fed-4819-adf6-a0e328a741dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:24.407391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c08470-7fed-4819-adf6-a0e328a741dc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:24.435112 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3539/7047] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:19:24 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:19:24.439523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43793d-d261-4284-9049-e929bcde4163 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:24.447407 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:24.455204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43793d-d261-4284-9049-e929bcde4163 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:24.468559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a350d-f5e6-460c-ac23-19e6bdee8800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:24.469433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a350d-f5e6-460c-ac23-19e6bdee8800 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:24.469899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a350d-f5e6-460c-ac23-19e6bdee8800 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:24.470375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a350d-f5e6-460c-ac23-19e6bdee8800 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:24.471229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a350d-f5e6-460c-ac23-19e6bdee8800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:24.473846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a350d-f5e6-460c-ac23-19e6bdee8800 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:24.491519 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3509/7048] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:19:24.492404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c08470-7fed-4819-adf6-a0e328a741dc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:24.503746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c08470-7fed-4819-adf6-a0e328a741dc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:24.510072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35111f-d8b3-4723-8079-0efc3d2f35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:24.510802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35111f-d8b3-4723-8079-0efc3d2f35b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:24.511081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35111f-d8b3-4723-8079-0efc3d2f35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:24.511369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35111f-d8b3-4723-8079-0efc3d2f35b5 admin admin] PATH_INFO: `/v3/projects/cfc1e3d828384ff7ab6577e2c17beb74/users/cc86bb17e64b4737ad20a13452074333/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:24.528759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35111f-d8b3-4723-8079-0efc3d2f35b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc1e3d828384ff7ab6577e2c17beb74, user_id=cc86bb17e64b4737ad20a13452074333, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:24.531705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35111f-d8b3-4723-8079-0efc3d2f35b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:24.552327 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3540/7049] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:19:24 2022] PUT /identity/v3/projects/cfc1e3d828384ff7ab6577e2c17beb74/users/cc86bb17e64b4737ad20a13452074333/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:19:24.556200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a350d-f5e6-460c-ac23-19e6bdee8800 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:24.577575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a350d-f5e6-460c-ac23-19e6bdee8800 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:24.666461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b999e8-115a-430f-a92c-773b27732728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:24.667555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b999e8-115a-430f-a92c-773b27732728 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:24.668110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b999e8-115a-430f-a92c-773b27732728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:24.668868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b999e8-115a-430f-a92c-773b27732728 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:24.670039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b999e8-115a-430f-a92c-773b27732728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:24.672496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b999e8-115a-430f-a92c-773b27732728 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:24.689415 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3510/7050] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:19:24.690827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35111f-d8b3-4723-8079-0efc3d2f35b5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:24.707359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35111f-d8b3-4723-8079-0efc3d2f35b5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:24.715070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3ebe4-a162-41eb-b143-2189d705f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:24.715847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3ebe4-a162-41eb-b143-2189d705f04c admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:24.716305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3ebe4-a162-41eb-b143-2189d705f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:24.716688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3ebe4-a162-41eb-b143-2189d705f04c admin admin] PATH_INFO: `/v3/projects/cfc1e3d828384ff7ab6577e2c17beb74/users/cc86bb17e64b4737ad20a13452074333/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:24.719110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3ebe4-a162-41eb-b143-2189d705f04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc1e3d828384ff7ab6577e2c17beb74, user_id=cc86bb17e64b4737ad20a13452074333, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:24.722102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3ebe4-a162-41eb-b143-2189d705f04c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:24.737018 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3541/7051] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:19:24 2022] PUT /identity/v3/projects/cfc1e3d828384ff7ab6577e2c17beb74/users/cc86bb17e64b4737ad20a13452074333/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:24.747683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c81674-b92b-40b4-8861-2e507a082491 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:24.748246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c81674-b92b-40b4-8861-2e507a082491 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:24.748717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c81674-b92b-40b4-8861-2e507a082491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:24.795278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d8c81674-b92b-40b4-8861-2e507a082491 None None] MFA Rules not processed for user `cc86bb17e64b4737ad20a13452074333`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:24.796510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d8c81674-b92b-40b4-8861-2e507a082491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:24.904677 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3511/7052] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:24.917224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3ebe4-a162-41eb-b143-2189d705f04c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:24.919277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-22c3ebe4-a162-41eb-b143-2189d705f04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:25.005347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3ebe4-a162-41eb-b143-2189d705f04c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:25.014578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baa283-e2cb-4ba4-89f9-84bba3a6a375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:25.015216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa283-e2cb-4ba4-89f9-84bba3a6a375 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:25.015494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa283-e2cb-4ba4-89f9-84bba3a6a375 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:25.015765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa283-e2cb-4ba4-89f9-84bba3a6a375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:25.066378 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:25.109452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baa283-e2cb-4ba4-89f9-84bba3a6a375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:25.110908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baa283-e2cb-4ba4-89f9-84bba3a6a375 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:25.126650 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3542/7053] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:26.501916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c81674-b92b-40b4-8861-2e507a082491 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:26.504286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d8c81674-b92b-40b4-8861-2e507a082491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:26.632751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c81674-b92b-40b4-8861-2e507a082491 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:26.639825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:26.640782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:26.641252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:26.650633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] PATH_INFO: `/v3/users/48518217acf44665a9ce74d4a30391bf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:26.656507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48518217acf44665a9ce74d4a30391bf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:26.671218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:26.697185 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:26.766275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48518217acf44665a9ce74d4a30391bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:26.788576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48518217acf44665a9ce74d4a30391bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:26.801849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48518217acf44665a9ce74d4a30391bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:26.813118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48518217acf44665a9ce74d4a30391bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:26.813947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b5e1812-a261-428b-acc4-98ba27f3568e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48518217acf44665a9ce74d4a30391bf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:26.823611 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3512/7054] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:19:26 2022] DELETE /identity/v3/users/48518217acf44665a9ce74d4a30391bf => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:27.171593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baa283-e2cb-4ba4-89f9-84bba3a6a375 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:27.188569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baa283-e2cb-4ba4-89f9-84bba3a6a375 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:27.259342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:27.259988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.260266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.260538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] PATH_INFO: `/v3/projects/ee9420b773e6484188aa45a2aed1bc0e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.261702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9420b773e6484188aa45a2aed1bc0e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:27.263602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:27.315462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9420b773e6484188aa45a2aed1bc0e', 'request_id': 'req-d8ea16cb-ec33-414f-99c5-91a758b6301e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:27.325598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9420b773e6484188aa45a2aed1bc0e', 'request_id': 'req-d8ea16cb-ec33-414f-99c5-91a758b6301e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:27.331696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9420b773e6484188aa45a2aed1bc0e', 'request_id': 'req-d8ea16cb-ec33-414f-99c5-91a758b6301e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:27.343988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] The token cache is being invalidate because project ee9420b773e6484188aa45a2aed1bc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:19:27.344276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:27.344960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8ea16cb-ec33-414f-99c5-91a758b6301e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:27.346455 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3543/7055] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:19:27 2022] DELETE /identity/v3/projects/ee9420b773e6484188aa45a2aed1bc0e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:27.353049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cde73-9c50-4090-9795-e9da1394b10f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.353414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cde73-9c50-4090-9795-e9da1394b10f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.353804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cde73-9c50-4090-9795-e9da1394b10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.375350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-115cde73-9c50-4090-9795-e9da1394b10f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:27.376834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-115cde73-9c50-4090-9795-e9da1394b10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:27.444434 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3513/7056] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:27.454497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923603f2-f569-473f-ad4e-b21ebe144419 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.454791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923603f2-f569-473f-ad4e-b21ebe144419 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.455075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923603f2-f569-473f-ad4e-b21ebe144419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.477792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-923603f2-f569-473f-ad4e-b21ebe144419 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:27.479080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-923603f2-f569-473f-ad4e-b21ebe144419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:27.491685 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3544/7057] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:19:27.496301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cde73-9c50-4090-9795-e9da1394b10f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:27.511107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cde73-9c50-4090-9795-e9da1394b10f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:27.516641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc5b4-f315-4793-9b65-a12f648cc599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:27.517610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc5b4-f315-4793-9b65-a12f648cc599 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.517986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc5b4-f315-4793-9b65-a12f648cc599 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.518343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc5b4-f315-4793-9b65-a12f648cc599 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.519547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc5b4-f315-4793-9b65-a12f648cc599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:19:27.520479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc5b4-f315-4793-9b65-a12f648cc599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:27.522919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc5b4-f315-4793-9b65-a12f648cc599 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:27.539960 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3514/7058] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:19:27.541137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923603f2-f569-473f-ad4e-b21ebe144419 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:27.551551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923603f2-f569-473f-ad4e-b21ebe144419 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:27.559915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ce94c-3c6d-485f-b4cb-1451e56233ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:27.561246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ce94c-3c6d-485f-b4cb-1451e56233ad admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.561440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ce94c-3c6d-485f-b4cb-1451e56233ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.562108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ce94c-3c6d-485f-b4cb-1451e56233ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.562994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ce94c-3c6d-485f-b4cb-1451e56233ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:27.565178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ce94c-3c6d-485f-b4cb-1451e56233ad admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:27.600700 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3545/7059] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:19:27 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:19:27.602946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc5b4-f315-4793-9b65-a12f648cc599 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:27.613191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc5b4-f315-4793-9b65-a12f648cc599 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:27.679047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f32a-9e18-40cb-9db8-540867784a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:27.679670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f32a-9e18-40cb-9db8-540867784a85 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.679954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f32a-9e18-40cb-9db8-540867784a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.680230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f32a-9e18-40cb-9db8-540867784a85 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.680992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7f32a-9e18-40cb-9db8-540867784a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:27.683201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7f32a-9e18-40cb-9db8-540867784a85 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:27.708239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3515/7060] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:19:27 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:19:27.712532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ce94c-3c6d-485f-b4cb-1451e56233ad admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:27.731022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ce94c-3c6d-485f-b4cb-1451e56233ad admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:27.743353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5dabc-8980-4494-a4d2-a3ac7e8d43a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:27.744314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5dabc-8980-4494-a4d2-a3ac7e8d43a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.745056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5dabc-8980-4494-a4d2-a3ac7e8d43a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.745410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5dabc-8980-4494-a4d2-a3ac7e8d43a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.746205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5dabc-8980-4494-a4d2-a3ac7e8d43a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:27.748106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5dabc-8980-4494-a4d2-a3ac7e8d43a8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:27.767738 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3546/7061] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:19:27.771825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f32a-9e18-40cb-9db8-540867784a85 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:27.794822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f32a-9e18-40cb-9db8-540867784a85 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:27.809963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de52174-7ec0-4aad-9780-f4b69b861ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:27.810592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de52174-7ec0-4aad-9780-f4b69b861ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.810873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de52174-7ec0-4aad-9780-f4b69b861ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.811630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de52174-7ec0-4aad-9780-f4b69b861ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.812544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de52174-7ec0-4aad-9780-f4b69b861ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:27.815905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de52174-7ec0-4aad-9780-f4b69b861ba8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:27.824913 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:27.843179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5dabc-8980-4494-a4d2-a3ac7e8d43a8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:27.844975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-87d5dabc-8980-4494-a4d2-a3ac7e8d43a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:27.855284 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3516/7062] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:19:27.859471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de52174-7ec0-4aad-9780-f4b69b861ba8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:27.883738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de52174-7ec0-4aad-9780-f4b69b861ba8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:27.888584 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:27.891246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69819db6-b920-42ad-a260-621640eebb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:27.893136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69819db6-b920-42ad-a260-621640eebb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.893646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69819db6-b920-42ad-a260-621640eebb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.894202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69819db6-b920-42ad-a260-621640eebb98 admin admin] PATH_INFO: `/v3/projects/24871a8048b7422e8e4576360b3e81f5/users/a29461d7e91a431d9aa1bb77bcae9040/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.926718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69819db6-b920-42ad-a260-621640eebb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24871a8048b7422e8e4576360b3e81f5, user_id=a29461d7e91a431d9aa1bb77bcae9040, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:27.931276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69819db6-b920-42ad-a260-621640eebb98 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:27.948388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5dabc-8980-4494-a4d2-a3ac7e8d43a8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:27.963079 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3517/7063] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:19:27 2022] PUT /identity/v3/projects/24871a8048b7422e8e4576360b3e81f5/users/a29461d7e91a431d9aa1bb77bcae9040/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:27.975806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c55de5-8ac4-48f7-895d-6618422d7c1d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:27.976117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c55de5-8ac4-48f7-895d-6618422d7c1d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:27.976864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c55de5-8ac4-48f7-895d-6618422d7c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:27.999639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-93c55de5-8ac4-48f7-895d-6618422d7c1d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:28.002068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-93c55de5-8ac4-48f7-895d-6618422d7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:28.031976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:28.032601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:28.033426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:28.033902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:28.036144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:28.136929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:28.140978 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3518/7064] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:28.149233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:28.149933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c55de5-8ac4-48f7-895d-6618422d7c1d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:28.151358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-93c55de5-8ac4-48f7-895d-6618422d7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:28.162299 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3547/7065] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:28.261744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c55de5-8ac4-48f7-895d-6618422d7c1d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:28.266781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b0f1f-9b86-4a33-a8b0-2f75db3e1a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:28.267419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b0f1f-9b86-4a33-a8b0-2f75db3e1a8f service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:28.267702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b0f1f-9b86-4a33-a8b0-2f75db3e1a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:28.267992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b0f1f-9b86-4a33-a8b0-2f75db3e1a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:28.282467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b0f1f-9b86-4a33-a8b0-2f75db3e1a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:28.284578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b0f1f-9b86-4a33-a8b0-2f75db3e1a8f service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:28.299879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3519/7066] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:19:34.802138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:34.803762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:34.910000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251e6ed-db91-4c77-b7a8-227dd4c80534 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:34.910556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251e6ed-db91-4c77-b7a8-227dd4c80534 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:34.910556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251e6ed-db91-4c77-b7a8-227dd4c80534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:34.963901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6251e6ed-db91-4c77-b7a8-227dd4c80534 None None] MFA Rules not processed for user `a29461d7e91a431d9aa1bb77bcae9040`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:34.965258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6251e6ed-db91-4c77-b7a8-227dd4c80534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:34.987011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de63d0-89bf-47f7-b6df-66196740d98d service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:35.003012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:35.006884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:35.007172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:35.007456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:35.010712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:35.093112 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:35.111609 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3520/7067] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:35.123413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006e637-2f58-4395-b0c3-5a7ec9e02eb1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:35.124015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006e637-2f58-4395-b0c3-5a7ec9e02eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:35.124294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006e637-2f58-4395-b0c3-5a7ec9e02eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:35.147003 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:35.153680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:35.157392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:35.159407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1006e637-2f58-4395-b0c3-5a7ec9e02eb1 None None] MFA Rules not processed for user `a29461d7e91a431d9aa1bb77bcae9040`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:35.160696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1006e637-2f58-4395-b0c3-5a7ec9e02eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:35.181993 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3521/7068] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:35.189088 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3548/7069] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:35.193799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006e637-2f58-4395-b0c3-5a7ec9e02eb1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:35.195900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1006e637-2f58-4395-b0c3-5a7ec9e02eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:35.224122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006e637-2f58-4395-b0c3-5a7ec9e02eb1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:35.235128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6406f4-021d-4800-984a-ea09836a9223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:35.235913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6406f4-021d-4800-984a-ea09836a9223 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:35.236299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6406f4-021d-4800-984a-ea09836a9223 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:35.237047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6406f4-021d-4800-984a-ea09836a9223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:35.261690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6406f4-021d-4800-984a-ea09836a9223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:35.265930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6406f4-021d-4800-984a-ea09836a9223 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:35.289705 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3522/7070] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:38.425228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:38.428569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:38.635249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6332d5a-8506-4575-b00f-c47a87bc547d service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:38.640582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165e0d3-130a-4aef-88a9-663b395b8475 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:38.641309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e0d3-130a-4aef-88a9-663b395b8475 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:38.641653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e0d3-130a-4aef-88a9-663b395b8475 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:38.642127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e0d3-130a-4aef-88a9-663b395b8475 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:38.644089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9165e0d3-130a-4aef-88a9-663b395b8475 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:38.672337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165e0d3-130a-4aef-88a9-663b395b8475 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:38.675135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165e0d3-130a-4aef-88a9-663b395b8475 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:38.697811 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3549/7071] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:40.303526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6406f4-021d-4800-984a-ea09836a9223 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:40.305188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3d6406f4-021d-4800-984a-ea09836a9223 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:40.325379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6406f4-021d-4800-984a-ea09836a9223 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:40.331329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:40.332879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:40.333420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:40.333937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] PATH_INFO: `/v3/users/4ebb8016e72c444282f24bff7218d19c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:40.335387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ebb8016e72c444282f24bff7218d19c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:40.337617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:40.436271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ebb8016e72c444282f24bff7218d19c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:40.467051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ebb8016e72c444282f24bff7218d19c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:40.478775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ebb8016e72c444282f24bff7218d19c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:40.490591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ebb8016e72c444282f24bff7218d19c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:40.491540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ebb8016e72c444282f24bff7218d19c'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:40.503653 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3523/7072] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:19:40 2022] DELETE /identity/v3/users/4ebb8016e72c444282f24bff7218d19c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:40.508736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11851d-1282-4386-9fa7-2448282a35b2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:40.509638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11851d-1282-4386-9fa7-2448282a35b2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:40.510091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11851d-1282-4386-9fa7-2448282a35b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:40.548466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3c11851d-1282-4386-9fa7-2448282a35b2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:40.550005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3c11851d-1282-4386-9fa7-2448282a35b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:40.705119 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3550/7073] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:40.775117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:40.777222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:40.912035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4720-63b9-403a-9114-164d78c41655 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:40.921995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f57823-7a93-4537-a1a4-11e0cf7ae7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:40.922739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f57823-7a93-4537-a1a4-11e0cf7ae7fd service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:40.923166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f57823-7a93-4537-a1a4-11e0cf7ae7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:40.923452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f57823-7a93-4537-a1a4-11e0cf7ae7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:40.942781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f57823-7a93-4537-a1a4-11e0cf7ae7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:40.944242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f57823-7a93-4537-a1a4-11e0cf7ae7fd service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:40.975711 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3524/7074] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:42.043282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11851d-1282-4386-9fa7-2448282a35b2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:42.044835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3c11851d-1282-4386-9fa7-2448282a35b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:42.070737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11851d-1282-4386-9fa7-2448282a35b2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:42.089994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:42.095333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:42.095777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:42.098077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] PATH_INFO: `/v3/projects/1965ae304376455dbeaf58570c61ae57` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:42.101714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1965ae304376455dbeaf58570c61ae57)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:42.105510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:42.268357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1965ae304376455dbeaf58570c61ae57', 'request_id': 'req-f11112dd-dac7-4a18-818e-f01ba5cd1f46'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.276578 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:42.287774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1965ae304376455dbeaf58570c61ae57', 'request_id': 'req-f11112dd-dac7-4a18-818e-f01ba5cd1f46'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.318857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1965ae304376455dbeaf58570c61ae57', 'request_id': 'req-f11112dd-dac7-4a18-818e-f01ba5cd1f46'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.347277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] The token cache is being invalidate because project 1965ae304376455dbeaf58570c61ae57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:19:42.347739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.348597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.351386 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3551/7075] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:19:42 2022] DELETE /identity/v3/projects/1965ae304376455dbeaf58570c61ae57 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:42.355659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f57823-7a93-4537-a1a4-11e0cf7ae7fd service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:42.396426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f57823-7a93-4537-a1a4-11e0cf7ae7fd service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:42.575867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:42.577286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:42.577573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:42.577894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] PATH_INFO: `/v3/users/cc86bb17e64b4737ad20a13452074333` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:42.580954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc86bb17e64b4737ad20a13452074333)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:42.606121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:42.621778 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:42.779054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc86bb17e64b4737ad20a13452074333'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.835535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc86bb17e64b4737ad20a13452074333'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.852537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc86bb17e64b4737ad20a13452074333'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.863427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc86bb17e64b4737ad20a13452074333'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.864313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e7bdfcc6-d8b7-4302-bbd4-b2314cdf177b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc86bb17e64b4737ad20a13452074333'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:42.871182 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3525/7076] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:19:42 2022] DELETE /identity/v3/users/cc86bb17e64b4737ad20a13452074333 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:43.578290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:43.580522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:43.610634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11112dd-dac7-4a18-818e-f01ba5cd1f46 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:43.766190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:43.768305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:43.769836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:43.769836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] PATH_INFO: `/v3/projects/cfc1e3d828384ff7ab6577e2c17beb74` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:43.771327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc1e3d828384ff7ab6577e2c17beb74)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:43.774085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:43.854906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc1e3d828384ff7ab6577e2c17beb74', 'request_id': 'req-cf9ccc68-2970-4d59-89b9-28c981f04fb9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:43.864499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc1e3d828384ff7ab6577e2c17beb74', 'request_id': 'req-cf9ccc68-2970-4d59-89b9-28c981f04fb9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:43.875337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc1e3d828384ff7ab6577e2c17beb74', 'request_id': 'req-cf9ccc68-2970-4d59-89b9-28c981f04fb9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:43.893187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] The token cache is being invalidate because project cfc1e3d828384ff7ab6577e2c17beb74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:19:43.893544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:43.895182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf9ccc68-2970-4d59-89b9-28c981f04fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:19:43.896675 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3552/7077] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:19:43 2022] DELETE /identity/v3/projects/cfc1e3d828384ff7ab6577e2c17beb74 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:43.901735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11896e4e-11b6-45f7-993d-0e70567f7f94 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:43.902235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11896e4e-11b6-45f7-993d-0e70567f7f94 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:43.902311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11896e4e-11b6-45f7-993d-0e70567f7f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:43.937022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-11896e4e-11b6-45f7-993d-0e70567f7f94 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:43.939572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-11896e4e-11b6-45f7-993d-0e70567f7f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:44.019059 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3526/7078] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:44.029187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb48f-48fd-4aa6-948e-8a699e10aac7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:44.029689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb48f-48fd-4aa6-948e-8a699e10aac7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:44.031195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb48f-48fd-4aa6-948e-8a699e10aac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:44.070883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d51cb48f-48fd-4aa6-948e-8a699e10aac7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:44.072821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d51cb48f-48fd-4aa6-948e-8a699e10aac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:44.092813 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3553/7079] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:44.095732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11896e4e-11b6-45f7-993d-0e70567f7f94 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:44.107565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11896e4e-11b6-45f7-993d-0e70567f7f94 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:44.115142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba997c-8c0a-459d-8edb-a78aeb7ffd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:44.116075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba997c-8c0a-459d-8edb-a78aeb7ffd8e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:44.116742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba997c-8c0a-459d-8edb-a78aeb7ffd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:44.117378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba997c-8c0a-459d-8edb-a78aeb7ffd8e admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:44.118240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba997c-8c0a-459d-8edb-a78aeb7ffd8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:19:44.118855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba997c-8c0a-459d-8edb-a78aeb7ffd8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:44.122397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba997c-8c0a-459d-8edb-a78aeb7ffd8e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:44.138297 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3527/7080] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:19:44.142535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb48f-48fd-4aa6-948e-8a699e10aac7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:44.152141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb48f-48fd-4aa6-948e-8a699e10aac7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:44.157191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d59a0-70d2-49a1-b2ed-c9356adda340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:44.157807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d59a0-70d2-49a1-b2ed-c9356adda340 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:44.158090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d59a0-70d2-49a1-b2ed-c9356adda340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:44.158693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d59a0-70d2-49a1-b2ed-c9356adda340 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:44.159451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d59a0-70d2-49a1-b2ed-c9356adda340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:44.162145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d59a0-70d2-49a1-b2ed-c9356adda340 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:44.206005 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3554/7081] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:19:44 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:19:44.217768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba997c-8c0a-459d-8edb-a78aeb7ffd8e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:44.244644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba997c-8c0a-459d-8edb-a78aeb7ffd8e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:44.452951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee03118-348d-4b92-b241-5aed9e58e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:44.453710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee03118-348d-4b92-b241-5aed9e58e77c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:44.454002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee03118-348d-4b92-b241-5aed9e58e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:44.454284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee03118-348d-4b92-b241-5aed9e58e77c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:44.454944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee03118-348d-4b92-b241-5aed9e58e77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:44.458461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee03118-348d-4b92-b241-5aed9e58e77c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:44.497222 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:44.516860 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3528/7082] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:19:44 2022] POST /identity/v3/users => generated 282 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:19:44.518222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d59a0-70d2-49a1-b2ed-c9356adda340 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:44.538302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d59a0-70d2-49a1-b2ed-c9356adda340 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:44.563013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0d3b-f5de-4e9a-88c5-e27480b5005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:44.563794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0d3b-f5de-4e9a-88c5-e27480b5005b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:44.564077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0d3b-f5de-4e9a-88c5-e27480b5005b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:44.566365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0d3b-f5de-4e9a-88c5-e27480b5005b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:44.570119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d0d3b-f5de-4e9a-88c5-e27480b5005b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:44.571871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d0d3b-f5de-4e9a-88c5-e27480b5005b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:44.623157 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3555/7083] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:19:44.638633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee03118-348d-4b92-b241-5aed9e58e77c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:44.653667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee03118-348d-4b92-b241-5aed9e58e77c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:44.658641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fd227-4fc9-4436-95d6-487681ca3fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:44.659338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd227-4fc9-4436-95d6-487681ca3fca admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:44.660750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd227-4fc9-4436-95d6-487681ca3fca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:44.661763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd227-4fc9-4436-95d6-487681ca3fca admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:44.662290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fd227-4fc9-4436-95d6-487681ca3fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:44.664460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fd227-4fc9-4436-95d6-487681ca3fca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:44.688458 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3529/7084] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:19:44.689783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0d3b-f5de-4e9a-88c5-e27480b5005b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:44.713305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0d3b-f5de-4e9a-88c5-e27480b5005b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:44.728136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7acc28-aaba-4b8f-bfa5-d4265031d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:44.729212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7acc28-aaba-4b8f-bfa5-d4265031d06c admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:44.729595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7acc28-aaba-4b8f-bfa5-d4265031d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:44.729974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7acc28-aaba-4b8f-bfa5-d4265031d06c admin admin] PATH_INFO: `/v3/projects/edc183b18966444da97475a46c4e76d5/users/96c76ec5bdfb4d38b2e3c76abebd993b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:44.778782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7acc28-aaba-4b8f-bfa5-d4265031d06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc183b18966444da97475a46c4e76d5, user_id=96c76ec5bdfb4d38b2e3c76abebd993b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:44.782283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7acc28-aaba-4b8f-bfa5-d4265031d06c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:44.824726 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3556/7085] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:19:44 2022] PUT /identity/v3/projects/edc183b18966444da97475a46c4e76d5/users/96c76ec5bdfb4d38b2e3c76abebd993b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:19:44.969978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be3c21-7b8e-4f61-b836-3909e0a38196 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:44.970975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be3c21-7b8e-4f61-b836-3909e0a38196 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:44.971452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be3c21-7b8e-4f61-b836-3909e0a38196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:45.011537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-44be3c21-7b8e-4f61-b836-3909e0a38196 None None] MFA Rules not processed for user `96c76ec5bdfb4d38b2e3c76abebd993b`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:19:45.013232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-44be3c21-7b8e-4f61-b836-3909e0a38196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:45.143623 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3530/7086] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:19:45.157630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7acc28-aaba-4b8f-bfa5-d4265031d06c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:45.159400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4f7acc28-aaba-4b8f-bfa5-d4265031d06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:45.182390 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:45.273930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7acc28-aaba-4b8f-bfa5-d4265031d06c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:45.278277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab35e-b5a0-4405-b2b8-ab51946199ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:45.279265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab35e-b5a0-4405-b2b8-ab51946199ef service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:45.279703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab35e-b5a0-4405-b2b8-ab51946199ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:45.280252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab35e-b5a0-4405-b2b8-ab51946199ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:45.304236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ab35e-b5a0-4405-b2b8-ab51946199ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:45.306481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ab35e-b5a0-4405-b2b8-ab51946199ef service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:45.320146 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3557/7087] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:19:55.133974 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=38 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:55.312687 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=22 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:57.935325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be3c21-7b8e-4f61-b836-3909e0a38196 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:19:57.937085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-44be3c21-7b8e-4f61-b836-3909e0a38196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:58.082025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be3c21-7b8e-4f61-b836-3909e0a38196 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:19:58.102065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:19:58.102701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:19:58.102980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:19:58.103252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:19:58.114160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:19:58.147751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:19:58.149271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:19:58.186853 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3531/7088] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:05.345864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab35e-b5a0-4405-b2b8-ab51946199ef service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:05.348022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-533ab35e-b5a0-4405-b2b8-ab51946199ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:05.537742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab35e-b5a0-4405-b2b8-ab51946199ef service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:05.544315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:05.546270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:05.552410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:05.553023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:05.555575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:05.596832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:05.598662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:05.641531 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3558/7089] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:06.348878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:06.351017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:06.506168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9bd0-7c67-41e9-bc1f-71b20d21599c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:06.519515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de48f0-0d79-4bc2-a275-2010d85be18b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:06.520158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de48f0-0d79-4bc2-a275-2010d85be18b service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:06.520450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de48f0-0d79-4bc2-a275-2010d85be18b service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:06.520743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de48f0-0d79-4bc2-a275-2010d85be18b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:06.525485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-14de48f0-0d79-4bc2-a275-2010d85be18b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:06.560132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de48f0-0d79-4bc2-a275-2010d85be18b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:06.567453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de48f0-0d79-4bc2-a275-2010d85be18b service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:06.599841 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3532/7090] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:06.687265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:06.689721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:06.813744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b58ec-91fd-4e01-a433-e8967404e4df service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:06.822293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:06.827039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:06.827652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:06.828172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] PATH_INFO: `/v3/users/a29461d7e91a431d9aa1bb77bcae9040` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:06.829885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29461d7e91a431d9aa1bb77bcae9040)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:06.833068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:06.962819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29461d7e91a431d9aa1bb77bcae9040'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:06.987813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29461d7e91a431d9aa1bb77bcae9040'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:07.008811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29461d7e91a431d9aa1bb77bcae9040'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:07.019682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29461d7e91a431d9aa1bb77bcae9040'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:07.023710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-70266482-6f1c-4963-923b-ff04086367be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29461d7e91a431d9aa1bb77bcae9040'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:07.035748 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3559/7091] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:20:06 2022] DELETE /identity/v3/users/a29461d7e91a431d9aa1bb77bcae9040 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:20:07.674328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de48f0-0d79-4bc2-a275-2010d85be18b service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:07.692784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de48f0-0d79-4bc2-a275-2010d85be18b service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:07.926539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:07.928188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:07.928652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:07.929098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] PATH_INFO: `/v3/projects/24871a8048b7422e8e4576360b3e81f5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:07.932069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=24871a8048b7422e8e4576360b3e81f5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:07.935738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:08.210363 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:08.237665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24871a8048b7422e8e4576360b3e81f5', 'request_id': 'req-609c2b97-07e4-47da-af42-35f5eb6606ea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:08.254911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24871a8048b7422e8e4576360b3e81f5', 'request_id': 'req-609c2b97-07e4-47da-af42-35f5eb6606ea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:08.270930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24871a8048b7422e8e4576360b3e81f5', 'request_id': 'req-609c2b97-07e4-47da-af42-35f5eb6606ea'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:08.309751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] The token cache is being invalidate because project 24871a8048b7422e8e4576360b3e81f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:20:08.309969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:08.311374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-609c2b97-07e4-47da-af42-35f5eb6606ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:08.313581 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3533/7092] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:20:07 2022] DELETE /identity/v3/projects/24871a8048b7422e8e4576360b3e81f5 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:20:08.319670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143dd60-13c9-4a43-ba45-6b7ffd3a6023 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:08.320209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143dd60-13c9-4a43-ba45-6b7ffd3a6023 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:08.320209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143dd60-13c9-4a43-ba45-6b7ffd3a6023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:08.339148 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:08.386891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e143dd60-13c9-4a43-ba45-6b7ffd3a6023 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:08.391335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e143dd60-13c9-4a43-ba45-6b7ffd3a6023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:08.648079 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3560/7093] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:08.655427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74acd-5bd5-4ce7-8b8f-a176085bbbf7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:08.655717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74acd-5bd5-4ce7-8b8f-a176085bbbf7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:08.655995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74acd-5bd5-4ce7-8b8f-a176085bbbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:08.707973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-15e74acd-5bd5-4ce7-8b8f-a176085bbbf7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:08.710417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-15e74acd-5bd5-4ce7-8b8f-a176085bbbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:08.745887 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3534/7094] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:08.750123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143dd60-13c9-4a43-ba45-6b7ffd3a6023 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:08.772004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143dd60-13c9-4a43-ba45-6b7ffd3a6023 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:08.785159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186650c-5990-41b3-a410-ddcdaa083af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:08.785803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186650c-5990-41b3-a410-ddcdaa083af7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:08.786095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186650c-5990-41b3-a410-ddcdaa083af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:08.786373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186650c-5990-41b3-a410-ddcdaa083af7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:08.787043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186650c-5990-41b3-a410-ddcdaa083af7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:20:08.787345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186650c-5990-41b3-a410-ddcdaa083af7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:08.792791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186650c-5990-41b3-a410-ddcdaa083af7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:08.825320 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3561/7095] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:20:08.826496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74acd-5bd5-4ce7-8b8f-a176085bbbf7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:08.844095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74acd-5bd5-4ce7-8b8f-a176085bbbf7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:08.854674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb18428-ddf2-4596-a4a3-1f85ecac13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:08.855311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb18428-ddf2-4596-a4a3-1f85ecac13ac admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:08.855591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb18428-ddf2-4596-a4a3-1f85ecac13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:08.855861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb18428-ddf2-4596-a4a3-1f85ecac13ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:08.856519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb18428-ddf2-4596-a4a3-1f85ecac13ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:08.858560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb18428-ddf2-4596-a4a3-1f85ecac13ac admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:08.937471 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3535/7096] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:20:08 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:20:08.938705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186650c-5990-41b3-a410-ddcdaa083af7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:08.955704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186650c-5990-41b3-a410-ddcdaa083af7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:09.132934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a52cb2-bd9f-48dd-937f-e4d479cee3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:09.133662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a52cb2-bd9f-48dd-937f-e4d479cee3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:09.133947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a52cb2-bd9f-48dd-937f-e4d479cee3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:09.134225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a52cb2-bd9f-48dd-937f-e4d479cee3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:09.134881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a52cb2-bd9f-48dd-937f-e4d479cee3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:09.144092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a52cb2-bd9f-48dd-937f-e4d479cee3a8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:09.234832 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3562/7097] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:20:08 2022] POST /identity/v3/users => generated 296 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:20:09.238559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb18428-ddf2-4596-a4a3-1f85ecac13ac admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:09.255372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb18428-ddf2-4596-a4a3-1f85ecac13ac admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:09.268495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda389f-73f3-4635-b10b-737bc09bdce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:09.270595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda389f-73f3-4635-b10b-737bc09bdce0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:09.270595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda389f-73f3-4635-b10b-737bc09bdce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:09.271001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda389f-73f3-4635-b10b-737bc09bdce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:09.271774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda389f-73f3-4635-b10b-737bc09bdce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:09.275729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda389f-73f3-4635-b10b-737bc09bdce0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:09.297573 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3536/7098] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:20:09.300145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a52cb2-bd9f-48dd-937f-e4d479cee3a8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:09.325701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a52cb2-bd9f-48dd-937f-e4d479cee3a8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:09.350167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc629-c659-4c28-8164-2c2e1a35d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:09.351642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc629-c659-4c28-8164-2c2e1a35d0ef admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:09.352133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc629-c659-4c28-8164-2c2e1a35d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:09.352586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc629-c659-4c28-8164-2c2e1a35d0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:09.353458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bc629-c659-4c28-8164-2c2e1a35d0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:09.355423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bc629-c659-4c28-8164-2c2e1a35d0ef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:09.370633 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3563/7099] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:20:09.374255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda389f-73f3-4635-b10b-737bc09bdce0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:09.390889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda389f-73f3-4635-b10b-737bc09bdce0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:09.400412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499e41-8150-4d19-9580-033f7d10a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:09.401573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499e41-8150-4d19-9580-033f7d10a04a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:09.402073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499e41-8150-4d19-9580-033f7d10a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:09.402757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499e41-8150-4d19-9580-033f7d10a04a admin admin] PATH_INFO: `/v3/projects/8226ea08bb744d9c82b105fde33cc332/users/fccb51cb03de4f50a1dd059a30a6c4bb/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:09.444345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc499e41-8150-4d19-9580-033f7d10a04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8226ea08bb744d9c82b105fde33cc332, user_id=fccb51cb03de4f50a1dd059a30a6c4bb, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:09.445613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc499e41-8150-4d19-9580-033f7d10a04a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:09.468887 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3537/7100] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:20:09 2022] PUT /identity/v3/projects/8226ea08bb744d9c82b105fde33cc332/users/fccb51cb03de4f50a1dd059a30a6c4bb/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:20:09.474804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f7ce7-3e37-48ea-bb00-683275d94f58 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:09.475144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f7ce7-3e37-48ea-bb00-683275d94f58 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:09.475371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f7ce7-3e37-48ea-bb00-683275d94f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:09.532789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-326f7ce7-3e37-48ea-bb00-683275d94f58 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:09.543624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-326f7ce7-3e37-48ea-bb00-683275d94f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:09.693340 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3564/7101] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:09.731383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499e41-8150-4d19-9580-033f7d10a04a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:09.741138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc499e41-8150-4d19-9580-033f7d10a04a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:09.900003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499e41-8150-4d19-9580-033f7d10a04a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:09.910256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb67a9-6d9c-4c1f-b900-44aedd2394d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:09.911089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb67a9-6d9c-4c1f-b900-44aedd2394d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:09.911479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb67a9-6d9c-4c1f-b900-44aedd2394d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:09.911860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb67a9-6d9c-4c1f-b900-44aedd2394d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:09.936455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb67a9-6d9c-4c1f-b900-44aedd2394d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:09.938364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb67a9-6d9c-4c1f-b900-44aedd2394d4 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:09.968431 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3538/7102] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:19.684209 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:19.962564 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=5,keystone:SELECT=64,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:22.442015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb662f-b710-422e-8133-a84163bb0d08 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:22.442593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb662f-b710-422e-8133-a84163bb0d08 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:22.442593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb662f-b710-422e-8133-a84163bb0d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:22.515043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a2bb662f-b710-422e-8133-a84163bb0d08 None None] MFA Rules not processed for user `fccb51cb03de4f50a1dd059a30a6c4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:22.516222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a2bb662f-b710-422e-8133-a84163bb0d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:22.766586 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3565/7103] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:22.777981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07eee2-c835-4f7f-b8dd-53f0702c4e20 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:22.778817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07eee2-c835-4f7f-b8dd-53f0702c4e20 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:22.779256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07eee2-c835-4f7f-b8dd-53f0702c4e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:22.826026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5a07eee2-c835-4f7f-b8dd-53f0702c4e20 None None] MFA Rules not processed for user `fccb51cb03de4f50a1dd059a30a6c4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:22.827965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5a07eee2-c835-4f7f-b8dd-53f0702c4e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:22.862024 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3539/7104] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:22.872983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb662f-b710-422e-8133-a84163bb0d08 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:22.874724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a2bb662f-b710-422e-8133-a84163bb0d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:23.012724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb662f-b710-422e-8133-a84163bb0d08 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:23.023006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c857-cabd-451d-8f88-0173175f4688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:23.023871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c857-cabd-451d-8f88-0173175f4688 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:23.024280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c857-cabd-451d-8f88-0173175f4688 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:23.024685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c857-cabd-451d-8f88-0173175f4688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:23.050300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757c857-cabd-451d-8f88-0173175f4688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:23.053925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757c857-cabd-451d-8f88-0173175f4688 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:23.071016 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3566/7105] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:25.179575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191bad9-634f-470d-b961-fd32bd8ed50f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:25.180430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191bad9-634f-470d-b961-fd32bd8ed50f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:25.180864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191bad9-634f-470d-b961-fd32bd8ed50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:25.235510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2191bad9-634f-470d-b961-fd32bd8ed50f None None] MFA Rules not processed for user `fccb51cb03de4f50a1dd059a30a6c4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:25.237734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2191bad9-634f-470d-b961-fd32bd8ed50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:25.285768 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3540/7106] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:33.062056 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=66 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:35.205075 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:37.091407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c857-cabd-451d-8f88-0173175f4688 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:37.134803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c857-cabd-451d-8f88-0173175f4688 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:37.173471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9318d8d-a538-49d6-b161-17423bd319b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:37.176117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9318d8d-a538-49d6-b161-17423bd319b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:37.176706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9318d8d-a538-49d6-b161-17423bd319b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:37.179481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9318d8d-a538-49d6-b161-17423bd319b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:37.193933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d9318d8d-a538-49d6-b161-17423bd319b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:37.258314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9318d8d-a538-49d6-b161-17423bd319b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:37.264212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9318d8d-a538-49d6-b161-17423bd319b4 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:37.304877 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3567/7107] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:44.006801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191bad9-634f-470d-b961-fd32bd8ed50f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:44.054162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191bad9-634f-470d-b961-fd32bd8ed50f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:44.080399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:44.082089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:44.083136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:44.083521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:44.097106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:44.133147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:44.137697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:44.176968 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3541/7108] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:44.669013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4b251-7878-4887-adf1-a990da290e3b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:44.669563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4b251-7878-4887-adf1-a990da290e3b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:44.670147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4b251-7878-4887-adf1-a990da290e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:44.744269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-11b4b251-7878-4887-adf1-a990da290e3b None None] MFA Rules not processed for user `0d12c0ca2333460bbf044ceb5178affb`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:44.747971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-11b4b251-7878-4887-adf1-a990da290e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:44.931077 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3568/7109] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:51.452506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:51.454752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:51.472833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43698f9f-04e4-4e71-9dda-4930698c7dde service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:51.476450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:51.477088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:51.477540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:51.477986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:51.479929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:51.497891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:51.499550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:51.515509 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3542/7110] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:51.935756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4b251-7878-4887-adf1-a990da290e3b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:51.966314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4b251-7878-4887-adf1-a990da290e3b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:51.980491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54613259-3100-40bc-887c-1796867d7dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:51.981577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54613259-3100-40bc-887c-1796867d7dbb service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:51.982036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54613259-3100-40bc-887c-1796867d7dbb service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:51.982462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54613259-3100-40bc-887c-1796867d7dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:51.985091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-54613259-3100-40bc-887c-1796867d7dbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:52.024350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54613259-3100-40bc-887c-1796867d7dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:52.026003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54613259-3100-40bc-887c-1796867d7dbb service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:52.054677 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3569/7111] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:55.117454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:55.119953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:55.153624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec952a4-9017-4064-bc33-3347b5c61e91 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:55.162766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:55.166485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:55.167831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:55.169239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] PATH_INFO: `/v3/users/43b0aa480b844e3593d9f9f0dd331641` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:55.171704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b0aa480b844e3593d9f9f0dd331641)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:55.176728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:55.301721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b0aa480b844e3593d9f9f0dd331641'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:55.326358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b0aa480b844e3593d9f9f0dd331641'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:55.362070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b0aa480b844e3593d9f9f0dd331641'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:55.377682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b0aa480b844e3593d9f9f0dd331641'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:55.380467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b0aa480b844e3593d9f9f0dd331641'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:55.409652 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3543/7112] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:20:55 2022] DELETE /identity/v3/users/43b0aa480b844e3593d9f9f0dd331641 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:20:55.413891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78132f7-0543-4466-a4a9-af57604ec9de None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:55.414767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78132f7-0543-4466-a4a9-af57604ec9de None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:55.415199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78132f7-0543-4466-a4a9-af57604ec9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:55.441480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e78132f7-0543-4466-a4a9-af57604ec9de None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:55.443366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e78132f7-0543-4466-a4a9-af57604ec9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:55.530486 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3570/7113] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:55.541621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:55.543174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:55.628485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbb68a-5f07-4248-bf56-d3373a376291 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:55.632881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38556e-0334-4e35-8450-89e48a008ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:55.633505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38556e-0334-4e35-8450-89e48a008ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:55.633782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38556e-0334-4e35-8450-89e48a008ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:55.634056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38556e-0334-4e35-8450-89e48a008ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:55.649646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38556e-0334-4e35-8450-89e48a008ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:55.651502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38556e-0334-4e35-8450-89e48a008ee6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:55.673986 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3544/7114] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:56.110975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78132f7-0543-4466-a4a9-af57604ec9de None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:56.112520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e78132f7-0543-4466-a4a9-af57604ec9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:56.128745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78132f7-0543-4466-a4a9-af57604ec9de None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:56.135605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:56.136804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:56.136804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:56.137091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] PATH_INFO: `/v3/projects/61dd7134e98a40429f7052aba14df742` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:56.139181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61dd7134e98a40429f7052aba14df742)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:56.141440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:56.234466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61dd7134e98a40429f7052aba14df742', 'request_id': 'req-2a18af9e-8024-4986-ae8f-b3884d2a9b59'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:56.248764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61dd7134e98a40429f7052aba14df742', 'request_id': 'req-2a18af9e-8024-4986-ae8f-b3884d2a9b59'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:56.257423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61dd7134e98a40429f7052aba14df742', 'request_id': 'req-2a18af9e-8024-4986-ae8f-b3884d2a9b59'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:56.279393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] The token cache is being invalidate because project 61dd7134e98a40429f7052aba14df742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:20:56.279701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:56.280376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2a18af9e-8024-4986-ae8f-b3884d2a9b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:56.283474 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3571/7115] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:20:56 2022] DELETE /identity/v3/projects/61dd7134e98a40429f7052aba14df742 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:20:56.289634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fe59-2626-4d57-b20f-07aaa2594c1d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:56.290780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fe59-2626-4d57-b20f-07aaa2594c1d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:56.291681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fe59-2626-4d57-b20f-07aaa2594c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:56.324463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0e90fe59-2626-4d57-b20f-07aaa2594c1d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:56.327391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0e90fe59-2626-4d57-b20f-07aaa2594c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:56.431423 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:56.510546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3545/7116] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:56.518860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e0001-5969-4e4e-be08-a5c3d4ba84f1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:56.519699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e0001-5969-4e4e-be08-a5c3d4ba84f1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:56.520133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e0001-5969-4e4e-be08-a5c3d4ba84f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:56.529279 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:56.568455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-430e0001-5969-4e4e-be08-a5c3d4ba84f1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:56.570039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-430e0001-5969-4e4e-be08-a5c3d4ba84f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:56.587070 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3572/7117] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:56.591534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fe59-2626-4d57-b20f-07aaa2594c1d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:56.602864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fe59-2626-4d57-b20f-07aaa2594c1d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:56.622696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2daf7d-926b-4e10-99a4-bed46c847a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:56.626239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2daf7d-926b-4e10-99a4-bed46c847a7f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:56.626528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2daf7d-926b-4e10-99a4-bed46c847a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:56.626808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2daf7d-926b-4e10-99a4-bed46c847a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:56.627482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2daf7d-926b-4e10-99a4-bed46c847a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:20:56.627792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2daf7d-926b-4e10-99a4-bed46c847a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:56.629462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2daf7d-926b-4e10-99a4-bed46c847a7f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:56.667663 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3546/7118] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:20:56.676278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e0001-5969-4e4e-be08-a5c3d4ba84f1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:56.690405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e0001-5969-4e4e-be08-a5c3d4ba84f1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:56.698866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61991340-83ec-46fb-a33b-fb56caba6a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:56.699817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61991340-83ec-46fb-a33b-fb56caba6a26 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:56.700166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61991340-83ec-46fb-a33b-fb56caba6a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:56.700601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61991340-83ec-46fb-a33b-fb56caba6a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:56.706371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61991340-83ec-46fb-a33b-fb56caba6a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:56.708703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61991340-83ec-46fb-a33b-fb56caba6a26 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:56.764572 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3573/7119] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:20:56 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:20:56.765213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2daf7d-926b-4e10-99a4-bed46c847a7f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:56.777995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2daf7d-926b-4e10-99a4-bed46c847a7f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:56.860515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a71ac-96eb-4f80-8529-d0d089475616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:56.861176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a71ac-96eb-4f80-8529-d0d089475616 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:56.861479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a71ac-96eb-4f80-8529-d0d089475616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:56.861726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a71ac-96eb-4f80-8529-d0d089475616 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:56.864985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a71ac-96eb-4f80-8529-d0d089475616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:56.867077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a71ac-96eb-4f80-8529-d0d089475616 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:56.908109 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3547/7120] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:20:56 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:20:56.912305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61991340-83ec-46fb-a33b-fb56caba6a26 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:56.929219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61991340-83ec-46fb-a33b-fb56caba6a26 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:56.943224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5290-f657-4b74-b2fd-f416426de6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:56.944162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5290-f657-4b74-b2fd-f416426de6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:56.944774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5290-f657-4b74-b2fd-f416426de6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:56.945118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5290-f657-4b74-b2fd-f416426de6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:56.947093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf5290-f657-4b74-b2fd-f416426de6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:56.948986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf5290-f657-4b74-b2fd-f416426de6d6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:56.976791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3574/7121] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:20:56.978032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a71ac-96eb-4f80-8529-d0d089475616 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:57.023879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a71ac-96eb-4f80-8529-d0d089475616 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:57.034489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07d040-e4a7-4314-8207-865834a54d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:57.036819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d040-e4a7-4314-8207-865834a54d43 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:57.037847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d040-e4a7-4314-8207-865834a54d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:57.038893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d040-e4a7-4314-8207-865834a54d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:57.040328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07d040-e4a7-4314-8207-865834a54d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:57.042374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07d040-e4a7-4314-8207-865834a54d43 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:57.055030 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3548/7122] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:20:57.059633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5290-f657-4b74-b2fd-f416426de6d6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:57.072503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5290-f657-4b74-b2fd-f416426de6d6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:57.081140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03a6e-038b-42f7-8ed8-0b82a85fdea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:57.082291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03a6e-038b-42f7-8ed8-0b82a85fdea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:57.082590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03a6e-038b-42f7-8ed8-0b82a85fdea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:57.082868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03a6e-038b-42f7-8ed8-0b82a85fdea3 admin admin] PATH_INFO: `/v3/projects/b79441c35f874d4a9a07224b6acd8241/users/c1e6fdebef004218a9f6a581be736fbc/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:57.108018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f03a6e-038b-42f7-8ed8-0b82a85fdea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79441c35f874d4a9a07224b6acd8241, user_id=c1e6fdebef004218a9f6a581be736fbc, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:57.111508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f03a6e-038b-42f7-8ed8-0b82a85fdea3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:57.133772 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3575/7123] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:20:57 2022] PUT /identity/v3/projects/b79441c35f874d4a9a07224b6acd8241/users/c1e6fdebef004218a9f6a581be736fbc/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:20:57.145509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9ba9d-3941-4f2c-b742-0d508339c155 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:57.145796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9ba9d-3941-4f2c-b742-0d508339c155 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:57.146073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9ba9d-3941-4f2c-b742-0d508339c155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:57.185041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-91d9ba9d-3941-4f2c-b742-0d508339c155 None None] MFA Rules not processed for user `c1e6fdebef004218a9f6a581be736fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:57.187936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-91d9ba9d-3941-4f2c-b742-0d508339c155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:57.318616 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3549/7124] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:57.330830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03a6e-038b-42f7-8ed8-0b82a85fdea3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:57.332914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-10f03a6e-038b-42f7-8ed8-0b82a85fdea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:57.403928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03a6e-038b-42f7-8ed8-0b82a85fdea3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:57.408975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e255d5-9500-402e-ae65-7d95ec26cf6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:57.409752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e255d5-9500-402e-ae65-7d95ec26cf6b service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:57.410087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e255d5-9500-402e-ae65-7d95ec26cf6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:57.410695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e255d5-9500-402e-ae65-7d95ec26cf6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:57.421218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e255d5-9500-402e-ae65-7d95ec26cf6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:57.423386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e255d5-9500-402e-ae65-7d95ec26cf6b service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:57.433475 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3576/7125] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:57.903606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9ba9d-3941-4f2c-b742-0d508339c155 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:57.957481 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:57.980423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9ba9d-3941-4f2c-b742-0d508339c155 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:57.985306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:57.986104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:57.986386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:57.986667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] PATH_INFO: `/v3/users/c1e6fdebef004218a9f6a581be736fbc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:57.987824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e6fdebef004218a9f6a581be736fbc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:57.990550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:58.054444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e6fdebef004218a9f6a581be736fbc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:58.072446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e6fdebef004218a9f6a581be736fbc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:58.081884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e6fdebef004218a9f6a581be736fbc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:58.104057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e6fdebef004218a9f6a581be736fbc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:58.105514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e6fdebef004218a9f6a581be736fbc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:58.116812 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3550/7126] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:20:57 2022] DELETE /identity/v3/users/c1e6fdebef004218a9f6a581be736fbc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:20:58.118066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950c9b2-796a-458a-903f-8db9c2c0f625 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:58.118533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950c9b2-796a-458a-903f-8db9c2c0f625 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:58.118630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950c9b2-796a-458a-903f-8db9c2c0f625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:58.146984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b950c9b2-796a-458a-903f-8db9c2c0f625 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:58.148316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b950c9b2-796a-458a-903f-8db9c2c0f625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:58.249608 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3577/7127] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:20:58.261332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:58.262382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:58.364250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18e802-f225-44cb-b5f5-189f7f359c91 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:58.368441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1c36e-219b-4ed5-9910-c1a9a9abc059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:58.369049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1c36e-219b-4ed5-9910-c1a9a9abc059 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:58.369334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1c36e-219b-4ed5-9910-c1a9a9abc059 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:58.369615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1c36e-219b-4ed5-9910-c1a9a9abc059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:58.393102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1c36e-219b-4ed5-9910-c1a9a9abc059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:58.396820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1c36e-219b-4ed5-9910-c1a9a9abc059 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:58.418154 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3551/7128] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:20:59.178667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950c9b2-796a-458a-903f-8db9c2c0f625 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:59.180158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b950c9b2-796a-458a-903f-8db9c2c0f625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:59.193766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950c9b2-796a-458a-903f-8db9c2c0f625 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:59.199164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:59.199808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:59.200089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:59.200364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] PATH_INFO: `/v3/projects/b79441c35f874d4a9a07224b6acd8241` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:59.201595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79441c35f874d4a9a07224b6acd8241)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:59.205732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:59.270068 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:59.300766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79441c35f874d4a9a07224b6acd8241', 'request_id': 'req-b56ef09e-139b-4773-b697-ccd1daa3fdb1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:59.328715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79441c35f874d4a9a07224b6acd8241', 'request_id': 'req-b56ef09e-139b-4773-b697-ccd1daa3fdb1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:59.336288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79441c35f874d4a9a07224b6acd8241', 'request_id': 'req-b56ef09e-139b-4773-b697-ccd1daa3fdb1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:59.355343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] The token cache is being invalidate because project b79441c35f874d4a9a07224b6acd8241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:20:59.355985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:59.357299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b56ef09e-139b-4773-b697-ccd1daa3fdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:20:59.363664 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3578/7129] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:20:59 2022] DELETE /identity/v3/projects/b79441c35f874d4a9a07224b6acd8241 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:20:59.365220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca463081-4d64-480b-8315-4eabfdd04a8d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:59.365669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca463081-4d64-480b-8315-4eabfdd04a8d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:59.365749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca463081-4d64-480b-8315-4eabfdd04a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:59.407599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ca463081-4d64-480b-8315-4eabfdd04a8d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:59.409122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ca463081-4d64-480b-8315-4eabfdd04a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:59.551190 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3552/7130] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:20:59.552425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1843f5-eb4c-4ba0-90b6-f092a0b08034 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:59.554159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1843f5-eb4c-4ba0-90b6-f092a0b08034 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:59.554455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1843f5-eb4c-4ba0-90b6-f092a0b08034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:59.598217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1f1843f5-eb4c-4ba0-90b6-f092a0b08034 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:20:59.601017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1f1843f5-eb4c-4ba0-90b6-f092a0b08034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:20:59.623487 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3579/7131] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:20:59.625939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca463081-4d64-480b-8315-4eabfdd04a8d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:59.642091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca463081-4d64-480b-8315-4eabfdd04a8d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:59.653136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8076b-92b3-405f-8cd0-2c4346caf477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:59.654034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8076b-92b3-405f-8cd0-2c4346caf477 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:59.654471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8076b-92b3-405f-8cd0-2c4346caf477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:59.654940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8076b-92b3-405f-8cd0-2c4346caf477 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:59.657404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8076b-92b3-405f-8cd0-2c4346caf477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:20:59.657913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8076b-92b3-405f-8cd0-2c4346caf477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:59.659698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8076b-92b3-405f-8cd0-2c4346caf477 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:59.661691 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:59.679405 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3553/7132] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:20:59.682603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1843f5-eb4c-4ba0-90b6-f092a0b08034 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:59.698028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1843f5-eb4c-4ba0-90b6-f092a0b08034 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:20:59.720881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80dded-12cc-44fc-bd20-2e1826fa3a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:20:59.721632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80dded-12cc-44fc-bd20-2e1826fa3a7e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:20:59.722862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80dded-12cc-44fc-bd20-2e1826fa3a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:20:59.723226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80dded-12cc-44fc-bd20-2e1826fa3a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:20:59.725290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80dded-12cc-44fc-bd20-2e1826fa3a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:20:59.732303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80dded-12cc-44fc-bd20-2e1826fa3a7e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:20:59.838581 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3580/7133] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:20:59 2022] POST /identity/v3/projects => generated 351 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:20:59.841001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8076b-92b3-405f-8cd0-2c4346caf477 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:20:59.874047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8076b-92b3-405f-8cd0-2c4346caf477 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:00.010533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b672b39-0341-4604-bc25-0f8440916b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:00.011395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b672b39-0341-4604-bc25-0f8440916b48 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:00.011802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b672b39-0341-4604-bc25-0f8440916b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:00.012339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b672b39-0341-4604-bc25-0f8440916b48 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:00.014162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b672b39-0341-4604-bc25-0f8440916b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:00.015129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b672b39-0341-4604-bc25-0f8440916b48 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:00.071394 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3554/7134] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:20:59 2022] POST /identity/v3/users => generated 276 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:00.075181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80dded-12cc-44fc-bd20-2e1826fa3a7e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:00.095998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80dded-12cc-44fc-bd20-2e1826fa3a7e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:00.107088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66721757-b6bf-4871-b9a9-2b8c3b815a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:00.107806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66721757-b6bf-4871-b9a9-2b8c3b815a00 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:00.108158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66721757-b6bf-4871-b9a9-2b8c3b815a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:00.108504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66721757-b6bf-4871-b9a9-2b8c3b815a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:00.109961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66721757-b6bf-4871-b9a9-2b8c3b815a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:00.115974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66721757-b6bf-4871-b9a9-2b8c3b815a00 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:00.135696 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3581/7135] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:00.139741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b672b39-0341-4604-bc25-0f8440916b48 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:00.152197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b672b39-0341-4604-bc25-0f8440916b48 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:00.158971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89963-41c9-478a-84df-920ee49175b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:00.160000 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89963-41c9-478a-84df-920ee49175b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:00.160286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89963-41c9-478a-84df-920ee49175b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:00.160777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89963-41c9-478a-84df-920ee49175b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:00.161352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89963-41c9-478a-84df-920ee49175b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:00.163087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89963-41c9-478a-84df-920ee49175b6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:00.175818 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3555/7136] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:00.179938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66721757-b6bf-4871-b9a9-2b8c3b815a00 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:00.193539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66721757-b6bf-4871-b9a9-2b8c3b815a00 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:00.200598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29510adf-8abd-4334-8680-96213b476e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:00.205327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29510adf-8abd-4334-8680-96213b476e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:00.205874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29510adf-8abd-4334-8680-96213b476e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:00.206087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29510adf-8abd-4334-8680-96213b476e41 admin admin] PATH_INFO: `/v3/projects/3c895777df584015bafb02afc87f915b/users/ef0c200348ae47d3a2ba3669d328f231/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:00.246984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29510adf-8abd-4334-8680-96213b476e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c895777df584015bafb02afc87f915b, user_id=ef0c200348ae47d3a2ba3669d328f231, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:00.250235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29510adf-8abd-4334-8680-96213b476e41 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:00.267555 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3582/7137] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:00 2022] PUT /identity/v3/projects/3c895777df584015bafb02afc87f915b/users/ef0c200348ae47d3a2ba3669d328f231/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:00.277623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6eec-328a-4566-927d-9f3ddbb05467 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:00.278084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6eec-328a-4566-927d-9f3ddbb05467 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:00.278537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6eec-328a-4566-927d-9f3ddbb05467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:00.311853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e51b6eec-328a-4566-927d-9f3ddbb05467 None None] MFA Rules not processed for user `ef0c200348ae47d3a2ba3669d328f231`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:00.313176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e51b6eec-328a-4566-927d-9f3ddbb05467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:00.393535 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3556/7138] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:00.403100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29510adf-8abd-4334-8680-96213b476e41 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:00.405091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-29510adf-8abd-4334-8680-96213b476e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:00.501618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29510adf-8abd-4334-8680-96213b476e41 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:00.501618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251fc56-f9d6-4ddc-9c35-8589a2427e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:00.501618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251fc56-f9d6-4ddc-9c35-8589a2427e70 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:00.501618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251fc56-f9d6-4ddc-9c35-8589a2427e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:00.502021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251fc56-f9d6-4ddc-9c35-8589a2427e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:00.525605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251fc56-f9d6-4ddc-9c35-8589a2427e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:00.527307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251fc56-f9d6-4ddc-9c35-8589a2427e70 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:00.541291 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3583/7139] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:21:02.904497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6eec-328a-4566-927d-9f3ddbb05467 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:02.925523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251fc56-f9d6-4ddc-9c35-8589a2427e70 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:02.927728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5251fc56-f9d6-4ddc-9c35-8589a2427e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:03.038792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251fc56-f9d6-4ddc-9c35-8589a2427e70 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:03.054264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:03.054996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:03.055343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:03.055690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] PATH_INFO: `/v3/users/4e394c9876db468caaf058abac55f3fc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:03.058178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e394c9876db468caaf058abac55f3fc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:03.073231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:03.079231 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:03.083836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6eec-328a-4566-927d-9f3ddbb05467 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:03.097374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:03.098051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:03.098336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:03.098614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] PATH_INFO: `/v3/users/ef0c200348ae47d3a2ba3669d328f231` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:03.099924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0c200348ae47d3a2ba3669d328f231)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:03.101920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:03.104705 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:03.174500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e394c9876db468caaf058abac55f3fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.186571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0c200348ae47d3a2ba3669d328f231'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.206536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0c200348ae47d3a2ba3669d328f231'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.207822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e394c9876db468caaf058abac55f3fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.222370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0c200348ae47d3a2ba3669d328f231'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.230730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e394c9876db468caaf058abac55f3fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.239089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0c200348ae47d3a2ba3669d328f231'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.239914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3c466855-aaed-44f1-9443-050e7001c12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0c200348ae47d3a2ba3669d328f231'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.247256 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3557/7140] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:02 2022] DELETE /identity/v3/users/ef0c200348ae47d3a2ba3669d328f231 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:03.250293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e394c9876db468caaf058abac55f3fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.250293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e394c9876db468caaf058abac55f3fc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.252859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699427a-46fe-40b3-a542-2a5415a97e83 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:03.253238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699427a-46fe-40b3-a542-2a5415a97e83 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:03.253587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699427a-46fe-40b3-a542-2a5415a97e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:03.267452 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3584/7141] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:02 2022] DELETE /identity/v3/users/4e394c9876db468caaf058abac55f3fc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:03.282003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6699427a-46fe-40b3-a542-2a5415a97e83 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:03.283378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6699427a-46fe-40b3-a542-2a5415a97e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:03.398341 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3558/7142] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:03.410147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:03.411742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:03.521594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2a85d-5868-4dd0-a5e9-101f7ab9c172 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:03.527775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ce600-6922-4007-ba55-caf57b2a55ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:03.528453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce600-6922-4007-ba55-caf57b2a55ad service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:03.528776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce600-6922-4007-ba55-caf57b2a55ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:03.529436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce600-6922-4007-ba55-caf57b2a55ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:03.538443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699427a-46fe-40b3-a542-2a5415a97e83 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:03.540078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6699427a-46fe-40b3-a542-2a5415a97e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:03.548738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ce600-6922-4007-ba55-caf57b2a55ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:03.550247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ce600-6922-4007-ba55-caf57b2a55ad service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:03.562032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699427a-46fe-40b3-a542-2a5415a97e83 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:03.567438 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3585/7143] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:21:03.570217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:03.571070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:03.571622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:03.571912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] PATH_INFO: `/v3/projects/69300f41e0bb41c191a9576afafccd63` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:03.573673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69300f41e0bb41c191a9576afafccd63)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:03.576349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:03.672671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69300f41e0bb41c191a9576afafccd63', 'request_id': 'req-37c214bc-c846-410a-b5f5-7fbf7291d37f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.695156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69300f41e0bb41c191a9576afafccd63', 'request_id': 'req-37c214bc-c846-410a-b5f5-7fbf7291d37f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.704589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69300f41e0bb41c191a9576afafccd63', 'request_id': 'req-37c214bc-c846-410a-b5f5-7fbf7291d37f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.721469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] The token cache is being invalidate because project 69300f41e0bb41c191a9576afafccd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:03.722009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.722906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:03.725523 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3559/7144] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:03 2022] DELETE /identity/v3/projects/69300f41e0bb41c191a9576afafccd63 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:03.730270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ce600-6922-4007-ba55-caf57b2a55ad service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:03.755874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ce600-6922-4007-ba55-caf57b2a55ad service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:03.865169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:03.865966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:03.866261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:03.866617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] PATH_INFO: `/v3/users/48bf307208d64c8597d11947ff951cf3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:03.870564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bf307208d64c8597d11947ff951cf3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:03.872443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:03.894615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:03.896396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:03.915859 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:03.925841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c214bc-c846-410a-b5f5-7fbf7291d37f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:03.939102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:03.940057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:03.940467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:03.940895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] PATH_INFO: `/v3/projects/3c895777df584015bafb02afc87f915b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:03.945093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c895777df584015bafb02afc87f915b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:03.948840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:03.961850 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:03.990050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bf307208d64c8597d11947ff951cf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.011532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bf307208d64c8597d11947ff951cf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.023122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bf307208d64c8597d11947ff951cf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.029544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c895777df584015bafb02afc87f915b', 'request_id': 'req-a75a95ab-0522-4719-ac10-51965c25bcfe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.036773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bf307208d64c8597d11947ff951cf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.037736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f51a062d-4370-453b-9ed3-4009477d187b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bf307208d64c8597d11947ff951cf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.041540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c895777df584015bafb02afc87f915b', 'request_id': 'req-a75a95ab-0522-4719-ac10-51965c25bcfe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.057157 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3586/7145] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:03 2022] DELETE /identity/v3/users/48bf307208d64c8597d11947ff951cf3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:04.065277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c895777df584015bafb02afc87f915b', 'request_id': 'req-a75a95ab-0522-4719-ac10-51965c25bcfe'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.097585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] The token cache is being invalidate because project 3c895777df584015bafb02afc87f915b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:04.098054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.099464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a75a95ab-0522-4719-ac10-51965c25bcfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.105402 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3560/7146] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:03 2022] DELETE /identity/v3/projects/3c895777df584015bafb02afc87f915b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:04.107108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05d1b-2010-4bf3-bc4f-3fe4e0744009 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.107398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05d1b-2010-4bf3-bc4f-3fe4e0744009 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.107676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05d1b-2010-4bf3-bc4f-3fe4e0744009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.144152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d7e05d1b-2010-4bf3-bc4f-3fe4e0744009 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:04.145439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d7e05d1b-2010-4bf3-bc4f-3fe4e0744009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:04.243400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b869b96-e05c-48aa-b276-0986b6fb5e40 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.243613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b869b96-e05c-48aa-b276-0986b6fb5e40 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.243889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b869b96-e05c-48aa-b276-0986b6fb5e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.255273 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3587/7147] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:04.294711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5b869b96-e05c-48aa-b276-0986b6fb5e40 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:04.298069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5b869b96-e05c-48aa-b276-0986b6fb5e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:04.303401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05d1b-2010-4bf3-bc4f-3fe4e0744009 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.305481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d7e05d1b-2010-4bf3-bc4f-3fe4e0744009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:04.314237 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3561/7148] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:04.318233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b869b96-e05c-48aa-b276-0986b6fb5e40 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.332364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b869b96-e05c-48aa-b276-0986b6fb5e40 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:04.338852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05d1b-2010-4bf3-bc4f-3fe4e0744009 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:04.346615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:04.347285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.347568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.347848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] PATH_INFO: `/v3/projects/4c1e2d50044b41a8b01c244908329cc4` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.349301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1e2d50044b41a8b01c244908329cc4)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:04.350035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3ab3-54ba-4bb0-8dbe-c2b9548bdc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:04.352781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3ab3-54ba-4bb0-8dbe-c2b9548bdc61 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.353294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3ab3-54ba-4bb0-8dbe-c2b9548bdc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.354070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3ab3-54ba-4bb0-8dbe-c2b9548bdc61 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.355029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e3ab3-54ba-4bb0-8dbe-c2b9548bdc61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:04.355586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e3ab3-54ba-4bb0-8dbe-c2b9548bdc61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:04.358175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e3ab3-54ba-4bb0-8dbe-c2b9548bdc61 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:04.360901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:04.388389 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3562/7149] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:04.389548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3ab3-54ba-4bb0-8dbe-c2b9548bdc61 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.402964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3ab3-54ba-4bb0-8dbe-c2b9548bdc61 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:04.411312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be468-c1ec-4dff-b57c-a7af3dbae5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:04.412347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be468-c1ec-4dff-b57c-a7af3dbae5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.412745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be468-c1ec-4dff-b57c-a7af3dbae5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.413676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be468-c1ec-4dff-b57c-a7af3dbae5d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.415125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01be468-c1ec-4dff-b57c-a7af3dbae5d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:04.418318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01be468-c1ec-4dff-b57c-a7af3dbae5d6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:04.438097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1e2d50044b41a8b01c244908329cc4', 'request_id': 'req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.458864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1e2d50044b41a8b01c244908329cc4', 'request_id': 'req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.467821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1e2d50044b41a8b01c244908329cc4', 'request_id': 'req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.475977 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3563/7150] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:04 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:04.477808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be468-c1ec-4dff-b57c-a7af3dbae5d6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.494197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] The token cache is being invalidate because project 4c1e2d50044b41a8b01c244908329cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:04.494394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.500840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-09d8a812-cb32-4ff6-bf07-f430dcfd0c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:04.503619 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3588/7151] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:04 2022] DELETE /identity/v3/projects/4c1e2d50044b41a8b01c244908329cc4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:04.509075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9980e91-98be-45fe-be21-73868e83c777 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.509494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9980e91-98be-45fe-be21-73868e83c777 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.509784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9980e91-98be-45fe-be21-73868e83c777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.569252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a9980e91-98be-45fe-be21-73868e83c777 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:04.573708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a9980e91-98be-45fe-be21-73868e83c777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:04.598803 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3589/7152] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:04.599524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be468-c1ec-4dff-b57c-a7af3dbae5d6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:04.601330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30290d3-2915-4b50-88ac-b341d4b1b882 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.601621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30290d3-2915-4b50-88ac-b341d4b1b882 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.602004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30290d3-2915-4b50-88ac-b341d4b1b882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.605014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3588bd-0727-4c8c-82c8-7f02b57fc21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:04.606029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3588bd-0727-4c8c-82c8-7f02b57fc21a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.606417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3588bd-0727-4c8c-82c8-7f02b57fc21a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.606841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3588bd-0727-4c8c-82c8-7f02b57fc21a admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.607665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3588bd-0727-4c8c-82c8-7f02b57fc21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:04.610999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3588bd-0727-4c8c-82c8-7f02b57fc21a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:04.642525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f30290d3-2915-4b50-88ac-b341d4b1b882 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:04.644748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f30290d3-2915-4b50-88ac-b341d4b1b882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:04.654356 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3564/7153] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:04 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:04.657063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3588bd-0727-4c8c-82c8-7f02b57fc21a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.658974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8c3588bd-0727-4c8c-82c8-7f02b57fc21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:04.676054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3588bd-0727-4c8c-82c8-7f02b57fc21a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:04.681860 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3590/7154] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:04.683502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30290d3-2915-4b50-88ac-b341d4b1b882 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.686630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b958ebd-a99e-4faa-ab5e-df0b95eabd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:04.687793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b958ebd-a99e-4faa-ab5e-df0b95eabd34 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.687926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b958ebd-a99e-4faa-ab5e-df0b95eabd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.688543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b958ebd-a99e-4faa-ab5e-df0b95eabd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.689501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b958ebd-a99e-4faa-ab5e-df0b95eabd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:04.692273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b958ebd-a99e-4faa-ab5e-df0b95eabd34 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:04.701514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30290d3-2915-4b50-88ac-b341d4b1b882 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:04.710376 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3565/7155] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:04.711538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b958ebd-a99e-4faa-ab5e-df0b95eabd34 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.713993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e02d6-8025-4426-9d54-549abe43c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:04.714671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e02d6-8025-4426-9d54-549abe43c64c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.714956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e02d6-8025-4426-9d54-549abe43c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.715231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e02d6-8025-4426-9d54-549abe43c64c admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.715992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e02d6-8025-4426-9d54-549abe43c64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:04.716186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e02d6-8025-4426-9d54-549abe43c64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:04.717912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e02d6-8025-4426-9d54-549abe43c64c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:04.729527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b958ebd-a99e-4faa-ab5e-df0b95eabd34 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:04.737452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bbbc9-932b-41aa-9edf-6da4e2297cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:04.738521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bbbc9-932b-41aa-9edf-6da4e2297cde admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.739026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bbbc9-932b-41aa-9edf-6da4e2297cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.739597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bbbc9-932b-41aa-9edf-6da4e2297cde admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.740810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bbbc9-932b-41aa-9edf-6da4e2297cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:04.742863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bbbc9-932b-41aa-9edf-6da4e2297cde admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:04.752050 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3591/7156] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:21:04.756190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e02d6-8025-4426-9d54-549abe43c64c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.759765 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3566/7157] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:04.763306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bbbc9-932b-41aa-9edf-6da4e2297cde admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.763880 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:04.774311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e02d6-8025-4426-9d54-549abe43c64c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:04.784298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bbbc9-932b-41aa-9edf-6da4e2297cde admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:04.787220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162228-c86b-44df-a5b8-4e21b75b95ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:04.788401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162228-c86b-44df-a5b8-4e21b75b95ec admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.790014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162228-c86b-44df-a5b8-4e21b75b95ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.791797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162228-c86b-44df-a5b8-4e21b75b95ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.793661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56162228-c86b-44df-a5b8-4e21b75b95ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:04.799047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56162228-c86b-44df-a5b8-4e21b75b95ec admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:04.802562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab336926-8a02-4b51-8ebb-9e6d9d2e5f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:04.803506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab336926-8a02-4b51-8ebb-9e6d9d2e5f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.804019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab336926-8a02-4b51-8ebb-9e6d9d2e5f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.804500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab336926-8a02-4b51-8ebb-9e6d9d2e5f98 admin admin] PATH_INFO: `/v3/projects/842101b2cf9d4db28d33b8cdecdcb5f9/users/c23cafac1ad84a2aaf7eb75182cc8232/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.825519 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:04.832675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab336926-8a02-4b51-8ebb-9e6d9d2e5f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842101b2cf9d4db28d33b8cdecdcb5f9, user_id=c23cafac1ad84a2aaf7eb75182cc8232, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:04.837271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab336926-8a02-4b51-8ebb-9e6d9d2e5f98 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:04.862070 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3567/7158] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:04 2022] PUT /identity/v3/projects/842101b2cf9d4db28d33b8cdecdcb5f9/users/c23cafac1ad84a2aaf7eb75182cc8232/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:04.873554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6ca02-9152-4aab-9c5e-11f073f7c6ca None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:04.873840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6ca02-9152-4aab-9c5e-11f073f7c6ca None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:04.874153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6ca02-9152-4aab-9c5e-11f073f7c6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:04.882038 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3592/7159] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:04 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:04.888092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162228-c86b-44df-a5b8-4e21b75b95ec admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:04.923027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-99d6ca02-9152-4aab-9c5e-11f073f7c6ca None None] MFA Rules not processed for user `c23cafac1ad84a2aaf7eb75182cc8232`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:04.924908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-99d6ca02-9152-4aab-9c5e-11f073f7c6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:04.989942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162228-c86b-44df-a5b8-4e21b75b95ec admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.000869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da37b2d-22b2-476a-b86a-96b1818955a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.002261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da37b2d-22b2-476a-b86a-96b1818955a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.002393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da37b2d-22b2-476a-b86a-96b1818955a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.002747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da37b2d-22b2-476a-b86a-96b1818955a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.003826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da37b2d-22b2-476a-b86a-96b1818955a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.007331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da37b2d-22b2-476a-b86a-96b1818955a7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.031288 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3568/7160] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:05.036282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6ca02-9152-4aab-9c5e-11f073f7c6ca None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.049031 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3593/7161] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:04 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:05.049895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6ca02-9152-4aab-9c5e-11f073f7c6ca None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.050977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da37b2d-22b2-476a-b86a-96b1818955a7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.056534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ff8a-f43d-4d94-abdf-e99e3b9df8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.057383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ff8a-f43d-4d94-abdf-e99e3b9df8ba admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.057669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ff8a-f43d-4d94-abdf-e99e3b9df8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.057946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1ff8a-f43d-4d94-abdf-e99e3b9df8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.058584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ff8a-f43d-4d94-abdf-e99e3b9df8ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.060785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1ff8a-f43d-4d94-abdf-e99e3b9df8ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.077075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da37b2d-22b2-476a-b86a-96b1818955a7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.084519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69ec3f-fb8c-44cf-999e-48754b90b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.085834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69ec3f-fb8c-44cf-999e-48754b90b09f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.086179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69ec3f-fb8c-44cf-999e-48754b90b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.086562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69ec3f-fb8c-44cf-999e-48754b90b09f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.087339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69ec3f-fb8c-44cf-999e-48754b90b09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.089544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69ec3f-fb8c-44cf-999e-48754b90b09f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.097078 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3569/7162] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:05 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:05.100700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ff8a-f43d-4d94-abdf-e99e3b9df8ba admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.106966 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3594/7163] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:05.110665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69ec3f-fb8c-44cf-999e-48754b90b09f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.127700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69ec3f-fb8c-44cf-999e-48754b90b09f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.183763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1ff8a-f43d-4d94-abdf-e99e3b9df8ba admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.189786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c17bc-d9e9-4870-9cea-9f7911f8314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.190405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c17bc-d9e9-4870-9cea-9f7911f8314f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.190683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c17bc-d9e9-4870-9cea-9f7911f8314f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.190952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c17bc-d9e9-4870-9cea-9f7911f8314f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.191585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c17bc-d9e9-4870-9cea-9f7911f8314f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.193569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c17bc-d9e9-4870-9cea-9f7911f8314f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.218960 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3570/7164] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:05 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:05.223774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c17bc-d9e9-4870-9cea-9f7911f8314f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.224826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf145-500f-4a89-96a3-ca9c80808a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.225699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf145-500f-4a89-96a3-ca9c80808a5d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.226045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf145-500f-4a89-96a3-ca9c80808a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.226349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf145-500f-4a89-96a3-ca9c80808a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.226875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaf145-500f-4a89-96a3-ca9c80808a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.228783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaf145-500f-4a89-96a3-ca9c80808a5d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.241791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3595/7165] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:05.245371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf145-500f-4a89-96a3-ca9c80808a5d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.247862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c17bc-d9e9-4870-9cea-9f7911f8314f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.256784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf145-500f-4a89-96a3-ca9c80808a5d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.258460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a45115-442a-4a9a-a3da-b36f1c17fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.259280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a45115-442a-4a9a-a3da-b36f1c17fcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.259776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a45115-442a-4a9a-a3da-b36f1c17fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.261268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a45115-442a-4a9a-a3da-b36f1c17fcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.262011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a45115-442a-4a9a-a3da-b36f1c17fcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.262885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099234a-a1fb-436d-a283-e94fa16c1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.263166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099234a-a1fb-436d-a283-e94fa16c1024 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.263449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099234a-a1fb-436d-a283-e94fa16c1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.263724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099234a-a1fb-436d-a283-e94fa16c1024 admin admin] PATH_INFO: `/v3/projects/f06e14eb8ea544e09633e2d786c67143/users/14bd2636440d4357a2dd9a8867636581/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.265509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a45115-442a-4a9a-a3da-b36f1c17fcc4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.284340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099234a-a1fb-436d-a283-e94fa16c1024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06e14eb8ea544e09633e2d786c67143, user_id=14bd2636440d4357a2dd9a8867636581, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.289046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099234a-a1fb-436d-a283-e94fa16c1024 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.291943 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3571/7166] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:05.293073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a45115-442a-4a9a-a3da-b36f1c17fcc4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.309425 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3596/7167] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:05 2022] PUT /identity/v3/projects/f06e14eb8ea544e09633e2d786c67143/users/14bd2636440d4357a2dd9a8867636581/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:05.318266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1b9d-fb9c-4037-84c0-f470edfc8dd1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.319105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1b9d-fb9c-4037-84c0-f470edfc8dd1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.319461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1b9d-fb9c-4037-84c0-f470edfc8dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.324864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a45115-442a-4a9a-a3da-b36f1c17fcc4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.359663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e3ea1b9d-fb9c-4037-84c0-f470edfc8dd1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:05.361168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e3ea1b9d-fb9c-4037-84c0-f470edfc8dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:05.394328 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:05.432421 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:05.461630 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3597/7168] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:05.473416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1b9d-fb9c-4037-84c0-f470edfc8dd1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.475504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e3ea1b9d-fb9c-4037-84c0-f470edfc8dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:05.491880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00d5c-23bd-45f7-8a8a-c6a333ac14ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.492698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00d5c-23bd-45f7-8a8a-c6a333ac14ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.493052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00d5c-23bd-45f7-8a8a-c6a333ac14ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.493395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00d5c-23bd-45f7-8a8a-c6a333ac14ab admin admin] PATH_INFO: `/v3/projects/b25c38256d994a2480070ae1495a713a/users/fbe907d1fa614ecdb67058270565f5a2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.510760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b00d5c-23bd-45f7-8a8a-c6a333ac14ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25c38256d994a2480070ae1495a713a, user_id=fbe907d1fa614ecdb67058270565f5a2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.513834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b00d5c-23bd-45f7-8a8a-c6a333ac14ab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.540655 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3572/7169] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:05 2022] PUT /identity/v3/projects/b25c38256d994a2480070ae1495a713a/users/fbe907d1fa614ecdb67058270565f5a2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:05.544636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00d5c-23bd-45f7-8a8a-c6a333ac14ab admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.611792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1b9d-fb9c-4037-84c0-f470edfc8dd1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.643342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00d5c-23bd-45f7-8a8a-c6a333ac14ab admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.668803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381ff11-6aae-428c-b4a9-91d17509b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.669751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381ff11-6aae-428c-b4a9-91d17509b2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.671070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381ff11-6aae-428c-b4a9-91d17509b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.674335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381ff11-6aae-428c-b4a9-91d17509b2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.680913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381ff11-6aae-428c-b4a9-91d17509b2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.682940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381ff11-6aae-428c-b4a9-91d17509b2d6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.700568 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3573/7170] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:05.708965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381ff11-6aae-428c-b4a9-91d17509b2d6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.726943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381ff11-6aae-428c-b4a9-91d17509b2d6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:05.737953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ddfde-179c-4829-b6bb-88a482c9c350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.738613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ddfde-179c-4829-b6bb-88a482c9c350 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.738898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ddfde-179c-4829-b6bb-88a482c9c350 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.739179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ddfde-179c-4829-b6bb-88a482c9c350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.742521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df3b93-b863-4a28-8cab-254ab3ed19fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:05.743208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df3b93-b863-4a28-8cab-254ab3ed19fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.743491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df3b93-b863-4a28-8cab-254ab3ed19fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.743774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df3b93-b863-4a28-8cab-254ab3ed19fe admin admin] PATH_INFO: `/v3/projects/b25c38256d994a2480070ae1495a713a/users/fbe907d1fa614ecdb67058270565f5a2/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.746744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df3b93-b863-4a28-8cab-254ab3ed19fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25c38256d994a2480070ae1495a713a, user_id=fbe907d1fa614ecdb67058270565f5a2, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.750866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df3b93-b863-4a28-8cab-254ab3ed19fe admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.763364 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3574/7171] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:05 2022] PUT /identity/v3/projects/b25c38256d994a2480070ae1495a713a/users/fbe907d1fa614ecdb67058270565f5a2/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:05.767356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ddfde-179c-4829-b6bb-88a482c9c350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:05.768843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ddfde-179c-4829-b6bb-88a482c9c350 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:05.783191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54157b-3686-4347-b354-eee6c4a79ada None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:05.783488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54157b-3686-4347-b354-eee6c4a79ada None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:05.783766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54157b-3686-4347-b354-eee6c4a79ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:05.787983 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3598/7172] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:05.817380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ab54157b-3686-4347-b354-eee6c4a79ada None None] MFA Rules not processed for user `fbe907d1fa614ecdb67058270565f5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:05.818867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ab54157b-3686-4347-b354-eee6c4a79ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:05.911594 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3575/7173] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:05.925564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ddfde-179c-4829-b6bb-88a482c9c350 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:05.927502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b8ddfde-179c-4829-b6bb-88a482c9c350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:06.056303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ddfde-179c-4829-b6bb-88a482c9c350 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:06.132070 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:06.175768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ecc36-4a2c-4230-87c9-b18a8dd295a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:06.176404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ecc36-4a2c-4230-87c9-b18a8dd295a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:06.176719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ecc36-4a2c-4230-87c9-b18a8dd295a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:06.177339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ecc36-4a2c-4230-87c9-b18a8dd295a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:06.189781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ecc36-4a2c-4230-87c9-b18a8dd295a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:06.191639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ecc36-4a2c-4230-87c9-b18a8dd295a1 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:06.209167 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3599/7174] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:06.809634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54157b-3686-4347-b354-eee6c4a79ada None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:06.866997 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:06.918965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54157b-3686-4347-b354-eee6c4a79ada None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:06.925224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:06.926159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:06.926543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:06.926920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] PATH_INFO: `/v3/users/c23cafac1ad84a2aaf7eb75182cc8232` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:06.928403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23cafac1ad84a2aaf7eb75182cc8232)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:06.930645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:07.053939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23cafac1ad84a2aaf7eb75182cc8232'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.071070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23cafac1ad84a2aaf7eb75182cc8232'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.080893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23cafac1ad84a2aaf7eb75182cc8232'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.100176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23cafac1ad84a2aaf7eb75182cc8232'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.100940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23cafac1ad84a2aaf7eb75182cc8232'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.111245 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3576/7175] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:06 2022] DELETE /identity/v3/users/c23cafac1ad84a2aaf7eb75182cc8232 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:07.113190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18995a-9826-4aaf-bb4e-e4388c3f65e5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:07.113677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18995a-9826-4aaf-bb4e-e4388c3f65e5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:07.113770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18995a-9826-4aaf-bb4e-e4388c3f65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:07.142555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5c18995a-9826-4aaf-bb4e-e4388c3f65e5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:07.144033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5c18995a-9826-4aaf-bb4e-e4388c3f65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:07.239763 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3600/7176] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:07.252398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:07.254072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:07.332817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16064fc2-9901-4800-9230-c78bb6cf90d1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:07.337619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406a95d-d4fb-45bc-8db9-b472085a266b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:07.338246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406a95d-d4fb-45bc-8db9-b472085a266b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:07.338527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406a95d-d4fb-45bc-8db9-b472085a266b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:07.338799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406a95d-d4fb-45bc-8db9-b472085a266b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:07.350124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406a95d-d4fb-45bc-8db9-b472085a266b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:07.352074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406a95d-d4fb-45bc-8db9-b472085a266b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:07.365566 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3577/7177] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:07.793748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18995a-9826-4aaf-bb4e-e4388c3f65e5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:07.795619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5c18995a-9826-4aaf-bb4e-e4388c3f65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:07.829844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18995a-9826-4aaf-bb4e-e4388c3f65e5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:07.836069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:07.837073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:07.837501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:07.837905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] PATH_INFO: `/v3/projects/842101b2cf9d4db28d33b8cdecdcb5f9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:07.841556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=842101b2cf9d4db28d33b8cdecdcb5f9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:07.844841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:07.938581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842101b2cf9d4db28d33b8cdecdcb5f9', 'request_id': 'req-0185b159-426e-45e6-9387-9519786c2840'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.950882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842101b2cf9d4db28d33b8cdecdcb5f9', 'request_id': 'req-0185b159-426e-45e6-9387-9519786c2840'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.958140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842101b2cf9d4db28d33b8cdecdcb5f9', 'request_id': 'req-0185b159-426e-45e6-9387-9519786c2840'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.983245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] The token cache is being invalidate because project 842101b2cf9d4db28d33b8cdecdcb5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:07.984922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.985969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:07.988796 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3601/7178] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:07 2022] DELETE /identity/v3/projects/842101b2cf9d4db28d33b8cdecdcb5f9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:07.992454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406a95d-d4fb-45bc-8db9-b472085a266b service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:08.006369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406a95d-d4fb-45bc-8db9-b472085a266b service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:08.101336 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:08.126276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:08.127519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:08.127843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:08.128128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] PATH_INFO: `/v3/users/fbe907d1fa614ecdb67058270565f5a2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:08.130567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe907d1fa614ecdb67058270565f5a2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:08.132935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:08.221478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe907d1fa614ecdb67058270565f5a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:08.238401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe907d1fa614ecdb67058270565f5a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:08.250947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe907d1fa614ecdb67058270565f5a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:08.273686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe907d1fa614ecdb67058270565f5a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:08.274478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06526b0f-92e3-4bce-b327-8e493176087c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe907d1fa614ecdb67058270565f5a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:08.283266 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3578/7179] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:07 2022] DELETE /identity/v3/users/fbe907d1fa614ecdb67058270565f5a2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:08.865379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:08.869918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:08.931556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b159-426e-45e6-9387-9519786c2840 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:09.023429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:09.024195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.024543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.025434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] PATH_INFO: `/v3/projects/b25c38256d994a2480070ae1495a713a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.026454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25c38256d994a2480070ae1495a713a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:09.028520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:09.032214 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:09.104470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25c38256d994a2480070ae1495a713a', 'request_id': 'req-37063a29-bbc0-4dd3-a670-046eede32aa1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:09.115970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25c38256d994a2480070ae1495a713a', 'request_id': 'req-37063a29-bbc0-4dd3-a670-046eede32aa1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:09.132569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25c38256d994a2480070ae1495a713a', 'request_id': 'req-37063a29-bbc0-4dd3-a670-046eede32aa1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:09.159527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] The token cache is being invalidate because project b25c38256d994a2480070ae1495a713a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:09.160043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:09.161400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-37063a29-bbc0-4dd3-a670-046eede32aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:09.169138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1a83-7809-4736-ab64-2c0bf79cad6f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.170017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1a83-7809-4736-ab64-2c0bf79cad6f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.170494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1a83-7809-4736-ab64-2c0bf79cad6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.179816 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3602/7180] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:08 2022] DELETE /identity/v3/projects/b25c38256d994a2480070ae1495a713a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:09.200721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5a1d1a83-7809-4736-ab64-2c0bf79cad6f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:09.202246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5a1d1a83-7809-4736-ab64-2c0bf79cad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:09.294739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef8ecd-ff1b-48e5-a761-9c9fe5743aab None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.295026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef8ecd-ff1b-48e5-a761-9c9fe5743aab None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.295309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef8ecd-ff1b-48e5-a761-9c9fe5743aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.305739 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3579/7181] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:09.333378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-94ef8ecd-ff1b-48e5-a761-9c9fe5743aab None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:09.335048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-94ef8ecd-ff1b-48e5-a761-9c9fe5743aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:09.352075 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3603/7182] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:09.359440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d1a83-7809-4736-ab64-2c0bf79cad6f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:09.387259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d1a83-7809-4736-ab64-2c0bf79cad6f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:09.400717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b157530-9874-4a8e-bf6d-3fe9f3660440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:09.401360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b157530-9874-4a8e-bf6d-3fe9f3660440 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.401642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b157530-9874-4a8e-bf6d-3fe9f3660440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.401915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b157530-9874-4a8e-bf6d-3fe9f3660440 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.402681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b157530-9874-4a8e-bf6d-3fe9f3660440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:09.403741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b157530-9874-4a8e-bf6d-3fe9f3660440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:09.407975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b157530-9874-4a8e-bf6d-3fe9f3660440 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:09.444693 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3580/7183] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:09.445612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef8ecd-ff1b-48e5-a761-9c9fe5743aab None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:09.459436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef8ecd-ff1b-48e5-a761-9c9fe5743aab None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:09.476691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bc674-f72a-4157-b671-9a38d8d6503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:09.476932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bc674-f72a-4157-b671-9a38d8d6503a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.477270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bc674-f72a-4157-b671-9a38d8d6503a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.477615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bc674-f72a-4157-b671-9a38d8d6503a admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.480940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bc674-f72a-4157-b671-9a38d8d6503a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:09.483158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bc674-f72a-4157-b671-9a38d8d6503a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:09.548071 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3604/7184] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:09 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:09.551616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b157530-9874-4a8e-bf6d-3fe9f3660440 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:09.563599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b157530-9874-4a8e-bf6d-3fe9f3660440 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:09.666426 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:09.678817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27894ace-b057-4b8f-bca4-1c3fb465a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:09.679570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27894ace-b057-4b8f-bca4-1c3fb465a43d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.679936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27894ace-b057-4b8f-bca4-1c3fb465a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.680694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27894ace-b057-4b8f-bca4-1c3fb465a43d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.681496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27894ace-b057-4b8f-bca4-1c3fb465a43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:09.683939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27894ace-b057-4b8f-bca4-1c3fb465a43d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:09.722026 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3581/7185] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:09 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:09.722450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bc674-f72a-4157-b671-9a38d8d6503a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:09.737737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bc674-f72a-4157-b671-9a38d8d6503a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:09.743493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e533860-3a1c-4962-be7e-ffca234fd872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:09.744249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e533860-3a1c-4962-be7e-ffca234fd872 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.744594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e533860-3a1c-4962-be7e-ffca234fd872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.744988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e533860-3a1c-4962-be7e-ffca234fd872 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.745941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e533860-3a1c-4962-be7e-ffca234fd872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:09.748668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e533860-3a1c-4962-be7e-ffca234fd872 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:09.771069 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3605/7186] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:09.775549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27894ace-b057-4b8f-bca4-1c3fb465a43d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:09.796964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27894ace-b057-4b8f-bca4-1c3fb465a43d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:09.803377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f075d-5ef0-4b70-99a7-10a389e43583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:09.804003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f075d-5ef0-4b70-99a7-10a389e43583 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.804284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f075d-5ef0-4b70-99a7-10a389e43583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.804557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f075d-5ef0-4b70-99a7-10a389e43583 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.805246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f075d-5ef0-4b70-99a7-10a389e43583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:09.806850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f075d-5ef0-4b70-99a7-10a389e43583 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:09.822547 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3582/7187] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:09.826948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e533860-3a1c-4962-be7e-ffca234fd872 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:09.840673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e533860-3a1c-4962-be7e-ffca234fd872 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:09.847135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e16b6-8318-45ce-ac4a-745e73775ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:09.847942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e16b6-8318-45ce-ac4a-745e73775ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.848235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e16b6-8318-45ce-ac4a-745e73775ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.848722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e16b6-8318-45ce-ac4a-745e73775ef5 admin admin] PATH_INFO: `/v3/projects/affe944466f54bb9b12bd7d767bbb0b5/users/f04288ffaec1481cb8aadfcda6813f8c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.867513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e16b6-8318-45ce-ac4a-745e73775ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affe944466f54bb9b12bd7d767bbb0b5, user_id=f04288ffaec1481cb8aadfcda6813f8c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:09.870608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e16b6-8318-45ce-ac4a-745e73775ef5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:09.897766 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3606/7188] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:09 2022] PUT /identity/v3/projects/affe944466f54bb9b12bd7d767bbb0b5/users/f04288ffaec1481cb8aadfcda6813f8c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:09.904454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db1d7b-62d9-4d60-85c2-c5f636026637 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:09.904797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db1d7b-62d9-4d60-85c2-c5f636026637 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:09.906468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db1d7b-62d9-4d60-85c2-c5f636026637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:09.955254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-21db1d7b-62d9-4d60-85c2-c5f636026637 None None] MFA Rules not processed for user `f04288ffaec1481cb8aadfcda6813f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:09.957697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-21db1d7b-62d9-4d60-85c2-c5f636026637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:10.074671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e16b6-8318-45ce-ac4a-745e73775ef5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:10.075709 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3583/7189] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:10.167139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e16b6-8318-45ce-ac4a-745e73775ef5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:10.182836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca13bdb-fe05-4b45-a787-c37ffc418a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:10.183849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca13bdb-fe05-4b45-a787-c37ffc418a43 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:10.184295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca13bdb-fe05-4b45-a787-c37ffc418a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:10.184649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca13bdb-fe05-4b45-a787-c37ffc418a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:10.186133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca13bdb-fe05-4b45-a787-c37ffc418a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:10.188365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca13bdb-fe05-4b45-a787-c37ffc418a43 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:10.227662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db1d7b-62d9-4d60-85c2-c5f636026637 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:10.228299 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3607/7190] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:10 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:10.244197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db1d7b-62d9-4d60-85c2-c5f636026637 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:10.329199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ee49-ad84-4989-94cc-bce197b00e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:10.330332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ee49-ad84-4989-94cc-bce197b00e7d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:10.330734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ee49-ad84-4989-94cc-bce197b00e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:10.331235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ee49-ad84-4989-94cc-bce197b00e7d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:10.331956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137ee49-ad84-4989-94cc-bce197b00e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:10.334560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137ee49-ad84-4989-94cc-bce197b00e7d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:10.366093 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3584/7191] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:10 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:10.370271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca13bdb-fe05-4b45-a787-c37ffc418a43 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:10.383021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca13bdb-fe05-4b45-a787-c37ffc418a43 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:10.388471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56257154-8efd-4ffd-a4ca-b8f8fc463ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:10.389388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56257154-8efd-4ffd-a4ca-b8f8fc463ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:10.389742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56257154-8efd-4ffd-a4ca-b8f8fc463ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:10.390656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56257154-8efd-4ffd-a4ca-b8f8fc463ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:10.391576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56257154-8efd-4ffd-a4ca-b8f8fc463ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:10.393567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56257154-8efd-4ffd-a4ca-b8f8fc463ef3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:10.409173 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3608/7192] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:10.413479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ee49-ad84-4989-94cc-bce197b00e7d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:10.430695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ee49-ad84-4989-94cc-bce197b00e7d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:10.446427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03533c-2bb4-4c41-ad76-aab25835ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:10.447137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03533c-2bb4-4c41-ad76-aab25835ee91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:10.447423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03533c-2bb4-4c41-ad76-aab25835ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:10.447859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03533c-2bb4-4c41-ad76-aab25835ee91 admin admin] PATH_INFO: `/v3/projects/06697e14f170421480f1ef26d55e5dff/users/db6bf0f16a6841a3bc1c10ada20ccce9/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:10.474085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03533c-2bb4-4c41-ad76-aab25835ee91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06697e14f170421480f1ef26d55e5dff, user_id=db6bf0f16a6841a3bc1c10ada20ccce9, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:10.476987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03533c-2bb4-4c41-ad76-aab25835ee91 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:10.509486 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3585/7193] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:10 2022] PUT /identity/v3/projects/06697e14f170421480f1ef26d55e5dff/users/db6bf0f16a6841a3bc1c10ada20ccce9/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:10.515325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56257154-8efd-4ffd-a4ca-b8f8fc463ef3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:10.525172 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:10.531350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56257154-8efd-4ffd-a4ca-b8f8fc463ef3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:10.613515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009ce8-f32f-4d7c-a4e1-5cbd073c351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:10.614225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009ce8-f32f-4d7c-a4e1-5cbd073c351c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:10.614618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009ce8-f32f-4d7c-a4e1-5cbd073c351c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:10.615002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009ce8-f32f-4d7c-a4e1-5cbd073c351c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:10.615722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66009ce8-f32f-4d7c-a4e1-5cbd073c351c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:10.617704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66009ce8-f32f-4d7c-a4e1-5cbd073c351c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:10.631139 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3609/7194] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:10.635569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03533c-2bb4-4c41-ad76-aab25835ee91 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:10.647662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03533c-2bb4-4c41-ad76-aab25835ee91 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:10.655062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8060f1-c9d5-4b52-addb-58589791672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:10.657122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8060f1-c9d5-4b52-addb-58589791672c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:10.657581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8060f1-c9d5-4b52-addb-58589791672c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:10.659390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8060f1-c9d5-4b52-addb-58589791672c admin admin] PATH_INFO: `/v3/projects/06697e14f170421480f1ef26d55e5dff/users/db6bf0f16a6841a3bc1c10ada20ccce9/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:10.661415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8060f1-c9d5-4b52-addb-58589791672c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06697e14f170421480f1ef26d55e5dff, user_id=db6bf0f16a6841a3bc1c10ada20ccce9, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:10.664399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8060f1-c9d5-4b52-addb-58589791672c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:10.679529 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3586/7195] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:10 2022] PUT /identity/v3/projects/06697e14f170421480f1ef26d55e5dff/users/db6bf0f16a6841a3bc1c10ada20ccce9/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:10.695832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118a49-6b34-4066-b369-18a1471f7d63 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:10.696249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118a49-6b34-4066-b369-18a1471f7d63 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:10.696766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118a49-6b34-4066-b369-18a1471f7d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:10.758613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-26118a49-6b34-4066-b369-18a1471f7d63 None None] MFA Rules not processed for user `db6bf0f16a6841a3bc1c10ada20ccce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:10.760923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-26118a49-6b34-4066-b369-18a1471f7d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:10.936168 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3610/7196] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:10.949111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8060f1-c9d5-4b52-addb-58589791672c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:10.950542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3e8060f1-c9d5-4b52-addb-58589791672c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:11.013920 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:11.077850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8060f1-c9d5-4b52-addb-58589791672c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:11.082134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf644c-29a8-46cf-a851-3ef6495089fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:11.083104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf644c-29a8-46cf-a851-3ef6495089fa service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:11.083575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf644c-29a8-46cf-a851-3ef6495089fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:11.084159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf644c-29a8-46cf-a851-3ef6495089fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:11.107971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf644c-29a8-46cf-a851-3ef6495089fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:11.110568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf644c-29a8-46cf-a851-3ef6495089fa service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:11.128740 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3587/7197] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:11.909339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118a49-6b34-4066-b369-18a1471f7d63 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:11.967143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beb597-1d00-4d17-821d-a1b2d20a7900 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:11.968096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beb597-1d00-4d17-821d-a1b2d20a7900 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:11.968668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beb597-1d00-4d17-821d-a1b2d20a7900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:12.015398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118a49-6b34-4066-b369-18a1471f7d63 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:12.019951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-31beb597-1d00-4d17-821d-a1b2d20a7900 None None] MFA Rules not processed for user `14bd2636440d4357a2dd9a8867636581`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:12.021583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-31beb597-1d00-4d17-821d-a1b2d20a7900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:12.025909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:12.026857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:12.027346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:12.027827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] PATH_INFO: `/v3/users/f04288ffaec1481cb8aadfcda6813f8c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:12.029696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04288ffaec1481cb8aadfcda6813f8c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:12.031945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:12.075452 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:12.103962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04288ffaec1481cb8aadfcda6813f8c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:12.125983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04288ffaec1481cb8aadfcda6813f8c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:12.132386 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3588/7198] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:12.137193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04288ffaec1481cb8aadfcda6813f8c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:12.146219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31beb597-1d00-4d17-821d-a1b2d20a7900 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:12.147032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04288ffaec1481cb8aadfcda6813f8c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:12.147656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-31beb597-1d00-4d17-821d-a1b2d20a7900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:12.148003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d5b99c16-3751-406d-88bf-5a3096444bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04288ffaec1481cb8aadfcda6813f8c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:12.157475 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3611/7199] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:11 2022] DELETE /identity/v3/users/f04288ffaec1481cb8aadfcda6813f8c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:12.161884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe67bbb-c132-40f2-9d4d-c893759f12ef None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:12.162247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe67bbb-c132-40f2-9d4d-c893759f12ef None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:12.162600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe67bbb-c132-40f2-9d4d-c893759f12ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:12.186318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dfe67bbb-c132-40f2-9d4d-c893759f12ef None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:12.189761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dfe67bbb-c132-40f2-9d4d-c893759f12ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:12.291796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31beb597-1d00-4d17-821d-a1b2d20a7900 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:12.300751 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3612/7200] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:12.312739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe67bbb-c132-40f2-9d4d-c893759f12ef None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:12.314252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dfe67bbb-c132-40f2-9d4d-c893759f12ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:12.385244 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:12.402808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe67bbb-c132-40f2-9d4d-c893759f12ef None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:12.407431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8e12d-cae1-4291-86ee-ef3ba0343c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:12.408072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8e12d-cae1-4291-86ee-ef3ba0343c2f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:12.408361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8e12d-cae1-4291-86ee-ef3ba0343c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:12.408662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8e12d-cae1-4291-86ee-ef3ba0343c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:12.419795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c197c-592b-492f-9466-86520551d7c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:12.420416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c197c-592b-492f-9466-86520551d7c4 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:12.420826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c197c-592b-492f-9466-86520551d7c4 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:12.421227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c197c-592b-492f-9466-86520551d7c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:12.422007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8e12d-cae1-4291-86ee-ef3ba0343c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:12.423320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-957c197c-592b-492f-9466-86520551d7c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:12.424309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8e12d-cae1-4291-86ee-ef3ba0343c2f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:12.438721 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3613/7201] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:21:12.500527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c197c-592b-492f-9466-86520551d7c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:12.502314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c197c-592b-492f-9466-86520551d7c4 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:12.527867 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3589/7202] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:21:12.992983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8e12d-cae1-4291-86ee-ef3ba0343c2f service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:12.994434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bef8e12d-cae1-4291-86ee-ef3ba0343c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:13.008595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8e12d-cae1-4291-86ee-ef3ba0343c2f service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:13.013578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:13.014383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:13.015607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:13.016497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] PATH_INFO: `/v3/projects/affe944466f54bb9b12bd7d767bbb0b5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:13.018162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=affe944466f54bb9b12bd7d767bbb0b5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:13.020394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:13.096144 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:13.105057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affe944466f54bb9b12bd7d767bbb0b5', 'request_id': 'req-ac02eb4d-b280-428f-acb6-909c6052a4c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.120100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affe944466f54bb9b12bd7d767bbb0b5', 'request_id': 'req-ac02eb4d-b280-428f-acb6-909c6052a4c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.129335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affe944466f54bb9b12bd7d767bbb0b5', 'request_id': 'req-ac02eb4d-b280-428f-acb6-909c6052a4c5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.150206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] The token cache is being invalidate because project affe944466f54bb9b12bd7d767bbb0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:13.151128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.151788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.154030 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3614/7203] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:12 2022] DELETE /identity/v3/projects/affe944466f54bb9b12bd7d767bbb0b5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:13.157931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c197c-592b-492f-9466-86520551d7c4 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:13.173860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c197c-592b-492f-9466-86520551d7c4 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:13.248561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:13.250468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:13.250760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:13.251042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] PATH_INFO: `/v3/users/db6bf0f16a6841a3bc1c10ada20ccce9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:13.252242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6bf0f16a6841a3bc1c10ada20ccce9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:13.254496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:13.322784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6bf0f16a6841a3bc1c10ada20ccce9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.337789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6bf0f16a6841a3bc1c10ada20ccce9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.347824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6bf0f16a6841a3bc1c10ada20ccce9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.356351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6bf0f16a6841a3bc1c10ada20ccce9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.357109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-140bebf6-e07b-4d7b-a8ff-e76d673c9043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6bf0f16a6841a3bc1c10ada20ccce9'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:13.364913 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3590/7204] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:13 2022] DELETE /identity/v3/users/db6bf0f16a6841a3bc1c10ada20ccce9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:13.982129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:13.984299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:13.998138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02eb4d-b280-428f-acb6-909c6052a4c5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:14.106863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:14.108165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:14.109290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:14.109879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] PATH_INFO: `/v3/projects/06697e14f170421480f1ef26d55e5dff` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:14.111273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=06697e14f170421480f1ef26d55e5dff)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:14.113863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:14.189011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06697e14f170421480f1ef26d55e5dff', 'request_id': 'req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:14.204610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06697e14f170421480f1ef26d55e5dff', 'request_id': 'req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:14.226382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06697e14f170421480f1ef26d55e5dff', 'request_id': 'req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:14.251620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] The token cache is being invalidate because project 06697e14f170421480f1ef26d55e5dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:14.251832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:14.256958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4640456d-bc4e-4d2a-93ac-17a46af9bfbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:14.258793 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3615/7205] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:13 2022] DELETE /identity/v3/projects/06697e14f170421480f1ef26d55e5dff => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:14.263763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb8498-c335-4341-b764-651dd2bde2ea None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:14.264219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb8498-c335-4341-b764-651dd2bde2ea None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:14.264313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb8498-c335-4341-b764-651dd2bde2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:14.278039 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:14.303668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a5eb8498-c335-4341-b764-651dd2bde2ea None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:14.305191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a5eb8498-c335-4341-b764-651dd2bde2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:14.493101 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3591/7206] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:14.501588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4003b18-9d8c-4946-a894-00573c96918c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:14.502155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4003b18-9d8c-4946-a894-00573c96918c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:14.502725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4003b18-9d8c-4946-a894-00573c96918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:14.568117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d4003b18-9d8c-4946-a894-00573c96918c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:14.571151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d4003b18-9d8c-4946-a894-00573c96918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:14.594186 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3616/7207] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:14.599197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb8498-c335-4341-b764-651dd2bde2ea None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:14.614027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb8498-c335-4341-b764-651dd2bde2ea None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:14.628972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096c921-dc35-43bd-8dda-217ea39d655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:14.629637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096c921-dc35-43bd-8dda-217ea39d655a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:14.630026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096c921-dc35-43bd-8dda-217ea39d655a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:14.630407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096c921-dc35-43bd-8dda-217ea39d655a admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:14.631192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096c921-dc35-43bd-8dda-217ea39d655a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:14.633062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096c921-dc35-43bd-8dda-217ea39d655a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:14.634851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096c921-dc35-43bd-8dda-217ea39d655a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:14.670286 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3592/7208] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:14.675027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4003b18-9d8c-4946-a894-00573c96918c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:14.685904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4003b18-9d8c-4946-a894-00573c96918c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:14.694209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c34d7-c8a1-413f-83e0-b64a64d0e11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:14.694938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c34d7-c8a1-413f-83e0-b64a64d0e11d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:14.695292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c34d7-c8a1-413f-83e0-b64a64d0e11d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:14.695636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c34d7-c8a1-413f-83e0-b64a64d0e11d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:14.696354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c34d7-c8a1-413f-83e0-b64a64d0e11d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:14.698402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c34d7-c8a1-413f-83e0-b64a64d0e11d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:14.748480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096c921-dc35-43bd-8dda-217ea39d655a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:14.749013 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3617/7209] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:14 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:14.759773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096c921-dc35-43bd-8dda-217ea39d655a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:14.976340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9553b-26b2-4ba3-9294-b012d8c636fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:14.976340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9553b-26b2-4ba3-9294-b012d8c636fc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:14.976340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9553b-26b2-4ba3-9294-b012d8c636fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:14.976340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9553b-26b2-4ba3-9294-b012d8c636fc admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:14.976983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9553b-26b2-4ba3-9294-b012d8c636fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:14.980014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9553b-26b2-4ba3-9294-b012d8c636fc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:15.030860 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3593/7210] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:14 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:15.034942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c34d7-c8a1-413f-83e0-b64a64d0e11d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:15.057080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c34d7-c8a1-413f-83e0-b64a64d0e11d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:15.075278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce416d-7fdd-4ffe-9c05-383f91d6ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:15.075931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce416d-7fdd-4ffe-9c05-383f91d6ba99 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:15.076214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce416d-7fdd-4ffe-9c05-383f91d6ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:15.076486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce416d-7fdd-4ffe-9c05-383f91d6ba99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:15.077258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce416d-7fdd-4ffe-9c05-383f91d6ba99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:15.081159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce416d-7fdd-4ffe-9c05-383f91d6ba99 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:15.123751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9553b-26b2-4ba3-9294-b012d8c636fc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:15.127716 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3618/7211] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:15.156903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9553b-26b2-4ba3-9294-b012d8c636fc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:15.164994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c5def-acd9-408c-ac67-4c279929b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:15.165887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c5def-acd9-408c-ac67-4c279929b6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:15.166551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c5def-acd9-408c-ac67-4c279929b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:15.167053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c5def-acd9-408c-ac67-4c279929b6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:15.168159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c5def-acd9-408c-ac67-4c279929b6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:15.173165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c5def-acd9-408c-ac67-4c279929b6f7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:15.211615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3594/7212] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:15.212309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce416d-7fdd-4ffe-9c05-383f91d6ba99 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:15.225973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce416d-7fdd-4ffe-9c05-383f91d6ba99 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:15.235277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99ab7e-5c0b-498a-90a3-51589fb3b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:15.236421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ab7e-5c0b-498a-90a3-51589fb3b97b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:15.236943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ab7e-5c0b-498a-90a3-51589fb3b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:15.237448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ab7e-5c0b-498a-90a3-51589fb3b97b admin admin] PATH_INFO: `/v3/projects/7e6a9b2ce9724525a7a748d01be70ab2/users/790d3a57544d4e97a737a2fb9624a781/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:15.279896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99ab7e-5c0b-498a-90a3-51589fb3b97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6a9b2ce9724525a7a748d01be70ab2, user_id=790d3a57544d4e97a737a2fb9624a781, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:15.284270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99ab7e-5c0b-498a-90a3-51589fb3b97b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:15.288293 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:15.309393 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3619/7213] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:15 2022] PUT /identity/v3/projects/7e6a9b2ce9724525a7a748d01be70ab2/users/790d3a57544d4e97a737a2fb9624a781/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:15.320495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781304f5-c719-42d6-b654-28a755fc518f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:15.321058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781304f5-c719-42d6-b654-28a755fc518f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:15.321336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781304f5-c719-42d6-b654-28a755fc518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:15.389483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-781304f5-c719-42d6-b654-28a755fc518f None None] MFA Rules not processed for user `790d3a57544d4e97a737a2fb9624a781`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:15.394193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-781304f5-c719-42d6-b654-28a755fc518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:15.573027 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:15.581902 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3595/7214] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:15.586752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99ab7e-5c0b-498a-90a3-51589fb3b97b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:15.680300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99ab7e-5c0b-498a-90a3-51589fb3b97b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:15.687955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c056-9303-433a-bd37-068f78781687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:15.688743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c056-9303-433a-bd37-068f78781687 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:15.689048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c056-9303-433a-bd37-068f78781687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:15.689362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c056-9303-433a-bd37-068f78781687 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:15.690016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c056-9303-433a-bd37-068f78781687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:15.691995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c056-9303-433a-bd37-068f78781687 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:15.746054 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3620/7215] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:15 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:15.751416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781304f5-c719-42d6-b654-28a755fc518f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:15.775840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781304f5-c719-42d6-b654-28a755fc518f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:15.862208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887421f3-aa53-4601-a39a-78587f9b9be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:15.864470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887421f3-aa53-4601-a39a-78587f9b9be8 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:15.864991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887421f3-aa53-4601-a39a-78587f9b9be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:15.865139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887421f3-aa53-4601-a39a-78587f9b9be8 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:15.866073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887421f3-aa53-4601-a39a-78587f9b9be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:15.870118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887421f3-aa53-4601-a39a-78587f9b9be8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:15.918471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c056-9303-433a-bd37-068f78781687 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:15.918746 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3596/7216] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:15 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:15.931483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c056-9303-433a-bd37-068f78781687 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:15.939186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9238fbb-6b73-4da4-b2c7-c6e8866601e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:15.940068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9238fbb-6b73-4da4-b2c7-c6e8866601e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:15.940449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9238fbb-6b73-4da4-b2c7-c6e8866601e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:15.940861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9238fbb-6b73-4da4-b2c7-c6e8866601e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:15.941680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9238fbb-6b73-4da4-b2c7-c6e8866601e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:15.943725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9238fbb-6b73-4da4-b2c7-c6e8866601e0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:15.987245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887421f3-aa53-4601-a39a-78587f9b9be8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:15.996975 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3621/7217] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:16.002746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887421f3-aa53-4601-a39a-78587f9b9be8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:16.008806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455dc7a-0c9a-4e95-9f0b-bbeb4ea9138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:16.011029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455dc7a-0c9a-4e95-9f0b-bbeb4ea9138c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:16.011564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455dc7a-0c9a-4e95-9f0b-bbeb4ea9138c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:16.011846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455dc7a-0c9a-4e95-9f0b-bbeb4ea9138c admin admin] PATH_INFO: `/v3/projects/ef8b20974a204742ace39be46073555a/users/ca1482c5813b4499a4681a00c04ad183/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:16.043477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455dc7a-0c9a-4e95-9f0b-bbeb4ea9138c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8b20974a204742ace39be46073555a, user_id=ca1482c5813b4499a4681a00c04ad183, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:16.048373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455dc7a-0c9a-4e95-9f0b-bbeb4ea9138c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:16.065734 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3597/7218] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:15 2022] PUT /identity/v3/projects/ef8b20974a204742ace39be46073555a/users/ca1482c5813b4499a4681a00c04ad183/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:16.069499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9238fbb-6b73-4da4-b2c7-c6e8866601e0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:16.082150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9238fbb-6b73-4da4-b2c7-c6e8866601e0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:16.150176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cee2b-f826-4886-adc3-d87ea50c43eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:16.150890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cee2b-f826-4886-adc3-d87ea50c43eb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:16.151080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cee2b-f826-4886-adc3-d87ea50c43eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:16.151352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cee2b-f826-4886-adc3-d87ea50c43eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:16.152181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cee2b-f826-4886-adc3-d87ea50c43eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:16.153915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cee2b-f826-4886-adc3-d87ea50c43eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:16.165435 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3622/7219] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:16.169416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455dc7a-0c9a-4e95-9f0b-bbeb4ea9138c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:16.181188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455dc7a-0c9a-4e95-9f0b-bbeb4ea9138c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:16.186370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ea8b-1f5f-434c-893b-0f6e3880ec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:16.187792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ea8b-1f5f-434c-893b-0f6e3880ec71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:16.188145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ea8b-1f5f-434c-893b-0f6e3880ec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:16.188495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ea8b-1f5f-434c-893b-0f6e3880ec71 admin admin] PATH_INFO: `/v3/projects/ef8b20974a204742ace39be46073555a/users/ca1482c5813b4499a4681a00c04ad183/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:16.190601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ea8b-1f5f-434c-893b-0f6e3880ec71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8b20974a204742ace39be46073555a, user_id=ca1482c5813b4499a4681a00c04ad183, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:16.193477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ea8b-1f5f-434c-893b-0f6e3880ec71 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:16.211959 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3598/7220] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:16 2022] PUT /identity/v3/projects/ef8b20974a204742ace39be46073555a/users/ca1482c5813b4499a4681a00c04ad183/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:16.223953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fab8d-1a2d-4074-92b6-d860020350da None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:16.224293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fab8d-1a2d-4074-92b6-d860020350da None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:16.224515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fab8d-1a2d-4074-92b6-d860020350da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:16.262905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-932fab8d-1a2d-4074-92b6-d860020350da None None] MFA Rules not processed for user `ca1482c5813b4499a4681a00c04ad183`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:16.265356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-932fab8d-1a2d-4074-92b6-d860020350da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:16.337304 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:16.362093 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3623/7221] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:16.368911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ea8b-1f5f-434c-893b-0f6e3880ec71 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:16.370740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8508ea8b-1f5f-434c-893b-0f6e3880ec71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:16.467551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ea8b-1f5f-434c-893b-0f6e3880ec71 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:16.474310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f07eb-8f04-4d96-bd60-5013ea4b7b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:16.475319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f07eb-8f04-4d96-bd60-5013ea4b7b8d service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:16.475782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f07eb-8f04-4d96-bd60-5013ea4b7b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:16.476207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f07eb-8f04-4d96-bd60-5013ea4b7b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:16.488826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f07eb-8f04-4d96-bd60-5013ea4b7b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:16.490389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f07eb-8f04-4d96-bd60-5013ea4b7b8d service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:16.504892 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3599/7222] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:16.589360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fab8d-1a2d-4074-92b6-d860020350da None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:16.613362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fab8d-1a2d-4074-92b6-d860020350da None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:16.619718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc673-c34c-476d-b3ba-a32ec950d9ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:16.621389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc673-c34c-476d-b3ba-a32ec950d9ea service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:16.622817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc673-c34c-476d-b3ba-a32ec950d9ea service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:16.623494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc673-c34c-476d-b3ba-a32ec950d9ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:16.724835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc673-c34c-476d-b3ba-a32ec950d9ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:16.729536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc673-c34c-476d-b3ba-a32ec950d9ea service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:16.744917 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3624/7223] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:17.667357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f07eb-8f04-4d96-bd60-5013ea4b7b8d service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:17.669310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ca6f07eb-8f04-4d96-bd60-5013ea4b7b8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:17.744560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc673-c34c-476d-b3ba-a32ec950d9ea service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:17.747041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-649bc673-c34c-476d-b3ba-a32ec950d9ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:17.753873 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:17.780430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f07eb-8f04-4d96-bd60-5013ea4b7b8d service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:17.787149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:17.788179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:17.788465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:17.788780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] PATH_INFO: `/v3/users/96c76ec5bdfb4d38b2e3c76abebd993b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:17.790773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c76ec5bdfb4d38b2e3c76abebd993b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:17.793188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:17.862205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc673-c34c-476d-b3ba-a32ec950d9ea service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:17.862669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c76ec5bdfb4d38b2e3c76abebd993b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.867426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:17.868132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:17.868790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:17.868959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] PATH_INFO: `/v3/users/14bd2636440d4357a2dd9a8867636581` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:17.870016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bd2636440d4357a2dd9a8867636581)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:17.871958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:17.883720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c76ec5bdfb4d38b2e3c76abebd993b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.894034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c76ec5bdfb4d38b2e3c76abebd993b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.904229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c76ec5bdfb4d38b2e3c76abebd993b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.905039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f3222dea-3a88-46aa-b4c2-ef094d6f20d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c76ec5bdfb4d38b2e3c76abebd993b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.916010 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3600/7224] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:17 2022] DELETE /identity/v3/users/96c76ec5bdfb4d38b2e3c76abebd993b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:17.920646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e5c3-40e1-4bbd-8c17-754040ef4e7b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:17.921722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e5c3-40e1-4bbd-8c17-754040ef4e7b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:17.921970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e5c3-40e1-4bbd-8c17-754040ef4e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:17.933212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bd2636440d4357a2dd9a8867636581'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.946603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4903e5c3-40e1-4bbd-8c17-754040ef4e7b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:17.948019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4903e5c3-40e1-4bbd-8c17-754040ef4e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:17.952322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bd2636440d4357a2dd9a8867636581'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.966827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bd2636440d4357a2dd9a8867636581'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.977208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bd2636440d4357a2dd9a8867636581'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.978490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bd2636440d4357a2dd9a8867636581'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:17.986192 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3625/7225] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:17 2022] DELETE /identity/v3/users/14bd2636440d4357a2dd9a8867636581 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:18.017148 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3601/7226] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:18.026966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:18.028450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:18.040276 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:18.116875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680a407-bf0a-44a7-bb7c-3d2bd9d48fd7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:18.121588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9f976-ae79-4e2a-b27b-788ffc001c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:18.122611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f976-ae79-4e2a-b27b-788ffc001c7a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:18.122957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f976-ae79-4e2a-b27b-788ffc001c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:18.123301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f976-ae79-4e2a-b27b-788ffc001c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:18.214022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e5c3-40e1-4bbd-8c17-754040ef4e7b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:18.215825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4903e5c3-40e1-4bbd-8c17-754040ef4e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:18.236569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e5c3-40e1-4bbd-8c17-754040ef4e7b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:18.259506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9f976-ae79-4e2a-b27b-788ffc001c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:18.262739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9f976-ae79-4e2a-b27b-788ffc001c7a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:18.286885 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3626/7227] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:18.333771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:18.334419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:18.334702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:18.334972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] PATH_INFO: `/v3/projects/f06e14eb8ea544e09633e2d786c67143` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:18.336101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06e14eb8ea544e09633e2d786c67143)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:18.338084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:18.369506 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:18.431701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06e14eb8ea544e09633e2d786c67143', 'request_id': 'req-a9e212c0-dc19-4094-8975-b132fa60679b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.445722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06e14eb8ea544e09633e2d786c67143', 'request_id': 'req-a9e212c0-dc19-4094-8975-b132fa60679b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.456980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06e14eb8ea544e09633e2d786c67143', 'request_id': 'req-a9e212c0-dc19-4094-8975-b132fa60679b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.470727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] The token cache is being invalidate because project f06e14eb8ea544e09633e2d786c67143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:18.471228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.473063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a9e212c0-dc19-4094-8975-b132fa60679b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.475230 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3602/7228] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:18 2022] DELETE /identity/v3/projects/f06e14eb8ea544e09633e2d786c67143 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:18.486165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0c72-6734-4897-b500-0de9a5fc8130 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:18.486649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0c72-6734-4897-b500-0de9a5fc8130 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:18.487105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0c72-6734-4897-b500-0de9a5fc8130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:18.528538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bf6d0c72-6734-4897-b500-0de9a5fc8130 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:18.529778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bf6d0c72-6734-4897-b500-0de9a5fc8130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:18.636105 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3627/7229] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:18.644539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160ac56-1499-4472-847e-37c6c26a1118 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:18.644852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160ac56-1499-4472-847e-37c6c26a1118 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:18.645124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160ac56-1499-4472-847e-37c6c26a1118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:18.672364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4160ac56-1499-4472-847e-37c6c26a1118 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:18.673370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4160ac56-1499-4472-847e-37c6c26a1118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:18.688030 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3603/7230] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:18.688245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d0c72-6734-4897-b500-0de9a5fc8130 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:18.700195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d0c72-6734-4897-b500-0de9a5fc8130 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:18.708978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3cbdc-f126-4d38-bea4-214fbdc697eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:18.711881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3cbdc-f126-4d38-bea4-214fbdc697eb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:18.712549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3cbdc-f126-4d38-bea4-214fbdc697eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:18.712702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3cbdc-f126-4d38-bea4-214fbdc697eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:18.713291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3cbdc-f126-4d38-bea4-214fbdc697eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:18.713655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3cbdc-f126-4d38-bea4-214fbdc697eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:18.717896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3cbdc-f126-4d38-bea4-214fbdc697eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:18.749798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160ac56-1499-4472-847e-37c6c26a1118 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:18.751254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4160ac56-1499-4472-847e-37c6c26a1118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:18.754945 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3628/7231] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:21:18.756009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3cbdc-f126-4d38-bea4-214fbdc697eb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:18.767775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3cbdc-f126-4d38-bea4-214fbdc697eb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:18.770315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160ac56-1499-4472-847e-37c6c26a1118 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:18.780593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:18.782101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:18.782222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11174bf-f0a0-4a57-b486-c30b19e2ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:18.782384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:18.782805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] PATH_INFO: `/v3/projects/edc183b18966444da97475a46c4e76d5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:18.782998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11174bf-f0a0-4a57-b486-c30b19e2ed52 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:18.783824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11174bf-f0a0-4a57-b486-c30b19e2ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:18.784111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11174bf-f0a0-4a57-b486-c30b19e2ed52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:18.784220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc183b18966444da97475a46c4e76d5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:18.785250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11174bf-f0a0-4a57-b486-c30b19e2ed52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:18.786284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:18.787378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11174bf-f0a0-4a57-b486-c30b19e2ed52 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:18.825073 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3629/7232] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:18 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:18.829076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11174bf-f0a0-4a57-b486-c30b19e2ed52 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:18.867026 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:18.879038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc183b18966444da97475a46c4e76d5', 'request_id': 'req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.891672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc183b18966444da97475a46c4e76d5', 'request_id': 'req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.900791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc183b18966444da97475a46c4e76d5', 'request_id': 'req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.922777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] The token cache is being invalidate because project edc183b18966444da97475a46c4e76d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:18.923578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.924571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45095101-32a9-4e0e-a2b9-7d81cf77cf4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:18.931265 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3604/7233] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:18 2022] DELETE /identity/v3/projects/edc183b18966444da97475a46c4e76d5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:18.933291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6313a-b2b3-4f25-a413-17133a17aeb8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:18.933847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6313a-b2b3-4f25-a413-17133a17aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:18.934493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6313a-b2b3-4f25-a413-17133a17aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:18.936085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11174bf-f0a0-4a57-b486-c30b19e2ed52 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:18.962655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-aed6313a-b2b3-4f25-a413-17133a17aeb8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:18.964006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aed6313a-b2b3-4f25-a413-17133a17aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:19.042649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabd646-78b5-43c3-9e27-5fb4621831db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.043133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabd646-78b5-43c3-9e27-5fb4621831db admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.043420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabd646-78b5-43c3-9e27-5fb4621831db admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.043682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabd646-78b5-43c3-9e27-5fb4621831db admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.044333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabd646-78b5-43c3-9e27-5fb4621831db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.046466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabd646-78b5-43c3-9e27-5fb4621831db admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.080236 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3630/7234] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:18 2022] POST /identity/v3/users => generated 301 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:19.081583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabd646-78b5-43c3-9e27-5fb4621831db admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.097526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aaabd646-78b5-43c3-9e27-5fb4621831db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:19.115218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabd646-78b5-43c3-9e27-5fb4621831db admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.126789 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3605/7235] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:19.127886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7861a6-bbe4-4da3-86e7-82ae8dcbcea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.127886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7861a6-bbe4-4da3-86e7-82ae8dcbcea4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.127886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7861a6-bbe4-4da3-86e7-82ae8dcbcea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.127886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7861a6-bbe4-4da3-86e7-82ae8dcbcea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.128186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7861a6-bbe4-4da3-86e7-82ae8dcbcea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.128186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7861a6-bbe4-4da3-86e7-82ae8dcbcea4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.130773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58027-23ab-459a-8d17-4af7b6fdcb59 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.131104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58027-23ab-459a-8d17-4af7b6fdcb59 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.131390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58027-23ab-459a-8d17-4af7b6fdcb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.142761 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3631/7236] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:19.145068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7861a6-bbe4-4da3-86e7-82ae8dcbcea4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.157319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7861a6-bbe4-4da3-86e7-82ae8dcbcea4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.164188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-29c58027-23ab-459a-8d17-4af7b6fdcb59 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:19.164899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f800a-0921-455f-a991-674392e23565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.165554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f800a-0921-455f-a991-674392e23565 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.165663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-29c58027-23ab-459a-8d17-4af7b6fdcb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:19.165910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f800a-0921-455f-a991-674392e23565 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.166159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f800a-0921-455f-a991-674392e23565 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.166938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f800a-0921-455f-a991-674392e23565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.168769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f800a-0921-455f-a991-674392e23565 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.176156 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3606/7237] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:19.180491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c58027-23ab-459a-8d17-4af7b6fdcb59 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.180889 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3632/7238] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:19.184764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f800a-0921-455f-a991-674392e23565 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.191398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c58027-23ab-459a-8d17-4af7b6fdcb59 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.195395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f800a-0921-455f-a991-674392e23565 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.196132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c9447-b307-46af-86ac-5eee06a76c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.196766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c9447-b307-46af-86ac-5eee06a76c18 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.197049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c9447-b307-46af-86ac-5eee06a76c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.197337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c9447-b307-46af-86ac-5eee06a76c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.197983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c9447-b307-46af-86ac-5eee06a76c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:19.198287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c9447-b307-46af-86ac-5eee06a76c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.199906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c9447-b307-46af-86ac-5eee06a76c18 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.200197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d03045-21fa-4283-9b1b-f8f7f2c06fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.200870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d03045-21fa-4283-9b1b-f8f7f2c06fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.201152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d03045-21fa-4283-9b1b-f8f7f2c06fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.201456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d03045-21fa-4283-9b1b-f8f7f2c06fe8 admin admin] PATH_INFO: `/v3/projects/aef7f41b37a948cbbb60562a4d2043ee/users/12ca2587a56040bc91744caec39c62ca/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.209949 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:19.216698 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3607/7239] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:21:19.218392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c9447-b307-46af-86ac-5eee06a76c18 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.221800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d03045-21fa-4283-9b1b-f8f7f2c06fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef7f41b37a948cbbb60562a4d2043ee, user_id=12ca2587a56040bc91744caec39c62ca, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.224518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d03045-21fa-4283-9b1b-f8f7f2c06fe8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.228542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c9447-b307-46af-86ac-5eee06a76c18 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.234767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968940f-a42a-43fc-abad-ebc599cb4675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.235365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968940f-a42a-43fc-abad-ebc599cb4675 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.235646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968940f-a42a-43fc-abad-ebc599cb4675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.235927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968940f-a42a-43fc-abad-ebc599cb4675 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.236557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968940f-a42a-43fc-abad-ebc599cb4675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.238482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968940f-a42a-43fc-abad-ebc599cb4675 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.239116 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3633/7240] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:19 2022] PUT /identity/v3/projects/aef7f41b37a948cbbb60562a4d2043ee/users/12ca2587a56040bc91744caec39c62ca/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:19.250815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d9d38-3e4a-4610-9882-af8192fabbc3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.251156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d9d38-3e4a-4610-9882-af8192fabbc3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.251460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d9d38-3e4a-4610-9882-af8192fabbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.270683 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3608/7241] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:19.272134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968940f-a42a-43fc-abad-ebc599cb4675 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.281858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-490d9d38-3e4a-4610-9882-af8192fabbc3 None None] MFA Rules not processed for user `12ca2587a56040bc91744caec39c62ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:19.283089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-490d9d38-3e4a-4610-9882-af8192fabbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:19.335020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968940f-a42a-43fc-abad-ebc599cb4675 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.339782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4bb5a-629b-4d7e-b176-f876b24062c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.340389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4bb5a-629b-4d7e-b176-f876b24062c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.340699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4bb5a-629b-4d7e-b176-f876b24062c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.340978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4bb5a-629b-4d7e-b176-f876b24062c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.341608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4bb5a-629b-4d7e-b176-f876b24062c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.343786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4bb5a-629b-4d7e-b176-f876b24062c7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.349753 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3634/7242] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:19.354139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d9d38-3e4a-4610-9882-af8192fabbc3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.361838 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:19.367824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d9d38-3e4a-4610-9882-af8192fabbc3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.368993 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3609/7243] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:19.375811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a48af-ff5c-4f4d-b785-352fe5ff8136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.376542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a48af-ff5c-4f4d-b785-352fe5ff8136 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.376876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a48af-ff5c-4f4d-b785-352fe5ff8136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.377158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a48af-ff5c-4f4d-b785-352fe5ff8136 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.377796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a48af-ff5c-4f4d-b785-352fe5ff8136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.379725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a48af-ff5c-4f4d-b785-352fe5ff8136 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.385516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4bb5a-629b-4d7e-b176-f876b24062c7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.398195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4bb5a-629b-4d7e-b176-f876b24062c7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.405315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6901e-74dd-4287-ad5a-3e31207b4d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.405933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6901e-74dd-4287-ad5a-3e31207b4d91 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.406211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6901e-74dd-4287-ad5a-3e31207b4d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.406505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6901e-74dd-4287-ad5a-3e31207b4d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.407115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6901e-74dd-4287-ad5a-3e31207b4d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.408962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6901e-74dd-4287-ad5a-3e31207b4d91 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.414025 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3635/7244] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/projects => generated 401 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:19.415670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a48af-ff5c-4f4d-b785-352fe5ff8136 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.425674 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3610/7245] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:19.429891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6901e-74dd-4287-ad5a-3e31207b4d91 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.441430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6901e-74dd-4287-ad5a-3e31207b4d91 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.502415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a48af-ff5c-4f4d-b785-352fe5ff8136 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.508076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062d31f-d5a9-4a36-99b2-c27ef89bec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.508811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062d31f-d5a9-4a36-99b2-c27ef89bec78 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.509000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062d31f-d5a9-4a36-99b2-c27ef89bec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.509269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062d31f-d5a9-4a36-99b2-c27ef89bec78 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.509994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062d31f-d5a9-4a36-99b2-c27ef89bec78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.511930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062d31f-d5a9-4a36-99b2-c27ef89bec78 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.514992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8254ce6-1d5a-4ced-ae7f-f170b6566ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.515792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8254ce6-1d5a-4ced-ae7f-f170b6566ddb admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.516080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8254ce6-1d5a-4ced-ae7f-f170b6566ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.516352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8254ce6-1d5a-4ced-ae7f-f170b6566ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.517028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8254ce6-1d5a-4ced-ae7f-f170b6566ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.518661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8254ce6-1d5a-4ced-ae7f-f170b6566ddb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.535575 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3611/7246] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:19.537370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8254ce6-1d5a-4ced-ae7f-f170b6566ddb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.538474 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3636/7247] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/users => generated 307 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:19.542246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062d31f-d5a9-4a36-99b2-c27ef89bec78 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.549060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8254ce6-1d5a-4ced-ae7f-f170b6566ddb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.553427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062d31f-d5a9-4a36-99b2-c27ef89bec78 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.564853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde971f-31bd-40e0-a4b1-7958e2efa899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.564853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde971f-31bd-40e0-a4b1-7958e2efa899 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.564853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde971f-31bd-40e0-a4b1-7958e2efa899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.564853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde971f-31bd-40e0-a4b1-7958e2efa899 admin admin] PATH_INFO: `/v3/projects/85f9ba3495ea494cbc3bb25587a5d4f5/users/699c843eed26438bbc9ef7508bcbad25/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.565348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab760e33-3b32-43ce-a12b-1d5c2bd83a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.565348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab760e33-3b32-43ce-a12b-1d5c2bd83a15 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.565348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab760e33-3b32-43ce-a12b-1d5c2bd83a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.565348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab760e33-3b32-43ce-a12b-1d5c2bd83a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.565632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab760e33-3b32-43ce-a12b-1d5c2bd83a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.565632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab760e33-3b32-43ce-a12b-1d5c2bd83a15 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.573409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde971f-31bd-40e0-a4b1-7958e2efa899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f9ba3495ea494cbc3bb25587a5d4f5, user_id=699c843eed26438bbc9ef7508bcbad25, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.576594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde971f-31bd-40e0-a4b1-7958e2efa899 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.577703 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3637/7248] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:19.581912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab760e33-3b32-43ce-a12b-1d5c2bd83a15 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.593582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab760e33-3b32-43ce-a12b-1d5c2bd83a15 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.595342 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3612/7249] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:19 2022] PUT /identity/v3/projects/85f9ba3495ea494cbc3bb25587a5d4f5/users/699c843eed26438bbc9ef7508bcbad25/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:19.605517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7343-51ae-4b1b-b115-cb50b4c0533c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.605809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7343-51ae-4b1b-b115-cb50b4c0533c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.606274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7343-51ae-4b1b-b115-cb50b4c0533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.638105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2d0b7343-51ae-4b1b-b115-cb50b4c0533c None None] MFA Rules not processed for user `699c843eed26438bbc9ef7508bcbad25`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:19.639332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2d0b7343-51ae-4b1b-b115-cb50b4c0533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:19.657813 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:19.658877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050972db-77b7-4791-b1fb-ca70edda6803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.659542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050972db-77b7-4791-b1fb-ca70edda6803 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.659819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050972db-77b7-4791-b1fb-ca70edda6803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.660094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050972db-77b7-4791-b1fb-ca70edda6803 admin admin] PATH_INFO: `/v3/projects/297cd6e52ebb41b288cda71a47b0f6f1/users/713f0d3ad53b49dcaccc6f4417bd83af/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.681950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050972db-77b7-4791-b1fb-ca70edda6803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297cd6e52ebb41b288cda71a47b0f6f1, user_id=713f0d3ad53b49dcaccc6f4417bd83af, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.684652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050972db-77b7-4791-b1fb-ca70edda6803 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.699413 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3638/7250] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:19 2022] PUT /identity/v3/projects/297cd6e52ebb41b288cda71a47b0f6f1/users/713f0d3ad53b49dcaccc6f4417bd83af/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:19.703879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050972db-77b7-4791-b1fb-ca70edda6803 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.719924 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3613/7251] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:19.724488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7343-51ae-4b1b-b115-cb50b4c0533c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.734807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7343-51ae-4b1b-b115-cb50b4c0533c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.753023 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:19.771944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050972db-77b7-4791-b1fb-ca70edda6803 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.776827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae5a2e-28e8-4468-bdab-76e11ed85dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.777463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5a2e-28e8-4468-bdab-76e11ed85dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.777725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5a2e-28e8-4468-bdab-76e11ed85dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.778000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5a2e-28e8-4468-bdab-76e11ed85dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.778639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae5a2e-28e8-4468-bdab-76e11ed85dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.780403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae5a2e-28e8-4468-bdab-76e11ed85dc6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.793659 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3639/7252] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:19.794633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae5a2e-28e8-4468-bdab-76e11ed85dc6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.800959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec2e17-4562-4f6b-b90a-ef1d93f6f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.801597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec2e17-4562-4f6b-b90a-ef1d93f6f6ee admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.801898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec2e17-4562-4f6b-b90a-ef1d93f6f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.802307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec2e17-4562-4f6b-b90a-ef1d93f6f6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.802930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec2e17-4562-4f6b-b90a-ef1d93f6f6ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.804358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae5a2e-28e8-4468-bdab-76e11ed85dc6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.804844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec2e17-4562-4f6b-b90a-ef1d93f6f6ee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.809146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955eab96-e909-4b56-813a-afc41dffd512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.809791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eab96-e909-4b56-813a-afc41dffd512 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.810317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eab96-e909-4b56-813a-afc41dffd512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.810608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eab96-e909-4b56-813a-afc41dffd512 admin admin] PATH_INFO: `/v3/projects/297cd6e52ebb41b288cda71a47b0f6f1/users/713f0d3ad53b49dcaccc6f4417bd83af/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.813196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955eab96-e909-4b56-813a-afc41dffd512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297cd6e52ebb41b288cda71a47b0f6f1, user_id=713f0d3ad53b49dcaccc6f4417bd83af, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.815856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955eab96-e909-4b56-813a-afc41dffd512 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.826756 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3640/7253] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:19 2022] PUT /identity/v3/projects/297cd6e52ebb41b288cda71a47b0f6f1/users/713f0d3ad53b49dcaccc6f4417bd83af/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:19.836442 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3614/7254] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:19.837512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec2e17-4562-4f6b-b90a-ef1d93f6f6ee admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.837863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d83a5d-d7c6-4202-8e7a-83f031ae9cb4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.838152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d83a5d-d7c6-4202-8e7a-83f031ae9cb4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.838432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d83a5d-d7c6-4202-8e7a-83f031ae9cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.868442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a8d83a5d-d7c6-4202-8e7a-83f031ae9cb4 None None] MFA Rules not processed for user `713f0d3ad53b49dcaccc6f4417bd83af`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:19.869765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a8d83a5d-d7c6-4202-8e7a-83f031ae9cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:19.901102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec2e17-4562-4f6b-b90a-ef1d93f6f6ee admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.906478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff518d9-8663-4bad-bf74-4624255cc9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.907096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff518d9-8663-4bad-bf74-4624255cc9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.907377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff518d9-8663-4bad-bf74-4624255cc9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.907778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff518d9-8663-4bad-bf74-4624255cc9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.908411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff518d9-8663-4bad-bf74-4624255cc9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.910366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff518d9-8663-4bad-bf74-4624255cc9e6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.933495 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3615/7255] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:19.938072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff518d9-8663-4bad-bf74-4624255cc9e6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.942061 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3641/7256] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:19.946881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d83a5d-d7c6-4202-8e7a-83f031ae9cb4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.948754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff518d9-8663-4bad-bf74-4624255cc9e6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.953847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d542446-9765-4b97-b81f-8d59a4e992fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.954515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d542446-9765-4b97-b81f-8d59a4e992fa admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.955053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d542446-9765-4b97-b81f-8d59a4e992fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.955299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d542446-9765-4b97-b81f-8d59a4e992fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.956080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d542446-9765-4b97-b81f-8d59a4e992fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.956229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d83a5d-d7c6-4202-8e7a-83f031ae9cb4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.957963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d542446-9765-4b97-b81f-8d59a4e992fa admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.961560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c856271-8460-43d4-af4b-f58426f21a52 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713f0d3ad53b49dcaccc6f4417bd83af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297cd6e52ebb41b288cda71a47b0f6f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.961946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c856271-8460-43d4-af4b-f58426f21a52 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.962231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c856271-8460-43d4-af4b-f58426f21a52 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.962512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c856271-8460-43d4-af4b-f58426f21a52 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.963180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c856271-8460-43d4-af4b-f58426f21a52 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:19.964823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c856271-8460-43d4-af4b-f58426f21a52 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:19.970001 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3616/7257] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:19.974810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d542446-9765-4b97-b81f-8d59a4e992fa admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.984426 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3642/7258] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:21:19 2022] POST /identity/v3/roles => generated 238 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:19.985495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c856271-8460-43d4-af4b-f58426f21a52 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:19.986432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d542446-9765-4b97-b81f-8d59a4e992fa admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:19.991559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586e7bc-ced3-4a98-8f02-21b792ce2514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:19.992991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586e7bc-ced3-4a98-8f02-21b792ce2514 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:19.993292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586e7bc-ced3-4a98-8f02-21b792ce2514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:19.993577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586e7bc-ced3-4a98-8f02-21b792ce2514 admin admin] PATH_INFO: `/v3/projects/b78e4afa8ee34ced91535e464182a193/users/80189d2fa13e448e943eb4fdfe3a3aef/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:19.997265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c856271-8460-43d4-af4b-f58426f21a52 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:20.002082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57881b06-9459-48b0-baa2-a2b0faee7428 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713f0d3ad53b49dcaccc6f4417bd83af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297cd6e52ebb41b288cda71a47b0f6f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:20.002748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881b06-9459-48b0-baa2-a2b0faee7428 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:20.003037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881b06-9459-48b0-baa2-a2b0faee7428 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:20.003317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881b06-9459-48b0-baa2-a2b0faee7428 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] PATH_INFO: `/v3/projects/aef7f41b37a948cbbb60562a4d2043ee/users/12ca2587a56040bc91744caec39c62ca/roles/76241fa2e9df425a80d3a8e08bfbbb24` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:20.005565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57881b06-9459-48b0-baa2-a2b0faee7428 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aef7f41b37a948cbbb60562a4d2043ee, user_id=12ca2587a56040bc91744caec39c62ca, role_id=76241fa2e9df425a80d3a8e08bfbbb24)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:20.008822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57881b06-9459-48b0-baa2-a2b0faee7428 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:20.010280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586e7bc-ced3-4a98-8f02-21b792ce2514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78e4afa8ee34ced91535e464182a193, user_id=80189d2fa13e448e943eb4fdfe3a3aef, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:20.014148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586e7bc-ced3-4a98-8f02-21b792ce2514 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:20.026137 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3643/7259] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:19 2022] PUT /identity/v3/projects/aef7f41b37a948cbbb60562a4d2043ee/users/12ca2587a56040bc91744caec39c62ca/roles/76241fa2e9df425a80d3a8e08bfbbb24 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:20.032840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57881b06-9459-48b0-baa2-a2b0faee7428 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:20.032922 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:20.039839 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3617/7260] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:19 2022] PUT /identity/v3/projects/b78e4afa8ee34ced91535e464182a193/users/80189d2fa13e448e943eb4fdfe3a3aef/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:20.052690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22109d-16c6-4555-91bc-1be41d597a5a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:20.052690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22109d-16c6-4555-91bc-1be41d597a5a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:20.052690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22109d-16c6-4555-91bc-1be41d597a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:20.083745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4c22109d-16c6-4555-91bc-1be41d597a5a None None] MFA Rules not processed for user `80189d2fa13e448e943eb4fdfe3a3aef`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:20.085033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4c22109d-16c6-4555-91bc-1be41d597a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:20.126195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57881b06-9459-48b0-baa2-a2b0faee7428 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:20.159941 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3618/7261] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:20.183818 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:20.193032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22109d-16c6-4555-91bc-1be41d597a5a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:20.196941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4c22109d-16c6-4555-91bc-1be41d597a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:20.217398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55afa9-0429-4266-8198-7695b743d6c7 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ca2587a56040bc91744caec39c62ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef7f41b37a948cbbb60562a4d2043ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-20349449'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:20.218421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55afa9-0429-4266-8198-7695b743d6c7 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:20.219218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55afa9-0429-4266-8198-7695b743d6c7 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:20.219506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55afa9-0429-4266-8198-7695b743d6c7 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] PATH_INFO: `/v3/users/12ca2587a56040bc91744caec39c62ca/application_credentials` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:20.220190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55afa9-0429-4266-8198-7695b743d6c7 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] RBAC: Authorizing `identity:create_application_credential(user_id=12ca2587a56040bc91744caec39c62ca)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:20.221369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55afa9-0429-4266-8198-7695b743d6c7 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:20.309420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22109d-16c6-4555-91bc-1be41d597a5a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:20.320366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eed742-1a93-4a3f-bd42-41d976049d32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:20.321824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eed742-1a93-4a3f-bd42-41d976049d32 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:20.322242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eed742-1a93-4a3f-bd42-41d976049d32 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:20.322528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eed742-1a93-4a3f-bd42-41d976049d32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:20.327946 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3644/7262] 10.222.0.27 () {60 vars in 1315 bytes} [Wed Oct 19 01:21:20 2022] POST /identity/v3/users/12ca2587a56040bc91744caec39c62ca/application_credentials => generated 657 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:20.332294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7473d-18c2-4707-bed1-11cf96623d4c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:20.332581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7473d-18c2-4707-bed1-11cf96623d4c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:20.334088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eed742-1a93-4a3f-bd42-41d976049d32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:20.334990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7473d-18c2-4707-bed1-11cf96623d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:20.336529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eed742-1a93-4a3f-bd42-41d976049d32 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:20.350695 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3619/7263] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:21:20.367037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-eca7473d-18c2-4707-bed1-11cf96623d4c None None] MFA Rules not processed for user `12ca2587a56040bc91744caec39c62ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:20.368411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eca7473d-18c2-4707-bed1-11cf96623d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:20.541735 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3645/7264] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3392 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 19 01:21:20.546852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eed742-1a93-4a3f-bd42-41d976049d32 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:20.560657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eed742-1a93-4a3f-bd42-41d976049d32 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:20.572104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636cd04-6541-4bdf-b4c0-f8d993165ad0 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ca2587a56040bc91744caec39c62ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef7f41b37a948cbbb60562a4d2043ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-20349449'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:20.573010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636cd04-6541-4bdf-b4c0-f8d993165ad0 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:20.573203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636cd04-6541-4bdf-b4c0-f8d993165ad0 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:20.573556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636cd04-6541-4bdf-b4c0-f8d993165ad0 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] PATH_INFO: `/v3/users/12ca2587a56040bc91744caec39c62ca/application_credentials/3fea00ec1480490fbb8568ec53f3e85f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:20.587491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636cd04-6541-4bdf-b4c0-f8d993165ad0 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] RBAC: Authorizing `identity:delete_application_credential(user_id=12ca2587a56040bc91744caec39c62ca, application_credential_id=3fea00ec1480490fbb8568ec53f3e85f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:20.595274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636cd04-6541-4bdf-b4c0-f8d993165ad0 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:20.644186 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3620/7265] 10.222.0.27 () {58 vars in 1395 bytes} [Wed Oct 19 01:21:20 2022] DELETE /identity/v3/users/12ca2587a56040bc91744caec39c62ca/application_credentials/3fea00ec1480490fbb8568ec53f3e85f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:20.645896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7473d-18c2-4707-bed1-11cf96623d4c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:20.661963 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:20.752285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7473d-18c2-4707-bed1-11cf96623d4c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:20.758866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713f0d3ad53b49dcaccc6f4417bd83af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297cd6e52ebb41b288cda71a47b0f6f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:20.759619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:20.759994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:20.760457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] PATH_INFO: `/v3/roles/76241fa2e9df425a80d3a8e08bfbbb24` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:20.761943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] RBAC: Authorizing `identity:delete_role(role_id=76241fa2e9df425a80d3a8e08bfbbb24)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:20.763902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:20.824293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Invalidating the token cache because role 76241fa2e9df425a80d3a8e08bfbbb24 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:20.824958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:20.825507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:20.828665 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3646/7266] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:20 2022] DELETE /identity/v3/roles/76241fa2e9df425a80d3a8e08bfbbb24 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:20.834265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636cd04-6541-4bdf-b4c0-f8d993165ad0 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:20.836479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1636cd04-6541-4bdf-b4c0-f8d993165ad0 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:20.872983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:20.872983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:20.969641 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:20.975441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ea01e-2d22-4a61-9415-4c2f32c4e856 tempest-ApplicationCredentialsV3AdminTest-163777729 tempest-ApplicationCredentialsV3AdminTest-163777729-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:20.984190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:20.984930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:20.985215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:20.985551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] PATH_INFO: `/v3/users/790d3a57544d4e97a737a2fb9624a781` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:20.987000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790d3a57544d4e97a737a2fb9624a781)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:20.991097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:20.991327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636cd04-6541-4bdf-b4c0-f8d993165ad0 tempest-ApplicationCredentialsV3AdminTest-362911455 tempest-ApplicationCredentialsV3AdminTest-362911455-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:21.012563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:21.015637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:21.015965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:21.016250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] PATH_INFO: `/v3/users/12ca2587a56040bc91744caec39c62ca` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:21.023450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ca2587a56040bc91744caec39c62ca)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:21.027336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:21.070044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790d3a57544d4e97a737a2fb9624a781'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.093524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790d3a57544d4e97a737a2fb9624a781'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.110385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790d3a57544d4e97a737a2fb9624a781'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.116881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ca2587a56040bc91744caec39c62ca'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.117568 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:21.120332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790d3a57544d4e97a737a2fb9624a781'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.121348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a0f4571b-903a-423f-97d8-b58a7de26a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790d3a57544d4e97a737a2fb9624a781'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.134656 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3647/7267] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:20 2022] DELETE /identity/v3/users/790d3a57544d4e97a737a2fb9624a781 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:21.136312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b86b1-e1a7-4a71-96dd-c05c568699a6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:21.136556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b86b1-e1a7-4a71-96dd-c05c568699a6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:21.136808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b86b1-e1a7-4a71-96dd-c05c568699a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:21.147080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ca2587a56040bc91744caec39c62ca'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.158339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ca2587a56040bc91744caec39c62ca'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.173086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ca2587a56040bc91744caec39c62ca'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.174319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-dd79895a-0285-476b-87a6-cb68fe5197f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ca2587a56040bc91744caec39c62ca'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.175831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7f5b86b1-e1a7-4a71-96dd-c05c568699a6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:21.180158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7f5b86b1-e1a7-4a71-96dd-c05c568699a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:21.189827 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3621/7268] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:20 2022] DELETE /identity/v3/users/12ca2587a56040bc91744caec39c62ca => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:21.194619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093b36d-48f5-476d-957f-7d2017e32992 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:21.195073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093b36d-48f5-476d-957f-7d2017e32992 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:21.195619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093b36d-48f5-476d-957f-7d2017e32992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:21.228149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6093b36d-48f5-476d-957f-7d2017e32992 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:21.229916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6093b36d-48f5-476d-957f-7d2017e32992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:21.265451 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3648/7269] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:21.265451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b86b1-e1a7-4a71-96dd-c05c568699a6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:21.266774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7f5b86b1-e1a7-4a71-96dd-c05c568699a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:21.282377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b86b1-e1a7-4a71-96dd-c05c568699a6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:21.307621 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3622/7270] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:21.309053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093b36d-48f5-476d-957f-7d2017e32992 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:21.310737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6093b36d-48f5-476d-957f-7d2017e32992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:21.357329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:21.361589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:21.361884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:21.362166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] PATH_INFO: `/v3/users/699c843eed26438bbc9ef7508bcbad25` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:21.363573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699c843eed26438bbc9ef7508bcbad25)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:21.366006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:21.377359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093b36d-48f5-476d-957f-7d2017e32992 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:21.381057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2493d0-326b-40ed-8529-2afbf7ad559c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:21.381676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2493d0-326b-40ed-8529-2afbf7ad559c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:21.381961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2493d0-326b-40ed-8529-2afbf7ad559c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:21.382243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2493d0-326b-40ed-8529-2afbf7ad559c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:21.394148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2493d0-326b-40ed-8529-2afbf7ad559c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:21.395802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2493d0-326b-40ed-8529-2afbf7ad559c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:21.409089 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3623/7271] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:21.410110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2493d0-326b-40ed-8529-2afbf7ad559c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:21.423863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699c843eed26438bbc9ef7508bcbad25'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.426866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2493d0-326b-40ed-8529-2afbf7ad559c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:21.432197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ce57e-a0f5-41d2-8b91-32e070686b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:21.432898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ce57e-a0f5-41d2-8b91-32e070686b26 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:21.433183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ce57e-a0f5-41d2-8b91-32e070686b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:21.433459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ce57e-a0f5-41d2-8b91-32e070686b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:21.445578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699c843eed26438bbc9ef7508bcbad25'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.449486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ce57e-a0f5-41d2-8b91-32e070686b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:21.451183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ce57e-a0f5-41d2-8b91-32e070686b26 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:21.459124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699c843eed26438bbc9ef7508bcbad25'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.466330 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3624/7272] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:21.469130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699c843eed26438bbc9ef7508bcbad25'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.470365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699c843eed26438bbc9ef7508bcbad25'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.477270 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3649/7273] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:21 2022] DELETE /identity/v3/users/699c843eed26438bbc9ef7508bcbad25 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:21.485871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c8868-fdcc-41fd-8b83-ae13715d6cb7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:21.486427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c8868-fdcc-41fd-8b83-ae13715d6cb7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:21.486654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c8868-fdcc-41fd-8b83-ae13715d6cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:21.496370 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:21.511727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9d7c8868-fdcc-41fd-8b83-ae13715d6cb7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:21.513038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9d7c8868-fdcc-41fd-8b83-ae13715d6cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:21.598160 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3625/7274] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:21.610431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:21.613340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:21.633516 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:21.699681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131f3e8-931d-4fd3-9b06-1770cccffa20 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:21.706957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb6c9e-f5db-4a0b-97b0-e1f7bcc91afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:21.707678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb6c9e-f5db-4a0b-97b0-e1f7bcc91afb service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:21.707931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb6c9e-f5db-4a0b-97b0-e1f7bcc91afb service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:21.708212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb6c9e-f5db-4a0b-97b0-e1f7bcc91afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:21.723650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb6c9e-f5db-4a0b-97b0-e1f7bcc91afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:21.724036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb6c9e-f5db-4a0b-97b0-e1f7bcc91afb service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:21.738702 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3650/7275] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:21.880536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c8868-fdcc-41fd-8b83-ae13715d6cb7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:21.882248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9d7c8868-fdcc-41fd-8b83-ae13715d6cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:21.899846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c8868-fdcc-41fd-8b83-ae13715d6cb7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:21.906548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:21.907849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:21.908150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:21.908424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] PATH_INFO: `/v3/projects/aef7f41b37a948cbbb60562a4d2043ee` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:21.909863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef7f41b37a948cbbb60562a4d2043ee)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:21.911944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:21.977775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef7f41b37a948cbbb60562a4d2043ee', 'request_id': 'req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.987210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef7f41b37a948cbbb60562a4d2043ee', 'request_id': 'req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:21.991296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb6c9e-f5db-4a0b-97b0-e1f7bcc91afb service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:21.992934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f2cb6c9e-f5db-4a0b-97b0-e1f7bcc91afb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:21.996313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef7f41b37a948cbbb60562a4d2043ee', 'request_id': 'req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.008352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb6c9e-f5db-4a0b-97b0-e1f7bcc91afb service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:22.009351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] The token cache is being invalidate because project aef7f41b37a948cbbb60562a4d2043ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:22.009642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.010487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.015740 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3626/7276] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:21 2022] DELETE /identity/v3/projects/aef7f41b37a948cbbb60562a4d2043ee => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:22.016295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:22.017728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:22.100105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1623b0-0af6-4d2d-ba2f-b96aec566cb3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:22.106103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:22.106923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:22.107382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:22.107633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] PATH_INFO: `/v3/users/713f0d3ad53b49dcaccc6f4417bd83af` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:22.109555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713f0d3ad53b49dcaccc6f4417bd83af)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:22.111554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:22.113663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:22.114704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:22.115211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:22.115560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] PATH_INFO: `/v3/projects/7e6a9b2ce9724525a7a748d01be70ab2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:22.116833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6a9b2ce9724525a7a748d01be70ab2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:22.118955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:22.150181 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:22.169794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713f0d3ad53b49dcaccc6f4417bd83af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.180753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6a9b2ce9724525a7a748d01be70ab2', 'request_id': 'req-f47e8081-8922-4b23-90b3-100c068c4dfe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.186875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713f0d3ad53b49dcaccc6f4417bd83af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.190267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6a9b2ce9724525a7a748d01be70ab2', 'request_id': 'req-f47e8081-8922-4b23-90b3-100c068c4dfe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.196500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713f0d3ad53b49dcaccc6f4417bd83af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.198674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6a9b2ce9724525a7a748d01be70ab2', 'request_id': 'req-f47e8081-8922-4b23-90b3-100c068c4dfe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.204743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713f0d3ad53b49dcaccc6f4417bd83af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.205520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713f0d3ad53b49dcaccc6f4417bd83af'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.212905 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3627/7277] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:22 2022] DELETE /identity/v3/users/713f0d3ad53b49dcaccc6f4417bd83af => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:22.213081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] The token cache is being invalidate because project 7e6a9b2ce9724525a7a748d01be70ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:22.213491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.213613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:22.214483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.215250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:22.219941 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3651/7278] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:21 2022] DELETE /identity/v3/projects/7e6a9b2ce9724525a7a748d01be70ab2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:22.220728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:22.222272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:22.288375 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:22.306804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8081-8922-4b23-90b3-100c068c4dfe admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:22.307657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952296e-ec52-4858-acda-491bd3229300 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:22.312757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:22.313343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:22.313548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:22.313832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:22.314109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] PATH_INFO: `/v3/users/ca1482c5813b4499a4681a00c04ad183` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:22.314212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:22.314507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:22.314935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] PATH_INFO: `/v3/projects/85f9ba3495ea494cbc3bb25587a5d4f5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:22.315297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1482c5813b4499a4681a00c04ad183)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:22.316368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f9ba3495ea494cbc3bb25587a5d4f5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:22.317666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:22.318487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:22.377757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1482c5813b4499a4681a00c04ad183'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.386515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f9ba3495ea494cbc3bb25587a5d4f5', 'request_id': 'req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.393189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1482c5813b4499a4681a00c04ad183'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.396682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f9ba3495ea494cbc3bb25587a5d4f5', 'request_id': 'req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.401046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1482c5813b4499a4681a00c04ad183'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.407772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f9ba3495ea494cbc3bb25587a5d4f5', 'request_id': 'req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.411442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1482c5813b4499a4681a00c04ad183'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.412175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1482c5813b4499a4681a00c04ad183'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.423075 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3652/7279] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:22 2022] DELETE /identity/v3/users/ca1482c5813b4499a4681a00c04ad183 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:22.423271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] The token cache is being invalidate because project 85f9ba3495ea494cbc3bb25587a5d4f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:22.423271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.423271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.423525 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3628/7280] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:22 2022] DELETE /identity/v3/projects/85f9ba3495ea494cbc3bb25587a5d4f5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:22.427285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:22.428743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:22.500039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71313362-62cd-4a7e-833c-920ab5d33bbf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:22.504842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:22.505477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:22.505772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:22.506030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] PATH_INFO: `/v3/users/80189d2fa13e448e943eb4fdfe3a3aef` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:22.507159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80189d2fa13e448e943eb4fdfe3a3aef)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:22.509120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:22.560576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80189d2fa13e448e943eb4fdfe3a3aef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.576011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80189d2fa13e448e943eb4fdfe3a3aef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.580141 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:22.588962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80189d2fa13e448e943eb4fdfe3a3aef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.590253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:22.593276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:22.605120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80189d2fa13e448e943eb4fdfe3a3aef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.605890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80189d2fa13e448e943eb4fdfe3a3aef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.614303 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3653/7281] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:22 2022] DELETE /identity/v3/users/80189d2fa13e448e943eb4fdfe3a3aef => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:22.679459 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:22.711892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af3db4-8a4e-40cc-aa1e-9849f404bfc0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:22.779215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:22.783002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:22.783002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:22.783002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] PATH_INFO: `/v3/projects/297cd6e52ebb41b288cda71a47b0f6f1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:22.784254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:22.786558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:22.791722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=297cd6e52ebb41b288cda71a47b0f6f1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:22.800244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:22.820364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb50cd-d632-4c6a-b6f2-8ddf67803f68 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:22.827081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:22.827748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:22.828097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:22.828384 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] PATH_INFO: `/v3/projects/ef8b20974a204742ace39be46073555a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:22.829676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8b20974a204742ace39be46073555a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:22.832026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:22.860716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297cd6e52ebb41b288cda71a47b0f6f1', 'request_id': 'req-99214556-ce76-4805-9c2b-90823439dd0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.870923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297cd6e52ebb41b288cda71a47b0f6f1', 'request_id': 'req-99214556-ce76-4805-9c2b-90823439dd0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.878664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297cd6e52ebb41b288cda71a47b0f6f1', 'request_id': 'req-99214556-ce76-4805-9c2b-90823439dd0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.893003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] The token cache is being invalidate because project 297cd6e52ebb41b288cda71a47b0f6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:22.893562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.894610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-99214556-ce76-4805-9c2b-90823439dd0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.895606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8b20974a204742ace39be46073555a', 'request_id': 'req-f286e3cf-d797-41f7-ac54-6222328b6e06'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.896505 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3629/7282] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:22 2022] DELETE /identity/v3/projects/297cd6e52ebb41b288cda71a47b0f6f1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:22.901080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77055a9a-98d4-4098-b7e8-a97f5ab2606b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:22.901443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77055a9a-98d4-4098-b7e8-a97f5ab2606b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:22.901756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77055a9a-98d4-4098-b7e8-a97f5ab2606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:22.904678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8b20974a204742ace39be46073555a', 'request_id': 'req-f286e3cf-d797-41f7-ac54-6222328b6e06'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.913456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8b20974a204742ace39be46073555a', 'request_id': 'req-f286e3cf-d797-41f7-ac54-6222328b6e06'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.930516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-77055a9a-98d4-4098-b7e8-a97f5ab2606b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:22.931952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-77055a9a-98d4-4098-b7e8-a97f5ab2606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:22.940482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] The token cache is being invalidate because project ef8b20974a204742ace39be46073555a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:22.940862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.941570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f286e3cf-d797-41f7-ac54-6222328b6e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:22.943329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3654/7283] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:22 2022] DELETE /identity/v3/projects/ef8b20974a204742ace39be46073555a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:22.948963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffcb2a-91b8-4f40-adc6-806f0a532a35 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:22.950837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffcb2a-91b8-4f40-adc6-806f0a532a35 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:22.950837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffcb2a-91b8-4f40-adc6-806f0a532a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:22.973426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-23ffcb2a-91b8-4f40-adc6-806f0a532a35 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:22.975563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-23ffcb2a-91b8-4f40-adc6-806f0a532a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:23.037045 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3630/7284] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:23.037697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77055a9a-98d4-4098-b7e8-a97f5ab2606b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.039717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-77055a9a-98d4-4098-b7e8-a97f5ab2606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:23.054750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77055a9a-98d4-4098-b7e8-a97f5ab2606b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.061190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.062108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.062467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.062815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] PATH_INFO: `/v3/projects/b78e4afa8ee34ced91535e464182a193` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.064295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78e4afa8ee34ced91535e464182a193)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.066549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.086871 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3655/7285] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:23.086871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190de61-0332-465e-b6c6-0019479ca0aa None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.086871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190de61-0332-465e-b6c6-0019479ca0aa None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.086871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190de61-0332-465e-b6c6-0019479ca0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.089343 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:23.112899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5190de61-0332-465e-b6c6-0019479ca0aa None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:23.114238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5190de61-0332-465e-b6c6-0019479ca0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:23.134041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78e4afa8ee34ced91535e464182a193', 'request_id': 'req-da8aa476-a683-498a-8034-74fdd650ba07'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:23.142867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78e4afa8ee34ced91535e464182a193', 'request_id': 'req-da8aa476-a683-498a-8034-74fdd650ba07'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:23.149997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78e4afa8ee34ced91535e464182a193', 'request_id': 'req-da8aa476-a683-498a-8034-74fdd650ba07'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:23.168517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] The token cache is being invalidate because project b78e4afa8ee34ced91535e464182a193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:23.169099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:23.169651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-da8aa476-a683-498a-8034-74fdd650ba07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:23.184847 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3631/7286] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:23 2022] DELETE /identity/v3/projects/b78e4afa8ee34ced91535e464182a193 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:23.184847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae3b4-0feb-4c04-9e52-acc27425b508 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.184847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae3b4-0feb-4c04-9e52-acc27425b508 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.184847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae3b4-0feb-4c04-9e52-acc27425b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.204871 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3656/7287] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:23.208962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190de61-0332-465e-b6c6-0019479ca0aa None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.209097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-109ae3b4-0feb-4c04-9e52-acc27425b508 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:23.210342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-109ae3b4-0feb-4c04-9e52-acc27425b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:23.220745 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3632/7288] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:23.221535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190de61-0332-465e-b6c6-0019479ca0aa None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.225453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae3b4-0feb-4c04-9e52-acc27425b508 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.227018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51839228-9a7b-4597-aee7-c274690ad7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.228048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51839228-9a7b-4597-aee7-c274690ad7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.228584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51839228-9a7b-4597-aee7-c274690ad7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.229002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51839228-9a7b-4597-aee7-c274690ad7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.229798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51839228-9a7b-4597-aee7-c274690ad7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:23.230209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51839228-9a7b-4597-aee7-c274690ad7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.231954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51839228-9a7b-4597-aee7-c274690ad7a4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.235976 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:23.237237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae3b4-0feb-4c04-9e52-acc27425b508 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.254776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4189bac-d4ce-4132-9c9e-a8bbe8cd6c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.255512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4189bac-d4ce-4132-9c9e-a8bbe8cd6c24 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.255904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4189bac-d4ce-4132-9c9e-a8bbe8cd6c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.256250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4189bac-d4ce-4132-9c9e-a8bbe8cd6c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.257210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3657/7289] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:21:23.260958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4189bac-d4ce-4132-9c9e-a8bbe8cd6c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:23.261412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51839228-9a7b-4597-aee7-c274690ad7a4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.261995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4189bac-d4ce-4132-9c9e-a8bbe8cd6c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.263431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4189bac-d4ce-4132-9c9e-a8bbe8cd6c24 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.275909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51839228-9a7b-4597-aee7-c274690ad7a4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.283726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2865e5-ea13-480f-8ff4-a7f7d5625bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.284610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2865e5-ea13-480f-8ff4-a7f7d5625bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.285022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2865e5-ea13-480f-8ff4-a7f7d5625bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.285637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2865e5-ea13-480f-8ff4-a7f7d5625bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.286462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2865e5-ea13-480f-8ff4-a7f7d5625bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.288227 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3633/7290] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:23.289167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2865e5-ea13-480f-8ff4-a7f7d5625bb7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.289326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4189bac-d4ce-4132-9c9e-a8bbe8cd6c24 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.302663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4189bac-d4ce-4132-9c9e-a8bbe8cd6c24 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.308972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30deb2-e0a5-4420-b65c-15ab87d2d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.309615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30deb2-e0a5-4420-b65c-15ab87d2d123 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.309899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30deb2-e0a5-4420-b65c-15ab87d2d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.311570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30deb2-e0a5-4420-b65c-15ab87d2d123 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.311570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30deb2-e0a5-4420-b65c-15ab87d2d123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.314308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30deb2-e0a5-4420-b65c-15ab87d2d123 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.332697 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3658/7291] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:23.336645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2865e5-ea13-480f-8ff4-a7f7d5625bb7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.364170 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3634/7292] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:23.366229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30deb2-e0a5-4420-b65c-15ab87d2d123 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.462024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30deb2-e0a5-4420-b65c-15ab87d2d123 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.465653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2865e5-ea13-480f-8ff4-a7f7d5625bb7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.468606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672169ea-4c23-4eca-9a18-0f9093830d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.468824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672169ea-4c23-4eca-9a18-0f9093830d8b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.469070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672169ea-4c23-4eca-9a18-0f9093830d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.469531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672169ea-4c23-4eca-9a18-0f9093830d8b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.470850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672169ea-4c23-4eca-9a18-0f9093830d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.472354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672169ea-4c23-4eca-9a18-0f9093830d8b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.473879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9296a-e06b-4091-9d2d-dd52600ae97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.474855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9296a-e06b-4091-9d2d-dd52600ae97c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.478637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9296a-e06b-4091-9d2d-dd52600ae97c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.478637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9296a-e06b-4091-9d2d-dd52600ae97c admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.478637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9296a-e06b-4091-9d2d-dd52600ae97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.479972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9296a-e06b-4091-9d2d-dd52600ae97c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.502013 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3635/7293] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:23.507093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672169ea-4c23-4eca-9a18-0f9093830d8b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.517321 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3659/7294] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:23.518549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9296a-e06b-4091-9d2d-dd52600ae97c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.520122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672169ea-4c23-4eca-9a18-0f9093830d8b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.527419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094d07a-5829-4324-af28-150375d6043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.529175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094d07a-5829-4324-af28-150375d6043f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.531337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094d07a-5829-4324-af28-150375d6043f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.532594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094d07a-5829-4324-af28-150375d6043f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.533504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094d07a-5829-4324-af28-150375d6043f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.535189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094d07a-5829-4324-af28-150375d6043f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.541668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9296a-e06b-4091-9d2d-dd52600ae97c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.548667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5ab2-b04e-4010-b114-c9345a697925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.548901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5ab2-b04e-4010-b114-c9345a697925 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.549281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5ab2-b04e-4010-b114-c9345a697925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.549691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5ab2-b04e-4010-b114-c9345a697925 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.550620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5ab2-b04e-4010-b114-c9345a697925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.552650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5ab2-b04e-4010-b114-c9345a697925 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.558185 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3636/7295] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:23.559680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094d07a-5829-4324-af28-150375d6043f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.568699 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3660/7296] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:23.573193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5ab2-b04e-4010-b114-c9345a697925 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.587857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5ab2-b04e-4010-b114-c9345a697925 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.588116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094d07a-5829-4324-af28-150375d6043f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.594704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611c941-f244-463b-9caf-de0caa8e284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.595494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611c941-f244-463b-9caf-de0caa8e284a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.595846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611c941-f244-463b-9caf-de0caa8e284a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.596188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611c941-f244-463b-9caf-de0caa8e284a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.596968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611c941-f244-463b-9caf-de0caa8e284a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.598949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611c941-f244-463b-9caf-de0caa8e284a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.601283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909d7f9-b918-4411-b485-3c60b3862fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.602353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909d7f9-b918-4411-b485-3c60b3862fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.602840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909d7f9-b918-4411-b485-3c60b3862fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.603584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909d7f9-b918-4411-b485-3c60b3862fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.604706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909d7f9-b918-4411-b485-3c60b3862fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.606898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909d7f9-b918-4411-b485-3c60b3862fc6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.616678 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3661/7297] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:23.620884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611c941-f244-463b-9caf-de0caa8e284a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.629748 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3637/7298] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:23.633571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611c941-f244-463b-9caf-de0caa8e284a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.634552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909d7f9-b918-4411-b485-3c60b3862fc6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.639774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c961a67-d980-4ea1-8475-0a81743987f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.641252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961a67-d980-4ea1-8475-0a81743987f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.641637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961a67-d980-4ea1-8475-0a81743987f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.642016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961a67-d980-4ea1-8475-0a81743987f6 admin admin] PATH_INFO: `/v3/projects/fd57dec64d97465bb58bd63d39bb6a9c/users/4b03fad3586840aa8e79903b42a27788/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.648484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909d7f9-b918-4411-b485-3c60b3862fc6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.655487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18dc6c-5e30-454e-a568-69eda629ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.656573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dc6c-5e30-454e-a568-69eda629ce85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.657700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dc6c-5e30-454e-a568-69eda629ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.658357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dc6c-5e30-454e-a568-69eda629ce85 admin admin] PATH_INFO: `/v3/projects/7a6c50151b9248c6869654273191cf63/users/a32a97a7d2f846958b5c4d636a9b71d1/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.671593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c961a67-d980-4ea1-8475-0a81743987f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd57dec64d97465bb58bd63d39bb6a9c, user_id=4b03fad3586840aa8e79903b42a27788, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.674535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c961a67-d980-4ea1-8475-0a81743987f6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.679627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18dc6c-5e30-454e-a568-69eda629ce85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6c50151b9248c6869654273191cf63, user_id=a32a97a7d2f846958b5c4d636a9b71d1, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.682970 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18dc6c-5e30-454e-a568-69eda629ce85 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.693081 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3662/7299] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:23 2022] PUT /identity/v3/projects/fd57dec64d97465bb58bd63d39bb6a9c/users/4b03fad3586840aa8e79903b42a27788/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:23.703996 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:23.704908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014355f2-9e1d-4ae5-a8fc-439adc479ad4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.705186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014355f2-9e1d-4ae5-a8fc-439adc479ad4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.705442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014355f2-9e1d-4ae5-a8fc-439adc479ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.707648 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3638/7300] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:23 2022] PUT /identity/v3/projects/7a6c50151b9248c6869654273191cf63/users/a32a97a7d2f846958b5c4d636a9b71d1/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:23.721794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acdbb8-1d61-4fba-a8ac-5f693360f630 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.722148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acdbb8-1d61-4fba-a8ac-5f693360f630 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.722381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acdbb8-1d61-4fba-a8ac-5f693360f630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.748267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-014355f2-9e1d-4ae5-a8fc-439adc479ad4 None None] MFA Rules not processed for user `4b03fad3586840aa8e79903b42a27788`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:23.750178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-014355f2-9e1d-4ae5-a8fc-439adc479ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:23.770354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e6acdbb8-1d61-4fba-a8ac-5f693360f630 None None] MFA Rules not processed for user `a32a97a7d2f846958b5c4d636a9b71d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:23.771719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e6acdbb8-1d61-4fba-a8ac-5f693360f630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:23.824054 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3663/7301] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:23.829030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014355f2-9e1d-4ae5-a8fc-439adc479ad4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.837097 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:23.845322 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3639/7302] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:23.849706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acdbb8-1d61-4fba-a8ac-5f693360f630 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.896895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014355f2-9e1d-4ae5-a8fc-439adc479ad4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.901559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289fdb4-9469-4ebd-84f7-b9574303235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.902200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289fdb4-9469-4ebd-84f7-b9574303235c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.902537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289fdb4-9469-4ebd-84f7-b9574303235c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.902754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289fdb4-9469-4ebd-84f7-b9574303235c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.903413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289fdb4-9469-4ebd-84f7-b9574303235c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.906179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289fdb4-9469-4ebd-84f7-b9574303235c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.912344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acdbb8-1d61-4fba-a8ac-5f693360f630 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:23.917227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff338054-3df5-4085-a284-6c536a7b99a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:23.917860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff338054-3df5-4085-a284-6c536a7b99a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:23.918136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff338054-3df5-4085-a284-6c536a7b99a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:23.918428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff338054-3df5-4085-a284-6c536a7b99a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:23.919030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff338054-3df5-4085-a284-6c536a7b99a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:23.921218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff338054-3df5-4085-a284-6c536a7b99a3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:23.933433 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3664/7303] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:23.937718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289fdb4-9469-4ebd-84f7-b9574303235c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:23.954845 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3640/7304] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:23.955836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff338054-3df5-4085-a284-6c536a7b99a3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.006443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289fdb4-9469-4ebd-84f7-b9574303235c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.021138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff338054-3df5-4085-a284-6c536a7b99a3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.026183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9ecd1-ecff-4544-86f4-0505316c283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.026797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9ecd1-ecff-4544-86f4-0505316c283b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.027091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9ecd1-ecff-4544-86f4-0505316c283b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.027363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9ecd1-ecff-4544-86f4-0505316c283b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.027989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9ecd1-ecff-4544-86f4-0505316c283b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.030586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9ecd1-ecff-4544-86f4-0505316c283b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.054541 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3641/7305] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:24.058623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9ecd1-ecff-4544-86f4-0505316c283b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.065215 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:24.067550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b570ea4-24b6-4683-a528-e52d65eb66b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.068175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b570ea4-24b6-4683-a528-e52d65eb66b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.068454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b570ea4-24b6-4683-a528-e52d65eb66b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.068761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b570ea4-24b6-4683-a528-e52d65eb66b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.069345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9ecd1-ecff-4544-86f4-0505316c283b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.069486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b570ea4-24b6-4683-a528-e52d65eb66b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.071347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b570ea4-24b6-4683-a528-e52d65eb66b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.075241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ec45c-8790-4d67-9d24-6df2d33b3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.075878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ec45c-8790-4d67-9d24-6df2d33b3aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.076157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ec45c-8790-4d67-9d24-6df2d33b3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.076432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ec45c-8790-4d67-9d24-6df2d33b3aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.077740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ec45c-8790-4d67-9d24-6df2d33b3aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.079324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ec45c-8790-4d67-9d24-6df2d33b3aa9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.090003 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3642/7306] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:24.094697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ec45c-8790-4d67-9d24-6df2d33b3aa9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.096684 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3665/7307] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:23 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:24.097975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b570ea4-24b6-4683-a528-e52d65eb66b5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.105922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ec45c-8790-4d67-9d24-6df2d33b3aa9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.108189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b570ea4-24b6-4683-a528-e52d65eb66b5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.110997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99588f6a-d236-4474-83dc-42f051f575d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.111666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99588f6a-d236-4474-83dc-42f051f575d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.111952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99588f6a-d236-4474-83dc-42f051f575d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.112234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99588f6a-d236-4474-83dc-42f051f575d6 admin admin] PATH_INFO: `/v3/projects/b2c16006c2234192ae03173793e1370d/users/4634225d1113477b9c41ffe2f6c2b038/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.112968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cacb78-7823-463c-af16-cc84dd880fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.113556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cacb78-7823-463c-af16-cc84dd880fcf admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.113834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cacb78-7823-463c-af16-cc84dd880fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.114106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cacb78-7823-463c-af16-cc84dd880fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.114737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cacb78-7823-463c-af16-cc84dd880fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.116330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cacb78-7823-463c-af16-cc84dd880fcf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.126964 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3666/7308] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:24.128007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99588f6a-d236-4474-83dc-42f051f575d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c16006c2234192ae03173793e1370d, user_id=4634225d1113477b9c41ffe2f6c2b038, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.130719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99588f6a-d236-4474-83dc-42f051f575d6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.130915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cacb78-7823-463c-af16-cc84dd880fcf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.142902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cacb78-7823-463c-af16-cc84dd880fcf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.145980 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3643/7309] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:24 2022] PUT /identity/v3/projects/b2c16006c2234192ae03173793e1370d/users/4634225d1113477b9c41ffe2f6c2b038/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:24.149832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99588f6a-d236-4474-83dc-42f051f575d6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.155377 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:24.202550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45da3d-7084-445a-a9b4-d4de5ff4d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.203208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45da3d-7084-445a-a9b4-d4de5ff4d05a admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.203486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45da3d-7084-445a-a9b4-d4de5ff4d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.203755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45da3d-7084-445a-a9b4-d4de5ff4d05a admin admin] PATH_INFO: `/v3/projects/dc93262c55ce4f6aa708cf6936fdebbb/users/1e944619019a434e8de09bb83ca90be7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.212750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99588f6a-d236-4474-83dc-42f051f575d6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.217750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9598d-6090-4b3d-988c-6db0152044a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.218380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9598d-6090-4b3d-988c-6db0152044a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.218647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9598d-6090-4b3d-988c-6db0152044a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.218760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45da3d-7084-445a-a9b4-d4de5ff4d05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc93262c55ce4f6aa708cf6936fdebbb, user_id=1e944619019a434e8de09bb83ca90be7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.218929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9598d-6090-4b3d-988c-6db0152044a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.219572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9598d-6090-4b3d-988c-6db0152044a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.221189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9598d-6090-4b3d-988c-6db0152044a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.221443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45da3d-7084-445a-a9b4-d4de5ff4d05a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.231684 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3644/7310] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:24.235475 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3667/7311] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:24 2022] PUT /identity/v3/projects/dc93262c55ce4f6aa708cf6936fdebbb/users/1e944619019a434e8de09bb83ca90be7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:24.236187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9598d-6090-4b3d-988c-6db0152044a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.239058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45da3d-7084-445a-a9b4-d4de5ff4d05a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.246331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9598d-6090-4b3d-988c-6db0152044a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.303852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45da3d-7084-445a-a9b4-d4de5ff4d05a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.305019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082ac78-435c-4bca-bc37-73b82752763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.305686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082ac78-435c-4bca-bc37-73b82752763a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.305968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082ac78-435c-4bca-bc37-73b82752763a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.306246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082ac78-435c-4bca-bc37-73b82752763a admin admin] PATH_INFO: `/v3/projects/b2c16006c2234192ae03173793e1370d/users/4634225d1113477b9c41ffe2f6c2b038/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.308140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082ac78-435c-4bca-bc37-73b82752763a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c16006c2234192ae03173793e1370d, user_id=4634225d1113477b9c41ffe2f6c2b038, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.308948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616ab35-a0e6-41a5-a3e8-c3e9ff6beaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.309528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ab35-a0e6-41a5-a3e8-c3e9ff6beaeb admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.309813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ab35-a0e6-41a5-a3e8-c3e9ff6beaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.310350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ab35-a0e6-41a5-a3e8-c3e9ff6beaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.310993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616ab35-a0e6-41a5-a3e8-c3e9ff6beaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.311622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082ac78-435c-4bca-bc37-73b82752763a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.313251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616ab35-a0e6-41a5-a3e8-c3e9ff6beaeb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.321922 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3645/7312] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:24 2022] PUT /identity/v3/projects/b2c16006c2234192ae03173793e1370d/users/4634225d1113477b9c41ffe2f6c2b038/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:24.323557 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3668/7313] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:24.329859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082ac78-435c-4bca-bc37-73b82752763a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.404155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082ac78-435c-4bca-bc37-73b82752763a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.409494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d573d3-0439-41c6-9454-33f0baa968a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.410191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d573d3-0439-41c6-9454-33f0baa968a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.410493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d573d3-0439-41c6-9454-33f0baa968a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.410752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d573d3-0439-41c6-9454-33f0baa968a2 admin admin] PATH_INFO: `/v3/projects/dc93262c55ce4f6aa708cf6936fdebbb/users/1e944619019a434e8de09bb83ca90be7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.412779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d573d3-0439-41c6-9454-33f0baa968a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc93262c55ce4f6aa708cf6936fdebbb, user_id=1e944619019a434e8de09bb83ca90be7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.415481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d573d3-0439-41c6-9454-33f0baa968a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.418340 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:24.428466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15f95-5973-40c1-b193-95a7b5231cd8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.428786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15f95-5973-40c1-b193-95a7b5231cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.429069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15f95-5973-40c1-b193-95a7b5231cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.429941 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3646/7314] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:24 2022] PUT /identity/v3/projects/dc93262c55ce4f6aa708cf6936fdebbb/users/1e944619019a434e8de09bb83ca90be7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:24.441402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527df7ad-610d-47b1-ae30-95451f8989dc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.441691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527df7ad-610d-47b1-ae30-95451f8989dc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.441969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527df7ad-610d-47b1-ae30-95451f8989dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.464187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-56a15f95-5973-40c1-b193-95a7b5231cd8 None None] MFA Rules not processed for user `4634225d1113477b9c41ffe2f6c2b038`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:24.465466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-56a15f95-5973-40c1-b193-95a7b5231cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:24.473458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-527df7ad-610d-47b1-ae30-95451f8989dc None None] MFA Rules not processed for user `1e944619019a434e8de09bb83ca90be7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:24.474678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-527df7ad-610d-47b1-ae30-95451f8989dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:24.540233 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3669/7315] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:24.549588 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3647/7316] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:24.551495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a15f95-5973-40c1-b193-95a7b5231cd8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.553004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-56a15f95-5973-40c1-b193-95a7b5231cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:24.554233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527df7ad-610d-47b1-ae30-95451f8989dc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.564437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527df7ad-610d-47b1-ae30-95451f8989dc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.569259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9444-cf3f-4186-8e65-2d6c5e8f9102 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.569868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9444-cf3f-4186-8e65-2d6c5e8f9102 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.570181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9444-cf3f-4186-8e65-2d6c5e8f9102 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.570487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9444-cf3f-4186-8e65-2d6c5e8f9102 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.571145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9444-cf3f-4186-8e65-2d6c5e8f9102 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.572942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9444-cf3f-4186-8e65-2d6c5e8f9102 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.582890 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:24.594302 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3648/7317] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:24 2022] POST /identity/v3/services => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:24.595264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9444-cf3f-4186-8e65-2d6c5e8f9102 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.616564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9444-cf3f-4186-8e65-2d6c5e8f9102 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.622543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd43d46-2ac7-4788-bd97-9521537f08c4 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.623253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43d46-2ac7-4788-bd97-9521537f08c4 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.623775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43d46-2ac7-4788-bd97-9521537f08c4 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.623946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43d46-2ac7-4788-bd97-9521537f08c4 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.624834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd43d46-2ac7-4788-bd97-9521537f08c4 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.626640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd43d46-2ac7-4788-bd97-9521537f08c4 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.627594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a15f95-5973-40c1-b193-95a7b5231cd8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-3fd43d46-2ac7-4788-bd97-9521537f08c4 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: On instance['enabled']: Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: On instance['enabled']: Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: 'False' Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise error Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['enabled']: Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application 'False' Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.633600 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 19 01:21:24.635055 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['enabled']: Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application 'False' Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.636024 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3649/7318] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 01:21:24 2022] POST /identity/v3/endpoints => generated 283 bytes in 40 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 01:21:24.643713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd43d46-2ac7-4788-bd97-9521537f08c4 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.644427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c300d-b38e-4428-b60d-64572bb909d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.645116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c300d-b38e-4428-b60d-64572bb909d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.645404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c300d-b38e-4428-b60d-64572bb909d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.645681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c300d-b38e-4428-b60d-64572bb909d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.654640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd43d46-2ac7-4788-bd97-9521537f08c4 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.657626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c300d-b38e-4428-b60d-64572bb909d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.659099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c300d-b38e-4428-b60d-64572bb909d6 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.659973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc43c-ad2f-44fe-b074-5d3515623c7b tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.660557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc43c-ad2f-44fe-b074-5d3515623c7b tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.660865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc43c-ad2f-44fe-b074-5d3515623c7b tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.661141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc43c-ad2f-44fe-b074-5d3515623c7b tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.661792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bc43c-ad2f-44fe-b074-5d3515623c7b tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.664012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bc43c-ad2f-44fe-b074-5d3515623c7b tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-1c9bc43c-ad2f-44fe-b074-5d3515623c7b tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: On instance['enabled']: Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: On instance['enabled']: Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: 'True' Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise error Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['enabled']: Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application 'True' Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.671474 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 19 01:21:24.672932 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['enabled']: Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application 'True' Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:24.673886 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3650/7319] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 01:21:24 2022] POST /identity/v3/endpoints => generated 281 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 01:21:24.681591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc43c-ad2f-44fe-b074-5d3515623c7b tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.692509 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3670/7320] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:24 2022] GET /identity/v3/auth/tokens => generated 3458 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:24.694570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc43c-ad2f-44fe-b074-5d3515623c7b tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.699769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239bddd-0561-4001-b3f9-3f010940ee34 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.700299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bddd-0561-4001-b3f9-3f010940ee34 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.707732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bddd-0561-4001-b3f9-3f010940ee34 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.708070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bddd-0561-4001-b3f9-3f010940ee34 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.711110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239bddd-0561-4001-b3f9-3f010940ee34 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.711110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239bddd-0561-4001-b3f9-3f010940ee34 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.741892 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-d239bddd-0561-4001-b3f9-3f010940ee34 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-113825501. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:21:24.741892 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:21:24.741892 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:21:24.776762 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3651/7321] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 01:21:24 2022] POST /identity/v3/endpoints => generated 358 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:24.781126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c300d-b38e-4428-b60d-64572bb909d6 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.793150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c300d-b38e-4428-b60d-64572bb909d6 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.802962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239bddd-0561-4001-b3f9-3f010940ee34 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.810552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e43d1-192d-4da6-99be-2e1ff042bd5c tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.811825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e43d1-192d-4da6-99be-2e1ff042bd5c tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.812199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e43d1-192d-4da6-99be-2e1ff042bd5c tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.812543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e43d1-192d-4da6-99be-2e1ff042bd5c tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/regions/tempest-region-113825501` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.813404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e43d1-192d-4da6-99be-2e1ff042bd5c tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-113825501)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.814625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e43d1-192d-4da6-99be-2e1ff042bd5c tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.821569 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3671/7322] 10.222.0.27 () {58 vars in 1203 bytes} [Wed Oct 19 01:21:24 2022] GET /identity/v3/regions/tempest-region-113825501 => generated 178 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:24.822621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e43d1-192d-4da6-99be-2e1ff042bd5c tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.833441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e43d1-192d-4da6-99be-2e1ff042bd5c tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.838906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4510c8-b7cf-45e3-bc9e-5e8effd0f555 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.839618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4510c8-b7cf-45e3-bc9e-5e8effd0f555 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.839938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4510c8-b7cf-45e3-bc9e-5e8effd0f555 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.840268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4510c8-b7cf-45e3-bc9e-5e8effd0f555 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/endpoints/ea8207348d0c4a84952e2c84a8b23bf1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.840380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239bddd-0561-4001-b3f9-3f010940ee34 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.846436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e0ac2-4bc9-4363-892b-5c8b101f7ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.847196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e0ac2-4bc9-4363-892b-5c8b101f7ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.847384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e0ac2-4bc9-4363-892b-5c8b101f7ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.847885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e0ac2-4bc9-4363-892b-5c8b101f7ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.848938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4510c8-b7cf-45e3-bc9e-5e8effd0f555 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=ea8207348d0c4a84952e2c84a8b23bf1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.850787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4510c8-b7cf-45e3-bc9e-5e8effd0f555 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-7b4510c8-b7cf-45e3-bc9e-5e8effd0f555 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: On instance['enabled']: Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: On instance['enabled']: Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: 'False' Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise error Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application On instance['enabled']: Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application 'False' Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:21:24.860029 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 19 01:21:24.861425 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application On instance['enabled']: Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application 'False' Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:21:24.862368 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3672/7323] 10.222.0.27 () {60 vars in 1255 bytes} [Wed Oct 19 01:21:24 2022] PATCH /identity/v3/endpoints/ea8207348d0c4a84952e2c84a8b23bf1 => generated 283 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 01:21:24.865655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4510c8-b7cf-45e3-bc9e-5e8effd0f555 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.880802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4510c8-b7cf-45e3-bc9e-5e8effd0f555 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.887668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c179619-5889-49f3-93ff-5071aa95374f tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.888677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c179619-5889-49f3-93ff-5071aa95374f tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.889210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c179619-5889-49f3-93ff-5071aa95374f tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.890196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c179619-5889-49f3-93ff-5071aa95374f tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/endpoints/ea8207348d0c4a84952e2c84a8b23bf1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.891653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c179619-5889-49f3-93ff-5071aa95374f tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ea8207348d0c4a84952e2c84a8b23bf1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.894182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c179619-5889-49f3-93ff-5071aa95374f tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.906596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7c179619-5889-49f3-93ff-5071aa95374f tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ea8207348d0c4a84952e2c84a8b23bf1', 'request_id': 'req-7c179619-5889-49f3-93ff-5071aa95374f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:24.921775 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3673/7324] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:24 2022] DELETE /identity/v3/endpoints/ea8207348d0c4a84952e2c84a8b23bf1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:24.922604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c179619-5889-49f3-93ff-5071aa95374f tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:24.931684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e0ac2-4bc9-4363-892b-5c8b101f7ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.933284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e0ac2-4bc9-4363-892b-5c8b101f7ee4 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:24.939275 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:24.949515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c179619-5889-49f3-93ff-5071aa95374f tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:24.956951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106cf93-6d2a-4c6d-b178-4837916649d2 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:24.957946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106cf93-6d2a-4c6d-b178-4837916649d2 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:24.958438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106cf93-6d2a-4c6d-b178-4837916649d2 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:24.958921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106cf93-6d2a-4c6d-b178-4837916649d2 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/regions/tempest-region-113825501` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:24.959722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106cf93-6d2a-4c6d-b178-4837916649d2 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-113825501)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:24.960522 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3652/7325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:24 2022] GET /identity/v3/auth/tokens => generated 3389 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:21:24.974081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106cf93-6d2a-4c6d-b178-4837916649d2 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:25.005799 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-7106cf93-6d2a-4c6d-b178-4837916649d2 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-113825501. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:21:25.005799 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:21:25.005799 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:21:25.017400 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3674/7326] 10.222.0.27 () {58 vars in 1206 bytes} [Wed Oct 19 01:21:24 2022] DELETE /identity/v3/regions/tempest-region-113825501 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:25.022393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e0ac2-4bc9-4363-892b-5c8b101f7ee4 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:25.034479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e0ac2-4bc9-4363-892b-5c8b101f7ee4 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:25.050104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dcf78-dd9d-4c91-ab5d-f275638c1c91 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:25.050715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dcf78-dd9d-4c91-ab5d-f275638c1c91 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:25.051134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dcf78-dd9d-4c91-ab5d-f275638c1c91 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:25.051493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dcf78-dd9d-4c91-ab5d-f275638c1c91 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:25.052107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31dcf78-dd9d-4c91-ab5d-f275638c1c91 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:25.053774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31dcf78-dd9d-4c91-ab5d-f275638c1c91 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:25.070299 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-f31dcf78-dd9d-4c91-ab5d-f275638c1c91 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-427819684. To ensure interoperability, identifiers should be a valid uuid. Oct 19 01:21:25.070299 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 19 01:21:25.070299 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:21:25.096764 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3653/7327] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 01:21:25 2022] POST /identity/v3/endpoints => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:25.100979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106cf93-6d2a-4c6d-b178-4837916649d2 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:25.112329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106cf93-6d2a-4c6d-b178-4837916649d2 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:25.128221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cafa7-5415-4c74-b524-00a53b2d07c6 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:25.129323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cafa7-5415-4c74-b524-00a53b2d07c6 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:25.129849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cafa7-5415-4c74-b524-00a53b2d07c6 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:25.130218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cafa7-5415-4c74-b524-00a53b2d07c6 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/regions/tempest-region-427819684` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:25.130993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cafa7-5415-4c74-b524-00a53b2d07c6 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-427819684)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:25.132231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cafa7-5415-4c74-b524-00a53b2d07c6 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:25.134797 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3675/7328] 10.222.0.27 () {58 vars in 1203 bytes} [Wed Oct 19 01:21:25 2022] GET /identity/v3/regions/tempest-region-427819684 => generated 178 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:25.139174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dcf78-dd9d-4c91-ab5d-f275638c1c91 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:25.150237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dcf78-dd9d-4c91-ab5d-f275638c1c91 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:25.155543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:25.156265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:25.156556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:25.156871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/endpoints/a9815572273d4fed80a4dc5cbee418c5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:25.162745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=a9815572273d4fed80a4dc5cbee418c5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:25.163795 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:25.163795 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:21:25.163795 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:21:25.164741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: On instance['enabled']: Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: On instance['enabled']: Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: 'True' Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise error Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['enabled']: Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application 'True' Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:25.173533 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 19 01:21:25.175082 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application On instance['enabled']: Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application 'True' Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:25.176063 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3654/7329] 10.222.0.27 () {60 vars in 1255 bytes} [Wed Oct 19 01:21:25 2022] PATCH /identity/v3/endpoints/a9815572273d4fed80a4dc5cbee418c5 => generated 281 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 01:21:25.178869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cafa7-5415-4c74-b524-00a53b2d07c6 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:25.190813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cafa7-5415-4c74-b524-00a53b2d07c6 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:25.196165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a0233-d0df-4660-a48c-91f4a9a7a775 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:25.196826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a0233-d0df-4660-a48c-91f4a9a7a775 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:25.197117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a0233-d0df-4660-a48c-91f4a9a7a775 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:25.197456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a0233-d0df-4660-a48c-91f4a9a7a775 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/endpoints/a9815572273d4fed80a4dc5cbee418c5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:25.198604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a0233-d0df-4660-a48c-91f4a9a7a775 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a9815572273d4fed80a4dc5cbee418c5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:25.200408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a0233-d0df-4660-a48c-91f4a9a7a775 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:25.209686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8a8a0233-d0df-4660-a48c-91f4a9a7a775 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a9815572273d4fed80a4dc5cbee418c5', 'request_id': 'req-8a8a0233-d0df-4660-a48c-91f4a9a7a775'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:25.230814 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3676/7330] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:25 2022] DELETE /identity/v3/endpoints/a9815572273d4fed80a4dc5cbee418c5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:25.232502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:25.245413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba48c7-9ce1-4455-bca3-d6f2670ca660 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:25.261406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11cf3-7c44-4ba1-a65b-787fcfe21f33 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:25.262159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11cf3-7c44-4ba1-a65b-787fcfe21f33 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:25.262325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11cf3-7c44-4ba1-a65b-787fcfe21f33 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:25.262598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11cf3-7c44-4ba1-a65b-787fcfe21f33 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/regions/tempest-region-427819684` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:25.263391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11cf3-7c44-4ba1-a65b-787fcfe21f33 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-427819684)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:25.265896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11cf3-7c44-4ba1-a65b-787fcfe21f33 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:25.288907 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3655/7331] 10.222.0.27 () {58 vars in 1206 bytes} [Wed Oct 19 01:21:25 2022] DELETE /identity/v3/regions/tempest-region-427819684 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:25.293899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a0233-d0df-4660-a48c-91f4a9a7a775 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:25.304769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a0233-d0df-4660-a48c-91f4a9a7a775 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:25.320647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2204a5b-4c5b-4a6a-b507-f891944d7402 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e944619019a434e8de09bb83ca90be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc93262c55ce4f6aa708cf6936fdebbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:25.321219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2204a5b-4c5b-4a6a-b507-f891944d7402 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:25.324750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2204a5b-4c5b-4a6a-b507-f891944d7402 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:25.325093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2204a5b-4c5b-4a6a-b507-f891944d7402 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] PATH_INFO: `/v3/services/6bc3b509f15441bbbd2e600b28c024e1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:25.325786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2204a5b-4c5b-4a6a-b507-f891944d7402 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6bc3b509f15441bbbd2e600b28c024e1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:25.327972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2204a5b-4c5b-4a6a-b507-f891944d7402 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:25.350541 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3677/7332] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:25 2022] DELETE /identity/v3/services/6bc3b509f15441bbbd2e600b28c024e1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:25.354787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11cf3-7c44-4ba1-a65b-787fcfe21f33 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:25.428728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11cf3-7c44-4ba1-a65b-787fcfe21f33 tempest-EndpointsNegativeTestJSON-417584315 tempest-EndpointsNegativeTestJSON-417584315-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:25.444383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:25.445059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:25.445341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:25.445615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] PATH_INFO: `/v3/users/4b03fad3586840aa8e79903b42a27788` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:25.446794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b03fad3586840aa8e79903b42a27788)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:25.448860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:25.498612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b03fad3586840aa8e79903b42a27788'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:25.500636 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:25.512549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b03fad3586840aa8e79903b42a27788'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:25.520671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b03fad3586840aa8e79903b42a27788'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:25.527694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b03fad3586840aa8e79903b42a27788'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:25.528372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b03fad3586840aa8e79903b42a27788'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:25.534313 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3656/7333] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:25 2022] DELETE /identity/v3/users/4b03fad3586840aa8e79903b42a27788 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:25.538934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ceeff-b68c-405f-bb1a-d76e0f70ed92 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:25.539214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ceeff-b68c-405f-bb1a-d76e0f70ed92 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:25.539482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ceeff-b68c-405f-bb1a-d76e0f70ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:25.559271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-739ceeff-b68c-405f-bb1a-d76e0f70ed92 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:25.560788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-739ceeff-b68c-405f-bb1a-d76e0f70ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:25.586490 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:25.625360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3678/7334] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:25.634989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:25.636435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:25.707768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649dd1-b313-441a-a005-567fc5fd20a8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:25.711857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177a527-f870-40e1-aa6c-0068b7eddc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:25.712478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177a527-f870-40e1-aa6c-0068b7eddc4c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:25.712817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177a527-f870-40e1-aa6c-0068b7eddc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:25.713101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177a527-f870-40e1-aa6c-0068b7eddc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:25.723559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177a527-f870-40e1-aa6c-0068b7eddc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:25.725182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177a527-f870-40e1-aa6c-0068b7eddc4c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:25.735855 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3657/7335] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:26.027047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ceeff-b68c-405f-bb1a-d76e0f70ed92 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:26.029376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-739ceeff-b68c-405f-bb1a-d76e0f70ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:26.057978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ceeff-b68c-405f-bb1a-d76e0f70ed92 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:26.067970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:26.068939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:26.074753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:26.075469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] PATH_INFO: `/v3/projects/fd57dec64d97465bb58bd63d39bb6a9c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:26.077536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd57dec64d97465bb58bd63d39bb6a9c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:26.079749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:26.146043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd57dec64d97465bb58bd63d39bb6a9c', 'request_id': 'req-f16057c6-3851-4e1e-8963-b8e3badaf4ac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.155807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd57dec64d97465bb58bd63d39bb6a9c', 'request_id': 'req-f16057c6-3851-4e1e-8963-b8e3badaf4ac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.163159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd57dec64d97465bb58bd63d39bb6a9c', 'request_id': 'req-f16057c6-3851-4e1e-8963-b8e3badaf4ac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.175984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] The token cache is being invalidate because project fd57dec64d97465bb58bd63d39bb6a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:26.176278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.176965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.178715 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3679/7336] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:26 2022] DELETE /identity/v3/projects/fd57dec64d97465bb58bd63d39bb6a9c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:26.182871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177a527-f870-40e1-aa6c-0068b7eddc4c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:26.196494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177a527-f870-40e1-aa6c-0068b7eddc4c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:26.256820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:26.257455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:26.257745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:26.258020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] PATH_INFO: `/v3/users/1e944619019a434e8de09bb83ca90be7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:26.259138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e944619019a434e8de09bb83ca90be7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:26.261099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:26.308974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e944619019a434e8de09bb83ca90be7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.321180 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:26.322885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e944619019a434e8de09bb83ca90be7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.331801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e944619019a434e8de09bb83ca90be7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.344545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e944619019a434e8de09bb83ca90be7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.347612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f0102334-7753-4c9e-8131-f54c2b2d4c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e944619019a434e8de09bb83ca90be7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.353938 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3658/7337] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:26 2022] DELETE /identity/v3/users/1e944619019a434e8de09bb83ca90be7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:26.646026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:26.647605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:26.662254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16057c6-3851-4e1e-8963-b8e3badaf4ac admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:26.722792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:26.723555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:26.723917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:26.724258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] PATH_INFO: `/v3/projects/dc93262c55ce4f6aa708cf6936fdebbb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:26.725435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc93262c55ce4f6aa708cf6936fdebbb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:26.727379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:26.774141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc93262c55ce4f6aa708cf6936fdebbb', 'request_id': 'req-7151e285-eb16-44c5-9e8e-0fe12af7208f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.777936 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:26.783203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc93262c55ce4f6aa708cf6936fdebbb', 'request_id': 'req-7151e285-eb16-44c5-9e8e-0fe12af7208f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.790849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc93262c55ce4f6aa708cf6936fdebbb', 'request_id': 'req-7151e285-eb16-44c5-9e8e-0fe12af7208f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.803337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] The token cache is being invalidate because project dc93262c55ce4f6aa708cf6936fdebbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:26.803619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.804328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7151e285-eb16-44c5-9e8e-0fe12af7208f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:26.805846 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3680/7338] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:26 2022] DELETE /identity/v3/projects/dc93262c55ce4f6aa708cf6936fdebbb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:26.811031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1a24-b654-4883-ac97-567bf7fdb773 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:26.811622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1a24-b654-4883-ac97-567bf7fdb773 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:26.811975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1a24-b654-4883-ac97-567bf7fdb773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:26.840294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8b2a1a24-b654-4883-ac97-567bf7fdb773 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:26.841910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8b2a1a24-b654-4883-ac97-567bf7fdb773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:26.906687 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3659/7339] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:26.914381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca07d16-79a0-494d-bf35-3995a3eda7d1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:26.914667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca07d16-79a0-494d-bf35-3995a3eda7d1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:26.914942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca07d16-79a0-494d-bf35-3995a3eda7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:26.935241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fca07d16-79a0-494d-bf35-3995a3eda7d1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:26.936507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fca07d16-79a0-494d-bf35-3995a3eda7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:26.944740 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3681/7340] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:26.949172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a1a24-b654-4883-ac97-567bf7fdb773 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:26.959837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a1a24-b654-4883-ac97-567bf7fdb773 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:26.964437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d4944-6a7c-4bdf-bfd6-1cdf51f164ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:26.965073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d4944-6a7c-4bdf-bfd6-1cdf51f164ac admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:26.965353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d4944-6a7c-4bdf-bfd6-1cdf51f164ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:26.965626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d4944-6a7c-4bdf-bfd6-1cdf51f164ac admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:26.966269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d4944-6a7c-4bdf-bfd6-1cdf51f164ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:26.966570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d4944-6a7c-4bdf-bfd6-1cdf51f164ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:26.969172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d4944-6a7c-4bdf-bfd6-1cdf51f164ac admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:26.980976 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3660/7341] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:26.985723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca07d16-79a0-494d-bf35-3995a3eda7d1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:26.995061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca07d16-79a0-494d-bf35-3995a3eda7d1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.000033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c739b2e-65f9-49c0-973a-952074b93e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.000661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c739b2e-65f9-49c0-973a-952074b93e5e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.000948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c739b2e-65f9-49c0-973a-952074b93e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.001221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c739b2e-65f9-49c0-973a-952074b93e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.001849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c739b2e-65f9-49c0-973a-952074b93e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.003752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c739b2e-65f9-49c0-973a-952074b93e5e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.043230 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3682/7342] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:26 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:27.050840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d4944-6a7c-4bdf-bfd6-1cdf51f164ac admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.062728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d4944-6a7c-4bdf-bfd6-1cdf51f164ac admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.126344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c8cb3-d76e-4bf1-a617-63efe3ae519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.126971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c8cb3-d76e-4bf1-a617-63efe3ae519f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.127253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c8cb3-d76e-4bf1-a617-63efe3ae519f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.127529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c8cb3-d76e-4bf1-a617-63efe3ae519f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.128166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c8cb3-d76e-4bf1-a617-63efe3ae519f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.130144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c8cb3-d76e-4bf1-a617-63efe3ae519f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.152846 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3661/7343] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:27 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:27.157631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c739b2e-65f9-49c0-973a-952074b93e5e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.168446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c739b2e-65f9-49c0-973a-952074b93e5e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.174224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0404a6-1a0d-494f-bbff-43994036837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.174848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0404a6-1a0d-494f-bbff-43994036837f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.175205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0404a6-1a0d-494f-bbff-43994036837f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.175483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0404a6-1a0d-494f-bbff-43994036837f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.176128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0404a6-1a0d-494f-bbff-43994036837f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.177778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0404a6-1a0d-494f-bbff-43994036837f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.190451 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3683/7344] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:27.194595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c8cb3-d76e-4bf1-a617-63efe3ae519f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.206639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c8cb3-d76e-4bf1-a617-63efe3ae519f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.211628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8c2aa-4efc-44b9-89ae-96843ed1ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.212267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c2aa-4efc-44b9-89ae-96843ed1ec92 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.212569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c2aa-4efc-44b9-89ae-96843ed1ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.212870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c2aa-4efc-44b9-89ae-96843ed1ec92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.213512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8c2aa-4efc-44b9-89ae-96843ed1ec92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.215157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8c2aa-4efc-44b9-89ae-96843ed1ec92 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.226703 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3662/7345] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:27.230981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0404a6-1a0d-494f-bbff-43994036837f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.242184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0404a6-1a0d-494f-bbff-43994036837f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.247019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e4c3f-d62f-49bc-beae-da090e9ce9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.247683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e4c3f-d62f-49bc-beae-da090e9ce9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.248122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e4c3f-d62f-49bc-beae-da090e9ce9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.248943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e4c3f-d62f-49bc-beae-da090e9ce9c3 admin admin] PATH_INFO: `/v3/projects/908d7f04932e4eed8aabbda061387ad0/users/ec7f466de48d4baaadb6313701c28eef/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.266051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e4c3f-d62f-49bc-beae-da090e9ce9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908d7f04932e4eed8aabbda061387ad0, user_id=ec7f466de48d4baaadb6313701c28eef, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.269787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e4c3f-d62f-49bc-beae-da090e9ce9c3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.286901 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3684/7346] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:27 2022] PUT /identity/v3/projects/908d7f04932e4eed8aabbda061387ad0/users/ec7f466de48d4baaadb6313701c28eef/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:27.298144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438fa89-adb0-4982-bd38-6db563acfb86 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.298803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438fa89-adb0-4982-bd38-6db563acfb86 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.299086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438fa89-adb0-4982-bd38-6db563acfb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.341492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2438fa89-adb0-4982-bd38-6db563acfb86 None None] MFA Rules not processed for user `ec7f466de48d4baaadb6313701c28eef`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:27.342867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2438fa89-adb0-4982-bd38-6db563acfb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:27.381385 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:27.427756 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3663/7347] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:27.433274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e4c3f-d62f-49bc-beae-da090e9ce9c3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.497347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e4c3f-d62f-49bc-beae-da090e9ce9c3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.502055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f370192-5538-4622-a12b-da0745ecebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.502671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f370192-5538-4622-a12b-da0745ecebfb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.502954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f370192-5538-4622-a12b-da0745ecebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.503233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f370192-5538-4622-a12b-da0745ecebfb admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.503869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f370192-5538-4622-a12b-da0745ecebfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.505814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f370192-5538-4622-a12b-da0745ecebfb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.537323 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3685/7348] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:27 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:27.538658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438fa89-adb0-4982-bd38-6db563acfb86 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.549804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438fa89-adb0-4982-bd38-6db563acfb86 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.611561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236265c-38d1-4f1e-a7cc-70208e380764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.612180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236265c-38d1-4f1e-a7cc-70208e380764 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.612464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236265c-38d1-4f1e-a7cc-70208e380764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.612773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236265c-38d1-4f1e-a7cc-70208e380764 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.613420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236265c-38d1-4f1e-a7cc-70208e380764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.615369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236265c-38d1-4f1e-a7cc-70208e380764 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.645388 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3664/7349] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:27 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:27.650430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f370192-5538-4622-a12b-da0745ecebfb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.661838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f370192-5538-4622-a12b-da0745ecebfb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.666730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b0ca9-3625-49e0-bc7a-d22cc131df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.667510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b0ca9-3625-49e0-bc7a-d22cc131df0b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.667872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b0ca9-3625-49e0-bc7a-d22cc131df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.668243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b0ca9-3625-49e0-bc7a-d22cc131df0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.668941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b0ca9-3625-49e0-bc7a-d22cc131df0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.670641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b0ca9-3625-49e0-bc7a-d22cc131df0b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.683611 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3686/7350] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:27.688701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236265c-38d1-4f1e-a7cc-70208e380764 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.699521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236265c-38d1-4f1e-a7cc-70208e380764 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.704774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af46ca-79b6-4d87-8523-7b434c360328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.705432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af46ca-79b6-4d87-8523-7b434c360328 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.705717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af46ca-79b6-4d87-8523-7b434c360328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.705994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af46ca-79b6-4d87-8523-7b434c360328 admin admin] PATH_INFO: `/v3/projects/39da0f9cf6034126b25e5dc1fdc4b134/users/e6a4de074c144c30935b4d2b0763a526/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.721464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af46ca-79b6-4d87-8523-7b434c360328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39da0f9cf6034126b25e5dc1fdc4b134, user_id=e6a4de074c144c30935b4d2b0763a526, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.724150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af46ca-79b6-4d87-8523-7b434c360328 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.736717 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3665/7351] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:27 2022] PUT /identity/v3/projects/39da0f9cf6034126b25e5dc1fdc4b134/users/e6a4de074c144c30935b4d2b0763a526/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:27.740614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b0ca9-3625-49e0-bc7a-d22cc131df0b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.751559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b0ca9-3625-49e0-bc7a-d22cc131df0b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.806707 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:27.817884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df768a-6978-40c5-b5f5-ff99fcc3f26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.818532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df768a-6978-40c5-b5f5-ff99fcc3f26a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.818855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df768a-6978-40c5-b5f5-ff99fcc3f26a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.819373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df768a-6978-40c5-b5f5-ff99fcc3f26a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.820020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df768a-6978-40c5-b5f5-ff99fcc3f26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.821681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df768a-6978-40c5-b5f5-ff99fcc3f26a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.835868 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3687/7352] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:27.837132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af46ca-79b6-4d87-8523-7b434c360328 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.848727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af46ca-79b6-4d87-8523-7b434c360328 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:27.853320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ea465-c1a9-43f3-bbf5-72936d5bc107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:27.853969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ea465-c1a9-43f3-bbf5-72936d5bc107 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.854279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ea465-c1a9-43f3-bbf5-72936d5bc107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.854555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ea465-c1a9-43f3-bbf5-72936d5bc107 admin admin] PATH_INFO: `/v3/projects/39da0f9cf6034126b25e5dc1fdc4b134/users/e6a4de074c144c30935b4d2b0763a526/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.856473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ea465-c1a9-43f3-bbf5-72936d5bc107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39da0f9cf6034126b25e5dc1fdc4b134, user_id=e6a4de074c144c30935b4d2b0763a526, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:27.859131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ea465-c1a9-43f3-bbf5-72936d5bc107 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:27.869793 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3666/7353] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:27 2022] PUT /identity/v3/projects/39da0f9cf6034126b25e5dc1fdc4b134/users/e6a4de074c144c30935b4d2b0763a526/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:27.880226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5553f6-95d4-44f9-911a-a80995a1be97 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:27.880506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5553f6-95d4-44f9-911a-a80995a1be97 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:27.880810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5553f6-95d4-44f9-911a-a80995a1be97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:27.910023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0f5553f6-95d4-44f9-911a-a80995a1be97 None None] MFA Rules not processed for user `e6a4de074c144c30935b4d2b0763a526`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:27.911231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0f5553f6-95d4-44f9-911a-a80995a1be97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:27.981631 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3688/7354] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:27.986424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ea465-c1a9-43f3-bbf5-72936d5bc107 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:27.997412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ea465-c1a9-43f3-bbf5-72936d5bc107 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.002584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.003187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.003471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.003783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.004761 n-d-master-1 devstack@keystone.service[86424]: WARNING oslo_log.versionutils [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 19 01:21:28.005257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.006500 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:28.006500 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:21:28.006500 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:21:28.007400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.030945 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3667/7355] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:21:27 2022] POST /identity/v3/policies => generated 228 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:28.035104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5553f6-95d4-44f9-911a-a80995a1be97 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.044758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5553f6-95d4-44f9-911a-a80995a1be97 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.049740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.050392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.050681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.050961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies/4ee00bdbd4ae460084a06dca9883568c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.051992 n-d-master-1 devstack@keystone.service[86425]: WARNING oslo_log.versionutils [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 19 01:21:28.052435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=4ee00bdbd4ae460084a06dca9883568c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.053701 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:28.053701 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:21:28.053701 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:21:28.054609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.079324 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3689/7356] 10.222.0.27 () {60 vars in 1252 bytes} [Wed Oct 19 01:21:28 2022] PATCH /identity/v3/policies/4ee00bdbd4ae460084a06dca9883568c => generated 235 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:21:28.083538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.096042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb6467-4fc5-4b01-ba1a-3b73d0be7566 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.100956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.101665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.102021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.102370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies/4ee00bdbd4ae460084a06dca9883568c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.103214 n-d-master-1 devstack@keystone.service[86424]: WARNING oslo_log.versionutils [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 19 01:21:28.103891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=4ee00bdbd4ae460084a06dca9883568c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.105217 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:28.105217 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:21:28.105217 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:21:28.106286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.116921 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3668/7357] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:21:28 2022] GET /identity/v3/policies/4ee00bdbd4ae460084a06dca9883568c => generated 235 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:28.121029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.132870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf14d2-f56b-44fd-bab5-3cde7adb4cde tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.137557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.138195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.138477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.138754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies/4ee00bdbd4ae460084a06dca9883568c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.140700 n-d-master-1 devstack@keystone.service[86425]: WARNING oslo_log.versionutils [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 19 01:21:28.141274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=4ee00bdbd4ae460084a06dca9883568c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.142618 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:28.142618 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:21:28.142618 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:21:28.143532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.159313 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3690/7358] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:28 2022] DELETE /identity/v3/policies/4ee00bdbd4ae460084a06dca9883568c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:28.164433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.175614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabb36f-d5da-4dc9-98d4-7011fb062be3 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.180263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4f384-bbef-4b93-acb4-d70a23cd9388 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.180892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4f384-bbef-4b93-acb4-d70a23cd9388 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.181180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4f384-bbef-4b93-acb4-d70a23cd9388 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.181458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4f384-bbef-4b93-acb4-d70a23cd9388 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.182583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4f384-bbef-4b93-acb4-d70a23cd9388 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.184399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4f384-bbef-4b93-acb4-d70a23cd9388 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.207745 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3669/7359] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:21:28 2022] POST /identity/v3/policies => generated 229 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:28.209344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.220940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f217d9-0113-4ca7-9a54-11d47e778f24 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.225981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.226589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.226877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.227156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.228026 n-d-master-1 devstack@keystone.service[86425]: WARNING oslo_log.versionutils [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 19 01:21:28.228518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.229806 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:28.229806 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:21:28.229806 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:21:28.230701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.249688 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3691/7360] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:21:28 2022] POST /identity/v3/policies => generated 227 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:28.253755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4f384-bbef-4b93-acb4-d70a23cd9388 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.264806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4f384-bbef-4b93-acb4-d70a23cd9388 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.269590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bd698-399e-4cee-870f-8d003dd08055 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.270212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd698-399e-4cee-870f-8d003dd08055 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.270495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd698-399e-4cee-870f-8d003dd08055 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.270774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd698-399e-4cee-870f-8d003dd08055 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.271914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bd698-399e-4cee-870f-8d003dd08055 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.273785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bd698-399e-4cee-870f-8d003dd08055 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.292809 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3670/7361] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:21:28 2022] POST /identity/v3/policies => generated 229 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:28.297259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.309172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485aea-c052-42df-b6a4-7d5f7990960d tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.314687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.315295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.315580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.315858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.316644 n-d-master-1 devstack@keystone.service[86425]: WARNING oslo_log.versionutils [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 19 01:21:28.317213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.318435 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:28.318435 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:21:28.318435 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:21:28.319329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.330136 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3692/7362] 10.222.0.27 () {58 vars in 1131 bytes} [Wed Oct 19 01:21:28 2022] GET /identity/v3/policies => generated 761 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:28.334306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bd698-399e-4cee-870f-8d003dd08055 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.350150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bd698-399e-4cee-870f-8d003dd08055 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.355025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.355646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.355926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.356198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies/02bea04b225d4613a9d8ec99fcdcb770` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.357022 n-d-master-1 devstack@keystone.service[86424]: WARNING oslo_log.versionutils [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 19 01:21:28.357575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=02bea04b225d4613a9d8ec99fcdcb770)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.358848 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:28.358848 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:21:28.358848 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:21:28.359726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.375271 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3671/7363] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:28 2022] DELETE /identity/v3/policies/02bea04b225d4613a9d8ec99fcdcb770 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:28.379572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.391584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfef9c0-0bcc-4c8c-a654-29bef31997e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.398634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a0d2f-481c-4872-b50f-a76e458cdd61 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.399281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0d2f-481c-4872-b50f-a76e458cdd61 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.399563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0d2f-481c-4872-b50f-a76e458cdd61 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.400141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0d2f-481c-4872-b50f-a76e458cdd61 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies/a830f1a185834685a1afe99f5c0c0472` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.400957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0d2f-481c-4872-b50f-a76e458cdd61 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a830f1a185834685a1afe99f5c0c0472)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.402790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0d2f-481c-4872-b50f-a76e458cdd61 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.422340 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3693/7364] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:28 2022] DELETE /identity/v3/policies/a830f1a185834685a1afe99f5c0c0472 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:28.426958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.439224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e08e-5650-49cb-a84d-b57d761d6a6e tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.444771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b8d83-10bb-4bbc-8da2-5a05bb2857e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a4de074c144c30935b4d2b0763a526', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39da0f9cf6034126b25e5dc1fdc4b134', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.445736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8d83-10bb-4bbc-8da2-5a05bb2857e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.446112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8d83-10bb-4bbc-8da2-5a05bb2857e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.446496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8d83-10bb-4bbc-8da2-5a05bb2857e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] PATH_INFO: `/v3/policies/0b14a865e9324c7398dfef3e398c0db1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.447774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b8d83-10bb-4bbc-8da2-5a05bb2857e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=0b14a865e9324c7398dfef3e398c0db1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.449933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b8d83-10bb-4bbc-8da2-5a05bb2857e2 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.467931 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3672/7365] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:28 2022] DELETE /identity/v3/policies/0b14a865e9324c7398dfef3e398c0db1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:28.473497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a0d2f-481c-4872-b50f-a76e458cdd61 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.545116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a0d2f-481c-4872-b50f-a76e458cdd61 tempest-PoliciesTestJSON-1264702026 tempest-PoliciesTestJSON-1264702026-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.551878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.552530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.552855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.553131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] PATH_INFO: `/v3/users/ec7f466de48d4baaadb6313701c28eef` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.554441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec7f466de48d4baaadb6313701c28eef)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.556410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.563574 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:28.617411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec7f466de48d4baaadb6313701c28eef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.632334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec7f466de48d4baaadb6313701c28eef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.640527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec7f466de48d4baaadb6313701c28eef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.647870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec7f466de48d4baaadb6313701c28eef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.648703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec7f466de48d4baaadb6313701c28eef'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.655563 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3694/7366] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:28 2022] DELETE /identity/v3/users/ec7f466de48d4baaadb6313701c28eef => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:28.660192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81518c-e0ef-4232-8578-76bad9ef3533 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.660500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81518c-e0ef-4232-8578-76bad9ef3533 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.660815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81518c-e0ef-4232-8578-76bad9ef3533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.677486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.679269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:28.686179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2a81518c-e0ef-4232-8578-76bad9ef3533 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:28.687065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2a81518c-e0ef-4232-8578-76bad9ef3533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:28.691434 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:28.753406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e66b-f8cd-4f15-8e00-a1fbff90aeae admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.758186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.758809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.759090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.759361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] PATH_INFO: `/v3/users/a32a97a7d2f846958b5c4d636a9b71d1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.760484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32a97a7d2f846958b5c4d636a9b71d1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.762457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.764588 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3673/7367] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:28.776078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81518c-e0ef-4232-8578-76bad9ef3533 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.778022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2a81518c-e0ef-4232-8578-76bad9ef3533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:28.817496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32a97a7d2f846958b5c4d636a9b71d1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.830835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32a97a7d2f846958b5c4d636a9b71d1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.844548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32a97a7d2f846958b5c4d636a9b71d1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.852299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32a97a7d2f846958b5c4d636a9b71d1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.853271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-8812550a-2b36-4208-8d6e-28a1626e8b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32a97a7d2f846958b5c4d636a9b71d1'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:28.854497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81518c-e0ef-4232-8578-76bad9ef3533 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:28.860016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:28.860793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.861282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.861480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.863102 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3695/7368] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:28 2022] DELETE /identity/v3/users/a32a97a7d2f846958b5c4d636a9b71d1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:28.865266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:28.867417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464df11-01a0-4031-be14-e5e530a41c84 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:28.867710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464df11-01a0-4031-be14-e5e530a41c84 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:28.868052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464df11-01a0-4031-be14-e5e530a41c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:28.876489 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:28.881994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:28.884052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:28.889662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9464df11-01a0-4031-be14-e5e530a41c84 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:28.891434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9464df11-01a0-4031-be14-e5e530a41c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:28.896452 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3674/7369] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:21:28.968045 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3696/7370] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:28.979280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:28.982058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:29.004461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff3423-2a7a-44d2-9cee-5a2746ec8a1d service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:29.092046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f09444-b3bf-4e84-b89e-cfb181e61152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:29.094564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f09444-b3bf-4e84-b89e-cfb181e61152 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:29.094853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f09444-b3bf-4e84-b89e-cfb181e61152 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:29.095553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f09444-b3bf-4e84-b89e-cfb181e61152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:29.109144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f09444-b3bf-4e84-b89e-cfb181e61152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:29.111904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f09444-b3bf-4e84-b89e-cfb181e61152 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:29.124580 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3675/7371] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:29.268161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464df11-01a0-4031-be14-e5e530a41c84 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:29.269843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9464df11-01a0-4031-be14-e5e530a41c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:29.284473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464df11-01a0-4031-be14-e5e530a41c84 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:29.290839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:29.291630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:29.292554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:29.292554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] PATH_INFO: `/v3/projects/908d7f04932e4eed8aabbda061387ad0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:29.294101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=908d7f04932e4eed8aabbda061387ad0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:29.296230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:29.363670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908d7f04932e4eed8aabbda061387ad0', 'request_id': 'req-6a3627a3-ceea-45d8-92c7-b862c215bd6d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.374685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908d7f04932e4eed8aabbda061387ad0', 'request_id': 'req-6a3627a3-ceea-45d8-92c7-b862c215bd6d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.385895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908d7f04932e4eed8aabbda061387ad0', 'request_id': 'req-6a3627a3-ceea-45d8-92c7-b862c215bd6d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.400439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] The token cache is being invalidate because project 908d7f04932e4eed8aabbda061387ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:29.401021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.401793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.403646 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3697/7372] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:29 2022] DELETE /identity/v3/projects/908d7f04932e4eed8aabbda061387ad0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:29.408226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f09444-b3bf-4e84-b89e-cfb181e61152 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:29.418335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f09444-b3bf-4e84-b89e-cfb181e61152 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:29.477454 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:29.485776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:29.486424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:29.486706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:29.486979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] PATH_INFO: `/v3/users/e6a4de074c144c30935b4d2b0763a526` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:29.488652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a4de074c144c30935b4d2b0763a526)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:29.490580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:29.528099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:29.530005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:29.552856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a4de074c144c30935b4d2b0763a526'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.553843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3627a3-ceea-45d8-92c7-b862c215bd6d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:29.568736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:29.569211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a4de074c144c30935b4d2b0763a526'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.569567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:29.570221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:29.570505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] PATH_INFO: `/v3/projects/7a6c50151b9248c6869654273191cf63` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:29.571797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6c50151b9248c6869654273191cf63)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:29.574311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:29.581364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a4de074c144c30935b4d2b0763a526'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.591205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a4de074c144c30935b4d2b0763a526'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.591895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a4de074c144c30935b4d2b0763a526'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.599257 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3676/7373] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:29 2022] DELETE /identity/v3/users/e6a4de074c144c30935b4d2b0763a526 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:29.633433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6c50151b9248c6869654273191cf63', 'request_id': 'req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.644571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6c50151b9248c6869654273191cf63', 'request_id': 'req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.653509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6c50151b9248c6869654273191cf63', 'request_id': 'req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.672705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] The token cache is being invalidate because project 7a6c50151b9248c6869654273191cf63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:29.673012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.674038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.677391 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3698/7374] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:29 2022] DELETE /identity/v3/projects/7a6c50151b9248c6869654273191cf63 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:29.681822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:29.683488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:29.759027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e45a96-a56d-436a-96ae-d53e1f62aa1d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:29.838721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:29.839377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:29.839664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:29.839942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] PATH_INFO: `/v3/users/4634225d1113477b9c41ffe2f6c2b038` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:29.846328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4634225d1113477b9c41ffe2f6c2b038)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:29.849223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:29.876775 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:29.910794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4634225d1113477b9c41ffe2f6c2b038'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.926509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4634225d1113477b9c41ffe2f6c2b038'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.938907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4634225d1113477b9c41ffe2f6c2b038'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.948990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4634225d1113477b9c41ffe2f6c2b038'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.949748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1ebc9e41-f6da-43a5-9958-3a0da9962b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4634225d1113477b9c41ffe2f6c2b038'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:29.963503 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3677/7375] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:29 2022] DELETE /identity/v3/users/4634225d1113477b9c41ffe2f6c2b038 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:29.991926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:29.993539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:30.019405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f635-76e8-4f7a-9a00-fbb7b98e76a6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.033525 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:30.115062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.116319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.116564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.116877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] PATH_INFO: `/v3/projects/39da0f9cf6034126b25e5dc1fdc4b134` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.118069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39da0f9cf6034126b25e5dc1fdc4b134)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.120753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.192207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39da0f9cf6034126b25e5dc1fdc4b134', 'request_id': 'req-5363356b-ca0a-433c-997f-6ba11b57ea3e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.201274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39da0f9cf6034126b25e5dc1fdc4b134', 'request_id': 'req-5363356b-ca0a-433c-997f-6ba11b57ea3e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.208142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39da0f9cf6034126b25e5dc1fdc4b134', 'request_id': 'req-5363356b-ca0a-433c-997f-6ba11b57ea3e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.222907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] The token cache is being invalidate because project 39da0f9cf6034126b25e5dc1fdc4b134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:30.223260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.224050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.225819 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3699/7376] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:29 2022] DELETE /identity/v3/projects/39da0f9cf6034126b25e5dc1fdc4b134 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:30.230803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37532ab-2373-4a32-9eab-cae76c1b097c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.231097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37532ab-2373-4a32-9eab-cae76c1b097c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.231371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37532ab-2373-4a32-9eab-cae76c1b097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.254521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d37532ab-2373-4a32-9eab-cae76c1b097c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:30.255763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d37532ab-2373-4a32-9eab-cae76c1b097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:30.313017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.314764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:30.341313 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3678/7377] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:30.349992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106a034-66fa-4d95-b492-ed5fd1ce27f5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.350283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106a034-66fa-4d95-b492-ed5fd1ce27f5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.350562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106a034-66fa-4d95-b492-ed5fd1ce27f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.379936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7106a034-66fa-4d95-b492-ed5fd1ce27f5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:30.381516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7106a034-66fa-4d95-b492-ed5fd1ce27f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:30.408946 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3679/7378] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:30.413151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106a034-66fa-4d95-b492-ed5fd1ce27f5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.423390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106a034-66fa-4d95-b492-ed5fd1ce27f5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.428290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997c545-9688-400a-8842-2c079cb1c985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.429028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997c545-9688-400a-8842-2c079cb1c985 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.429401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997c545-9688-400a-8842-2c079cb1c985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.429792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997c545-9688-400a-8842-2c079cb1c985 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.430507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997c545-9688-400a-8842-2c079cb1c985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:30.430888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997c545-9688-400a-8842-2c079cb1c985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.432535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997c545-9688-400a-8842-2c079cb1c985 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.447192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363356b-ca0a-433c-997f-6ba11b57ea3e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.449064 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3680/7379] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:21:30.454707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997c545-9688-400a-8842-2c079cb1c985 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.457077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.457734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.458023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.458295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] PATH_INFO: `/v3/projects/b2c16006c2234192ae03173793e1370d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.459441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c16006c2234192ae03173793e1370d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.462070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.466114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997c545-9688-400a-8842-2c079cb1c985 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.472952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c71942-e744-4003-a07e-35183161a7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.473846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c71942-e744-4003-a07e-35183161a7de admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.474221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c71942-e744-4003-a07e-35183161a7de admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.474557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c71942-e744-4003-a07e-35183161a7de admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.475314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c71942-e744-4003-a07e-35183161a7de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.477318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c71942-e744-4003-a07e-35183161a7de admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.508660 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3681/7380] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:30.510682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c71942-e744-4003-a07e-35183161a7de admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.517294 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:30.523279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c16006c2234192ae03173793e1370d', 'request_id': 'req-72a18340-abf3-4c01-944c-857a6d92bbe5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.534907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c16006c2234192ae03173793e1370d', 'request_id': 'req-72a18340-abf3-4c01-944c-857a6d92bbe5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.541553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c16006c2234192ae03173793e1370d', 'request_id': 'req-72a18340-abf3-4c01-944c-857a6d92bbe5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.556946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] The token cache is being invalidate because project b2c16006c2234192ae03173793e1370d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:30.557280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.558340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-72a18340-abf3-4c01-944c-857a6d92bbe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:30.560258 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3700/7381] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:30 2022] DELETE /identity/v3/projects/b2c16006c2234192ae03173793e1370d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:30.565008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e5255-54a6-4024-9b82-d952eb9cd958 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.565298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e5255-54a6-4024-9b82-d952eb9cd958 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.565581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e5255-54a6-4024-9b82-d952eb9cd958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.583876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c71942-e744-4003-a07e-35183161a7de admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.589251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47dab-c0ca-47ab-923d-16a0df7450ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.589602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-360e5255-54a6-4024-9b82-d952eb9cd958 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:30.590009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47dab-c0ca-47ab-923d-16a0df7450ff admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.590383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47dab-c0ca-47ab-923d-16a0df7450ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.590731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47dab-c0ca-47ab-923d-16a0df7450ff admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.590830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-360e5255-54a6-4024-9b82-d952eb9cd958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:30.591444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e47dab-c0ca-47ab-923d-16a0df7450ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.594214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e47dab-c0ca-47ab-923d-16a0df7450ff admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.600058 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3701/7382] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:30.603506 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:30.608749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da32d28-fa06-4bde-82a3-de3208700f63 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.609053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da32d28-fa06-4bde-82a3-de3208700f63 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.609397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da32d28-fa06-4bde-82a3-de3208700f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.626012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3682/7383] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:30.627200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47dab-c0ca-47ab-923d-16a0df7450ff admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.628998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8e47dab-c0ca-47ab-923d-16a0df7450ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:30.632368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7da32d28-fa06-4bde-82a3-de3208700f63 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:30.633671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7da32d28-fa06-4bde-82a3-de3208700f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:30.641645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47dab-c0ca-47ab-923d-16a0df7450ff admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.643218 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3702/7384] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:30.647034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da32d28-fa06-4bde-82a3-de3208700f63 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.648351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a686e-d908-4105-8c6c-9c270a9d9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.649080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a686e-d908-4105-8c6c-9c270a9d9db4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.649435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a686e-d908-4105-8c6c-9c270a9d9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.649780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a686e-d908-4105-8c6c-9c270a9d9db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.650495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a686e-d908-4105-8c6c-9c270a9d9db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.652229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a686e-d908-4105-8c6c-9c270a9d9db4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.656951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da32d28-fa06-4bde-82a3-de3208700f63 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.662076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae20e5f-3a80-412e-9503-2802f85741d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.662683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae20e5f-3a80-412e-9503-2802f85741d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.663568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae20e5f-3a80-412e-9503-2802f85741d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.663850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae20e5f-3a80-412e-9503-2802f85741d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.664755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae20e5f-3a80-412e-9503-2802f85741d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:30.664878 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3683/7385] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:30.667733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae20e5f-3a80-412e-9503-2802f85741d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.668472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a686e-d908-4105-8c6c-9c270a9d9db4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.669417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae20e5f-3a80-412e-9503-2802f85741d1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.679578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a686e-d908-4105-8c6c-9c270a9d9db4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.684528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c28f5-0bfa-4248-8bda-12aee85ed42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.685510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c28f5-0bfa-4248-8bda-12aee85ed42f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.686991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c28f5-0bfa-4248-8bda-12aee85ed42f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.687366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c28f5-0bfa-4248-8bda-12aee85ed42f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.688147 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3703/7386] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:30.688266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c28f5-0bfa-4248-8bda-12aee85ed42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.689832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c28f5-0bfa-4248-8bda-12aee85ed42f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.692572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae20e5f-3a80-412e-9503-2802f85741d1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.702829 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3684/7387] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:30.705114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae20e5f-3a80-412e-9503-2802f85741d1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.706688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c28f5-0bfa-4248-8bda-12aee85ed42f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.710019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291ec6d-b43d-4b5c-a5dd-cde9729a2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.710635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291ec6d-b43d-4b5c-a5dd-cde9729a2f86 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.710924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291ec6d-b43d-4b5c-a5dd-cde9729a2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.711185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291ec6d-b43d-4b5c-a5dd-cde9729a2f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.711821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291ec6d-b43d-4b5c-a5dd-cde9729a2f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.713768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291ec6d-b43d-4b5c-a5dd-cde9729a2f86 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.716901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c28f5-0bfa-4248-8bda-12aee85ed42f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.721928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0622f-3c51-4aaa-8376-30e5276effa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.722591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0622f-3c51-4aaa-8376-30e5276effa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.722871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0622f-3c51-4aaa-8376-30e5276effa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.723151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0622f-3c51-4aaa-8376-30e5276effa9 admin admin] PATH_INFO: `/v3/projects/ef081f84a9644bb3959252e5263f1da8/users/7592d41f8b2f4361be2609fbed3ec143/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.740989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0622f-3c51-4aaa-8376-30e5276effa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef081f84a9644bb3959252e5263f1da8, user_id=7592d41f8b2f4361be2609fbed3ec143, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.743665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0622f-3c51-4aaa-8376-30e5276effa9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.744442 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3704/7388] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:30.749690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291ec6d-b43d-4b5c-a5dd-cde9729a2f86 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.762483 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3685/7389] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:30 2022] PUT /identity/v3/projects/ef081f84a9644bb3959252e5263f1da8/users/7592d41f8b2f4361be2609fbed3ec143/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:30.827777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291ec6d-b43d-4b5c-a5dd-cde9729a2f86 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.853173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9add0-b128-4167-8093-9cacb7f2bfac None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.853493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9add0-b128-4167-8093-9cacb7f2bfac None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.853778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9add0-b128-4167-8093-9cacb7f2bfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.890455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5bf9add0-b128-4167-8093-9cacb7f2bfac None None] MFA Rules not processed for user `7592d41f8b2f4361be2609fbed3ec143`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:30.891804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5bf9add0-b128-4167-8093-9cacb7f2bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:30.894086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211c7cc-e876-47e6-ba12-4886b60efaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.894713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211c7cc-e876-47e6-ba12-4886b60efaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.894995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211c7cc-e876-47e6-ba12-4886b60efaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.895273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211c7cc-e876-47e6-ba12-4886b60efaf4 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.896173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211c7cc-e876-47e6-ba12-4886b60efaf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.898362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211c7cc-e876-47e6-ba12-4886b60efaf4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.925169 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3705/7390] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:30.928967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211c7cc-e876-47e6-ba12-4886b60efaf4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.940851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211c7cc-e876-47e6-ba12-4886b60efaf4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.946409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73637-dc8f-41a5-9535-dc879837a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.947121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73637-dc8f-41a5-9535-dc879837a65f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.947410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73637-dc8f-41a5-9535-dc879837a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.947713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73637-dc8f-41a5-9535-dc879837a65f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.948507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c73637-dc8f-41a5-9535-dc879837a65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.950708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c73637-dc8f-41a5-9535-dc879837a65f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.962654 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3706/7391] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:30.966213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73637-dc8f-41a5-9535-dc879837a65f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.971629 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3686/7392] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:30.972780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9add0-b128-4167-8093-9cacb7f2bfac None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:30.977838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73637-dc8f-41a5-9535-dc879837a65f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.983529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64e69e-0b9d-4968-9db0-55a5e45746fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.984191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64e69e-0b9d-4968-9db0-55a5e45746fa admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.984553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64e69e-0b9d-4968-9db0-55a5e45746fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.984925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64e69e-0b9d-4968-9db0-55a5e45746fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.985233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9add0-b128-4167-8093-9cacb7f2bfac None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:30.985731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64e69e-0b9d-4968-9db0-55a5e45746fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.987383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64e69e-0b9d-4968-9db0-55a5e45746fa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:30.989856 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:30.990944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9fac8-f828-4a0a-bc5b-1f5ffc9e999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:30.991653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9fac8-f828-4a0a-bc5b-1f5ffc9e999b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:30.992020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9fac8-f828-4a0a-bc5b-1f5ffc9e999b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:30.992452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9fac8-f828-4a0a-bc5b-1f5ffc9e999b admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:30.993076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9fac8-f828-4a0a-bc5b-1f5ffc9e999b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:30.995587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9fac8-f828-4a0a-bc5b-1f5ffc9e999b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.004301 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3707/7393] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:31.005643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64e69e-0b9d-4968-9db0-55a5e45746fa admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.017853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64e69e-0b9d-4968-9db0-55a5e45746fa admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.023301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656dd83-07d7-40f9-8cca-a29bc0198ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.024046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656dd83-07d7-40f9-8cca-a29bc0198ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.024403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656dd83-07d7-40f9-8cca-a29bc0198ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.024784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656dd83-07d7-40f9-8cca-a29bc0198ec0 admin admin] PATH_INFO: `/v3/projects/712de07c21e04da39299e7f53a7b6a29/users/2e17cb04dd32451fa3a46c941fe1ca81/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.027916 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3687/7394] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:30 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:31.032255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9fac8-f828-4a0a-bc5b-1f5ffc9e999b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.043433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656dd83-07d7-40f9-8cca-a29bc0198ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712de07c21e04da39299e7f53a7b6a29, user_id=2e17cb04dd32451fa3a46c941fe1ca81, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.046820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656dd83-07d7-40f9-8cca-a29bc0198ec0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.061387 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3708/7395] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:31 2022] PUT /identity/v3/projects/712de07c21e04da39299e7f53a7b6a29/users/2e17cb04dd32451fa3a46c941fe1ca81/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:31.066032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bf26d-ec61-4888-89b5-6d8a9b75de49 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.066319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bf26d-ec61-4888-89b5-6d8a9b75de49 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.066595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bf26d-ec61-4888-89b5-6d8a9b75de49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.086023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0c1bf26d-ec61-4888-89b5-6d8a9b75de49 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:31.087442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0c1bf26d-ec61-4888-89b5-6d8a9b75de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:31.113819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9fac8-f828-4a0a-bc5b-1f5ffc9e999b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.128764 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:31.167950 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3709/7396] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:31.177994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bf26d-ec61-4888-89b5-6d8a9b75de49 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.180223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0c1bf26d-ec61-4888-89b5-6d8a9b75de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:31.192347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b8bab-e931-4c27-aa33-82f86c369562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.193216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b8bab-e931-4c27-aa33-82f86c369562 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.193569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b8bab-e931-4c27-aa33-82f86c369562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.193912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b8bab-e931-4c27-aa33-82f86c369562 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.194788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b8bab-e931-4c27-aa33-82f86c369562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.197366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b8bab-e931-4c27-aa33-82f86c369562 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.226276 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3688/7397] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:31 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:31.230029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b8bab-e931-4c27-aa33-82f86c369562 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.241433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b8bab-e931-4c27-aa33-82f86c369562 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.246248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa26445-4c34-40e2-b626-9c05d85d19a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.246871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa26445-4c34-40e2-b626-9c05d85d19a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.247152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa26445-4c34-40e2-b626-9c05d85d19a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.247425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa26445-4c34-40e2-b626-9c05d85d19a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.248078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa26445-4c34-40e2-b626-9c05d85d19a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.250515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa26445-4c34-40e2-b626-9c05d85d19a4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.255596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bf26d-ec61-4888-89b5-6d8a9b75de49 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.259799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5f5b8-c2ae-4847-b644-537187bd9f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.260430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5f5b8-c2ae-4847-b644-537187bd9f90 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.260747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5f5b8-c2ae-4847-b644-537187bd9f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.261026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5f5b8-c2ae-4847-b644-537187bd9f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.262012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3689/7398] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:31.266654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa26445-4c34-40e2-b626-9c05d85d19a4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.272494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5f5b8-c2ae-4847-b644-537187bd9f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.274041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5f5b8-c2ae-4847-b644-537187bd9f90 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.277439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa26445-4c34-40e2-b626-9c05d85d19a4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.282853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895170f-9ec6-4a32-ac66-5a7f862fc0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.283525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895170f-9ec6-4a32-ac66-5a7f862fc0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.283815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895170f-9ec6-4a32-ac66-5a7f862fc0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.284078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895170f-9ec6-4a32-ac66-5a7f862fc0dc admin admin] PATH_INFO: `/v3/projects/fec233ca405e4b6aa5070febf83a254a/users/0870ef36b5ac4248be96938e4af9f14e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.289781 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3710/7399] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:21:31.301769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895170f-9ec6-4a32-ac66-5a7f862fc0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec233ca405e4b6aa5070febf83a254a, user_id=0870ef36b5ac4248be96938e4af9f14e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.305220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895170f-9ec6-4a32-ac66-5a7f862fc0dc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.324853 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3690/7400] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:31 2022] PUT /identity/v3/projects/fec233ca405e4b6aa5070febf83a254a/users/0870ef36b5ac4248be96938e4af9f14e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:31.325755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5f5b8-c2ae-4847-b644-537187bd9f90 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.338078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5f5b8-c2ae-4847-b644-537187bd9f90 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.400097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb66114-49a5-4a08-8c67-f6dd6776e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.400757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb66114-49a5-4a08-8c67-f6dd6776e93b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.401041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb66114-49a5-4a08-8c67-f6dd6776e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.401318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb66114-49a5-4a08-8c67-f6dd6776e93b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.401961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb66114-49a5-4a08-8c67-f6dd6776e93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.403848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb66114-49a5-4a08-8c67-f6dd6776e93b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.419122 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3711/7401] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:31.421335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895170f-9ec6-4a32-ac66-5a7f862fc0dc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.432706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895170f-9ec6-4a32-ac66-5a7f862fc0dc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.439185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c143b6-5e5a-41a8-ad13-7dfa35e6efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.440044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c143b6-5e5a-41a8-ad13-7dfa35e6efdb admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.440275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c143b6-5e5a-41a8-ad13-7dfa35e6efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.440638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c143b6-5e5a-41a8-ad13-7dfa35e6efdb admin admin] PATH_INFO: `/v3/projects/fec233ca405e4b6aa5070febf83a254a/users/0870ef36b5ac4248be96938e4af9f14e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.442725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c143b6-5e5a-41a8-ad13-7dfa35e6efdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec233ca405e4b6aa5070febf83a254a, user_id=0870ef36b5ac4248be96938e4af9f14e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.445516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c143b6-5e5a-41a8-ad13-7dfa35e6efdb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.461039 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3691/7402] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:31 2022] PUT /identity/v3/projects/fec233ca405e4b6aa5070febf83a254a/users/0870ef36b5ac4248be96938e4af9f14e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:31.475978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87509dee-2913-4697-9bf2-93a8bfe03834 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.475978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87509dee-2913-4697-9bf2-93a8bfe03834 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.475978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87509dee-2913-4697-9bf2-93a8bfe03834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.502266 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:31.508350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-87509dee-2913-4697-9bf2-93a8bfe03834 None None] MFA Rules not processed for user `0870ef36b5ac4248be96938e4af9f14e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:31.510769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-87509dee-2913-4697-9bf2-93a8bfe03834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:31.591901 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3712/7403] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:31.597525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c143b6-5e5a-41a8-ad13-7dfa35e6efdb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.608743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c143b6-5e5a-41a8-ad13-7dfa35e6efdb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.616767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0013f3b-11f6-49b1-bec1-2c75d9a69e47 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0870ef36b5ac4248be96938e4af9f14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec233ca405e4b6aa5070febf83a254a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.617404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013f3b-11f6-49b1-bec1-2c75d9a69e47 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.617689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013f3b-11f6-49b1-bec1-2c75d9a69e47 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.617979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013f3b-11f6-49b1-bec1-2c75d9a69e47 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.618703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0013f3b-11f6-49b1-bec1-2c75d9a69e47 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.620852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0013f3b-11f6-49b1-bec1-2c75d9a69e47 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.659957 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3692/7404] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:31 2022] POST /identity/v3/projects => generated 359 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:31.664533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87509dee-2913-4697-9bf2-93a8bfe03834 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.746741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87509dee-2913-4697-9bf2-93a8bfe03834 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.819431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199a17-5fed-426c-9e2c-4942591b566c tempest-ProjectsNegativeTestJSON-1449912630 tempest-ProjectsNegativeTestJSON-1449912630-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7592d41f8b2f4361be2609fbed3ec143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef081f84a9644bb3959252e5263f1da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.820164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199a17-5fed-426c-9e2c-4942591b566c tempest-ProjectsNegativeTestJSON-1449912630 tempest-ProjectsNegativeTestJSON-1449912630-project] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.820453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199a17-5fed-426c-9e2c-4942591b566c tempest-ProjectsNegativeTestJSON-1449912630 tempest-ProjectsNegativeTestJSON-1449912630-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.820766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199a17-5fed-426c-9e2c-4942591b566c tempest-ProjectsNegativeTestJSON-1449912630 tempest-ProjectsNegativeTestJSON-1449912630-project] PATH_INFO: `/v3/projects/127e3a1a56ba4b0586de184ca8758b37` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.822074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b199a17-5fed-426c-9e2c-4942591b566c tempest-ProjectsNegativeTestJSON-1449912630 tempest-ProjectsNegativeTestJSON-1449912630-project] RBAC: Authorizing `identity:delete_project(project_id=127e3a1a56ba4b0586de184ca8758b37)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-8b199a17-5fed-426c-9e2c-4942591b566c tempest-ProjectsNegativeTestJSON-1449912630 tempest-ProjectsNegativeTestJSON-1449912630-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 19 01:21:31.839984 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 19 01:21:31.841084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 19 01:21:31.841084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 19 01:21:31.841084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 19 01:21:31.841084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 19 01:21:31.841084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 01:21:31.841084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 19 01:21:31.841084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 19 01:21:31.841084 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:21:31.842723 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3713/7405] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:31 2022] DELETE /identity/v3/projects/127e3a1a56ba4b0586de184ca8758b37 => generated 136 bytes in 178 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:21:31.846426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0013f3b-11f6-49b1-bec1-2c75d9a69e47 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:31.921872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0013f3b-11f6-49b1-bec1-2c75d9a69e47 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:31.927319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0870ef36b5ac4248be96938e4af9f14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec233ca405e4b6aa5070febf83a254a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:31.927986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:31.928273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:31.928555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] PATH_INFO: `/v3/projects/127e3a1a56ba4b0586de184ca8758b37` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:31.930065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] RBAC: Authorizing `identity:delete_project(project_id=127e3a1a56ba4b0586de184ca8758b37)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:31.932400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:31.992593 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:32.012382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127e3a1a56ba4b0586de184ca8758b37', 'request_id': 'req-763c98ea-f606-48da-8069-30f4bde20e28'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.030973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127e3a1a56ba4b0586de184ca8758b37', 'request_id': 'req-763c98ea-f606-48da-8069-30f4bde20e28'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.033241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2330a-0434-4891-aae4-cbf4c79cc48b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.033721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2330a-0434-4891-aae4-cbf4c79cc48b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.034006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2330a-0434-4891-aae4-cbf4c79cc48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.041586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127e3a1a56ba4b0586de184ca8758b37', 'request_id': 'req-763c98ea-f606-48da-8069-30f4bde20e28'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.057977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] The token cache is being invalidate because project 127e3a1a56ba4b0586de184ca8758b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:32.059020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.062560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.064204 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3693/7406] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:31 2022] DELETE /identity/v3/projects/127e3a1a56ba4b0586de184ca8758b37 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:32.069140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.073624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:32.080503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c7a2330a-0434-4891-aae4-cbf4c79cc48b None None] MFA Rules not processed for user `2e17cb04dd32451fa3a46c941fe1ca81`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:32.081499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c7a2330a-0434-4891-aae4-cbf4c79cc48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:32.143685 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:32.171361 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3714/7407] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:32.175087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2330a-0434-4891-aae4-cbf4c79cc48b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.176573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c7a2330a-0434-4891-aae4-cbf4c79cc48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:32.177691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c98ea-f606-48da-8069-30f4bde20e28 tempest-ProjectsNegativeTestJSON-1434481805 tempest-ProjectsNegativeTestJSON-1434481805-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:32.182881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:32.183688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.184105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.184394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] PATH_INFO: `/v3/users/7592d41f8b2f4361be2609fbed3ec143` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.186774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7592d41f8b2f4361be2609fbed3ec143)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:32.190304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:32.193202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2330a-0434-4891-aae4-cbf4c79cc48b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:32.198369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa5ebf-4696-430d-aa6f-8ffaa00cfd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:32.198994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa5ebf-4696-430d-aa6f-8ffaa00cfd01 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.199269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa5ebf-4696-430d-aa6f-8ffaa00cfd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.199539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa5ebf-4696-430d-aa6f-8ffaa00cfd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.200176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa5ebf-4696-430d-aa6f-8ffaa00cfd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:32.202217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa5ebf-4696-430d-aa6f-8ffaa00cfd01 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:32.243290 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3715/7408] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:32 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:32.247246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa5ebf-4696-430d-aa6f-8ffaa00cfd01 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.256491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7592d41f8b2f4361be2609fbed3ec143'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.269993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7592d41f8b2f4361be2609fbed3ec143'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.278200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7592d41f8b2f4361be2609fbed3ec143'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.287972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7592d41f8b2f4361be2609fbed3ec143'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.288722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4737734f-e2d5-4018-9d7b-0cb87a3431e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7592d41f8b2f4361be2609fbed3ec143'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.297593 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3694/7409] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:32 2022] DELETE /identity/v3/users/7592d41f8b2f4361be2609fbed3ec143 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:32.302078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c4247-ecf3-47e4-bea2-2c09b00ae901 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.302442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c4247-ecf3-47e4-bea2-2c09b00ae901 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.302795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c4247-ecf3-47e4-bea2-2c09b00ae901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.324589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa5ebf-4696-430d-aa6f-8ffaa00cfd01 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:32.327340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-de9c4247-ecf3-47e4-bea2-2c09b00ae901 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:32.329109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-de9c4247-ecf3-47e4-bea2-2c09b00ae901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:32.378461 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:32.388777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c475346-19ed-476e-855f-7b4b03758ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:32.389612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475346-19ed-476e-855f-7b4b03758ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.389723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475346-19ed-476e-855f-7b4b03758ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.389961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475346-19ed-476e-855f-7b4b03758ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.390614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c475346-19ed-476e-855f-7b4b03758ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:32.392768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c475346-19ed-476e-855f-7b4b03758ec7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:32.406878 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3695/7410] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:32.417601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c4247-ecf3-47e4-bea2-2c09b00ae901 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.419484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-de9c4247-ecf3-47e4-bea2-2c09b00ae901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:32.421726 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3716/7411] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:32 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:32.422777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c475346-19ed-476e-855f-7b4b03758ec7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.424345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5c475346-19ed-476e-855f-7b4b03758ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:32.437678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c475346-19ed-476e-855f-7b4b03758ec7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:32.442713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8ff4b-838e-4589-a791-0b3cc867b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:32.443320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8ff4b-838e-4589-a791-0b3cc867b3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.443599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8ff4b-838e-4589-a791-0b3cc867b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.443867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8ff4b-838e-4589-a791-0b3cc867b3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.444507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8ff4b-838e-4589-a791-0b3cc867b3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:32.446144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8ff4b-838e-4589-a791-0b3cc867b3d1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:32.459406 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3717/7412] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:32.463555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8ff4b-838e-4589-a791-0b3cc867b3d1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.476009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8ff4b-838e-4589-a791-0b3cc867b3d1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:32.481497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee69bc-f822-418f-b726-b8b0362e1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:32.482386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee69bc-f822-418f-b726-b8b0362e1fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.483261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee69bc-f822-418f-b726-b8b0362e1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.483956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee69bc-f822-418f-b726-b8b0362e1fa1 admin admin] PATH_INFO: `/v3/projects/5ad2672ed9de4e938b7166ba9203890e/users/a0064f3ced69420d93d22be5b419a15c/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.493951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c4247-ecf3-47e4-bea2-2c09b00ae901 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:32.498196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849e6ae-a736-4c59-89ec-e825887b9947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:32.499617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849e6ae-a736-4c59-89ec-e825887b9947 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.500237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849e6ae-a736-4c59-89ec-e825887b9947 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.500524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849e6ae-a736-4c59-89ec-e825887b9947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.502869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee69bc-f822-418f-b726-b8b0362e1fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad2672ed9de4e938b7166ba9203890e, user_id=a0064f3ced69420d93d22be5b419a15c, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:32.505581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee69bc-f822-418f-b726-b8b0362e1fa1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:32.510815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849e6ae-a736-4c59-89ec-e825887b9947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:32.512612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849e6ae-a736-4c59-89ec-e825887b9947 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:32.519363 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3718/7413] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:32 2022] PUT /identity/v3/projects/5ad2672ed9de4e938b7166ba9203890e/users/a0064f3ced69420d93d22be5b419a15c/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:32.523311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee69bc-f822-418f-b726-b8b0362e1fa1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.523708 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3696/7414] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:21:32.553657 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:32.589673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee69bc-f822-418f-b726-b8b0362e1fa1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:32.595574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175abfdd-8a18-4a94-a2e8-d6e0abf71ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:32.596178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abfdd-8a18-4a94-a2e8-d6e0abf71ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.596457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abfdd-8a18-4a94-a2e8-d6e0abf71ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.596765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abfdd-8a18-4a94-a2e8-d6e0abf71ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.597401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175abfdd-8a18-4a94-a2e8-d6e0abf71ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:32.599110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175abfdd-8a18-4a94-a2e8-d6e0abf71ea0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:32.610117 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3719/7415] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:32.614427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849e6ae-a736-4c59-89ec-e825887b9947 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.624677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849e6ae-a736-4c59-89ec-e825887b9947 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:32.630589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c827aa-7ac6-458a-b551-3e66c5fd7f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:32.631253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c827aa-7ac6-458a-b551-3e66c5fd7f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.631538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c827aa-7ac6-458a-b551-3e66c5fd7f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.631814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c827aa-7ac6-458a-b551-3e66c5fd7f25 admin admin] PATH_INFO: `/v3/projects/5ad2672ed9de4e938b7166ba9203890e/users/a0064f3ced69420d93d22be5b419a15c/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.633772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c827aa-7ac6-458a-b551-3e66c5fd7f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad2672ed9de4e938b7166ba9203890e, user_id=a0064f3ced69420d93d22be5b419a15c, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:32.636432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c827aa-7ac6-458a-b551-3e66c5fd7f25 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:32.647983 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3697/7416] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:32 2022] PUT /identity/v3/projects/5ad2672ed9de4e938b7166ba9203890e/users/a0064f3ced69420d93d22be5b419a15c/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:32.809806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175abfdd-8a18-4a94-a2e8-d6e0abf71ea0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.812111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-175abfdd-8a18-4a94-a2e8-d6e0abf71ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:32.826185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175abfdd-8a18-4a94-a2e8-d6e0abf71ea0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:32.890628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:32.891211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:32.891447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:32.891739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] PATH_INFO: `/v3/projects/ef081f84a9644bb3959252e5263f1da8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:32.893045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef081f84a9644bb3959252e5263f1da8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:32.894960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:32.946446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef081f84a9644bb3959252e5263f1da8', 'request_id': 'req-52538b23-51c4-4cb8-836e-0bb86cf9862e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.955257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef081f84a9644bb3959252e5263f1da8', 'request_id': 'req-52538b23-51c4-4cb8-836e-0bb86cf9862e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.961060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef081f84a9644bb3959252e5263f1da8', 'request_id': 'req-52538b23-51c4-4cb8-836e-0bb86cf9862e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.973404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] The token cache is being invalidate because project ef081f84a9644bb3959252e5263f1da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:32.973854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.974732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-52538b23-51c4-4cb8-836e-0bb86cf9862e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:32.983388 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3720/7417] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:32 2022] DELETE /identity/v3/projects/ef081f84a9644bb3959252e5263f1da8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:32.987135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c827aa-7ac6-458a-b551-3e66c5fd7f25 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:32.988986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-94c827aa-7ac6-458a-b551-3e66c5fd7f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:33.004203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c827aa-7ac6-458a-b551-3e66c5fd7f25 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:33.078097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:33.078739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.079016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.079285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] PATH_INFO: `/v3/users/0870ef36b5ac4248be96938e4af9f14e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.080409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0870ef36b5ac4248be96938e4af9f14e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:33.082694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:33.140803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0870ef36b5ac4248be96938e4af9f14e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.155212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0870ef36b5ac4248be96938e4af9f14e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.162918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0870ef36b5ac4248be96938e4af9f14e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.168960 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:33.172487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0870ef36b5ac4248be96938e4af9f14e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.172958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0870ef36b5ac4248be96938e4af9f14e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.181734 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3698/7418] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:32 2022] DELETE /identity/v3/users/0870ef36b5ac4248be96938e4af9f14e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:33.437516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4113-163e-4315-a0bb-12b7be1992c8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.438017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4113-163e-4315-a0bb-12b7be1992c8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.438133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4113-163e-4315-a0bb-12b7be1992c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.470563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2a7f4113-163e-4315-a0bb-12b7be1992c8 None None] MFA Rules not processed for user `a0064f3ced69420d93d22be5b419a15c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:33.471792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2a7f4113-163e-4315-a0bb-12b7be1992c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:33.487990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:33.490048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:33.521853 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:33.566028 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3721/7419] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:33.567305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e715c-ae44-4d23-b9f8-0d8cdad9fa88 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:33.567902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaf8f8-adfe-4f9d-830f-3d0a0092a08e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.568929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaf8f8-adfe-4f9d-830f-3d0a0092a08e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.569536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaf8f8-adfe-4f9d-830f-3d0a0092a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.572913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:33.573435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.573873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.574222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] PATH_INFO: `/v3/projects/fec233ca405e4b6aa5070febf83a254a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.575547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec233ca405e4b6aa5070febf83a254a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:33.578455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:33.597510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0dbaf8f8-adfe-4f9d-830f-3d0a0092a08e None None] MFA Rules not processed for user `2e17cb04dd32451fa3a46c941fe1ca81`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:33.598981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0dbaf8f8-adfe-4f9d-830f-3d0a0092a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:33.633948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec233ca405e4b6aa5070febf83a254a', 'request_id': 'req-e01fa22f-274c-4c23-9ed9-bf7795a82400'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.643855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec233ca405e4b6aa5070febf83a254a', 'request_id': 'req-e01fa22f-274c-4c23-9ed9-bf7795a82400'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.650347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec233ca405e4b6aa5070febf83a254a', 'request_id': 'req-e01fa22f-274c-4c23-9ed9-bf7795a82400'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.663097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] The token cache is being invalidate because project fec233ca405e4b6aa5070febf83a254a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:33.663500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.664087 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3722/7420] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:33.664207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:33.665835 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3699/7421] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:33 2022] DELETE /identity/v3/projects/fec233ca405e4b6aa5070febf83a254a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:33.671174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab8e1d-2ffc-4562-a928-0c4ba1ba7587 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.671174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab8e1d-2ffc-4562-a928-0c4ba1ba7587 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.671414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab8e1d-2ffc-4562-a928-0c4ba1ba7587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.678699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:33.688831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:33.692803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dbab8e1d-2ffc-4562-a928-0c4ba1ba7587 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:33.693867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dbab8e1d-2ffc-4562-a928-0c4ba1ba7587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:33.777938 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3723/7422] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:33.787259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f6405-f232-4f07-bcc4-9747afa5403d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.787552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f6405-f232-4f07-bcc4-9747afa5403d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.787831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f6405-f232-4f07-bcc4-9747afa5403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.806967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa22f-274c-4c23-9ed9-bf7795a82400 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:33.808600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6a8f6405-f232-4f07-bcc4-9747afa5403d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:33.810313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6a8f6405-f232-4f07-bcc4-9747afa5403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:33.813546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39138714-db39-4bf9-be42-2e7102cd6a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:33.814187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39138714-db39-4bf9-be42-2e7102cd6a79 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.814468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39138714-db39-4bf9-be42-2e7102cd6a79 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.814740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39138714-db39-4bf9-be42-2e7102cd6a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.816608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-39138714-db39-4bf9-be42-2e7102cd6a79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:33.818922 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3724/7423] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:33.822990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f6405-f232-4f07-bcc4-9747afa5403d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:33.833349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f6405-f232-4f07-bcc4-9747afa5403d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:33.834576 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:33.839572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb33fc-5103-4c73-86ac-20de1e23d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:33.840304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb33fc-5103-4c73-86ac-20de1e23d953 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.840588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb33fc-5103-4c73-86ac-20de1e23d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.840897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb33fc-5103-4c73-86ac-20de1e23d953 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.841550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb33fc-5103-4c73-86ac-20de1e23d953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:33.841985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb33fc-5103-4c73-86ac-20de1e23d953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:33.845266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb33fc-5103-4c73-86ac-20de1e23d953 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:33.857593 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3725/7424] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:21:33.861945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb33fc-5103-4c73-86ac-20de1e23d953 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:33.871715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb33fc-5103-4c73-86ac-20de1e23d953 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:33.878190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f130c-dcc7-4ef6-a568-23545acca0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:33.878814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f130c-dcc7-4ef6-a568-23545acca0ee admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.879096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f130c-dcc7-4ef6-a568-23545acca0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.879373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f130c-dcc7-4ef6-a568-23545acca0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.880012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f130c-dcc7-4ef6-a568-23545acca0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:33.881948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f130c-dcc7-4ef6-a568-23545acca0ee admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:33.886245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39138714-db39-4bf9-be42-2e7102cd6a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:33.888026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39138714-db39-4bf9-be42-2e7102cd6a79 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:33.897989 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3700/7425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:33.916678 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3726/7426] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:33 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:33.917799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39138714-db39-4bf9-be42-2e7102cd6a79 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:33.929657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39138714-db39-4bf9-be42-2e7102cd6a79 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:33.992346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6e612-b518-4cbf-ad37-34df4ba89a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:33.993011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6e612-b518-4cbf-ad37-34df4ba89a08 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:33.993291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6e612-b518-4cbf-ad37-34df4ba89a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:33.993591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6e612-b518-4cbf-ad37-34df4ba89a08 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:33.994231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6e612-b518-4cbf-ad37-34df4ba89a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:33.996147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6e612-b518-4cbf-ad37-34df4ba89a08 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.023622 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3701/7427] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:33 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:34.025019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f130c-dcc7-4ef6-a568-23545acca0ee admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.036164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f130c-dcc7-4ef6-a568-23545acca0ee admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.041648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094778f-e637-4a92-9d03-bd2e0ad8dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.042327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094778f-e637-4a92-9d03-bd2e0ad8dbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.042749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094778f-e637-4a92-9d03-bd2e0ad8dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.043020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094778f-e637-4a92-9d03-bd2e0ad8dbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.043670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094778f-e637-4a92-9d03-bd2e0ad8dbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.045372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094778f-e637-4a92-9d03-bd2e0ad8dbb2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.056664 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3727/7428] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:34.061385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6e612-b518-4cbf-ad37-34df4ba89a08 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.071748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6e612-b518-4cbf-ad37-34df4ba89a08 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.077328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ce867-4c2b-49b0-9357-8a4b5e72ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.077936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ce867-4c2b-49b0-9357-8a4b5e72ce2d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.078215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ce867-4c2b-49b0-9357-8a4b5e72ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.078490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ce867-4c2b-49b0-9357-8a4b5e72ce2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.079134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ce867-4c2b-49b0-9357-8a4b5e72ce2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.080836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ce867-4c2b-49b0-9357-8a4b5e72ce2d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.097114 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3702/7429] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:34.101161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094778f-e637-4a92-9d03-bd2e0ad8dbb2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.111627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094778f-e637-4a92-9d03-bd2e0ad8dbb2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.116527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604c8d-7220-4014-a8c1-f0c7f9fa0021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.117362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604c8d-7220-4014-a8c1-f0c7f9fa0021 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.117725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604c8d-7220-4014-a8c1-f0c7f9fa0021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.118015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604c8d-7220-4014-a8c1-f0c7f9fa0021 admin admin] PATH_INFO: `/v3/projects/2cf083f840c046c1b38da59244845d0e/users/5a2f36a9104c4e0487a663651cf9f200/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.134404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da604c8d-7220-4014-a8c1-f0c7f9fa0021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf083f840c046c1b38da59244845d0e, user_id=5a2f36a9104c4e0487a663651cf9f200, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.137102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da604c8d-7220-4014-a8c1-f0c7f9fa0021 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.151768 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3728/7430] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:34 2022] PUT /identity/v3/projects/2cf083f840c046c1b38da59244845d0e/users/5a2f36a9104c4e0487a663651cf9f200/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:34.162294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc5b4-96ba-4593-ad4b-5db0d93c09c0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.162513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc5b4-96ba-4593-ad4b-5db0d93c09c0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.162796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc5b4-96ba-4593-ad4b-5db0d93c09c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.192743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5cecc5b4-96ba-4593-ad4b-5db0d93c09c0 None None] MFA Rules not processed for user `5a2f36a9104c4e0487a663651cf9f200`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:34.194107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cecc5b4-96ba-4593-ad4b-5db0d93c09c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:34.264142 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3703/7431] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:34.268439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604c8d-7220-4014-a8c1-f0c7f9fa0021 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.278634 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:34.338265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604c8d-7220-4014-a8c1-f0c7f9fa0021 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.343810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301fef4-06fb-4c86-a3fe-daee49bbefa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.344426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301fef4-06fb-4c86-a3fe-daee49bbefa7 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.344732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301fef4-06fb-4c86-a3fe-daee49bbefa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.345007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301fef4-06fb-4c86-a3fe-daee49bbefa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.345652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301fef4-06fb-4c86-a3fe-daee49bbefa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.347563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301fef4-06fb-4c86-a3fe-daee49bbefa7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.377535 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3729/7432] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:34 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:34.381409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecc5b4-96ba-4593-ad4b-5db0d93c09c0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.394536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecc5b4-96ba-4593-ad4b-5db0d93c09c0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.421315 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:34.473510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951d834-fb6a-4cb4-91d4-5aaaa17b3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.474122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951d834-fb6a-4cb4-91d4-5aaaa17b3e7c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.474402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951d834-fb6a-4cb4-91d4-5aaaa17b3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.474677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951d834-fb6a-4cb4-91d4-5aaaa17b3e7c admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.475349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951d834-fb6a-4cb4-91d4-5aaaa17b3e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.477348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951d834-fb6a-4cb4-91d4-5aaaa17b3e7c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.499036 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3704/7433] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:34 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:34.502989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301fef4-06fb-4c86-a3fe-daee49bbefa7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.515301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301fef4-06fb-4c86-a3fe-daee49bbefa7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.520986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a49e08-b7e0-4b99-b1de-5abfe3c307b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.521615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a49e08-b7e0-4b99-b1de-5abfe3c307b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.521899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a49e08-b7e0-4b99-b1de-5abfe3c307b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.522471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a49e08-b7e0-4b99-b1de-5abfe3c307b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.524628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a49e08-b7e0-4b99-b1de-5abfe3c307b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.526267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a49e08-b7e0-4b99-b1de-5abfe3c307b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.541091 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3730/7434] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:34.545799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951d834-fb6a-4cb4-91d4-5aaaa17b3e7c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.557444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951d834-fb6a-4cb4-91d4-5aaaa17b3e7c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.561121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a49e08-b7e0-4b99-b1de-5abfe3c307b5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.562854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-27a49e08-b7e0-4b99-b1de-5abfe3c307b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:34.563435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79114-4e40-4794-8be9-470e317e019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.564201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79114-4e40-4794-8be9-470e317e019d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.564551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79114-4e40-4794-8be9-470e317e019d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.564937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79114-4e40-4794-8be9-470e317e019d admin admin] PATH_INFO: `/v3/projects/ecd69c0534fb4737992fa245b3da238c/users/ac2b79f3518041339f46db14b69de9ae/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.587952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79114-4e40-4794-8be9-470e317e019d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd69c0534fb4737992fa245b3da238c, user_id=ac2b79f3518041339f46db14b69de9ae, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.590697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79114-4e40-4794-8be9-470e317e019d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.606039 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3705/7435] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:34 2022] PUT /identity/v3/projects/ecd69c0534fb4737992fa245b3da238c/users/ac2b79f3518041339f46db14b69de9ae/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:34.610788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79114-4e40-4794-8be9-470e317e019d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.659324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a49e08-b7e0-4b99-b1de-5abfe3c307b5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.673794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79114-4e40-4794-8be9-470e317e019d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.678370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c441a6-9421-401d-b222-77bf8bebd5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.678976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c441a6-9421-401d-b222-77bf8bebd5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.679277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c441a6-9421-401d-b222-77bf8bebd5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.679550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c441a6-9421-401d-b222-77bf8bebd5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.680185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c441a6-9421-401d-b222-77bf8bebd5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.681800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c441a6-9421-401d-b222-77bf8bebd5e6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.692791 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3706/7436] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:21:34.696788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c441a6-9421-401d-b222-77bf8bebd5e6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.707282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c441a6-9421-401d-b222-77bf8bebd5e6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.712444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754f76f-b19a-442c-a706-ae8a70219e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.713243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754f76f-b19a-442c-a706-ae8a70219e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.713531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754f76f-b19a-442c-a706-ae8a70219e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.713813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754f76f-b19a-442c-a706-ae8a70219e4c admin admin] PATH_INFO: `/v3/projects/ecd69c0534fb4737992fa245b3da238c/users/ac2b79f3518041339f46db14b69de9ae/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.715796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754f76f-b19a-442c-a706-ae8a70219e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd69c0534fb4737992fa245b3da238c, user_id=ac2b79f3518041339f46db14b69de9ae, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.719250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754f76f-b19a-442c-a706-ae8a70219e4c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.725439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71acb48-b925-4273-b58e-50e0ae906dac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.726082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71acb48-b925-4273-b58e-50e0ae906dac service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.726365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71acb48-b925-4273-b58e-50e0ae906dac service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.726640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71acb48-b925-4273-b58e-50e0ae906dac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.728454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b71acb48-b925-4273-b58e-50e0ae906dac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:34.729993 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3707/7437] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:34 2022] PUT /identity/v3/projects/ecd69c0534fb4737992fa245b3da238c/users/ac2b79f3518041339f46db14b69de9ae/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:34.740356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fd2f6-ecf8-4f91-a3ec-d8c88a468c8c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.740673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fd2f6-ecf8-4f91-a3ec-d8c88a468c8c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.740958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fd2f6-ecf8-4f91-a3ec-d8c88a468c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.750353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71acb48-b925-4273-b58e-50e0ae906dac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.751954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71acb48-b925-4273-b58e-50e0ae906dac service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.765914 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3731/7438] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:21:34.769989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7b2fd2f6-ecf8-4f91-a3ec-d8c88a468c8c None None] MFA Rules not processed for user `ac2b79f3518041339f46db14b69de9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:34.771204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7b2fd2f6-ecf8-4f91-a3ec-d8c88a468c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:34.831536 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:34.841394 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3708/7439] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:34.846553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71acb48-b925-4273-b58e-50e0ae906dac service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.852117 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:34.913632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71acb48-b925-4273-b58e-50e0ae906dac service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:34.918391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82926a-fdf7-481a-968b-daa6cdd679c1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:34.919071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82926a-fdf7-481a-968b-daa6cdd679c1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:34.919360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82926a-fdf7-481a-968b-daa6cdd679c1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:34.919632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82926a-fdf7-481a-968b-daa6cdd679c1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:34.920317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82926a-fdf7-481a-968b-daa6cdd679c1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:34.922173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82926a-fdf7-481a-968b-daa6cdd679c1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:34.954904 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3732/7440] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:34 2022] POST /identity/v3/projects => generated 360 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:34.959325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fd2f6-ecf8-4f91-a3ec-d8c88a468c8c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:34.969445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fd2f6-ecf8-4f91-a3ec-d8c88a468c8c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.030279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82345211-9c25-4ca7-8f26-2043f1dc0e1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.031062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82345211-9c25-4ca7-8f26-2043f1dc0e1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.031348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82345211-9c25-4ca7-8f26-2043f1dc0e1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.031627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82345211-9c25-4ca7-8f26-2043f1dc0e1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.032262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82345211-9c25-4ca7-8f26-2043f1dc0e1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.034180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82345211-9c25-4ca7-8f26-2043f1dc0e1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.066836 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3709/7441] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:34 2022] POST /identity/v3/users => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:21:35.071392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82926a-fdf7-481a-968b-daa6cdd679c1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.083686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82926a-fdf7-481a-968b-daa6cdd679c1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.088711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef526ee4-c4bc-420d-ae98-0576ec3b2a58 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.089361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef526ee4-c4bc-420d-ae98-0576ec3b2a58 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.089646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef526ee4-c4bc-420d-ae98-0576ec3b2a58 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.089928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef526ee4-c4bc-420d-ae98-0576ec3b2a58 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/07e9140f81e943f48e7f088d9f983a19` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.106203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef526ee4-c4bc-420d-ae98-0576ec3b2a58 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:get_user(user_id=07e9140f81e943f48e7f088d9f983a19)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.109159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef526ee4-c4bc-420d-ae98-0576ec3b2a58 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.110870 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3733/7442] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:21:35 2022] GET /identity/v3/users/07e9140f81e943f48e7f088d9f983a19 => generated 371 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:35.115183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82345211-9c25-4ca7-8f26-2043f1dc0e1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.126061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82345211-9c25-4ca7-8f26-2043f1dc0e1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.132009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.132827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.133117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.133397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/07e9140f81e943f48e7f088d9f983a19` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.134565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_user(user_id=07e9140f81e943f48e7f088d9f983a19)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.136743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.187137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e9140f81e943f48e7f088d9f983a19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.199781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e9140f81e943f48e7f088d9f983a19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.207867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e9140f81e943f48e7f088d9f983a19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.215357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e9140f81e943f48e7f088d9f983a19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.216143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e9140f81e943f48e7f088d9f983a19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.223180 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3710/7443] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:35 2022] DELETE /identity/v3/users/07e9140f81e943f48e7f088d9f983a19 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:35.227969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef526ee4-c4bc-420d-ae98-0576ec3b2a58 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.230100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ef526ee4-c4bc-420d-ae98-0576ec3b2a58 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:35.243118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef526ee4-c4bc-420d-ae98-0576ec3b2a58 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.305634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.306274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.306564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.306853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects/b4299e9cd0f14c8593af6ebbf06c12c6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.308006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4299e9cd0f14c8593af6ebbf06c12c6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.310309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.357020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4299e9cd0f14c8593af6ebbf06c12c6', 'request_id': 'req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.365386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4299e9cd0f14c8593af6ebbf06c12c6', 'request_id': 'req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.371491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4299e9cd0f14c8593af6ebbf06c12c6', 'request_id': 'req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.383110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] The token cache is being invalidate because project b4299e9cd0f14c8593af6ebbf06c12c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:35.383402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.384168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:35.386414 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3734/7444] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:35 2022] DELETE /identity/v3/projects/b4299e9cd0f14c8593af6ebbf06c12c6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:35.390786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.401345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4796d-6022-48bb-a68a-44fcf0f780e0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.457066 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:35.465582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a5ec8-8d8f-4909-ad55-38df81d386fc tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.466662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5ec8-8d8f-4909-ad55-38df81d386fc tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.468229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5ec8-8d8f-4909-ad55-38df81d386fc tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.469555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5ec8-8d8f-4909-ad55-38df81d386fc tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.470211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a5ec8-8d8f-4909-ad55-38df81d386fc tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.473105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a5ec8-8d8f-4909-ad55-38df81d386fc tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.512788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3711/7445] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:35 2022] POST /identity/v3/projects => generated 359 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:35.514108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.515762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:35.526134 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:35.532253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc228b7e-9d0a-4b62-b0f0-1a0da4a20ffb tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.605456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c42df7-6880-42a3-8887-e369f2dd264c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.606086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c42df7-6880-42a3-8887-e369f2dd264c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.606374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c42df7-6880-42a3-8887-e369f2dd264c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.606653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c42df7-6880-42a3-8887-e369f2dd264c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.607310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c42df7-6880-42a3-8887-e369f2dd264c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.609758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c42df7-6880-42a3-8887-e369f2dd264c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.642170 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3735/7446] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:35 2022] POST /identity/v3/users => generated 414 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:35.646242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a5ec8-8d8f-4909-ad55-38df81d386fc tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.660684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a5ec8-8d8f-4909-ad55-38df81d386fc tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.668819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ce46-8236-4ff3-b562-2676af8d629f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.669435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ce46-8236-4ff3-b562-2676af8d629f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.669727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ce46-8236-4ff3-b562-2676af8d629f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.670578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ce46-8236-4ff3-b562-2676af8d629f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.671358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291ce46-8236-4ff3-b562-2676af8d629f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.673239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291ce46-8236-4ff3-b562-2676af8d629f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.694477 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3712/7447] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:21:35 2022] POST /identity/v3/roles => generated 239 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:35.695875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c42df7-6880-42a3-8887-e369f2dd264c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.706725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c42df7-6880-42a3-8887-e369f2dd264c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.711767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153591-b98b-4219-a140-f51a1350d20b tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.712478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153591-b98b-4219-a140-f51a1350d20b tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.712857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153591-b98b-4219-a140-f51a1350d20b tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.713170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153591-b98b-4219-a140-f51a1350d20b tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/7a77e91c635b4b1ca4cddabed927d89c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.728813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97153591-b98b-4219-a140-f51a1350d20b tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:get_user(user_id=7a77e91c635b4b1ca4cddabed927d89c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.731055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97153591-b98b-4219-a140-f51a1350d20b tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.733494 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3736/7448] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:21:35 2022] GET /identity/v3/users/7a77e91c635b4b1ca4cddabed927d89c => generated 414 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:35.737382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ce46-8236-4ff3-b562-2676af8d629f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.747569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ce46-8236-4ff3-b562-2676af8d629f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.752454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c79b9-0c46-4f18-83d1-eeb06ad42235 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.753120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c79b9-0c46-4f18-83d1-eeb06ad42235 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.753428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c79b9-0c46-4f18-83d1-eeb06ad42235 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.753760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c79b9-0c46-4f18-83d1-eeb06ad42235 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/roles/9452923f7ae34700a2638498423a2006` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.755208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c79b9-0c46-4f18-83d1-eeb06ad42235 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:get_role(role_id=9452923f7ae34700a2638498423a2006)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.756231 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-047c79b9-0c46-4f18-83d1-eeb06ad42235 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:35.756231 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:21:35.756231 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:21:35.757157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c79b9-0c46-4f18-83d1-eeb06ad42235 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.758480 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3713/7449] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:21:35 2022] GET /identity/v3/roles/9452923f7ae34700a2638498423a2006 => generated 239 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:35.762368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153591-b98b-4219-a140-f51a1350d20b tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.772988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153591-b98b-4219-a140-f51a1350d20b tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.777699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec5a49-5f4c-49c2-83db-da9fcd63a308 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.778291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec5a49-5f4c-49c2-83db-da9fcd63a308 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.778571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec5a49-5f4c-49c2-83db-da9fcd63a308 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.778844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec5a49-5f4c-49c2-83db-da9fcd63a308 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.780107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec5a49-5f4c-49c2-83db-da9fcd63a308 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.782057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec5a49-5f4c-49c2-83db-da9fcd63a308 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.812377 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3737/7450] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:35 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:35.816597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c79b9-0c46-4f18-83d1-eeb06ad42235 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.827269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c79b9-0c46-4f18-83d1-eeb06ad42235 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.886038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69142163-9f58-44d4-9362-c45b102f4c68 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.886675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69142163-9f58-44d4-9362-c45b102f4c68 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.886962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69142163-9f58-44d4-9362-c45b102f4c68 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.887266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69142163-9f58-44d4-9362-c45b102f4c68 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects/1373dd4dbe474f1c879bcb6d5aaef490` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.888400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69142163-9f58-44d4-9362-c45b102f4c68 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:get_project(project_id=1373dd4dbe474f1c879bcb6d5aaef490)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.891159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69142163-9f58-44d4-9362-c45b102f4c68 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.892861 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3714/7451] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:21:35 2022] GET /identity/v3/projects/1373dd4dbe474f1c879bcb6d5aaef490 => generated 359 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:35.897485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec5a49-5f4c-49c2-83db-da9fcd63a308 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.909027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec5a49-5f4c-49c2-83db-da9fcd63a308 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:35.913766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37803ffa-8148-4644-aa8e-8f1177f267d7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:35.914436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37803ffa-8148-4644-aa8e-8f1177f267d7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:35.914724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37803ffa-8148-4644-aa8e-8f1177f267d7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:35.915004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37803ffa-8148-4644-aa8e-8f1177f267d7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects/1373dd4dbe474f1c879bcb6d5aaef490/users/7a77e91c635b4b1ca4cddabed927d89c/roles/9452923f7ae34700a2638498423a2006` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:35.917261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37803ffa-8148-4644-aa8e-8f1177f267d7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1373dd4dbe474f1c879bcb6d5aaef490, user_id=7a77e91c635b4b1ca4cddabed927d89c, role_id=9452923f7ae34700a2638498423a2006)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:35.920580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37803ffa-8148-4644-aa8e-8f1177f267d7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:35.932843 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3738/7452] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:35 2022] PUT /identity/v3/projects/1373dd4dbe474f1c879bcb6d5aaef490/users/7a77e91c635b4b1ca4cddabed927d89c/roles/9452923f7ae34700a2638498423a2006 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:35.937362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69142163-9f58-44d4-9362-c45b102f4c68 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:35.947842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69142163-9f58-44d4-9362-c45b102f4c68 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:36.011590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abf9bb-cb33-4aec-a988-c6c8f176f7d0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:36.012159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abf9bb-cb33-4aec-a988-c6c8f176f7d0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:36.012500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abf9bb-cb33-4aec-a988-c6c8f176f7d0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:36.012985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abf9bb-cb33-4aec-a988-c6c8f176f7d0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:36.014137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abf9bb-cb33-4aec-a988-c6c8f176f7d0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:36.016072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abf9bb-cb33-4aec-a988-c6c8f176f7d0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:36.052481 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3715/7453] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:35 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:36.056799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37803ffa-8148-4644-aa8e-8f1177f267d7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:36.071898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37803ffa-8148-4644-aa8e-8f1177f267d7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:36.145002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467d83-f25f-4029-9b8b-e11aeacc3e59 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:36.145650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467d83-f25f-4029-9b8b-e11aeacc3e59 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:36.145937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467d83-f25f-4029-9b8b-e11aeacc3e59 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:36.146219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467d83-f25f-4029-9b8b-e11aeacc3e59 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects/2e444e4672cf4175b01e9c7cc6f16697` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:36.147375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467d83-f25f-4029-9b8b-e11aeacc3e59 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:get_project(project_id=2e444e4672cf4175b01e9c7cc6f16697)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:36.149540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467d83-f25f-4029-9b8b-e11aeacc3e59 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:36.151206 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3739/7454] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:21:36 2022] GET /identity/v3/projects/2e444e4672cf4175b01e9c7cc6f16697 => generated 359 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:36.155552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abf9bb-cb33-4aec-a988-c6c8f176f7d0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:36.166600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abf9bb-cb33-4aec-a988-c6c8f176f7d0 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:36.171412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb3e1a-1094-480f-aa40-00820bacce17 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:36.172077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3e1a-1094-480f-aa40-00820bacce17 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:36.172370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3e1a-1094-480f-aa40-00820bacce17 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:36.172674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3e1a-1094-480f-aa40-00820bacce17 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects/2e444e4672cf4175b01e9c7cc6f16697/users/7a77e91c635b4b1ca4cddabed927d89c/roles/9452923f7ae34700a2638498423a2006` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:36.174941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb3e1a-1094-480f-aa40-00820bacce17 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2e444e4672cf4175b01e9c7cc6f16697, user_id=7a77e91c635b4b1ca4cddabed927d89c, role_id=9452923f7ae34700a2638498423a2006)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:36.178023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb3e1a-1094-480f-aa40-00820bacce17 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:36.193162 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3716/7455] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:36 2022] PUT /identity/v3/projects/2e444e4672cf4175b01e9c7cc6f16697/users/7a77e91c635b4b1ca4cddabed927d89c/roles/9452923f7ae34700a2638498423a2006 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:36.197306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467d83-f25f-4029-9b8b-e11aeacc3e59 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:36.208912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467d83-f25f-4029-9b8b-e11aeacc3e59 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:36.255665 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:36.272378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b046f8-432d-452b-84ec-bd3732663389 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:36.272974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b046f8-432d-452b-84ec-bd3732663389 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:36.273266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b046f8-432d-452b-84ec-bd3732663389 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:36.273548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b046f8-432d-452b-84ec-bd3732663389 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/7a77e91c635b4b1ca4cddabed927d89c/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:36.274762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b046f8-432d-452b-84ec-bd3732663389 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=7a77e91c635b4b1ca4cddabed927d89c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:36.277092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b046f8-432d-452b-84ec-bd3732663389 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:36.314731 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3740/7456] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:21:36 2022] GET /identity/v3/users/7a77e91c635b4b1ca4cddabed927d89c/projects => generated 842 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:36.318831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb3e1a-1094-480f-aa40-00820bacce17 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:36.330859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb3e1a-1094-480f-aa40-00820bacce17 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:36.335548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:36.336181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:36.336468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:36.336777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects/2e444e4672cf4175b01e9c7cc6f16697` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:36.338122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e444e4672cf4175b01e9c7cc6f16697)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:36.340048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:36.382808 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:36.395964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e444e4672cf4175b01e9c7cc6f16697', 'request_id': 'req-158386dc-3e5d-4762-9656-bd621807c675'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.403491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e444e4672cf4175b01e9c7cc6f16697', 'request_id': 'req-158386dc-3e5d-4762-9656-bd621807c675'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.410158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e444e4672cf4175b01e9c7cc6f16697', 'request_id': 'req-158386dc-3e5d-4762-9656-bd621807c675'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.423748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] The token cache is being invalidate because project 2e444e4672cf4175b01e9c7cc6f16697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:36.424043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.425512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.426488 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3717/7457] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:36 2022] DELETE /identity/v3/projects/2e444e4672cf4175b01e9c7cc6f16697 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:36.430594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b046f8-432d-452b-84ec-bd3732663389 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:36.432710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-06b046f8-432d-452b-84ec-bd3732663389 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:36.446494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b046f8-432d-452b-84ec-bd3732663389 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:36.506956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:36.507633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:36.507948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:36.508228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects/1373dd4dbe474f1c879bcb6d5aaef490` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:36.509473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1373dd4dbe474f1c879bcb6d5aaef490)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:36.511400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:36.564412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1373dd4dbe474f1c879bcb6d5aaef490', 'request_id': 'req-be87cc0a-6d36-49ca-8eb1-399927e9536a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.573954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1373dd4dbe474f1c879bcb6d5aaef490', 'request_id': 'req-be87cc0a-6d36-49ca-8eb1-399927e9536a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.581479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1373dd4dbe474f1c879bcb6d5aaef490', 'request_id': 'req-be87cc0a-6d36-49ca-8eb1-399927e9536a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.593396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] The token cache is being invalidate because project 1373dd4dbe474f1c879bcb6d5aaef490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:36.593683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.594452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.596034 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3741/7458] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:36 2022] DELETE /identity/v3/projects/1373dd4dbe474f1c879bcb6d5aaef490 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:36.600375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:36.611721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158386dc-3e5d-4762-9656-bd621807c675 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:36.674807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:36.675348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:36.675449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:36.675674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/roles/9452923f7ae34700a2638498423a2006` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:36.677330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9452923f7ae34700a2638498423a2006)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:36.678932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:36.718174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invalidating the token cache because role 9452923f7ae34700a2638498423a2006 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:36.718460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.719136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.720988 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3718/7459] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:36 2022] DELETE /identity/v3/roles/9452923f7ae34700a2638498423a2006 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:36.725190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:36.726603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:36.739924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87cc0a-6d36-49ca-8eb1-399927e9536a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:36.788383 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:36.805656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:36.806395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:36.806738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:36.807073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/7a77e91c635b4b1ca4cddabed927d89c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:36.808340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7a77e91c635b4b1ca4cddabed927d89c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:36.811478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:36.858203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a77e91c635b4b1ca4cddabed927d89c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.872317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a77e91c635b4b1ca4cddabed927d89c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.880379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a77e91c635b4b1ca4cddabed927d89c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.887721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a77e91c635b4b1ca4cddabed927d89c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.888470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a77e91c635b4b1ca4cddabed927d89c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:36.897364 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3742/7460] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:36 2022] DELETE /identity/v3/users/7a77e91c635b4b1ca4cddabed927d89c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:36.899418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:36.901180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:36.915165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85807d2e-25ad-4c87-bf42-114379553fee tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:36.980160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:36.980994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:36.981219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:36.981531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects/4a2c7a2679654ea2bb003ab7d97cd3ed` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:36.983092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a2c7a2679654ea2bb003ab7d97cd3ed)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:36.985054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:37.035995 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:37.053701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2c7a2679654ea2bb003ab7d97cd3ed', 'request_id': 'req-7d0073a4-fce5-4534-a185-38265a927312'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.062859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2c7a2679654ea2bb003ab7d97cd3ed', 'request_id': 'req-7d0073a4-fce5-4534-a185-38265a927312'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.068997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2c7a2679654ea2bb003ab7d97cd3ed', 'request_id': 'req-7d0073a4-fce5-4534-a185-38265a927312'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.081588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] The token cache is being invalidate because project 4a2c7a2679654ea2bb003ab7d97cd3ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:37.081956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.082699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7d0073a4-fce5-4534-a185-38265a927312 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.084260 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3719/7461] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:36 2022] DELETE /identity/v3/projects/4a2c7a2679654ea2bb003ab7d97cd3ed => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:37.090499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:37.092327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:37.105886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae349e2f-f951-452e-973c-32c4b58b58e3 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:37.163529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:37.164186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:37.164469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:37.164770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/5a2f36a9104c4e0487a663651cf9f200` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:37.165962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:update_user(user_id=5a2f36a9104c4e0487a663651cf9f200)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:37.166977 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:21:37.166977 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:21:37.166977 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:21:37.168188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:37.205603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5a2f36a9104c4e0487a663651cf9f200'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.213535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invalidating the token cache because user 5a2f36a9104c4e0487a663651cf9f200 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:37.213824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.214438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.219119 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3743/7462] 10.222.0.27 () {60 vars in 1243 bytes} [Wed Oct 19 01:21:37 2022] PATCH /identity/v3/users/5a2f36a9104c4e0487a663651cf9f200 => generated 297 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:37.220894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3abd-f773-4e99-ac70-6b5ba5f99797 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:37.221177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3abd-f773-4e99-ac70-6b5ba5f99797 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:37.221444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3abd-f773-4e99-ac70-6b5ba5f99797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:37.253279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f0ff3abd-f773-4e99-ac70-6b5ba5f99797 None None] MFA Rules not processed for user `5a2f36a9104c4e0487a663651cf9f200`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:37.254484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f0ff3abd-f773-4e99-ac70-6b5ba5f99797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:37.257631 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3720/7463] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:37 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:37.261714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:37.263088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:37.276097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3e3ac-2691-49c3-ab5c-fa53730b4c1a tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:37.281566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:37.282237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:37.282526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:37.282811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/5a2f36a9104c4e0487a663651cf9f200` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:37.284057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:update_user(user_id=5a2f36a9104c4e0487a663651cf9f200)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:37.286039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:37.326838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5a2f36a9104c4e0487a663651cf9f200'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.334785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invalidating the token cache because user 5a2f36a9104c4e0487a663651cf9f200 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:37.335090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.335735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-daa4c13b-203a-4b50-9732-ceb5ad3e3722 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.338095 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3744/7464] 10.222.0.27 () {60 vars in 1243 bytes} [Wed Oct 19 01:21:37 2022] PATCH /identity/v3/users/5a2f36a9104c4e0487a663651cf9f200 => generated 297 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:21:37.342735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3abd-f773-4e99-ac70-6b5ba5f99797 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:37.355159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3abd-f773-4e99-ac70-6b5ba5f99797 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:37.360408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:37.361074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:37.361382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:37.361644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/5a2f36a9104c4e0487a663651cf9f200` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:37.378710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:update_user(user_id=5a2f36a9104c4e0487a663651cf9f200)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:37.380703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:37.417241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5a2f36a9104c4e0487a663651cf9f200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.426681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invalidating the token cache because user 5a2f36a9104c4e0487a663651cf9f200 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:37.426984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.427668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.429661 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3721/7465] 10.222.0.27 () {60 vars in 1243 bytes} [Wed Oct 19 01:21:37 2022] PATCH /identity/v3/users/5a2f36a9104c4e0487a663651cf9f200 => generated 297 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:37.434106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf90f9-6f39-4466-9d48-0915b45d64ef None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:37.434423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf90f9-6f39-4466-9d48-0915b45d64ef None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:37.434695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf90f9-6f39-4466-9d48-0915b45d64ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:37.451883 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=12,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:37.471233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d8cf90f9-6f39-4466-9d48-0915b45d64ef None None] MFA Rules not processed for user `5a2f36a9104c4e0487a663651cf9f200`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:37.472551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d8cf90f9-6f39-4466-9d48-0915b45d64ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:37.476028 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3745/7466] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:37 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:37.480442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:37.482095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:37.494731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347215a-e60c-4e29-8107-618f1db21c74 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:37.500068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:37.500772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:37.501078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:37.501356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/5a2f36a9104c4e0487a663651cf9f200` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:37.502595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:update_user(user_id=5a2f36a9104c4e0487a663651cf9f200)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:37.504837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:37.541574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5a2f36a9104c4e0487a663651cf9f200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.549543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invalidating the token cache because user 5a2f36a9104c4e0487a663651cf9f200 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:37.549959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.550675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.552670 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3722/7467] 10.222.0.27 () {60 vars in 1243 bytes} [Wed Oct 19 01:21:37 2022] PATCH /identity/v3/users/5a2f36a9104c4e0487a663651cf9f200 => generated 297 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:37.558141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf90f9-6f39-4466-9d48-0915b45d64ef None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:37.572483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf90f9-6f39-4466-9d48-0915b45d64ef None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:37.579067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557d75e-15f6-4a4a-939f-09684fa3a6a1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:37.579701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557d75e-15f6-4a4a-939f-09684fa3a6a1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:37.579971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557d75e-15f6-4a4a-939f-09684fa3a6a1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:37.580250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557d75e-15f6-4a4a-939f-09684fa3a6a1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:37.580926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557d75e-15f6-4a4a-939f-09684fa3a6a1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:37.582796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557d75e-15f6-4a4a-939f-09684fa3a6a1 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:37.613213 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3746/7468] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:21:37 2022] POST /identity/v3/users => generated 264 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:37.617760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:37.619370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:37.634862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf86d3-da4d-4fa8-a57a-33ba2fbb4618 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:37.640482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766112-ea15-431f-99a8-c90c1b54c7df tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:37.641242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766112-ea15-431f-99a8-c90c1b54c7df tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:37.641589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766112-ea15-431f-99a8-c90c1b54c7df tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:37.641939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766112-ea15-431f-99a8-c90c1b54c7df tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/271590df20734d5a8c56e2c7a3ff4b4a/password` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:37.708302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3766112-ea15-431f-99a8-c90c1b54c7df tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '271590df20734d5a8c56e2c7a3ff4b4a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:37.718026 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3723/7469] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:21:37 2022] POST /identity/v3/users/271590df20734d5a8c56e2c7a3ff4b4a/password => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:38.724052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187bf3e-ba87-4a64-b048-3e837362cd09 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:38.724613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187bf3e-ba87-4a64-b048-3e837362cd09 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:38.724613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187bf3e-ba87-4a64-b048-3e837362cd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:38.747468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d187bf3e-ba87-4a64-b048-3e837362cd09 None None] MFA Rules not processed for user `271590df20734d5a8c56e2c7a3ff4b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:38.749898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d187bf3e-ba87-4a64-b048-3e837362cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:38.753183 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3747/7470] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:38 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:38.757395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766112-ea15-431f-99a8-c90c1b54c7df tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:38.768562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766112-ea15-431f-99a8-c90c1b54c7df tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:38.773298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56537e-0df7-462f-b76d-4bc71c448e7c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:38.773930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56537e-0df7-462f-b76d-4bc71c448e7c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:38.774406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56537e-0df7-462f-b76d-4bc71c448e7c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:38.774693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56537e-0df7-462f-b76d-4bc71c448e7c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:38.781728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56537e-0df7-462f-b76d-4bc71c448e7c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:38.784074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56537e-0df7-462f-b76d-4bc71c448e7c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:38.794174 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3724/7471] 10.222.0.27 () {56 vars in 1263 bytes} [Wed Oct 19 01:21:38 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:38.796237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187bf3e-ba87-4a64-b048-3e837362cd09 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:38.809317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187bf3e-ba87-4a64-b048-3e837362cd09 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:38.815508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:38.816175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:38.816461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:38.816798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/271590df20734d5a8c56e2c7a3ff4b4a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:38.817953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_user(user_id=271590df20734d5a8c56e2c7a3ff4b4a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:38.820077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:38.871450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271590df20734d5a8c56e2c7a3ff4b4a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:38.886582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271590df20734d5a8c56e2c7a3ff4b4a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:38.895470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271590df20734d5a8c56e2c7a3ff4b4a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:38.903645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271590df20734d5a8c56e2c7a3ff4b4a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:38.905007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271590df20734d5a8c56e2c7a3ff4b4a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:38.911428 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3748/7472] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:38 2022] DELETE /identity/v3/users/271590df20734d5a8c56e2c7a3ff4b4a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:38.916794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56537e-0df7-462f-b76d-4bc71c448e7c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:38.930394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56537e-0df7-462f-b76d-4bc71c448e7c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:38.948090 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=7,keystone:UPDATE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:38.992724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec887243-e1dd-4064-bd6b-e37e5253ce7f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:38.993309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec887243-e1dd-4064-bd6b-e37e5253ce7f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:38.993600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec887243-e1dd-4064-bd6b-e37e5253ce7f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:38.993882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec887243-e1dd-4064-bd6b-e37e5253ce7f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:38.994558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec887243-e1dd-4064-bd6b-e37e5253ce7f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:38.996419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec887243-e1dd-4064-bd6b-e37e5253ce7f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:39.021998 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3725/7473] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:38 2022] POST /identity/v3/users => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:39.026018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:39.027441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:39.041685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688ffc7-f5cb-4c71-a4b3-704ffebbaa3c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:39.046477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ddb84-6e60-4a93-9c5f-0b5219f820ec tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:39.047085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ddb84-6e60-4a93-9c5f-0b5219f820ec tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:39.047375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ddb84-6e60-4a93-9c5f-0b5219f820ec tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:39.047657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ddb84-6e60-4a93-9c5f-0b5219f820ec tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:39.048281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ddb84-6e60-4a93-9c5f-0b5219f820ec tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:39.050183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ddb84-6e60-4a93-9c5f-0b5219f820ec tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:39.082892 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3749/7474] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:39 2022] POST /identity/v3/projects => generated 360 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:39.087138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec887243-e1dd-4064-bd6b-e37e5253ce7f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:39.098384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec887243-e1dd-4064-bd6b-e37e5253ce7f tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:39.154291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d85f0-d791-4498-9cb3-b82bd4e8c710 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:39.154954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d85f0-d791-4498-9cb3-b82bd4e8c710 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:39.155224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d85f0-d791-4498-9cb3-b82bd4e8c710 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:39.155498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d85f0-d791-4498-9cb3-b82bd4e8c710 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/b16d795277c141099ffa53c622399f68` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:39.169781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d85f0-d791-4498-9cb3-b82bd4e8c710 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:update_user(user_id=b16d795277c141099ffa53c622399f68)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:39.171933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d85f0-d791-4498-9cb3-b82bd4e8c710 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:39.203598 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3726/7475] 10.222.0.27 () {60 vars in 1244 bytes} [Wed Oct 19 01:21:39 2022] PATCH /identity/v3/users/b16d795277c141099ffa53c622399f68 => generated 524 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:39.208064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ddb84-6e60-4a93-9c5f-0b5219f820ec tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:39.219041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ddb84-6e60-4a93-9c5f-0b5219f820ec tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:39.223719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baaab1-03ec-4357-8d39-e3030aadb46c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:39.224349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baaab1-03ec-4357-8d39-e3030aadb46c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:39.224667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baaab1-03ec-4357-8d39-e3030aadb46c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:39.224958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baaab1-03ec-4357-8d39-e3030aadb46c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/b16d795277c141099ffa53c622399f68` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:39.239213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56baaab1-03ec-4357-8d39-e3030aadb46c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:get_user(user_id=b16d795277c141099ffa53c622399f68)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:39.241501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56baaab1-03ec-4357-8d39-e3030aadb46c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:39.243160 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3750/7476] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:21:39 2022] GET /identity/v3/users/b16d795277c141099ffa53c622399f68 => generated 390 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:39.247453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d85f0-d791-4498-9cb3-b82bd4e8c710 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:39.258005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d85f0-d791-4498-9cb3-b82bd4e8c710 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:39.262583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:39.263200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:39.263481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:39.264331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/projects/1e3954750e944ed4b650865bfd145631` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:39.265477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e3954750e944ed4b650865bfd145631)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:39.267362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:39.315943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3954750e944ed4b650865bfd145631', 'request_id': 'req-d831bbfd-8927-4589-8d80-1aa132eb51e7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.324487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3954750e944ed4b650865bfd145631', 'request_id': 'req-d831bbfd-8927-4589-8d80-1aa132eb51e7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.333159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3954750e944ed4b650865bfd145631', 'request_id': 'req-d831bbfd-8927-4589-8d80-1aa132eb51e7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.348230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] The token cache is being invalidate because project 1e3954750e944ed4b650865bfd145631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:39.348525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.349389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.350998 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3727/7477] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:39 2022] DELETE /identity/v3/projects/1e3954750e944ed4b650865bfd145631 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:39.355394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baaab1-03ec-4357-8d39-e3030aadb46c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:39.357631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-56baaab1-03ec-4357-8d39-e3030aadb46c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:39.395274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baaab1-03ec-4357-8d39-e3030aadb46c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:39.449222 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:39.463163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2b79f3518041339f46db14b69de9ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecd69c0534fb4737992fa245b3da238c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:39.463814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:39.464099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:39.464420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] PATH_INFO: `/v3/users/b16d795277c141099ffa53c622399f68` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:39.465694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b16d795277c141099ffa53c622399f68)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:39.467820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:39.516959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16d795277c141099ffa53c622399f68'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.528892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16d795277c141099ffa53c622399f68'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.537399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16d795277c141099ffa53c622399f68'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.546083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16d795277c141099ffa53c622399f68'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.547296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ef9c4244-7fc7-4d2d-a61f-d0aab7b19c1c tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16d795277c141099ffa53c622399f68'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.554215 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3751/7478] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:39 2022] DELETE /identity/v3/users/b16d795277c141099ffa53c622399f68 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:39.565028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:39.569846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:39.573810 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:39.648849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831bbfd-8927-4589-8d80-1aa132eb51e7 tempest-UsersV3TestJSON-527920709 tempest-UsersV3TestJSON-527920709-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:39.703517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:39.704143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:39.704423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:39.704724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] PATH_INFO: `/v3/users/5a2f36a9104c4e0487a663651cf9f200` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:39.718094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2f36a9104c4e0487a663651cf9f200)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:39.720042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:39.767837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2f36a9104c4e0487a663651cf9f200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.780247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2f36a9104c4e0487a663651cf9f200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.787657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2f36a9104c4e0487a663651cf9f200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.794693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2f36a9104c4e0487a663651cf9f200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.795404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2f36a9104c4e0487a663651cf9f200'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:39.801235 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3728/7479] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:39 2022] DELETE /identity/v3/users/5a2f36a9104c4e0487a663651cf9f200 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:39.806136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa60ec0-d3af-4029-9362-f40ff136e644 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:39.806603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa60ec0-d3af-4029-9362-f40ff136e644 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:39.806698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa60ec0-d3af-4029-9362-f40ff136e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:39.827420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dfa60ec0-d3af-4029-9362-f40ff136e644 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:39.828666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dfa60ec0-d3af-4029-9362-f40ff136e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:39.890240 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3752/7480] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:39.899955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:39.901414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:39.911270 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:39.965740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859c07-ef89-41ba-8e58-3fc71b7821a7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:39.969953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986b38f-fb7a-4c9b-a4cd-eef73f8e81fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:39.970589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986b38f-fb7a-4c9b-a4cd-eef73f8e81fa service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:39.970870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986b38f-fb7a-4c9b-a4cd-eef73f8e81fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:39.971143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986b38f-fb7a-4c9b-a4cd-eef73f8e81fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:39.980356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986b38f-fb7a-4c9b-a4cd-eef73f8e81fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:39.981829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986b38f-fb7a-4c9b-a4cd-eef73f8e81fa service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:39.993056 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3729/7481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:40.577699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa60ec0-d3af-4029-9362-f40ff136e644 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:40.578688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dfa60ec0-d3af-4029-9362-f40ff136e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:40.618241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa60ec0-d3af-4029-9362-f40ff136e644 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:40.639787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:40.640595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:40.641015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:40.641501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] PATH_INFO: `/v3/projects/2cf083f840c046c1b38da59244845d0e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:40.643484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf083f840c046c1b38da59244845d0e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:40.645914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:40.702498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf083f840c046c1b38da59244845d0e', 'request_id': 'req-07b859e2-ed7c-4e02-bf76-bb21063a2558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.710446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf083f840c046c1b38da59244845d0e', 'request_id': 'req-07b859e2-ed7c-4e02-bf76-bb21063a2558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.716222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf083f840c046c1b38da59244845d0e', 'request_id': 'req-07b859e2-ed7c-4e02-bf76-bb21063a2558'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.717457 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:40.732023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] The token cache is being invalidate because project 2cf083f840c046c1b38da59244845d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:40.732430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.733236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.734780 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3753/7482] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:40 2022] DELETE /identity/v3/projects/2cf083f840c046c1b38da59244845d0e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:40.738812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986b38f-fb7a-4c9b-a4cd-eef73f8e81fa service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:40.750139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986b38f-fb7a-4c9b-a4cd-eef73f8e81fa service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:40.820833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:40.821481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:40.822228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:40.822228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] PATH_INFO: `/v3/users/ac2b79f3518041339f46db14b69de9ae` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:40.823167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2b79f3518041339f46db14b69de9ae)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:40.825847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:40.891493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2b79f3518041339f46db14b69de9ae'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.908860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2b79f3518041339f46db14b69de9ae'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.933028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2b79f3518041339f46db14b69de9ae'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.951120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2b79f3518041339f46db14b69de9ae'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.951929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a7d6a11d-2f4d-485c-aaf7-9e2391860c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2b79f3518041339f46db14b69de9ae'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:40.958880 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3730/7483] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:40 2022] DELETE /identity/v3/users/ac2b79f3518041339f46db14b69de9ae => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:41.238743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:41.240966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:41.254627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b859e2-ed7c-4e02-bf76-bb21063a2558 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:41.321805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:41.322468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.322732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.323007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] PATH_INFO: `/v3/projects/ecd69c0534fb4737992fa245b3da238c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.324142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd69c0534fb4737992fa245b3da238c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:41.326898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:41.376333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd69c0534fb4737992fa245b3da238c', 'request_id': 'req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:41.384122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd69c0534fb4737992fa245b3da238c', 'request_id': 'req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:41.390954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd69c0534fb4737992fa245b3da238c', 'request_id': 'req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:41.403974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] The token cache is being invalidate because project ecd69c0534fb4737992fa245b3da238c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:41.404381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:41.405129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-41067edc-35a1-43ea-a15a-81ff7e2a0b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:41.406946 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3754/7484] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:41 2022] DELETE /identity/v3/projects/ecd69c0534fb4737992fa245b3da238c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:41.412575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ee32c-5b28-42b4-8150-4034b76b84e7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.413098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ee32c-5b28-42b4-8150-4034b76b84e7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.413446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ee32c-5b28-42b4-8150-4034b76b84e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.433727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-da3ee32c-5b28-42b4-8150-4034b76b84e7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:41.435755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da3ee32c-5b28-42b4-8150-4034b76b84e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:41.462463 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:41.502536 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3731/7485] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:41.511331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0f2ff-1ea3-461c-a387-fc4aae96231b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.511641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0f2ff-1ea3-461c-a387-fc4aae96231b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.511922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0f2ff-1ea3-461c-a387-fc4aae96231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.533789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a5e0f2ff-1ea3-461c-a387-fc4aae96231b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:41.534817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a5e0f2ff-1ea3-461c-a387-fc4aae96231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:41.543656 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3755/7486] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:41.548171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ee32c-5b28-42b4-8150-4034b76b84e7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:41.557906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ee32c-5b28-42b4-8150-4034b76b84e7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:41.563712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37d616-f37e-4152-a9b5-b526af51019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:41.564335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37d616-f37e-4152-a9b5-b526af51019a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.564942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37d616-f37e-4152-a9b5-b526af51019a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.564942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37d616-f37e-4152-a9b5-b526af51019a admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.565583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37d616-f37e-4152-a9b5-b526af51019a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:41.565887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37d616-f37e-4152-a9b5-b526af51019a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:41.567491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37d616-f37e-4152-a9b5-b526af51019a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:41.588071 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3732/7487] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:41.593097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0f2ff-1ea3-461c-a387-fc4aae96231b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:41.605093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0f2ff-1ea3-461c-a387-fc4aae96231b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:41.610958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664374-92a0-45c7-8331-bd2a0e1e8ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:41.611680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664374-92a0-45c7-8331-bd2a0e1e8ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.611844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664374-92a0-45c7-8331-bd2a0e1e8ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.612113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664374-92a0-45c7-8331-bd2a0e1e8ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.612807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f664374-92a0-45c7-8331-bd2a0e1e8ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:41.614744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f664374-92a0-45c7-8331-bd2a0e1e8ce5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:41.653108 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3756/7488] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:41 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:41.654391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37d616-f37e-4152-a9b5-b526af51019a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:41.665182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37d616-f37e-4152-a9b5-b526af51019a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:41.738183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797e1f-0b28-4870-b4b9-014b0c347014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:41.739095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797e1f-0b28-4870-b4b9-014b0c347014 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.739343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797e1f-0b28-4870-b4b9-014b0c347014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.739628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797e1f-0b28-4870-b4b9-014b0c347014 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.740287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59797e1f-0b28-4870-b4b9-014b0c347014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:41.742695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59797e1f-0b28-4870-b4b9-014b0c347014 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:41.777902 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3733/7489] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:41 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:41.779383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664374-92a0-45c7-8331-bd2a0e1e8ce5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:41.801374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664374-92a0-45c7-8331-bd2a0e1e8ce5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:41.818770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b445-d1c7-4803-9959-f841c292924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:41.819568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b445-d1c7-4803-9959-f841c292924d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.820338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b445-d1c7-4803-9959-f841c292924d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.821142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b445-d1c7-4803-9959-f841c292924d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.821655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7b445-d1c7-4803-9959-f841c292924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:41.823556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7b445-d1c7-4803-9959-f841c292924d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:41.842491 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3757/7490] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:41.843826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797e1f-0b28-4870-b4b9-014b0c347014 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:41.855251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797e1f-0b28-4870-b4b9-014b0c347014 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:41.860659 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daaca2-23d6-42cd-b765-194b0c603570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:41.861288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daaca2-23d6-42cd-b765-194b0c603570 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.861573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daaca2-23d6-42cd-b765-194b0c603570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.861853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daaca2-23d6-42cd-b765-194b0c603570 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.862510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daaca2-23d6-42cd-b765-194b0c603570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:41.864200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daaca2-23d6-42cd-b765-194b0c603570 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:41.880127 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3734/7491] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:41.881888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b445-d1c7-4803-9959-f841c292924d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:41.894541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b445-d1c7-4803-9959-f841c292924d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:41.899126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24171de8-b854-4661-938c-2e54d42a54f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:41.900077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24171de8-b854-4661-938c-2e54d42a54f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.900464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24171de8-b854-4661-938c-2e54d42a54f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.900844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24171de8-b854-4661-938c-2e54d42a54f9 admin admin] PATH_INFO: `/v3/projects/0e27d87fb13d4206924f2cb80488f2eb/users/75b150528db24332b67a715ad0dd34dd/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.917882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24171de8-b854-4661-938c-2e54d42a54f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e27d87fb13d4206924f2cb80488f2eb, user_id=75b150528db24332b67a715ad0dd34dd, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:41.921401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24171de8-b854-4661-938c-2e54d42a54f9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:41.947936 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3758/7492] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:41 2022] PUT /identity/v3/projects/0e27d87fb13d4206924f2cb80488f2eb/users/75b150528db24332b67a715ad0dd34dd/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:41.951108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8762ba-cb9f-4d20-b6a3-749a502c222b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:41.951396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8762ba-cb9f-4d20-b6a3-749a502c222b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:41.951678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8762ba-cb9f-4d20-b6a3-749a502c222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:41.985562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6c8762ba-cb9f-4d20-b6a3-749a502c222b None None] MFA Rules not processed for user `75b150528db24332b67a715ad0dd34dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:41.986809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6c8762ba-cb9f-4d20-b6a3-749a502c222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:42.084744 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3735/7493] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:42.088641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24171de8-b854-4661-938c-2e54d42a54f9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:42.099830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24171de8-b854-4661-938c-2e54d42a54f9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:42.104960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2539-27d6-4944-8cd9-ab0f8a6190e1 tempest-IdentityCatalogTest-1533885704 tempest-IdentityCatalogTest-1533885704-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b150528db24332b67a715ad0dd34dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e27d87fb13d4206924f2cb80488f2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:42.105147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2539-27d6-4944-8cd9-ab0f8a6190e1 tempest-IdentityCatalogTest-1533885704 tempest-IdentityCatalogTest-1533885704-project] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:42.105431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2539-27d6-4944-8cd9-ab0f8a6190e1 tempest-IdentityCatalogTest-1533885704 tempest-IdentityCatalogTest-1533885704-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:42.105705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2539-27d6-4944-8cd9-ab0f8a6190e1 tempest-IdentityCatalogTest-1533885704 tempest-IdentityCatalogTest-1533885704-project] PATH_INFO: `/v3/auth/catalog` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:42.106281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2539-27d6-4944-8cd9-ab0f8a6190e1 tempest-IdentityCatalogTest-1533885704 tempest-IdentityCatalogTest-1533885704-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:42.107906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2539-27d6-4944-8cd9-ab0f8a6190e1 tempest-IdentityCatalogTest-1533885704 tempest-IdentityCatalogTest-1533885704-project] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:42.109881 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3759/7494] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 01:21:42 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:42.114897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8762ba-cb9f-4d20-b6a3-749a502c222b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:42.150092 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:42.200592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8762ba-cb9f-4d20-b6a3-749a502c222b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:42.217701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:42.217701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:42.217701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:42.217701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] PATH_INFO: `/v3/users/75b150528db24332b67a715ad0dd34dd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:42.218113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b150528db24332b67a715ad0dd34dd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:42.218113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:42.281460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b150528db24332b67a715ad0dd34dd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.299994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b150528db24332b67a715ad0dd34dd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.309351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b150528db24332b67a715ad0dd34dd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.318094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b150528db24332b67a715ad0dd34dd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.318875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b150528db24332b67a715ad0dd34dd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.326040 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3736/7495] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:42 2022] DELETE /identity/v3/users/75b150528db24332b67a715ad0dd34dd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:42.330393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3d2d5-a726-430e-ab2b-ca6490dd8cfd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:42.330882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3d2d5-a726-430e-ab2b-ca6490dd8cfd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:42.331053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3d2d5-a726-430e-ab2b-ca6490dd8cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:42.351626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aae3d2d5-a726-430e-ab2b-ca6490dd8cfd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:42.353000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aae3d2d5-a726-430e-ab2b-ca6490dd8cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:42.366605 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:42.434480 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3760/7496] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:42.447527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:42.449526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:42.533767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817e880-6e90-437d-8fda-368f80883f71 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:42.537509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426400c-0e25-4d77-b34b-8423c1d6ca8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:42.538435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426400c-0e25-4d77-b34b-8423c1d6ca8e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:42.538435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426400c-0e25-4d77-b34b-8423c1d6ca8e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:42.538685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426400c-0e25-4d77-b34b-8423c1d6ca8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:42.549651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426400c-0e25-4d77-b34b-8423c1d6ca8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:42.551110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426400c-0e25-4d77-b34b-8423c1d6ca8e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:42.562722 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3737/7497] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:42.846900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3d2d5-a726-430e-ab2b-ca6490dd8cfd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:42.848372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aae3d2d5-a726-430e-ab2b-ca6490dd8cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:42.862807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3d2d5-a726-430e-ab2b-ca6490dd8cfd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:42.867809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:42.868490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:42.868817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:42.869112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] PATH_INFO: `/v3/projects/0e27d87fb13d4206924f2cb80488f2eb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:42.870235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e27d87fb13d4206924f2cb80488f2eb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:42.872144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:42.919950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e27d87fb13d4206924f2cb80488f2eb', 'request_id': 'req-4502ab33-5ca1-4176-ab5f-257974b81591'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.927248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e27d87fb13d4206924f2cb80488f2eb', 'request_id': 'req-4502ab33-5ca1-4176-ab5f-257974b81591'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.933055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e27d87fb13d4206924f2cb80488f2eb', 'request_id': 'req-4502ab33-5ca1-4176-ab5f-257974b81591'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.945453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] The token cache is being invalidate because project 0e27d87fb13d4206924f2cb80488f2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:42.945735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.946386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4502ab33-5ca1-4176-ab5f-257974b81591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:42.947882 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3761/7498] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:42 2022] DELETE /identity/v3/projects/0e27d87fb13d4206924f2cb80488f2eb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:42.953536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5144ac-b73f-4bdc-baed-c8d3bb8b615f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:42.954016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5144ac-b73f-4bdc-baed-c8d3bb8b615f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:42.954128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5144ac-b73f-4bdc-baed-c8d3bb8b615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:42.974387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0c5144ac-b73f-4bdc-baed-c8d3bb8b615f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:42.975229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0c5144ac-b73f-4bdc-baed-c8d3bb8b615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:43.019536 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:43.055887 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3738/7499] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:43.063909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8bdad-5699-4aa1-91b8-b9c859684860 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:43.064201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8bdad-5699-4aa1-91b8-b9c859684860 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:43.064483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8bdad-5699-4aa1-91b8-b9c859684860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:43.084902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ded8bdad-5699-4aa1-91b8-b9c859684860 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:43.086137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ded8bdad-5699-4aa1-91b8-b9c859684860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:43.095105 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3762/7500] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:43.099516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5144ac-b73f-4bdc-baed-c8d3bb8b615f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:43.110166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5144ac-b73f-4bdc-baed-c8d3bb8b615f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:43.115104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930be7-0488-4fd4-b4db-60fe457f8e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:43.115722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930be7-0488-4fd4-b4db-60fe457f8e17 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:43.116009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930be7-0488-4fd4-b4db-60fe457f8e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:43.116290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930be7-0488-4fd4-b4db-60fe457f8e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:43.116982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930be7-0488-4fd4-b4db-60fe457f8e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:21:43.117290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930be7-0488-4fd4-b4db-60fe457f8e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:43.118925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930be7-0488-4fd4-b4db-60fe457f8e17 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:43.131450 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3739/7501] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:21:43.135832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8bdad-5699-4aa1-91b8-b9c859684860 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:43.151791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8bdad-5699-4aa1-91b8-b9c859684860 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:43.157223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca94ca2-e6a9-479d-b08e-8b4f3f5db274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:43.157844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca94ca2-e6a9-479d-b08e-8b4f3f5db274 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:43.158738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca94ca2-e6a9-479d-b08e-8b4f3f5db274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:43.158738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca94ca2-e6a9-479d-b08e-8b4f3f5db274 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:43.159018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca94ca2-e6a9-479d-b08e-8b4f3f5db274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:43.160972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca94ca2-e6a9-479d-b08e-8b4f3f5db274 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:43.193209 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3763/7502] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:21:43 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:43.194333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930be7-0488-4fd4-b4db-60fe457f8e17 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:43.205441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930be7-0488-4fd4-b4db-60fe457f8e17 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:43.270275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5263d7-8faa-4820-911e-e870c3db288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:43.271194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5263d7-8faa-4820-911e-e870c3db288d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:43.271515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5263d7-8faa-4820-911e-e870c3db288d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:43.271910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5263d7-8faa-4820-911e-e870c3db288d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:43.272747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5263d7-8faa-4820-911e-e870c3db288d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:43.276178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5263d7-8faa-4820-911e-e870c3db288d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:43.306459 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3740/7503] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:21:43 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:21:43.307929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca94ca2-e6a9-479d-b08e-8b4f3f5db274 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:43.319109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca94ca2-e6a9-479d-b08e-8b4f3f5db274 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:43.324512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4cc5-800e-4311-9156-4a212e4e5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:43.325189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4cc5-800e-4311-9156-4a212e4e5741 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:43.325489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4cc5-800e-4311-9156-4a212e4e5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:43.326289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4cc5-800e-4311-9156-4a212e4e5741 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:43.326970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4cc5-800e-4311-9156-4a212e4e5741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:43.328650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4cc5-800e-4311-9156-4a212e4e5741 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:43.343250 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3764/7504] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:43.344363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5263d7-8faa-4820-911e-e870c3db288d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:43.354453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5263d7-8faa-4820-911e-e870c3db288d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:43.359367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9cfa7-dce4-4816-81c3-efade5ddea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:43.359973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9cfa7-dce4-4816-81c3-efade5ddea46 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:43.360255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9cfa7-dce4-4816-81c3-efade5ddea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:43.360531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9cfa7-dce4-4816-81c3-efade5ddea46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:43.361279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9cfa7-dce4-4816-81c3-efade5ddea46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:43.362875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9cfa7-dce4-4816-81c3-efade5ddea46 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:43.376978 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3741/7505] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:21:43.378244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4cc5-800e-4311-9156-4a212e4e5741 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:43.390095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4cc5-800e-4311-9156-4a212e4e5741 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:43.396226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d1e54-771c-499e-8ab4-eeb954c28870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:43.397413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1e54-771c-499e-8ab4-eeb954c28870 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:43.403581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1e54-771c-499e-8ab4-eeb954c28870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:43.405292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1e54-771c-499e-8ab4-eeb954c28870 admin admin] PATH_INFO: `/v3/projects/711dcabc1b644428890256fe0c3bd171/users/47bcd757bb5247dd98ddcedec9ecf078/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:43.421373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d1e54-771c-499e-8ab4-eeb954c28870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711dcabc1b644428890256fe0c3bd171, user_id=47bcd757bb5247dd98ddcedec9ecf078, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:43.424069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d1e54-771c-499e-8ab4-eeb954c28870 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:43.438426 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3765/7506] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:21:43 2022] PUT /identity/v3/projects/711dcabc1b644428890256fe0c3bd171/users/47bcd757bb5247dd98ddcedec9ecf078/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:43.449759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4824aad-5781-4ba4-9292-5a9d02cf6d67 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:43.450069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4824aad-5781-4ba4-9292-5a9d02cf6d67 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:43.450280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4824aad-5781-4ba4-9292-5a9d02cf6d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:43.497437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d4824aad-5781-4ba4-9292-5a9d02cf6d67 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:43.500146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d4824aad-5781-4ba4-9292-5a9d02cf6d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:43.605532 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3742/7507] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:43.612094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d1e54-771c-499e-8ab4-eeb954c28870 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:43.621940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d1e54-771c-499e-8ab4-eeb954c28870 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:43.626345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac8b8f-5e52-484d-a5b0-1ca172f89baa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:43.626992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac8b8f-5e52-484d-a5b0-1ca172f89baa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:43.627279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac8b8f-5e52-484d-a5b0-1ca172f89baa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:43.627558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac8b8f-5e52-484d-a5b0-1ca172f89baa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:43.669490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0cac8b8f-5e52-484d-a5b0-1ca172f89baa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:43.680056 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3766/7508] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:21:43 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:44.687231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc33ad-1bc5-403b-89d0-1c3b9c41665f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:44.687761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc33ad-1bc5-403b-89d0-1c3b9c41665f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:44.687857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc33ad-1bc5-403b-89d0-1c3b9c41665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:44.709172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3abc33ad-1bc5-403b-89d0-1c3b9c41665f None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:44.710468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3abc33ad-1bc5-403b-89d0-1c3b9c41665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:44.713888 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3743/7509] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:44 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:44.718336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9435-43d5-4108-b3f5-7f896b9832d1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:44.718838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9435-43d5-4108-b3f5-7f896b9832d1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:44.718968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9435-43d5-4108-b3f5-7f896b9832d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:44.726006 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:44.741240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e7fb9435-43d5-4108-b3f5-7f896b9832d1 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:44.742911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e7fb9435-43d5-4108-b3f5-7f896b9832d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:44.750511 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3767/7510] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:44.754623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc33ad-1bc5-403b-89d0-1c3b9c41665f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:44.765875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc33ad-1bc5-403b-89d0-1c3b9c41665f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:44.770132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdebc8-9ad1-4f00-ae59-294e1cc9a0fa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:44.770702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdebc8-9ad1-4f00-ae59-294e1cc9a0fa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:44.770988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdebc8-9ad1-4f00-ae59-294e1cc9a0fa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:44.771264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdebc8-9ad1-4f00-ae59-294e1cc9a0fa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:44.802129 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-9dfdebc8-9ad1-4f00-ae59-294e1cc9a0fa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:21:44.823121 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 19 01:21:44.824220 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:21:44.825592 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3744/7511] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:21:44 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 188 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 01:21:44.828597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9435-43d5-4108-b3f5-7f896b9832d1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:44.837894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9435-43d5-4108-b3f5-7f896b9832d1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:44.842378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c430e38-b98c-4101-8192-1fd453feede7 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:44.843034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c430e38-b98c-4101-8192-1fd453feede7 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:44.843322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c430e38-b98c-4101-8192-1fd453feede7 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:44.843604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c430e38-b98c-4101-8192-1fd453feede7 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-0c430e38-b98c-4101-8192-1fd453feede7 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:21:44.897841 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 19 01:21:44.898899 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:21:44.900128 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3768/7512] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:21:44 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 188 bytes in 71 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 19 01:21:44.903388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdebc8-9ad1-4f00-ae59-294e1cc9a0fa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:44.913359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdebc8-9ad1-4f00-ae59-294e1cc9a0fa tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:44.918639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072a70-e7d7-4f02-af9f-f128fc672967 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:44.919427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072a70-e7d7-4f02-af9f-f128fc672967 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:44.920255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072a70-e7d7-4f02-af9f-f128fc672967 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:44.920803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072a70-e7d7-4f02-af9f-f128fc672967 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:44.964728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-04072a70-e7d7-4f02-af9f-f128fc672967 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:44.975084 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3745/7513] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:21:44 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:45.979403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914385ce-5322-4846-bfe7-d254bd1a2ea8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:45.979823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914385ce-5322-4846-bfe7-d254bd1a2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:45.979970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914385ce-5322-4846-bfe7-d254bd1a2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:45.999497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-914385ce-5322-4846-bfe7-d254bd1a2ea8 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:46.000730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-914385ce-5322-4846-bfe7-d254bd1a2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:46.003945 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3769/7514] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:45 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:46.008562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38a077-8ec5-4117-8ca6-96d00e356042 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:46.009034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38a077-8ec5-4117-8ca6-96d00e356042 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:46.009160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38a077-8ec5-4117-8ca6-96d00e356042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:46.030141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7b38a077-8ec5-4117-8ca6-96d00e356042 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:46.030501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7b38a077-8ec5-4117-8ca6-96d00e356042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:46.037607 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3746/7515] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:46.041821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914385ce-5322-4846-bfe7-d254bd1a2ea8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:46.054818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914385ce-5322-4846-bfe7-d254bd1a2ea8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:46.059090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33277e9-02ab-465c-ad94-97c31e0e7dc5 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:46.059982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33277e9-02ab-465c-ad94-97c31e0e7dc5 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:46.060269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33277e9-02ab-465c-ad94-97c31e0e7dc5 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:46.060546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33277e9-02ab-465c-ad94-97c31e0e7dc5 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:46.108745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e33277e9-02ab-465c-ad94-97c31e0e7dc5 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:46.117603 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3770/7516] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:21:46 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:47.124056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e08b98-5cf9-41da-ad89-dfdb54157901 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:47.124667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e08b98-5cf9-41da-ad89-dfdb54157901 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:47.124667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e08b98-5cf9-41da-ad89-dfdb54157901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:47.144123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-96e08b98-5cf9-41da-ad89-dfdb54157901 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:47.145362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-96e08b98-5cf9-41da-ad89-dfdb54157901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:47.148426 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3747/7517] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:47 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:47.153570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b936-894a-4d49-ab33-5053f0a49920 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:47.154090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b936-894a-4d49-ab33-5053f0a49920 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:47.154189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b936-894a-4d49-ab33-5053f0a49920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:47.176562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7c36b936-894a-4d49-ab33-5053f0a49920 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:47.177824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c36b936-894a-4d49-ab33-5053f0a49920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:47.186624 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3771/7518] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:47.191442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e08b98-5cf9-41da-ad89-dfdb54157901 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:47.204853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e08b98-5cf9-41da-ad89-dfdb54157901 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:47.208078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dab85-233f-4261-92ce-092b211a5cc4 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:47.208761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dab85-233f-4261-92ce-092b211a5cc4 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:47.209035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dab85-233f-4261-92ce-092b211a5cc4 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:47.209309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dab85-233f-4261-92ce-092b211a5cc4 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:47.255441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-693dab85-233f-4261-92ce-092b211a5cc4 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:47.265026 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3748/7519] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:21:47 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:21:47.637929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36b936-894a-4d49-ab33-5053f0a49920 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:47.640485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c36b936-894a-4d49-ab33-5053f0a49920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:47.734829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36b936-894a-4d49-ab33-5053f0a49920 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:47.738661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34224ad8-a6fb-4cd9-a0d9-0a5282fbfd68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:47.739279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224ad8-a6fb-4cd9-a0d9-0a5282fbfd68 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:47.739557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224ad8-a6fb-4cd9-a0d9-0a5282fbfd68 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:47.739829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224ad8-a6fb-4cd9-a0d9-0a5282fbfd68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:47.741735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-34224ad8-a6fb-4cd9-a0d9-0a5282fbfd68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:47.851462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34224ad8-a6fb-4cd9-a0d9-0a5282fbfd68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:47.853332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34224ad8-a6fb-4cd9-a0d9-0a5282fbfd68 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:47.874849 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3772/7520] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:48.270214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e7eae-9910-4349-9bc4-19ad694a043a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:48.271185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e7eae-9910-4349-9bc4-19ad694a043a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:48.272400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e7eae-9910-4349-9bc4-19ad694a043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:48.316001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-211e7eae-9910-4349-9bc4-19ad694a043a None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:48.318242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-211e7eae-9910-4349-9bc4-19ad694a043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:48.340897 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3749/7521] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:48 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:48.346303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f070f-55d5-4ab7-9be0-6e46b3feed53 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:48.347233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f070f-55d5-4ab7-9be0-6e46b3feed53 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:48.347683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f070f-55d5-4ab7-9be0-6e46b3feed53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:48.358380 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:48.390605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a03f070f-55d5-4ab7-9be0-6e46b3feed53 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:48.391981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a03f070f-55d5-4ab7-9be0-6e46b3feed53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:48.399988 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3773/7522] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:48.403988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e7eae-9910-4349-9bc4-19ad694a043a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:48.417738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e7eae-9910-4349-9bc4-19ad694a043a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:48.424508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf06a-20fc-41f7-a1c9-04ce92f9d03e tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:48.434489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf06a-20fc-41f7-a1c9-04ce92f9d03e tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:48.435232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf06a-20fc-41f7-a1c9-04ce92f9d03e tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:48.435707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf06a-20fc-41f7-a1c9-04ce92f9d03e tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:48.496935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-23fbf06a-20fc-41f7-a1c9-04ce92f9d03e tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:48.515883 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3750/7523] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:21:48 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:49.521637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87590384-1e8e-4db5-a582-5c36cc25e38e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:49.522210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87590384-1e8e-4db5-a582-5c36cc25e38e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:49.522210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87590384-1e8e-4db5-a582-5c36cc25e38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:49.552603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-87590384-1e8e-4db5-a582-5c36cc25e38e None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:49.554366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-87590384-1e8e-4db5-a582-5c36cc25e38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:49.558592 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3774/7524] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:49 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:50.564293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86444bfb-6472-49e7-a47a-7ba62a268cc2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:50.564887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86444bfb-6472-49e7-a47a-7ba62a268cc2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:50.564887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86444bfb-6472-49e7-a47a-7ba62a268cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:50.591813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-86444bfb-6472-49e7-a47a-7ba62a268cc2 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:50.593114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-86444bfb-6472-49e7-a47a-7ba62a268cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:50.601644 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3751/7525] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:50.607850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0141790-faf4-4389-acc9-e3c89fa8a26d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:50.609390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0141790-faf4-4389-acc9-e3c89fa8a26d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:50.609833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0141790-faf4-4389-acc9-e3c89fa8a26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:50.635927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f0141790-faf4-4389-acc9-e3c89fa8a26d None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:50.637179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f0141790-faf4-4389-acc9-e3c89fa8a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:50.644711 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3775/7526] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:50 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:50.646602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352c96-69bd-4f52-bbcb-162f29d2fe9b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:50.647021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352c96-69bd-4f52-bbcb-162f29d2fe9b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:50.647562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352c96-69bd-4f52-bbcb-162f29d2fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:50.718056 n-d-master-1 devstack@keystone.service[86424]: WARNING keystone.server.flask.application [None req-6e352c96-69bd-4f52-bbcb-162f29d2fe9b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 19 01:21:50.719610 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3752/7527] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 74 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 19 01:21:50.724241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7cb3c-bd97-4692-8953-137598953f3a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:50.724523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7cb3c-bd97-4692-8953-137598953f3a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:50.724828 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7cb3c-bd97-4692-8953-137598953f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:50.771974 n-d-master-1 devstack@keystone.service[86425]: WARNING keystone.server.flask.application [None req-bfa7cb3c-bd97-4692-8953-137598953f3a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 19 01:21:50.773489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3776/7528] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 50 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 19 01:21:50.777978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6aa91-4c9a-4f40-bd5f-8727ae85b701 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:50.778257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6aa91-4c9a-4f40-bd5f-8727ae85b701 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:50.778525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6aa91-4c9a-4f40-bd5f-8727ae85b701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:50.805590 n-d-master-1 devstack@keystone.service[86424]: WARNING keystone.server.flask.application [None req-b4f6aa91-4c9a-4f40-bd5f-8727ae85b701 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 19 01:21:50.807214 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3753/7529] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 30 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 19 01:21:51.274108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7cb3c-bd97-4692-8953-137598953f3a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:51.276308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bfa7cb3c-bd97-4692-8953-137598953f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:51.364382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7cb3c-bd97-4692-8953-137598953f3a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:51.370104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:51.370898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:51.371245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:51.371588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] PATH_INFO: `/v3/users/0d12c0ca2333460bbf044ceb5178affb` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:51.372857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d12c0ca2333460bbf044ceb5178affb)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:51.375802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:51.441645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d12c0ca2333460bbf044ceb5178affb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:51.454816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d12c0ca2333460bbf044ceb5178affb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:51.463371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d12c0ca2333460bbf044ceb5178affb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:51.470966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d12c0ca2333460bbf044ceb5178affb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:51.471647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d12c0ca2333460bbf044ceb5178affb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:51.477793 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3777/7530] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:51 2022] DELETE /identity/v3/users/0d12c0ca2333460bbf044ceb5178affb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:51.483098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df810d-aab3-4769-ae54-3f2613282832 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:51.483460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df810d-aab3-4769-ae54-3f2613282832 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:51.483836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df810d-aab3-4769-ae54-3f2613282832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:51.505597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-62df810d-aab3-4769-ae54-3f2613282832 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:51.506943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-62df810d-aab3-4769-ae54-3f2613282832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:51.562435 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:UPDATE=4,keystone:INSERT=6,keystone:DELETE=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:51.576469 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3754/7531] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:21:51.585891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:51.587293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:51.641062 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:51.657378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720fc67-7b28-4ab2-9acf-ea0a55f9ed78 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:51.663234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44e6c8-7517-46b8-ab9b-9cf11772b758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:51.664007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44e6c8-7517-46b8-ab9b-9cf11772b758 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:51.664751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44e6c8-7517-46b8-ab9b-9cf11772b758 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:51.665052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44e6c8-7517-46b8-ab9b-9cf11772b758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:51.678625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44e6c8-7517-46b8-ab9b-9cf11772b758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:51.680168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44e6c8-7517-46b8-ab9b-9cf11772b758 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:51.692253 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3778/7532] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:21:51.895492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df810d-aab3-4769-ae54-3f2613282832 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:51.897430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-62df810d-aab3-4769-ae54-3f2613282832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:51.920655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df810d-aab3-4769-ae54-3f2613282832 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:51.938015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:51.938745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:51.939043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:51.939325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] PATH_INFO: `/v3/projects/1eabce6bc9744aa9b56f5d3a24900020` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:51.940592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eabce6bc9744aa9b56f5d3a24900020)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:51.942589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:52.023325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eabce6bc9744aa9b56f5d3a24900020', 'request_id': 'req-a669a154-6910-4b90-a663-0ecf1121ea65'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.042270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eabce6bc9744aa9b56f5d3a24900020', 'request_id': 'req-a669a154-6910-4b90-a663-0ecf1121ea65'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.055167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eabce6bc9744aa9b56f5d3a24900020', 'request_id': 'req-a669a154-6910-4b90-a663-0ecf1121ea65'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.070823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] The token cache is being invalidate because project 1eabce6bc9744aa9b56f5d3a24900020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:52.071123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.071902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.073685 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3755/7533] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:51 2022] DELETE /identity/v3/projects/1eabce6bc9744aa9b56f5d3a24900020 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:52.077948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44e6c8-7517-46b8-ab9b-9cf11772b758 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:52.092892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44e6c8-7517-46b8-ab9b-9cf11772b758 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:52.175345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:52.176157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:52.176538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:52.177095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] PATH_INFO: `/v3/users/46f86c902e15480fa7837b3463e2bc27` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:52.178425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f86c902e15480fa7837b3463e2bc27)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:52.180460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:52.237688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f86c902e15480fa7837b3463e2bc27'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.250105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f86c902e15480fa7837b3463e2bc27'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.259470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f86c902e15480fa7837b3463e2bc27'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.267499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f86c902e15480fa7837b3463e2bc27'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.268125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-1c3349d6-0612-4c40-a8f1-278de16eaf02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f86c902e15480fa7837b3463e2bc27'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:52.274522 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3779/7534] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:21:52 2022] DELETE /identity/v3/users/46f86c902e15480fa7837b3463e2bc27 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:52.836001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:52.839848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:52.879410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669a154-6910-4b90-a663-0ecf1121ea65 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:52.998734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:52.999596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:53.000055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:53.000485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] PATH_INFO: `/v3/projects/17366d0c57f4405884904e0aa5e16b5c` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:53.002104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17366d0c57f4405884904e0aa5e16b5c)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:53.004535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:53.079390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17366d0c57f4405884904e0aa5e16b5c', 'request_id': 'req-ab544a6b-3873-4753-87f5-2f4b821fa798'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:53.093769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17366d0c57f4405884904e0aa5e16b5c', 'request_id': 'req-ab544a6b-3873-4753-87f5-2f4b821fa798'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:53.100904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17366d0c57f4405884904e0aa5e16b5c', 'request_id': 'req-ab544a6b-3873-4753-87f5-2f4b821fa798'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:53.127025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] The token cache is being invalidate because project 17366d0c57f4405884904e0aa5e16b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:21:53.127399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:53.128131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:21:53.129791 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3756/7535] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:21:52 2022] DELETE /identity/v3/projects/17366d0c57f4405884904e0aa5e16b5c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:21:54.553297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24908b1e-90d7-48ae-85d1-6b17c0767492 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:54.553816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24908b1e-90d7-48ae-85d1-6b17c0767492 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:54.553954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24908b1e-90d7-48ae-85d1-6b17c0767492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:54.576692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-24908b1e-90d7-48ae-85d1-6b17c0767492 None None] MFA Rules not processed for user `fccb51cb03de4f50a1dd059a30a6c4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:21:54.578256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-24908b1e-90d7-48ae-85d1-6b17c0767492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:54.646370 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3780/7536] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:21:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:21:54.994108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:21:54.995582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:55.010705 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:55.062443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544a6b-3873-4753-87f5-2f4b821fa798 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:21:55.066061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:21:55.066678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:21:55.066965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:21:55.067243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:21:55.069034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:21:55.082538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:21:55.084010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:21:55.097986 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3757/7537] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:21:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:22:01.820838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba4fc-8989-4365-9d11-00a60b8cb15b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:01.821353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba4fc-8989-4365-9d11-00a60b8cb15b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:01.821456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba4fc-8989-4365-9d11-00a60b8cb15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:01.828076 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:01.868305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bc7ba4fc-8989-4365-9d11-00a60b8cb15b None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:01.869557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc7ba4fc-8989-4365-9d11-00a60b8cb15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:01.873916 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3781/7538] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:01 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:22:01.878848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:01.880398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:01.961729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5d95-90bc-403a-8b44-bb766acc1089 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:01.967265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96c03-f408-47af-95c5-b32069943928 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:01.968347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96c03-f408-47af-95c5-b32069943928 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:01.968914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96c03-f408-47af-95c5-b32069943928 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:01.969313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96c03-f408-47af-95c5-b32069943928 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:02.015217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-50b96c03-f408-47af-95c5-b32069943928 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:02.023791 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3758/7539] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:22:01 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:03.029999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057c1fe-0c99-4bba-a793-11fbf17f2b84 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:03.030543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057c1fe-0c99-4bba-a793-11fbf17f2b84 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:03.030543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057c1fe-0c99-4bba-a793-11fbf17f2b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:03.050864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f057c1fe-0c99-4bba-a793-11fbf17f2b84 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:03.052156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f057c1fe-0c99-4bba-a793-11fbf17f2b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:03.055344 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3782/7540] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:03 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:22:03.060147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca34b5-8228-4563-b069-46b3812aa411 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:03.061004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca34b5-8228-4563-b069-46b3812aa411 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:03.061360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca34b5-8228-4563-b069-46b3812aa411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-8bca34b5-8228-4563-b069-46b3812aa411 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 19 01:22:03.082092 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:22:03.083466 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:22:03.084672 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3759/7541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:03 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 01:22:03.087708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced37a58-0031-4160-b4eb-30bc3bd22d9e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:03.087999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced37a58-0031-4160-b4eb-30bc3bd22d9e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:03.088282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced37a58-0031-4160-b4eb-30bc3bd22d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:03.131703 n-d-master-1 devstack@keystone.service[86425]: WARNING keystone.server.flask.application [None req-ced37a58-0031-4160-b4eb-30bc3bd22d9e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 19 01:22:03.133151 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3783/7542] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:03 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 46 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 19 01:22:03.138011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8ce08-81dd-4490-bd13-3042566ec5f1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:03.138314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8ce08-81dd-4490-bd13-3042566ec5f1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:03.138586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8ce08-81dd-4490-bd13-3042566ec5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:03.176538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-efc8ce08-81dd-4490-bd13-3042566ec5f1 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:03.178027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-efc8ce08-81dd-4490-bd13-3042566ec5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:03.186788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3760/7543] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:03.190999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced37a58-0031-4160-b4eb-30bc3bd22d9e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:03.204121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced37a58-0031-4160-b4eb-30bc3bd22d9e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:03.208241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c7a93-9a8a-4cc1-977d-76dc376a5127 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:03.208913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c7a93-9a8a-4cc1-977d-76dc376a5127 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:03.209200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c7a93-9a8a-4cc1-977d-76dc376a5127 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:03.209496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c7a93-9a8a-4cc1-977d-76dc376a5127 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:03.254587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-733c7a93-9a8a-4cc1-977d-76dc376a5127 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:03.264287 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3784/7544] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:22:03 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:04.271062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46afa3-01ea-4fee-abf2-68738d60724a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:04.272572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46afa3-01ea-4fee-abf2-68738d60724a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:04.273381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46afa3-01ea-4fee-abf2-68738d60724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:04.301262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ed46afa3-01ea-4fee-abf2-68738d60724a None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:04.302934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ed46afa3-01ea-4fee-abf2-68738d60724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:04.313869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb178906-5b4e-45b7-8b91-376289e3ee2e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:04.314836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb178906-5b4e-45b7-8b91-376289e3ee2e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:04.315395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb178906-5b4e-45b7-8b91-376289e3ee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:04.319620 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3761/7545] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:04 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:22:04.372238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cb178906-5b4e-45b7-8b91-376289e3ee2e None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:04.376924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cb178906-5b4e-45b7-8b91-376289e3ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:04.390672 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3785/7546] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:04.395924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46afa3-01ea-4fee-abf2-68738d60724a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:04.421280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46afa3-01ea-4fee-abf2-68738d60724a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:04.427131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2926d-452f-4447-b501-a299e3cabe7a tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:04.428007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2926d-452f-4447-b501-a299e3cabe7a tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:04.428433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2926d-452f-4447-b501-a299e3cabe7a tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:04.428757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2926d-452f-4447-b501-a299e3cabe7a tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:04.515163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4cb2926d-452f-4447-b501-a299e3cabe7a tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:04.524848 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3762/7547] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:22:04 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:05.531886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7a073-b2ac-45e8-aee4-131ac18e1594 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:05.532446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7a073-b2ac-45e8-aee4-131ac18e1594 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:05.532446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7a073-b2ac-45e8-aee4-131ac18e1594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:05.567725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f6b7a073-b2ac-45e8-aee4-131ac18e1594 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:05.569041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f6b7a073-b2ac-45e8-aee4-131ac18e1594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:05.578148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c3fe3-018f-4329-9902-cb2c8fb1f6d9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:05.578736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c3fe3-018f-4329-9902-cb2c8fb1f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:05.578908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c3fe3-018f-4329-9902-cb2c8fb1f6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:05.584477 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3786/7548] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:05 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:22:05.602137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2a8c3fe3-018f-4329-9902-cb2c8fb1f6d9 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:05.603380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2a8c3fe3-018f-4329-9902-cb2c8fb1f6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:05.614546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3763/7549] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:22:05.615387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7a073-b2ac-45e8-aee4-131ac18e1594 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:05.638045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7a073-b2ac-45e8-aee4-131ac18e1594 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:05.644327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ccb67-ca23-4d13-9763-c3914a988e90 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bcd757bb5247dd98ddcedec9ecf078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711dcabc1b644428890256fe0c3bd171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:05.645271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ccb67-ca23-4d13-9763-c3914a988e90 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:05.645663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ccb67-ca23-4d13-9763-c3914a988e90 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:05.646042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ccb67-ca23-4d13-9763-c3914a988e90 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:05.722642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fb8ccb67-ca23-4d13-9763-c3914a988e90 tempest-IdentityV3UsersTest-783002995 tempest-IdentityV3UsersTest-783002995-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:05.735859 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3787/7550] 10.222.0.27 () {60 vars in 1269 bytes} [Wed Oct 19 01:22:05 2022] POST /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078/password => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:22:06.741403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934382e-e7f6-4c9a-b3ef-1f3b9e1a77d3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:06.741944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934382e-e7f6-4c9a-b3ef-1f3b9e1a77d3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:06.741944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934382e-e7f6-4c9a-b3ef-1f3b9e1a77d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:06.761029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7934382e-e7f6-4c9a-b3ef-1f3b9e1a77d3 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:06.762228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7934382e-e7f6-4c9a-b3ef-1f3b9e1a77d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:06.765404 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3764/7551] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:06 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 01:22:07.771251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b054-ef58-4eb6-ba7c-5e2835fd6ac1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:07.771782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b054-ef58-4eb6-ba7c-5e2835fd6ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:07.771782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b054-ef58-4eb6-ba7c-5e2835fd6ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:07.792205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f277b054-ef58-4eb6-ba7c-5e2835fd6ac1 None None] MFA Rules not processed for user `47bcd757bb5247dd98ddcedec9ecf078`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:07.793379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f277b054-ef58-4eb6-ba7c-5e2835fd6ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:07.800996 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3788/7552] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:07.806986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934382e-e7f6-4c9a-b3ef-1f3b9e1a77d3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:07.808527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7934382e-e7f6-4c9a-b3ef-1f3b9e1a77d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:07.829510 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:07.887128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934382e-e7f6-4c9a-b3ef-1f3b9e1a77d3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:07.891883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:07.892515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:07.892832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:07.893107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] PATH_INFO: `/v3/users/47bcd757bb5247dd98ddcedec9ecf078` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:07.894257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bcd757bb5247dd98ddcedec9ecf078)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:07.896201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:07.951828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:07.964203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:07.973442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:07.982271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:07.983109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bcd757bb5247dd98ddcedec9ecf078'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:07.989668 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3765/7553] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:22:07 2022] DELETE /identity/v3/users/47bcd757bb5247dd98ddcedec9ecf078 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:07.993930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c75e4-a1ae-43b2-b57a-f2f0ab524002 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:07.994287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c75e4-a1ae-43b2-b57a-f2f0ab524002 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:07.994549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c75e4-a1ae-43b2-b57a-f2f0ab524002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:08.015870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-177c75e4-a1ae-43b2-b57a-f2f0ab524002 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:08.017134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-177c75e4-a1ae-43b2-b57a-f2f0ab524002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:08.102528 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3789/7554] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:08.114048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:08.116943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:08.190134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ac341-9d79-48de-8b22-8391c4f69747 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:08.194224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7afde8-dfc1-475a-835f-222cf2e456c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:08.195181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7afde8-dfc1-475a-835f-222cf2e456c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:08.195538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7afde8-dfc1-475a-835f-222cf2e456c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:08.195887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7afde8-dfc1-475a-835f-222cf2e456c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:08.207168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7afde8-dfc1-475a-835f-222cf2e456c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:08.208778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7afde8-dfc1-475a-835f-222cf2e456c9 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:08.220437 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3766/7555] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:22:08.512187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c75e4-a1ae-43b2-b57a-f2f0ab524002 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:08.514665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-177c75e4-a1ae-43b2-b57a-f2f0ab524002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:08.530257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c75e4-a1ae-43b2-b57a-f2f0ab524002 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:08.535368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:08.536144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:08.536535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:08.536959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] PATH_INFO: `/v3/projects/711dcabc1b644428890256fe0c3bd171` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:08.538235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711dcabc1b644428890256fe0c3bd171)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:08.540645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:08.566382 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:08.601561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711dcabc1b644428890256fe0c3bd171', 'request_id': 'req-e8f8b1d2-dbfb-456b-b038-54aae05ee245'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:08.609845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711dcabc1b644428890256fe0c3bd171', 'request_id': 'req-e8f8b1d2-dbfb-456b-b038-54aae05ee245'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:08.616142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711dcabc1b644428890256fe0c3bd171', 'request_id': 'req-e8f8b1d2-dbfb-456b-b038-54aae05ee245'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:08.629557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] The token cache is being invalidate because project 711dcabc1b644428890256fe0c3bd171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:22:08.629860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:08.630506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e8f8b1d2-dbfb-456b-b038-54aae05ee245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:08.637514 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3790/7556] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:22:08 2022] DELETE /identity/v3/projects/711dcabc1b644428890256fe0c3bd171 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:08.640218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92882d36-cbbb-4974-bab2-a22645bdbe9e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:08.640512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92882d36-cbbb-4974-bab2-a22645bdbe9e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:08.640821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92882d36-cbbb-4974-bab2-a22645bdbe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:08.663627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-92882d36-cbbb-4974-bab2-a22645bdbe9e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:08.664879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-92882d36-cbbb-4974-bab2-a22645bdbe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:08.703171 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:08.745316 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3767/7557] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:08.747236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f8bc6-f5a8-4305-a236-ff97f72bed30 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:08.747569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f8bc6-f5a8-4305-a236-ff97f72bed30 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:08.747881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f8bc6-f5a8-4305-a236-ff97f72bed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:08.770004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-459f8bc6-f5a8-4305-a236-ff97f72bed30 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:08.771281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-459f8bc6-f5a8-4305-a236-ff97f72bed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:08.780425 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3791/7558] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:08.784730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92882d36-cbbb-4974-bab2-a22645bdbe9e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:08.795178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92882d36-cbbb-4974-bab2-a22645bdbe9e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:08.800120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5d7b0-78c2-4ad3-ad5f-51e254d53589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:08.800884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5d7b0-78c2-4ad3-ad5f-51e254d53589 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:08.801242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5d7b0-78c2-4ad3-ad5f-51e254d53589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:08.801598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5d7b0-78c2-4ad3-ad5f-51e254d53589 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:08.802403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5d7b0-78c2-4ad3-ad5f-51e254d53589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:22:08.802804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5d7b0-78c2-4ad3-ad5f-51e254d53589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:08.804718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5d7b0-78c2-4ad3-ad5f-51e254d53589 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:08.819845 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3768/7559] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:22:08.821679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f8bc6-f5a8-4305-a236-ff97f72bed30 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:08.831803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f8bc6-f5a8-4305-a236-ff97f72bed30 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:08.836584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1720-b3fa-4d76-899d-4316c951a162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:08.837300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1720-b3fa-4d76-899d-4316c951a162 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:08.837657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1720-b3fa-4d76-899d-4316c951a162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:08.838004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1720-b3fa-4d76-899d-4316c951a162 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:08.838728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa1720-b3fa-4d76-899d-4316c951a162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:08.840755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa1720-b3fa-4d76-899d-4316c951a162 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:08.876441 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3792/7560] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:22:08 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:22:08.877767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5d7b0-78c2-4ad3-ad5f-51e254d53589 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:08.892131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5d7b0-78c2-4ad3-ad5f-51e254d53589 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:08.976548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b47206-5e30-4dc9-aa39-77476500d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:08.977300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b47206-5e30-4dc9-aa39-77476500d01e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:08.977549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b47206-5e30-4dc9-aa39-77476500d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:08.977843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b47206-5e30-4dc9-aa39-77476500d01e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:08.978453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b47206-5e30-4dc9-aa39-77476500d01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:08.981416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b47206-5e30-4dc9-aa39-77476500d01e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.010925 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3769/7561] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:22:08 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:22:09.012262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1720-b3fa-4d76-899d-4316c951a162 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:09.024042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1720-b3fa-4d76-899d-4316c951a162 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:09.029507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061b421-c2be-426e-a705-84cb475a8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:09.030138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061b421-c2be-426e-a705-84cb475a8df5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.030424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061b421-c2be-426e-a705-84cb475a8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.030704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061b421-c2be-426e-a705-84cb475a8df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.031365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061b421-c2be-426e-a705-84cb475a8df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:09.033056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061b421-c2be-426e-a705-84cb475a8df5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.047449 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3793/7562] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:09.048929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b47206-5e30-4dc9-aa39-77476500d01e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:09.060074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b47206-5e30-4dc9-aa39-77476500d01e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:09.065090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189a8d6-d2c1-4549-9af4-afcae3c1134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:09.065776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189a8d6-d2c1-4549-9af4-afcae3c1134b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.066130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189a8d6-d2c1-4549-9af4-afcae3c1134b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.066486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189a8d6-d2c1-4549-9af4-afcae3c1134b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.067211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189a8d6-d2c1-4549-9af4-afcae3c1134b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:09.069071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189a8d6-d2c1-4549-9af4-afcae3c1134b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.085178 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3770/7563] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:09.086335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061b421-c2be-426e-a705-84cb475a8df5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:09.098611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061b421-c2be-426e-a705-84cb475a8df5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:09.103823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff982f9f-9788-47f4-bc93-77f34789540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:09.104483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff982f9f-9788-47f4-bc93-77f34789540d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.104804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff982f9f-9788-47f4-bc93-77f34789540d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.105093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff982f9f-9788-47f4-bc93-77f34789540d admin admin] PATH_INFO: `/v3/projects/43312374fa6c48db817c50df3432b492/users/f04cdf17048e4032a4d1c58a560af4ba/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.120151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff982f9f-9788-47f4-bc93-77f34789540d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43312374fa6c48db817c50df3432b492, user_id=f04cdf17048e4032a4d1c58a560af4ba, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:09.123726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff982f9f-9788-47f4-bc93-77f34789540d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.135835 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3794/7564] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:22:09 2022] PUT /identity/v3/projects/43312374fa6c48db817c50df3432b492/users/f04cdf17048e4032a4d1c58a560af4ba/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:09.147680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b2dd-24d2-4bd5-9d6c-1d597d397dea None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.147965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b2dd-24d2-4bd5-9d6c-1d597d397dea None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.148238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b2dd-24d2-4bd5-9d6c-1d597d397dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.176717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-eb20b2dd-24d2-4bd5-9d6c-1d597d397dea None None] MFA Rules not processed for user `f04cdf17048e4032a4d1c58a560af4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:09.177383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eb20b2dd-24d2-4bd5-9d6c-1d597d397dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:09.243327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3771/7565] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:09.248568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff982f9f-9788-47f4-bc93-77f34789540d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:09.314172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff982f9f-9788-47f4-bc93-77f34789540d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:09.318933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72458b67-084c-4a7b-a065-308152316aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:09.319685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458b67-084c-4a7b-a065-308152316aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.320070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458b67-084c-4a7b-a065-308152316aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.320747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458b67-084c-4a7b-a065-308152316aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.321291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72458b67-084c-4a7b-a065-308152316aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:09.323254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72458b67-084c-4a7b-a065-308152316aa6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.351593 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3795/7566] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:22:09 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:22:09.355576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b2dd-24d2-4bd5-9d6c-1d597d397dea None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:09.366528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b2dd-24d2-4bd5-9d6c-1d597d397dea None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:09.401933 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:09.431855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d16da4-1c9f-4a0e-8750-39a9c5d553f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:09.432544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d16da4-1c9f-4a0e-8750-39a9c5d553f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.432863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d16da4-1c9f-4a0e-8750-39a9c5d553f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.433138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d16da4-1c9f-4a0e-8750-39a9c5d553f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.433778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d16da4-1c9f-4a0e-8750-39a9c5d553f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:09.436465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d16da4-1c9f-4a0e-8750-39a9c5d553f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.462843 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3772/7567] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:22:09 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:22:09.463819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72458b67-084c-4a7b-a065-308152316aa6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:09.475483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72458b67-084c-4a7b-a065-308152316aa6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:09.480252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dcb96-16c4-4ea3-88b4-1b6feea752dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:09.480898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dcb96-16c4-4ea3-88b4-1b6feea752dd admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.481182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dcb96-16c4-4ea3-88b4-1b6feea752dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.481493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dcb96-16c4-4ea3-88b4-1b6feea752dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.483203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3dcb96-16c4-4ea3-88b4-1b6feea752dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:09.484827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3dcb96-16c4-4ea3-88b4-1b6feea752dd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.495880 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3796/7568] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:09.499992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d16da4-1c9f-4a0e-8750-39a9c5d553f5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:09.510123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d16da4-1c9f-4a0e-8750-39a9c5d553f5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:09.515806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0d0f5-40e3-4ab0-bb10-b62064ff171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:09.516414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0d0f5-40e3-4ab0-bb10-b62064ff171a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.516761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0d0f5-40e3-4ab0-bb10-b62064ff171a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.517063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0d0f5-40e3-4ab0-bb10-b62064ff171a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.517775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0d0f5-40e3-4ab0-bb10-b62064ff171a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:09.519466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0d0f5-40e3-4ab0-bb10-b62064ff171a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.530637 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3773/7569] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:09.535118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dcb96-16c4-4ea3-88b4-1b6feea752dd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:09.546258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dcb96-16c4-4ea3-88b4-1b6feea752dd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:09.551879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f337efb-908d-48d7-b516-a64b3c332c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:09.552591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f337efb-908d-48d7-b516-a64b3c332c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.552968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f337efb-908d-48d7-b516-a64b3c332c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.553310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f337efb-908d-48d7-b516-a64b3c332c21 admin admin] PATH_INFO: `/v3/projects/a76b333918bc4d6395bac49db93d85dd/users/4d34378d35044b04bd7f61eb80ff7644/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.569890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f337efb-908d-48d7-b516-a64b3c332c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76b333918bc4d6395bac49db93d85dd, user_id=4d34378d35044b04bd7f61eb80ff7644, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:09.572834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f337efb-908d-48d7-b516-a64b3c332c21 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.576647 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:09.591823 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3797/7570] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:22:09 2022] PUT /identity/v3/projects/a76b333918bc4d6395bac49db93d85dd/users/4d34378d35044b04bd7f61eb80ff7644/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:22:09.601968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ec69-c487-4004-a09b-4fba04c1880c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.602257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ec69-c487-4004-a09b-4fba04c1880c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.602533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ec69-c487-4004-a09b-4fba04c1880c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.634937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-71b5ec69-c487-4004-a09b-4fba04c1880c None None] MFA Rules not processed for user `4d34378d35044b04bd7f61eb80ff7644`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:09.636156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-71b5ec69-c487-4004-a09b-4fba04c1880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:09.708449 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3774/7571] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:09.720979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f337efb-908d-48d7-b516-a64b3c332c21 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:09.723098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3f337efb-908d-48d7-b516-a64b3c332c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:09.802406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f337efb-908d-48d7-b516-a64b3c332c21 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:09.806250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905d0ae-2b60-4da4-8440-ec41d121693c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:09.806935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905d0ae-2b60-4da4-8440-ec41d121693c service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:09.807221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905d0ae-2b60-4da4-8440-ec41d121693c service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:09.807494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905d0ae-2b60-4da4-8440-ec41d121693c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:09.885069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905d0ae-2b60-4da4-8440-ec41d121693c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:09.886512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905d0ae-2b60-4da4-8440-ec41d121693c service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:09.895938 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3798/7572] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:22:10.018111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5ec69-c487-4004-a09b-4fba04c1880c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:10.031536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5ec69-c487-4004-a09b-4fba04c1880c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:10.035115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7379ee-5c97-48c1-a900-0d5516a90d88 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:10.035715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7379ee-5c97-48c1-a900-0d5516a90d88 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:10.035992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7379ee-5c97-48c1-a900-0d5516a90d88 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:10.036263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7379ee-5c97-48c1-a900-0d5516a90d88 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:10.045848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7379ee-5c97-48c1-a900-0d5516a90d88 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:10.047309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7379ee-5c97-48c1-a900-0d5516a90d88 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:10.057604 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3775/7573] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:22:11.293164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905d0ae-2b60-4da4-8440-ec41d121693c service glance] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:11.359143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905d0ae-2b60-4da4-8440-ec41d121693c service glance] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:11.364358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:11.365058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:11.365340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:11.365620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] PATH_INFO: `/v3/users/f04cdf17048e4032a4d1c58a560af4ba` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:11.366800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04cdf17048e4032a4d1c58a560af4ba)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:11.368800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:11.412275 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=1,keystone:SELECT=93,keystone:DELETE=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:11.418587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04cdf17048e4032a4d1c58a560af4ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:11.432425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04cdf17048e4032a4d1c58a560af4ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:11.441342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04cdf17048e4032a4d1c58a560af4ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:11.448745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04cdf17048e4032a4d1c58a560af4ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:11.449529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04cdf17048e4032a4d1c58a560af4ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:11.456321 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3799/7574] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:22:11 2022] DELETE /identity/v3/users/f04cdf17048e4032a4d1c58a560af4ba => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:22:11.461480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85053e39-fb9b-4ad0-9000-505444db2cdf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:11.461480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85053e39-fb9b-4ad0-9000-505444db2cdf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:11.461912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85053e39-fb9b-4ad0-9000-505444db2cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:11.483727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-85053e39-fb9b-4ad0-9000-505444db2cdf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:11.484974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85053e39-fb9b-4ad0-9000-505444db2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:11.550754 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3776/7575] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:11.561578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:11.563354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:11.629130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f206-f69a-49f4-9689-ba548b5f4ded admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:11.633003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f5f5b-ddd8-49a4-b9cc-9f07adfabec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:11.633657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5f5b-ddd8-49a4-b9cc-9f07adfabec4 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:11.633942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5f5b-ddd8-49a4-b9cc-9f07adfabec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:11.634219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5f5b-ddd8-49a4-b9cc-9f07adfabec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:11.645326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f5f5b-ddd8-49a4-b9cc-9f07adfabec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:11.646785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f5f5b-ddd8-49a4-b9cc-9f07adfabec4 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:11.658359 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3800/7576] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:22:11.947332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85053e39-fb9b-4ad0-9000-505444db2cdf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:11.949279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85053e39-fb9b-4ad0-9000-505444db2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:11.970387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85053e39-fb9b-4ad0-9000-505444db2cdf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:11.978058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:11.978847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:11.979141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:11.989033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] PATH_INFO: `/v3/projects/43312374fa6c48db817c50df3432b492` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:11.989385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43312374fa6c48db817c50df3432b492)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:11.991358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:12.032345 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:12.064334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43312374fa6c48db817c50df3432b492', 'request_id': 'req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.074891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43312374fa6c48db817c50df3432b492', 'request_id': 'req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.084227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43312374fa6c48db817c50df3432b492', 'request_id': 'req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.098518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] The token cache is being invalidate because project 43312374fa6c48db817c50df3432b492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:22:12.098927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.099818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.104583 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3777/7577] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:22:11 2022] DELETE /identity/v3/projects/43312374fa6c48db817c50df3432b492 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:12.106182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f5f5b-ddd8-49a4-b9cc-9f07adfabec4 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:12.146172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f5f5b-ddd8-49a4-b9cc-9f07adfabec4 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:12.165949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:12.167455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:12.243391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:12.244658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:12.245125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:12.245725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] PATH_INFO: `/v3/users/4d34378d35044b04bd7f61eb80ff7644` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:12.247845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d34378d35044b04bd7f61eb80ff7644)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:12.250756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:12.281645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7f6e3-db4c-4f62-a3f0-7977cd9c085f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:12.288046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:12.288706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:12.289033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:12.289353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:12.291463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:12.310490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:12.312601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:12.321898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d34378d35044b04bd7f61eb80ff7644'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.326390 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3778/7578] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:22:12.334233 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:12.335666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d34378d35044b04bd7f61eb80ff7644'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.346943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d34378d35044b04bd7f61eb80ff7644'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.359129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d34378d35044b04bd7f61eb80ff7644'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.360334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f733a85-3af4-46af-bd46-ade30027eed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d34378d35044b04bd7f61eb80ff7644'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.368535 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3801/7579] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:22:12 2022] DELETE /identity/v3/users/4d34378d35044b04bd7f61eb80ff7644 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:12.711516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:12.713170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:12.735560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab659ab3-f484-4ab6-9105-757fca5d7a2c service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:12.799341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:12.800160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:12.800449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:12.800762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] PATH_INFO: `/v3/projects/a76b333918bc4d6395bac49db93d85dd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:12.802648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76b333918bc4d6395bac49db93d85dd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:12.805025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:12.852458 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:12.868911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76b333918bc4d6395bac49db93d85dd', 'request_id': 'req-b948ccc2-2058-435a-ae5a-2abd4deedc0e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.878981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76b333918bc4d6395bac49db93d85dd', 'request_id': 'req-b948ccc2-2058-435a-ae5a-2abd4deedc0e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.887075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76b333918bc4d6395bac49db93d85dd', 'request_id': 'req-b948ccc2-2058-435a-ae5a-2abd4deedc0e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.899682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] The token cache is being invalidate because project a76b333918bc4d6395bac49db93d85dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:22:12.900079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.900859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b948ccc2-2058-435a-ae5a-2abd4deedc0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:12.904695 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3779/7580] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:22:12 2022] DELETE /identity/v3/projects/a76b333918bc4d6395bac49db93d85dd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:12.910600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea4aa-127a-4c58-bd9d-ecbb179a33f2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:12.911083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea4aa-127a-4c58-bd9d-ecbb179a33f2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:12.911453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea4aa-127a-4c58-bd9d-ecbb179a33f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:12.931974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-307ea4aa-127a-4c58-bd9d-ecbb179a33f2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:12.933337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-307ea4aa-127a-4c58-bd9d-ecbb179a33f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:13.005832 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3802/7581] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:13.008995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1149854-53e9-4d10-a40a-f5a59ebe0c18 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:13.009279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1149854-53e9-4d10-a40a-f5a59ebe0c18 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:13.009554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1149854-53e9-4d10-a40a-f5a59ebe0c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:13.033271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b1149854-53e9-4d10-a40a-f5a59ebe0c18 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:13.034515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b1149854-53e9-4d10-a40a-f5a59ebe0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:13.047801 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3780/7582] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:13.049190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ea4aa-127a-4c58-bd9d-ecbb179a33f2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:13.062744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ea4aa-127a-4c58-bd9d-ecbb179a33f2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:13.067690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16527f1-d767-460b-a251-b42bfb391a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:13.068511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16527f1-d767-460b-a251-b42bfb391a08 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:13.068829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16527f1-d767-460b-a251-b42bfb391a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:13.069103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16527f1-d767-460b-a251-b42bfb391a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:13.069764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16527f1-d767-460b-a251-b42bfb391a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:22:13.070176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16527f1-d767-460b-a251-b42bfb391a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:13.071693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16527f1-d767-460b-a251-b42bfb391a08 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:13.089330 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3803/7583] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:22:13.090525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1149854-53e9-4d10-a40a-f5a59ebe0c18 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:13.102602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1149854-53e9-4d10-a40a-f5a59ebe0c18 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:13.108393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69984a-c184-4668-aee3-774fc3d4cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:13.109045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69984a-c184-4668-aee3-774fc3d4cf81 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:13.109328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69984a-c184-4668-aee3-774fc3d4cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:13.109606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69984a-c184-4668-aee3-774fc3d4cf81 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:13.110239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69984a-c184-4668-aee3-774fc3d4cf81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:13.112162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69984a-c184-4668-aee3-774fc3d4cf81 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:13.145150 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3781/7584] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:22:13 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:22:13.146376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16527f1-d767-460b-a251-b42bfb391a08 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:13.157657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16527f1-d767-460b-a251-b42bfb391a08 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:13.231156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb853b-aeae-49f8-bec8-93281c169a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:13.232410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb853b-aeae-49f8-bec8-93281c169a55 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:13.232897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb853b-aeae-49f8-bec8-93281c169a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:13.233249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb853b-aeae-49f8-bec8-93281c169a55 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:13.233956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb853b-aeae-49f8-bec8-93281c169a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:13.235986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb853b-aeae-49f8-bec8-93281c169a55 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:13.259757 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3804/7585] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:22:13 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:22:13.263992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69984a-c184-4668-aee3-774fc3d4cf81 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:13.274822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69984a-c184-4668-aee3-774fc3d4cf81 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:13.279632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a414c5-0b33-4236-baeb-223830c6c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:13.280239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a414c5-0b33-4236-baeb-223830c6c0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:13.280527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a414c5-0b33-4236-baeb-223830c6c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:13.280840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a414c5-0b33-4236-baeb-223830c6c0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:13.281485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a414c5-0b33-4236-baeb-223830c6c0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:13.283093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a414c5-0b33-4236-baeb-223830c6c0c2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:13.293169 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3782/7586] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:13.297713 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb853b-aeae-49f8-bec8-93281c169a55 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:13.307880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb853b-aeae-49f8-bec8-93281c169a55 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:13.313915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04c3ed-1b39-49f6-9f84-d0a2f9be3de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:13.314517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04c3ed-1b39-49f6-9f84-d0a2f9be3de6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:13.314801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04c3ed-1b39-49f6-9f84-d0a2f9be3de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:13.315082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04c3ed-1b39-49f6-9f84-d0a2f9be3de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:13.315731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04c3ed-1b39-49f6-9f84-d0a2f9be3de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:13.317358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04c3ed-1b39-49f6-9f84-d0a2f9be3de6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:13.327951 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3805/7587] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:13.331953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a414c5-0b33-4236-baeb-223830c6c0c2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:13.342932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a414c5-0b33-4236-baeb-223830c6c0c2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:13.347752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7da5a-276e-48f6-b4cd-7f12343eaf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:13.348425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7da5a-276e-48f6-b4cd-7f12343eaf7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:13.348748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7da5a-276e-48f6-b4cd-7f12343eaf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:13.349034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7da5a-276e-48f6-b4cd-7f12343eaf7b admin admin] PATH_INFO: `/v3/projects/51ad6088dc6841148a2937b2106b720c/users/45e340996210420caf46ce832c9a6973/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:13.365273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7da5a-276e-48f6-b4cd-7f12343eaf7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ad6088dc6841148a2937b2106b720c, user_id=45e340996210420caf46ce832c9a6973, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:13.367891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7da5a-276e-48f6-b4cd-7f12343eaf7b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:13.381493 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3783/7588] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:22:13 2022] PUT /identity/v3/projects/51ad6088dc6841148a2937b2106b720c/users/45e340996210420caf46ce832c9a6973/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:22:13.394352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a16c1-0d6a-4dfd-9fb9-cd2653db6107 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:13.394640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a16c1-0d6a-4dfd-9fb9-cd2653db6107 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:13.394915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a16c1-0d6a-4dfd-9fb9-cd2653db6107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:13.426249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7c0a16c1-0d6a-4dfd-9fb9-cd2653db6107 None None] MFA Rules not processed for user `45e340996210420caf46ce832c9a6973`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:13.427502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c0a16c1-0d6a-4dfd-9fb9-cd2653db6107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:13.469387 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:13.506034 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3806/7589] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:13.516297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7da5a-276e-48f6-b4cd-7f12343eaf7b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:13.517953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-abe7da5a-276e-48f6-b4cd-7f12343eaf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:13.583336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7da5a-276e-48f6-b4cd-7f12343eaf7b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:13.587123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3868-445e-4f4d-a0ce-2f0a545df6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:13.587739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3868-445e-4f4d-a0ce-2f0a545df6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:13.588017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3868-445e-4f4d-a0ce-2f0a545df6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:13.588287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3868-445e-4f4d-a0ce-2f0a545df6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:13.598445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb3868-445e-4f4d-a0ce-2f0a545df6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:13.599912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb3868-445e-4f4d-a0ce-2f0a545df6f9 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:13.609124 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3784/7590] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:22:15.795066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a16c1-0d6a-4dfd-9fb9-cd2653db6107 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:15.797245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c0a16c1-0d6a-4dfd-9fb9-cd2653db6107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:15.869870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a16c1-0d6a-4dfd-9fb9-cd2653db6107 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:15.875254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:15.875897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:15.876187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:15.876462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] PATH_INFO: `/v3/users/2e17cb04dd32451fa3a46c941fe1ca81` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:15.877637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e17cb04dd32451fa3a46c941fe1ca81)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:15.880339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:15.933844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e17cb04dd32451fa3a46c941fe1ca81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:15.952427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e17cb04dd32451fa3a46c941fe1ca81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:15.963446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e17cb04dd32451fa3a46c941fe1ca81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:15.976850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e17cb04dd32451fa3a46c941fe1ca81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:15.977601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e17cb04dd32451fa3a46c941fe1ca81'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:15.984758 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3807/7591] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:22:15 2022] DELETE /identity/v3/users/2e17cb04dd32451fa3a46c941fe1ca81 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:16.190386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3868-445e-4f4d-a0ce-2f0a545df6f9 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:16.202607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3868-445e-4f4d-a0ce-2f0a545df6f9 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:16.302234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:16.302897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:16.303180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:16.303457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] PATH_INFO: `/v3/projects/712de07c21e04da39299e7f53a7b6a29` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:16.304649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712de07c21e04da39299e7f53a7b6a29)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:16.306782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:16.310774 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:16.366693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712de07c21e04da39299e7f53a7b6a29', 'request_id': 'req-9b2808cf-5b3d-471f-9147-307046dc7882'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.378110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712de07c21e04da39299e7f53a7b6a29', 'request_id': 'req-9b2808cf-5b3d-471f-9147-307046dc7882'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.387400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712de07c21e04da39299e7f53a7b6a29', 'request_id': 'req-9b2808cf-5b3d-471f-9147-307046dc7882'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.400711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] The token cache is being invalidate because project 712de07c21e04da39299e7f53a7b6a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:22:16.401009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.401822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.403998 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3785/7592] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:22:16 2022] DELETE /identity/v3/projects/712de07c21e04da39299e7f53a7b6a29 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:16.408045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:16.409608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:16.425327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac62f88-4359-4aae-ad3c-ce851c07e31a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:16.489070 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:16.498769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:16.499571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:16.499843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:16.500121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] PATH_INFO: `/v3/users/a0064f3ced69420d93d22be5b419a15c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:16.501632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0064f3ced69420d93d22be5b419a15c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:16.504140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:16.572339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0064f3ced69420d93d22be5b419a15c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.594923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0064f3ced69420d93d22be5b419a15c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.606819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0064f3ced69420d93d22be5b419a15c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.618191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0064f3ced69420d93d22be5b419a15c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.619467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8924434-6a61-4ec1-936e-cf336b366e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0064f3ced69420d93d22be5b419a15c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:16.631992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3808/7593] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:22:16 2022] DELETE /identity/v3/users/a0064f3ced69420d93d22be5b419a15c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:22:16.850266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:16.852233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:16.875024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2808cf-5b3d-471f-9147-307046dc7882 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:16.992258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:16.992969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:16.993256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:16.993534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] PATH_INFO: `/v3/projects/5ad2672ed9de4e938b7166ba9203890e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:16.994723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad2672ed9de4e938b7166ba9203890e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:16.996699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:17.069938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad2672ed9de4e938b7166ba9203890e', 'request_id': 'req-5526823f-5e90-4fa5-b8e9-fd97579cfa17'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:17.080173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad2672ed9de4e938b7166ba9203890e', 'request_id': 'req-5526823f-5e90-4fa5-b8e9-fd97579cfa17'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:17.098811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad2672ed9de4e938b7166ba9203890e', 'request_id': 'req-5526823f-5e90-4fa5-b8e9-fd97579cfa17'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:17.116187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] The token cache is being invalidate because project 5ad2672ed9de4e938b7166ba9203890e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:22:17.116772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:17.117835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5526823f-5e90-4fa5-b8e9-fd97579cfa17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:17.121086 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3786/7594] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:22:16 2022] DELETE /identity/v3/projects/5ad2672ed9de4e938b7166ba9203890e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:17.127273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1e65a-5bdd-49ef-92ac-357e2dccb8d1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.127742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1e65a-5bdd-49ef-92ac-357e2dccb8d1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.127841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1e65a-5bdd-49ef-92ac-357e2dccb8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.171739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-02c1e65a-5bdd-49ef-92ac-357e2dccb8d1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:17.174596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-02c1e65a-5bdd-49ef-92ac-357e2dccb8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:17.261725 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3809/7595] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:17.269670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89b986-f741-4e86-aab5-975b8f75c9f9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.270238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89b986-f741-4e86-aab5-975b8f75c9f9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.270341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89b986-f741-4e86-aab5-975b8f75c9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.291615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bb89b986-f741-4e86-aab5-975b8f75c9f9 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:17.292877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bb89b986-f741-4e86-aab5-975b8f75c9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:17.330396 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3787/7596] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:17.334988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1e65a-5bdd-49ef-92ac-357e2dccb8d1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:17.351918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1e65a-5bdd-49ef-92ac-357e2dccb8d1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:17.357058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae294a83-34a0-4c75-820b-8bff3d75621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:17.357918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae294a83-34a0-4c75-820b-8bff3d75621f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.358166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae294a83-34a0-4c75-820b-8bff3d75621f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.358402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae294a83-34a0-4c75-820b-8bff3d75621f admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.359293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae294a83-34a0-4c75-820b-8bff3d75621f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:22:17.359604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae294a83-34a0-4c75-820b-8bff3d75621f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:17.361393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae294a83-34a0-4c75-820b-8bff3d75621f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:17.375790 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3810/7597] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:22:17.380650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89b986-f741-4e86-aab5-975b8f75c9f9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:17.391161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89b986-f741-4e86-aab5-975b8f75c9f9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:17.397170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd741f5-8027-459a-bef8-7d77663bda2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:17.397802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd741f5-8027-459a-bef8-7d77663bda2a admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.398083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd741f5-8027-459a-bef8-7d77663bda2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.398358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd741f5-8027-459a-bef8-7d77663bda2a admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.399041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd741f5-8027-459a-bef8-7d77663bda2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:17.401124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd741f5-8027-459a-bef8-7d77663bda2a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:17.419887 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:17.436920 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3788/7598] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:22:17 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:22:17.441154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae294a83-34a0-4c75-820b-8bff3d75621f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:17.452877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae294a83-34a0-4c75-820b-8bff3d75621f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:17.516023 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:17.529452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c39faf-fb9b-4490-99af-3a2467ab7478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:17.530227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c39faf-fb9b-4490-99af-3a2467ab7478 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.530639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c39faf-fb9b-4490-99af-3a2467ab7478 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.531015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c39faf-fb9b-4490-99af-3a2467ab7478 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.531784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c39faf-fb9b-4490-99af-3a2467ab7478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:17.533935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c39faf-fb9b-4490-99af-3a2467ab7478 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:17.566140 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3811/7599] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:22:17 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:22:17.570525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd741f5-8027-459a-bef8-7d77663bda2a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:17.584449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd741f5-8027-459a-bef8-7d77663bda2a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:17.589917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c7c2-fa09-48ba-9925-a0b471babae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:17.590733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c7c2-fa09-48ba-9925-a0b471babae5 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.591105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c7c2-fa09-48ba-9925-a0b471babae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.591532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c7c2-fa09-48ba-9925-a0b471babae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.592581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8c7c2-fa09-48ba-9925-a0b471babae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:17.597583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8c7c2-fa09-48ba-9925-a0b471babae5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:17.612729 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3789/7600] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:17.613420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c39faf-fb9b-4490-99af-3a2467ab7478 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:17.624732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c39faf-fb9b-4490-99af-3a2467ab7478 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:17.630170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72094e3-6580-479a-936a-8e0f23d8a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:17.630757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72094e3-6580-479a-936a-8e0f23d8a065 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.631523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72094e3-6580-479a-936a-8e0f23d8a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.631639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72094e3-6580-479a-936a-8e0f23d8a065 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.632267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72094e3-6580-479a-936a-8e0f23d8a065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:17.634113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72094e3-6580-479a-936a-8e0f23d8a065 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:17.654854 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3812/7601] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:17.658927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c7c2-fa09-48ba-9925-a0b471babae5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:17.671082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c7c2-fa09-48ba-9925-a0b471babae5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:17.677946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203348c9-6653-4998-b1da-7cc927ef616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:17.678704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203348c9-6653-4998-b1da-7cc927ef616b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.679057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203348c9-6653-4998-b1da-7cc927ef616b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.679409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203348c9-6653-4998-b1da-7cc927ef616b admin admin] PATH_INFO: `/v3/projects/6fe9e0a1d4b6422a8edac2ee53988325/users/52cd177eb1d645b5b802268db525ad9b/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.697539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203348c9-6653-4998-b1da-7cc927ef616b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe9e0a1d4b6422a8edac2ee53988325, user_id=52cd177eb1d645b5b802268db525ad9b, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:17.701523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203348c9-6653-4998-b1da-7cc927ef616b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:17.717291 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3790/7602] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:22:17 2022] PUT /identity/v3/projects/6fe9e0a1d4b6422a8edac2ee53988325/users/52cd177eb1d645b5b802268db525ad9b/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:22:17.723686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01fc18-abef-4659-9077-5557844e9a5b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.723980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01fc18-abef-4659-9077-5557844e9a5b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.724262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01fc18-abef-4659-9077-5557844e9a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.745219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dc01fc18-abef-4659-9077-5557844e9a5b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:17.746709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc01fc18-abef-4659-9077-5557844e9a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:17.818572 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3813/7603] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:17.828566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203348c9-6653-4998-b1da-7cc927ef616b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:17.830936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-203348c9-6653-4998-b1da-7cc927ef616b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:17.897103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203348c9-6653-4998-b1da-7cc927ef616b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:17.900790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae250e7d-aa8e-4885-8f6a-c89b7e7f9edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:17.901401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae250e7d-aa8e-4885-8f6a-c89b7e7f9edf service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:17.901699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae250e7d-aa8e-4885-8f6a-c89b7e7f9edf service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:17.901957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae250e7d-aa8e-4885-8f6a-c89b7e7f9edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:17.912397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae250e7d-aa8e-4885-8f6a-c89b7e7f9edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:17.913893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae250e7d-aa8e-4885-8f6a-c89b7e7f9edf service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:17.927172 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3791/7604] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:22:18.405119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01fc18-abef-4659-9077-5557844e9a5b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:18.406933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc01fc18-abef-4659-9077-5557844e9a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:18.486670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01fc18-abef-4659-9077-5557844e9a5b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:18.492001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:18.492639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:18.492923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:18.493200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:18.494941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:18.509502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:18.511111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:18.525673 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3814/7605] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:22:18.837266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039292e7-a7c1-4c84-a234-4ebc81e6f7de None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:18.838335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039292e7-a7c1-4c84-a234-4ebc81e6f7de None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:18.838830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039292e7-a7c1-4c84-a234-4ebc81e6f7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:18.887145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-039292e7-a7c1-4c84-a234-4ebc81e6f7de None None] MFA Rules not processed for user `52cd177eb1d645b5b802268db525ad9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:18.889665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-039292e7-a7c1-4c84-a234-4ebc81e6f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:19.009964 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3792/7606] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:19.020182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:19.021618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:19.109739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4159d-d18f-44a4-b172-1eb5ce314d02 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:19.114393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebd010-8096-48fb-afa5-67c7f1604f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:19.115112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebd010-8096-48fb-afa5-67c7f1604f69 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:19.115514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebd010-8096-48fb-afa5-67c7f1604f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:19.115806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebd010-8096-48fb-afa5-67c7f1604f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:19.126187 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebd010-8096-48fb-afa5-67c7f1604f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:19.127737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebd010-8096-48fb-afa5-67c7f1604f69 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:19.138387 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3815/7607] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:22:19.370285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039292e7-a7c1-4c84-a234-4ebc81e6f7de None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:19.372457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-039292e7-a7c1-4c84-a234-4ebc81e6f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:19.390809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039292e7-a7c1-4c84-a234-4ebc81e6f7de None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:19.396018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:19.396764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:19.397035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:19.397348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] PATH_INFO: `/v3/users/45e340996210420caf46ce832c9a6973` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:19.398686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e340996210420caf46ce832c9a6973)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:19.400833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:19.455028 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:19.457830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e340996210420caf46ce832c9a6973'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.476269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e340996210420caf46ce832c9a6973'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.500401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e340996210420caf46ce832c9a6973'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.500401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e340996210420caf46ce832c9a6973'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.500401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e340996210420caf46ce832c9a6973'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.503507 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3793/7608] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:22:19 2022] DELETE /identity/v3/users/45e340996210420caf46ce832c9a6973 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:19.507992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b30e4-7997-4bbe-a8ae-820ce498df69 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:19.508502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b30e4-7997-4bbe-a8ae-820ce498df69 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:19.508590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b30e4-7997-4bbe-a8ae-820ce498df69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:19.519137 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:19.532259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-069b30e4-7997-4bbe-a8ae-820ce498df69 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:19.533525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-069b30e4-7997-4bbe-a8ae-820ce498df69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:19.601856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3816/7609] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:19.611710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:19.613304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:19.678155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62de42-76b3-4bef-a704-dd5bf6747591 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:19.681804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07af0f9-1c8e-4a3e-9581-70154d8ac8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:19.682412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af0f9-1c8e-4a3e-9581-70154d8ac8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:19.682689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af0f9-1c8e-4a3e-9581-70154d8ac8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:19.682958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af0f9-1c8e-4a3e-9581-70154d8ac8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:19.693154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07af0f9-1c8e-4a3e-9581-70154d8ac8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:19.694753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07af0f9-1c8e-4a3e-9581-70154d8ac8c1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:19.705904 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3794/7610] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:22:19.873540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b30e4-7997-4bbe-a8ae-820ce498df69 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:19.875155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-069b30e4-7997-4bbe-a8ae-820ce498df69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:19.892377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b30e4-7997-4bbe-a8ae-820ce498df69 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:19.897805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:19.898778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:19.899126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:19.899473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] PATH_INFO: `/v3/projects/51ad6088dc6841148a2937b2106b720c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:19.900930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ad6088dc6841148a2937b2106b720c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:19.903761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:19.953520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ad6088dc6841148a2937b2106b720c', 'request_id': 'req-7228781b-8e7a-408b-b775-59c4acf515f4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.961156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ad6088dc6841148a2937b2106b720c', 'request_id': 'req-7228781b-8e7a-408b-b775-59c4acf515f4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.967651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ad6088dc6841148a2937b2106b720c', 'request_id': 'req-7228781b-8e7a-408b-b775-59c4acf515f4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.979011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] The token cache is being invalidate because project 51ad6088dc6841148a2937b2106b720c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:22:19.979302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.979958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7228781b-8e7a-408b-b775-59c4acf515f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:22:19.982622 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3817/7611] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:22:19 2022] DELETE /identity/v3/projects/51ad6088dc6841148a2937b2106b720c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:19.987896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec4040-2562-464c-bfe4-53ae80781fdd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:19.988396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec4040-2562-464c-bfe4-53ae80781fdd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:19.988493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec4040-2562-464c-bfe4-53ae80781fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.008906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-deec4040-2562-464c-bfe4-53ae80781fdd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:20.010121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-deec4040-2562-464c-bfe4-53ae80781fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:20.073932 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3795/7612] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:20.081816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa7176-a193-4b04-9d8e-403ba698ea1c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.082108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa7176-a193-4b04-9d8e-403ba698ea1c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.082388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa7176-a193-4b04-9d8e-403ba698ea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.102966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-61aa7176-a193-4b04-9d8e-403ba698ea1c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:20.104190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-61aa7176-a193-4b04-9d8e-403ba698ea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:20.112975 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3818/7613] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:20.117436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec4040-2562-464c-bfe4-53ae80781fdd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:20.129085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec4040-2562-464c-bfe4-53ae80781fdd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:20.135890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9b16b-670d-4e72-b0b2-9f5c5eab3e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:20.136520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9b16b-670d-4e72-b0b2-9f5c5eab3e22 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.136827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9b16b-670d-4e72-b0b2-9f5c5eab3e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.137098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9b16b-670d-4e72-b0b2-9f5c5eab3e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.138273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9b16b-670d-4e72-b0b2-9f5c5eab3e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:22:20.138572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9b16b-670d-4e72-b0b2-9f5c5eab3e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:20.140198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9b16b-670d-4e72-b0b2-9f5c5eab3e22 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:20.152738 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3796/7614] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:22:20.158208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa7176-a193-4b04-9d8e-403ba698ea1c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:20.170122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa7176-a193-4b04-9d8e-403ba698ea1c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:20.174937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de187c9b-8058-487c-92e0-f4c83fe6627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:20.175549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de187c9b-8058-487c-92e0-f4c83fe6627b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.175856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de187c9b-8058-487c-92e0-f4c83fe6627b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.176120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de187c9b-8058-487c-92e0-f4c83fe6627b admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.176923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de187c9b-8058-487c-92e0-f4c83fe6627b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:20.178872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de187c9b-8058-487c-92e0-f4c83fe6627b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:20.212230 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3819/7615] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:22:20 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:22:20.217374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9b16b-670d-4e72-b0b2-9f5c5eab3e22 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:20.230929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9b16b-670d-4e72-b0b2-9f5c5eab3e22 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:20.285117 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:20.297680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bed20-1c7b-4b7c-bd7f-20c6ed29f058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:20.298486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bed20-1c7b-4b7c-bd7f-20c6ed29f058 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.298879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bed20-1c7b-4b7c-bd7f-20c6ed29f058 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.299270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bed20-1c7b-4b7c-bd7f-20c6ed29f058 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.300029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bed20-1c7b-4b7c-bd7f-20c6ed29f058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:20.302056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bed20-1c7b-4b7c-bd7f-20c6ed29f058 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:20.327921 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3797/7616] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:22:20 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:22:20.329455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de187c9b-8058-487c-92e0-f4c83fe6627b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:20.340046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de187c9b-8058-487c-92e0-f4c83fe6627b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:20.345039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5517-cc47-4a24-80e7-d904cf68b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:20.345653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5517-cc47-4a24-80e7-d904cf68b6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.345936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5517-cc47-4a24-80e7-d904cf68b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.346238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5517-cc47-4a24-80e7-d904cf68b6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.346890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5517-cc47-4a24-80e7-d904cf68b6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:20.348736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5517-cc47-4a24-80e7-d904cf68b6e7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:20.361121 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3820/7617] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:20.365203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bed20-1c7b-4b7c-bd7f-20c6ed29f058 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:20.376902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bed20-1c7b-4b7c-bd7f-20c6ed29f058 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:20.381571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b45e0-1f66-487d-85aa-6af3981f73f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:20.382459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b45e0-1f66-487d-85aa-6af3981f73f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.382750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b45e0-1f66-487d-85aa-6af3981f73f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.383030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b45e0-1f66-487d-85aa-6af3981f73f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.383694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b45e0-1f66-487d-85aa-6af3981f73f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:20.385413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b45e0-1f66-487d-85aa-6af3981f73f3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:20.396602 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3798/7618] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:22:20.400754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5517-cc47-4a24-80e7-d904cf68b6e7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:20.412026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5517-cc47-4a24-80e7-d904cf68b6e7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:20.416774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd34c3d-363e-4728-9def-1d0aba978d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:20.417422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd34c3d-363e-4728-9def-1d0aba978d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.417726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd34c3d-363e-4728-9def-1d0aba978d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.418000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd34c3d-363e-4728-9def-1d0aba978d10 admin admin] PATH_INFO: `/v3/projects/1d1c95bb9b67401db52b667330b15a9b/users/04277c37116443bcacfbe98721715676/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.433418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd34c3d-363e-4728-9def-1d0aba978d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1c95bb9b67401db52b667330b15a9b, user_id=04277c37116443bcacfbe98721715676, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:20.436349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd34c3d-363e-4728-9def-1d0aba978d10 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:20.449421 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3821/7619] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:22:20 2022] PUT /identity/v3/projects/1d1c95bb9b67401db52b667330b15a9b/users/04277c37116443bcacfbe98721715676/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:22:20.459904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b185d-28df-4123-8df6-eb58b64fe6f6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.460201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b185d-28df-4123-8df6-eb58b64fe6f6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.460533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b185d-28df-4123-8df6-eb58b64fe6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.491710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-457b185d-28df-4123-8df6-eb58b64fe6f6 None None] MFA Rules not processed for user `04277c37116443bcacfbe98721715676`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:20.492996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-457b185d-28df-4123-8df6-eb58b64fe6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:20.565069 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3799/7620] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:20.566783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aeb99-ef4f-4551-85ee-84b69467fc6c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.567251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aeb99-ef4f-4551-85ee-84b69467fc6c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.567347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aeb99-ef4f-4551-85ee-84b69467fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.576588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b185d-28df-4123-8df6-eb58b64fe6f6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:20.578794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-457b185d-28df-4123-8df6-eb58b64fe6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:20.588657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f59aeb99-ef4f-4551-85ee-84b69467fc6c None None] MFA Rules not processed for user `52cd177eb1d645b5b802268db525ad9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:20.589837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f59aeb99-ef4f-4551-85ee-84b69467fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:20.610456 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:20.641820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b185d-28df-4123-8df6-eb58b64fe6f6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:20.645740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c8885-db71-435d-af5a-390363311c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:20.646343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c8885-db71-435d-af5a-390363311c3f service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:20.646619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c8885-db71-435d-af5a-390363311c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:20.646888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c8885-db71-435d-af5a-390363311c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:20.649047 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3822/7621] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:22:20.655942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c8885-db71-435d-af5a-390363311c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:20.657434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c8885-db71-435d-af5a-390363311c3f service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:20.668362 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3800/7622] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:22:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:22:30.642409 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=14 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:30.664350 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:36.127473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fe14c-ba24-454d-8905-7091e239a538 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:36.127982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fe14c-ba24-454d-8905-7091e239a538 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:36.128271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fe14c-ba24-454d-8905-7091e239a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:36.148292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-964fe14c-ba24-454d-8905-7091e239a538 None None] MFA Rules not processed for user `52cd177eb1d645b5b802268db525ad9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:36.149531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-964fe14c-ba24-454d-8905-7091e239a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:36.156866 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3823/7623] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:46.143582 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:52.498287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e1b92-cd5c-44b9-8a66-a4bea0a6b124 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:52.498855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e1b92-cd5c-44b9-8a66-a4bea0a6b124 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:52.498954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e1b92-cd5c-44b9-8a66-a4bea0a6b124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:52.527057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-202e1b92-cd5c-44b9-8a66-a4bea0a6b124 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:22:52.528959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-202e1b92-cd5c-44b9-8a66-a4bea0a6b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:52.640003 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3801/7624] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:22:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:22:52.703848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fe14c-ba24-454d-8905-7091e239a538 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:22:52.705647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-964fe14c-ba24-454d-8905-7091e239a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:22:52.802423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fe14c-ba24-454d-8905-7091e239a538 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:22:52.808684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0c85a-ab0c-4f47-94a4-d6b227a1d043 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:22:52.809346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c85a-ab0c-4f47-94a4-d6b227a1d043 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:22:52.809731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c85a-ab0c-4f47-94a4-d6b227a1d043 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:22:52.810088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c85a-ab0c-4f47-94a4-d6b227a1d043 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:22:52.820509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0c85a-ab0c-4f47-94a4-d6b227a1d043 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:22:52.822326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0c85a-ab0c-4f47-94a4-d6b227a1d043 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:22:52.837121 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3824/7625] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:23:02.635862 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=32 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:02.829911 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=36 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:05.016148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e1b92-cd5c-44b9-8a66-a4bea0a6b124 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:05.128097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e1b92-cd5c-44b9-8a66-a4bea0a6b124 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:05.134198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:05.135085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:05.136120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:05.136396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] PATH_INFO: `/v3/users/04277c37116443bcacfbe98721715676` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:05.138797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04277c37116443bcacfbe98721715676)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:05.140040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:05.203484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04277c37116443bcacfbe98721715676'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:05.218322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04277c37116443bcacfbe98721715676'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:05.229814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04277c37116443bcacfbe98721715676'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:05.237824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04277c37116443bcacfbe98721715676'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:05.238581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04277c37116443bcacfbe98721715676'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:05.245506 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3802/7626] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:23:05 2022] DELETE /identity/v3/users/04277c37116443bcacfbe98721715676 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:23:05.249846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89528-ea14-4432-a769-bff4755cad8b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:05.250931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89528-ea14-4432-a769-bff4755cad8b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:05.251599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89528-ea14-4432-a769-bff4755cad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:05.304420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-48e89528-ea14-4432-a769-bff4755cad8b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:05.305941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-48e89528-ea14-4432-a769-bff4755cad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:05.394522 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3825/7627] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:23:05.406481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:05.409581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:05.516126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468861e-f3fa-4e20-9950-6cf870074645 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:05.524741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f70c5c-841a-4d49-98d9-8eb5bf25f35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:05.525432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f70c5c-841a-4d49-98d9-8eb5bf25f35e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:05.525702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f70c5c-841a-4d49-98d9-8eb5bf25f35e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:05.526100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f70c5c-841a-4d49-98d9-8eb5bf25f35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:05.539043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f70c5c-841a-4d49-98d9-8eb5bf25f35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:05.540492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f70c5c-841a-4d49-98d9-8eb5bf25f35e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:05.553469 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3803/7628] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:23:05.859575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e89528-ea14-4432-a769-bff4755cad8b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:05.861103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-48e89528-ea14-4432-a769-bff4755cad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:05.882749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e89528-ea14-4432-a769-bff4755cad8b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:05.894716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:05.895455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:05.896040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:05.896392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] PATH_INFO: `/v3/projects/1d1c95bb9b67401db52b667330b15a9b` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:05.897918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1c95bb9b67401db52b667330b15a9b)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:05.900347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:05.990523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1c95bb9b67401db52b667330b15a9b', 'request_id': 'req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:06.002927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1c95bb9b67401db52b667330b15a9b', 'request_id': 'req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:06.012286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1c95bb9b67401db52b667330b15a9b', 'request_id': 'req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:06.027605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] The token cache is being invalidate because project 1d1c95bb9b67401db52b667330b15a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:23:06.028004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:06.028799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-79b57f0f-9b22-4f7c-a78d-cb6896d3ac7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:06.030441 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3826/7629] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:23:05 2022] DELETE /identity/v3/projects/1d1c95bb9b67401db52b667330b15a9b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:23:06.035648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9ddd3-607d-4a92-af09-34ab66265942 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.036132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9ddd3-607d-4a92-af09-34ab66265942 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.036228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9ddd3-607d-4a92-af09-34ab66265942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.043234 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:06.105674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-58f9ddd3-607d-4a92-af09-34ab66265942 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:06.106926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-58f9ddd3-607d-4a92-af09-34ab66265942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:06.188133 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3804/7630] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:06.197271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc0351-d707-4402-b458-532d661a00ca None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.197629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc0351-d707-4402-b458-532d661a00ca None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.198600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc0351-d707-4402-b458-532d661a00ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.223162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d8bc0351-d707-4402-b458-532d661a00ca None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:06.224392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d8bc0351-d707-4402-b458-532d661a00ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:06.233442 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3827/7631] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:23:06.237509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9ddd3-607d-4a92-af09-34ab66265942 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:06.249234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9ddd3-607d-4a92-af09-34ab66265942 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:06.254089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94c3b-5d09-4042-a9b2-2b7847413546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:06.254698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94c3b-5d09-4042-a9b2-2b7847413546 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.254978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94c3b-5d09-4042-a9b2-2b7847413546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.255254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94c3b-5d09-4042-a9b2-2b7847413546 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.255929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a94c3b-5d09-4042-a9b2-2b7847413546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:23:06.256231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a94c3b-5d09-4042-a9b2-2b7847413546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:06.257927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a94c3b-5d09-4042-a9b2-2b7847413546 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:06.275638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc0351-d707-4402-b458-532d661a00ca None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:06.281934 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3805/7632] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:23:06.285901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc0351-d707-4402-b458-532d661a00ca None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:06.290827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4a1cb-55da-49eb-b9c5-8256f3dab618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:06.291813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a1cb-55da-49eb-b9c5-8256f3dab618 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.292097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a1cb-55da-49eb-b9c5-8256f3dab618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.292458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a1cb-55da-49eb-b9c5-8256f3dab618 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.293129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4a1cb-55da-49eb-b9c5-8256f3dab618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:06.295281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4a1cb-55da-49eb-b9c5-8256f3dab618 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:06.329754 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3828/7633] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:23:06 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:23:06.333640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94c3b-5d09-4042-a9b2-2b7847413546 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:06.353868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94c3b-5d09-4042-a9b2-2b7847413546 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:06.442896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ca74f-3444-4376-927e-21c5426e2d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:06.443457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ca74f-3444-4376-927e-21c5426e2d33 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.443748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ca74f-3444-4376-927e-21c5426e2d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.444287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ca74f-3444-4376-927e-21c5426e2d33 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.444997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ca74f-3444-4376-927e-21c5426e2d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:06.446920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ca74f-3444-4376-927e-21c5426e2d33 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:06.476205 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3806/7634] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:23:06 2022] POST /identity/v3/users => generated 282 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:23:06.477123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4a1cb-55da-49eb-b9c5-8256f3dab618 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:06.492145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4a1cb-55da-49eb-b9c5-8256f3dab618 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:06.499297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d10b8-3ce1-4fa8-93e3-dda603ec34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:06.499929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d10b8-3ce1-4fa8-93e3-dda603ec34cf admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.500388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d10b8-3ce1-4fa8-93e3-dda603ec34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.500699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d10b8-3ce1-4fa8-93e3-dda603ec34cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.501606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d10b8-3ce1-4fa8-93e3-dda603ec34cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:06.503237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d10b8-3ce1-4fa8-93e3-dda603ec34cf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:06.516290 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3829/7635] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:23:06.520252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ca74f-3444-4376-927e-21c5426e2d33 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:06.532552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ca74f-3444-4376-927e-21c5426e2d33 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:06.538210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97373b61-3786-463f-80ef-3ac912293db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:06.539289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97373b61-3786-463f-80ef-3ac912293db7 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.540053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97373b61-3786-463f-80ef-3ac912293db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.540342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97373b61-3786-463f-80ef-3ac912293db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.541033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97373b61-3786-463f-80ef-3ac912293db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:06.544125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97373b61-3786-463f-80ef-3ac912293db7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:06.560491 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3807/7636] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:23:06.566491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d10b8-3ce1-4fa8-93e3-dda603ec34cf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:06.577764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d10b8-3ce1-4fa8-93e3-dda603ec34cf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:06.585487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7e4e1-ef37-40f7-a5e9-ee10e65fe010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:06.586298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7e4e1-ef37-40f7-a5e9-ee10e65fe010 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.586715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7e4e1-ef37-40f7-a5e9-ee10e65fe010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.587217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7e4e1-ef37-40f7-a5e9-ee10e65fe010 admin admin] PATH_INFO: `/v3/projects/d2e60ba82ef74ea8979e00a93371c05c/users/3398118289fd438aa916a55302219d5a/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.605554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7e4e1-ef37-40f7-a5e9-ee10e65fe010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e60ba82ef74ea8979e00a93371c05c, user_id=3398118289fd438aa916a55302219d5a, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:06.609282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7e4e1-ef37-40f7-a5e9-ee10e65fe010 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:06.627723 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3830/7637] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:23:06 2022] PUT /identity/v3/projects/d2e60ba82ef74ea8979e00a93371c05c/users/3398118289fd438aa916a55302219d5a/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:23:06.638520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c421c-7a4a-4e38-b6e0-9d361fa14078 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.638808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c421c-7a4a-4e38-b6e0-9d361fa14078 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.639120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c421c-7a4a-4e38-b6e0-9d361fa14078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.677623 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7a1c421c-7a4a-4e38-b6e0-9d361fa14078 None None] MFA Rules not processed for user `3398118289fd438aa916a55302219d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:06.678852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7a1c421c-7a4a-4e38-b6e0-9d361fa14078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:06.732875 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:06.772318 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3808/7638] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:06.784262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7e4e1-ef37-40f7-a5e9-ee10e65fe010 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:06.786226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-48b7e4e1-ef37-40f7-a5e9-ee10e65fe010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:06.794240 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:06.868590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7e4e1-ef37-40f7-a5e9-ee10e65fe010 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:06.873082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25fbbe-fc5a-441e-8af3-dcda43f8a3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:06.873704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25fbbe-fc5a-441e-8af3-dcda43f8a3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:06.873986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25fbbe-fc5a-441e-8af3-dcda43f8a3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:06.874262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25fbbe-fc5a-441e-8af3-dcda43f8a3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:06.883680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25fbbe-fc5a-441e-8af3-dcda43f8a3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:06.885948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25fbbe-fc5a-441e-8af3-dcda43f8a3f4 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:06.896372 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3831/7639] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:23:15.869551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aed3d2-63d4-4971-9ba6-eaff78d5d068 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:15.870437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aed3d2-63d4-4971-9ba6-eaff78d5d068 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:15.870705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aed3d2-63d4-4971-9ba6-eaff78d5d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:15.891476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f1aed3d2-63d4-4971-9ba6-eaff78d5d068 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:15.892437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f1aed3d2-63d4-4971-9ba6-eaff78d5d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:15.960272 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3809/7640] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:15.976344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25fbbe-fc5a-441e-8af3-dcda43f8a3f4 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:15.979465 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4e25fbbe-fc5a-441e-8af3-dcda43f8a3f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:16.076386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25fbbe-fc5a-441e-8af3-dcda43f8a3f4 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:16.081738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a413-3339-498c-b5e1-16baa3065b22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:16.082374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a413-3339-498c-b5e1-16baa3065b22 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:16.082657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a413-3339-498c-b5e1-16baa3065b22 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:16.082930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a413-3339-498c-b5e1-16baa3065b22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:16.092486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a413-3339-498c-b5e1-16baa3065b22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:16.095723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a413-3339-498c-b5e1-16baa3065b22 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:16.104753 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3832/7641] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:23:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:23:19.516181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aed3d2-63d4-4971-9ba6-eaff78d5d068 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:19.518362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f1aed3d2-63d4-4971-9ba6-eaff78d5d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:19.674353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aed3d2-63d4-4971-9ba6-eaff78d5d068 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:19.684702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:19.687512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:19.687877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:19.688222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] PATH_INFO: `/v3/users/52cd177eb1d645b5b802268db525ad9b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:19.690785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52cd177eb1d645b5b802268db525ad9b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:19.694872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:19.794048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52cd177eb1d645b5b802268db525ad9b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:19.809865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52cd177eb1d645b5b802268db525ad9b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:19.819638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52cd177eb1d645b5b802268db525ad9b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:19.829678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52cd177eb1d645b5b802268db525ad9b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:19.830445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-71617b25-1480-41b8-b9e4-9c5e28937e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52cd177eb1d645b5b802268db525ad9b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:19.838763 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3810/7642] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:23:19 2022] DELETE /identity/v3/users/52cd177eb1d645b5b802268db525ad9b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:23:20.036425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a413-3339-498c-b5e1-16baa3065b22 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:20.070215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a413-3339-498c-b5e1-16baa3065b22 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:20.201357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:20.201999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.202280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.202555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] PATH_INFO: `/v3/projects/6fe9e0a1d4b6422a8edac2ee53988325` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.203736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe9e0a1d4b6422a8edac2ee53988325)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:20.205745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:20.247553 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:20.257962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe9e0a1d4b6422a8edac2ee53988325', 'request_id': 'req-cf52e42a-2075-4360-b235-78d32437422f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:20.266220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe9e0a1d4b6422a8edac2ee53988325', 'request_id': 'req-cf52e42a-2075-4360-b235-78d32437422f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:20.272071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe9e0a1d4b6422a8edac2ee53988325', 'request_id': 'req-cf52e42a-2075-4360-b235-78d32437422f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:20.284764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] The token cache is being invalidate because project 6fe9e0a1d4b6422a8edac2ee53988325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:23:20.284868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:20.285813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cf52e42a-2075-4360-b235-78d32437422f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:20.287649 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3833/7643] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:23:20 2022] DELETE /identity/v3/projects/6fe9e0a1d4b6422a8edac2ee53988325 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:23:20.292497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b13c8-8633-4dd5-bb83-349fd212c473 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.292805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b13c8-8633-4dd5-bb83-349fd212c473 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.293079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b13c8-8633-4dd5-bb83-349fd212c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.307464 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:20.314817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ae3b13c8-8633-4dd5-bb83-349fd212c473 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:20.316708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ae3b13c8-8633-4dd5-bb83-349fd212c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:20.384425 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3811/7644] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:23:20.393375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f871fa-62eb-4e35-8e7c-3ebbae0508ca None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.393696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f871fa-62eb-4e35-8e7c-3ebbae0508ca None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.393991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f871fa-62eb-4e35-8e7c-3ebbae0508ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.414557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b9f871fa-62eb-4e35-8e7c-3ebbae0508ca None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:20.415796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b9f871fa-62eb-4e35-8e7c-3ebbae0508ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:20.427604 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3834/7645] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:20.428655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b13c8-8633-4dd5-bb83-349fd212c473 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:20.439522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b13c8-8633-4dd5-bb83-349fd212c473 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:20.444195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f446d6-c46a-4e34-9c77-14fa8c42b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:20.444850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f446d6-c46a-4e34-9c77-14fa8c42b351 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.445129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f446d6-c46a-4e34-9c77-14fa8c42b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.445425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f446d6-c46a-4e34-9c77-14fa8c42b351 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.446076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f446d6-c46a-4e34-9c77-14fa8c42b351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:23:20.446369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f446d6-c46a-4e34-9c77-14fa8c42b351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:20.448788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f446d6-c46a-4e34-9c77-14fa8c42b351 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:20.461352 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3812/7646] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:23:20.465470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f871fa-62eb-4e35-8e7c-3ebbae0508ca None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:20.480907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f871fa-62eb-4e35-8e7c-3ebbae0508ca None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:20.485756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3e248-0199-4860-9175-5da8675cdf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:20.486380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3e248-0199-4860-9175-5da8675cdf94 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.486696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3e248-0199-4860-9175-5da8675cdf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.486973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3e248-0199-4860-9175-5da8675cdf94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.487639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3e248-0199-4860-9175-5da8675cdf94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:20.489673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3e248-0199-4860-9175-5da8675cdf94 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:20.532008 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3835/7647] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:23:20 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:23:20.533191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f446d6-c46a-4e34-9c77-14fa8c42b351 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:20.544872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f446d6-c46a-4e34-9c77-14fa8c42b351 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:20.608342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e4ece-fc4d-40fe-bd92-527edebc2d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:20.608999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e4ece-fc4d-40fe-bd92-527edebc2d4d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.609290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e4ece-fc4d-40fe-bd92-527edebc2d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.609563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e4ece-fc4d-40fe-bd92-527edebc2d4d admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.610207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e4ece-fc4d-40fe-bd92-527edebc2d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:20.612133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e4ece-fc4d-40fe-bd92-527edebc2d4d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:20.641770 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3813/7648] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:23:20 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:23:20.647233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3e248-0199-4860-9175-5da8675cdf94 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:20.667506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3e248-0199-4860-9175-5da8675cdf94 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:20.677553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1675c9c-b9ca-4e49-90b1-394ed2d76a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:20.678600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1675c9c-b9ca-4e49-90b1-394ed2d76a97 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.679122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1675c9c-b9ca-4e49-90b1-394ed2d76a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.679629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1675c9c-b9ca-4e49-90b1-394ed2d76a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.680852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1675c9c-b9ca-4e49-90b1-394ed2d76a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:20.684859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1675c9c-b9ca-4e49-90b1-394ed2d76a97 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:20.704702 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3836/7649] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:23:20.709524 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e4ece-fc4d-40fe-bd92-527edebc2d4d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:20.728310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e4ece-fc4d-40fe-bd92-527edebc2d4d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:20.736212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36623df3-aea4-4272-97d2-63dc73568170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:20.737584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36623df3-aea4-4272-97d2-63dc73568170 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.738107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36623df3-aea4-4272-97d2-63dc73568170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.738816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36623df3-aea4-4272-97d2-63dc73568170 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.740029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36623df3-aea4-4272-97d2-63dc73568170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:20.743229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36623df3-aea4-4272-97d2-63dc73568170 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:20.768795 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3814/7650] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:23:20.771057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1675c9c-b9ca-4e49-90b1-394ed2d76a97 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:20.789360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1675c9c-b9ca-4e49-90b1-394ed2d76a97 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:20.795155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931fdae-7ae4-4d67-84b2-00d16471830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:20.795837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931fdae-7ae4-4d67-84b2-00d16471830f admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.796092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931fdae-7ae4-4d67-84b2-00d16471830f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.796369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931fdae-7ae4-4d67-84b2-00d16471830f admin admin] PATH_INFO: `/v3/projects/a1790f2bc30144f8bbd2c4e73b786a7d/users/56b9831c067648c490ad89a847380281/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.816573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931fdae-7ae4-4d67-84b2-00d16471830f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1790f2bc30144f8bbd2c4e73b786a7d, user_id=56b9831c067648c490ad89a847380281, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:20.819410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931fdae-7ae4-4d67-84b2-00d16471830f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:20.835057 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3837/7651] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:23:20 2022] PUT /identity/v3/projects/a1790f2bc30144f8bbd2c4e73b786a7d/users/56b9831c067648c490ad89a847380281/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:23:20.845045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cfd96-36ea-4488-8539-d171d4a0bf7e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:20.845337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cfd96-36ea-4488-8539-d171d4a0bf7e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:20.845579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cfd96-36ea-4488-8539-d171d4a0bf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:20.876206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-830cfd96-36ea-4488-8539-d171d4a0bf7e None None] MFA Rules not processed for user `56b9831c067648c490ad89a847380281`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:20.878061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-830cfd96-36ea-4488-8539-d171d4a0bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:20.959029 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3815/7652] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:20.973852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931fdae-7ae4-4d67-84b2-00d16471830f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:20.976662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6931fdae-7ae4-4d67-84b2-00d16471830f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:21.079353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931fdae-7ae4-4d67-84b2-00d16471830f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:21.084339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677ca7-c7a5-40eb-aa5f-82e8027db20d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:21.085205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677ca7-c7a5-40eb-aa5f-82e8027db20d service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:21.085652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677ca7-c7a5-40eb-aa5f-82e8027db20d service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:21.086114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677ca7-c7a5-40eb-aa5f-82e8027db20d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:21.097644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c677ca7-c7a5-40eb-aa5f-82e8027db20d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:21.099650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c677ca7-c7a5-40eb-aa5f-82e8027db20d service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:21.125701 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3838/7653] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:23:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:23:22.673844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957ca3e-6395-48bd-9bf9-aa92eb4fc8c8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:22.674545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957ca3e-6395-48bd-9bf9-aa92eb4fc8c8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:22.674545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957ca3e-6395-48bd-9bf9-aa92eb4fc8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:22.682686 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:22.697632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7957ca3e-6395-48bd-9bf9-aa92eb4fc8c8 None None] MFA Rules not processed for user `fccb51cb03de4f50a1dd059a30a6c4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:22.699935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7957ca3e-6395-48bd-9bf9-aa92eb4fc8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:22.784086 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3816/7654] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:31.116755 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:32.770551 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=24 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:36.424451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677ca7-c7a5-40eb-aa5f-82e8027db20d service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:36.497447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677ca7-c7a5-40eb-aa5f-82e8027db20d service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:36.502877 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:36.503671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:36.504059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:36.504481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] PATH_INFO: `/v3/users/56b9831c067648c490ad89a847380281` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:36.505771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b9831c067648c490ad89a847380281)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:36.507950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:36.565547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b9831c067648c490ad89a847380281'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:36.580132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b9831c067648c490ad89a847380281'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:36.591904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b9831c067648c490ad89a847380281'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:36.600464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b9831c067648c490ad89a847380281'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:36.601376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b9831c067648c490ad89a847380281'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:36.611116 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3839/7655] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:23:36 2022] DELETE /identity/v3/users/56b9831c067648c490ad89a847380281 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:23:36.612909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c46254-15fb-4270-b94a-632ec8560cc8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:36.613383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c46254-15fb-4270-b94a-632ec8560cc8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:36.613645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c46254-15fb-4270-b94a-632ec8560cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:36.634971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-42c46254-15fb-4270-b94a-632ec8560cc8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:36.636282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-42c46254-15fb-4270-b94a-632ec8560cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:36.703839 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3817/7656] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:36.714588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:36.716350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:36.779768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dac0d-d6df-4f0b-b8b2-6fb844bf254d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:36.783500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992aaf1-af20-4d48-b61d-a347cae6b486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:36.784321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992aaf1-af20-4d48-b61d-a347cae6b486 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:36.784591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992aaf1-af20-4d48-b61d-a347cae6b486 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:36.784906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992aaf1-af20-4d48-b61d-a347cae6b486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:36.795921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992aaf1-af20-4d48-b61d-a347cae6b486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:36.797447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992aaf1-af20-4d48-b61d-a347cae6b486 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:36.809368 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3840/7657] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:23:37.133339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c46254-15fb-4270-b94a-632ec8560cc8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:37.135058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-42c46254-15fb-4270-b94a-632ec8560cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:37.152900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c46254-15fb-4270-b94a-632ec8560cc8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:37.158087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:37.159445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.159445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.159719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] PATH_INFO: `/v3/projects/a1790f2bc30144f8bbd2c4e73b786a7d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.161119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1790f2bc30144f8bbd2c4e73b786a7d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:37.164241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:37.223167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1790f2bc30144f8bbd2c4e73b786a7d', 'request_id': 'req-f8bec516-92e5-4bf1-bb8e-8a388fe42002'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:37.232860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1790f2bc30144f8bbd2c4e73b786a7d', 'request_id': 'req-f8bec516-92e5-4bf1-bb8e-8a388fe42002'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:37.240163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1790f2bc30144f8bbd2c4e73b786a7d', 'request_id': 'req-f8bec516-92e5-4bf1-bb8e-8a388fe42002'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:37.258410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] The token cache is being invalidate because project a1790f2bc30144f8bbd2c4e73b786a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:23:37.259434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:37.260150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f8bec516-92e5-4bf1-bb8e-8a388fe42002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:23:37.262679 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3818/7658] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:23:37 2022] DELETE /identity/v3/projects/a1790f2bc30144f8bbd2c4e73b786a7d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:23:37.270332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052601f-aa24-4801-965a-e731d005caa0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.270616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052601f-aa24-4801-965a-e731d005caa0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.270892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052601f-aa24-4801-965a-e731d005caa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.294999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d052601f-aa24-4801-965a-e731d005caa0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:37.296222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d052601f-aa24-4801-965a-e731d005caa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:37.317891 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:37.385636 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3841/7659] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:37.394492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ba6d9-eef9-4a48-951e-d2d9b2b5985c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.394806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ba6d9-eef9-4a48-951e-d2d9b2b5985c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.395056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ba6d9-eef9-4a48-951e-d2d9b2b5985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.417754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b13ba6d9-eef9-4a48-951e-d2d9b2b5985c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:37.418957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b13ba6d9-eef9-4a48-951e-d2d9b2b5985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:37.429683 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3819/7660] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:37.434880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052601f-aa24-4801-965a-e731d005caa0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:37.446341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052601f-aa24-4801-965a-e731d005caa0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:37.451462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d148c-d293-4198-85d4-2a246ab67e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:37.452080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d148c-d293-4198-85d4-2a246ab67e6f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.452364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d148c-d293-4198-85d4-2a246ab67e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.452655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d148c-d293-4198-85d4-2a246ab67e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.453307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d148c-d293-4198-85d4-2a246ab67e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:23:37.453607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d148c-d293-4198-85d4-2a246ab67e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:37.455425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d148c-d293-4198-85d4-2a246ab67e6f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:37.472350 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3842/7661] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:23:37.473582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ba6d9-eef9-4a48-951e-d2d9b2b5985c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:37.484328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ba6d9-eef9-4a48-951e-d2d9b2b5985c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:37.489611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece17dd2-20c7-401c-beb4-71ca26834dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:37.490216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece17dd2-20c7-401c-beb4-71ca26834dae admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.490522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece17dd2-20c7-401c-beb4-71ca26834dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.490818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece17dd2-20c7-401c-beb4-71ca26834dae admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.491480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece17dd2-20c7-401c-beb4-71ca26834dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:37.493757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece17dd2-20c7-401c-beb4-71ca26834dae admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:37.526049 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3820/7662] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:23:37 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:23:37.527277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d148c-d293-4198-85d4-2a246ab67e6f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:37.538176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d148c-d293-4198-85d4-2a246ab67e6f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:37.611369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63228e-24c6-4864-a30f-24bee523b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:37.611994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63228e-24c6-4864-a30f-24bee523b019 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.612281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63228e-24c6-4864-a30f-24bee523b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.612559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63228e-24c6-4864-a30f-24bee523b019 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.613234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63228e-24c6-4864-a30f-24bee523b019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:37.615188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63228e-24c6-4864-a30f-24bee523b019 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:37.640570 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3843/7663] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:23:37 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:23:37.644523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece17dd2-20c7-401c-beb4-71ca26834dae admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:37.655921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece17dd2-20c7-401c-beb4-71ca26834dae admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:37.664098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a37647-2f38-4da4-a0f5-a5bbf2c82169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:37.664831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a37647-2f38-4da4-a0f5-a5bbf2c82169 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.665179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a37647-2f38-4da4-a0f5-a5bbf2c82169 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.665535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a37647-2f38-4da4-a0f5-a5bbf2c82169 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.666224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a37647-2f38-4da4-a0f5-a5bbf2c82169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:37.667910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a37647-2f38-4da4-a0f5-a5bbf2c82169 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:37.681907 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3821/7664] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:23:37.683605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63228e-24c6-4864-a30f-24bee523b019 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:37.694229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63228e-24c6-4864-a30f-24bee523b019 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:37.699784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357f162-12be-424f-8aa9-51dce89f03b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:37.700391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f162-12be-424f-8aa9-51dce89f03b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.700705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f162-12be-424f-8aa9-51dce89f03b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.700980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f162-12be-424f-8aa9-51dce89f03b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.701624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357f162-12be-424f-8aa9-51dce89f03b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:37.703241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357f162-12be-424f-8aa9-51dce89f03b3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:37.714251 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3844/7665] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:23:37.718444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a37647-2f38-4da4-a0f5-a5bbf2c82169 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:37.728629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a37647-2f38-4da4-a0f5-a5bbf2c82169 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:37.733283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa426-2e87-493b-a0d2-8852c83fe958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:37.733940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa426-2e87-493b-a0d2-8852c83fe958 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.734226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa426-2e87-493b-a0d2-8852c83fe958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.734503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa426-2e87-493b-a0d2-8852c83fe958 admin admin] PATH_INFO: `/v3/projects/568de9170fba47f09ef0d3cfdc9b34df/users/25a73a5fe5644dac874ce5d3e2558566/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.751009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfa426-2e87-493b-a0d2-8852c83fe958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568de9170fba47f09ef0d3cfdc9b34df, user_id=25a73a5fe5644dac874ce5d3e2558566, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:37.753738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfa426-2e87-493b-a0d2-8852c83fe958 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:37.770061 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3822/7666] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:23:37 2022] PUT /identity/v3/projects/568de9170fba47f09ef0d3cfdc9b34df/users/25a73a5fe5644dac874ce5d3e2558566/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:23:37.775882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef62e9-35ef-4862-b6f8-bddec1272528 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.776175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef62e9-35ef-4862-b6f8-bddec1272528 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.776447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef62e9-35ef-4862-b6f8-bddec1272528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.795768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4cef62e9-35ef-4862-b6f8-bddec1272528 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:37.797018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4cef62e9-35ef-4862-b6f8-bddec1272528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:37.861151 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3845/7667] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:37.871051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa426-2e87-493b-a0d2-8852c83fe958 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:37.872816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d6bfa426-2e87-493b-a0d2-8852c83fe958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:37.894836 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:37.937683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa426-2e87-493b-a0d2-8852c83fe958 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:37.941375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cf2e7-f9ee-4944-b1e1-55732629ace3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:37.941985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cf2e7-f9ee-4944-b1e1-55732629ace3 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:37.942413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cf2e7-f9ee-4944-b1e1-55732629ace3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:37.942693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cf2e7-f9ee-4944-b1e1-55732629ace3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:37.952233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cf2e7-f9ee-4944-b1e1-55732629ace3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:37.953828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cf2e7-f9ee-4944-b1e1-55732629ace3 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:37.964231 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3823/7668] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:23:38.691706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50319b42-0d00-4a9b-9fcf-f2260ae23352 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:38.692179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50319b42-0d00-4a9b-9fcf-f2260ae23352 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:38.692262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50319b42-0d00-4a9b-9fcf-f2260ae23352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:38.726560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-50319b42-0d00-4a9b-9fcf-f2260ae23352 None None] MFA Rules not processed for user `25a73a5fe5644dac874ce5d3e2558566`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:23:38.728963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-50319b42-0d00-4a9b-9fcf-f2260ae23352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:38.763996 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:38.832445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3846/7669] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:23:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:23:38.845758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cf2e7-f9ee-4944-b1e1-55732629ace3 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:23:38.847374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-361cf2e7-f9ee-4944-b1e1-55732629ace3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:23:38.923968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cf2e7-f9ee-4944-b1e1-55732629ace3 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:23:38.927850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925cd8-ab94-4340-b755-25cd5099346d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:23:38.929392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925cd8-ab94-4340-b755-25cd5099346d service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:23:38.929392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925cd8-ab94-4340-b755-25cd5099346d service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:23:38.929392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925cd8-ab94-4340-b755-25cd5099346d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:23:38.942667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99925cd8-ab94-4340-b755-25cd5099346d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:23:38.944145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99925cd8-ab94-4340-b755-25cd5099346d service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:23:38.955316 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3824/7670] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:23:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:23:48.829971 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=19 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:48.950686 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=43 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:00.108229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50319b42-0d00-4a9b-9fcf-f2260ae23352 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:00.112471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-50319b42-0d00-4a9b-9fcf-f2260ae23352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:00.226598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50319b42-0d00-4a9b-9fcf-f2260ae23352 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:00.233267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191d507-953b-4224-88df-06c7b34fd77d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:00.234219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191d507-953b-4224-88df-06c7b34fd77d service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:00.234502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191d507-953b-4224-88df-06c7b34fd77d service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:00.234776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191d507-953b-4224-88df-06c7b34fd77d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:00.244768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191d507-953b-4224-88df-06c7b34fd77d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:00.246401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191d507-953b-4224-88df-06c7b34fd77d service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:00.275495 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3847/7671] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:24:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:24:08.906033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925cd8-ab94-4340-b755-25cd5099346d service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:08.909087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-99925cd8-ab94-4340-b755-25cd5099346d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:08.931114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925cd8-ab94-4340-b755-25cd5099346d service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:08.938794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:08.939545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:08.939843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:08.940125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:08.941933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:09.041789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:09.043568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:09.061579 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3825/7672] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:24:10.252806 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=32 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:10.469747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191d507-953b-4224-88df-06c7b34fd77d service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:10.482820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191d507-953b-4224-88df-06c7b34fd77d service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:10.487253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3f537-b493-4d76-a22d-f0dad44f86b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:10.488084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3f537-b493-4d76-a22d-f0dad44f86b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:10.488519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3f537-b493-4d76-a22d-f0dad44f86b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:10.489042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3f537-b493-4d76-a22d-f0dad44f86b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:10.491051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6da3f537-b493-4d76-a22d-f0dad44f86b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:10.511133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3f537-b493-4d76-a22d-f0dad44f86b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:10.512871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3f537-b493-4d76-a22d-f0dad44f86b2 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:10.536281 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3848/7673] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:17.702114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:17.703670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:17.719465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf007c2-9d76-460d-abd2-2aaa591a2c7d service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:17.724852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:17.725685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:17.726650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:17.727004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] PATH_INFO: `/v3/users/3398118289fd438aa916a55302219d5a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:17.728353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3398118289fd438aa916a55302219d5a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:17.730507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:17.794302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3398118289fd438aa916a55302219d5a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:17.808515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3398118289fd438aa916a55302219d5a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:17.816646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3398118289fd438aa916a55302219d5a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:17.824830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3398118289fd438aa916a55302219d5a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:17.825560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3398118289fd438aa916a55302219d5a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:17.831491 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3826/7674] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:24:17 2022] DELETE /identity/v3/users/3398118289fd438aa916a55302219d5a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:17.836541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc986d2-3bca-42bf-a69a-819d35d8049b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:17.837418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc986d2-3bca-42bf-a69a-819d35d8049b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:17.837852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc986d2-3bca-42bf-a69a-819d35d8049b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:17.859071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ebc986d2-3bca-42bf-a69a-819d35d8049b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:17.860563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ebc986d2-3bca-42bf-a69a-819d35d8049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:17.946325 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3849/7675] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:17.956442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:17.957901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:18.031685 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:18.042829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6e5a-6533-4721-b56d-6515cfcd53d6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:18.051480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abf872-5387-408a-9250-29ec13dfd11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:18.052364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf872-5387-408a-9250-29ec13dfd11c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.052657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf872-5387-408a-9250-29ec13dfd11c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.052959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf872-5387-408a-9250-29ec13dfd11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.066172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abf872-5387-408a-9250-29ec13dfd11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:18.067983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abf872-5387-408a-9250-29ec13dfd11c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:18.081802 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3827/7676] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:18.280655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc986d2-3bca-42bf-a69a-819d35d8049b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:18.282222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ebc986d2-3bca-42bf-a69a-819d35d8049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:18.307745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc986d2-3bca-42bf-a69a-819d35d8049b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:18.314775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:18.315987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.317330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.317778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] PATH_INFO: `/v3/projects/d2e60ba82ef74ea8979e00a93371c05c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.319304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e60ba82ef74ea8979e00a93371c05c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:18.321778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:18.389136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e60ba82ef74ea8979e00a93371c05c', 'request_id': 'req-febd0046-dd85-4ba6-9b59-7b9be214986b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:18.400438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e60ba82ef74ea8979e00a93371c05c', 'request_id': 'req-febd0046-dd85-4ba6-9b59-7b9be214986b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:18.406785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e60ba82ef74ea8979e00a93371c05c', 'request_id': 'req-febd0046-dd85-4ba6-9b59-7b9be214986b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:18.420728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] The token cache is being invalidate because project d2e60ba82ef74ea8979e00a93371c05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:24:18.421018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:18.421685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-febd0046-dd85-4ba6-9b59-7b9be214986b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:18.426627 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3850/7677] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:24:18 2022] DELETE /identity/v3/projects/d2e60ba82ef74ea8979e00a93371c05c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:24:18.428382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e5bc-de09-4b04-9f9e-4d93bd505344 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.428951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e5bc-de09-4b04-9f9e-4d93bd505344 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.429244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e5bc-de09-4b04-9f9e-4d93bd505344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.450808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9425e5bc-de09-4b04-9f9e-4d93bd505344 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:18.452033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9425e5bc-de09-4b04-9f9e-4d93bd505344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:18.517456 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3828/7678] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:24:18.527458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1ffee-922f-4897-90da-944e4ef6cec1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.527899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1ffee-922f-4897-90da-944e4ef6cec1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.528131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1ffee-922f-4897-90da-944e4ef6cec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.554782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6bf1ffee-922f-4897-90da-944e4ef6cec1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:18.556314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6bf1ffee-922f-4897-90da-944e4ef6cec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:18.571700 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3851/7679] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:18.572565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e5bc-de09-4b04-9f9e-4d93bd505344 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:18.583547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e5bc-de09-4b04-9f9e-4d93bd505344 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:18.590209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e52fe-d83e-42c4-9aad-16335c7cd8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:18.590939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e52fe-d83e-42c4-9aad-16335c7cd8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.591316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e52fe-d83e-42c4-9aad-16335c7cd8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.591600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e52fe-d83e-42c4-9aad-16335c7cd8f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.592390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e52fe-d83e-42c4-9aad-16335c7cd8f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:24:18.592675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e52fe-d83e-42c4-9aad-16335c7cd8f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:18.594323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e52fe-d83e-42c4-9aad-16335c7cd8f2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:18.610464 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3829/7680] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:24:18.614945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1ffee-922f-4897-90da-944e4ef6cec1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:18.626041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1ffee-922f-4897-90da-944e4ef6cec1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:18.631440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b378874-d34c-404d-96db-aa9c8ae09574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:18.632825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b378874-d34c-404d-96db-aa9c8ae09574 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.633216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b378874-d34c-404d-96db-aa9c8ae09574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.633592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b378874-d34c-404d-96db-aa9c8ae09574 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.634449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b378874-d34c-404d-96db-aa9c8ae09574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:18.636983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b378874-d34c-404d-96db-aa9c8ae09574 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:18.684686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e52fe-d83e-42c4-9aad-16335c7cd8f2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:18.684984 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3852/7681] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:24:18 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:24:18.696290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e52fe-d83e-42c4-9aad-16335c7cd8f2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:18.761980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20c24c-0f99-402c-b008-fb13cf38c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:18.762648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20c24c-0f99-402c-b008-fb13cf38c326 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.762832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20c24c-0f99-402c-b008-fb13cf38c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.763206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20c24c-0f99-402c-b008-fb13cf38c326 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.763950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20c24c-0f99-402c-b008-fb13cf38c326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:18.766081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20c24c-0f99-402c-b008-fb13cf38c326 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:18.799446 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3830/7682] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:24:18 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:24:18.803605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b378874-d34c-404d-96db-aa9c8ae09574 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:18.815978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b378874-d34c-404d-96db-aa9c8ae09574 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:18.821792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f478e-3c86-4294-b19d-c5f20f9d0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:18.822526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f478e-3c86-4294-b19d-c5f20f9d0e6a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.822872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f478e-3c86-4294-b19d-c5f20f9d0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.823209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f478e-3c86-4294-b19d-c5f20f9d0e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.823919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f478e-3c86-4294-b19d-c5f20f9d0e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:18.826377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f478e-3c86-4294-b19d-c5f20f9d0e6a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:18.847719 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3853/7683] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:18.852202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20c24c-0f99-402c-b008-fb13cf38c326 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:18.868807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20c24c-0f99-402c-b008-fb13cf38c326 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:18.874401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a6a52-a0df-4d04-a605-55874d23e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:18.875210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a6a52-a0df-4d04-a605-55874d23e927 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.875545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a6a52-a0df-4d04-a605-55874d23e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.876085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a6a52-a0df-4d04-a605-55874d23e927 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.876786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a6a52-a0df-4d04-a605-55874d23e927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:18.878679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a6a52-a0df-4d04-a605-55874d23e927 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:18.895984 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3831/7684] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:18.898332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f478e-3c86-4294-b19d-c5f20f9d0e6a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:18.909613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f478e-3c86-4294-b19d-c5f20f9d0e6a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:18.914607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cd45e-f34c-48e5-9f55-52e82ce7ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:18.915376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cd45e-f34c-48e5-9f55-52e82ce7ff84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.915798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cd45e-f34c-48e5-9f55-52e82ce7ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.916171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cd45e-f34c-48e5-9f55-52e82ce7ff84 admin admin] PATH_INFO: `/v3/projects/16f55c7934d6445da82cd0b75913e34f/users/ccdeff74d7274cf3bf758ab95cc26497/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:18.933241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cd45e-f34c-48e5-9f55-52e82ce7ff84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f55c7934d6445da82cd0b75913e34f, user_id=ccdeff74d7274cf3bf758ab95cc26497, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:18.935912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cd45e-f34c-48e5-9f55-52e82ce7ff84 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:18.945706 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:18.955525 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3854/7685] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:18 2022] PUT /identity/v3/projects/16f55c7934d6445da82cd0b75913e34f/users/ccdeff74d7274cf3bf758ab95cc26497/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:18.969402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cd919-d8ce-483c-8512-6c54fc5def69 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:18.969700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cd919-d8ce-483c-8512-6c54fc5def69 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:18.969978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cd919-d8ce-483c-8512-6c54fc5def69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:19.007734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c19cd919-d8ce-483c-8512-6c54fc5def69 None None] MFA Rules not processed for user `ccdeff74d7274cf3bf758ab95cc26497`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:19.009034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c19cd919-d8ce-483c-8512-6c54fc5def69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:19.072182 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:19.095060 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3832/7686] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:19.115015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cd45e-f34c-48e5-9f55-52e82ce7ff84 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:19.117568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6c5cd45e-f34c-48e5-9f55-52e82ce7ff84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:19.190557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cd45e-f34c-48e5-9f55-52e82ce7ff84 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:19.194645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0d250-6339-43e1-88c4-f820179e5d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:19.195377 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d250-6339-43e1-88c4-f820179e5d75 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:19.195783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d250-6339-43e1-88c4-f820179e5d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:19.196073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d250-6339-43e1-88c4-f820179e5d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:19.205212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0d250-6339-43e1-88c4-f820179e5d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:19.206688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0d250-6339-43e1-88c4-f820179e5d75 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:19.217091 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3855/7687] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:19.232090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cd919-d8ce-483c-8512-6c54fc5def69 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:19.323926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cd919-d8ce-483c-8512-6c54fc5def69 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:19.328688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:19.329331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:19.329613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:19.329890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] PATH_INFO: `/v3/users/ccdeff74d7274cf3bf758ab95cc26497` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:19.331041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccdeff74d7274cf3bf758ab95cc26497)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:19.333001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:19.389599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccdeff74d7274cf3bf758ab95cc26497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:19.406490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccdeff74d7274cf3bf758ab95cc26497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:19.416217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccdeff74d7274cf3bf758ab95cc26497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:19.425167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccdeff74d7274cf3bf758ab95cc26497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:19.426008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccdeff74d7274cf3bf758ab95cc26497'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:19.435063 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3833/7688] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:24:19 2022] DELETE /identity/v3/users/ccdeff74d7274cf3bf758ab95cc26497 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:19.439653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4af3b-fc01-46bf-9032-ad9f7f2f0901 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:19.440030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4af3b-fc01-46bf-9032-ad9f7f2f0901 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:19.440417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4af3b-fc01-46bf-9032-ad9f7f2f0901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:19.463685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a3d4af3b-fc01-46bf-9032-ad9f7f2f0901 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:19.465064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a3d4af3b-fc01-46bf-9032-ad9f7f2f0901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:19.544689 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3856/7689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:24:19.556515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:19.558288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:19.625382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc620-8b55-4d13-9d27-876f5523659f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:19.629744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3054c-669c-4cbf-ab52-281009aef2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:19.630426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3054c-669c-4cbf-ab52-281009aef2fa service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:19.630773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3054c-669c-4cbf-ab52-281009aef2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:19.631212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3054c-669c-4cbf-ab52-281009aef2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:19.641476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3054c-669c-4cbf-ab52-281009aef2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:19.642843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3054c-669c-4cbf-ab52-281009aef2fa service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:19.658374 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3834/7690] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:19.985394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4af3b-fc01-46bf-9032-ad9f7f2f0901 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:19.987002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a3d4af3b-fc01-46bf-9032-ad9f7f2f0901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:20.006086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4af3b-fc01-46bf-9032-ad9f7f2f0901 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:20.012729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:20.030182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.030597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.030885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] PATH_INFO: `/v3/projects/16f55c7934d6445da82cd0b75913e34f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.037553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f55c7934d6445da82cd0b75913e34f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:20.042025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:20.105903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f55c7934d6445da82cd0b75913e34f', 'request_id': 'req-d773cd14-a053-43c1-bc2d-d05474b080eb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:20.115171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f55c7934d6445da82cd0b75913e34f', 'request_id': 'req-d773cd14-a053-43c1-bc2d-d05474b080eb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:20.126470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f55c7934d6445da82cd0b75913e34f', 'request_id': 'req-d773cd14-a053-43c1-bc2d-d05474b080eb'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:20.139405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] The token cache is being invalidate because project 16f55c7934d6445da82cd0b75913e34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:24:20.139695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:20.140357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d773cd14-a053-43c1-bc2d-d05474b080eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:20.141880 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3857/7691] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:24:19 2022] DELETE /identity/v3/projects/16f55c7934d6445da82cd0b75913e34f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:20.146924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e362eca-e2eb-4fe0-9c9f-358820f5d819 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.147428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e362eca-e2eb-4fe0-9c9f-358820f5d819 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.148136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e362eca-e2eb-4fe0-9c9f-358820f5d819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.165175 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:20.173133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3e362eca-e2eb-4fe0-9c9f-358820f5d819 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:20.175501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3e362eca-e2eb-4fe0-9c9f-358820f5d819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:20.254226 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3835/7692] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:20.262532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e05b-31d4-4168-a1bf-61534cf6b312 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.263054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e05b-31d4-4168-a1bf-61534cf6b312 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.263415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e05b-31d4-4168-a1bf-61534cf6b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.294362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d308e05b-31d4-4168-a1bf-61534cf6b312 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:20.295892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d308e05b-31d4-4168-a1bf-61534cf6b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:20.308693 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3858/7693] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:20.314222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e362eca-e2eb-4fe0-9c9f-358820f5d819 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:20.336636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e362eca-e2eb-4fe0-9c9f-358820f5d819 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:20.341698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0f1a8-1ace-4ddd-8f05-a26005e0e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:20.342337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0f1a8-1ace-4ddd-8f05-a26005e0e919 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.342620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0f1a8-1ace-4ddd-8f05-a26005e0e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.342899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0f1a8-1ace-4ddd-8f05-a26005e0e919 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.343569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0f1a8-1ace-4ddd-8f05-a26005e0e919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:24:20.344022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0f1a8-1ace-4ddd-8f05-a26005e0e919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:20.345980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0f1a8-1ace-4ddd-8f05-a26005e0e919 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:20.360921 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3836/7694] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:24:20.364959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308e05b-31d4-4168-a1bf-61534cf6b312 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:20.376183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308e05b-31d4-4168-a1bf-61534cf6b312 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:20.381110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a11b-f034-427b-8fa1-dd4ba114b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:20.381760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a11b-f034-427b-8fa1-dd4ba114b303 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.382793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a11b-f034-427b-8fa1-dd4ba114b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.383518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a11b-f034-427b-8fa1-dd4ba114b303 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.384179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899a11b-f034-427b-8fa1-dd4ba114b303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:20.386172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899a11b-f034-427b-8fa1-dd4ba114b303 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:20.411367 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:20.439648 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3859/7695] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:24:20 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:24:20.443765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0f1a8-1ace-4ddd-8f05-a26005e0e919 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:20.456421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0f1a8-1ace-4ddd-8f05-a26005e0e919 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:20.539707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516789bc-d5c0-472a-a721-9963bbeac827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:20.540327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516789bc-d5c0-472a-a721-9963bbeac827 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.540610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516789bc-d5c0-472a-a721-9963bbeac827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.540921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516789bc-d5c0-472a-a721-9963bbeac827 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.541572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516789bc-d5c0-472a-a721-9963bbeac827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:20.543711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516789bc-d5c0-472a-a721-9963bbeac827 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:20.567747 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3837/7696] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:24:20 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:24:20.572734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a11b-f034-427b-8fa1-dd4ba114b303 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:20.584238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a11b-f034-427b-8fa1-dd4ba114b303 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:20.607495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2fb68-e97f-4ffe-92d7-8fd96cf8c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:20.608654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2fb68-e97f-4ffe-92d7-8fd96cf8c4aa admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.608943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2fb68-e97f-4ffe-92d7-8fd96cf8c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.609220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2fb68-e97f-4ffe-92d7-8fd96cf8c4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.609885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2fb68-e97f-4ffe-92d7-8fd96cf8c4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:20.611702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2fb68-e97f-4ffe-92d7-8fd96cf8c4aa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:20.628821 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3860/7697] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:20.629985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516789bc-d5c0-472a-a721-9963bbeac827 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:20.641875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516789bc-d5c0-472a-a721-9963bbeac827 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:20.646880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff11849-aeed-4f4a-bb06-a1e5dfa8728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:20.647662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff11849-aeed-4f4a-bb06-a1e5dfa8728d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.647850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff11849-aeed-4f4a-bb06-a1e5dfa8728d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.648129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff11849-aeed-4f4a-bb06-a1e5dfa8728d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.649776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff11849-aeed-4f4a-bb06-a1e5dfa8728d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:20.651392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff11849-aeed-4f4a-bb06-a1e5dfa8728d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:20.666758 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3838/7698] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:24:20.668112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2fb68-e97f-4ffe-92d7-8fd96cf8c4aa admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:20.679892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2fb68-e97f-4ffe-92d7-8fd96cf8c4aa admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:20.686401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8621a7e-4f87-4b4a-ae23-e4809a505700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:20.687241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8621a7e-4f87-4b4a-ae23-e4809a505700 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.687934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8621a7e-4f87-4b4a-ae23-e4809a505700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.687934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8621a7e-4f87-4b4a-ae23-e4809a505700 admin admin] PATH_INFO: `/v3/projects/5f98ec3f273742f2a7744088bce05fb9/users/3a9fd8c41b204241891f113b6129dffd/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.705486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8621a7e-4f87-4b4a-ae23-e4809a505700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f98ec3f273742f2a7744088bce05fb9, user_id=3a9fd8c41b204241891f113b6129dffd, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:20.708381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8621a7e-4f87-4b4a-ae23-e4809a505700 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:20.740244 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3861/7699] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:20 2022] PUT /identity/v3/projects/5f98ec3f273742f2a7744088bce05fb9/users/3a9fd8c41b204241891f113b6129dffd/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:20.743103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1aceb-807e-4b65-a3a9-f4121a931816 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:20.744859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1aceb-807e-4b65-a3a9-f4121a931816 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:20.744859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1aceb-807e-4b65-a3a9-f4121a931816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:20.792182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5db1aceb-807e-4b65-a3a9-f4121a931816 None None] MFA Rules not processed for user `3a9fd8c41b204241891f113b6129dffd`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:20.794223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5db1aceb-807e-4b65-a3a9-f4121a931816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:20.923027 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3839/7700] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:20.949254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8621a7e-4f87-4b4a-ae23-e4809a505700 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:20.954203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f8621a7e-4f87-4b4a-ae23-e4809a505700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:21.056892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8621a7e-4f87-4b4a-ae23-e4809a505700 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:21.061324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4cf48-de31-4dd6-ad9f-c94b3c8a5c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:21.062050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4cf48-de31-4dd6-ad9f-c94b3c8a5c6a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:21.062338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4cf48-de31-4dd6-ad9f-c94b3c8a5c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:21.062616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4cf48-de31-4dd6-ad9f-c94b3c8a5c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:21.079160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4cf48-de31-4dd6-ad9f-c94b3c8a5c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:21.081125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4cf48-de31-4dd6-ad9f-c94b3c8a5c6a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:21.098435 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3862/7701] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:21.114953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1aceb-807e-4b65-a3a9-f4121a931816 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:21.119445 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:21.224754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1aceb-807e-4b65-a3a9-f4121a931816 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:21.230142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:21.230142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:21.230142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:21.230142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] PATH_INFO: `/v3/users/3a9fd8c41b204241891f113b6129dffd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:21.230710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a9fd8c41b204241891f113b6129dffd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:21.233038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:21.309393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a9fd8c41b204241891f113b6129dffd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:21.325140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a9fd8c41b204241891f113b6129dffd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:21.349421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a9fd8c41b204241891f113b6129dffd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:21.359391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a9fd8c41b204241891f113b6129dffd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:21.360214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a9fd8c41b204241891f113b6129dffd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:21.385184 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3840/7702] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:24:21 2022] DELETE /identity/v3/users/3a9fd8c41b204241891f113b6129dffd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:21.387402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc0a7b-7511-4f4e-9764-da3ad5d1a542 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:21.387694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc0a7b-7511-4f4e-9764-da3ad5d1a542 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:21.387976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc0a7b-7511-4f4e-9764-da3ad5d1a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:21.421522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f0fc0a7b-7511-4f4e-9764-da3ad5d1a542 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:21.422803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f0fc0a7b-7511-4f4e-9764-da3ad5d1a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:21.541586 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3863/7703] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:21.554145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:21.555902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:21.661493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3612251-0953-471a-95cc-77433ff24895 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:21.665732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e22367-5fc2-4757-9533-bf6e8df78acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:21.666449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22367-5fc2-4757-9533-bf6e8df78acc service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:21.666732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22367-5fc2-4757-9533-bf6e8df78acc service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:21.667008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22367-5fc2-4757-9533-bf6e8df78acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:21.679065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e22367-5fc2-4757-9533-bf6e8df78acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:21.680681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e22367-5fc2-4757-9533-bf6e8df78acc service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:21.692652 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3841/7704] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:22.041293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc0a7b-7511-4f4e-9764-da3ad5d1a542 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:22.044367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f0fc0a7b-7511-4f4e-9764-da3ad5d1a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:22.074460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc0a7b-7511-4f4e-9764-da3ad5d1a542 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:22.081234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:22.082131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.083513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.083890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] PATH_INFO: `/v3/projects/5f98ec3f273742f2a7744088bce05fb9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.085768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f98ec3f273742f2a7744088bce05fb9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:22.087962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:22.141742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f98ec3f273742f2a7744088bce05fb9', 'request_id': 'req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:22.150454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f98ec3f273742f2a7744088bce05fb9', 'request_id': 'req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:22.153007 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:22.158226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f98ec3f273742f2a7744088bce05fb9', 'request_id': 'req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:22.174714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] The token cache is being invalidate because project 5f98ec3f273742f2a7744088bce05fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:24:22.175018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:22.175810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-95cbc6bf-561b-4a07-8b4b-5187a0f049ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:22.177871 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3864/7705] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:24:22 2022] DELETE /identity/v3/projects/5f98ec3f273742f2a7744088bce05fb9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:22.183588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b777f7-80a7-45d8-b2b4-b07c582e11c1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.183994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b777f7-80a7-45d8-b2b4-b07c582e11c1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.185046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b777f7-80a7-45d8-b2b4-b07c582e11c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.209284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d6b777f7-80a7-45d8-b2b4-b07c582e11c1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:22.211342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d6b777f7-80a7-45d8-b2b4-b07c582e11c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:22.238026 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:22.287714 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3842/7706] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:22.296422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1607180-0deb-46f8-aa33-497a026f75ca None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.296741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1607180-0deb-46f8-aa33-497a026f75ca None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.297024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1607180-0deb-46f8-aa33-497a026f75ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.318957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d1607180-0deb-46f8-aa33-497a026f75ca None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:22.320408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d1607180-0deb-46f8-aa33-497a026f75ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:22.333851 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3865/7707] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:22.334612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b777f7-80a7-45d8-b2b4-b07c582e11c1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:22.345731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b777f7-80a7-45d8-b2b4-b07c582e11c1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:22.351758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c06805-594f-461b-a062-50cba8e5f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:22.352485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c06805-594f-461b-a062-50cba8e5f097 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.352913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c06805-594f-461b-a062-50cba8e5f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.353262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c06805-594f-461b-a062-50cba8e5f097 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.354211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c06805-594f-461b-a062-50cba8e5f097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:24:22.354586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c06805-594f-461b-a062-50cba8e5f097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:22.356271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c06805-594f-461b-a062-50cba8e5f097 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:22.373014 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3843/7708] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:24:22.374742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1607180-0deb-46f8-aa33-497a026f75ca None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:22.385169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1607180-0deb-46f8-aa33-497a026f75ca None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:22.390147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292d760-14f2-4913-a3f4-5c1364e567e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:22.390815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292d760-14f2-4913-a3f4-5c1364e567e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.391104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292d760-14f2-4913-a3f4-5c1364e567e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.391378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292d760-14f2-4913-a3f4-5c1364e567e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.392010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292d760-14f2-4913-a3f4-5c1364e567e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:22.395520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292d760-14f2-4913-a3f4-5c1364e567e8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:22.426762 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3866/7709] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:24:22 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:24:22.432153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c06805-594f-461b-a062-50cba8e5f097 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:22.447200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c06805-594f-461b-a062-50cba8e5f097 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:22.532101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5c420-8c87-48ca-8a4f-a2d83e7dc67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:22.533017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5c420-8c87-48ca-8a4f-a2d83e7dc67e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.533457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5c420-8c87-48ca-8a4f-a2d83e7dc67e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.533922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5c420-8c87-48ca-8a4f-a2d83e7dc67e admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.534715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5c420-8c87-48ca-8a4f-a2d83e7dc67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:22.536875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5c420-8c87-48ca-8a4f-a2d83e7dc67e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:22.563544 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3844/7710] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:24:22 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:24:22.567166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292d760-14f2-4913-a3f4-5c1364e567e8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:22.579670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292d760-14f2-4913-a3f4-5c1364e567e8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:22.585382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ede85e-1644-4069-b430-b2f95f678a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:22.586233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ede85e-1644-4069-b430-b2f95f678a4a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.587297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ede85e-1644-4069-b430-b2f95f678a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.587739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ede85e-1644-4069-b430-b2f95f678a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.588700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ede85e-1644-4069-b430-b2f95f678a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:22.590567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ede85e-1644-4069-b430-b2f95f678a4a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:22.602872 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3867/7711] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:24:22.606958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5c420-8c87-48ca-8a4f-a2d83e7dc67e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:22.618981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5c420-8c87-48ca-8a4f-a2d83e7dc67e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:22.624038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7959f4c-cc82-4d1f-b473-dec146250764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:22.624754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7959f4c-cc82-4d1f-b473-dec146250764 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.625102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7959f4c-cc82-4d1f-b473-dec146250764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.625562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7959f4c-cc82-4d1f-b473-dec146250764 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.626273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7959f4c-cc82-4d1f-b473-dec146250764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:22.627946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7959f4c-cc82-4d1f-b473-dec146250764 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:22.644424 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3845/7712] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:24:22.645751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ede85e-1644-4069-b430-b2f95f678a4a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:22.658448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ede85e-1644-4069-b430-b2f95f678a4a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:22.663569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283e3d-1d97-4a60-9347-47635c6bd214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:22.664112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283e3d-1d97-4a60-9347-47635c6bd214 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.664494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283e3d-1d97-4a60-9347-47635c6bd214 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.664868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283e3d-1d97-4a60-9347-47635c6bd214 admin admin] PATH_INFO: `/v3/projects/247bb4c868c74079b571953628c3c1da/users/421ccd6c5fca4a7dac56b3c9e05e3bc2/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.681013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82283e3d-1d97-4a60-9347-47635c6bd214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247bb4c868c74079b571953628c3c1da, user_id=421ccd6c5fca4a7dac56b3c9e05e3bc2, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:22.684026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82283e3d-1d97-4a60-9347-47635c6bd214 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:22.711349 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3868/7713] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:22 2022] PUT /identity/v3/projects/247bb4c868c74079b571953628c3c1da/users/421ccd6c5fca4a7dac56b3c9e05e3bc2/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:22.713132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9387c9-2e93-476e-8247-969db28f9eb3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.713602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9387c9-2e93-476e-8247-969db28f9eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.713949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9387c9-2e93-476e-8247-969db28f9eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.745481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ca9387c9-2e93-476e-8247-969db28f9eb3 None None] MFA Rules not processed for user `421ccd6c5fca4a7dac56b3c9e05e3bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:22.746619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ca9387c9-2e93-476e-8247-969db28f9eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:22.824945 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3846/7714] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:22.829490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283e3d-1d97-4a60-9347-47635c6bd214 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:22.915374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283e3d-1d97-4a60-9347-47635c6bd214 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:22.920391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909cd7a-2653-4f99-8bd6-cd44acb92024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:22.921108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909cd7a-2653-4f99-8bd6-cd44acb92024 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:22.921395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909cd7a-2653-4f99-8bd6-cd44acb92024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:22.921668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909cd7a-2653-4f99-8bd6-cd44acb92024 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:22.922317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909cd7a-2653-4f99-8bd6-cd44acb92024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:22.924254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909cd7a-2653-4f99-8bd6-cd44acb92024 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:22.961984 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3869/7715] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:24:22 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:24:22.962806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9387c9-2e93-476e-8247-969db28f9eb3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:22.974357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9387c9-2e93-476e-8247-969db28f9eb3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:23.000233 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:23.055333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a3ccc-93d9-4107-bac8-eecfca96950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:23.055959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a3ccc-93d9-4107-bac8-eecfca96950f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:23.056376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a3ccc-93d9-4107-bac8-eecfca96950f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:23.056739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a3ccc-93d9-4107-bac8-eecfca96950f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:23.061062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a3ccc-93d9-4107-bac8-eecfca96950f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:23.063190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a3ccc-93d9-4107-bac8-eecfca96950f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:23.096684 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3847/7716] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:24:22 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:24:23.098263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909cd7a-2653-4f99-8bd6-cd44acb92024 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:23.117474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909cd7a-2653-4f99-8bd6-cd44acb92024 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:23.123589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99940e81-cbc3-426e-a1a4-faab5575afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:23.124230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99940e81-cbc3-426e-a1a4-faab5575afa1 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:23.124516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99940e81-cbc3-426e-a1a4-faab5575afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:23.124867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99940e81-cbc3-426e-a1a4-faab5575afa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:23.125494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99940e81-cbc3-426e-a1a4-faab5575afa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:23.127164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99940e81-cbc3-426e-a1a4-faab5575afa1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:23.145573 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3870/7717] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:23.146757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a3ccc-93d9-4107-bac8-eecfca96950f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:23.158487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a3ccc-93d9-4107-bac8-eecfca96950f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:23.164400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c74c-f0de-4804-a6cd-3833694c2e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:23.165205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c74c-f0de-4804-a6cd-3833694c2e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:23.165670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c74c-f0de-4804-a6cd-3833694c2e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:23.166098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c74c-f0de-4804-a6cd-3833694c2e30 admin admin] PATH_INFO: `/v3/projects/72653b3b6d6349c7b55e9d8695fd2350/users/a465b4a2102b46fdbd49c3d34b8b5219/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:23.185543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c74c-f0de-4804-a6cd-3833694c2e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72653b3b6d6349c7b55e9d8695fd2350, user_id=a465b4a2102b46fdbd49c3d34b8b5219, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:23.188450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c74c-f0de-4804-a6cd-3833694c2e30 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:23.207344 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3848/7718] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:23 2022] PUT /identity/v3/projects/72653b3b6d6349c7b55e9d8695fd2350/users/a465b4a2102b46fdbd49c3d34b8b5219/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:23.208874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99940e81-cbc3-426e-a1a4-faab5575afa1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:23.220137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99940e81-cbc3-426e-a1a4-faab5575afa1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:23.279425 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:23.287359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01c05a-8d89-4eb3-a969-3964225ff607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:23.288507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01c05a-8d89-4eb3-a969-3964225ff607 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:23.289540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01c05a-8d89-4eb3-a969-3964225ff607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:23.290454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01c05a-8d89-4eb3-a969-3964225ff607 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:23.291615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01c05a-8d89-4eb3-a969-3964225ff607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:23.294391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01c05a-8d89-4eb3-a969-3964225ff607 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:23.311048 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3871/7719] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:23.312466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c74c-f0de-4804-a6cd-3833694c2e30 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:23.326062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c74c-f0de-4804-a6cd-3833694c2e30 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:23.331073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f3637-67fa-445d-a053-4c6e0ea91b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:23.331828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f3637-67fa-445d-a053-4c6e0ea91b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:23.332182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f3637-67fa-445d-a053-4c6e0ea91b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:23.332526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f3637-67fa-445d-a053-4c6e0ea91b39 admin admin] PATH_INFO: `/v3/projects/72653b3b6d6349c7b55e9d8695fd2350/users/a465b4a2102b46fdbd49c3d34b8b5219/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:23.334708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f3637-67fa-445d-a053-4c6e0ea91b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72653b3b6d6349c7b55e9d8695fd2350, user_id=a465b4a2102b46fdbd49c3d34b8b5219, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:23.337689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f3637-67fa-445d-a053-4c6e0ea91b39 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:23.349517 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3849/7720] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:23 2022] PUT /identity/v3/projects/72653b3b6d6349c7b55e9d8695fd2350/users/a465b4a2102b46fdbd49c3d34b8b5219/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:23.361559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdd441-65d3-4dab-b5c4-5f24ea7826be None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:23.362105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdd441-65d3-4dab-b5c4-5f24ea7826be None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:23.362523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdd441-65d3-4dab-b5c4-5f24ea7826be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:23.399443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-64fdd441-65d3-4dab-b5c4-5f24ea7826be None None] MFA Rules not processed for user `a465b4a2102b46fdbd49c3d34b8b5219`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:23.400731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-64fdd441-65d3-4dab-b5c4-5f24ea7826be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:23.476868 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3872/7721] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:23.488320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f3637-67fa-445d-a053-4c6e0ea91b39 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:23.490090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-060f3637-67fa-445d-a053-4c6e0ea91b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:23.563859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f3637-67fa-445d-a053-4c6e0ea91b39 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:23.567899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ab240-1eda-401f-a57f-771b212d9fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:23.568533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab240-1eda-401f-a57f-771b212d9fba service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:23.568860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab240-1eda-401f-a57f-771b212d9fba service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:23.569211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab240-1eda-401f-a57f-771b212d9fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:23.580328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ab240-1eda-401f-a57f-771b212d9fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:23.581805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ab240-1eda-401f-a57f-771b212d9fba service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:23.595254 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3850/7722] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:23.677615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdd441-65d3-4dab-b5c4-5f24ea7826be None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:23.691053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdd441-65d3-4dab-b5c4-5f24ea7826be None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:23.694900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4320df-200a-45d9-ad42-59c3f687bc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:23.695483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4320df-200a-45d9-ad42-59c3f687bc19 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:23.695766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4320df-200a-45d9-ad42-59c3f687bc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:23.696042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4320df-200a-45d9-ad42-59c3f687bc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:23.763476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4320df-200a-45d9-ad42-59c3f687bc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:23.765127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4320df-200a-45d9-ad42-59c3f687bc19 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:23.778759 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3873/7723] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:33.589418 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:33.773291 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=65 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:33.974611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ab240-1eda-401f-a57f-771b212d9fba service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:34.054905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ab240-1eda-401f-a57f-771b212d9fba service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:34.060762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:34.061410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:34.061696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:34.061974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] PATH_INFO: `/v3/users/421ccd6c5fca4a7dac56b3c9e05e3bc2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:34.063121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421ccd6c5fca4a7dac56b3c9e05e3bc2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:34.065169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:34.132096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421ccd6c5fca4a7dac56b3c9e05e3bc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.147598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421ccd6c5fca4a7dac56b3c9e05e3bc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.156005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421ccd6c5fca4a7dac56b3c9e05e3bc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.169056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421ccd6c5fca4a7dac56b3c9e05e3bc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.169056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421ccd6c5fca4a7dac56b3c9e05e3bc2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.185514 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3851/7724] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:24:33 2022] DELETE /identity/v3/users/421ccd6c5fca4a7dac56b3c9e05e3bc2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:34.186811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008c027-76e5-495a-b1d3-633929620af3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:34.187104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008c027-76e5-495a-b1d3-633929620af3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:34.187429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008c027-76e5-495a-b1d3-633929620af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:34.208932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8008c027-76e5-495a-b1d3-633929620af3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:34.211607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8008c027-76e5-495a-b1d3-633929620af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:34.291509 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3874/7725] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:24:34.304255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:34.306727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:34.401387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c33dd-8a31-4db3-a85e-6a4be93fb739 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:34.405703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555a355-6bcb-4343-8876-a26d8c574574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:34.406578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555a355-6bcb-4343-8876-a26d8c574574 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:34.407038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555a355-6bcb-4343-8876-a26d8c574574 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:34.407479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555a355-6bcb-4343-8876-a26d8c574574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:34.419532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555a355-6bcb-4343-8876-a26d8c574574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:34.421451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555a355-6bcb-4343-8876-a26d8c574574 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:34.434761 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3852/7726] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:34.767207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008c027-76e5-495a-b1d3-633929620af3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:34.768412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8008c027-76e5-495a-b1d3-633929620af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:34.789254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008c027-76e5-495a-b1d3-633929620af3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:34.797810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:34.798971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:34.799420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:34.800414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] PATH_INFO: `/v3/projects/247bb4c868c74079b571953628c3c1da` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:34.801853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247bb4c868c74079b571953628c3c1da)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:34.805466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:34.867458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247bb4c868c74079b571953628c3c1da', 'request_id': 'req-69e65193-05e1-424e-b66f-70fdfc5ad088'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.877785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247bb4c868c74079b571953628c3c1da', 'request_id': 'req-69e65193-05e1-424e-b66f-70fdfc5ad088'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.905322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247bb4c868c74079b571953628c3c1da', 'request_id': 'req-69e65193-05e1-424e-b66f-70fdfc5ad088'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.936168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] The token cache is being invalidate because project 247bb4c868c74079b571953628c3c1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:24:34.936386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.937105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:34.940671 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3875/7727] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:24:34 2022] DELETE /identity/v3/projects/247bb4c868c74079b571953628c3c1da => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:34.943943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555a355-6bcb-4343-8876-a26d8c574574 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:34.957081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555a355-6bcb-4343-8876-a26d8c574574 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:34.983270 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:35.033276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:35.034104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:35.034482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:35.034858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] PATH_INFO: `/v3/users/a465b4a2102b46fdbd49c3d34b8b5219` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:35.036501 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a465b4a2102b46fdbd49c3d34b8b5219)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:35.039038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:35.104826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a465b4a2102b46fdbd49c3d34b8b5219'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.121802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a465b4a2102b46fdbd49c3d34b8b5219'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.132148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a465b4a2102b46fdbd49c3d34b8b5219'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.141482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a465b4a2102b46fdbd49c3d34b8b5219'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.142530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-68da1df1-834c-4796-ba7e-a3a390c6b5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a465b4a2102b46fdbd49c3d34b8b5219'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.152604 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3853/7728] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:24:34 2022] DELETE /identity/v3/users/a465b4a2102b46fdbd49c3d34b8b5219 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:35.465813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:35.467442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:35.481728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e65193-05e1-424e-b66f-70fdfc5ad088 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:35.554820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:35.555467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:35.555745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:35.556019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] PATH_INFO: `/v3/projects/72653b3b6d6349c7b55e9d8695fd2350` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:35.557455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=72653b3b6d6349c7b55e9d8695fd2350)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:35.561423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:35.612855 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:35.642794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72653b3b6d6349c7b55e9d8695fd2350', 'request_id': 'req-990c45b9-1c4e-45e5-b77d-b6929b430d8d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.653939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72653b3b6d6349c7b55e9d8695fd2350', 'request_id': 'req-990c45b9-1c4e-45e5-b77d-b6929b430d8d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.660934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72653b3b6d6349c7b55e9d8695fd2350', 'request_id': 'req-990c45b9-1c4e-45e5-b77d-b6929b430d8d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.676387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] The token cache is being invalidate because project 72653b3b6d6349c7b55e9d8695fd2350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:24:35.676711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.677555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-990c45b9-1c4e-45e5-b77d-b6929b430d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:35.683982 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3876/7729] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:24:35 2022] DELETE /identity/v3/projects/72653b3b6d6349c7b55e9d8695fd2350 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:35.686684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa545f54-4cb1-4cd4-b610-ea1f29e5bbc0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:35.687245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa545f54-4cb1-4cd4-b610-ea1f29e5bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:35.687554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa545f54-4cb1-4cd4-b610-ea1f29e5bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:35.711594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-aa545f54-4cb1-4cd4-b610-ea1f29e5bbc0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:35.713448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aa545f54-4cb1-4cd4-b610-ea1f29e5bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:35.798191 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3854/7730] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:35.805536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c6fc-b56c-407c-bb05-457a61661716 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:35.806013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c6fc-b56c-407c-bb05-457a61661716 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:35.806141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c6fc-b56c-407c-bb05-457a61661716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:35.829723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f254c6fc-b56c-407c-bb05-457a61661716 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:35.830948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f254c6fc-b56c-407c-bb05-457a61661716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:35.839754 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3877/7731] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:35.844109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa545f54-4cb1-4cd4-b610-ea1f29e5bbc0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:35.855090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa545f54-4cb1-4cd4-b610-ea1f29e5bbc0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:35.859730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc817793-1867-4238-8eca-42a57f44c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:35.860342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc817793-1867-4238-8eca-42a57f44c1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:35.860647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc817793-1867-4238-8eca-42a57f44c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:35.860926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc817793-1867-4238-8eca-42a57f44c1f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:35.861576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc817793-1867-4238-8eca-42a57f44c1f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:24:35.861877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc817793-1867-4238-8eca-42a57f44c1f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:35.863482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc817793-1867-4238-8eca-42a57f44c1f8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:35.878429 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3855/7732] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:24:35.882812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254c6fc-b56c-407c-bb05-457a61661716 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:35.892998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254c6fc-b56c-407c-bb05-457a61661716 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:35.898420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830d1a9-f04a-4cc0-8c5a-712b52859294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:35.899127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830d1a9-f04a-4cc0-8c5a-712b52859294 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:35.899485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830d1a9-f04a-4cc0-8c5a-712b52859294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:35.899836 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830d1a9-f04a-4cc0-8c5a-712b52859294 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:35.900555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830d1a9-f04a-4cc0-8c5a-712b52859294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:35.903316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830d1a9-f04a-4cc0-8c5a-712b52859294 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:35.939543 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3878/7733] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:24:35 2022] POST /identity/v3/projects => generated 355 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:24:35.943395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc817793-1867-4238-8eca-42a57f44c1f8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:35.958729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc817793-1867-4238-8eca-42a57f44c1f8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:36.002887 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:36.065712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a0427-4ce2-48ab-bef2-b37a5b841ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:36.066438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a0427-4ce2-48ab-bef2-b37a5b841ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:36.066792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a0427-4ce2-48ab-bef2-b37a5b841ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:36.067145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a0427-4ce2-48ab-bef2-b37a5b841ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:36.069331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a0427-4ce2-48ab-bef2-b37a5b841ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:36.072063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a0427-4ce2-48ab-bef2-b37a5b841ae3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:36.100570 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3856/7734] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:24:35 2022] POST /identity/v3/users => generated 278 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:24:36.104845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830d1a9-f04a-4cc0-8c5a-712b52859294 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:36.116709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830d1a9-f04a-4cc0-8c5a-712b52859294 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:36.121997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f5f0-979c-4b8a-974b-41a310a535d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:36.122948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f5f0-979c-4b8a-974b-41a310a535d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:36.123430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f5f0-979c-4b8a-974b-41a310a535d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:36.123930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f5f0-979c-4b8a-974b-41a310a535d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:36.124825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7f5f0-979c-4b8a-974b-41a310a535d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:36.126894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7f5f0-979c-4b8a-974b-41a310a535d4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:36.145228 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3879/7735] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:36.149752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a0427-4ce2-48ab-bef2-b37a5b841ae3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:36.165650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a0427-4ce2-48ab-bef2-b37a5b841ae3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:36.173206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f3eba-7fec-4cdf-83d3-7cb4cc2cabd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:36.173941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f3eba-7fec-4cdf-83d3-7cb4cc2cabd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:36.175170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f3eba-7fec-4cdf-83d3-7cb4cc2cabd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:36.175559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f3eba-7fec-4cdf-83d3-7cb4cc2cabd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:36.176532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f3eba-7fec-4cdf-83d3-7cb4cc2cabd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:36.179148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f3eba-7fec-4cdf-83d3-7cb4cc2cabd0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:36.201550 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3857/7736] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:36.202068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f5f0-979c-4b8a-974b-41a310a535d4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:36.214074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f5f0-979c-4b8a-974b-41a310a535d4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:36.219263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2b645-3063-42cb-8d06-ec15167f7a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:36.220403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2b645-3063-42cb-8d06-ec15167f7a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:36.220815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2b645-3063-42cb-8d06-ec15167f7a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:36.221166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2b645-3063-42cb-8d06-ec15167f7a3d admin admin] PATH_INFO: `/v3/projects/5f2d9ba4b6e54efcb71cd4c1fd749bf3/users/655b2cadefac4874bf5a089b845cf0c8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:36.240159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2b645-3063-42cb-8d06-ec15167f7a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2d9ba4b6e54efcb71cd4c1fd749bf3, user_id=655b2cadefac4874bf5a089b845cf0c8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:36.243948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2b645-3063-42cb-8d06-ec15167f7a3d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:36.263486 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3880/7737] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:36 2022] PUT /identity/v3/projects/5f2d9ba4b6e54efcb71cd4c1fd749bf3/users/655b2cadefac4874bf5a089b845cf0c8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:36.275452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad32dc1-17ba-4b84-89c0-a64743da4216 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:36.276136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad32dc1-17ba-4b84-89c0-a64743da4216 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:36.276136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad32dc1-17ba-4b84-89c0-a64743da4216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:36.314369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9ad32dc1-17ba-4b84-89c0-a64743da4216 None None] MFA Rules not processed for user `655b2cadefac4874bf5a089b845cf0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:36.315781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9ad32dc1-17ba-4b84-89c0-a64743da4216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:36.465480 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3858/7738] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:36.470007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2b645-3063-42cb-8d06-ec15167f7a3d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:36.563990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2b645-3063-42cb-8d06-ec15167f7a3d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:36.576204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eacf3-b6f8-4584-9ff4-bada56749770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:36.577341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eacf3-b6f8-4584-9ff4-bada56749770 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:36.578061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eacf3-b6f8-4584-9ff4-bada56749770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:36.578576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eacf3-b6f8-4584-9ff4-bada56749770 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:36.579539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694eacf3-b6f8-4584-9ff4-bada56749770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:36.581779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694eacf3-b6f8-4584-9ff4-bada56749770 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:36.638349 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3881/7739] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:24:36 2022] POST /identity/v3/projects => generated 357 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:24:36.641965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad32dc1-17ba-4b84-89c0-a64743da4216 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:36.654900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad32dc1-17ba-4b84-89c0-a64743da4216 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:36.735971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9b6d-d02e-4c08-afe4-04ac00237a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:36.737002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9b6d-d02e-4c08-afe4-04ac00237a7b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:36.737286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9b6d-d02e-4c08-afe4-04ac00237a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:36.737564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9b6d-d02e-4c08-afe4-04ac00237a7b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:36.739781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c9b6d-d02e-4c08-afe4-04ac00237a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:36.741974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c9b6d-d02e-4c08-afe4-04ac00237a7b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:36.769784 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3859/7740] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:24:36 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:24:36.773755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eacf3-b6f8-4584-9ff4-bada56749770 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:36.792706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eacf3-b6f8-4584-9ff4-bada56749770 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:36.798490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad69d9-8930-4d31-9358-14b308b2ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:36.799515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad69d9-8930-4d31-9358-14b308b2ee6c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:36.800879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad69d9-8930-4d31-9358-14b308b2ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:36.801619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad69d9-8930-4d31-9358-14b308b2ee6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:36.802540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad69d9-8930-4d31-9358-14b308b2ee6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:36.805196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad69d9-8930-4d31-9358-14b308b2ee6c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:36.821653 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3882/7741] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:36.825048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9b6d-d02e-4c08-afe4-04ac00237a7b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:36.841772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9b6d-d02e-4c08-afe4-04ac00237a7b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:36.855252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066db8f-3c45-4159-ab66-c61a5caf0fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:36.856166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066db8f-3c45-4159-ab66-c61a5caf0fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:36.856321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066db8f-3c45-4159-ab66-c61a5caf0fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:36.856507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066db8f-3c45-4159-ab66-c61a5caf0fb8 admin admin] PATH_INFO: `/v3/projects/b1025650f3234f37af43b40e9d47a6b2/users/c0899cab608e424988a4a6cdb7978721/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:36.900955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066db8f-3c45-4159-ab66-c61a5caf0fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1025650f3234f37af43b40e9d47a6b2, user_id=c0899cab608e424988a4a6cdb7978721, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:36.903934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066db8f-3c45-4159-ab66-c61a5caf0fb8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:36.926351 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3860/7742] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:36 2022] PUT /identity/v3/projects/b1025650f3234f37af43b40e9d47a6b2/users/c0899cab608e424988a4a6cdb7978721/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:36.930238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad69d9-8930-4d31-9358-14b308b2ee6c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:36.942263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad69d9-8930-4d31-9358-14b308b2ee6c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:36.982924 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:37.096107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123446c8-2d50-4070-bcbf-c40466ce48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:37.096805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123446c8-2d50-4070-bcbf-c40466ce48d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:37.097363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123446c8-2d50-4070-bcbf-c40466ce48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:37.097650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123446c8-2d50-4070-bcbf-c40466ce48d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:37.098321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123446c8-2d50-4070-bcbf-c40466ce48d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:37.100158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123446c8-2d50-4070-bcbf-c40466ce48d9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:37.124875 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3883/7743] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:37.126131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066db8f-3c45-4159-ab66-c61a5caf0fb8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:37.134944 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:37.143601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066db8f-3c45-4159-ab66-c61a5caf0fb8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:37.150354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd2406-81bd-4458-b5ee-b1844d54c5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:37.151958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd2406-81bd-4458-b5ee-b1844d54c5be admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:37.152464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd2406-81bd-4458-b5ee-b1844d54c5be admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:37.153015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd2406-81bd-4458-b5ee-b1844d54c5be admin admin] PATH_INFO: `/v3/projects/b1025650f3234f37af43b40e9d47a6b2/users/c0899cab608e424988a4a6cdb7978721/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:37.156243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd2406-81bd-4458-b5ee-b1844d54c5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1025650f3234f37af43b40e9d47a6b2, user_id=c0899cab608e424988a4a6cdb7978721, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:37.160816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd2406-81bd-4458-b5ee-b1844d54c5be admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:37.174391 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3861/7744] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:37 2022] PUT /identity/v3/projects/b1025650f3234f37af43b40e9d47a6b2/users/c0899cab608e424988a4a6cdb7978721/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:37.186926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703728a-4827-456a-99f6-30c7c8f385b8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:37.187223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703728a-4827-456a-99f6-30c7c8f385b8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:37.187503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703728a-4827-456a-99f6-30c7c8f385b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:37.218531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4703728a-4827-456a-99f6-30c7c8f385b8 None None] MFA Rules not processed for user `c0899cab608e424988a4a6cdb7978721`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:37.219757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4703728a-4827-456a-99f6-30c7c8f385b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:37.323904 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3884/7745] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:37.336361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd2406-81bd-4458-b5ee-b1844d54c5be admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:37.338147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8ebd2406-81bd-4458-b5ee-b1844d54c5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:37.443070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd2406-81bd-4458-b5ee-b1844d54c5be admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:37.449305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b263-ee7a-4fbd-b83d-7cc04d5f527e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:37.450777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b263-ee7a-4fbd-b83d-7cc04d5f527e service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:37.450903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b263-ee7a-4fbd-b83d-7cc04d5f527e service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:37.451135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b263-ee7a-4fbd-b83d-7cc04d5f527e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:37.468548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8b263-ee7a-4fbd-b83d-7cc04d5f527e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:37.471635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8b263-ee7a-4fbd-b83d-7cc04d5f527e service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:37.491716 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3862/7746] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:37.607050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703728a-4827-456a-99f6-30c7c8f385b8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:37.638416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703728a-4827-456a-99f6-30c7c8f385b8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:37.642043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e2dda-3cff-4171-be75-82cb29cc8306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:37.642657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e2dda-3cff-4171-be75-82cb29cc8306 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:37.642937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e2dda-3cff-4171-be75-82cb29cc8306 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:37.643214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e2dda-3cff-4171-be75-82cb29cc8306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:37.706520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e2dda-3cff-4171-be75-82cb29cc8306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:37.707874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e2dda-3cff-4171-be75-82cb29cc8306 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:37.718546 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3885/7747] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:38.355855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b263-ee7a-4fbd-b83d-7cc04d5f527e service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:38.355855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-32a8b263-ee7a-4fbd-b83d-7cc04d5f527e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:38.424832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b263-ee7a-4fbd-b83d-7cc04d5f527e service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:38.430466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:38.431101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:38.431380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:38.431648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] PATH_INFO: `/v3/users/fccb51cb03de4f50a1dd059a30a6c4bb` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:38.433109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=fccb51cb03de4f50a1dd059a30a6c4bb)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:38.435018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:38.484435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fccb51cb03de4f50a1dd059a30a6c4bb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.496834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fccb51cb03de4f50a1dd059a30a6c4bb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.504846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fccb51cb03de4f50a1dd059a30a6c4bb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.513627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fccb51cb03de4f50a1dd059a30a6c4bb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.514327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7b6e76fe-ac50-4bc2-b9ac-48fed2bee4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fccb51cb03de4f50a1dd059a30a6c4bb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.520208 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3863/7748] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:24:38 2022] DELETE /identity/v3/users/fccb51cb03de4f50a1dd059a30a6c4bb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:38.703482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e2dda-3cff-4171-be75-82cb29cc8306 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:38.727155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e2dda-3cff-4171-be75-82cb29cc8306 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:38.775648 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:38.792482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:38.793266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:38.793549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:38.793825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] PATH_INFO: `/v3/projects/8226ea08bb744d9c82b105fde33cc332` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:38.794966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8226ea08bb744d9c82b105fde33cc332)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:38.797035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:38.844708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8226ea08bb744d9c82b105fde33cc332', 'request_id': 'req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.853414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8226ea08bb744d9c82b105fde33cc332', 'request_id': 'req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.860525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8226ea08bb744d9c82b105fde33cc332', 'request_id': 'req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.873051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] The token cache is being invalidate because project 8226ea08bb744d9c82b105fde33cc332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:24:38.873369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.874031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f939b2ee-ec6d-4a06-b24e-59edb138bb7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:38.875570 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3886/7749] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:24:38 2022] DELETE /identity/v3/projects/8226ea08bb744d9c82b105fde33cc332 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:38.880593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afb65e-ccd1-4a15-ab05-08d6dfb8e5b4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:38.881652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afb65e-ccd1-4a15-ab05-08d6dfb8e5b4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:38.882067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afb65e-ccd1-4a15-ab05-08d6dfb8e5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:38.903058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-21afb65e-ccd1-4a15-ab05-08d6dfb8e5b4 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:38.904355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-21afb65e-ccd1-4a15-ab05-08d6dfb8e5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:38.909895 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:38.974234 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3864/7750] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:38.982462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c5bb-6156-43ec-83c3-33cf94bcaf8c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:38.982746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c5bb-6156-43ec-83c3-33cf94bcaf8c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:38.983016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c5bb-6156-43ec-83c3-33cf94bcaf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.003213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fa31c5bb-6156-43ec-83c3-33cf94bcaf8c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:39.004388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fa31c5bb-6156-43ec-83c3-33cf94bcaf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:39.014053 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3887/7751] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:24:39.018674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afb65e-ccd1-4a15-ab05-08d6dfb8e5b4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:39.029489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afb65e-ccd1-4a15-ab05-08d6dfb8e5b4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:39.035379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858e055-1f23-47af-8eb4-099f0fdf2290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:39.035558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858e055-1f23-47af-8eb4-099f0fdf2290 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:39.035893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858e055-1f23-47af-8eb4-099f0fdf2290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:39.036250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858e055-1f23-47af-8eb4-099f0fdf2290 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.037012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858e055-1f23-47af-8eb4-099f0fdf2290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:24:39.037458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858e055-1f23-47af-8eb4-099f0fdf2290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:39.039123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858e055-1f23-47af-8eb4-099f0fdf2290 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:39.053530 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3865/7752] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:24:39.058428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c5bb-6156-43ec-83c3-33cf94bcaf8c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:39.081198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c5bb-6156-43ec-83c3-33cf94bcaf8c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:39.093314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e29d7-6f18-46b6-b95f-1ddef586126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:39.094214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e29d7-6f18-46b6-b95f-1ddef586126b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:39.094586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e29d7-6f18-46b6-b95f-1ddef586126b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:39.095024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e29d7-6f18-46b6-b95f-1ddef586126b admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.095842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e29d7-6f18-46b6-b95f-1ddef586126b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:39.100982 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e29d7-6f18-46b6-b95f-1ddef586126b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:39.145639 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3888/7753] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:24:39 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:24:39.149762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858e055-1f23-47af-8eb4-099f0fdf2290 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:39.161265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858e055-1f23-47af-8eb4-099f0fdf2290 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:39.250017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb47d8-2b04-4911-9f6c-11fa791a7622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:39.250810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb47d8-2b04-4911-9f6c-11fa791a7622 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:39.251100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb47d8-2b04-4911-9f6c-11fa791a7622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:39.251379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb47d8-2b04-4911-9f6c-11fa791a7622 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.252026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb47d8-2b04-4911-9f6c-11fa791a7622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:39.254179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb47d8-2b04-4911-9f6c-11fa791a7622 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:39.290251 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3866/7754] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:24:39 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:24:39.295518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e29d7-6f18-46b6-b95f-1ddef586126b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:39.319637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e29d7-6f18-46b6-b95f-1ddef586126b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:39.327297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a9aa-df2c-4b22-96d8-6d652f6fa906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:39.328079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a9aa-df2c-4b22-96d8-6d652f6fa906 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:39.336523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a9aa-df2c-4b22-96d8-6d652f6fa906 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:39.336523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a9aa-df2c-4b22-96d8-6d652f6fa906 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.336523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40a9aa-df2c-4b22-96d8-6d652f6fa906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:39.336523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40a9aa-df2c-4b22-96d8-6d652f6fa906 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:39.343864 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3889/7755] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:39.347751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb47d8-2b04-4911-9f6c-11fa791a7622 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:39.358605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb47d8-2b04-4911-9f6c-11fa791a7622 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:39.363878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa895f-9a09-4a2d-8b14-732a22f96b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:39.364570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa895f-9a09-4a2d-8b14-732a22f96b8e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:39.364962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa895f-9a09-4a2d-8b14-732a22f96b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:39.365886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa895f-9a09-4a2d-8b14-732a22f96b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.366708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa895f-9a09-4a2d-8b14-732a22f96b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:39.368394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa895f-9a09-4a2d-8b14-732a22f96b8e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:39.380456 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3867/7756] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:24:39.385292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a9aa-df2c-4b22-96d8-6d652f6fa906 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:39.396823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a9aa-df2c-4b22-96d8-6d652f6fa906 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:39.402153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa75050-5b13-4abe-aa1e-b663971f8dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:39.403006 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa75050-5b13-4abe-aa1e-b663971f8dea admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:39.403310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa75050-5b13-4abe-aa1e-b663971f8dea admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:39.403714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa75050-5b13-4abe-aa1e-b663971f8dea admin admin] PATH_INFO: `/v3/projects/b78f9f6c05124b8ebf03595244c9320c/users/9885f8a436684a0392e63b784cbe84fd/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.423027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa75050-5b13-4abe-aa1e-b663971f8dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78f9f6c05124b8ebf03595244c9320c, user_id=9885f8a436684a0392e63b784cbe84fd, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:39.426045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa75050-5b13-4abe-aa1e-b663971f8dea admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:39.444702 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3890/7757] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:39 2022] PUT /identity/v3/projects/b78f9f6c05124b8ebf03595244c9320c/users/9885f8a436684a0392e63b784cbe84fd/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:39.454469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282fb10-f467-4a99-bc48-c03b5aebf8b6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:39.454808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282fb10-f467-4a99-bc48-c03b5aebf8b6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:39.455078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282fb10-f467-4a99-bc48-c03b5aebf8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.489664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c282fb10-f467-4a99-bc48-c03b5aebf8b6 None None] MFA Rules not processed for user `9885f8a436684a0392e63b784cbe84fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:39.491715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c282fb10-f467-4a99-bc48-c03b5aebf8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:39.564583 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3868/7758] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:39.575422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bbf3a-edb9-4527-92cf-2a19fcf9fcae None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:39.575650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bbf3a-edb9-4527-92cf-2a19fcf9fcae None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:39.576019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bbf3a-edb9-4527-92cf-2a19fcf9fcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.597762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-258bbf3a-edb9-4527-92cf-2a19fcf9fcae None None] MFA Rules not processed for user `9885f8a436684a0392e63b784cbe84fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:39.599087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-258bbf3a-edb9-4527-92cf-2a19fcf9fcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:39.611033 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3891/7759] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:39.622916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282fb10-f467-4a99-bc48-c03b5aebf8b6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:39.625221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c282fb10-f467-4a99-bc48-c03b5aebf8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:39.638232 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:39.729529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282fb10-f467-4a99-bc48-c03b5aebf8b6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:39.737903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba88b-8348-418e-b6b0-3b364b797b09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:39.738561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba88b-8348-418e-b6b0-3b364b797b09 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:39.738847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba88b-8348-418e-b6b0-3b364b797b09 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:39.739125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba88b-8348-418e-b6b0-3b364b797b09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:39.748228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dba88b-8348-418e-b6b0-3b364b797b09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:39.750210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dba88b-8348-418e-b6b0-3b364b797b09 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:39.762058 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3869/7760] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:24:40.073711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9da96a-8743-4287-b797-b8d168085616 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:40.074927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9da96a-8743-4287-b797-b8d168085616 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:40.075509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9da96a-8743-4287-b797-b8d168085616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:40.102072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3e9da96a-8743-4287-b797-b8d168085616 None None] MFA Rules not processed for user `9885f8a436684a0392e63b784cbe84fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:40.104031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3e9da96a-8743-4287-b797-b8d168085616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:40.116973 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3892/7761] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:43.522581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e6446-562e-4ea0-a5a9-568ac5f71bb9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:43.523213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e6446-562e-4ea0-a5a9-568ac5f71bb9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:43.523605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e6446-562e-4ea0-a5a9-568ac5f71bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:43.546134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-555e6446-562e-4ea0-a5a9-568ac5f71bb9 None None] MFA Rules not processed for user `25a73a5fe5644dac874ce5d3e2558566`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:43.547465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-555e6446-562e-4ea0-a5a9-568ac5f71bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:43.607214 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3870/7762] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:43.866237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9da96a-8743-4287-b797-b8d168085616 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:43.867734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3e9da96a-8743-4287-b797-b8d168085616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:43.941264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9da96a-8743-4287-b797-b8d168085616 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:43.945669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cfa8f-2bd9-464f-9bbc-0e07b3fe3890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:43.946291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cfa8f-2bd9-464f-9bbc-0e07b3fe3890 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:43.946577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cfa8f-2bd9-464f-9bbc-0e07b3fe3890 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:43.946858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cfa8f-2bd9-464f-9bbc-0e07b3fe3890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:43.948606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-220cfa8f-2bd9-464f-9bbc-0e07b3fe3890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:43.962723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cfa8f-2bd9-464f-9bbc-0e07b3fe3890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:43.964178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cfa8f-2bd9-464f-9bbc-0e07b3fe3890 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:43.971174 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:43.979144 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3893/7763] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:53.600937 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=56 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:57.945908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e6446-562e-4ea0-a5a9-568ac5f71bb9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:57.948056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-555e6446-562e-4ea0-a5a9-568ac5f71bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:58.050127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e6446-562e-4ea0-a5a9-568ac5f71bb9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:58.061500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:58.062487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:58.062810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:58.063096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] PATH_INFO: `/v3/users/655b2cadefac4874bf5a089b845cf0c8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:58.064702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=655b2cadefac4874bf5a089b845cf0c8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:58.079724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:58.131409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655b2cadefac4874bf5a089b845cf0c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.154345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655b2cadefac4874bf5a089b845cf0c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.168743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655b2cadefac4874bf5a089b845cf0c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.181005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655b2cadefac4874bf5a089b845cf0c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.182343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655b2cadefac4874bf5a089b845cf0c8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.196264 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3871/7764] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:24:57 2022] DELETE /identity/v3/users/655b2cadefac4874bf5a089b845cf0c8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:58.200552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000cdc4-3294-4b01-ba28-36bcc9bc00fb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:58.201741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000cdc4-3294-4b01-ba28-36bcc9bc00fb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:58.202189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000cdc4-3294-4b01-ba28-36bcc9bc00fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:58.227709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0000cdc4-3294-4b01-ba28-36bcc9bc00fb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:58.228989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0000cdc4-3294-4b01-ba28-36bcc9bc00fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:58.301948 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3894/7765] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:58.309845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:58.311404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:58.382158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f077e-a919-4de2-b244-70de88580b4d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:58.389225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8bb0d-4550-48c6-b0e5-186b81c235de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:58.389935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8bb0d-4550-48c6-b0e5-186b81c235de service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:58.390359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8bb0d-4550-48c6-b0e5-186b81c235de service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:58.390708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8bb0d-4550-48c6-b0e5-186b81c235de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:58.402800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8bb0d-4550-48c6-b0e5-186b81c235de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:58.404397 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8bb0d-4550-48c6-b0e5-186b81c235de service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:58.420928 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3872/7766] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:24:58.761114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000cdc4-3294-4b01-ba28-36bcc9bc00fb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:58.763030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0000cdc4-3294-4b01-ba28-36bcc9bc00fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:58.783322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000cdc4-3294-4b01-ba28-36bcc9bc00fb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:58.791261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:58.791924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:58.792243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:58.792417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] PATH_INFO: `/v3/projects/5f2d9ba4b6e54efcb71cd4c1fd749bf3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:58.793600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2d9ba4b6e54efcb71cd4c1fd749bf3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:58.795549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:58.851931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2d9ba4b6e54efcb71cd4c1fd749bf3', 'request_id': 'req-11432a27-183e-47f9-b394-5dbc9ad167a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.859710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2d9ba4b6e54efcb71cd4c1fd749bf3', 'request_id': 'req-11432a27-183e-47f9-b394-5dbc9ad167a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.866057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2d9ba4b6e54efcb71cd4c1fd749bf3', 'request_id': 'req-11432a27-183e-47f9-b394-5dbc9ad167a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.877955 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] The token cache is being invalidate because project 5f2d9ba4b6e54efcb71cd4c1fd749bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:24:58.878240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.878900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:58.880996 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3895/7767] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:24:58 2022] DELETE /identity/v3/projects/5f2d9ba4b6e54efcb71cd4c1fd749bf3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:58.885318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8bb0d-4550-48c6-b0e5-186b81c235de service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:58.897051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8bb0d-4550-48c6-b0e5-186b81c235de service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:58.916893 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:58.960691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:58.961392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:58.961616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:58.961968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] PATH_INFO: `/v3/users/c0899cab608e424988a4a6cdb7978721` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:58.963135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0899cab608e424988a4a6cdb7978721)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:58.965122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:59.015601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0899cab608e424988a4a6cdb7978721'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.031258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0899cab608e424988a4a6cdb7978721'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.039989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0899cab608e424988a4a6cdb7978721'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.054389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0899cab608e424988a4a6cdb7978721'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.055362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8b3478a6-a530-4002-936c-7bc0c1f41af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0899cab608e424988a4a6cdb7978721'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.062244 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3873/7768] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:24:58 2022] DELETE /identity/v3/users/c0899cab608e424988a4a6cdb7978721 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:24:59.372366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:59.374035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:59.391865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11432a27-183e-47f9-b394-5dbc9ad167a4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:59.456872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:59.457518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:59.458124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:59.458941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] PATH_INFO: `/v3/projects/b1025650f3234f37af43b40e9d47a6b2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:59.460455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1025650f3234f37af43b40e9d47a6b2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:59.462738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:59.494592 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:59.519046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1025650f3234f37af43b40e9d47a6b2', 'request_id': 'req-6f0d9675-d11e-4eba-a384-2bbae610e47e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.529142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1025650f3234f37af43b40e9d47a6b2', 'request_id': 'req-6f0d9675-d11e-4eba-a384-2bbae610e47e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.534913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1025650f3234f37af43b40e9d47a6b2', 'request_id': 'req-6f0d9675-d11e-4eba-a384-2bbae610e47e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.547771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] The token cache is being invalidate because project b1025650f3234f37af43b40e9d47a6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:24:59.547771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.547771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6f0d9675-d11e-4eba-a384-2bbae610e47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:24:59.548961 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3896/7769] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:24:59 2022] DELETE /identity/v3/projects/b1025650f3234f37af43b40e9d47a6b2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:24:59.554002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba8f2-04a2-4469-98ca-436576659134 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:59.554292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba8f2-04a2-4469-98ca-436576659134 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:59.554574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba8f2-04a2-4469-98ca-436576659134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:59.575315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-12cba8f2-04a2-4469-98ca-436576659134 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:59.576553 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-12cba8f2-04a2-4469-98ca-436576659134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:59.642570 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3874/7770] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:59.651162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43804d-fc12-4807-91d7-cc47682d9aa7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:59.651449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43804d-fc12-4807-91d7-cc47682d9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:59.651725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43804d-fc12-4807-91d7-cc47682d9aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:59.672389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8f43804d-fc12-4807-91d7-cc47682d9aa7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:24:59.673755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8f43804d-fc12-4807-91d7-cc47682d9aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:24:59.682260 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3897/7771] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:24:59.686504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba8f2-04a2-4469-98ca-436576659134 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:59.697089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba8f2-04a2-4469-98ca-436576659134 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:59.701890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c86c-7353-48dd-b5da-c683018e1776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:59.702537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c86c-7353-48dd-b5da-c683018e1776 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:59.702828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c86c-7353-48dd-b5da-c683018e1776 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:59.703108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c86c-7353-48dd-b5da-c683018e1776 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:59.703764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c86c-7353-48dd-b5da-c683018e1776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:24:59.704070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c86c-7353-48dd-b5da-c683018e1776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:59.705730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c86c-7353-48dd-b5da-c683018e1776 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:59.719775 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3875/7772] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:24:59.724235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43804d-fc12-4807-91d7-cc47682d9aa7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:59.733903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43804d-fc12-4807-91d7-cc47682d9aa7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:59.738574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fecab0-19b1-49cb-9e8f-642e6139b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:59.739176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fecab0-19b1-49cb-9e8f-642e6139b1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:59.739615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fecab0-19b1-49cb-9e8f-642e6139b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:59.739901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fecab0-19b1-49cb-9e8f-642e6139b1d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:59.740638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fecab0-19b1-49cb-9e8f-642e6139b1d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:59.742545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fecab0-19b1-49cb-9e8f-642e6139b1d3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:59.776431 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3898/7773] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:24:59 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:24:59.777793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c86c-7353-48dd-b5da-c683018e1776 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:59.788261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c86c-7353-48dd-b5da-c683018e1776 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:59.815948 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:59.853494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95c3f7-4b4e-4620-9b21-0b572326d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:59.854104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95c3f7-4b4e-4620-9b21-0b572326d2ea admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:59.854382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95c3f7-4b4e-4620-9b21-0b572326d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:59.854656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95c3f7-4b4e-4620-9b21-0b572326d2ea admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:59.855284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95c3f7-4b4e-4620-9b21-0b572326d2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:59.857242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95c3f7-4b4e-4620-9b21-0b572326d2ea admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:59.880382 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3876/7774] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:24:59 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:24:59.884486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fecab0-19b1-49cb-9e8f-642e6139b1d3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:59.896323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fecab0-19b1-49cb-9e8f-642e6139b1d3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:59.901184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93a487-0bb9-44b6-ae0e-6c0eb106ed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:59.901834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93a487-0bb9-44b6-ae0e-6c0eb106ed68 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:59.902115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93a487-0bb9-44b6-ae0e-6c0eb106ed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:59.902396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93a487-0bb9-44b6-ae0e-6c0eb106ed68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:59.903039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93a487-0bb9-44b6-ae0e-6c0eb106ed68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:59.904656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93a487-0bb9-44b6-ae0e-6c0eb106ed68 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:59.918791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3899/7775] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:59.920112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95c3f7-4b4e-4620-9b21-0b572326d2ea admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:59.931248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95c3f7-4b4e-4620-9b21-0b572326d2ea admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:59.937754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7153f-df57-4797-9cab-1af089a4faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:59.938452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7153f-df57-4797-9cab-1af089a4faba admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:59.938734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7153f-df57-4797-9cab-1af089a4faba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:59.939010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7153f-df57-4797-9cab-1af089a4faba admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:59.939678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7153f-df57-4797-9cab-1af089a4faba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:59.941348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7153f-df57-4797-9cab-1af089a4faba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:24:59.959425 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3877/7776] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:24:59.960700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93a487-0bb9-44b6-ae0e-6c0eb106ed68 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:24:59.971381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93a487-0bb9-44b6-ae0e-6c0eb106ed68 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:24:59.978281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191aad1c-c805-4949-8e5b-6d2a329e57cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:24:59.978965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aad1c-c805-4949-8e5b-6d2a329e57cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:24:59.979246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aad1c-c805-4949-8e5b-6d2a329e57cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:24:59.979529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aad1c-c805-4949-8e5b-6d2a329e57cb admin admin] PATH_INFO: `/v3/projects/a5c5d86bfca9428688a6d5fe0aefada7/users/41ae414c4b99429a9b28ad11f040b50c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:24:59.995764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191aad1c-c805-4949-8e5b-6d2a329e57cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c5d86bfca9428688a6d5fe0aefada7, user_id=41ae414c4b99429a9b28ad11f040b50c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:24:59.998506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191aad1c-c805-4949-8e5b-6d2a329e57cb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:00.012269 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3900/7777] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:24:59 2022] PUT /identity/v3/projects/a5c5d86bfca9428688a6d5fe0aefada7/users/41ae414c4b99429a9b28ad11f040b50c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:00.115593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77986724-7c22-4772-8423-e6a20bd3fcb1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:00.116132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77986724-7c22-4772-8423-e6a20bd3fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:00.116132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77986724-7c22-4772-8423-e6a20bd3fcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:00.144715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-77986724-7c22-4772-8423-e6a20bd3fcb1 None None] MFA Rules not processed for user `41ae414c4b99429a9b28ad11f040b50c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:00.146273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-77986724-7c22-4772-8423-e6a20bd3fcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:00.227297 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3878/7778] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:00.231699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191aad1c-c805-4949-8e5b-6d2a329e57cb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:00.298034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191aad1c-c805-4949-8e5b-6d2a329e57cb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:00.303434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3834eb4-1414-465d-a603-91da8efe4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:00.304050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3834eb4-1414-465d-a603-91da8efe4ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:00.304333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3834eb4-1414-465d-a603-91da8efe4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:00.304612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3834eb4-1414-465d-a603-91da8efe4ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:00.305283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3834eb4-1414-465d-a603-91da8efe4ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:00.307471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3834eb4-1414-465d-a603-91da8efe4ab7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:00.336651 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3901/7779] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:25:00 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:25:00.339518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77986724-7c22-4772-8423-e6a20bd3fcb1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:00.351683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77986724-7c22-4772-8423-e6a20bd3fcb1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:00.425812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa36db-6c50-4eed-aa8a-38f9c8a4c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:00.425812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa36db-6c50-4eed-aa8a-38f9c8a4c2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:00.425812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa36db-6c50-4eed-aa8a-38f9c8a4c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:00.425812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa36db-6c50-4eed-aa8a-38f9c8a4c2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:00.426252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa36db-6c50-4eed-aa8a-38f9c8a4c2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:00.429040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa36db-6c50-4eed-aa8a-38f9c8a4c2f3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:00.453836 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3879/7780] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:25:00 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:25:00.457349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3834eb4-1414-465d-a603-91da8efe4ab7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:00.486873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3834eb4-1414-465d-a603-91da8efe4ab7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:00.491862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8600b7-6400-4158-939c-4196fd64990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:00.492501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8600b7-6400-4158-939c-4196fd64990c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:00.492814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8600b7-6400-4158-939c-4196fd64990c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:00.493093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8600b7-6400-4158-939c-4196fd64990c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:00.493736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8600b7-6400-4158-939c-4196fd64990c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:00.495448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8600b7-6400-4158-939c-4196fd64990c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:00.510862 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3902/7781] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:25:00.515067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa36db-6c50-4eed-aa8a-38f9c8a4c2f3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:00.526340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa36db-6c50-4eed-aa8a-38f9c8a4c2f3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:00.531279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306d5fe-49c0-40ef-982f-fa41aadb5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:00.531942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306d5fe-49c0-40ef-982f-fa41aadb5ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:00.532219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306d5fe-49c0-40ef-982f-fa41aadb5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:00.532493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306d5fe-49c0-40ef-982f-fa41aadb5ae8 admin admin] PATH_INFO: `/v3/projects/379d0a14fbfa4498bb55f4c8b738917b/users/a1486087030e41d6917687155630b910/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:00.550129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306d5fe-49c0-40ef-982f-fa41aadb5ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379d0a14fbfa4498bb55f4c8b738917b, user_id=a1486087030e41d6917687155630b910, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:00.553776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306d5fe-49c0-40ef-982f-fa41aadb5ae8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:00.570310 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3880/7782] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:25:00 2022] PUT /identity/v3/projects/379d0a14fbfa4498bb55f4c8b738917b/users/a1486087030e41d6917687155630b910/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:00.574364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8600b7-6400-4158-939c-4196fd64990c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:00.585067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8600b7-6400-4158-939c-4196fd64990c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:00.609880 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:00.653110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69649fb7-4e7a-4de1-90d2-423b32599552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:00.653736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69649fb7-4e7a-4de1-90d2-423b32599552 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:00.654019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69649fb7-4e7a-4de1-90d2-423b32599552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:00.654294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69649fb7-4e7a-4de1-90d2-423b32599552 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:00.654941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69649fb7-4e7a-4de1-90d2-423b32599552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:00.656561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69649fb7-4e7a-4de1-90d2-423b32599552 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:00.670597 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3903/7783] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:25:00.671998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306d5fe-49c0-40ef-982f-fa41aadb5ae8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:00.678841 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:00.685918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306d5fe-49c0-40ef-982f-fa41aadb5ae8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:00.690992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7ecab-3902-4dc4-a9ff-a9fcd326f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:00.691655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7ecab-3902-4dc4-a9ff-a9fcd326f561 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:00.691936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7ecab-3902-4dc4-a9ff-a9fcd326f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:00.692215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7ecab-3902-4dc4-a9ff-a9fcd326f561 admin admin] PATH_INFO: `/v3/projects/379d0a14fbfa4498bb55f4c8b738917b/users/a1486087030e41d6917687155630b910/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:00.694362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7ecab-3902-4dc4-a9ff-a9fcd326f561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379d0a14fbfa4498bb55f4c8b738917b, user_id=a1486087030e41d6917687155630b910, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:00.697055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7ecab-3902-4dc4-a9ff-a9fcd326f561 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:00.707773 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3881/7784] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:25:00 2022] PUT /identity/v3/projects/379d0a14fbfa4498bb55f4c8b738917b/users/a1486087030e41d6917687155630b910/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:00.718655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2688d51-8846-4ef3-b78e-0ec255f7d20a None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:00.718944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2688d51-8846-4ef3-b78e-0ec255f7d20a None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:00.719221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2688d51-8846-4ef3-b78e-0ec255f7d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:00.750867 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f2688d51-8846-4ef3-b78e-0ec255f7d20a None None] MFA Rules not processed for user `a1486087030e41d6917687155630b910`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:00.752100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f2688d51-8846-4ef3-b78e-0ec255f7d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:00.827913 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3904/7785] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:00.839512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7ecab-3902-4dc4-a9ff-a9fcd326f561 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:00.841254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e6c7ecab-3902-4dc4-a9ff-a9fcd326f561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:00.907143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7ecab-3902-4dc4-a9ff-a9fcd326f561 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:00.910907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf788d0f-82a2-48de-9424-2d8165ea8174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:00.912115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf788d0f-82a2-48de-9424-2d8165ea8174 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:00.912391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf788d0f-82a2-48de-9424-2d8165ea8174 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:00.912703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf788d0f-82a2-48de-9424-2d8165ea8174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:00.923567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf788d0f-82a2-48de-9424-2d8165ea8174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:00.925084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf788d0f-82a2-48de-9424-2d8165ea8174 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:00.936151 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3882/7786] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:01.083754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2688d51-8846-4ef3-b78e-0ec255f7d20a None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:01.153294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2688d51-8846-4ef3-b78e-0ec255f7d20a None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:01.157943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:01.158581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:01.158865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:01.159145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] PATH_INFO: `/v3/users/41ae414c4b99429a9b28ad11f040b50c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:01.160371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ae414c4b99429a9b28ad11f040b50c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:01.162971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:01.214523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ae414c4b99429a9b28ad11f040b50c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.215636 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:01.232727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ae414c4b99429a9b28ad11f040b50c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.242727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ae414c4b99429a9b28ad11f040b50c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.252945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ae414c4b99429a9b28ad11f040b50c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.252945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ae414c4b99429a9b28ad11f040b50c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.259407 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3905/7787] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:25:01 2022] DELETE /identity/v3/users/41ae414c4b99429a9b28ad11f040b50c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:01.266226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c286f8-25ef-495b-ba4c-987898195cc2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:01.266710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c286f8-25ef-495b-ba4c-987898195cc2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:01.266833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c286f8-25ef-495b-ba4c-987898195cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:01.290839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a1c286f8-25ef-495b-ba4c-987898195cc2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:01.292068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a1c286f8-25ef-495b-ba4c-987898195cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:01.359237 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3883/7788] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:01.372441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:01.374043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:01.441453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3c0c3-8b6e-4a54-ac07-8c1035909151 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:01.446497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aee90-d71e-4704-ba6e-4ab50e7b8248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:01.448197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aee90-d71e-4704-ba6e-4ab50e7b8248 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:01.448486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aee90-d71e-4704-ba6e-4ab50e7b8248 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:01.448789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aee90-d71e-4704-ba6e-4ab50e7b8248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:01.459036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7aee90-d71e-4704-ba6e-4ab50e7b8248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:01.460648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7aee90-d71e-4704-ba6e-4ab50e7b8248 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:01.471669 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3906/7789] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:25:01.773429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c286f8-25ef-495b-ba4c-987898195cc2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:01.778532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a1c286f8-25ef-495b-ba4c-987898195cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:01.793182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c286f8-25ef-495b-ba4c-987898195cc2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:01.799674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:01.800388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:01.800588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:01.800892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] PATH_INFO: `/v3/projects/a5c5d86bfca9428688a6d5fe0aefada7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:01.803236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c5d86bfca9428688a6d5fe0aefada7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:01.805280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:01.860909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c5d86bfca9428688a6d5fe0aefada7', 'request_id': 'req-8ea6a0ca-b60d-425c-ab86-8cca205d204f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.869745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c5d86bfca9428688a6d5fe0aefada7', 'request_id': 'req-8ea6a0ca-b60d-425c-ab86-8cca205d204f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.879026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c5d86bfca9428688a6d5fe0aefada7', 'request_id': 'req-8ea6a0ca-b60d-425c-ab86-8cca205d204f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.890762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] The token cache is being invalidate because project a5c5d86bfca9428688a6d5fe0aefada7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:25:01.891055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.891719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:01.893288 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3884/7790] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:25:01 2022] DELETE /identity/v3/projects/a5c5d86bfca9428688a6d5fe0aefada7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:01.897356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aee90-d71e-4704-ba6e-4ab50e7b8248 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:01.907112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aee90-d71e-4704-ba6e-4ab50e7b8248 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:01.970568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:01.971214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:01.971854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:01.972144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] PATH_INFO: `/v3/users/a1486087030e41d6917687155630b910` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:01.974137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1486087030e41d6917687155630b910)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:01.977185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:02.029753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1486087030e41d6917687155630b910'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.043336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1486087030e41d6917687155630b910'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.051706 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:02.052927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1486087030e41d6917687155630b910'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.062417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1486087030e41d6917687155630b910'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.063150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a5aaabb1-4b3a-458a-a0e6-35c908eedd42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1486087030e41d6917687155630b910'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.069656 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3907/7791] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:25:01 2022] DELETE /identity/v3/users/a1486087030e41d6917687155630b910 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:25:02.371525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:02.373051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:02.399932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6a0ca-b60d-425c-ab86-8cca205d204f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:02.415423 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:02.471084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:02.472009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:02.472291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:02.472598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] PATH_INFO: `/v3/projects/379d0a14fbfa4498bb55f4c8b738917b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:02.475994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=379d0a14fbfa4498bb55f4c8b738917b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:02.476219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:02.531622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379d0a14fbfa4498bb55f4c8b738917b', 'request_id': 'req-bc645810-be4b-47db-baa1-259bf5cac06f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.539475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379d0a14fbfa4498bb55f4c8b738917b', 'request_id': 'req-bc645810-be4b-47db-baa1-259bf5cac06f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.546199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379d0a14fbfa4498bb55f4c8b738917b', 'request_id': 'req-bc645810-be4b-47db-baa1-259bf5cac06f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.559877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] The token cache is being invalidate because project 379d0a14fbfa4498bb55f4c8b738917b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:25:02.560283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.561304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bc645810-be4b-47db-baa1-259bf5cac06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:02.563249 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3885/7792] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:25:02 2022] DELETE /identity/v3/projects/379d0a14fbfa4498bb55f4c8b738917b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:02.568882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af453461-73a3-4ce8-968b-f5e2fd3f2f65 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:02.569386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af453461-73a3-4ce8-968b-f5e2fd3f2f65 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:02.569540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af453461-73a3-4ce8-968b-f5e2fd3f2f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:02.591971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-af453461-73a3-4ce8-968b-f5e2fd3f2f65 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:02.593416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-af453461-73a3-4ce8-968b-f5e2fd3f2f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:02.678258 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3908/7793] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:25:02.688955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a91fd7-9f0f-46cd-9b2b-ea72e6da792a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:02.689597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a91fd7-9f0f-46cd-9b2b-ea72e6da792a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:02.691111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a91fd7-9f0f-46cd-9b2b-ea72e6da792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:02.723725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b8a91fd7-9f0f-46cd-9b2b-ea72e6da792a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:02.725062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b8a91fd7-9f0f-46cd-9b2b-ea72e6da792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:02.734451 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3886/7794] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:02.738522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af453461-73a3-4ce8-968b-f5e2fd3f2f65 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:02.751647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af453461-73a3-4ce8-968b-f5e2fd3f2f65 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:02.757979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600c716-f940-4fda-b7e8-cb809f7f5b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:02.758755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600c716-f940-4fda-b7e8-cb809f7f5b66 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:02.759033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600c716-f940-4fda-b7e8-cb809f7f5b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:02.759306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600c716-f940-4fda-b7e8-cb809f7f5b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:02.759953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600c716-f940-4fda-b7e8-cb809f7f5b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:25:02.760252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600c716-f940-4fda-b7e8-cb809f7f5b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:02.761965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600c716-f940-4fda-b7e8-cb809f7f5b66 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:02.780183 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3909/7795] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:25:02.781420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a91fd7-9f0f-46cd-9b2b-ea72e6da792a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:02.791914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a91fd7-9f0f-46cd-9b2b-ea72e6da792a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:02.803329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b1646-2b4f-4545-9755-531ff67bced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:02.804257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b1646-2b4f-4545-9755-531ff67bced2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:02.804640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b1646-2b4f-4545-9755-531ff67bced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:02.805213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b1646-2b4f-4545-9755-531ff67bced2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:02.805876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b1646-2b4f-4545-9755-531ff67bced2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:02.809176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b1646-2b4f-4545-9755-531ff67bced2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:02.842298 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3887/7796] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:25:02 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:25:02.846701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600c716-f940-4fda-b7e8-cb809f7f5b66 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:02.857708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600c716-f940-4fda-b7e8-cb809f7f5b66 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:02.935801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea21cd9-4caa-45a5-8af0-246c33d400fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:02.938145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea21cd9-4caa-45a5-8af0-246c33d400fb admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:02.938145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea21cd9-4caa-45a5-8af0-246c33d400fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:02.938145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea21cd9-4caa-45a5-8af0-246c33d400fb admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:02.938145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea21cd9-4caa-45a5-8af0-246c33d400fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:02.940216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea21cd9-4caa-45a5-8af0-246c33d400fb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:02.965878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b1646-2b4f-4545-9755-531ff67bced2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:02.967720 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3910/7797] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:25:02 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:25:02.969390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8b9b1646-2b4f-4545-9755-531ff67bced2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:02.972110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea21cd9-4caa-45a5-8af0-246c33d400fb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:02.986258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea21cd9-4caa-45a5-8af0-246c33d400fb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:02.992902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a60c6-ab61-48b6-9fe8-19acc74e15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:02.995264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a60c6-ab61-48b6-9fe8-19acc74e15dd admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:02.995264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a60c6-ab61-48b6-9fe8-19acc74e15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:02.995264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a60c6-ab61-48b6-9fe8-19acc74e15dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:02.995264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a60c6-ab61-48b6-9fe8-19acc74e15dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:02.996484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a60c6-ab61-48b6-9fe8-19acc74e15dd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.012726 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3911/7798] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:25:03.013650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a60c6-ab61-48b6-9fe8-19acc74e15dd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:03.024528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a60c6-ab61-48b6-9fe8-19acc74e15dd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:03.031683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdeac2-5260-4492-b8f3-53a544991f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:03.032309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdeac2-5260-4492-b8f3-53a544991f94 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.032589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdeac2-5260-4492-b8f3-53a544991f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.032895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdeac2-5260-4492-b8f3-53a544991f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.033686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdeac2-5260-4492-b8f3-53a544991f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:03.035288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdeac2-5260-4492-b8f3-53a544991f94 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.044322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b1646-2b4f-4545-9755-531ff67bced2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:03.047638 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3912/7799] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:25:03.048536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112acec-6f87-4979-ad07-01137cde345a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:03.049202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112acec-6f87-4979-ad07-01137cde345a service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.049487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112acec-6f87-4979-ad07-01137cde345a service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.049766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112acec-6f87-4979-ad07-01137cde345a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.051902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdeac2-5260-4492-b8f3-53a544991f94 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:03.052736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7112acec-6f87-4979-ad07-01137cde345a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:03.066010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdeac2-5260-4492-b8f3-53a544991f94 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:03.067170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112acec-6f87-4979-ad07-01137cde345a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:03.068923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112acec-6f87-4979-ad07-01137cde345a service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.076340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c709de2-a1e7-478d-b52b-0b86977a8258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:03.077560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c709de2-a1e7-478d-b52b-0b86977a8258 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.077920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c709de2-a1e7-478d-b52b-0b86977a8258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.078266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c709de2-a1e7-478d-b52b-0b86977a8258 admin admin] PATH_INFO: `/v3/projects/a6f3ef4eea0449d9af3ac1eb45987b75/users/4a385e594e93422fb988cce3c12719a2/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.092904 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3888/7800] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:03.107526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c709de2-a1e7-478d-b52b-0b86977a8258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f3ef4eea0449d9af3ac1eb45987b75, user_id=4a385e594e93422fb988cce3c12719a2, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:03.111624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c709de2-a1e7-478d-b52b-0b86977a8258 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.128278 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3913/7801] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:25:03 2022] PUT /identity/v3/projects/a6f3ef4eea0449d9af3ac1eb45987b75/users/4a385e594e93422fb988cce3c12719a2/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:03.139719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b269ce-8e18-425e-b430-50722f13f056 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.140012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b269ce-8e18-425e-b430-50722f13f056 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.140297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b269ce-8e18-425e-b430-50722f13f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.181649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d3b269ce-8e18-425e-b430-50722f13f056 None None] MFA Rules not processed for user `4a385e594e93422fb988cce3c12719a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:03.183731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d3b269ce-8e18-425e-b430-50722f13f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:03.195774 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:03.273268 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3889/7802] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:03.277819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c709de2-a1e7-478d-b52b-0b86977a8258 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:03.303164 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:03.372282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c709de2-a1e7-478d-b52b-0b86977a8258 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:03.377437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48536498-49cc-4ef4-996d-ba72490f3e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:03.378064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536498-49cc-4ef4-996d-ba72490f3e8f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.378349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536498-49cc-4ef4-996d-ba72490f3e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.378635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536498-49cc-4ef4-996d-ba72490f3e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.379276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48536498-49cc-4ef4-996d-ba72490f3e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:03.381994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48536498-49cc-4ef4-996d-ba72490f3e8f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.414847 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3914/7803] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:25:03 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:25:03.415838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b269ce-8e18-425e-b430-50722f13f056 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:03.434511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b269ce-8e18-425e-b430-50722f13f056 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:03.510686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50272016-9e8a-46f3-b7c7-1c410fb032a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:03.511480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272016-9e8a-46f3-b7c7-1c410fb032a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.511760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272016-9e8a-46f3-b7c7-1c410fb032a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.512129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272016-9e8a-46f3-b7c7-1c410fb032a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.512698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50272016-9e8a-46f3-b7c7-1c410fb032a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:03.514669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50272016-9e8a-46f3-b7c7-1c410fb032a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.540664 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3890/7804] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:25:03 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:25:03.544398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48536498-49cc-4ef4-996d-ba72490f3e8f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:03.557097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48536498-49cc-4ef4-996d-ba72490f3e8f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:03.562388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34c4a7-3e80-4eaa-83a0-703e66c2a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:03.563059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34c4a7-3e80-4eaa-83a0-703e66c2a071 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.563345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34c4a7-3e80-4eaa-83a0-703e66c2a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.563649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34c4a7-3e80-4eaa-83a0-703e66c2a071 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.564315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34c4a7-3e80-4eaa-83a0-703e66c2a071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:03.565974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34c4a7-3e80-4eaa-83a0-703e66c2a071 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.579781 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3915/7805] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:25:03.584203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50272016-9e8a-46f3-b7c7-1c410fb032a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:03.597023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50272016-9e8a-46f3-b7c7-1c410fb032a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:03.602238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c19677-2eb7-4884-af20-8618128d2642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:03.602921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c19677-2eb7-4884-af20-8618128d2642 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.603231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c19677-2eb7-4884-af20-8618128d2642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.603517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c19677-2eb7-4884-af20-8618128d2642 admin admin] PATH_INFO: `/v3/projects/644ed2673c7645748c7d12e3ce90e972/users/3bca945dad8c44d6b0029734c65498c0/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.622777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c19677-2eb7-4884-af20-8618128d2642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644ed2673c7645748c7d12e3ce90e972, user_id=3bca945dad8c44d6b0029734c65498c0, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:03.625523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c19677-2eb7-4884-af20-8618128d2642 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.642219 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3891/7806] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:25:03 2022] PUT /identity/v3/projects/644ed2673c7645748c7d12e3ce90e972/users/3bca945dad8c44d6b0029734c65498c0/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:03.646220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34c4a7-3e80-4eaa-83a0-703e66c2a071 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:03.657218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34c4a7-3e80-4eaa-83a0-703e66c2a071 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:03.728862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f46b0-6dff-4998-849f-279d8dc7f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:03.729488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f46b0-6dff-4998-849f-279d8dc7f187 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.729768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f46b0-6dff-4998-849f-279d8dc7f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.730040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f46b0-6dff-4998-849f-279d8dc7f187 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.730936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f46b0-6dff-4998-849f-279d8dc7f187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:03.732846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f46b0-6dff-4998-849f-279d8dc7f187 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.752832 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3916/7807] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:25:03.755179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c19677-2eb7-4884-af20-8618128d2642 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:03.767413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c19677-2eb7-4884-af20-8618128d2642 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:03.775362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b489c-6f64-4bc8-a8df-3a4ad6f90f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:03.776065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b489c-6f64-4bc8-a8df-3a4ad6f90f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.776347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b489c-6f64-4bc8-a8df-3a4ad6f90f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.776661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b489c-6f64-4bc8-a8df-3a4ad6f90f8f admin admin] PATH_INFO: `/v3/projects/644ed2673c7645748c7d12e3ce90e972/users/3bca945dad8c44d6b0029734c65498c0/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.778652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b489c-6f64-4bc8-a8df-3a4ad6f90f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=644ed2673c7645748c7d12e3ce90e972, user_id=3bca945dad8c44d6b0029734c65498c0, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:03.782433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b489c-6f64-4bc8-a8df-3a4ad6f90f8f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:03.795575 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3892/7808] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:25:03 2022] PUT /identity/v3/projects/644ed2673c7645748c7d12e3ce90e972/users/3bca945dad8c44d6b0029734c65498c0/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:03.807023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2cb04-2ad8-4a9c-aabd-ec16d2c9ef08 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:03.807563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2cb04-2ad8-4a9c-aabd-ec16d2c9ef08 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:03.807886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2cb04-2ad8-4a9c-aabd-ec16d2c9ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:03.848311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a3e2cb04-2ad8-4a9c-aabd-ec16d2c9ef08 None None] MFA Rules not processed for user `3bca945dad8c44d6b0029734c65498c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:03.850842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a3e2cb04-2ad8-4a9c-aabd-ec16d2c9ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:03.948949 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3917/7809] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:03.961977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b489c-6f64-4bc8-a8df-3a4ad6f90f8f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:03.963763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d87b489c-6f64-4bc8-a8df-3a4ad6f90f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:04.035268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b489c-6f64-4bc8-a8df-3a4ad6f90f8f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:04.040006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2116a-8026-4f55-a39f-4d05932059b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:04.040947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2116a-8026-4f55-a39f-4d05932059b6 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:04.041339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2116a-8026-4f55-a39f-4d05932059b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:04.041718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2116a-8026-4f55-a39f-4d05932059b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:04.061032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2116a-8026-4f55-a39f-4d05932059b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:04.062436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2116a-8026-4f55-a39f-4d05932059b6 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:04.092665 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3893/7810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:04.179516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2cb04-2ad8-4a9c-aabd-ec16d2c9ef08 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:04.192477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2cb04-2ad8-4a9c-aabd-ec16d2c9ef08 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:04.196798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45614ed2-c0c6-491e-b2b3-aefab13d827d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:04.197413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45614ed2-c0c6-491e-b2b3-aefab13d827d service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:04.197826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45614ed2-c0c6-491e-b2b3-aefab13d827d service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:04.198111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45614ed2-c0c6-491e-b2b3-aefab13d827d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:04.208675 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:04.261251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45614ed2-c0c6-491e-b2b3-aefab13d827d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:04.262695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45614ed2-c0c6-491e-b2b3-aefab13d827d service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:04.273484 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3918/7811] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:04.569848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2116a-8026-4f55-a39f-4d05932059b6 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:04.575334 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:04.637194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2116a-8026-4f55-a39f-4d05932059b6 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:04.641761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:04.642398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:04.642682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:04.642958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] PATH_INFO: `/v3/users/4a385e594e93422fb988cce3c12719a2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:04.644093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a385e594e93422fb988cce3c12719a2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:04.646589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:04.695655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a385e594e93422fb988cce3c12719a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:04.708552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a385e594e93422fb988cce3c12719a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:04.716400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a385e594e93422fb988cce3c12719a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:04.726375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a385e594e93422fb988cce3c12719a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:04.727194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a385e594e93422fb988cce3c12719a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:04.733628 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3894/7812] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:25:04 2022] DELETE /identity/v3/users/4a385e594e93422fb988cce3c12719a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:04.738185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e05551-6f6c-4c04-8a07-bdb8241603f1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:04.738666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e05551-6f6c-4c04-8a07-bdb8241603f1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:04.738776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e05551-6f6c-4c04-8a07-bdb8241603f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:04.759793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c0e05551-6f6c-4c04-8a07-bdb8241603f1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:04.761077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c0e05551-6f6c-4c04-8a07-bdb8241603f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:04.827379 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3919/7813] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:25:04.837733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:04.839256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:04.904769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b5e51-4374-4fc6-95dd-ad4f7866f4a0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:04.910195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d10be-5fa2-4e40-bd52-45a61896e4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:04.910825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d10be-5fa2-4e40-bd52-45a61896e4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:04.911205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d10be-5fa2-4e40-bd52-45a61896e4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:04.911647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d10be-5fa2-4e40-bd52-45a61896e4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:04.921714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d10be-5fa2-4e40-bd52-45a61896e4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:04.923157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d10be-5fa2-4e40-bd52-45a61896e4c8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:04.933989 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3895/7814] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:05.233919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e05551-6f6c-4c04-8a07-bdb8241603f1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:05.235641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c0e05551-6f6c-4c04-8a07-bdb8241603f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:05.248525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e05551-6f6c-4c04-8a07-bdb8241603f1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:05.253628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:05.254294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:05.254563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:05.254875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] PATH_INFO: `/v3/projects/a6f3ef4eea0449d9af3ac1eb45987b75` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:05.257125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f3ef4eea0449d9af3ac1eb45987b75)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:05.258428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:05.331925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f3ef4eea0449d9af3ac1eb45987b75', 'request_id': 'req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.341010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f3ef4eea0449d9af3ac1eb45987b75', 'request_id': 'req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.347042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f3ef4eea0449d9af3ac1eb45987b75', 'request_id': 'req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.359988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] The token cache is being invalidate because project a6f3ef4eea0449d9af3ac1eb45987b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:25:05.360282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.361069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.362812 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3920/7815] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:25:05 2022] DELETE /identity/v3/projects/a6f3ef4eea0449d9af3ac1eb45987b75 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:05.366860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d10be-5fa2-4e40-bd52-45a61896e4c8 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:05.378800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d10be-5fa2-4e40-bd52-45a61896e4c8 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:05.404587 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:05.445853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:05.446525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:05.446793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:05.447073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] PATH_INFO: `/v3/users/3bca945dad8c44d6b0029734c65498c0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:05.448435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bca945dad8c44d6b0029734c65498c0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:05.450421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:05.522396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bca945dad8c44d6b0029734c65498c0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.535760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bca945dad8c44d6b0029734c65498c0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.543923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bca945dad8c44d6b0029734c65498c0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.553591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bca945dad8c44d6b0029734c65498c0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.554583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c4d25c10-1953-4b7f-b7fc-2ed61f189cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bca945dad8c44d6b0029734c65498c0'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:05.561741 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3896/7816] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:25:05 2022] DELETE /identity/v3/users/3bca945dad8c44d6b0029734c65498c0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:25:05.883577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:05.885902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:05.902356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0cbcd-28e3-4cf9-b9cc-0482a4f71e7b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:05.942449 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:05.970800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:05.971577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:05.971861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:05.972140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] PATH_INFO: `/v3/projects/644ed2673c7645748c7d12e3ce90e972` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:05.973306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=644ed2673c7645748c7d12e3ce90e972)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:05.976293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:06.025565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644ed2673c7645748c7d12e3ce90e972', 'request_id': 'req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:06.032777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644ed2673c7645748c7d12e3ce90e972', 'request_id': 'req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:06.039757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644ed2673c7645748c7d12e3ce90e972', 'request_id': 'req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:06.052847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] The token cache is being invalidate because project 644ed2673c7645748c7d12e3ce90e972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:25:06.053150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:06.053857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bbaa902d-c907-43cb-8f98-f2d7f55fe0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:06.055405 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3921/7817] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:25:05 2022] DELETE /identity/v3/projects/644ed2673c7645748c7d12e3ce90e972 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:06.061278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87c6c1-c26e-48ca-89f1-f02c8b2db015 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.061882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87c6c1-c26e-48ca-89f1-f02c8b2db015 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.061882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87c6c1-c26e-48ca-89f1-f02c8b2db015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.085619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-eb87c6c1-c26e-48ca-89f1-f02c8b2db015 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:06.086853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eb87c6c1-c26e-48ca-89f1-f02c8b2db015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:06.154856 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3897/7818] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:06.164371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9938e-1f27-4c53-97e7-e0dd7372fbc0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.164677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9938e-1f27-4c53-97e7-e0dd7372fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.164999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9938e-1f27-4c53-97e7-e0dd7372fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.186318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-98a9938e-1f27-4c53-97e7-e0dd7372fbc0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:06.187885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-98a9938e-1f27-4c53-97e7-e0dd7372fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:06.197111 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3922/7819] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:06.201327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87c6c1-c26e-48ca-89f1-f02c8b2db015 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:06.212752 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87c6c1-c26e-48ca-89f1-f02c8b2db015 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:06.217468 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0190c-bd4f-48c9-a24d-265dc1258b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:06.218107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0190c-bd4f-48c9-a24d-265dc1258b8c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.218387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0190c-bd4f-48c9-a24d-265dc1258b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.218696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0190c-bd4f-48c9-a24d-265dc1258b8c admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.219340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0190c-bd4f-48c9-a24d-265dc1258b8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:25:06.219642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0190c-bd4f-48c9-a24d-265dc1258b8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:06.221286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0190c-bd4f-48c9-a24d-265dc1258b8c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:06.234530 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3898/7820] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:25:06.238917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9938e-1f27-4c53-97e7-e0dd7372fbc0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:06.248422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9938e-1f27-4c53-97e7-e0dd7372fbc0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:06.253189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f7d94-cd5f-4cb8-b33e-ee065c262439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:06.253794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f7d94-cd5f-4cb8-b33e-ee065c262439 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.254074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f7d94-cd5f-4cb8-b33e-ee065c262439 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.254350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f7d94-cd5f-4cb8-b33e-ee065c262439 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.255539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f7d94-cd5f-4cb8-b33e-ee065c262439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:06.257479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f7d94-cd5f-4cb8-b33e-ee065c262439 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:06.289146 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3923/7821] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:25:06 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:25:06.290310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0190c-bd4f-48c9-a24d-265dc1258b8c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:06.301160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0190c-bd4f-48c9-a24d-265dc1258b8c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:06.336234 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:06.367632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34ac01-cd79-4da6-a9f5-46f18f872bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:06.368248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34ac01-cd79-4da6-a9f5-46f18f872bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.368530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34ac01-cd79-4da6-a9f5-46f18f872bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.368835 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34ac01-cd79-4da6-a9f5-46f18f872bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.369459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34ac01-cd79-4da6-a9f5-46f18f872bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:06.371407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34ac01-cd79-4da6-a9f5-46f18f872bd1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:06.396995 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3899/7822] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:25:06 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:25:06.401101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f7d94-cd5f-4cb8-b33e-ee065c262439 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:06.412862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f7d94-cd5f-4cb8-b33e-ee065c262439 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:06.418949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b5ac7-6fac-46f6-95fd-64b1b90aabe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:06.419808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b5ac7-6fac-46f6-95fd-64b1b90aabe3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.420298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b5ac7-6fac-46f6-95fd-64b1b90aabe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.420575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b5ac7-6fac-46f6-95fd-64b1b90aabe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.421264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b5ac7-6fac-46f6-95fd-64b1b90aabe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:06.422898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b5ac7-6fac-46f6-95fd-64b1b90aabe3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:06.439500 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3924/7823] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:25:06.440809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34ac01-cd79-4da6-a9f5-46f18f872bd1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:06.452119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34ac01-cd79-4da6-a9f5-46f18f872bd1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:06.457212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad930b2c-f21d-4e50-b452-b5604e230ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:06.458381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad930b2c-f21d-4e50-b452-b5604e230ada admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.458676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad930b2c-f21d-4e50-b452-b5604e230ada admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.458950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad930b2c-f21d-4e50-b452-b5604e230ada admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.459586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad930b2c-f21d-4e50-b452-b5604e230ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:06.461214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad930b2c-f21d-4e50-b452-b5604e230ada admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:06.472541 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3900/7824] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:25:06.476771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b5ac7-6fac-46f6-95fd-64b1b90aabe3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:06.487010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b5ac7-6fac-46f6-95fd-64b1b90aabe3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:06.491868 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a3e65-2a98-40ad-8562-2048a9aea444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:06.492527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a3e65-2a98-40ad-8562-2048a9aea444 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.492850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a3e65-2a98-40ad-8562-2048a9aea444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.493127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a3e65-2a98-40ad-8562-2048a9aea444 admin admin] PATH_INFO: `/v3/projects/50c481b6746440f99c673ba61a1ed915/users/20779cd4f9734fb89d2144414b4630e8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.512319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a3e65-2a98-40ad-8562-2048a9aea444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c481b6746440f99c673ba61a1ed915, user_id=20779cd4f9734fb89d2144414b4630e8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:06.515101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a3e65-2a98-40ad-8562-2048a9aea444 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:06.546768 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3925/7825] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:25:06 2022] PUT /identity/v3/projects/50c481b6746440f99c673ba61a1ed915/users/20779cd4f9734fb89d2144414b4630e8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:06.555311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12082e5-8332-454f-b070-6f3a623760bf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.555615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12082e5-8332-454f-b070-6f3a623760bf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.555889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12082e5-8332-454f-b070-6f3a623760bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.608219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d12082e5-8332-454f-b070-6f3a623760bf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:06.609505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d12082e5-8332-454f-b070-6f3a623760bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:06.671862 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3901/7826] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:06.683054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a3e65-2a98-40ad-8562-2048a9aea444 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:06.684815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e21a3e65-2a98-40ad-8562-2048a9aea444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:06.747895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a3e65-2a98-40ad-8562-2048a9aea444 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:06.751642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12acf3-c2ce-4d0f-af12-c40df445751f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:06.752255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12acf3-c2ce-4d0f-af12-c40df445751f service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:06.752536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12acf3-c2ce-4d0f-af12-c40df445751f service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:06.752850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12acf3-c2ce-4d0f-af12-c40df445751f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:06.762849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12acf3-c2ce-4d0f-af12-c40df445751f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:06.764295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12acf3-c2ce-4d0f-af12-c40df445751f service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:06.774737 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3926/7827] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:11.299441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d79949-e1d9-4224-b7e9-feb5e7de4db3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:11.299922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d79949-e1d9-4224-b7e9-feb5e7de4db3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:11.300182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d79949-e1d9-4224-b7e9-feb5e7de4db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:11.340368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-99d79949-e1d9-4224-b7e9-feb5e7de4db3 None None] MFA Rules not processed for user `20779cd4f9734fb89d2144414b4630e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:11.341910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-99d79949-e1d9-4224-b7e9-feb5e7de4db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:11.429251 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3902/7828] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:11.433827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12acf3-c2ce-4d0f-af12-c40df445751f service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:11.451187 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:11.456243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12acf3-c2ce-4d0f-af12-c40df445751f service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:11.464052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4189e1-a9d7-41aa-bc33-3050e47ef732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:11.465099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4189e1-a9d7-41aa-bc33-3050e47ef732 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:11.465847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4189e1-a9d7-41aa-bc33-3050e47ef732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:11.466292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4189e1-a9d7-41aa-bc33-3050e47ef732 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:11.467352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4189e1-a9d7-41aa-bc33-3050e47ef732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:11.474229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4189e1-a9d7-41aa-bc33-3050e47ef732 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:11.511945 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3927/7829] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:25:11 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:25:11.513587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d79949-e1d9-4224-b7e9-feb5e7de4db3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:11.526471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d79949-e1d9-4224-b7e9-feb5e7de4db3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:11.583205 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:11.617211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fde3e-03ac-47a6-ac56-8bcbaf64e492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:11.617868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fde3e-03ac-47a6-ac56-8bcbaf64e492 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:11.618153 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fde3e-03ac-47a6-ac56-8bcbaf64e492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:11.618431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fde3e-03ac-47a6-ac56-8bcbaf64e492 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:11.619081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fde3e-03ac-47a6-ac56-8bcbaf64e492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:11.621273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fde3e-03ac-47a6-ac56-8bcbaf64e492 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:11.661592 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3903/7830] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:25:11 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:25:11.665475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4189e1-a9d7-41aa-bc33-3050e47ef732 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:11.678931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4189e1-a9d7-41aa-bc33-3050e47ef732 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:11.687426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca6433-bb07-4073-b9d9-22095038c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:11.688046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca6433-bb07-4073-b9d9-22095038c6ed admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:11.688335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca6433-bb07-4073-b9d9-22095038c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:11.689485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca6433-bb07-4073-b9d9-22095038c6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:11.690260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca6433-bb07-4073-b9d9-22095038c6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:11.692796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca6433-bb07-4073-b9d9-22095038c6ed admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:11.715744 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3928/7831] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:25:11.720011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fde3e-03ac-47a6-ac56-8bcbaf64e492 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:11.735978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fde3e-03ac-47a6-ac56-8bcbaf64e492 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:11.742932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186efc-4847-45c7-9844-cd6ed94811a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:11.743586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186efc-4847-45c7-9844-cd6ed94811a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:11.744605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186efc-4847-45c7-9844-cd6ed94811a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:11.744931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186efc-4847-45c7-9844-cd6ed94811a8 admin admin] PATH_INFO: `/v3/projects/a43109e7b20148d1bb0277dc76b02c6d/users/d041167120fa4ed5868b6ed344271bb6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:11.789637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b186efc-4847-45c7-9844-cd6ed94811a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43109e7b20148d1bb0277dc76b02c6d, user_id=d041167120fa4ed5868b6ed344271bb6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:11.792807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b186efc-4847-45c7-9844-cd6ed94811a8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:11.819414 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3904/7832] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:25:11 2022] PUT /identity/v3/projects/a43109e7b20148d1bb0277dc76b02c6d/users/d041167120fa4ed5868b6ed344271bb6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:25:11.824497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca6433-bb07-4073-b9d9-22095038c6ed admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:11.839680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca6433-bb07-4073-b9d9-22095038c6ed admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:11.927437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aaffb-74a2-4ba5-8615-393a3cb4cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:11.928089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aaffb-74a2-4ba5-8615-393a3cb4cbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:11.928375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aaffb-74a2-4ba5-8615-393a3cb4cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:11.929170 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aaffb-74a2-4ba5-8615-393a3cb4cbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:11.929899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383aaffb-74a2-4ba5-8615-393a3cb4cbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:11.931881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383aaffb-74a2-4ba5-8615-393a3cb4cbd5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:11.945887 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3929/7833] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:25:11.950385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186efc-4847-45c7-9844-cd6ed94811a8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:11.962980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186efc-4847-45c7-9844-cd6ed94811a8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:11.968272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13339d33-12f0-4cbd-a22e-f88fde79efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:11.969127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339d33-12f0-4cbd-a22e-f88fde79efcb admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:11.969801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339d33-12f0-4cbd-a22e-f88fde79efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:11.969995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339d33-12f0-4cbd-a22e-f88fde79efcb admin admin] PATH_INFO: `/v3/projects/a43109e7b20148d1bb0277dc76b02c6d/users/d041167120fa4ed5868b6ed344271bb6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:11.972191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13339d33-12f0-4cbd-a22e-f88fde79efcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43109e7b20148d1bb0277dc76b02c6d, user_id=d041167120fa4ed5868b6ed344271bb6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:11.975285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13339d33-12f0-4cbd-a22e-f88fde79efcb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:11.992050 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3905/7834] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:25:11 2022] PUT /identity/v3/projects/a43109e7b20148d1bb0277dc76b02c6d/users/d041167120fa4ed5868b6ed344271bb6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:17.740756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c942b-a69e-4698-99cf-57e4200763ab None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:17.741247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c942b-a69e-4698-99cf-57e4200763ab None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:17.741646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c942b-a69e-4698-99cf-57e4200763ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:17.783695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e64c942b-a69e-4698-99cf-57e4200763ab None None] MFA Rules not processed for user `d041167120fa4ed5868b6ed344271bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:17.786277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e64c942b-a69e-4698-99cf-57e4200763ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:17.891513 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3930/7835] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:17.908906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13339d33-12f0-4cbd-a22e-f88fde79efcb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:17.911797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-13339d33-12f0-4cbd-a22e-f88fde79efcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:18.070596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13339d33-12f0-4cbd-a22e-f88fde79efcb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:18.076840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ab53-1ea7-468d-b822-b9552b051d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:18.077685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ab53-1ea7-468d-b822-b9552b051d7d service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:18.078761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ab53-1ea7-468d-b822-b9552b051d7d service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:18.079157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ab53-1ea7-468d-b822-b9552b051d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:18.150508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3ab53-1ea7-468d-b822-b9552b051d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:18.152125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3ab53-1ea7-468d-b822-b9552b051d7d service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:18.164742 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3906/7836] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:19.319767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53543e-26e6-429a-b5e7-063ae5d41411 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:19.320908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53543e-26e6-429a-b5e7-063ae5d41411 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:19.321337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53543e-26e6-429a-b5e7-063ae5d41411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:19.342430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3f53543e-26e6-429a-b5e7-063ae5d41411 None None] MFA Rules not processed for user `20779cd4f9734fb89d2144414b4630e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:19.343904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3f53543e-26e6-429a-b5e7-063ae5d41411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:19.356040 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3931/7837] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:28.157905 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:29.337167 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=78,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:31.051601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ab53-1ea7-468d-b822-b9552b051d7d service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:31.053166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-12a3ab53-1ea7-468d-b822-b9552b051d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:31.122300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ab53-1ea7-468d-b822-b9552b051d7d service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:31.127099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:31.127736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:31.128016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:31.128290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] PATH_INFO: `/v3/users/9885f8a436684a0392e63b784cbe84fd` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:31.129447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9885f8a436684a0392e63b784cbe84fd)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:31.131907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:31.184741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9885f8a436684a0392e63b784cbe84fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.197614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9885f8a436684a0392e63b784cbe84fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.205982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9885f8a436684a0392e63b784cbe84fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.214011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9885f8a436684a0392e63b784cbe84fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.214974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9885f8a436684a0392e63b784cbe84fd'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.225691 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3907/7838] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:25:31 2022] DELETE /identity/v3/users/9885f8a436684a0392e63b784cbe84fd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:31.227409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518c8f-e7c6-468a-8b72-7208c1737e5c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:31.227856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518c8f-e7c6-468a-8b72-7208c1737e5c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:31.228061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518c8f-e7c6-468a-8b72-7208c1737e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:31.250486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-76518c8f-e7c6-468a-8b72-7208c1737e5c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:31.251702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-76518c8f-e7c6-468a-8b72-7208c1737e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:31.325042 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3932/7839] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:31.335663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:31.337141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:31.424495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4f8e0-6b79-414d-adc5-77348573fb26 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:31.428747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ac811-e3ef-4468-a47f-112b58b44018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:31.429373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ac811-e3ef-4468-a47f-112b58b44018 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:31.429655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ac811-e3ef-4468-a47f-112b58b44018 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:31.429928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ac811-e3ef-4468-a47f-112b58b44018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:31.442644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ac811-e3ef-4468-a47f-112b58b44018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:31.444898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ac811-e3ef-4468-a47f-112b58b44018 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:31.457998 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3908/7840] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:31.817898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76518c8f-e7c6-468a-8b72-7208c1737e5c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:31.820073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-76518c8f-e7c6-468a-8b72-7208c1737e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:31.832482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76518c8f-e7c6-468a-8b72-7208c1737e5c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:31.838111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:31.838763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:31.839067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:31.839322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] PATH_INFO: `/v3/projects/b78f9f6c05124b8ebf03595244c9320c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:31.840461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78f9f6c05124b8ebf03595244c9320c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:31.842427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:31.892517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78f9f6c05124b8ebf03595244c9320c', 'request_id': 'req-d1b952a5-7081-4953-adb4-7ae1910dbc19'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.905290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78f9f6c05124b8ebf03595244c9320c', 'request_id': 'req-d1b952a5-7081-4953-adb4-7ae1910dbc19'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.911604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78f9f6c05124b8ebf03595244c9320c', 'request_id': 'req-d1b952a5-7081-4953-adb4-7ae1910dbc19'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.924096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] The token cache is being invalidate because project b78f9f6c05124b8ebf03595244c9320c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:25:31.924412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.925106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:25:31.926635 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3933/7841] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:25:31 2022] DELETE /identity/v3/projects/b78f9f6c05124b8ebf03595244c9320c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:25:31.932187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c1fa-3f02-444a-811e-605691147557 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:31.932473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c1fa-3f02-444a-811e-605691147557 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:31.932782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c1fa-3f02-444a-811e-605691147557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:31.953204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c1f6c1fa-3f02-444a-811e-605691147557 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:31.954429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c1f6c1fa-3f02-444a-811e-605691147557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:31.972653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:31.973539 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:31.974850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:32.023637 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3909/7842] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:32.031526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9887a-c731-46c3-9829-ad5c2f359d8a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.031819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9887a-c731-46c3-9829-ad5c2f359d8a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.032100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9887a-c731-46c3-9829-ad5c2f359d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.048901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b952a5-7081-4953-adb4-7ae1910dbc19 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:32.052232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f8f9887a-c731-46c3-9829-ad5c2f359d8a None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:32.052739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608235-86f0-41f2-9b84-1600c46c8343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:32.054062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f8f9887a-c731-46c3-9829-ad5c2f359d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:32.054211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608235-86f0-41f2-9b84-1600c46c8343 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.054398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608235-86f0-41f2-9b84-1600c46c8343 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.054661 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608235-86f0-41f2-9b84-1600c46c8343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.056685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-16608235-86f0-41f2-9b84-1600c46c8343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:32.062551 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3910/7843] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:25:32.066558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9887a-c731-46c3-9829-ad5c2f359d8a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:32.076530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9887a-c731-46c3-9829-ad5c2f359d8a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:32.081428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27d08-bb02-4a3e-84bc-b3849639fd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:32.082062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27d08-bb02-4a3e-84bc-b3849639fd0e admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.082475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27d08-bb02-4a3e-84bc-b3849639fd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.082766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27d08-bb02-4a3e-84bc-b3849639fd0e admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.083405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb27d08-bb02-4a3e-84bc-b3849639fd0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:25:32.083721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb27d08-bb02-4a3e-84bc-b3849639fd0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:32.085469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb27d08-bb02-4a3e-84bc-b3849639fd0e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:32.097564 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3911/7844] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:25:32.102512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27d08-bb02-4a3e-84bc-b3849639fd0e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:32.102660 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:32.117091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27d08-bb02-4a3e-84bc-b3849639fd0e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:32.123164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad0b5a-bf4e-404c-8517-880e4f74b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:32.124112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad0b5a-bf4e-404c-8517-880e4f74b928 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.124496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad0b5a-bf4e-404c-8517-880e4f74b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.124889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad0b5a-bf4e-404c-8517-880e4f74b928 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.125615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad0b5a-bf4e-404c-8517-880e4f74b928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:32.127597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad0b5a-bf4e-404c-8517-880e4f74b928 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:32.131897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16608235-86f0-41f2-9b84-1600c46c8343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:32.133434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16608235-86f0-41f2-9b84-1600c46c8343 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:32.143579 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3934/7845] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:32.156816 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3912/7846] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:25:32 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:25:32.161062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608235-86f0-41f2-9b84-1600c46c8343 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:32.172421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608235-86f0-41f2-9b84-1600c46c8343 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:32.234756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21794d-f6de-4069-8813-022bb71c957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:32.235445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21794d-f6de-4069-8813-022bb71c957b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.235816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21794d-f6de-4069-8813-022bb71c957b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.236153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21794d-f6de-4069-8813-022bb71c957b admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.236881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21794d-f6de-4069-8813-022bb71c957b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:32.238862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21794d-f6de-4069-8813-022bb71c957b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:32.263603 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3935/7847] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:25:32 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:25:32.267769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad0b5a-bf4e-404c-8517-880e4f74b928 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:32.284563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad0b5a-bf4e-404c-8517-880e4f74b928 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:32.290078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91e3b6-d95d-4939-8f87-babed96d1545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:32.290765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e3b6-d95d-4939-8f87-babed96d1545 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.291250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e3b6-d95d-4939-8f87-babed96d1545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.291591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e3b6-d95d-4939-8f87-babed96d1545 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.292297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91e3b6-d95d-4939-8f87-babed96d1545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:32.294009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91e3b6-d95d-4939-8f87-babed96d1545 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:32.306790 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3913/7848] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:25:32.310732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21794d-f6de-4069-8813-022bb71c957b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:32.324797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21794d-f6de-4069-8813-022bb71c957b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:32.331814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede90b1-d4c5-43a5-ad7c-75efcd1b5d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:32.332933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede90b1-d4c5-43a5-ad7c-75efcd1b5d58 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.333284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede90b1-d4c5-43a5-ad7c-75efcd1b5d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.333625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede90b1-d4c5-43a5-ad7c-75efcd1b5d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.334479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede90b1-d4c5-43a5-ad7c-75efcd1b5d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:32.336296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede90b1-d4c5-43a5-ad7c-75efcd1b5d58 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:32.347165 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3936/7849] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:25:32.352484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91e3b6-d95d-4939-8f87-babed96d1545 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:32.366234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91e3b6-d95d-4939-8f87-babed96d1545 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:32.372525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab45be1-5eb1-48c8-abe8-7bbc24879a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:32.373378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab45be1-5eb1-48c8-abe8-7bbc24879a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.373719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab45be1-5eb1-48c8-abe8-7bbc24879a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.374215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab45be1-5eb1-48c8-abe8-7bbc24879a67 admin admin] PATH_INFO: `/v3/projects/59d06462e3cd4d998f91e84aff8ebda9/users/965ccead68054318a2f18507da6ca13c/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.395408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab45be1-5eb1-48c8-abe8-7bbc24879a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d06462e3cd4d998f91e84aff8ebda9, user_id=965ccead68054318a2f18507da6ca13c, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:32.398527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab45be1-5eb1-48c8-abe8-7bbc24879a67 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:32.415508 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3914/7850] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:25:32 2022] PUT /identity/v3/projects/59d06462e3cd4d998f91e84aff8ebda9/users/965ccead68054318a2f18507da6ca13c/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:25:32.421364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e555a2e-6d6e-44d4-a878-00b2a8d96e16 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.421718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e555a2e-6d6e-44d4-a878-00b2a8d96e16 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.422090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e555a2e-6d6e-44d4-a878-00b2a8d96e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.449887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2e555a2e-6d6e-44d4-a878-00b2a8d96e16 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:32.451177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e555a2e-6d6e-44d4-a878-00b2a8d96e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:32.530954 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3937/7851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:32.542533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab45be1-5eb1-48c8-abe8-7bbc24879a67 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:32.544183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eab45be1-5eb1-48c8-abe8-7bbc24879a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:32.612303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab45be1-5eb1-48c8-abe8-7bbc24879a67 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:32.617911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559f777-4549-499f-adde-955370b0dae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:32.619109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559f777-4549-499f-adde-955370b0dae9 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:32.619547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559f777-4549-499f-adde-955370b0dae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:32.619957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559f777-4549-499f-adde-955370b0dae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:32.633276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559f777-4549-499f-adde-955370b0dae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:32.635756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559f777-4549-499f-adde-955370b0dae9 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:32.646465 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3915/7852] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:34.222390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e555a2e-6d6e-44d4-a878-00b2a8d96e16 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:34.224132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e555a2e-6d6e-44d4-a878-00b2a8d96e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:34.292803 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:34.330643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e555a2e-6d6e-44d4-a878-00b2a8d96e16 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:34.337580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:34.338446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:34.338903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:34.339352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:34.342039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:34.358220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:34.360059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:34.378105 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3938/7853] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:38.430736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aa5a8-4c85-4e57-b1ea-9a046372ef3c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:38.431565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aa5a8-4c85-4e57-b1ea-9a046372ef3c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:38.431565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aa5a8-4c85-4e57-b1ea-9a046372ef3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:38.465614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-919aa5a8-4c85-4e57-b1ea-9a046372ef3c None None] MFA Rules not processed for user `965ccead68054318a2f18507da6ca13c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:38.466780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-919aa5a8-4c85-4e57-b1ea-9a046372ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:38.513265 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:38.546219 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3916/7854] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:38.563417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:38.565699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:38.582832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2a54-1ddf-40b7-a69f-5524074fc21a service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:38.589718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11470f37-d5ba-40fb-8498-9d691bdcd6f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:38.590368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11470f37-d5ba-40fb-8498-9d691bdcd6f1 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:38.590649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11470f37-d5ba-40fb-8498-9d691bdcd6f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:38.590984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11470f37-d5ba-40fb-8498-9d691bdcd6f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:38.621542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11470f37-d5ba-40fb-8498-9d691bdcd6f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:38.623560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11470f37-d5ba-40fb-8498-9d691bdcd6f1 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:38.637238 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3939/7855] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:40.032104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db36e8a-0d1c-46c5-83f4-7d79b02b8bfa None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:40.032606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db36e8a-0d1c-46c5-83f4-7d79b02b8bfa None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:40.032901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db36e8a-0d1c-46c5-83f4-7d79b02b8bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:40.058869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5db36e8a-0d1c-46c5-83f4-7d79b02b8bfa None None] MFA Rules not processed for user `965ccead68054318a2f18507da6ca13c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:40.060383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5db36e8a-0d1c-46c5-83f4-7d79b02b8bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:40.068331 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3917/7856] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:25:43.156914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11470f37-d5ba-40fb-8498-9d691bdcd6f1 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:43.173305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11470f37-d5ba-40fb-8498-9d691bdcd6f1 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:43.177600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de40dc-aeda-4751-a4ff-aeb1466b31fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:43.179331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de40dc-aeda-4751-a4ff-aeb1466b31fa service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:43.179793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de40dc-aeda-4751-a4ff-aeb1466b31fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:43.180234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de40dc-aeda-4751-a4ff-aeb1466b31fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:43.183647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-72de40dc-aeda-4751-a4ff-aeb1466b31fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:43.201595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de40dc-aeda-4751-a4ff-aeb1466b31fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:43.204316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de40dc-aeda-4751-a4ff-aeb1466b31fa service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:43.222615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3940/7857] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:49.504650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db36e8a-0d1c-46c5-83f4-7d79b02b8bfa None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:49.523033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db36e8a-0d1c-46c5-83f4-7d79b02b8bfa None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:49.529938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1eb310-03c6-46f9-8aa3-b6c9a5c97897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:49.530755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1eb310-03c6-46f9-8aa3-b6c9a5c97897 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:49.531199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1eb310-03c6-46f9-8aa3-b6c9a5c97897 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:49.531643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1eb310-03c6-46f9-8aa3-b6c9a5c97897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:49.533617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cc1eb310-03c6-46f9-8aa3-b6c9a5c97897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:49.551602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1eb310-03c6-46f9-8aa3-b6c9a5c97897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:49.553521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1eb310-03c6-46f9-8aa3-b6c9a5c97897 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:49.568769 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3918/7858] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:25:53.159950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de40dc-aeda-4751-a4ff-aeb1466b31fa service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:25:53.176891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de40dc-aeda-4751-a4ff-aeb1466b31fa service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:25:53.183064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6a2e-cb8d-451e-b91c-507014c80d45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:25:53.183803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6a2e-cb8d-451e-b91c-507014c80d45 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:53.184140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6a2e-cb8d-451e-b91c-507014c80d45 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:53.184492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6a2e-cb8d-451e-b91c-507014c80d45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:53.186321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ffdf6a2e-cb8d-451e-b91c-507014c80d45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:53.202675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf6a2e-cb8d-451e-b91c-507014c80d45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:25:53.204286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf6a2e-cb8d-451e-b91c-507014c80d45 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:25:53.219055 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3941/7859] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:25:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:25:57.257615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32b01-7451-470c-b5d8-72646f71caa6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:25:57.258102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32b01-7451-470c-b5d8-72646f71caa6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:25:57.258206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32b01-7451-470c-b5d8-72646f71caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:25:57.278804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-19c32b01-7451-470c-b5d8-72646f71caa6 None None] MFA Rules not processed for user `25a73a5fe5644dac874ce5d3e2558566`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:25:57.279999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-19c32b01-7451-470c-b5d8-72646f71caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:25:57.335308 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3919/7860] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:25:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:26:03.211864 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=28 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:07.327106 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=44 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:08.335149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6a2e-cb8d-451e-b91c-507014c80d45 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:26:08.347162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6a2e-cb8d-451e-b91c-507014c80d45 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:26:08.351484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:26:08.352182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:26:08.352516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:26:08.352882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:26:08.354629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:26:08.365619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:26:08.367097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:26:08.376600 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3942/7861] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:26:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:26:18.371498 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:45.247087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83627-17a0-4a98-b6ce-16007bf26e18 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:26:45.247631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83627-17a0-4a98-b6ce-16007bf26e18 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:26:45.248071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83627-17a0-4a98-b6ce-16007bf26e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:26:45.277045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1bc83627-17a0-4a98-b6ce-16007bf26e18 None None] MFA Rules not processed for user `965ccead68054318a2f18507da6ca13c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:26:45.278617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1bc83627-17a0-4a98-b6ce-16007bf26e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:26:45.293332 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3920/7862] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:26:45.986196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:26:45.987754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:26:46.113436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878240e-bb41-43ff-8fe6-ad1b533982ff service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:26:46.119720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50fa80-1a69-488c-8e09-0d30054be85e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:26:46.120376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50fa80-1a69-488c-8e09-0d30054be85e service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:26:46.120593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50fa80-1a69-488c-8e09-0d30054be85e service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:26:46.120890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50fa80-1a69-488c-8e09-0d30054be85e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:26:46.122709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6c50fa80-1a69-488c-8e09-0d30054be85e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:26:46.137330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50fa80-1a69-488c-8e09-0d30054be85e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:26:46.139057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50fa80-1a69-488c-8e09-0d30054be85e service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:26:46.152562 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3943/7863] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:26:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:26:55.276134 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:56.147298 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=32 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:16.181673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc83627-17a0-4a98-b6ce-16007bf26e18 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:16.183406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1bc83627-17a0-4a98-b6ce-16007bf26e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:16.201736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc83627-17a0-4a98-b6ce-16007bf26e18 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:16.207037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2969b2-6724-4bf7-8635-2489bd11f0ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:16.207677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2969b2-6724-4bf7-8635-2489bd11f0ea service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:16.207961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2969b2-6724-4bf7-8635-2489bd11f0ea service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:16.208238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2969b2-6724-4bf7-8635-2489bd11f0ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:16.210117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-eb2969b2-6724-4bf7-8635-2489bd11f0ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:16.224556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2969b2-6724-4bf7-8635-2489bd11f0ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:16.226190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2969b2-6724-4bf7-8635-2489bd11f0ea service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:16.239183 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3921/7864] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:27:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:27:23.313072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50fa80-1a69-488c-8e09-0d30054be85e service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:23.326522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50fa80-1a69-488c-8e09-0d30054be85e service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:23.331699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:23.332300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:23.332581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:23.332887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:23.334736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:23.348897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:23.351084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:23.363681 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3944/7865] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:27:24.033636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2969b2-6724-4bf7-8635-2489bd11f0ea service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:24.056387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2969b2-6724-4bf7-8635-2489bd11f0ea service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:24.062338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea318c-70c2-4573-aca3-088072f42409 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:24.063079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea318c-70c2-4573-aca3-088072f42409 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.063451 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea318c-70c2-4573-aca3-088072f42409 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.063819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea318c-70c2-4573-aca3-088072f42409 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.065671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-88ea318c-70c2-4573-aca3-088072f42409 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:24.092796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea318c-70c2-4573-aca3-088072f42409 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:24.095055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea318c-70c2-4573-aca3-088072f42409 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:24.110100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:24.111910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:24.117852 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3922/7866] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:27:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:27:24.133144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d800a-efc2-48dd-8a38-ac7e9307b15e service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:24.138380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:24.139038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.139322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.139598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] PATH_INFO: `/v3/users/25a73a5fe5644dac874ce5d3e2558566` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.140783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a73a5fe5644dac874ce5d3e2558566)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:24.142721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:24.192334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a73a5fe5644dac874ce5d3e2558566'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.205477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a73a5fe5644dac874ce5d3e2558566'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.213060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a73a5fe5644dac874ce5d3e2558566'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.221169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a73a5fe5644dac874ce5d3e2558566'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.222056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-43baeac1-f27e-4bcf-a7f4-462898c2deee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a73a5fe5644dac874ce5d3e2558566'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.229173 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3945/7867] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:27:24 2022] DELETE /identity/v3/users/25a73a5fe5644dac874ce5d3e2558566 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:27:24.406536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea318c-70c2-4573-aca3-088072f42409 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:24.421206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea318c-70c2-4573-aca3-088072f42409 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:24.482243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:24.482871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.483149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.483421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] PATH_INFO: `/v3/projects/568de9170fba47f09ef0d3cfdc9b34df` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.484548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=568de9170fba47f09ef0d3cfdc9b34df)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:24.486478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:24.533416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568de9170fba47f09ef0d3cfdc9b34df', 'request_id': 'req-f67c2220-61e9-4b03-9fb7-a84c5ca14075'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.541280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568de9170fba47f09ef0d3cfdc9b34df', 'request_id': 'req-f67c2220-61e9-4b03-9fb7-a84c5ca14075'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.547282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568de9170fba47f09ef0d3cfdc9b34df', 'request_id': 'req-f67c2220-61e9-4b03-9fb7-a84c5ca14075'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.559063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] The token cache is being invalidate because project 568de9170fba47f09ef0d3cfdc9b34df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:27:24.559352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.560023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f67c2220-61e9-4b03-9fb7-a84c5ca14075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:24.561551 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3923/7868] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:27:24 2022] DELETE /identity/v3/projects/568de9170fba47f09ef0d3cfdc9b34df => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:27:24.566446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002b5b3-c1f6-4eb7-b4c6-3dc42b160d54 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.566919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002b5b3-c1f6-4eb7-b4c6-3dc42b160d54 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.567021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002b5b3-c1f6-4eb7-b4c6-3dc42b160d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.587227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8002b5b3-c1f6-4eb7-b4c6-3dc42b160d54 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:27:24.588449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8002b5b3-c1f6-4eb7-b4c6-3dc42b160d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:24.650393 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3946/7869] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:27:24.657909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef997053-d42f-423b-8340-584ca5d48b7d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.658214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef997053-d42f-423b-8340-584ca5d48b7d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.658491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef997053-d42f-423b-8340-584ca5d48b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.679886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ef997053-d42f-423b-8340-584ca5d48b7d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:27:24.681161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ef997053-d42f-423b-8340-584ca5d48b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:24.689429 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3924/7870] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:27:24.693988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002b5b3-c1f6-4eb7-b4c6-3dc42b160d54 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:24.703754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002b5b3-c1f6-4eb7-b4c6-3dc42b160d54 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:24.708316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7d25b-2a6c-4b3d-965e-8cc92bb802ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:24.709000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7d25b-2a6c-4b3d-965e-8cc92bb802ca admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.709486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7d25b-2a6c-4b3d-965e-8cc92bb802ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.709767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7d25b-2a6c-4b3d-965e-8cc92bb802ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.710412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7d25b-2a6c-4b3d-965e-8cc92bb802ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:27:24.710723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7d25b-2a6c-4b3d-965e-8cc92bb802ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:24.712320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7d25b-2a6c-4b3d-965e-8cc92bb802ca admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:24.724068 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3947/7871] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:27:24.728726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef997053-d42f-423b-8340-584ca5d48b7d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:24.738113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef997053-d42f-423b-8340-584ca5d48b7d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:24.743103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a01036-a1b9-49d4-a157-7cdacab7caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:24.743701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a01036-a1b9-49d4-a157-7cdacab7caed admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.743985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a01036-a1b9-49d4-a157-7cdacab7caed admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.744262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a01036-a1b9-49d4-a157-7cdacab7caed admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.744967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a01036-a1b9-49d4-a157-7cdacab7caed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:24.746862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a01036-a1b9-49d4-a157-7cdacab7caed admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:24.774741 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3925/7872] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:27:24 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:27:24.778816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7d25b-2a6c-4b3d-965e-8cc92bb802ca admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:24.788929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7d25b-2a6c-4b3d-965e-8cc92bb802ca admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:24.833029 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:24.847813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275b814-fa14-46b2-82ac-2e9bf6010c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:24.848422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275b814-fa14-46b2-82ac-2e9bf6010c2b admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.848740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275b814-fa14-46b2-82ac-2e9bf6010c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.849020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275b814-fa14-46b2-82ac-2e9bf6010c2b admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.849786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275b814-fa14-46b2-82ac-2e9bf6010c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:24.851799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275b814-fa14-46b2-82ac-2e9bf6010c2b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:24.872928 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3948/7873] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:27:24 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:27:24.877010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a01036-a1b9-49d4-a157-7cdacab7caed admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:24.888358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a01036-a1b9-49d4-a157-7cdacab7caed admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:24.893064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28b2e6-3533-45a3-8b60-b412ec57ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:24.893664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b2e6-3533-45a3-8b60-b412ec57ad9c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.893945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b2e6-3533-45a3-8b60-b412ec57ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.894222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b2e6-3533-45a3-8b60-b412ec57ad9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.894856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28b2e6-3533-45a3-8b60-b412ec57ad9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:24.896492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28b2e6-3533-45a3-8b60-b412ec57ad9c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:24.907609 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3926/7874] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:27:24.911482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275b814-fa14-46b2-82ac-2e9bf6010c2b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:24.922091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275b814-fa14-46b2-82ac-2e9bf6010c2b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:24.926855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c90a7b-13a8-4774-b29a-171214b85311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:24.927455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c90a7b-13a8-4774-b29a-171214b85311 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.928243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c90a7b-13a8-4774-b29a-171214b85311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.928519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c90a7b-13a8-4774-b29a-171214b85311 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.929183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c90a7b-13a8-4774-b29a-171214b85311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:24.930786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c90a7b-13a8-4774-b29a-171214b85311 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:24.941685 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3949/7875] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:27:24.946395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28b2e6-3533-45a3-8b60-b412ec57ad9c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:24.956448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28b2e6-3533-45a3-8b60-b412ec57ad9c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:24.961386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028d9f1-116a-4d25-ac45-e7800da6039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:24.962040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028d9f1-116a-4d25-ac45-e7800da6039d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:24.962327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028d9f1-116a-4d25-ac45-e7800da6039d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:24.962607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028d9f1-116a-4d25-ac45-e7800da6039d admin admin] PATH_INFO: `/v3/projects/e865309644474763a39c4f64e59e8c7b/users/4f7297e7d476468aa8b4e4e3a1d6df64/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:24.977317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028d9f1-116a-4d25-ac45-e7800da6039d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e865309644474763a39c4f64e59e8c7b, user_id=4f7297e7d476468aa8b4e4e3a1d6df64, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:24.979986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028d9f1-116a-4d25-ac45-e7800da6039d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:24.988743 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:24.994632 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3927/7876] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:27:24 2022] PUT /identity/v3/projects/e865309644474763a39c4f64e59e8c7b/users/4f7297e7d476468aa8b4e4e3a1d6df64/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:27:25.006735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0de3f8-bb2a-41da-bee9-383d2db989ea None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:25.007026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0de3f8-bb2a-41da-bee9-383d2db989ea None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:25.007306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0de3f8-bb2a-41da-bee9-383d2db989ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:25.034609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1b0de3f8-bb2a-41da-bee9-383d2db989ea None None] MFA Rules not processed for user `4f7297e7d476468aa8b4e4e3a1d6df64`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:27:25.035813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b0de3f8-bb2a-41da-bee9-383d2db989ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:25.099717 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3950/7877] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:27:25.110886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028d9f1-116a-4d25-ac45-e7800da6039d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:25.112686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4028d9f1-116a-4d25-ac45-e7800da6039d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:25.172283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028d9f1-116a-4d25-ac45-e7800da6039d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:25.175935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbe51a-8009-4307-91b6-a3c5e4766dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:25.176531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbe51a-8009-4307-91b6-a3c5e4766dba service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:25.176839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbe51a-8009-4307-91b6-a3c5e4766dba service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:25.177109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbe51a-8009-4307-91b6-a3c5e4766dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:25.186266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbe51a-8009-4307-91b6-a3c5e4766dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:25.187696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbe51a-8009-4307-91b6-a3c5e4766dba service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:25.197015 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3928/7878] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:27:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:27:33.313801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0de3f8-bb2a-41da-bee9-383d2db989ea None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:33.377036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0de3f8-bb2a-41da-bee9-383d2db989ea None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:33.382234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:33.382872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:33.383153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:33.383427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] PATH_INFO: `/v3/users/4f7297e7d476468aa8b4e4e3a1d6df64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:33.384559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7297e7d476468aa8b4e4e3a1d6df64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:33.386507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:33.434064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7297e7d476468aa8b4e4e3a1d6df64'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:33.441875 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:33.448869 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7297e7d476468aa8b4e4e3a1d6df64'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:33.457416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7297e7d476468aa8b4e4e3a1d6df64'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:33.464611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7297e7d476468aa8b4e4e3a1d6df64'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:33.465274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7297e7d476468aa8b4e4e3a1d6df64'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:33.471318 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3951/7879] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:27:33 2022] DELETE /identity/v3/users/4f7297e7d476468aa8b4e4e3a1d6df64 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:27:33.476325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcd431-919d-4f2e-a24a-155faf57f678 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:33.476868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcd431-919d-4f2e-a24a-155faf57f678 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:33.476963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcd431-919d-4f2e-a24a-155faf57f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:33.496826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e2bcd431-919d-4f2e-a24a-155faf57f678 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:27:33.498029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e2bcd431-919d-4f2e-a24a-155faf57f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:33.560871 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3929/7880] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:27:33.570707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:33.572123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:33.637687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f76d3-6e5c-4e70-9218-b61a007d5b09 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:33.641601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a429f9-327b-4efb-9e3b-7088f4bfa876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:33.642268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a429f9-327b-4efb-9e3b-7088f4bfa876 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:33.642575 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a429f9-327b-4efb-9e3b-7088f4bfa876 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:33.642879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a429f9-327b-4efb-9e3b-7088f4bfa876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:33.654181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a429f9-327b-4efb-9e3b-7088f4bfa876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:33.655249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a429f9-327b-4efb-9e3b-7088f4bfa876 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:33.667058 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3952/7881] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:27:33.950452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcd431-919d-4f2e-a24a-155faf57f678 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:33.952029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e2bcd431-919d-4f2e-a24a-155faf57f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:33.971908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcd431-919d-4f2e-a24a-155faf57f678 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:33.978037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:33.978732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:33.979173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:33.979457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] PATH_INFO: `/v3/projects/e865309644474763a39c4f64e59e8c7b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:33.981349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e865309644474763a39c4f64e59e8c7b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:33.984203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:34.034163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e865309644474763a39c4f64e59e8c7b', 'request_id': 'req-b3e6cd90-0834-4357-82a4-f37c33df9437'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:34.041988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e865309644474763a39c4f64e59e8c7b', 'request_id': 'req-b3e6cd90-0834-4357-82a4-f37c33df9437'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:34.048457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e865309644474763a39c4f64e59e8c7b', 'request_id': 'req-b3e6cd90-0834-4357-82a4-f37c33df9437'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:34.061325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] The token cache is being invalidate because project e865309644474763a39c4f64e59e8c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:27:34.061688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:34.062369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:27:34.063840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3930/7882] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:27:33 2022] DELETE /identity/v3/projects/e865309644474763a39c4f64e59e8c7b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:27:43.661038 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=35,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:44.057966 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:52.410281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad55f-c9c9-46c3-ba7a-782a10c19833 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:52.410764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad55f-c9c9-46c3-ba7a-782a10c19833 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:52.410886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad55f-c9c9-46c3-ba7a-782a10c19833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:52.429789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-243ad55f-c9c9-46c3-ba7a-782a10c19833 None None] MFA Rules not processed for user `965ccead68054318a2f18507da6ca13c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:27:52.430992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-243ad55f-c9c9-46c3-ba7a-782a10c19833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:52.490014 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3953/7883] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:27:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:27:52.795546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:27:52.797210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:52.859344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6cd90-0834-4357-82a4-f37c33df9437 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:27:52.862977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ca7e-b56c-4a79-834b-044effaff75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:27:52.863609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ca7e-b56c-4a79-834b-044effaff75b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:27:52.863892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ca7e-b56c-4a79-834b-044effaff75b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:27:52.864168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ca7e-b56c-4a79-834b-044effaff75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:27:52.865996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4603ca7e-b56c-4a79-834b-044effaff75b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:27:52.878295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603ca7e-b56c-4a79-834b-044effaff75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:27:52.879785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603ca7e-b56c-4a79-834b-044effaff75b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:27:52.890118 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3931/7884] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:27:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:28:02.483269 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=25 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:02.884287 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=26 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:29:04.930042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703ca8a-b68f-4778-bb15-5ba9d2bb930e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:29:04.930596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703ca8a-b68f-4778-bb15-5ba9d2bb930e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:29:04.930596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703ca8a-b68f-4778-bb15-5ba9d2bb930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:29:04.949815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6703ca8a-b68f-4778-bb15-5ba9d2bb930e None None] MFA Rules not processed for user `965ccead68054318a2f18507da6ca13c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:29:04.951011 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6703ca8a-b68f-4778-bb15-5ba9d2bb930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:29:04.958531 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3954/7885] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:29:10.155650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ca7e-b56c-4a79-834b-044effaff75b service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:29:10.167316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ca7e-b56c-4a79-834b-044effaff75b service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:29:10.170891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a64ffb-4028-4dc8-a2c1-915e5c1ec642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:29:10.171475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a64ffb-4028-4dc8-a2c1-915e5c1ec642 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:29:10.171751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a64ffb-4028-4dc8-a2c1-915e5c1ec642 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:29:10.172019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a64ffb-4028-4dc8-a2c1-915e5c1ec642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:29:10.173762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f3a64ffb-4028-4dc8-a2c1-915e5c1ec642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:29:10.246061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a64ffb-4028-4dc8-a2c1-915e5c1ec642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:29:10.247498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a64ffb-4028-4dc8-a2c1-915e5c1ec642 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:29:10.260847 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3932/7886] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:29:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:29:11.444446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703ca8a-b68f-4778-bb15-5ba9d2bb930e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:29:11.457195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703ca8a-b68f-4778-bb15-5ba9d2bb930e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:29:11.463458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d7a16-b3d1-4123-bfc8-7d1eae89a101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:29:11.464251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d7a16-b3d1-4123-bfc8-7d1eae89a101 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:29:11.464572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d7a16-b3d1-4123-bfc8-7d1eae89a101 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:29:11.464758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d7a16-b3d1-4123-bfc8-7d1eae89a101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:29:11.466599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f07d7a16-b3d1-4123-bfc8-7d1eae89a101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:29:11.484337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d7a16-b3d1-4123-bfc8-7d1eae89a101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:29:11.485790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d7a16-b3d1-4123-bfc8-7d1eae89a101 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:29:11.500018 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3955/7887] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:29:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:29:20.253565 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=34 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:29:21.492637 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:07.889694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a64ffb-4028-4dc8-a2c1-915e5c1ec642 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:07.902536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a64ffb-4028-4dc8-a2c1-915e5c1ec642 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:07.909466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:07.910420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:07.910898 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:07.911354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:07.914127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:07.928694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:07.930152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:07.942766 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3933/7888] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:17.431024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d7a16-b3d1-4123-bfc8-7d1eae89a101 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:17.443226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d7a16-b3d1-4123-bfc8-7d1eae89a101 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:17.448337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:17.449200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:17.449483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:17.449761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:17.451599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:17.518586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:17.520017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:17.530125 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3956/7889] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:17.938229 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:25.084457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:25.086569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:25.173111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:25.176754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:25.198610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc840a00-a96c-4782-8a2b-c41d0c2b6412 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:25.205882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe5f6f-6360-4be3-8241-075c0f1eea36 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:25.207068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:25.208452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:25.208967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:25.209275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] PATH_INFO: `/v3/users/20779cd4f9734fb89d2144414b4630e8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:25.211593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20779cd4f9734fb89d2144414b4630e8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:25.213211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec90a9-768c-4c70-ad36-eb064c062f3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:25.213923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec90a9-768c-4c70-ad36-eb064c062f3d service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:25.214211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:25.214376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec90a9-768c-4c70-ad36-eb064c062f3d service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:25.214656 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec90a9-768c-4c70-ad36-eb064c062f3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:25.216446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-39ec90a9-768c-4c70-ad36-eb064c062f3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:25.232395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec90a9-768c-4c70-ad36-eb064c062f3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:25.234303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec90a9-768c-4c70-ad36-eb064c062f3d service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:25.250001 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3934/7890] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:25.276395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20779cd4f9734fb89d2144414b4630e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.292359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20779cd4f9734fb89d2144414b4630e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.303503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20779cd4f9734fb89d2144414b4630e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.313902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20779cd4f9734fb89d2144414b4630e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.314583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20779cd4f9734fb89d2144414b4630e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.322150 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3957/7891] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:25 2022] DELETE /identity/v3/users/20779cd4f9734fb89d2144414b4630e8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:25.514525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec90a9-768c-4c70-ad36-eb064c062f3d service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:25.525846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec90a9-768c-4c70-ad36-eb064c062f3d service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:25.593907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:25.594545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:25.594827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:25.595106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] PATH_INFO: `/v3/projects/50c481b6746440f99c673ba61a1ed915` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:25.596236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c481b6746440f99c673ba61a1ed915)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:25.598216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:25.651076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c481b6746440f99c673ba61a1ed915', 'request_id': 'req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.660244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c481b6746440f99c673ba61a1ed915', 'request_id': 'req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.667719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c481b6746440f99c673ba61a1ed915', 'request_id': 'req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.679713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] The token cache is being invalidate because project 50c481b6746440f99c673ba61a1ed915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:25.680090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.680709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.682233 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3935/7892] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:25 2022] DELETE /identity/v3/projects/50c481b6746440f99c673ba61a1ed915 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:25.686225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:25.687781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:25.701779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde68d9-f824-40ab-bcf4-c3c300ad3e39 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:25.760615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:25.761194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:25.761484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:25.761757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] PATH_INFO: `/v3/users/d041167120fa4ed5868b6ed344271bb6` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:25.762931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d041167120fa4ed5868b6ed344271bb6)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:25.764889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:25.771063 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:25.816156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd041167120fa4ed5868b6ed344271bb6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.828534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd041167120fa4ed5868b6ed344271bb6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.836864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd041167120fa4ed5868b6ed344271bb6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.844154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd041167120fa4ed5868b6ed344271bb6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.844853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd041167120fa4ed5868b6ed344271bb6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:25.850719 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3958/7893] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:25 2022] DELETE /identity/v3/users/d041167120fa4ed5868b6ed344271bb6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:26.025045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:26.026713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:26.048428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7e177-2ffc-47e9-b15c-cc3b1ab90feb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:26.075428 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:26.120065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:26.120754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:26.121009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:26.121288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] PATH_INFO: `/v3/projects/a43109e7b20148d1bb0277dc76b02c6d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:26.122719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43109e7b20148d1bb0277dc76b02c6d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:26.124653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:26.175779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43109e7b20148d1bb0277dc76b02c6d', 'request_id': 'req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:26.184235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43109e7b20148d1bb0277dc76b02c6d', 'request_id': 'req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:26.190284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43109e7b20148d1bb0277dc76b02c6d', 'request_id': 'req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:26.203088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] The token cache is being invalidate because project a43109e7b20148d1bb0277dc76b02c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:26.203373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:26.204049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:26.205578 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3936/7894] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:26 2022] DELETE /identity/v3/projects/a43109e7b20148d1bb0277dc76b02c6d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:30.629411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:30.631071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:30.644749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914170f-3952-4dff-a2c5-b81bd16b8715 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:30.711300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:30.711944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:30.712227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:30.712506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] PATH_INFO: `/v3/users/965ccead68054318a2f18507da6ca13c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:30.713679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965ccead68054318a2f18507da6ca13c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:30.715603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:30.762820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965ccead68054318a2f18507da6ca13c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:30.777249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965ccead68054318a2f18507da6ca13c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:30.784541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965ccead68054318a2f18507da6ca13c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:30.792002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965ccead68054318a2f18507da6ca13c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:30.792611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-50e5a38d-0594-4eaf-8b96-bd23acc04d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965ccead68054318a2f18507da6ca13c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:30.798828 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3959/7895] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:30 2022] DELETE /identity/v3/users/965ccead68054318a2f18507da6ca13c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:30.976758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:30.978236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:30.991187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4930ff-5fd9-4b3d-9a77-56178193b9a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.048480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.049168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.049453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.049735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] PATH_INFO: `/v3/projects/59d06462e3cd4d998f91e84aff8ebda9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.050896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d06462e3cd4d998f91e84aff8ebda9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.052850 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.101909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d06462e3cd4d998f91e84aff8ebda9', 'request_id': 'req-5ad4591f-1f84-43b0-933d-c13e7094bf3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:31.104403 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:31.110036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d06462e3cd4d998f91e84aff8ebda9', 'request_id': 'req-5ad4591f-1f84-43b0-933d-c13e7094bf3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:31.117172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d06462e3cd4d998f91e84aff8ebda9', 'request_id': 'req-5ad4591f-1f84-43b0-933d-c13e7094bf3b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:31.129063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] The token cache is being invalidate because project 59d06462e3cd4d998f91e84aff8ebda9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:31.129355 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:31.130006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5ad4591f-1f84-43b0-933d-c13e7094bf3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:31.131503 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3937/7896] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:30 2022] DELETE /identity/v3/projects/59d06462e3cd4d998f91e84aff8ebda9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:31.136495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b65b7-2edc-4d7c-96cd-7b38af5c548b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.136823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b65b7-2edc-4d7c-96cd-7b38af5c548b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.137101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b65b7-2edc-4d7c-96cd-7b38af5c548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.145792 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:31.158719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0e0b65b7-2edc-4d7c-96cd-7b38af5c548b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:31.160373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0e0b65b7-2edc-4d7c-96cd-7b38af5c548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:31.221805 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3960/7897] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:31.230410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e67b-b9b3-42bf-9718-44c4641cdcb6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.230703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e67b-b9b3-42bf-9718-44c4641cdcb6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.231004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e67b-b9b3-42bf-9718-44c4641cdcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.251409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1ae1e67b-b9b3-42bf-9718-44c4641cdcb6 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:31.252674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1ae1e67b-b9b3-42bf-9718-44c4641cdcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:31.261679 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3938/7898] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:31.265967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b65b7-2edc-4d7c-96cd-7b38af5c548b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.276515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b65b7-2edc-4d7c-96cd-7b38af5c548b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.281217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f6651-96a5-41f2-aaae-b55aec4cdb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.281818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6651-96a5-41f2-aaae-b55aec4cdb58 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.282100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6651-96a5-41f2-aaae-b55aec4cdb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.282375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6651-96a5-41f2-aaae-b55aec4cdb58 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.283018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f6651-96a5-41f2-aaae-b55aec4cdb58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:31.283325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f6651-96a5-41f2-aaae-b55aec4cdb58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.284938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f6651-96a5-41f2-aaae-b55aec4cdb58 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.296411 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3961/7899] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:31.300510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e67b-b9b3-42bf-9718-44c4641cdcb6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.310369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e67b-b9b3-42bf-9718-44c4641cdcb6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.315248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f7f11-d91f-4bff-a388-bcef63647f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.315834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f7f11-d91f-4bff-a388-bcef63647f30 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.316139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f7f11-d91f-4bff-a388-bcef63647f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.316409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f7f11-d91f-4bff-a388-bcef63647f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.317074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f7f11-d91f-4bff-a388-bcef63647f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.318964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f7f11-d91f-4bff-a388-bcef63647f30 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.353447 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3939/7900] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:31 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:31.354511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f6651-96a5-41f2-aaae-b55aec4cdb58 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.364514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f6651-96a5-41f2-aaae-b55aec4cdb58 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.425617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090d549-f10a-445b-ad2a-2380315ee5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.426230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090d549-f10a-445b-ad2a-2380315ee5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.426516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090d549-f10a-445b-ad2a-2380315ee5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.426792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090d549-f10a-445b-ad2a-2380315ee5d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.427423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090d549-f10a-445b-ad2a-2380315ee5d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.429969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090d549-f10a-445b-ad2a-2380315ee5d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.454027 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3962/7901] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:31 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:31.458288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f7f11-d91f-4bff-a388-bcef63647f30 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.469576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f7f11-d91f-4bff-a388-bcef63647f30 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.474249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29095c79-0b97-4920-a9ee-09ced5423d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.474848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29095c79-0b97-4920-a9ee-09ced5423d07 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.475220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29095c79-0b97-4920-a9ee-09ced5423d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.475503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29095c79-0b97-4920-a9ee-09ced5423d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.476302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29095c79-0b97-4920-a9ee-09ced5423d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.477984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29095c79-0b97-4920-a9ee-09ced5423d07 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.488372 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3940/7902] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:31.492351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090d549-f10a-445b-ad2a-2380315ee5d8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.502675 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090d549-f10a-445b-ad2a-2380315ee5d8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.508201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9242f-cd33-4296-bfa4-c7840db85bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.508969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9242f-cd33-4296-bfa4-c7840db85bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.509254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9242f-cd33-4296-bfa4-c7840db85bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.509529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9242f-cd33-4296-bfa4-c7840db85bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.510196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9242f-cd33-4296-bfa4-c7840db85bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.511791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9242f-cd33-4296-bfa4-c7840db85bf0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.522525 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3963/7903] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:31.528006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29095c79-0b97-4920-a9ee-09ced5423d07 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.538074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29095c79-0b97-4920-a9ee-09ced5423d07 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.543527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284869b-62b9-4d0c-a1e2-7738279916c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.544189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284869b-62b9-4d0c-a1e2-7738279916c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.544473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284869b-62b9-4d0c-a1e2-7738279916c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.544793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284869b-62b9-4d0c-a1e2-7738279916c1 admin admin] PATH_INFO: `/v3/projects/1f56cb53b5dc4137a7f252dc30a3c172/users/3cb458cee1a9472aabb590257e7d7fd5/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.559377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284869b-62b9-4d0c-a1e2-7738279916c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f56cb53b5dc4137a7f252dc30a3c172, user_id=3cb458cee1a9472aabb590257e7d7fd5, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.562119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284869b-62b9-4d0c-a1e2-7738279916c1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.575842 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3941/7904] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:31 2022] PUT /identity/v3/projects/1f56cb53b5dc4137a7f252dc30a3c172/users/3cb458cee1a9472aabb590257e7d7fd5/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:31.587589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd13e4-d9c9-447a-8750-f36e005d0090 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.587870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd13e4-d9c9-447a-8750-f36e005d0090 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.588141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd13e4-d9c9-447a-8750-f36e005d0090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.615076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-36cd13e4-d9c9-447a-8750-f36e005d0090 None None] MFA Rules not processed for user `3cb458cee1a9472aabb590257e7d7fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:31.616200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-36cd13e4-d9c9-447a-8750-f36e005d0090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:31.677269 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:31.682551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3964/7905] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:30:31.686546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284869b-62b9-4d0c-a1e2-7738279916c1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.749489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284869b-62b9-4d0c-a1e2-7738279916c1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.754150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b83f9a-b53e-43aa-9da9-a780ad84780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.754748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b83f9a-b53e-43aa-9da9-a780ad84780e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.755025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b83f9a-b53e-43aa-9da9-a780ad84780e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.755294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b83f9a-b53e-43aa-9da9-a780ad84780e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.755917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b83f9a-b53e-43aa-9da9-a780ad84780e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.758681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b83f9a-b53e-43aa-9da9-a780ad84780e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.788224 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3942/7906] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:31 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:31.789425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd13e4-d9c9-447a-8750-f36e005d0090 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.800212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd13e4-d9c9-447a-8750-f36e005d0090 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.859965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5fab-0d92-41c0-8d54-ba1160441f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.860574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5fab-0d92-41c0-8d54-ba1160441f55 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.860887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5fab-0d92-41c0-8d54-ba1160441f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.861168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5fab-0d92-41c0-8d54-ba1160441f55 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.861806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b5fab-0d92-41c0-8d54-ba1160441f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.863739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b5fab-0d92-41c0-8d54-ba1160441f55 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.884320 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3965/7907] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:31 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:31.888388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b83f9a-b53e-43aa-9da9-a780ad84780e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.899426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b83f9a-b53e-43aa-9da9-a780ad84780e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.904241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a948-a34b-41b3-9641-705720a8f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.904943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a948-a34b-41b3-9641-705720a8f474 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.905243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a948-a34b-41b3-9641-705720a8f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.905543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a948-a34b-41b3-9641-705720a8f474 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.906175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a948-a34b-41b3-9641-705720a8f474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.907757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a948-a34b-41b3-9641-705720a8f474 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.918919 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3943/7908] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:31.923302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5fab-0d92-41c0-8d54-ba1160441f55 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.934148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5fab-0d92-41c0-8d54-ba1160441f55 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:31.939041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4f0ad-3ce9-4b15-82de-6f9079c3271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:31.939689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4f0ad-3ce9-4b15-82de-6f9079c3271e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:31.939970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4f0ad-3ce9-4b15-82de-6f9079c3271e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:31.940244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4f0ad-3ce9-4b15-82de-6f9079c3271e admin admin] PATH_INFO: `/v3/projects/0941f29221e24dd7af7620ee719cf2d9/users/876b3b443a6345819c8ad9db4ac0e47e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:31.955417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4f0ad-3ce9-4b15-82de-6f9079c3271e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0941f29221e24dd7af7620ee719cf2d9, user_id=876b3b443a6345819c8ad9db4ac0e47e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:31.958107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4f0ad-3ce9-4b15-82de-6f9079c3271e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:31.972166 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3966/7909] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:31 2022] PUT /identity/v3/projects/0941f29221e24dd7af7620ee719cf2d9/users/876b3b443a6345819c8ad9db4ac0e47e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:31.976257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a948-a34b-41b3-9641-705720a8f474 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:31.986388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a948-a34b-41b3-9641-705720a8f474 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.033909 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:32.047858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba6fc-dee0-4892-a546-6ab27a64c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.047858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba6fc-dee0-4892-a546-6ab27a64c052 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.047858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba6fc-dee0-4892-a546-6ab27a64c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.047858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba6fc-dee0-4892-a546-6ab27a64c052 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.048434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba6fc-dee0-4892-a546-6ab27a64c052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.048789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba6fc-dee0-4892-a546-6ab27a64c052 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:32.059086 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3944/7910] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:32.063536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4f0ad-3ce9-4b15-82de-6f9079c3271e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:32.075246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4f0ad-3ce9-4b15-82de-6f9079c3271e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.080612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f86f6-f1d9-4052-99e9-ed00905cf516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.081348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f86f6-f1d9-4052-99e9-ed00905cf516 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.081627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f86f6-f1d9-4052-99e9-ed00905cf516 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.081901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f86f6-f1d9-4052-99e9-ed00905cf516 admin admin] PATH_INFO: `/v3/projects/0941f29221e24dd7af7620ee719cf2d9/users/876b3b443a6345819c8ad9db4ac0e47e/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.083895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f86f6-f1d9-4052-99e9-ed00905cf516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0941f29221e24dd7af7620ee719cf2d9, user_id=876b3b443a6345819c8ad9db4ac0e47e, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.087219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f86f6-f1d9-4052-99e9-ed00905cf516 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:32.099807 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3967/7911] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:32 2022] PUT /identity/v3/projects/0941f29221e24dd7af7620ee719cf2d9/users/876b3b443a6345819c8ad9db4ac0e47e/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:32.110255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d20b70-1434-4c37-97e2-066d6f9a1aee None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.110543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d20b70-1434-4c37-97e2-066d6f9a1aee None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.110825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d20b70-1434-4c37-97e2-066d6f9a1aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.140069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-53d20b70-1434-4c37-97e2-066d6f9a1aee None None] MFA Rules not processed for user `876b3b443a6345819c8ad9db4ac0e47e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:32.141249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-53d20b70-1434-4c37-97e2-066d6f9a1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:32.210010 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3945/7912] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:32.215083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f86f6-f1d9-4052-99e9-ed00905cf516 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:32.225788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f86f6-f1d9-4052-99e9-ed00905cf516 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.231068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716266f-1974-40b7-9882-6caf6057e85b tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876b3b443a6345819c8ad9db4ac0e47e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0941f29221e24dd7af7620ee719cf2d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.231669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716266f-1974-40b7-9882-6caf6057e85b tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.231956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716266f-1974-40b7-9882-6caf6057e85b tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.232244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716266f-1974-40b7-9882-6caf6057e85b tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.232948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716266f-1974-40b7-9882-6caf6057e85b tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.234564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716266f-1974-40b7-9882-6caf6057e85b tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:32.252388 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3968/7913] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:30:32 2022] POST /identity/v3/domains => generated 245 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:32.256520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d20b70-1434-4c37-97e2-066d6f9a1aee None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:32.265928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d20b70-1434-4c37-97e2-066d6f9a1aee None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.325068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721d4e2-7274-4bc6-a95c-285c255d57ba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876b3b443a6345819c8ad9db4ac0e47e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0941f29221e24dd7af7620ee719cf2d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.325680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721d4e2-7274-4bc6-a95c-285c255d57ba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.325968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721d4e2-7274-4bc6-a95c-285c255d57ba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.326252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721d4e2-7274-4bc6-a95c-285c255d57ba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.326882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721d4e2-7274-4bc6-a95c-285c255d57ba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.328837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721d4e2-7274-4bc6-a95c-285c255d57ba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:32.365750 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3946/7914] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:32 2022] POST /identity/v3/projects => generated 408 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:32.370134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716266f-1974-40b7-9882-6caf6057e85b tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:32.380387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716266f-1974-40b7-9882-6caf6057e85b tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.438451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c182-497d-4d2e-aa93-bed09eebadb7 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876b3b443a6345819c8ad9db4ac0e47e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0941f29221e24dd7af7620ee719cf2d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.438980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c182-497d-4d2e-aa93-bed09eebadb7 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.439290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c182-497d-4d2e-aa93-bed09eebadb7 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.439569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c182-497d-4d2e-aa93-bed09eebadb7 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.440208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988c182-497d-4d2e-aa93-bed09eebadb7 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.442163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988c182-497d-4d2e-aa93-bed09eebadb7 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:32.464761 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3969/7915] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:32 2022] POST /identity/v3/users => generated 347 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:32.468967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721d4e2-7274-4bc6-a95c-285c255d57ba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:32.480112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721d4e2-7274-4bc6-a95c-285c255d57ba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.484980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828b426-4c7a-49e2-af9b-c94e442d278e tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876b3b443a6345819c8ad9db4ac0e47e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0941f29221e24dd7af7620ee719cf2d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.485587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b426-4c7a-49e2-af9b-c94e442d278e tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.485897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b426-4c7a-49e2-af9b-c94e442d278e tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.486200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b426-4c7a-49e2-af9b-c94e442d278e tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.486846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828b426-4c7a-49e2-af9b-c94e442d278e tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.488473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828b426-4c7a-49e2-af9b-c94e442d278e tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:32.498631 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3947/7916] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:32.502726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c182-497d-4d2e-aa93-bed09eebadb7 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:32.513407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c182-497d-4d2e-aa93-bed09eebadb7 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.518381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775623b-b284-4570-ab7f-7f11a9f33d52 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876b3b443a6345819c8ad9db4ac0e47e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0941f29221e24dd7af7620ee719cf2d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.519133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775623b-b284-4570-ab7f-7f11a9f33d52 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.519420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775623b-b284-4570-ab7f-7f11a9f33d52 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.519701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775623b-b284-4570-ab7f-7f11a9f33d52 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] PATH_INFO: `/v3/projects/3f1b36105e244b5cb31db99733ec556e/users/2668370acaee4d97b0fdb4b39d01e98a/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.535099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775623b-b284-4570-ab7f-7f11a9f33d52 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3f1b36105e244b5cb31db99733ec556e, user_id=2668370acaee4d97b0fdb4b39d01e98a, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.537849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775623b-b284-4570-ab7f-7f11a9f33d52 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:32.551313 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3970/7917] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:32 2022] PUT /identity/v3/projects/3f1b36105e244b5cb31db99733ec556e/users/2668370acaee4d97b0fdb4b39d01e98a/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:32.555954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360450-7284-4a89-8180-d017d2b0a30c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.556247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360450-7284-4a89-8180-d017d2b0a30c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.556531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360450-7284-4a89-8180-d017d2b0a30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.612917 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:32.659144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ee360450-7284-4a89-8180-d017d2b0a30c None None] MFA Rules not processed for user `2668370acaee4d97b0fdb4b39d01e98a`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:32.660352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ee360450-7284-4a89-8180-d017d2b0a30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:32.676472 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3948/7918] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:32.687613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b233-3173-4fd0-aefe-6088bdf58828 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.688395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b233-3173-4fd0-aefe-6088bdf58828 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.688395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b233-3173-4fd0-aefe-6088bdf58828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.696536 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:32.710242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e205b233-3173-4fd0-aefe-6088bdf58828 None None] MFA Rules not processed for user `2668370acaee4d97b0fdb4b39d01e98a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:32.711510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e205b233-3173-4fd0-aefe-6088bdf58828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:32.718519 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3971/7919] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:32.722757 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360450-7284-4a89-8180-d017d2b0a30c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:32.732869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360450-7284-4a89-8180-d017d2b0a30c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.737465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af625-d5e3-4ba6-9111-7f8b2c32cc98 tempest-test_project-697372316 tempest-user-580594474] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2668370acaee4d97b0fdb4b39d01e98a', 'user_domain_id': 'd34a62b1843742e38d2371ed9e672834', 'system_scope': None, 'project_id': '3f1b36105e244b5cb31db99733ec556e', 'project_domain_id': 'd34a62b1843742e38d2371ed9e672834', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.738057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af625-d5e3-4ba6-9111-7f8b2c32cc98 tempest-test_project-697372316 tempest-user-580594474] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.738334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af625-d5e3-4ba6-9111-7f8b2c32cc98 tempest-test_project-697372316 tempest-user-580594474] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.738607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af625-d5e3-4ba6-9111-7f8b2c32cc98 tempest-test_project-697372316 tempest-user-580594474] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.746984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36af625-d5e3-4ba6-9111-7f8b2c32cc98 tempest-test_project-697372316 tempest-user-580594474] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.748762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36af625-d5e3-4ba6-9111-7f8b2c32cc98 tempest-test_project-697372316 tempest-user-580594474] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:32.757773 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3949/7920] 10.222.0.27 () {56 vars in 1284 bytes} [Wed Oct 19 01:30:32 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:32.762333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205b233-3173-4fd0-aefe-6088bdf58828 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:32.824279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205b233-3173-4fd0-aefe-6088bdf58828 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.829043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876b3b443a6345819c8ad9db4ac0e47e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0941f29221e24dd7af7620ee719cf2d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.829677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.829970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.830253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] PATH_INFO: `/v3/users/2668370acaee4d97b0fdb4b39d01e98a` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.831392 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2668370acaee4d97b0fdb4b39d01e98a)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.833399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:32.879349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2668370acaee4d97b0fdb4b39d01e98a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:32.891171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2668370acaee4d97b0fdb4b39d01e98a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:32.898367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2668370acaee4d97b0fdb4b39d01e98a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:32.905695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2668370acaee4d97b0fdb4b39d01e98a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:32.906375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2668370acaee4d97b0fdb4b39d01e98a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:32.912167 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3972/7921] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:32 2022] DELETE /identity/v3/users/2668370acaee4d97b0fdb4b39d01e98a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:32.917425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af625-d5e3-4ba6-9111-7f8b2c32cc98 tempest-test_project-697372316 tempest-user-580594474] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:32.927929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af625-d5e3-4ba6-9111-7f8b2c32cc98 tempest-test_project-697372316 tempest-user-580594474] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:32.983573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876b3b443a6345819c8ad9db4ac0e47e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0941f29221e24dd7af7620ee719cf2d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:32.984126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:32.984407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:32.984700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] PATH_INFO: `/v3/projects/3f1b36105e244b5cb31db99733ec556e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:32.985845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f1b36105e244b5cb31db99733ec556e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:32.987797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:33.035009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1b36105e244b5cb31db99733ec556e', 'request_id': 'req-94d3c27b-c5d1-4504-9522-ddd834cb1b58'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.042100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1b36105e244b5cb31db99733ec556e', 'request_id': 'req-94d3c27b-c5d1-4504-9522-ddd834cb1b58'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.052263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1b36105e244b5cb31db99733ec556e', 'request_id': 'req-94d3c27b-c5d1-4504-9522-ddd834cb1b58'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.064293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] The token cache is being invalidate because project 3f1b36105e244b5cb31db99733ec556e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:33.064584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.065298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.066806 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3950/7922] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:32 2022] DELETE /identity/v3/projects/3f1b36105e244b5cb31db99733ec556e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:33.071193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:33.072587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:33.090479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d82f-57a7-4f3a-a512-3e9388ae9aba tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:33.145417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876b3b443a6345819c8ad9db4ac0e47e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0941f29221e24dd7af7620ee719cf2d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:33.146055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:33.146336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:33.146606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] PATH_INFO: `/v3/domains/d34a62b1843742e38d2371ed9e672834` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:33.147889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d34a62b1843742e38d2371ed9e672834)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:33.150037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:33.170724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd34a62b1843742e38d2371ed9e672834'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.171399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd34a62b1843742e38d2371ed9e672834'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.173186 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:33.197798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd34a62b1843742e38d2371ed9e672834'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.198471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd34a62b1843742e38d2371ed9e672834'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.200882 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3973/7923] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:30:33 2022] PATCH /identity/v3/domains/d34a62b1843742e38d2371ed9e672834 => generated 246 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:30:33.205074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:33.206477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:33.219799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3c27b-c5d1-4504-9522-ddd834cb1b58 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:33.240148 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:33.279812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876b3b443a6345819c8ad9db4ac0e47e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0941f29221e24dd7af7620ee719cf2d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:33.280440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:33.280750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:33.281020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] PATH_INFO: `/v3/domains/d34a62b1843742e38d2371ed9e672834` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:33.292353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d34a62b1843742e38d2371ed9e672834)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:33.293989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:33.316424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd34a62b1843742e38d2371ed9e672834'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.326806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd34a62b1843742e38d2371ed9e672834'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.366276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34a62b1843742e38d2371ed9e672834', 'request_id': 'req-809c6ac7-27ff-4b68-9d10-0233e1631103'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.373791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34a62b1843742e38d2371ed9e672834', 'request_id': 'req-809c6ac7-27ff-4b68-9d10-0233e1631103'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.379605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34a62b1843742e38d2371ed9e672834', 'request_id': 'req-809c6ac7-27ff-4b68-9d10-0233e1631103'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.391180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] The token cache is being invalidate because project d34a62b1843742e38d2371ed9e672834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:33.391472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.392127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.400485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd34a62b1843742e38d2371ed9e672834', 'request_id': 'req-809c6ac7-27ff-4b68-9d10-0233e1631103'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.401154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd34a62b1843742e38d2371ed9e672834', 'request_id': 'req-809c6ac7-27ff-4b68-9d10-0233e1631103'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.401775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-809c6ac7-27ff-4b68-9d10-0233e1631103 tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd34a62b1843742e38d2371ed9e672834', 'request_id': 'req-809c6ac7-27ff-4b68-9d10-0233e1631103'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.409802 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3951/7924] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:30:33 2022] DELETE /identity/v3/domains/d34a62b1843742e38d2371ed9e672834 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:33.415488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:33.417034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:33.482842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ce1f1-1bc4-46e8-bb28-438d4c1651aa tempest-TestDefaultProjectId-1568999611 tempest-TestDefaultProjectId-1568999611-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:33.537789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:33.538341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:33.538622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:33.539432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] PATH_INFO: `/v3/users/3cb458cee1a9472aabb590257e7d7fd5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:33.540551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb458cee1a9472aabb590257e7d7fd5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:33.542505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:33.590013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb458cee1a9472aabb590257e7d7fd5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.602524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb458cee1a9472aabb590257e7d7fd5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.609374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb458cee1a9472aabb590257e7d7fd5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.616493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb458cee1a9472aabb590257e7d7fd5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.618210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb458cee1a9472aabb590257e7d7fd5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:33.624531 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3974/7925] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:33 2022] DELETE /identity/v3/users/3cb458cee1a9472aabb590257e7d7fd5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:33.629011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d341-d2dc-4b78-95d2-6952b7319d0f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:33.629293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d341-d2dc-4b78-95d2-6952b7319d0f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:33.629567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d341-d2dc-4b78-95d2-6952b7319d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:33.648551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2f86d341-d2dc-4b78-95d2-6952b7319d0f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:33.649641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2f86d341-d2dc-4b78-95d2-6952b7319d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:33.707959 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3952/7926] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:33.717665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:33.719105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:33.730642 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:33.783137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b2feb-1b22-480f-bf76-3997a7c41d5f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:33.786840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad94f6-25e7-4792-a582-5476e3ac62a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:33.787438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad94f6-25e7-4792-a582-5476e3ac62a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:33.787716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad94f6-25e7-4792-a582-5476e3ac62a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:33.788038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad94f6-25e7-4792-a582-5476e3ac62a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:33.797881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad94f6-25e7-4792-a582-5476e3ac62a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:33.799298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad94f6-25e7-4792-a582-5476e3ac62a3 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:33.809703 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3975/7927] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:34.075152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d341-d2dc-4b78-95d2-6952b7319d0f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:34.076641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2f86d341-d2dc-4b78-95d2-6952b7319d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:34.084151 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:34.092380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d341-d2dc-4b78-95d2-6952b7319d0f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:34.098861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:34.099702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:34.100071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:34.100416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] PATH_INFO: `/v3/projects/1f56cb53b5dc4137a7f252dc30a3c172` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:34.102393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f56cb53b5dc4137a7f252dc30a3c172)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:34.104761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:34.153110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f56cb53b5dc4137a7f252dc30a3c172', 'request_id': 'req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.160318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f56cb53b5dc4137a7f252dc30a3c172', 'request_id': 'req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.166950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f56cb53b5dc4137a7f252dc30a3c172', 'request_id': 'req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.177858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] The token cache is being invalidate because project 1f56cb53b5dc4137a7f252dc30a3c172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:34.178147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.178788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.180454 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3953/7928] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:34 2022] DELETE /identity/v3/projects/1f56cb53b5dc4137a7f252dc30a3c172 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:34.184436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad94f6-25e7-4792-a582-5476e3ac62a3 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:34.194494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad94f6-25e7-4792-a582-5476e3ac62a3 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:34.251009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:34.251637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:34.251935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:34.252235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] PATH_INFO: `/v3/users/876b3b443a6345819c8ad9db4ac0e47e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:34.253378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876b3b443a6345819c8ad9db4ac0e47e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:34.255319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:34.301643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876b3b443a6345819c8ad9db4ac0e47e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.314424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876b3b443a6345819c8ad9db4ac0e47e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.323422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876b3b443a6345819c8ad9db4ac0e47e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.331052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876b3b443a6345819c8ad9db4ac0e47e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.331742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a4d0155-3a9e-4feb-8ffa-5901f884c0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876b3b443a6345819c8ad9db4ac0e47e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.338603 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3976/7929] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:34 2022] DELETE /identity/v3/users/876b3b443a6345819c8ad9db4ac0e47e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:34.614178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:34.615729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:34.633336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bb0d5-af74-4bc9-b96e-8aa47cdfa9c4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:34.691834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:34.692462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:34.692785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:34.693060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] PATH_INFO: `/v3/projects/0941f29221e24dd7af7620ee719cf2d9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:34.694163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0941f29221e24dd7af7620ee719cf2d9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:34.696717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:34.741697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0941f29221e24dd7af7620ee719cf2d9', 'request_id': 'req-c5f80163-f762-41ac-8291-5775c9f9fb38'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.749500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0941f29221e24dd7af7620ee719cf2d9', 'request_id': 'req-c5f80163-f762-41ac-8291-5775c9f9fb38'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.755403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0941f29221e24dd7af7620ee719cf2d9', 'request_id': 'req-c5f80163-f762-41ac-8291-5775c9f9fb38'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.767106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] The token cache is being invalidate because project 0941f29221e24dd7af7620ee719cf2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:34.767417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.768054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5f80163-f762-41ac-8291-5775c9f9fb38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:34.769566 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3954/7930] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:34 2022] DELETE /identity/v3/projects/0941f29221e24dd7af7620ee719cf2d9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:34.774950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f5450-99f3-4748-a0d9-b58cfb2fd9ea None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:34.775455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f5450-99f3-4748-a0d9-b58cfb2fd9ea None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:34.775565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f5450-99f3-4748-a0d9-b58cfb2fd9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:34.794802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-284f5450-99f3-4748-a0d9-b58cfb2fd9ea None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:34.795999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-284f5450-99f3-4748-a0d9-b58cfb2fd9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:34.823767 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:34.859450 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3977/7931] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:34.867429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc62344-b894-4ef3-a9b9-e3b30bfeb575 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:34.867718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc62344-b894-4ef3-a9b9-e3b30bfeb575 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:34.868076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc62344-b894-4ef3-a9b9-e3b30bfeb575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:34.888328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5bc62344-b894-4ef3-a9b9-e3b30bfeb575 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:34.889567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5bc62344-b894-4ef3-a9b9-e3b30bfeb575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:34.897479 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3955/7932] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:34.902201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f5450-99f3-4748-a0d9-b58cfb2fd9ea None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:34.912146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f5450-99f3-4748-a0d9-b58cfb2fd9ea None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:34.917451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442c59e-2d55-4561-b759-25afcea60f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:34.918083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c59e-2d55-4561-b759-25afcea60f07 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:34.918365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c59e-2d55-4561-b759-25afcea60f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:34.918637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c59e-2d55-4561-b759-25afcea60f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:34.919279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442c59e-2d55-4561-b759-25afcea60f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:34.919586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442c59e-2d55-4561-b759-25afcea60f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:34.921217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442c59e-2d55-4561-b759-25afcea60f07 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:34.932854 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3978/7933] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:34.936949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc62344-b894-4ef3-a9b9-e3b30bfeb575 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:34.946864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc62344-b894-4ef3-a9b9-e3b30bfeb575 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:34.951540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174dc9b-8141-4b19-a950-590c3a4c3a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:34.952132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174dc9b-8141-4b19-a950-590c3a4c3a8f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:34.952411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174dc9b-8141-4b19-a950-590c3a4c3a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:34.952722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174dc9b-8141-4b19-a950-590c3a4c3a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:34.953357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174dc9b-8141-4b19-a950-590c3a4c3a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:34.955247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174dc9b-8141-4b19-a950-590c3a4c3a8f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:34.961706 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:34.984327 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3956/7934] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:34 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:34.988443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442c59e-2d55-4561-b759-25afcea60f07 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:34.998474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442c59e-2d55-4561-b759-25afcea60f07 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.055452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85703c41-98c5-49b6-928c-062f95b421bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.056064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85703c41-98c5-49b6-928c-062f95b421bd admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.056349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85703c41-98c5-49b6-928c-062f95b421bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.056647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85703c41-98c5-49b6-928c-062f95b421bd admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.057293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85703c41-98c5-49b6-928c-062f95b421bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.059218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85703c41-98c5-49b6-928c-062f95b421bd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.081109 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3979/7935] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:34 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:35.085254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174dc9b-8141-4b19-a950-590c3a4c3a8f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.097090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174dc9b-8141-4b19-a950-590c3a4c3a8f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.102049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e56e4-2e5e-473e-bc55-3468acec4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.102677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e56e4-2e5e-473e-bc55-3468acec4e29 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.102962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e56e4-2e5e-473e-bc55-3468acec4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.103266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e56e4-2e5e-473e-bc55-3468acec4e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.103908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e56e4-2e5e-473e-bc55-3468acec4e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.105555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e56e4-2e5e-473e-bc55-3468acec4e29 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.115579 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3957/7936] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:35.119615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85703c41-98c5-49b6-928c-062f95b421bd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.129943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85703c41-98c5-49b6-928c-062f95b421bd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.135352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f3575-6453-43dd-acdc-463f61587184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.135952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f3575-6453-43dd-acdc-463f61587184 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.136237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f3575-6453-43dd-acdc-463f61587184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.136512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f3575-6453-43dd-acdc-463f61587184 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.137250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f3575-6453-43dd-acdc-463f61587184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.138849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f3575-6453-43dd-acdc-463f61587184 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.150213 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3980/7937] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:35.154339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e56e4-2e5e-473e-bc55-3468acec4e29 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.164522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e56e4-2e5e-473e-bc55-3468acec4e29 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.169316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29b6a5-d793-4580-9af9-14dab6678521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.169968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29b6a5-d793-4580-9af9-14dab6678521 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.170246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29b6a5-d793-4580-9af9-14dab6678521 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.170518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29b6a5-d793-4580-9af9-14dab6678521 admin admin] PATH_INFO: `/v3/projects/1d3b7357ca134612b95861c016451ac2/users/997daa1e71b845abba55d31fd9b8828a/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.184928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29b6a5-d793-4580-9af9-14dab6678521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3b7357ca134612b95861c016451ac2, user_id=997daa1e71b845abba55d31fd9b8828a, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.187582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29b6a5-d793-4580-9af9-14dab6678521 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.201161 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3958/7938] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:35 2022] PUT /identity/v3/projects/1d3b7357ca134612b95861c016451ac2/users/997daa1e71b845abba55d31fd9b8828a/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:35.212446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875743d-a932-4ab0-b7e7-89da51bfda83 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.212780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875743d-a932-4ab0-b7e7-89da51bfda83 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.213059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875743d-a932-4ab0-b7e7-89da51bfda83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.240455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b875743d-a932-4ab0-b7e7-89da51bfda83 None None] MFA Rules not processed for user `997daa1e71b845abba55d31fd9b8828a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:35.241700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b875743d-a932-4ab0-b7e7-89da51bfda83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:35.305876 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3981/7939] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:35.310446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29b6a5-d793-4580-9af9-14dab6678521 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.374682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29b6a5-d793-4580-9af9-14dab6678521 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.379365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098ccac-6d81-45bf-b0b4-64d37782b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.379967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098ccac-6d81-45bf-b0b4-64d37782b6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.380249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098ccac-6d81-45bf-b0b4-64d37782b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.380526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098ccac-6d81-45bf-b0b4-64d37782b6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.381171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098ccac-6d81-45bf-b0b4-64d37782b6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.383812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098ccac-6d81-45bf-b0b4-64d37782b6e1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.409875 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3959/7940] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:35 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:35.414244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875743d-a932-4ab0-b7e7-89da51bfda83 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.425368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875743d-a932-4ab0-b7e7-89da51bfda83 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.450757 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:35.483921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d60f2-1c5e-4a33-afae-a8fa2628fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.484523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d60f2-1c5e-4a33-afae-a8fa2628fa5f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.484841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d60f2-1c5e-4a33-afae-a8fa2628fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.485119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d60f2-1c5e-4a33-afae-a8fa2628fa5f admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.485756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d60f2-1c5e-4a33-afae-a8fa2628fa5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.487687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d60f2-1c5e-4a33-afae-a8fa2628fa5f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.509597 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3982/7941] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:35 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:35.513863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098ccac-6d81-45bf-b0b4-64d37782b6e1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.524804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098ccac-6d81-45bf-b0b4-64d37782b6e1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.529395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54089c54-e329-4294-b45e-d411f2c0ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.530013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54089c54-e329-4294-b45e-d411f2c0ec13 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.530293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54089c54-e329-4294-b45e-d411f2c0ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.530567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54089c54-e329-4294-b45e-d411f2c0ec13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.531202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54089c54-e329-4294-b45e-d411f2c0ec13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.532870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54089c54-e329-4294-b45e-d411f2c0ec13 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.543436 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3960/7942] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:35.547679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d60f2-1c5e-4a33-afae-a8fa2628fa5f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.558587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d60f2-1c5e-4a33-afae-a8fa2628fa5f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.563684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46627cc-6bf9-46cd-8071-77045538d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.564333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46627cc-6bf9-46cd-8071-77045538d407 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.564642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46627cc-6bf9-46cd-8071-77045538d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.564923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46627cc-6bf9-46cd-8071-77045538d407 admin admin] PATH_INFO: `/v3/projects/6a1056efbd4c4385ae5584c0c2d5beb0/users/a5ab5f0a5da54dd5957880c8b51042d1/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.580440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46627cc-6bf9-46cd-8071-77045538d407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1056efbd4c4385ae5584c0c2d5beb0, user_id=a5ab5f0a5da54dd5957880c8b51042d1, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.583160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46627cc-6bf9-46cd-8071-77045538d407 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.597657 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3983/7943] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:35 2022] PUT /identity/v3/projects/6a1056efbd4c4385ae5584c0c2d5beb0/users/a5ab5f0a5da54dd5957880c8b51042d1/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:35.601877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54089c54-e329-4294-b45e-d411f2c0ec13 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.612321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54089c54-e329-4294-b45e-d411f2c0ec13 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.670192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f5346-7840-4f0d-9509-a0ca4edf18d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.670719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f5346-7840-4f0d-9509-a0ca4edf18d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.671005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f5346-7840-4f0d-9509-a0ca4edf18d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.671284 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f5346-7840-4f0d-9509-a0ca4edf18d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.671929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f5346-7840-4f0d-9509-a0ca4edf18d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.673571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f5346-7840-4f0d-9509-a0ca4edf18d3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.683898 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3961/7944] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:35.688475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46627cc-6bf9-46cd-8071-77045538d407 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.699898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46627cc-6bf9-46cd-8071-77045538d407 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.704650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949da495-ba0d-4d9a-935b-ee152227388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.705354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949da495-ba0d-4d9a-935b-ee152227388e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.705641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949da495-ba0d-4d9a-935b-ee152227388e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.705916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949da495-ba0d-4d9a-935b-ee152227388e admin admin] PATH_INFO: `/v3/projects/6a1056efbd4c4385ae5584c0c2d5beb0/users/a5ab5f0a5da54dd5957880c8b51042d1/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.707841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949da495-ba0d-4d9a-935b-ee152227388e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1056efbd4c4385ae5584c0c2d5beb0, user_id=a5ab5f0a5da54dd5957880c8b51042d1, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.710573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949da495-ba0d-4d9a-935b-ee152227388e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.721012 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3984/7945] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:35 2022] PUT /identity/v3/projects/6a1056efbd4c4385ae5584c0c2d5beb0/users/a5ab5f0a5da54dd5957880c8b51042d1/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:35.732720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809443d0-46ea-4a65-8eea-6047245ed018 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.733014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809443d0-46ea-4a65-8eea-6047245ed018 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.733292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809443d0-46ea-4a65-8eea-6047245ed018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.762617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-809443d0-46ea-4a65-8eea-6047245ed018 None None] MFA Rules not processed for user `a5ab5f0a5da54dd5957880c8b51042d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:35.763851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-809443d0-46ea-4a65-8eea-6047245ed018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:35.772972 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:35.832799 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3962/7946] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:35.837345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949da495-ba0d-4d9a-935b-ee152227388e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.848226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949da495-ba0d-4d9a-935b-ee152227388e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.853776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a3ac3-cd06-4529-ac56-ddc47c623932 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.854402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a3ac3-cd06-4529-ac56-ddc47c623932 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.854672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a3ac3-cd06-4529-ac56-ddc47c623932 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.854954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a3ac3-cd06-4529-ac56-ddc47c623932 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.855633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a3ac3-cd06-4529-ac56-ddc47c623932 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.857255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a3ac3-cd06-4529-ac56-ddc47c623932 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.874452 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3985/7947] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:30:35 2022] POST /identity/v3/roles => generated 234 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:35.878557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809443d0-46ea-4a65-8eea-6047245ed018 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.887864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809443d0-46ea-4a65-8eea-6047245ed018 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.892558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0270336-5609-48dc-aa9b-c75d6ff6dd95 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.893219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0270336-5609-48dc-aa9b-c75d6ff6dd95 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.893500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0270336-5609-48dc-aa9b-c75d6ff6dd95 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.893772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0270336-5609-48dc-aa9b-c75d6ff6dd95 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.894427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0270336-5609-48dc-aa9b-c75d6ff6dd95 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.896015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0270336-5609-48dc-aa9b-c75d6ff6dd95 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.912261 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3963/7948] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:30:35 2022] POST /identity/v3/roles => generated 235 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:35.916514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a3ac3-cd06-4529-ac56-ddc47c623932 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.927034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a3ac3-cd06-4529-ac56-ddc47c623932 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.932304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f57757-71a6-4f66-9710-11da42d6965e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.932946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57757-71a6-4f66-9710-11da42d6965e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.933234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57757-71a6-4f66-9710-11da42d6965e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.933510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57757-71a6-4f66-9710-11da42d6965e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.934174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f57757-71a6-4f66-9710-11da42d6965e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.935764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f57757-71a6-4f66-9710-11da42d6965e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.950936 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3986/7949] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:30:35 2022] POST /identity/v3/roles => generated 234 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:35.954744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0270336-5609-48dc-aa9b-c75d6ff6dd95 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:35.965310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0270336-5609-48dc-aa9b-c75d6ff6dd95 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:35.970053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a5de-459f-4e4c-9d52-67ba47d50713 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:35.970679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a5de-459f-4e4c-9d52-67ba47d50713 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:35.970966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a5de-459f-4e4c-9d52-67ba47d50713 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:35.971245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a5de-459f-4e4c-9d52-67ba47d50713 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:35.971929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a5de-459f-4e4c-9d52-67ba47d50713 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:35.973570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a5de-459f-4e4c-9d52-67ba47d50713 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:35.992748 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3964/7950] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:30:35 2022] POST /identity/v3/domains => generated 275 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:35.994466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f57757-71a6-4f66-9710-11da42d6965e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.004424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f57757-71a6-4f66-9710-11da42d6965e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.060245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5767040-9f0c-43df-9e54-b30d78aa9c6f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.060887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5767040-9f0c-43df-9e54-b30d78aa9c6f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.061177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5767040-9f0c-43df-9e54-b30d78aa9c6f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.061456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5767040-9f0c-43df-9e54-b30d78aa9c6f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.062096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5767040-9f0c-43df-9e54-b30d78aa9c6f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.064270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5767040-9f0c-43df-9e54-b30d78aa9c6f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.102180 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3987/7951] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:35 2022] POST /identity/v3/projects => generated 400 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:36.106437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a5de-459f-4e4c-9d52-67ba47d50713 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.117027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a5de-459f-4e4c-9d52-67ba47d50713 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.174933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a59c13-51fb-4dad-8633-b83d6d230966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.175541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a59c13-51fb-4dad-8633-b83d6d230966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.175825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a59c13-51fb-4dad-8633-b83d6d230966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.176103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a59c13-51fb-4dad-8633-b83d6d230966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/groups` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.176787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a59c13-51fb-4dad-8633-b83d6d230966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.178748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a59c13-51fb-4dad-8633-b83d6d230966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.193803 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3965/7952] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:30:36 2022] POST /identity/v3/groups => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:36.198207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5767040-9f0c-43df-9e54-b30d78aa9c6f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.208562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5767040-9f0c-43df-9e54-b30d78aa9c6f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.213767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dc37c-80b2-4528-a676-1d7b44cd38e9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.214367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dc37c-80b2-4528-a676-1d7b44cd38e9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.214651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dc37c-80b2-4528-a676-1d7b44cd38e9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.214929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dc37c-80b2-4528-a676-1d7b44cd38e9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.215585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dc37c-80b2-4528-a676-1d7b44cd38e9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.217211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dc37c-80b2-4528-a676-1d7b44cd38e9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.231299 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3988/7953] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:30:36 2022] POST /identity/v3/roles => generated 234 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:36.235375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a59c13-51fb-4dad-8633-b83d6d230966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.246196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a59c13-51fb-4dad-8633-b83d6d230966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.250848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd4871-b6a5-4dbf-88bb-614b63832468 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.251454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd4871-b6a5-4dbf-88bb-614b63832468 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.251739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd4871-b6a5-4dbf-88bb-614b63832468 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.252020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd4871-b6a5-4dbf-88bb-614b63832468 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.252733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd4871-b6a5-4dbf-88bb-614b63832468 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.254647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd4871-b6a5-4dbf-88bb-614b63832468 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.279431 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3966/7954] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:36 2022] POST /identity/v3/users => generated 439 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:36.280666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dc37c-80b2-4528-a676-1d7b44cd38e9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.291182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dc37c-80b2-4528-a676-1d7b44cd38e9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.295846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77eb5e-746e-48d7-8b03-c734a3830276 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.296445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77eb5e-746e-48d7-8b03-c734a3830276 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.296766 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77eb5e-746e-48d7-8b03-c734a3830276 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.297047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77eb5e-746e-48d7-8b03-c734a3830276 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.297707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77eb5e-746e-48d7-8b03-c734a3830276 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.298711 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-9a77eb5e-746e-48d7-8b03-c734a3830276 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:36.298711 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:36.298711 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:36.299595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77eb5e-746e-48d7-8b03-c734a3830276 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.317739 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3989/7955] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:30:36 2022] POST /identity/v3/roles => generated 270 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:36.323376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd4871-b6a5-4dbf-88bb-614b63832468 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.333918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd4871-b6a5-4dbf-88bb-614b63832468 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.338911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af219d8d-cfbb-47a9-9222-099ada88ccc3 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.339570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219d8d-cfbb-47a9-9222-099ada88ccc3 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.339858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219d8d-cfbb-47a9-9222-099ada88ccc3 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.340140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219d8d-cfbb-47a9-9222-099ada88ccc3 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/bf482a32072a4cf4a82357a3a09f3654` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.355717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af219d8d-cfbb-47a9-9222-099ada88ccc3 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_grant(project_id=071add0845414c4c817d650399264618, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=bf482a32072a4cf4a82357a3a09f3654)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.358439 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af219d8d-cfbb-47a9-9222-099ada88ccc3 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.372383 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3967/7956] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:36 2022] PUT /identity/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/bf482a32072a4cf4a82357a3a09f3654 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:36.377008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77eb5e-746e-48d7-8b03-c734a3830276 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.382164 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:36.389820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77eb5e-746e-48d7-8b03-c734a3830276 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.448060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.448603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.448918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.449199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.449925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Adding query filter params (scope.project.id=071add0845414c4c817d650399264618, user.id=1ea57eb7b4ff43cb92b630813130bbac) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:36.450241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.452167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.499285 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3990/7957] 10.222.0.27 () {58 vars in 1356 bytes} [Wed Oct 19 01:30:36 2022] GET /identity/v3/role_assignments?scope.project.id=071add0845414c4c817d650399264618&user.id=1ea57eb7b4ff43cb92b630813130bbac&effective => generated 228 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:36.503529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af219d8d-cfbb-47a9-9222-099ada88ccc3 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.514183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af219d8d-cfbb-47a9-9222-099ada88ccc3 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.518823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.519535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.519816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.520092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/bf482a32072a4cf4a82357a3a09f3654` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.522313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=071add0845414c4c817d650399264618, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=bf482a32072a4cf4a82357a3a09f3654)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.525127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.530280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role bf482a32072a4cf4a82357a3a09f3654 was removed from user 1ea57eb7b4ff43cb92b630813130bbac on project 071add0845414c4c817d650399264618. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:36.530566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:36.531222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:36.545200 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3968/7958] 10.222.0.27 () {58 vars in 1467 bytes} [Wed Oct 19 01:30:36 2022] DELETE /identity/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/bf482a32072a4cf4a82357a3a09f3654 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:36.549278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.551044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:36.564748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1333-4a2c-48ff-b2a6-2c9079b7f4cd tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.621603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.622597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.623020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.623467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/bf482a32072a4cf4a82357a3a09f3654` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.624768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=bf482a32072a4cf4a82357a3a09f3654)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.625947 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:36.625947 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:36.625947 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:36.627250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.662435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role bf482a32072a4cf4a82357a3a09f3654 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:36.662726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:36.663395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:36.666178 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3991/7959] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:36 2022] DELETE /identity/v3/roles/bf482a32072a4cf4a82357a3a09f3654 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:36.671232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.682201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa09c53-d54f-4521-9c93-2b6b1d273761 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.694250 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:36.741127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e79d3-fc40-4c14-bb7e-fc995021af3f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.741719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e79d3-fc40-4c14-bb7e-fc995021af3f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.742963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e79d3-fc40-4c14-bb7e-fc995021af3f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.743250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e79d3-fc40-4c14-bb7e-fc995021af3f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/f87ca3f98ae34782b8695a43a6f2bffa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.745526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e79d3-fc40-4c14-bb7e-fc995021af3f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_grant(project_id=071add0845414c4c817d650399264618, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=f87ca3f98ae34782b8695a43a6f2bffa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.748179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e79d3-fc40-4c14-bb7e-fc995021af3f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.761285 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3969/7960] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:36 2022] PUT /identity/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/f87ca3f98ae34782b8695a43a6f2bffa => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:36.765345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.766723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:36.779616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cfc94-e390-474c-baae-61ce980d799c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.805012 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:36.840309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c33b4-a0cd-4e7c-aeac-ecb6cfcb27f6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.840975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c33b4-a0cd-4e7c-aeac-ecb6cfcb27f6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.841265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c33b4-a0cd-4e7c-aeac-ecb6cfcb27f6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.841546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c33b4-a0cd-4e7c-aeac-ecb6cfcb27f6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.843238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c33b4-a0cd-4e7c-aeac-ecb6cfcb27f6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.844254 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-659c33b4-a0cd-4e7c-aeac-ecb6cfcb27f6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:36.844254 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:36.844254 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:36.845188 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c33b4-a0cd-4e7c-aeac-ecb6cfcb27f6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.871015 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3992/7961] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:36 2022] PUT /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 520 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:36.875246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e79d3-fc40-4c14-bb7e-fc995021af3f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:36.886241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e79d3-fc40-4c14-bb7e-fc995021af3f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:36.942369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc91815-347e-4b12-89be-d61f0811afd7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:36.942965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc91815-347e-4b12-89be-d61f0811afd7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:36.943251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc91815-347e-4b12-89be-d61f0811afd7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:36.943528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc91815-347e-4b12-89be-d61f0811afd7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:36.944258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc91815-347e-4b12-89be-d61f0811afd7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Adding query filter params (scope.project.id=071add0845414c4c817d650399264618, user.id=1ea57eb7b4ff43cb92b630813130bbac) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:36.944570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc91815-347e-4b12-89be-d61f0811afd7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:36.947126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc91815-347e-4b12-89be-d61f0811afd7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:36.998534 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3970/7962] 10.222.0.27 () {58 vars in 1356 bytes} [Wed Oct 19 01:30:36 2022] GET /identity/v3/role_assignments?scope.project.id=071add0845414c4c817d650399264618&user.id=1ea57eb7b4ff43cb92b630813130bbac&effective => generated 1061 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:37.002635 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c33b4-a0cd-4e7c-aeac-ecb6cfcb27f6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.014037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c33b4-a0cd-4e7c-aeac-ecb6cfcb27f6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.018731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35387a-6f8d-4d10-86ab-a0b2bcbe54d6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.019394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35387a-6f8d-4d10-86ab-a0b2bcbe54d6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.019678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35387a-6f8d-4d10-86ab-a0b2bcbe54d6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.019957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35387a-6f8d-4d10-86ab-a0b2bcbe54d6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.021620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35387a-6f8d-4d10-86ab-a0b2bcbe54d6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.022624 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-4a35387a-6f8d-4d10-86ab-a0b2bcbe54d6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:37.022624 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:37.022624 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:37.024032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35387a-6f8d-4d10-86ab-a0b2bcbe54d6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.032910 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3993/7963] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:37 2022] DELETE /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:37.037131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc91815-347e-4b12-89be-d61f0811afd7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.048068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc91815-347e-4b12-89be-d61f0811afd7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.105901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadfb6f-5e72-42b6-9768-f1e742998934 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.106520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadfb6f-5e72-42b6-9768-f1e742998934 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.107112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadfb6f-5e72-42b6-9768-f1e742998934 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.107112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadfb6f-5e72-42b6-9768-f1e742998934 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.107785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadfb6f-5e72-42b6-9768-f1e742998934 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Adding query filter params (scope.project.id=071add0845414c4c817d650399264618, user.id=1ea57eb7b4ff43cb92b630813130bbac) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:37.108097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadfb6f-5e72-42b6-9768-f1e742998934 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.109982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadfb6f-5e72-42b6-9768-f1e742998934 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.116250 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:37.158738 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3971/7964] 10.222.0.27 () {58 vars in 1356 bytes} [Wed Oct 19 01:30:37 2022] GET /identity/v3/role_assignments?scope.project.id=071add0845414c4c817d650399264618&user.id=1ea57eb7b4ff43cb92b630813130bbac&effective => generated 577 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:37.163003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35387a-6f8d-4d10-86ab-a0b2bcbe54d6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.173390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35387a-6f8d-4d10-86ab-a0b2bcbe54d6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.178003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.178630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.178915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.179186 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.181402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.182988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] f87ca3f98ae34782b8695a43a6f2bffa does not imply 733352863b094e75a8b5ebc146c25d64.: keystone.exception.ImpliedRoleNotFound: f87ca3f98ae34782b8695a43a6f2bffa does not imply 733352863b094e75a8b5ebc146c25d64. Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = query.one() Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._iter().one() Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._only_one_row( Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:37.205831 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 19 01:30:37.207276 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 19 01:30:37.208435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 19 01:30:37.208435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 19 01:30:37.208435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 19 01:30:37.208435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: f87ca3f98ae34782b8695a43a6f2bffa does not imply 733352863b094e75a8b5ebc146c25d64. Oct 19 01:30:37.208435 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:30:37.208435 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3994/7965] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:37 2022] DELETE /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 137 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:30:37.210993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadfb6f-5e72-42b6-9768-f1e742998934 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.221125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadfb6f-5e72-42b6-9768-f1e742998934 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.225847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.227075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.227384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.227663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/f87ca3f98ae34782b8695a43a6f2bffa` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.230456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=071add0845414c4c817d650399264618, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=f87ca3f98ae34782b8695a43a6f2bffa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.233902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.239325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role f87ca3f98ae34782b8695a43a6f2bffa was removed from user 1ea57eb7b4ff43cb92b630813130bbac on project 071add0845414c4c817d650399264618. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:37.239620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:37.240290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:37.253359 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3972/7966] 10.222.0.27 () {58 vars in 1467 bytes} [Wed Oct 19 01:30:37 2022] DELETE /identity/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/f87ca3f98ae34782b8695a43a6f2bffa => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:37.258873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.260601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:37.273714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52738-bde3-45e7-854b-9a2f4f10141e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.330306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c7108-3b9c-42da-8a65-712e449daeaa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.330920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c7108-3b9c-42da-8a65-712e449daeaa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.331199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c7108-3b9c-42da-8a65-712e449daeaa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.331472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c7108-3b9c-42da-8a65-712e449daeaa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.332134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c7108-3b9c-42da-8a65-712e449daeaa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.333767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c7108-3b9c-42da-8a65-712e449daeaa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.348445 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3995/7967] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:37 2022] POST /identity/v3/roles => generated 272 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:37.353139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.363353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9aae2-b024-4de4-a206-bca65c84ed27 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.368128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.368749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.369033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.369310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.369962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Adding query filter params (domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:37.370266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.371273 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:37.371273 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:37.371273 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:37.372152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.380089 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3973/7968] 10.222.0.27 () {58 vars in 1207 bytes} [Wed Oct 19 01:30:37 2022] GET /identity/v3/roles?domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480 => generated 409 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:37.384608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c7108-3b9c-42da-8a65-712e449daeaa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.394785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c7108-3b9c-42da-8a65-712e449daeaa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.400137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.400823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.401091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.401366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/84699fdddae74393a4a83f7d68b6ab02` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.402488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=84699fdddae74393a4a83f7d68b6ab02)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.404072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.437832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role 84699fdddae74393a4a83f7d68b6ab02 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:37.438372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:37.439041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:37.440878 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3996/7969] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:37 2022] DELETE /identity/v3/roles/84699fdddae74393a4a83f7d68b6ab02 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:37.444901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.447183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:37.459871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df417756-9525-4fae-9ec2-15af102eaf9d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.516919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5e6b-724c-4b84-b4b5-7cbc5a21522f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.517441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5e6b-724c-4b84-b4b5-7cbc5a21522f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.517721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5e6b-724c-4b84-b4b5-7cbc5a21522f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.517996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5e6b-724c-4b84-b4b5-7cbc5a21522f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.518638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f5e6b-724c-4b84-b4b5-7cbc5a21522f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Adding query filter params (domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:37.518935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f5e6b-724c-4b84-b4b5-7cbc5a21522f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.520583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f5e6b-724c-4b84-b4b5-7cbc5a21522f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.526972 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3974/7970] 10.222.0.27 () {58 vars in 1207 bytes} [Wed Oct 19 01:30:37 2022] GET /identity/v3/roles?domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480 => generated 148 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:30:37.531432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.541893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d649-a284-4131-83e0-cb62164fb870 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.546604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da91c-b28a-496c-82b6-da04a4ac9226 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.547232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da91c-b28a-496c-82b6-da04a4ac9226 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.547520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da91c-b28a-496c-82b6-da04a4ac9226 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.547800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da91c-b28a-496c-82b6-da04a4ac9226 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/84699fdddae74393a4a83f7d68b6ab02` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.558948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01da91c-b28a-496c-82b6-da04a4ac9226 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-d01da91c-b28a-496c-82b6-da04a4ac9226 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Could not find role: 84699fdddae74393a4a83f7d68b6ab02.: keystone.exception.RoleNotFound: Could not find role: 84699fdddae74393a4a83f7d68b6ab02. Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 19 01:30:37.563978 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application with Lock( Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:30:37.565370 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 84699fdddae74393a4a83f7d68b6ab02. Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:30:37.566748 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3997/7971] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:37 2022] DELETE /identity/v3/roles/84699fdddae74393a4a83f7d68b6ab02 => generated 110 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:30:37.570582 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5e6b-724c-4b84-b4b5-7cbc5a21522f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.580540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5e6b-724c-4b84-b4b5-7cbc5a21522f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.585185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4909c4-8b7a-47f5-b1bd-0dea1d7c37eb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.586385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4909c4-8b7a-47f5-b1bd-0dea1d7c37eb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.586667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4909c4-8b7a-47f5-b1bd-0dea1d7c37eb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.586937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4909c4-8b7a-47f5-b1bd-0dea1d7c37eb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.592857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4909c4-8b7a-47f5-b1bd-0dea1d7c37eb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480, group_id=c593171b43a14c6da249396a2724cb71, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.595497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4909c4-8b7a-47f5-b1bd-0dea1d7c37eb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.608806 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3975/7972] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:37 2022] PUT /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:37.612845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da91c-b28a-496c-82b6-da04a4ac9226 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.624956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da91c-b28a-496c-82b6-da04a4ac9226 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.651719 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:37.686079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50219d-8522-4049-ac18-21bb0ad60a65 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.686722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50219d-8522-4049-ac18-21bb0ad60a65 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.687000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50219d-8522-4049-ac18-21bb0ad60a65 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.687272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50219d-8522-4049-ac18-21bb0ad60a65 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/groups/c593171b43a14c6da249396a2724cb71/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.689205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50219d-8522-4049-ac18-21bb0ad60a65 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480, group_id=c593171b43a14c6da249396a2724cb71)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.690243 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-1d50219d-8522-4049-ac18-21bb0ad60a65 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:37.690243 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:37.690243 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:37.692060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50219d-8522-4049-ac18-21bb0ad60a65 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.704833 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3998/7973] 10.222.0.27 () {58 vars in 1365 bytes} [Wed Oct 19 01:30:37 2022] GET /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/groups/c593171b43a14c6da249396a2724cb71/roles => generated 409 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:37.708998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4909c4-8b7a-47f5-b1bd-0dea1d7c37eb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.720173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4909c4-8b7a-47f5-b1bd-0dea1d7c37eb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.725004 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d8d32-32f4-4b51-917e-f574c7736e48 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.725681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d8d32-32f4-4b51-917e-f574c7736e48 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.725961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d8d32-32f4-4b51-917e-f574c7736e48 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.726878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d8d32-32f4-4b51-917e-f574c7736e48 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.729093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d8d32-32f4-4b51-917e-f574c7736e48 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480, group_id=c593171b43a14c6da249396a2724cb71, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.731723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d8d32-32f4-4b51-917e-f574c7736e48 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.737418 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3976/7974] 10.222.0.27 () {58 vars in 1465 bytes} [Wed Oct 19 01:30:37 2022] HEAD /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:37.741408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50219d-8522-4049-ac18-21bb0ad60a65 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.751381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50219d-8522-4049-ac18-21bb0ad60a65 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.756080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.756752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.757035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.757308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.759660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480, group_id=c593171b43a14c6da249396a2724cb71, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.762339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.767731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role ac4ff4521b0c4d789d8cb24eed6d3bb1 was removed from group c593171b43a14c6da249396a2724cb71 on domain 2ab6aa3d59cf4c70ad6220fcbadc9480. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:37.767967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:37.768695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:37.783069 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 3999/7975] 10.222.0.27 () {58 vars in 1467 bytes} [Wed Oct 19 01:30:37 2022] DELETE /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:37.788065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d8d32-32f4-4b51-917e-f574c7736e48 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.790655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3e5d8d32-32f4-4b51-917e-f574c7736e48 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:37.803253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d8d32-32f4-4b51-917e-f574c7736e48 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.859943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1ab3d-2816-487a-9551-cb6e29eb9765 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.860601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1ab3d-2816-487a-9551-cb6e29eb9765 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.860923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1ab3d-2816-487a-9551-cb6e29eb9765 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.861203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1ab3d-2816-487a-9551-cb6e29eb9765 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.863448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1ab3d-2816-487a-9551-cb6e29eb9765 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_grant(project_id=071add0845414c4c817d650399264618, group_id=c593171b43a14c6da249396a2724cb71, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.866144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1ab3d-2816-487a-9551-cb6e29eb9765 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.874521 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:37.879348 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3977/7976] 10.222.0.27 () {60 vars in 1486 bytes} [Wed Oct 19 01:30:37 2022] PUT /identity/v3/projects/071add0845414c4c817d650399264618/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:37.883612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.893978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe14a1-ae39-4877-a68d-c54e243ef09b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.951432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b84d-254f-440e-af54-4beb413c3b44 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.952211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b84d-254f-440e-af54-4beb413c3b44 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.952501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b84d-254f-440e-af54-4beb413c3b44 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.952811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b84d-254f-440e-af54-4beb413c3b44 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/groups/c593171b43a14c6da249396a2724cb71/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.954496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537b84d-254f-440e-af54-4beb413c3b44 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_grants(project_id=071add0845414c4c817d650399264618, group_id=c593171b43a14c6da249396a2724cb71)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.957071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537b84d-254f-440e-af54-4beb413c3b44 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:37.969140 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4000/7977] 10.222.0.27 () {58 vars in 1368 bytes} [Wed Oct 19 01:30:37 2022] GET /identity/v3/projects/071add0845414c4c817d650399264618/groups/c593171b43a14c6da249396a2724cb71/roles => generated 410 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:37.973233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1ab3d-2816-487a-9551-cb6e29eb9765 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:37.983637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1ab3d-2816-487a-9551-cb6e29eb9765 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:37.988285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c86ff-3cd8-4421-af23-e252b936545b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:37.988963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c86ff-3cd8-4421-af23-e252b936545b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:37.989247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c86ff-3cd8-4421-af23-e252b936545b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:37.989527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c86ff-3cd8-4421-af23-e252b936545b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/groups/c593171b43a14c6da249396a2724cb71/users/1ea57eb7b4ff43cb92b630813130bbac` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:37.991212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c86ff-3cd8-4421-af23-e252b936545b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c593171b43a14c6da249396a2724cb71, user_id=1ea57eb7b4ff43cb92b630813130bbac)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:37.993224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c86ff-3cd8-4421-af23-e252b936545b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.016278 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3978/7978] 10.222.0.27 () {60 vars in 1360 bytes} [Wed Oct 19 01:30:37 2022] PUT /identity/v3/groups/c593171b43a14c6da249396a2724cb71/users/1ea57eb7b4ff43cb92b630813130bbac => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.020694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb40f3b-d9d5-4f58-bd7d-894278661915 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.020946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb40f3b-d9d5-4f58-bd7d-894278661915 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.021224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb40f3b-d9d5-4f58-bd7d-894278661915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.061480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8fb40f3b-d9d5-4f58-bd7d-894278661915 None None] MFA Rules not processed for user `1ea57eb7b4ff43cb92b630813130bbac`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:38.062700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8fb40f3b-d9d5-4f58-bd7d-894278661915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:38.139316 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:38.160894 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4001/7979] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:30:38.165607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c86ff-3cd8-4421-af23-e252b936545b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.234465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c86ff-3cd8-4421-af23-e252b936545b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.239235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeed7d5-90c7-4189-bc13-60634d51b058 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.239917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeed7d5-90c7-4189-bc13-60634d51b058 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.240202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeed7d5-90c7-4189-bc13-60634d51b058 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.240487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeed7d5-90c7-4189-bc13-60634d51b058 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.243256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeed7d5-90c7-4189-bc13-60634d51b058 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:check_grant(project_id=071add0845414c4c817d650399264618, group_id=c593171b43a14c6da249396a2724cb71, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.246006 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeed7d5-90c7-4189-bc13-60634d51b058 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.252650 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3979/7980] 10.222.0.27 () {58 vars in 1468 bytes} [Wed Oct 19 01:30:38 2022] HEAD /identity/v3/projects/071add0845414c4c817d650399264618/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.256972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb40f3b-d9d5-4f58-bd7d-894278661915 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.269646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb40f3b-d9d5-4f58-bd7d-894278661915 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.275142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.275740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.276027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.276308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.278538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=071add0845414c4c817d650399264618, group_id=c593171b43a14c6da249396a2724cb71, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.281244 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.286561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role ac4ff4521b0c4d789d8cb24eed6d3bb1 was removed from group c593171b43a14c6da249396a2724cb71 on project 071add0845414c4c817d650399264618. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:38.286854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:38.287532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:38.300772 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4002/7981] 10.222.0.27 () {58 vars in 1470 bytes} [Wed Oct 19 01:30:38 2022] DELETE /identity/v3/projects/071add0845414c4c817d650399264618/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:38.304908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeed7d5-90c7-4189-bc13-60634d51b058 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.306645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-faeed7d5-90c7-4189-bc13-60634d51b058 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:38.320809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeed7d5-90c7-4189-bc13-60634d51b058 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.377526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a95ce-f556-4b83-b698-3153077c2a21 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.378174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a95ce-f556-4b83-b698-3153077c2a21 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.378464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a95ce-f556-4b83-b698-3153077c2a21 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.378746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a95ce-f556-4b83-b698-3153077c2a21 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/groups/c593171b43a14c6da249396a2724cb71/users/1ea57eb7b4ff43cb92b630813130bbac` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.380424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a95ce-f556-4b83-b698-3153077c2a21 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c593171b43a14c6da249396a2724cb71, user_id=1ea57eb7b4ff43cb92b630813130bbac)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.382374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a95ce-f556-4b83-b698-3153077c2a21 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.390745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-894a95ce-f556-4b83-b698-3153077c2a21 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1ea57eb7b4ff43cb92b630813130bbac'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:38.404258 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3980/7982] 10.222.0.27 () {58 vars in 1344 bytes} [Wed Oct 19 01:30:38 2022] DELETE /identity/v3/groups/c593171b43a14c6da249396a2724cb71/users/1ea57eb7b4ff43cb92b630813130bbac => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.409452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.419730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611725e1-8d2f-4989-b830-6597f72e3c49 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.478454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c0116-8e2f-4a45-a22a-6837cf4684ad tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.479113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c0116-8e2f-4a45-a22a-6837cf4684ad tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.479402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c0116-8e2f-4a45-a22a-6837cf4684ad tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.479682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c0116-8e2f-4a45-a22a-6837cf4684ad tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/system/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.481410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c0116-8e2f-4a45-a22a-6837cf4684ad tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=c593171b43a14c6da249396a2724cb71, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.482435 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-288c0116-8e2f-4a45-a22a-6837cf4684ad tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:38.482435 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:38.482435 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:38.483351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c0116-8e2f-4a45-a22a-6837cf4684ad tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.491500 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4003/7983] 10.222.0.27 () {60 vars in 1381 bytes} [Wed Oct 19 01:30:38 2022] PUT /identity/v3/system/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.496110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a95ce-f556-4b83-b698-3153077c2a21 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.506462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a95ce-f556-4b83-b698-3153077c2a21 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.511879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34a40-de82-47be-8c56-f03d64563e41 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.512544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34a40-de82-47be-8c56-f03d64563e41 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.512865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34a40-de82-47be-8c56-f03d64563e41 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.513144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34a40-de82-47be-8c56-f03d64563e41 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/system/groups/c593171b43a14c6da249396a2724cb71/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.514325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34a40-de82-47be-8c56-f03d64563e41 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=c593171b43a14c6da249396a2724cb71)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.515396 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-09d34a40-de82-47be-8c56-f03d64563e41 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:38.515396 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:38.515396 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:38.516281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34a40-de82-47be-8c56-f03d64563e41 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.528397 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3981/7984] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 01:30:38 2022] GET /identity/v3/system/groups/c593171b43a14c6da249396a2724cb71/roles => generated 375 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:38.532387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c0116-8e2f-4a45-a22a-6837cf4684ad tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.542702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c0116-8e2f-4a45-a22a-6837cf4684ad tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.547464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6c9e7-671c-428b-915a-2fa31c180a79 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.548103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6c9e7-671c-428b-915a-2fa31c180a79 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.548393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6c9e7-671c-428b-915a-2fa31c180a79 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.548714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6c9e7-671c-428b-915a-2fa31c180a79 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/system/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.550517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6c9e7-671c-428b-915a-2fa31c180a79 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=c593171b43a14c6da249396a2724cb71, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.551528 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-d8c6c9e7-671c-428b-915a-2fa31c180a79 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:38.551528 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:38.551528 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:38.552432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6c9e7-671c-428b-915a-2fa31c180a79 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.559228 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4004/7985] 10.222.0.27 () {58 vars in 1363 bytes} [Wed Oct 19 01:30:38 2022] HEAD /identity/v3/system/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.563029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34a40-de82-47be-8c56-f03d64563e41 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.573826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34a40-de82-47be-8c56-f03d64563e41 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.578545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a77d4-e39a-4557-8812-d1923dbb7caa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.579177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a77d4-e39a-4557-8812-d1923dbb7caa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.579461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a77d4-e39a-4557-8812-d1923dbb7caa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.579763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a77d4-e39a-4557-8812-d1923dbb7caa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/system/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.581454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a77d4-e39a-4557-8812-d1923dbb7caa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=c593171b43a14c6da249396a2724cb71, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.582465 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-c20a77d4-e39a-4557-8812-d1923dbb7caa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:38.582465 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:38.582465 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:38.583344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a77d4-e39a-4557-8812-d1923dbb7caa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.591329 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3982/7986] 10.222.0.27 () {58 vars in 1365 bytes} [Wed Oct 19 01:30:38 2022] DELETE /identity/v3/system/groups/c593171b43a14c6da249396a2724cb71/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.596260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6c9e7-671c-428b-915a-2fa31c180a79 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.606923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6c9e7-671c-428b-915a-2fa31c180a79 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.611493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed63b6e-22f9-45c3-96c1-08e820919a01 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.612142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed63b6e-22f9-45c3-96c1-08e820919a01 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.612449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed63b6e-22f9-45c3-96c1-08e820919a01 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.612769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed63b6e-22f9-45c3-96c1-08e820919a01 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.615068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed63b6e-22f9-45c3-96c1-08e820919a01 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.618482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed63b6e-22f9-45c3-96c1-08e820919a01 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.631695 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4005/7987] 10.222.0.27 () {60 vars in 1480 bytes} [Wed Oct 19 01:30:38 2022] PUT /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.636474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a77d4-e39a-4557-8812-d1923dbb7caa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.646702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a77d4-e39a-4557-8812-d1923dbb7caa tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.680257 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:38.707031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00043a-a512-4a77-92b7-fb2cc2224122 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.707686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00043a-a512-4a77-92b7-fb2cc2224122 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.707972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00043a-a512-4a77-92b7-fb2cc2224122 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.708256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00043a-a512-4a77-92b7-fb2cc2224122 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/users/1ea57eb7b4ff43cb92b630813130bbac/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.709987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00043a-a512-4a77-92b7-fb2cc2224122 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480, user_id=1ea57eb7b4ff43cb92b630813130bbac)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.712753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00043a-a512-4a77-92b7-fb2cc2224122 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.724521 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3983/7988] 10.222.0.27 () {58 vars in 1362 bytes} [Wed Oct 19 01:30:38 2022] GET /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/users/1ea57eb7b4ff43cb92b630813130bbac/roles => generated 408 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:38.729315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed63b6e-22f9-45c3-96c1-08e820919a01 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.739582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed63b6e-22f9-45c3-96c1-08e820919a01 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.744913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a2e1f-ee4e-48a4-abee-b75b2c36cde5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.745563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a2e1f-ee4e-48a4-abee-b75b2c36cde5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.745847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a2e1f-ee4e-48a4-abee-b75b2c36cde5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.746127 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a2e1f-ee4e-48a4-abee-b75b2c36cde5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.748336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a2e1f-ee4e-48a4-abee-b75b2c36cde5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.751032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a2e1f-ee4e-48a4-abee-b75b2c36cde5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.756789 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4006/7989] 10.222.0.27 () {58 vars in 1462 bytes} [Wed Oct 19 01:30:38 2022] HEAD /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.760828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00043a-a512-4a77-92b7-fb2cc2224122 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.770879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00043a-a512-4a77-92b7-fb2cc2224122 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.775626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.776276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.776560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.776878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.779138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.781797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.787074 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role ac4ff4521b0c4d789d8cb24eed6d3bb1 was removed from user 1ea57eb7b4ff43cb92b630813130bbac on domain 2ab6aa3d59cf4c70ad6220fcbadc9480. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:38.787369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:38.788055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:38.801574 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3984/7990] 10.222.0.27 () {58 vars in 1464 bytes} [Wed Oct 19 01:30:38 2022] DELETE /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.807447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a2e1f-ee4e-48a4-abee-b75b2c36cde5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.809473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-607a2e1f-ee4e-48a4-abee-b75b2c36cde5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:38.823289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a2e1f-ee4e-48a4-abee-b75b2c36cde5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.884044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd1686-17c2-45c8-9b61-802e390a6cf0 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.884804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd1686-17c2-45c8-9b61-802e390a6cf0 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.885032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd1686-17c2-45c8-9b61-802e390a6cf0 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.885308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd1686-17c2-45c8-9b61-802e390a6cf0 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.887486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd1686-17c2-45c8-9b61-802e390a6cf0 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_grant(project_id=071add0845414c4c817d650399264618, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.890180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd1686-17c2-45c8-9b61-802e390a6cf0 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.903716 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4007/7991] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:38 2022] PUT /identity/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:38.907903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:38.918028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df945f3b-d548-4f24-9f5e-002a907a577b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:38.975100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e8b5f-5f18-4067-992f-765ccb3cfffe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:38.975779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e8b5f-5f18-4067-992f-765ccb3cfffe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:38.976068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e8b5f-5f18-4067-992f-765ccb3cfffe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:38.976425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e8b5f-5f18-4067-992f-765ccb3cfffe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:38.978201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e8b5f-5f18-4067-992f-765ccb3cfffe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_grants(project_id=071add0845414c4c817d650399264618, user_id=1ea57eb7b4ff43cb92b630813130bbac)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:38.980808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e8b5f-5f18-4067-992f-765ccb3cfffe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:38.992505 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3985/7992] 10.222.0.27 () {58 vars in 1365 bytes} [Wed Oct 19 01:30:38 2022] GET /identity/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles => generated 409 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:38.996698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd1686-17c2-45c8-9b61-802e390a6cf0 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.006951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd1686-17c2-45c8-9b61-802e390a6cf0 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.012067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5240b7-0830-49eb-bd8f-248a10aee899 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.012759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5240b7-0830-49eb-bd8f-248a10aee899 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.013027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5240b7-0830-49eb-bd8f-248a10aee899 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.013539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5240b7-0830-49eb-bd8f-248a10aee899 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.015719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5240b7-0830-49eb-bd8f-248a10aee899 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:check_grant(project_id=071add0845414c4c817d650399264618, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.018408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5240b7-0830-49eb-bd8f-248a10aee899 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.024708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4008/7993] 10.222.0.27 () {58 vars in 1465 bytes} [Wed Oct 19 01:30:38 2022] HEAD /identity/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:39.028509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e8b5f-5f18-4067-992f-765ccb3cfffe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.038564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e8b5f-5f18-4067-992f-765ccb3cfffe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.043237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.043871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.044161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.044442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.046736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=071add0845414c4c817d650399264618, user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.049433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.054977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role ac4ff4521b0c4d789d8cb24eed6d3bb1 was removed from user 1ea57eb7b4ff43cb92b630813130bbac on project 071add0845414c4c817d650399264618. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:39.055268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:39.055953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:39.069621 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3986/7994] 10.222.0.27 () {58 vars in 1467 bytes} [Wed Oct 19 01:30:39 2022] DELETE /identity/v3/projects/071add0845414c4c817d650399264618/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:39.075273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5240b7-0830-49eb-bd8f-248a10aee899 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.077069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea5240b7-0830-49eb-bd8f-248a10aee899 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:39.090520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5240b7-0830-49eb-bd8f-248a10aee899 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.110161 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:39.149140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24880e-b1ab-41e6-b80e-17a233f6ca59 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.149790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24880e-b1ab-41e6-b80e-17a233f6ca59 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.150072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24880e-b1ab-41e6-b80e-17a233f6ca59 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.150350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24880e-b1ab-41e6-b80e-17a233f6ca59 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/system/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.152063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24880e-b1ab-41e6-b80e-17a233f6ca59 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.153095 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-9a24880e-b1ab-41e6-b80e-17a233f6ca59 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:39.153095 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:39.153095 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:39.153988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24880e-b1ab-41e6-b80e-17a233f6ca59 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.160312 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4009/7995] 10.222.0.27 () {60 vars in 1378 bytes} [Wed Oct 19 01:30:39 2022] PUT /identity/v3/system/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:39.164955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.175357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f89055-83ea-408c-8a91-520065d16643 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.180837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57c5ba-fad2-46a1-b8de-fbe88b35f69b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.181474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57c5ba-fad2-46a1-b8de-fbe88b35f69b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.181763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57c5ba-fad2-46a1-b8de-fbe88b35f69b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.182041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57c5ba-fad2-46a1-b8de-fbe88b35f69b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/system/users/1ea57eb7b4ff43cb92b630813130bbac/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.183239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57c5ba-fad2-46a1-b8de-fbe88b35f69b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=1ea57eb7b4ff43cb92b630813130bbac)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.184257 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-ff57c5ba-fad2-46a1-b8de-fbe88b35f69b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:39.184257 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:39.184257 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:39.185189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57c5ba-fad2-46a1-b8de-fbe88b35f69b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.198761 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3987/7996] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 01:30:39 2022] GET /identity/v3/system/users/1ea57eb7b4ff43cb92b630813130bbac/roles => generated 374 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:39.202472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24880e-b1ab-41e6-b80e-17a233f6ca59 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.212593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24880e-b1ab-41e6-b80e-17a233f6ca59 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.217346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086cd6c-40ae-4e72-b289-6587b1065307 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.217975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086cd6c-40ae-4e72-b289-6587b1065307 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.218277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086cd6c-40ae-4e72-b289-6587b1065307 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.218535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086cd6c-40ae-4e72-b289-6587b1065307 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/system/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.221337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086cd6c-40ae-4e72-b289-6587b1065307 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.221337 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-7086cd6c-40ae-4e72-b289-6587b1065307 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:39.221337 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:39.221337 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:39.222107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086cd6c-40ae-4e72-b289-6587b1065307 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.227147 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4010/7997] 10.222.0.27 () {58 vars in 1360 bytes} [Wed Oct 19 01:30:39 2022] HEAD /identity/v3/system/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:39.231137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57c5ba-fad2-46a1-b8de-fbe88b35f69b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.241379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57c5ba-fad2-46a1-b8de-fbe88b35f69b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.246585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7f903-0ec1-4531-aa8e-1dded3395692 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.247220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7f903-0ec1-4531-aa8e-1dded3395692 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.247496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7f903-0ec1-4531-aa8e-1dded3395692 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.247770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7f903-0ec1-4531-aa8e-1dded3395692 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/system/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.249432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7f903-0ec1-4531-aa8e-1dded3395692 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=1ea57eb7b4ff43cb92b630813130bbac, role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.250446 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-47c7f903-0ec1-4531-aa8e-1dded3395692 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:39.250446 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:39.250446 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:39.251321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7f903-0ec1-4531-aa8e-1dded3395692 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.259016 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3988/7998] 10.222.0.27 () {58 vars in 1362 bytes} [Wed Oct 19 01:30:39 2022] DELETE /identity/v3/system/users/1ea57eb7b4ff43cb92b630813130bbac/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:39.263793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086cd6c-40ae-4e72-b289-6587b1065307 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.273759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086cd6c-40ae-4e72-b289-6587b1065307 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.278407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9b13e-a7d5-4c43-959c-dc04bebb0f91 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.278998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b13e-a7d5-4c43-959c-dc04bebb0f91 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.279279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b13e-a7d5-4c43-959c-dc04bebb0f91 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.279552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b13e-a7d5-4c43-959c-dc04bebb0f91 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.280207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9b13e-a7d5-4c43-959c-dc04bebb0f91 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.281805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9b13e-a7d5-4c43-959c-dc04bebb0f91 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.296219 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4011/7999] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:30:39 2022] POST /identity/v3/roles => generated 270 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:39.300066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7f903-0ec1-4531-aa8e-1dded3395692 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.310688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7f903-0ec1-4531-aa8e-1dded3395692 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.315630 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c957f4-e3ba-49e8-8549-d178c502597e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.316218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c957f4-e3ba-49e8-8549-d178c502597e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.316503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c957f4-e3ba-49e8-8549-d178c502597e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.316816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c957f4-e3ba-49e8-8549-d178c502597e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.317500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c957f4-e3ba-49e8-8549-d178c502597e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.318489 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-22c957f4-e3ba-49e8-8549-d178c502597e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:39.318489 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:39.318489 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:39.319366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c957f4-e3ba-49e8-8549-d178c502597e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.335769 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3989/8000] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:30:39 2022] POST /identity/v3/roles => generated 270 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:39.339931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9b13e-a7d5-4c43-959c-dc04bebb0f91 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.350002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9b13e-a7d5-4c43-959c-dc04bebb0f91 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.354618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0999b-de6b-4c6d-bfef-b4cc3ae04f97 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.355251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0999b-de6b-4c6d-bfef-b4cc3ae04f97 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.355542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0999b-de6b-4c6d-bfef-b4cc3ae04f97 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.355820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0999b-de6b-4c6d-bfef-b4cc3ae04f97 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/b827d4e0234846f4a9fb958951424f19` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.357705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0999b-de6b-4c6d-bfef-b4cc3ae04f97 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=be37c54d25684d9188714c20b52b0e79, implied_role_id=b827d4e0234846f4a9fb958951424f19)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.359313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0999b-de6b-4c6d-bfef-b4cc3ae04f97 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.387720 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4012/8001] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:39 2022] PUT /identity/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/b827d4e0234846f4a9fb958951424f19 => generated 531 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:39.388922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c957f4-e3ba-49e8-8549-d178c502597e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.399007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c957f4-e3ba-49e8-8549-d178c502597e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.443598 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:39.457339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dacbb-5b91-437c-b7b3-5bdc741934c6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.457949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dacbb-5b91-437c-b7b3-5bdc741934c6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.458229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dacbb-5b91-437c-b7b3-5bdc741934c6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.458507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dacbb-5b91-437c-b7b3-5bdc741934c6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.459164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dacbb-5b91-437c-b7b3-5bdc741934c6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.460974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dacbb-5b91-437c-b7b3-5bdc741934c6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.477076 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3990/8002] 10.222.0.27 () {60 vars in 1149 bytes} [Wed Oct 19 01:30:39 2022] POST /identity/v3/domains => generated 275 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:39.481169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0999b-de6b-4c6d-bfef-b4cc3ae04f97 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.491581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0999b-de6b-4c6d-bfef-b4cc3ae04f97 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.549900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8bbba-300d-46df-b785-950b4d9fbdbb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.550433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8bbba-300d-46df-b785-950b4d9fbdbb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.550737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8bbba-300d-46df-b785-950b4d9fbdbb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.551009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8bbba-300d-46df-b785-950b4d9fbdbb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.551674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8bbba-300d-46df-b785-950b4d9fbdbb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.553354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8bbba-300d-46df-b785-950b4d9fbdbb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.568361 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4013/8003] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:30:39 2022] POST /identity/v3/roles => generated 269 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:39.572672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dacbb-5b91-437c-b7b3-5bdc741934c6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.582836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dacbb-5b91-437c-b7b3-5bdc741934c6 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.587513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b58de3-10d8-4d9b-aa9f-a913e28832c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.588150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b58de3-10d8-4d9b-aa9f-a913e28832c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.588430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b58de3-10d8-4d9b-aa9f-a913e28832c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.588735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b58de3-10d8-4d9b-aa9f-a913e28832c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/8c584bead7b446b8822d27298607a1c0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.590370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b58de3-10d8-4d9b-aa9f-a913e28832c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=be37c54d25684d9188714c20b52b0e79, implied_role_id=8c584bead7b446b8822d27298607a1c0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.591376 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-00b58de3-10d8-4d9b-aa9f-a913e28832c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:39.591376 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:39.591376 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:39.592248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b58de3-10d8-4d9b-aa9f-a913e28832c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.621403 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3991/8004] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:39 2022] PUT /identity/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/8c584bead7b446b8822d27298607a1c0 => generated 530 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:39.625923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8bbba-300d-46df-b785-950b4d9fbdbb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.636803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8bbba-300d-46df-b785-950b4d9fbdbb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.693203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f89c4c-9071-4924-9af6-2b02fea0f79f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.693852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f89c4c-9071-4924-9af6-2b02fea0f79f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.694138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f89c4c-9071-4924-9af6-2b02fea0f79f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.694417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f89c4c-9071-4924-9af6-2b02fea0f79f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.696103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f89c4c-9071-4924-9af6-2b02fea0f79f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=be37c54d25684d9188714c20b52b0e79, implied_role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.697744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f89c4c-9071-4924-9af6-2b02fea0f79f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.705764 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:39.722439 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4014/8005] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:39 2022] PUT /identity/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 525 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:39.727589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b58de3-10d8-4d9b-aa9f-a913e28832c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.737968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b58de3-10d8-4d9b-aa9f-a913e28832c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.794217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911ff19-15d3-4409-8e78-ce41b91675dc tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.794858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911ff19-15d3-4409-8e78-ce41b91675dc tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.795133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911ff19-15d3-4409-8e78-ce41b91675dc tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.795407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911ff19-15d3-4409-8e78-ce41b91675dc tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1/implies/be37c54d25684d9188714c20b52b0e79` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.797067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911ff19-15d3-4409-8e78-ce41b91675dc tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1, implied_role_id=be37c54d25684d9188714c20b52b0e79)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.798684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911ff19-15d3-4409-8e78-ce41b91675dc tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-b911ff19-15d3-4409-8e78-ce41b91675dc tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] be37c54d25684d9188714c20b52b0e79 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: be37c54d25684d9188714c20b52b0e79 cannot be an implied roles. Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 19 01:30:39.816091 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 19 01:30:39.817475 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:30:39.817475 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:30:39.817475 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 19 01:30:39.817475 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 19 01:30:39.817475 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: be37c54d25684d9188714c20b52b0e79 cannot be an implied roles. Oct 19 01:30:39.817475 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:39.817475 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3992/8006] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:39 2022] PUT /identity/v3/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1/implies/be37c54d25684d9188714c20b52b0e79 => generated 116 bytes in 91 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:30:39.821362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f89c4c-9071-4924-9af6-2b02fea0f79f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.831485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f89c4c-9071-4924-9af6-2b02fea0f79f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.836584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aa7ad-9998-462e-9ae1-2c228522871a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.837242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa7ad-9998-462e-9ae1-2c228522871a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.837522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa7ad-9998-462e-9ae1-2c228522871a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.837794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa7ad-9998-462e-9ae1-2c228522871a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.839435 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aa7ad-9998-462e-9ae1-2c228522871a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=be37c54d25684d9188714c20b52b0e79, implied_role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.841064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aa7ad-9998-462e-9ae1-2c228522871a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.849689 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4015/8007] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:39 2022] DELETE /identity/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:39.854567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911ff19-15d3-4409-8e78-ce41b91675dc tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.866812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911ff19-15d3-4409-8e78-ce41b91675dc tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:39.923172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:39.923813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:39.924098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:39.924371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/8c584bead7b446b8822d27298607a1c0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:39.926073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=be37c54d25684d9188714c20b52b0e79, implied_role_id=8c584bead7b446b8822d27298607a1c0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:39.927087 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:39.927087 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:39.927087 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:39.927973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:39.936803 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3993/8008] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:39 2022] DELETE /identity/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/8c584bead7b446b8822d27298607a1c0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:39.941183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aa7ad-9998-462e-9ae1-2c228522871a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:39.952023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aa7ad-9998-462e-9ae1-2c228522871a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.010715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.011346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.011641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.011918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/8c584bead7b446b8822d27298607a1c0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.013086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8c584bead7b446b8822d27298607a1c0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.014676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.049315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role 8c584bead7b446b8822d27298607a1c0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:40.049636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.050309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.052112 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4016/8009] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:39 2022] DELETE /identity/v3/roles/8c584bead7b446b8822d27298607a1c0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:40.056878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:40.058594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:40.072196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77626e-f323-422c-a715-fb1eeb116ff8 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.111779 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:40.131155 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.131800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.132088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.132470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/7175b812d0634c3b89e69cefd5ad1adc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.144245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7175b812d0634c3b89e69cefd5ad1adc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.145905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.168512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.169223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.193242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.193868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.197093 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3994/8010] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:30:40 2022] PATCH /identity/v3/domains/7175b812d0634c3b89e69cefd5ad1adc => generated 276 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:40.201445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:40.211737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeab29-72e7-4920-88f6-4a99b2f09699 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.267824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.268456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.268774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.269065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/7175b812d0634c3b89e69cefd5ad1adc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.279658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7175b812d0634c3b89e69cefd5ad1adc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.281339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.303954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.315055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.320610 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:40.361637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc', 'request_id': 'req-a4c4e839-743a-4d1c-9dad-a40603d97cbe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.369520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc', 'request_id': 'req-a4c4e839-743a-4d1c-9dad-a40603d97cbe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.375427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc', 'request_id': 'req-a4c4e839-743a-4d1c-9dad-a40603d97cbe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.386833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] The token cache is being invalidate because project 7175b812d0634c3b89e69cefd5ad1adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:40.387123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.387765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.395402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc', 'request_id': 'req-a4c4e839-743a-4d1c-9dad-a40603d97cbe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.398792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc', 'request_id': 'req-a4c4e839-743a-4d1c-9dad-a40603d97cbe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.399476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7175b812d0634c3b89e69cefd5ad1adc', 'request_id': 'req-a4c4e839-743a-4d1c-9dad-a40603d97cbe'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.404994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4017/8011] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:30:40 2022] DELETE /identity/v3/domains/7175b812d0634c3b89e69cefd5ad1adc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:40.409168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:40.410584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:40.423688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b68f3-8a19-49d8-8e12-bb5bcf57d091 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.484228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe9061-4979-4c59-a2b4-c2191852514d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.484919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe9061-4979-4c59-a2b4-c2191852514d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.485205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe9061-4979-4c59-a2b4-c2191852514d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.485483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe9061-4979-4c59-a2b4-c2191852514d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/b827d4e0234846f4a9fb958951424f19` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.487231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe9061-4979-4c59-a2b4-c2191852514d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=be37c54d25684d9188714c20b52b0e79, implied_role_id=b827d4e0234846f4a9fb958951424f19)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.488869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe9061-4979-4c59-a2b4-c2191852514d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.497766 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3995/8012] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:40 2022] DELETE /identity/v3/roles/be37c54d25684d9188714c20b52b0e79/implies/b827d4e0234846f4a9fb958951424f19 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:40.501816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:40.503227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:40.515664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4e839-743a-4d1c-9dad-a40603d97cbe tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.575037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.575671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.575980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.576260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/b827d4e0234846f4a9fb958951424f19` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.577431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b827d4e0234846f4a9fb958951424f19)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.579066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.613433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role b827d4e0234846f4a9fb958951424f19 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:40.613656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.614318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.616237 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4018/8013] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:40 2022] DELETE /identity/v3/roles/b827d4e0234846f4a9fb958951424f19 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:40.621453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe9061-4979-4c59-a2b4-c2191852514d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:40.623163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d4fe9061-4979-4c59-a2b4-c2191852514d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:40.636403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe9061-4979-4c59-a2b4-c2191852514d tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.692923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.693561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.693847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.694122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/be37c54d25684d9188714c20b52b0e79` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.695722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=be37c54d25684d9188714c20b52b0e79)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.696777 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:40.696777 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:40.696777 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:40.697666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.729706 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:40.734283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role be37c54d25684d9188714c20b52b0e79 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:40.734777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.735982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:40.738398 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3996/8014] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:40 2022] DELETE /identity/v3/roles/be37c54d25684d9188714c20b52b0e79 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:40.744270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:40.754364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dcfa1-a165-40c4-b912-dec175cd8730 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.799776 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:40.814561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89e44-7b02-47a2-a2a7-3c1bc4f5a3fb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.815228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89e44-7b02-47a2-a2a7-3c1bc4f5a3fb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.815512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89e44-7b02-47a2-a2a7-3c1bc4f5a3fb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.815789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89e44-7b02-47a2-a2a7-3c1bc4f5a3fb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.817470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a89e44-7b02-47a2-a2a7-3c1bc4f5a3fb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.819063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a89e44-7b02-47a2-a2a7-3c1bc4f5a3fb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.842899 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4019/8015] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:40 2022] PUT /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 520 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:40.846950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:40.848362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:40.861833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6ca22-0eaa-4786-9eed-78ba11908772 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.918145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.918739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `HEAD` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.919009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.919292 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.920996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.922017 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:40.922017 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:40.922017 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:40.922903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.923812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.924712 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:40.924712 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:40.924712 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:40.925542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.931009 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3997/8016] 10.222.0.27 () {58 vars in 1345 bytes} [Wed Oct 19 01:30:40 2022] HEAD /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:40.935061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89e44-7b02-47a2-a2a7-3c1bc4f5a3fb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:40.946590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89e44-7b02-47a2-a2a7-3c1bc4f5a3fb tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.951290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f430ec-03ae-48e6-b8ea-12f6eafa6453 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.951918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f430ec-03ae-48e6-b8ea-12f6eafa6453 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.952203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f430ec-03ae-48e6-b8ea-12f6eafa6453 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.952484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f430ec-03ae-48e6-b8ea-12f6eafa6453 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.954157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f430ec-03ae-48e6-b8ea-12f6eafa6453 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.955167 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-a1f430ec-03ae-48e6-b8ea-12f6eafa6453 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:40.955167 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:40.955167 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:40.956067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f430ec-03ae-48e6-b8ea-12f6eafa6453 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.962634 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4020/8017] 10.222.0.27 () {58 vars in 1344 bytes} [Wed Oct 19 01:30:40 2022] GET /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 520 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:40.966486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:40.976614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7de07-2c3d-4533-ae33-217391c77213 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:40.981208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d302ee5-681e-473f-892d-5a95ade91f3e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:40.981839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d302ee5-681e-473f-892d-5a95ade91f3e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:40.982124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d302ee5-681e-473f-892d-5a95ade91f3e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:40.982407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d302ee5-681e-473f-892d-5a95ade91f3e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:40.984026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d302ee5-681e-473f-892d-5a95ade91f3e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:40.985680 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d302ee5-681e-473f-892d-5a95ade91f3e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:40.994047 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3998/8018] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:40 2022] DELETE /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:40.998355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f430ec-03ae-48e6-b8ea-12f6eafa6453 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.009016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f430ec-03ae-48e6-b8ea-12f6eafa6453 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.067358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab1921-01db-4650-9bda-47c15be8fb3b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.068012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab1921-01db-4650-9bda-47c15be8fb3b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.068298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab1921-01db-4650-9bda-47c15be8fb3b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.068581 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab1921-01db-4650-9bda-47c15be8fb3b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.071063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab1921-01db-4650-9bda-47c15be8fb3b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.072727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab1921-01db-4650-9bda-47c15be8fb3b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-18ab1921-01db-4650-9bda-47c15be8fb3b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] f87ca3f98ae34782b8695a43a6f2bffa does not imply 733352863b094e75a8b5ebc146c25d64.: keystone.exception.ImpliedRoleNotFound: f87ca3f98ae34782b8695a43a6f2bffa does not imply 733352863b094e75a8b5ebc146c25d64. Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = query.one() Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._iter().one() Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._only_one_row( Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:41.081099 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 19 01:30:41.082522 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 19 01:30:41.083861 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 19 01:30:41.083861 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: f87ca3f98ae34782b8695a43a6f2bffa does not imply 733352863b094e75a8b5ebc146c25d64. Oct 19 01:30:41.083861 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:30:41.083861 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4021/8019] 10.222.0.27 () {58 vars in 1344 bytes} [Wed Oct 19 01:30:40 2022] GET /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 137 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 19 01:30:41.087137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d302ee5-681e-473f-892d-5a95ade91f3e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.097696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d302ee5-681e-473f-892d-5a95ade91f3e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.102369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4296e8-cc40-4aae-aff1-d17c4fe0c45c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.103003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4296e8-cc40-4aae-aff1-d17c4fe0c45c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.103289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4296e8-cc40-4aae-aff1-d17c4fe0c45c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.103569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4296e8-cc40-4aae-aff1-d17c4fe0c45c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.105217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4296e8-cc40-4aae-aff1-d17c4fe0c45c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.106832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4296e8-cc40-4aae-aff1-d17c4fe0c45c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-eb4296e8-cc40-4aae-aff1-d17c4fe0c45c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] f87ca3f98ae34782b8695a43a6f2bffa does not imply 733352863b094e75a8b5ebc146c25d64.: keystone.exception.ImpliedRoleNotFound: f87ca3f98ae34782b8695a43a6f2bffa does not imply 733352863b094e75a8b5ebc146c25d64. Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = query.one() Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._iter().one() Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._only_one_row( Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:41.115323 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 19 01:30:41.116809 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 19 01:30:41.118163 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 19 01:30:41.118163 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 19 01:30:41.118163 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 19 01:30:41.118163 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: f87ca3f98ae34782b8695a43a6f2bffa does not imply 733352863b094e75a8b5ebc146c25d64. Oct 19 01:30:41.118163 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:41.118163 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 3999/8020] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:41 2022] DELETE /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 137 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:30:41.121730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab1921-01db-4650-9bda-47c15be8fb3b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.131753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab1921-01db-4650-9bda-47c15be8fb3b tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.137216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dd5f6-bd61-46a9-88b0-cd1bcb09cf60 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.137850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dd5f6-bd61-46a9-88b0-cd1bcb09cf60 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.138136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dd5f6-bd61-46a9-88b0-cd1bcb09cf60 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.138417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dd5f6-bd61-46a9-88b0-cd1bcb09cf60 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.140033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dd5f6-bd61-46a9-88b0-cd1bcb09cf60 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.141637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dd5f6-bd61-46a9-88b0-cd1bcb09cf60 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.166364 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4022/8021] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:41 2022] PUT /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 520 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:41.170469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4296e8-cc40-4aae-aff1-d17c4fe0c45c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.181162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4296e8-cc40-4aae-aff1-d17c4fe0c45c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.236802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9258f-810b-4409-8d3e-3a113ec64966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.237590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9258f-810b-4409-8d3e-3a113ec64966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.237761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9258f-810b-4409-8d3e-3a113ec64966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.237967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9258f-810b-4409-8d3e-3a113ec64966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/686a1c5a961640bca5bc0250baf8fd45` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.239626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9258f-810b-4409-8d3e-3a113ec64966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=686a1c5a961640bca5bc0250baf8fd45)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.241258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9258f-810b-4409-8d3e-3a113ec64966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.265456 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4000/8022] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:41 2022] PUT /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/686a1c5a961640bca5bc0250baf8fd45 => generated 519 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:41.269440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dd5f6-bd61-46a9-88b0-cd1bcb09cf60 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.280043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dd5f6-bd61-46a9-88b0-cd1bcb09cf60 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.336262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e56e9-c6b9-4f00-9946-1c2809e77d9a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.336985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e56e9-c6b9-4f00-9946-1c2809e77d9a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.337272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e56e9-c6b9-4f00-9946-1c2809e77d9a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.337544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e56e9-c6b9-4f00-9946-1c2809e77d9a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.339220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e56e9-c6b9-4f00-9946-1c2809e77d9a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=686a1c5a961640bca5bc0250baf8fd45, implied_role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.340843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e56e9-c6b9-4f00-9946-1c2809e77d9a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.364259 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4023/8023] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:41 2022] PUT /identity/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 519 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:41.368603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9258f-810b-4409-8d3e-3a113ec64966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.378797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9258f-810b-4409-8d3e-3a113ec64966 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.435261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539285b-795e-46f0-9941-d83729951909 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.435771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539285b-795e-46f0-9941-d83729951909 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.436054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539285b-795e-46f0-9941-d83729951909 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.436333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539285b-795e-46f0-9941-d83729951909 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.436932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539285b-795e-46f0-9941-d83729951909 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.437937 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-5539285b-795e-46f0-9941-d83729951909 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:41.437937 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:41.437937 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:41.439085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539285b-795e-46f0-9941-d83729951909 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.440107 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:41.458092 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4001/8024] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 01:30:41 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:41.462832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e56e9-c6b9-4f00-9946-1c2809e77d9a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.473061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e56e9-c6b9-4f00-9946-1c2809e77d9a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.478393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22660e-de6d-42a2-acfa-16995594b11e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.479034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22660e-de6d-42a2-acfa-16995594b11e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.479317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22660e-de6d-42a2-acfa-16995594b11e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.479597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22660e-de6d-42a2-acfa-16995594b11e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.481264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22660e-de6d-42a2-acfa-16995594b11e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=686a1c5a961640bca5bc0250baf8fd45, implied_role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.482853 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22660e-de6d-42a2-acfa-16995594b11e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.486294 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:41.492014 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4024/8025] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:41 2022] DELETE /identity/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:41.496797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539285b-795e-46f0-9941-d83729951909 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.506995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539285b-795e-46f0-9941-d83729951909 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.564378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0289b-1330-46f3-b88f-b304bca70f3c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.565050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0289b-1330-46f3-b88f-b304bca70f3c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.565336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0289b-1330-46f3-b88f-b304bca70f3c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.565616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0289b-1330-46f3-b88f-b304bca70f3c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/686a1c5a961640bca5bc0250baf8fd45` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.567255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0289b-1330-46f3-b88f-b304bca70f3c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=686a1c5a961640bca5bc0250baf8fd45)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.568883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0289b-1330-46f3-b88f-b304bca70f3c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.577009 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4002/8026] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:41 2022] DELETE /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/686a1c5a961640bca5bc0250baf8fd45 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:41.581421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22660e-de6d-42a2-acfa-16995594b11e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.592411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22660e-de6d-42a2-acfa-16995594b11e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.648878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60506d51-4bf8-4b79-b792-5fd723663a9c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.649519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60506d51-4bf8-4b79-b792-5fd723663a9c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.649800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60506d51-4bf8-4b79-b792-5fd723663a9c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.650077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60506d51-4bf8-4b79-b792-5fd723663a9c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.651727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60506d51-4bf8-4b79-b792-5fd723663a9c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.653353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60506d51-4bf8-4b79-b792-5fd723663a9c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.661210 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4025/8027] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:41 2022] DELETE /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:41.667469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0289b-1330-46f3-b88f-b304bca70f3c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.677769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0289b-1330-46f3-b88f-b304bca70f3c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.733902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970656fa-b84c-47ea-8081-96c066bb67f7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.734428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970656fa-b84c-47ea-8081-96c066bb67f7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.734710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970656fa-b84c-47ea-8081-96c066bb67f7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.734986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970656fa-b84c-47ea-8081-96c066bb67f7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.735614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970656fa-b84c-47ea-8081-96c066bb67f7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.737744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970656fa-b84c-47ea-8081-96c066bb67f7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.748847 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4003/8028] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:41 2022] GET /identity/v3/roles => generated 2321 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:41.753779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60506d51-4bf8-4b79-b792-5fd723663a9c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.764687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60506d51-4bf8-4b79-b792-5fd723663a9c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.769339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ef57f-f5e3-4b2e-a9ec-a3a4f493e223 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.769940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ef57f-f5e3-4b2e-a9ec-a3a4f493e223 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.770225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ef57f-f5e3-4b2e-a9ec-a3a4f493e223 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.770505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ef57f-f5e3-4b2e-a9ec-a3a4f493e223 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.771164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ef57f-f5e3-4b2e-a9ec-a3a4f493e223 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.772773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ef57f-f5e3-4b2e-a9ec-a3a4f493e223 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.787257 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4026/8029] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Oct 19 01:30:41 2022] POST /identity/v3/roles => generated 235 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:41.791298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970656fa-b84c-47ea-8081-96c066bb67f7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.801399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970656fa-b84c-47ea-8081-96c066bb67f7 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.806309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc52b9-69f5-4aa4-877d-0d24d1ce363c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.806930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc52b9-69f5-4aa4-877d-0d24d1ce363c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.807217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc52b9-69f5-4aa4-877d-0d24d1ce363c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.807499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc52b9-69f5-4aa4-877d-0d24d1ce363c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/2290d58d12fc4144b5390c718dde729e` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.809035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc52b9-69f5-4aa4-877d-0d24d1ce363c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:update_role(role_id=2290d58d12fc4144b5390c718dde729e)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.810048 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-a9cc52b9-69f5-4aa4-877d-0d24d1ce363c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:41.810048 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:41.810048 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:41.810925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc52b9-69f5-4aa4-877d-0d24d1ce363c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.841760 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4004/8030] 10.222.0.27 () {60 vars in 1243 bytes} [Wed Oct 19 01:30:41 2022] PATCH /identity/v3/roles/2290d58d12fc4144b5390c718dde729e => generated 237 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:41.843004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ef57f-f5e3-4b2e-a9ec-a3a4f493e223 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.853839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ef57f-f5e3-4b2e-a9ec-a3a4f493e223 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.858434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db435b61-df02-4483-b3e6-9851f7d29f3a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.859054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db435b61-df02-4483-b3e6-9851f7d29f3a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.859336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db435b61-df02-4483-b3e6-9851f7d29f3a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.859615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db435b61-df02-4483-b3e6-9851f7d29f3a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/2290d58d12fc4144b5390c718dde729e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.868469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db435b61-df02-4483-b3e6-9851f7d29f3a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:get_role(role_id=2290d58d12fc4144b5390c718dde729e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.869494 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-db435b61-df02-4483-b3e6-9851f7d29f3a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:41.869494 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:41.869494 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:41.870406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db435b61-df02-4483-b3e6-9851f7d29f3a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.871700 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4027/8031] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:30:41 2022] GET /identity/v3/roles/2290d58d12fc4144b5390c718dde729e => generated 237 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:41.875434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc52b9-69f5-4aa4-877d-0d24d1ce363c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.885579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc52b9-69f5-4aa4-877d-0d24d1ce363c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.890260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fe881-23bb-4c37-9eb1-acc2cc154c4e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.890856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe881-23bb-4c37-9eb1-acc2cc154c4e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.891143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe881-23bb-4c37-9eb1-acc2cc154c4e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.891429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe881-23bb-4c37-9eb1-acc2cc154c4e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.892069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fe881-23bb-4c37-9eb1-acc2cc154c4e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.893728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fe881-23bb-4c37-9eb1-acc2cc154c4e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.905344 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4005/8032] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:41 2022] GET /identity/v3/roles => generated 2549 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:41.909517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db435b61-df02-4483-b3e6-9851f7d29f3a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.920106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db435b61-df02-4483-b3e6-9851f7d29f3a tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:41.924804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:41.925427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:41.925712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:41.925990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/2290d58d12fc4144b5390c718dde729e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:41.927447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2290d58d12fc4144b5390c718dde729e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:41.929079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:41.965092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role 2290d58d12fc4144b5390c718dde729e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:41.965701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:41.966172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:41.968088 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4028/8033] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:41 2022] DELETE /identity/v3/roles/2290d58d12fc4144b5390c718dde729e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:41.973097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fe881-23bb-4c37-9eb1-acc2cc154c4e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:41.974837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-969fe881-23bb-4c37-9eb1-acc2cc154c4e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:41.988174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fe881-23bb-4c37-9eb1-acc2cc154c4e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.032784 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:42.047665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471059-77cf-423e-82a9-b25955cf107c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.048317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471059-77cf-423e-82a9-b25955cf107c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.048603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471059-77cf-423e-82a9-b25955cf107c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.048902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471059-77cf-423e-82a9-b25955cf107c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.050694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471059-77cf-423e-82a9-b25955cf107c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.052251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471059-77cf-423e-82a9-b25955cf107c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.076614 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4006/8034] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:41 2022] PUT /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 520 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:42.080755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.091827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bfe03-44fe-4aec-b966-b8f5db6ae23f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.147261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7099-65bf-4082-a8d4-71e9dad6de38 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.147906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7099-65bf-4082-a8d4-71e9dad6de38 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.148734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7099-65bf-4082-a8d4-71e9dad6de38 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.149013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7099-65bf-4082-a8d4-71e9dad6de38 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/686a1c5a961640bca5bc0250baf8fd45` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.150678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed7099-65bf-4082-a8d4-71e9dad6de38 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=686a1c5a961640bca5bc0250baf8fd45)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.152267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed7099-65bf-4082-a8d4-71e9dad6de38 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.176327 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4029/8035] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:42 2022] PUT /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/686a1c5a961640bca5bc0250baf8fd45 => generated 519 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:42.180971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471059-77cf-423e-82a9-b25955cf107c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.191822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471059-77cf-423e-82a9-b25955cf107c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.248915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1543ff2-b6fa-4188-a445-c45d2d21c991 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.249550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1543ff2-b6fa-4188-a445-c45d2d21c991 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.249766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1543ff2-b6fa-4188-a445-c45d2d21c991 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.250048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1543ff2-b6fa-4188-a445-c45d2d21c991 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.251711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1543ff2-b6fa-4188-a445-c45d2d21c991 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=686a1c5a961640bca5bc0250baf8fd45, implied_role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.253351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1543ff2-b6fa-4188-a445-c45d2d21c991 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.280129 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4007/8036] 10.222.0.27 () {60 vars in 1363 bytes} [Wed Oct 19 01:30:42 2022] PUT /identity/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 519 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:42.281345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7099-65bf-4082-a8d4-71e9dad6de38 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.291899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7099-65bf-4082-a8d4-71e9dad6de38 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.299740 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:42.352370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fb16a-e695-4123-a3a0-566285c45293 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.353036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fb16a-e695-4123-a3a0-566285c45293 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.353322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fb16a-e695-4123-a3a0-566285c45293 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.353598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fb16a-e695-4123-a3a0-566285c45293 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.354707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fb16a-e695-4123-a3a0-566285c45293 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=686a1c5a961640bca5bc0250baf8fd45)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.355701 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-277fb16a-e695-4123-a3a0-566285c45293 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:42.355701 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:42.355701 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:42.356592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fb16a-e695-4123-a3a0-566285c45293 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.362202 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4030/8037] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 01:30:42 2022] GET /identity/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies => generated 488 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:30:42.367341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1543ff2-b6fa-4188-a445-c45d2d21c991 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.377707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1543ff2-b6fa-4188-a445-c45d2d21c991 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.382314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61243-fd66-43b2-a6cc-b56a1d934fb5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.383540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61243-fd66-43b2-a6cc-b56a1d934fb5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.383824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61243-fd66-43b2-a6cc-b56a1d934fb5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.384100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61243-fd66-43b2-a6cc-b56a1d934fb5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.385243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f61243-fd66-43b2-a6cc-b56a1d934fb5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.386264 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-54f61243-fd66-43b2-a6cc-b56a1d934fb5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:42.386264 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:42.386264 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:42.387268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f61243-fd66-43b2-a6cc-b56a1d934fb5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.393767 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4008/8038] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 01:30:42 2022] GET /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies => generated 659 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:42.397769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fb16a-e695-4123-a3a0-566285c45293 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.407626 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fb16a-e695-4123-a3a0-566285c45293 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.412191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62013ce8-e2ca-42a0-94ce-17999111c90f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.412841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62013ce8-e2ca-42a0-94ce-17999111c90f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.413121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62013ce8-e2ca-42a0-94ce-17999111c90f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.413397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62013ce8-e2ca-42a0-94ce-17999111c90f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.415093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62013ce8-e2ca-42a0-94ce-17999111c90f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=686a1c5a961640bca5bc0250baf8fd45, implied_role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.416666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62013ce8-e2ca-42a0-94ce-17999111c90f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.425037 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4031/8039] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:42 2022] DELETE /identity/v3/roles/686a1c5a961640bca5bc0250baf8fd45/implies/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:42.429231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61243-fd66-43b2-a6cc-b56a1d934fb5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.440218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61243-fd66-43b2-a6cc-b56a1d934fb5 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.497566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a147fa-eb96-4d20-b28e-aa8e4999251c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.498316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a147fa-eb96-4d20-b28e-aa8e4999251c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.498589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a147fa-eb96-4d20-b28e-aa8e4999251c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.498865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a147fa-eb96-4d20-b28e-aa8e4999251c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/686a1c5a961640bca5bc0250baf8fd45` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.500649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a147fa-eb96-4d20-b28e-aa8e4999251c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=686a1c5a961640bca5bc0250baf8fd45)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.502186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a147fa-eb96-4d20-b28e-aa8e4999251c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.511316 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4009/8040] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:42 2022] DELETE /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/686a1c5a961640bca5bc0250baf8fd45 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:42.515540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62013ce8-e2ca-42a0-94ce-17999111c90f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.526083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62013ce8-e2ca-42a0-94ce-17999111c90f tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.583063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73909e-39bd-48b2-9195-39fe508c1927 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.583825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73909e-39bd-48b2-9195-39fe508c1927 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.584134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73909e-39bd-48b2-9195-39fe508c1927 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.584478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73909e-39bd-48b2-9195-39fe508c1927 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.586564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73909e-39bd-48b2-9195-39fe508c1927 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f87ca3f98ae34782b8695a43a6f2bffa, implied_role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.588184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73909e-39bd-48b2-9195-39fe508c1927 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.596791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4032/8041] 10.222.0.27 () {58 vars in 1347 bytes} [Wed Oct 19 01:30:42 2022] DELETE /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa/implies/733352863b094e75a8b5ebc146c25d64 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:42.602307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a147fa-eb96-4d20-b28e-aa8e4999251c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.612586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a147fa-eb96-4d20-b28e-aa8e4999251c tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.646876 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:42.672906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ba692-3ad8-4cd9-9778-749b1c3b1822 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.673573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ba692-3ad8-4cd9-9778-749b1c3b1822 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.673858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ba692-3ad8-4cd9-9778-749b1c3b1822 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.674136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ba692-3ad8-4cd9-9778-749b1c3b1822 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/7175b812d0634c3b89e69cefd5ad1adc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.681676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ba692-3ad8-4cd9-9778-749b1c3b1822 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-a51ba692-3ad8-4cd9-9778-749b1c3b1822 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Could not find domain: 7175b812d0634c3b89e69cefd5ad1adc.: keystone.exception.DomainNotFound: Could not find domain: 7175b812d0634c3b89e69cefd5ad1adc. Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7175b812d0634c3b89e69cefd5ad1adc. Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:30:42.686648 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:30:42.688085 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7175b812d0634c3b89e69cefd5ad1adc. Oct 19 01:30:42.689710 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:42.691646 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4010/8042] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:30:42 2022] PATCH /identity/v3/domains/7175b812d0634c3b89e69cefd5ad1adc => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:30:42.694214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73909e-39bd-48b2-9195-39fe508c1927 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.704792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73909e-39bd-48b2-9195-39fe508c1927 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.709434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.710047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.710332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.710639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/users/1ea57eb7b4ff43cb92b630813130bbac` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.711871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1ea57eb7b4ff43cb92b630813130bbac)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.713826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.757074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea57eb7b4ff43cb92b630813130bbac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:42.768803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea57eb7b4ff43cb92b630813130bbac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:42.776366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea57eb7b4ff43cb92b630813130bbac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:42.783434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea57eb7b4ff43cb92b630813130bbac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:42.784072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea57eb7b4ff43cb92b630813130bbac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:42.790524 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4033/8043] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:42 2022] DELETE /identity/v3/users/1ea57eb7b4ff43cb92b630813130bbac => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:42.795127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ba692-3ad8-4cd9-9778-749b1c3b1822 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.796843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a51ba692-3ad8-4cd9-9778-749b1c3b1822 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:42.809857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ba692-3ad8-4cd9-9778-749b1c3b1822 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.865705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.866325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.866604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.867499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.868860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ac4ff4521b0c4d789d8cb24eed6d3bb1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.870442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:42.903954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role ac4ff4521b0c4d789d8cb24eed6d3bb1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:42.904261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:42.904933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:42.906680 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4011/8044] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:42 2022] DELETE /identity/v3/roles/ac4ff4521b0c4d789d8cb24eed6d3bb1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:42.910658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:42.921315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb775d-a12b-494e-84a7-c8ea45dcb529 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:42.924905 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:42.983277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061695ab-2097-4e8a-b3a0-210d715528c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:42.983956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061695ab-2097-4e8a-b3a0-210d715528c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:42.984175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061695ab-2097-4e8a-b3a0-210d715528c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:42.984452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061695ab-2097-4e8a-b3a0-210d715528c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/groups/c593171b43a14c6da249396a2724cb71` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:42.985657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061695ab-2097-4e8a-b3a0-210d715528c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c593171b43a14c6da249396a2724cb71)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:42.987579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061695ab-2097-4e8a-b3a0-210d715528c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:43.035555 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4034/8045] 10.222.0.27 () {58 vars in 1227 bytes} [Wed Oct 19 01:30:42 2022] DELETE /identity/v3/groups/c593171b43a14c6da249396a2724cb71 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:43.039471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:43.041069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:43.053731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e9e80-1b50-4e19-8b8a-ede05c6b9491 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:43.115112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:43.116124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:43.116417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:43.117258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/projects/071add0845414c4c817d650399264618` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:43.118731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_project(project_id=071add0845414c4c817d650399264618)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:43.120933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:43.164478 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:43.168840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071add0845414c4c817d650399264618', 'request_id': 'req-e023bdd4-4072-4243-9ac6-b608cf62356e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.176883 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071add0845414c4c817d650399264618', 'request_id': 'req-e023bdd4-4072-4243-9ac6-b608cf62356e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.182565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071add0845414c4c817d650399264618', 'request_id': 'req-e023bdd4-4072-4243-9ac6-b608cf62356e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.193985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] The token cache is being invalidate because project 071add0845414c4c817d650399264618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:43.194266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.195455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.197119 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4012/8046] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:43 2022] DELETE /identity/v3/projects/071add0845414c4c817d650399264618 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:43.201144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061695ab-2097-4e8a-b3a0-210d715528c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:43.202888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-061695ab-2097-4e8a-b3a0-210d715528c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:43.216252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061695ab-2097-4e8a-b3a0-210d715528c9 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:43.273106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:43.274750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:43.275067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:43.275342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:43.276588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:43.278226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:43.300012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.300653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.326226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.327113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.329601 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4035/8047] 10.222.0.27 () {60 vars in 1249 bytes} [Wed Oct 19 01:30:43 2022] PATCH /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480 => generated 276 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:30:43.333677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:43.344783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023bdd4-4072-4243-9ac6-b608cf62356e tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:43.403369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:43.404008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:43.404294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:43.404573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:43.415105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2ab6aa3d59cf4c70ad6220fcbadc9480)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:43.416769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:43.439092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.449567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.489009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480', 'request_id': 'req-aaec535c-f7c9-41a1-a6c1-1ac14980e689'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.496318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480', 'request_id': 'req-aaec535c-f7c9-41a1-a6c1-1ac14980e689'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.502176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480', 'request_id': 'req-aaec535c-f7c9-41a1-a6c1-1ac14980e689'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.514678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] The token cache is being invalidate because project 2ab6aa3d59cf4c70ad6220fcbadc9480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:43.514964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.515613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.524261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480', 'request_id': 'req-aaec535c-f7c9-41a1-a6c1-1ac14980e689'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.524933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480', 'request_id': 'req-aaec535c-f7c9-41a1-a6c1-1ac14980e689'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.525560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2ab6aa3d59cf4c70ad6220fcbadc9480', 'request_id': 'req-aaec535c-f7c9-41a1-a6c1-1ac14980e689'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.533744 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4013/8048] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:30:43 2022] DELETE /identity/v3/domains/2ab6aa3d59cf4c70ad6220fcbadc9480 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:43.537902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:43.539591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:43.552160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570510a-865c-45a1-bb8e-454d98ad50ec tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:43.581477 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:43.610806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:43.611440 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:43.611728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:43.612008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/686a1c5a961640bca5bc0250baf8fd45` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:43.613438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_role(role_id=686a1c5a961640bca5bc0250baf8fd45)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:43.615041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:43.664183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role 686a1c5a961640bca5bc0250baf8fd45 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:43.664531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.665178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.666971 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4036/8049] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:43 2022] DELETE /identity/v3/roles/686a1c5a961640bca5bc0250baf8fd45 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:43.671028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:43.672430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:43.686082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec535c-f7c9-41a1-a6c1-1ac14980e689 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:43.690970 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:43.744565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:43.745227 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:43.745519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:43.745798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/733352863b094e75a8b5ebc146c25d64` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:43.747200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_role(role_id=733352863b094e75a8b5ebc146c25d64)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:43.748843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:43.781878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role 733352863b094e75a8b5ebc146c25d64 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:43.782169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.782832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.784604 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4014/8050] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:43 2022] DELETE /identity/v3/roles/733352863b094e75a8b5ebc146c25d64 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:43.788596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:43.790271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:43.802834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa6e89-9aae-4be1-b6eb-2aba150ced05 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:43.861625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f82ab9-d074-495c-8ad9-66656a559f74 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ab5f0a5da54dd5957880c8b51042d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a1056efbd4c4385ae5584c0c2d5beb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:43.862293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f82ab9-d074-495c-8ad9-66656a559f74 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:43.862577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f82ab9-d074-495c-8ad9-66656a559f74 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:43.862860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f82ab9-d074-495c-8ad9-66656a559f74 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] PATH_INFO: `/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:43.864291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f82ab9-d074-495c-8ad9-66656a559f74 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f87ca3f98ae34782b8695a43a6f2bffa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:43.865916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f82ab9-d074-495c-8ad9-66656a559f74 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:43.902718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-52f82ab9-d074-495c-8ad9-66656a559f74 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invalidating the token cache because role f87ca3f98ae34782b8695a43a6f2bffa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:43.903005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-52f82ab9-d074-495c-8ad9-66656a559f74 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.903698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-52f82ab9-d074-495c-8ad9-66656a559f74 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:43.905615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4037/8051] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:43 2022] DELETE /identity/v3/roles/f87ca3f98ae34782b8695a43a6f2bffa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:43.909712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:43.911131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:43.977567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbbf79-2058-47bf-9361-dad74f7781d2 tempest-RolesV3TestJSON-2054846589 tempest-RolesV3TestJSON-2054846589-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:44.031981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:44.032589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:44.032899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:44.033172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] PATH_INFO: `/v3/users/997daa1e71b845abba55d31fd9b8828a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:44.034393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=997daa1e71b845abba55d31fd9b8828a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:44.036294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:44.061668 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:44.088799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '997daa1e71b845abba55d31fd9b8828a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.102416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '997daa1e71b845abba55d31fd9b8828a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.110053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '997daa1e71b845abba55d31fd9b8828a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.117982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '997daa1e71b845abba55d31fd9b8828a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.118640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '997daa1e71b845abba55d31fd9b8828a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.124474 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4015/8052] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:43 2022] DELETE /identity/v3/users/997daa1e71b845abba55d31fd9b8828a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:44.129041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb3fd4-87e5-4dc1-88d8-7e3ae9fe00dd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:44.129903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb3fd4-87e5-4dc1-88d8-7e3ae9fe00dd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:44.130192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb3fd4-87e5-4dc1-88d8-7e3ae9fe00dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:44.149510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e8eb3fd4-87e5-4dc1-88d8-7e3ae9fe00dd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:44.150723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e8eb3fd4-87e5-4dc1-88d8-7e3ae9fe00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:44.211860 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4038/8053] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:44.221475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:44.222914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:44.283137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e968ed3-470e-4877-b54b-02c90dbf0702 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:44.286782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425be58-9ee5-47d0-8a93-b7bb38b2e13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:44.287418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425be58-9ee5-47d0-8a93-b7bb38b2e13d service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:44.287689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425be58-9ee5-47d0-8a93-b7bb38b2e13d service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:44.287959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425be58-9ee5-47d0-8a93-b7bb38b2e13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:44.297381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425be58-9ee5-47d0-8a93-b7bb38b2e13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:44.298802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425be58-9ee5-47d0-8a93-b7bb38b2e13d service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:44.308755 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4016/8054] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:44.589226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb3fd4-87e5-4dc1-88d8-7e3ae9fe00dd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:44.591026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e8eb3fd4-87e5-4dc1-88d8-7e3ae9fe00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:44.604006 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:44.610956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb3fd4-87e5-4dc1-88d8-7e3ae9fe00dd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:44.623715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:44.624366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:44.624676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:44.624954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] PATH_INFO: `/v3/projects/1d3b7357ca134612b95861c016451ac2` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:44.626091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3b7357ca134612b95861c016451ac2)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:44.628041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:44.676010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3b7357ca134612b95861c016451ac2', 'request_id': 'req-b1d80619-9884-483a-bf95-02f31c54f81a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.683236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3b7357ca134612b95861c016451ac2', 'request_id': 'req-b1d80619-9884-483a-bf95-02f31c54f81a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.689265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3b7357ca134612b95861c016451ac2', 'request_id': 'req-b1d80619-9884-483a-bf95-02f31c54f81a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.700759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] The token cache is being invalidate because project 1d3b7357ca134612b95861c016451ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:44.701052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.701698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.703206 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4039/8055] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:44 2022] DELETE /identity/v3/projects/1d3b7357ca134612b95861c016451ac2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:44.707391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425be58-9ee5-47d0-8a93-b7bb38b2e13d service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:44.718427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425be58-9ee5-47d0-8a93-b7bb38b2e13d service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:44.775370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:44.776001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:44.776282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:44.776558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] PATH_INFO: `/v3/users/a5ab5f0a5da54dd5957880c8b51042d1` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:44.777718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ab5f0a5da54dd5957880c8b51042d1)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:44.779648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:44.823741 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:44.825687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ab5f0a5da54dd5957880c8b51042d1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.841092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ab5f0a5da54dd5957880c8b51042d1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.848276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ab5f0a5da54dd5957880c8b51042d1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.855821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ab5f0a5da54dd5957880c8b51042d1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.856455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a608fcd-4ddf-4fed-b515-bf511dc0be0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ab5f0a5da54dd5957880c8b51042d1'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:44.862281 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4017/8056] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:44 2022] DELETE /identity/v3/users/a5ab5f0a5da54dd5957880c8b51042d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:45.136849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:45.138498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:45.153525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d80619-9884-483a-bf95-02f31c54f81a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:45.212456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:45.213113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.213401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.213677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] PATH_INFO: `/v3/projects/6a1056efbd4c4385ae5584c0c2d5beb0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.214806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1056efbd4c4385ae5584c0c2d5beb0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:45.216751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:45.262391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1056efbd4c4385ae5584c0c2d5beb0', 'request_id': 'req-7aad660c-3d1a-4741-adba-fa5b20eb29d8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:45.269033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1056efbd4c4385ae5584c0c2d5beb0', 'request_id': 'req-7aad660c-3d1a-4741-adba-fa5b20eb29d8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:45.275631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1056efbd4c4385ae5584c0c2d5beb0', 'request_id': 'req-7aad660c-3d1a-4741-adba-fa5b20eb29d8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:45.286528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] The token cache is being invalidate because project 6a1056efbd4c4385ae5584c0c2d5beb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:45.286821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:45.287458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7aad660c-3d1a-4741-adba-fa5b20eb29d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:45.289574 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4040/8057] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:45 2022] DELETE /identity/v3/projects/6a1056efbd4c4385ae5584c0c2d5beb0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:45.294362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcaff4-d55b-4ee7-a52e-5418f53f7eb5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.294675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcaff4-d55b-4ee7-a52e-5418f53f7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.294953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcaff4-d55b-4ee7-a52e-5418f53f7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.315044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2ddcaff4-d55b-4ee7-a52e-5418f53f7eb5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:45.316244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2ddcaff4-d55b-4ee7-a52e-5418f53f7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:45.377633 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4018/8058] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:45.385466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b5f4-4c35-46bb-b0d1-b542ada98e06 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.385692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b5f4-4c35-46bb-b0d1-b542ada98e06 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.385968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b5f4-4c35-46bb-b0d1-b542ada98e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.405758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bc65b5f4-4c35-46bb-b0d1-b542ada98e06 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:45.406953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc65b5f4-4c35-46bb-b0d1-b542ada98e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:45.415669 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4041/8059] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:45.419775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcaff4-d55b-4ee7-a52e-5418f53f7eb5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:45.429633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcaff4-d55b-4ee7-a52e-5418f53f7eb5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:45.434557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b06337-be66-42f5-b65b-910f3e099166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:45.435171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b06337-be66-42f5-b65b-910f3e099166 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.435453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b06337-be66-42f5-b65b-910f3e099166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.435729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b06337-be66-42f5-b65b-910f3e099166 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.436374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b06337-be66-42f5-b65b-910f3e099166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:45.436736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b06337-be66-42f5-b65b-910f3e099166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:45.438648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b06337-be66-42f5-b65b-910f3e099166 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:45.451086 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4019/8060] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:45.455403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65b5f4-4c35-46bb-b0d1-b542ada98e06 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:45.465369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65b5f4-4c35-46bb-b0d1-b542ada98e06 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:45.470144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e3278-b6a9-4eba-bbbe-c980aef296fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:45.470749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e3278-b6a9-4eba-bbbe-c980aef296fa admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.471033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e3278-b6a9-4eba-bbbe-c980aef296fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.471311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e3278-b6a9-4eba-bbbe-c980aef296fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.471950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e3278-b6a9-4eba-bbbe-c980aef296fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:45.473921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e3278-b6a9-4eba-bbbe-c980aef296fa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:45.479298 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:45.502366 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4042/8061] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:45 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:45.506616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b06337-be66-42f5-b65b-910f3e099166 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:45.517484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b06337-be66-42f5-b65b-910f3e099166 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:45.574915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971d5e-77d3-4838-af56-8f41c518f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:45.575502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971d5e-77d3-4838-af56-8f41c518f6bc admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.575779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971d5e-77d3-4838-af56-8f41c518f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.576052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971d5e-77d3-4838-af56-8f41c518f6bc admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.576698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45971d5e-77d3-4838-af56-8f41c518f6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:45.578621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45971d5e-77d3-4838-af56-8f41c518f6bc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:45.601347 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4020/8062] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:45 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:45.605594 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e3278-b6a9-4eba-bbbe-c980aef296fa admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:45.615925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e3278-b6a9-4eba-bbbe-c980aef296fa admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:45.620860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d25fd-5309-460d-ba70-12d8e0f0e0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:45.621458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d25fd-5309-460d-ba70-12d8e0f0e0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.621740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d25fd-5309-460d-ba70-12d8e0f0e0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.622015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d25fd-5309-460d-ba70-12d8e0f0e0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.622659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d25fd-5309-460d-ba70-12d8e0f0e0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:45.624252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d25fd-5309-460d-ba70-12d8e0f0e0c7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:45.634744 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4043/8063] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:45.638838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971d5e-77d3-4838-af56-8f41c518f6bc admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:45.649517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971d5e-77d3-4838-af56-8f41c518f6bc admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:45.654174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ddbf4-2d6f-4deb-b082-4e5e4eea4ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:45.654763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ddbf4-2d6f-4deb-b082-4e5e4eea4ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.655040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ddbf4-2d6f-4deb-b082-4e5e4eea4ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.655311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ddbf4-2d6f-4deb-b082-4e5e4eea4ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.655942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ddbf4-2d6f-4deb-b082-4e5e4eea4ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:45.657560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ddbf4-2d6f-4deb-b082-4e5e4eea4ac2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:45.668272 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4021/8064] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:45.672356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d25fd-5309-460d-ba70-12d8e0f0e0c7 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:45.682619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d25fd-5309-460d-ba70-12d8e0f0e0c7 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:45.687293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98f597-235a-446f-8878-9f4c83dfb961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:45.687935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98f597-235a-446f-8878-9f4c83dfb961 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.688219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98f597-235a-446f-8878-9f4c83dfb961 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.688789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98f597-235a-446f-8878-9f4c83dfb961 admin admin] PATH_INFO: `/v3/projects/f1040dcfbd9e46d78d33b0dfa537b01d/users/6373ed8b58284430868dee2c71b585e8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.703700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98f597-235a-446f-8878-9f4c83dfb961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1040dcfbd9e46d78d33b0dfa537b01d, user_id=6373ed8b58284430868dee2c71b585e8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:45.706428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98f597-235a-446f-8878-9f4c83dfb961 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:45.719789 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4044/8065] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:45 2022] PUT /identity/v3/projects/f1040dcfbd9e46d78d33b0dfa537b01d/users/6373ed8b58284430868dee2c71b585e8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:45.730076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9567921-d087-46a8-a488-b2393a7dd92d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.730595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9567921-d087-46a8-a488-b2393a7dd92d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.730810 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9567921-d087-46a8-a488-b2393a7dd92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.758560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f9567921-d087-46a8-a488-b2393a7dd92d None None] MFA Rules not processed for user `6373ed8b58284430868dee2c71b585e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:45.759814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f9567921-d087-46a8-a488-b2393a7dd92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:45.776702 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:45.827568 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4022/8066] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:45.832045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98f597-235a-446f-8878-9f4c83dfb961 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:45.894385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98f597-235a-446f-8878-9f4c83dfb961 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:45.899719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d900fa-6695-41b8-a71d-b18bc02e5def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:45.900142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d900fa-6695-41b8-a71d-b18bc02e5def admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:45.900434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d900fa-6695-41b8-a71d-b18bc02e5def admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:45.900739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d900fa-6695-41b8-a71d-b18bc02e5def admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:45.901361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d900fa-6695-41b8-a71d-b18bc02e5def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:45.903289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d900fa-6695-41b8-a71d-b18bc02e5def admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:45.929602 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4045/8067] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:45 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:45.933943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9567921-d087-46a8-a488-b2393a7dd92d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:45.944985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9567921-d087-46a8-a488-b2393a7dd92d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.002548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659b17-2dd7-4e89-880e-9db3993a8bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.003150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659b17-2dd7-4e89-880e-9db3993a8bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.003434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659b17-2dd7-4e89-880e-9db3993a8bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.003711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659b17-2dd7-4e89-880e-9db3993a8bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.004348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09659b17-2dd7-4e89-880e-9db3993a8bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.006310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09659b17-2dd7-4e89-880e-9db3993a8bf0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.028068 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4023/8068] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:45 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:46.031721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d900fa-6695-41b8-a71d-b18bc02e5def admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.042816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d900fa-6695-41b8-a71d-b18bc02e5def admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.047595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f25b-87b8-40e5-ab03-878c4476cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.048208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f25b-87b8-40e5-ab03-878c4476cac6 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.048489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f25b-87b8-40e5-ab03-878c4476cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.048825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f25b-87b8-40e5-ab03-878c4476cac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.049480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f25b-87b8-40e5-ab03-878c4476cac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.051067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f25b-87b8-40e5-ab03-878c4476cac6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.062012 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4046/8069] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:46.066332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659b17-2dd7-4e89-880e-9db3993a8bf0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.076437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659b17-2dd7-4e89-880e-9db3993a8bf0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.081131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3714496-68e4-410d-a017-5cd1333d3475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.081784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3714496-68e4-410d-a017-5cd1333d3475 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.082068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3714496-68e4-410d-a017-5cd1333d3475 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.082350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3714496-68e4-410d-a017-5cd1333d3475 admin admin] PATH_INFO: `/v3/projects/a30f1c65d58a46afb5b4f883f3a1d493/users/553d8bf8c83e4eb6bc7a129bfd9dac38/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.098143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3714496-68e4-410d-a017-5cd1333d3475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30f1c65d58a46afb5b4f883f3a1d493, user_id=553d8bf8c83e4eb6bc7a129bfd9dac38, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.100844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3714496-68e4-410d-a017-5cd1333d3475 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.114177 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4024/8070] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:46 2022] PUT /identity/v3/projects/a30f1c65d58a46afb5b4f883f3a1d493/users/553d8bf8c83e4eb6bc7a129bfd9dac38/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:46.118243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f25b-87b8-40e5-ab03-878c4476cac6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.128184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f25b-87b8-40e5-ab03-878c4476cac6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.183932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792706-f673-4d89-acbf-06385002b86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.184565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792706-f673-4d89-acbf-06385002b86d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.184779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792706-f673-4d89-acbf-06385002b86d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.185058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792706-f673-4d89-acbf-06385002b86d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.185700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792706-f673-4d89-acbf-06385002b86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.187327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792706-f673-4d89-acbf-06385002b86d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.198174 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4047/8071] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:46.202366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3714496-68e4-410d-a017-5cd1333d3475 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.213643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3714496-68e4-410d-a017-5cd1333d3475 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.218378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc0ef5-d83f-46fe-b104-578f81c5e92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.219027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc0ef5-d83f-46fe-b104-578f81c5e92c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.219309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc0ef5-d83f-46fe-b104-578f81c5e92c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.219587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc0ef5-d83f-46fe-b104-578f81c5e92c admin admin] PATH_INFO: `/v3/projects/a30f1c65d58a46afb5b4f883f3a1d493/users/553d8bf8c83e4eb6bc7a129bfd9dac38/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.221556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc0ef5-d83f-46fe-b104-578f81c5e92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30f1c65d58a46afb5b4f883f3a1d493, user_id=553d8bf8c83e4eb6bc7a129bfd9dac38, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.224225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc0ef5-d83f-46fe-b104-578f81c5e92c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.234448 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4025/8072] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:46 2022] PUT /identity/v3/projects/a30f1c65d58a46afb5b4f883f3a1d493/users/553d8bf8c83e4eb6bc7a129bfd9dac38/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:46.245550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39213784-185d-4610-9bb8-629c3f9711aa None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.245841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39213784-185d-4610-9bb8-629c3f9711aa None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.246117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39213784-185d-4610-9bb8-629c3f9711aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.273769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-39213784-185d-4610-9bb8-629c3f9711aa None None] MFA Rules not processed for user `553d8bf8c83e4eb6bc7a129bfd9dac38`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:46.275642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-39213784-185d-4610-9bb8-629c3f9711aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:46.284799 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:46.344889 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4048/8073] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:46.349855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc0ef5-d83f-46fe-b104-578f81c5e92c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.360818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc0ef5-d83f-46fe-b104-578f81c5e92c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.365455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aab82-0938-4bb7-84ce-9e99de7aae7b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.366057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aab82-0938-4bb7-84ce-9e99de7aae7b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.366361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aab82-0938-4bb7-84ce-9e99de7aae7b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.366648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aab82-0938-4bb7-84ce-9e99de7aae7b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.367303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aab82-0938-4bb7-84ce-9e99de7aae7b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.369188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aab82-0938-4bb7-84ce-9e99de7aae7b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.385812 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4026/8074] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Oct 19 01:30:46 2022] POST /identity/v3/services => generated 239 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:46.390084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39213784-185d-4610-9bb8-629c3f9711aa None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.400548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39213784-185d-4610-9bb8-629c3f9711aa None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.415660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ffe7-bff3-4a61-a359-9bb3854ce90d tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.416286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ffe7-bff3-4a61-a359-9bb3854ce90d tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.416572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ffe7-bff3-4a61-a359-9bb3854ce90d tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.416883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ffe7-bff3-4a61-a359-9bb3854ce90d tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services/e4753767de414ceaad1dbb4fc4ba8911` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.417463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139ffe7-bff3-4a61-a359-9bb3854ce90d tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e4753767de414ceaad1dbb4fc4ba8911)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.419064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139ffe7-bff3-4a61-a359-9bb3854ce90d tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.440606 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4049/8075] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:46 2022] DELETE /identity/v3/services/e4753767de414ceaad1dbb4fc4ba8911 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:46.446638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aab82-0938-4bb7-84ce-9e99de7aae7b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.457331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aab82-0938-4bb7-84ce-9e99de7aae7b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.472601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dfe79-d0c9-4326-b81f-857adaf90c59 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.473224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dfe79-d0c9-4326-b81f-857adaf90c59 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.473509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dfe79-d0c9-4326-b81f-857adaf90c59 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.473784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dfe79-d0c9-4326-b81f-857adaf90c59 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.474420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dfe79-d0c9-4326-b81f-857adaf90c59 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.476007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dfe79-d0c9-4326-b81f-857adaf90c59 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.490660 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4027/8076] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:46 2022] POST /identity/v3/services => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:46.494870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ffe7-bff3-4a61-a359-9bb3854ce90d tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.506321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ffe7-bff3-4a61-a359-9bb3854ce90d tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.521561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a30e91-1de4-4076-9bb3-145046ddd0f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.522189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a30e91-1de4-4076-9bb3-145046ddd0f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `PATCH` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.522475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a30e91-1de4-4076-9bb3-145046ddd0f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.522755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a30e91-1de4-4076-9bb3-145046ddd0f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services/265177bf909c422a9509073ec9d74481` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.523410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a30e91-1de4-4076-9bb3-145046ddd0f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:update_service(service_id=265177bf909c422a9509073ec9d74481)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.525104 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-72a30e91-1de4-4076-9bb3-145046ddd0f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:46.525104 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:46.525104 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:46.525996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a30e91-1de4-4076-9bb3-145046ddd0f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.542708 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4050/8077] 10.222.0.27 () {60 vars in 1252 bytes} [Wed Oct 19 01:30:46 2022] PATCH /identity/v3/services/265177bf909c422a9509073ec9d74481 => generated 282 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:30:46.546777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dfe79-d0c9-4326-b81f-857adaf90c59 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.558572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dfe79-d0c9-4326-b81f-857adaf90c59 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.574042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657514f4-e3f7-477d-bb16-fcc41593406a tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.574665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657514f4-e3f7-477d-bb16-fcc41593406a tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.574972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657514f4-e3f7-477d-bb16-fcc41593406a tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.575250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657514f4-e3f7-477d-bb16-fcc41593406a tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services/265177bf909c422a9509073ec9d74481` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.575814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657514f4-e3f7-477d-bb16-fcc41593406a tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:get_service(service_id=265177bf909c422a9509073ec9d74481)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.576858 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-657514f4-e3f7-477d-bb16-fcc41593406a tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:46.576858 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:46.576858 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:46.577739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657514f4-e3f7-477d-bb16-fcc41593406a tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.583146 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4028/8078] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:30:46 2022] GET /identity/v3/services/265177bf909c422a9509073ec9d74481 => generated 282 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:46.587611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a30e91-1de4-4076-9bb3-145046ddd0f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.598066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a30e91-1de4-4076-9bb3-145046ddd0f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.603150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc605-28ac-4668-b4ee-f4934271c4b9 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.603769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc605-28ac-4668-b4ee-f4934271c4b9 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.604053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc605-28ac-4668-b4ee-f4934271c4b9 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.604327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc605-28ac-4668-b4ee-f4934271c4b9 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services/265177bf909c422a9509073ec9d74481` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.604936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cc605-28ac-4668-b4ee-f4934271c4b9 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:delete_service(service_id=265177bf909c422a9509073ec9d74481)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.606515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cc605-28ac-4668-b4ee-f4934271c4b9 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.627432 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4051/8079] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:46 2022] DELETE /identity/v3/services/265177bf909c422a9509073ec9d74481 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:46.631503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657514f4-e3f7-477d-bb16-fcc41593406a tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.642546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657514f4-e3f7-477d-bb16-fcc41593406a tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.657273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c140c-8f6b-461d-b99d-27c90ebf0f0f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.657888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c140c-8f6b-461d-b99d-27c90ebf0f0f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.658170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c140c-8f6b-461d-b99d-27c90ebf0f0f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.658442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c140c-8f6b-461d-b99d-27c90ebf0f0f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services/265177bf909c422a9509073ec9d74481` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.659014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c140c-8f6b-461d-b99d-27c90ebf0f0f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:get_service(service_id=265177bf909c422a9509073ec9d74481)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.660594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c140c-8f6b-461d-b99d-27c90ebf0f0f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.663199 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application [None req-547c140c-8f6b-461d-b99d-27c90ebf0f0f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Could not find service: 265177bf909c422a9509073ec9d74481.: keystone.exception.ServiceNotFound: Could not find service: 265177bf909c422a9509073ec9d74481. Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 265177bf909c422a9509073ec9d74481. Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:30:46.671117 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 01:30:46.672581 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application with Lock( Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self._enter() Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application return self.creator() Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application created_value = creator( Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 265177bf909c422a9509073ec9d74481. Oct 19 01:30:46.673835 n-d-master-1 devstack@keystone.service[86424]: ERROR keystone.server.flask.application Oct 19 01:30:46.676118 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4029/8080] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 01:30:46 2022] GET /identity/v3/services/265177bf909c422a9509073ec9d74481 => generated 113 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 19 01:30:46.677444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc605-28ac-4668-b4ee-f4934271c4b9 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.689275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc605-28ac-4668-b4ee-f4934271c4b9 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.694002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccd6eb-d68e-4cd3-8be7-5fc40e356c00 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.694543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccd6eb-d68e-4cd3-8be7-5fc40e356c00 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.694830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccd6eb-d68e-4cd3-8be7-5fc40e356c00 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.695118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccd6eb-d68e-4cd3-8be7-5fc40e356c00 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.696437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccd6eb-d68e-4cd3-8be7-5fc40e356c00 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.698215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccd6eb-d68e-4cd3-8be7-5fc40e356c00 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.713448 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4052/8081] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:46 2022] POST /identity/v3/services => generated 275 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:46.717320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c140c-8f6b-461d-b99d-27c90ebf0f0f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.727893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c140c-8f6b-461d-b99d-27c90ebf0f0f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.743333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf639ad6-d4dd-4643-87f1-43ac88137028 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.743966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf639ad6-d4dd-4643-87f1-43ac88137028 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.744194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf639ad6-d4dd-4643-87f1-43ac88137028 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.744469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf639ad6-d4dd-4643-87f1-43ac88137028 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.745157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf639ad6-d4dd-4643-87f1-43ac88137028 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.746782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf639ad6-d4dd-4643-87f1-43ac88137028 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.761579 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4030/8082] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:46 2022] POST /identity/v3/services => generated 274 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:46.765512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccd6eb-d68e-4cd3-8be7-5fc40e356c00 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.776100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccd6eb-d68e-4cd3-8be7-5fc40e356c00 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.790957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760c8e8-9c43-4350-83a6-8a1b5b2c72f4 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.791557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760c8e8-9c43-4350-83a6-8a1b5b2c72f4 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.791837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760c8e8-9c43-4350-83a6-8a1b5b2c72f4 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.792111 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760c8e8-9c43-4350-83a6-8a1b5b2c72f4 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.792796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760c8e8-9c43-4350-83a6-8a1b5b2c72f4 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.794370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760c8e8-9c43-4350-83a6-8a1b5b2c72f4 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.809056 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4053/8083] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:46 2022] POST /identity/v3/services => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:46.812941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf639ad6-d4dd-4643-87f1-43ac88137028 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.823818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf639ad6-d4dd-4643-87f1-43ac88137028 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.839590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e1173-9b78-410d-a553-fb7ce0f5a309 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.840194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e1173-9b78-410d-a553-fb7ce0f5a309 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.840479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e1173-9b78-410d-a553-fb7ce0f5a309 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.840788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e1173-9b78-410d-a553-fb7ce0f5a309 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.841388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e1173-9b78-410d-a553-fb7ce0f5a309 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.842397 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-4d4e1173-9b78-410d-a553-fb7ce0f5a309 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:46.842397 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:46.842397 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:46.843286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e1173-9b78-410d-a553-fb7ce0f5a309 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.854660 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4031/8084] 10.222.0.27 () {58 vars in 1131 bytes} [Wed Oct 19 01:30:46 2022] GET /identity/v3/services => generated 2979 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:46.855757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760c8e8-9c43-4350-83a6-8a1b5b2c72f4 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.866314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760c8e8-9c43-4350-83a6-8a1b5b2c72f4 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.871034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.871659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.871938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.872213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.872863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1273955002) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:46.873167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.874150 n-d-master-1 devstack@keystone.service[86425]: WARNING py.warnings [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:46.874150 n-d-master-1 devstack@keystone.service[86425]: warnings.warn(msg) Oct 19 01:30:46.874150 n-d-master-1 devstack@keystone.service[86425]: Oct 19 01:30:46.875063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.879991 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4054/8085] 10.222.0.27 () {58 vars in 1222 bytes} [Wed Oct 19 01:30:46 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1273955002 => generated 418 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:46.883740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e1173-9b78-410d-a553-fb7ce0f5a309 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.893519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e1173-9b78-410d-a553-fb7ce0f5a309 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.898110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec02f4f-1156-42b3-8e97-2103aa60d82f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.899218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec02f4f-1156-42b3-8e97-2103aa60d82f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.899495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec02f4f-1156-42b3-8e97-2103aa60d82f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.899770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec02f4f-1156-42b3-8e97-2103aa60d82f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.900384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec02f4f-1156-42b3-8e97-2103aa60d82f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-609209074) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:46.900714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec02f4f-1156-42b3-8e97-2103aa60d82f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.902285 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec02f4f-1156-42b3-8e97-2103aa60d82f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.907069 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4032/8086] 10.222.0.27 () {58 vars in 1220 bytes} [Wed Oct 19 01:30:46 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-609209074 => generated 416 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:46.910906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.921619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1b078-b811-4d97-a505-32dd1ba154d6 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.926339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc047d-ab3a-49f1-bbf4-99902366a6f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.926925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc047d-ab3a-49f1-bbf4-99902366a6f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.927206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc047d-ab3a-49f1-bbf4-99902366a6f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.927480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc047d-ab3a-49f1-bbf4-99902366a6f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.928097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc047d-ab3a-49f1-bbf4-99902366a6f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1567261883) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:46.928407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc047d-ab3a-49f1-bbf4-99902366a6f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.930036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc047d-ab3a-49f1-bbf4-99902366a6f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.935050 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4055/8087] 10.222.0.27 () {58 vars in 1222 bytes} [Wed Oct 19 01:30:46 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1567261883 => generated 418 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:46.938996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec02f4f-1156-42b3-8e97-2103aa60d82f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.950133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec02f4f-1156-42b3-8e97-2103aa60d82f tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:46.954775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b013d7d-1d2f-473a-813c-879bc766aafb tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:46.955390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b013d7d-1d2f-473a-813c-879bc766aafb tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:46.955679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b013d7d-1d2f-473a-813c-879bc766aafb tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:46.955961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b013d7d-1d2f-473a-813c-879bc766aafb tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services/ad19e63690b641e0a1c813bad3bdc2c9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:46.956543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b013d7d-1d2f-473a-813c-879bc766aafb tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ad19e63690b641e0a1c813bad3bdc2c9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:46.957584 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-9b013d7d-1d2f-473a-813c-879bc766aafb tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:30:46.957584 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:30:46.957584 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:30:46.958474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b013d7d-1d2f-473a-813c-879bc766aafb tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:46.982519 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4033/8088] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:46 2022] DELETE /identity/v3/services/ad19e63690b641e0a1c813bad3bdc2c9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:46.986480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc047d-ab3a-49f1-bbf4-99902366a6f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:46.996547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc047d-ab3a-49f1-bbf4-99902366a6f3 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:47.011807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dab55-56f1-4eb7-8793-b36f3182d18b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:47.012451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dab55-56f1-4eb7-8793-b36f3182d18b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:47.012779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dab55-56f1-4eb7-8793-b36f3182d18b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:47.013054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dab55-56f1-4eb7-8793-b36f3182d18b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services/4126ef4ba5514a35aa665c461f3b22bf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:47.013624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dab55-56f1-4eb7-8793-b36f3182d18b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4126ef4ba5514a35aa665c461f3b22bf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:47.015222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dab55-56f1-4eb7-8793-b36f3182d18b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:47.031499 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:47.038026 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4056/8089] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:46 2022] DELETE /identity/v3/services/4126ef4ba5514a35aa665c461f3b22bf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:47.042330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b013d7d-1d2f-473a-813c-879bc766aafb tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:47.053270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b013d7d-1d2f-473a-813c-879bc766aafb tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:47.068505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded3f8-5647-435f-82fd-1df91ab3de58 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553d8bf8c83e4eb6bc7a129bfd9dac38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a30f1c65d58a46afb5b4f883f3a1d493', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:47.069158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded3f8-5647-435f-82fd-1df91ab3de58 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:47.069444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded3f8-5647-435f-82fd-1df91ab3de58 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:47.069720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded3f8-5647-435f-82fd-1df91ab3de58 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] PATH_INFO: `/v3/services/e4ca3acb8f39475389f2324356c05634` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:47.070299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded3f8-5647-435f-82fd-1df91ab3de58 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e4ca3acb8f39475389f2324356c05634)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:47.072526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded3f8-5647-435f-82fd-1df91ab3de58 tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:47.094842 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4034/8090] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:47 2022] DELETE /identity/v3/services/e4ca3acb8f39475389f2324356c05634 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:47.099871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dab55-56f1-4eb7-8793-b36f3182d18b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:47.173615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dab55-56f1-4eb7-8793-b36f3182d18b tempest-ServicesTestJSON-1082075652 tempest-ServicesTestJSON-1082075652-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:47.187786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:47.188731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:47.188960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:47.189232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] PATH_INFO: `/v3/users/6373ed8b58284430868dee2c71b585e8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:47.190371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6373ed8b58284430868dee2c71b585e8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:47.192284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:47.238778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6373ed8b58284430868dee2c71b585e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.250695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6373ed8b58284430868dee2c71b585e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.258583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6373ed8b58284430868dee2c71b585e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.265825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6373ed8b58284430868dee2c71b585e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.266477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6373ed8b58284430868dee2c71b585e8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.272321 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4057/8091] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:47 2022] DELETE /identity/v3/users/6373ed8b58284430868dee2c71b585e8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:47.277690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878282f-b1eb-439a-afed-1304123594cb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:47.277984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878282f-b1eb-439a-afed-1304123594cb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:47.278260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878282f-b1eb-439a-afed-1304123594cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:47.297181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d878282f-b1eb-439a-afed-1304123594cb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:47.298398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d878282f-b1eb-439a-afed-1304123594cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:47.360927 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4035/8092] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:47.371153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:47.372551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:47.442302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2f65b-f2df-4bfe-8618-fd0cad106524 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:47.447163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3225f-7fb1-4951-a004-d24fd0f0f992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:47.447808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3225f-7fb1-4951-a004-d24fd0f0f992 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:47.448086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3225f-7fb1-4951-a004-d24fd0f0f992 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:47.448358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3225f-7fb1-4951-a004-d24fd0f0f992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:47.455332 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:47.458412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3225f-7fb1-4951-a004-d24fd0f0f992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:47.459985 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3225f-7fb1-4951-a004-d24fd0f0f992 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:47.470856 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4058/8093] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:47.740602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878282f-b1eb-439a-afed-1304123594cb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:47.742082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d878282f-b1eb-439a-afed-1304123594cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:47.755906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878282f-b1eb-439a-afed-1304123594cb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:47.761252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a68e29-8694-480d-9548-f010240743be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:47.761902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a68e29-8694-480d-9548-f010240743be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:47.762184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a68e29-8694-480d-9548-f010240743be admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:47.762462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a68e29-8694-480d-9548-f010240743be admin admin] PATH_INFO: `/v3/projects/f1040dcfbd9e46d78d33b0dfa537b01d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:47.763611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a68e29-8694-480d-9548-f010240743be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1040dcfbd9e46d78d33b0dfa537b01d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:47.765576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a68e29-8694-480d-9548-f010240743be admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:47.818766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-44a68e29-8694-480d-9548-f010240743be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1040dcfbd9e46d78d33b0dfa537b01d', 'request_id': 'req-44a68e29-8694-480d-9548-f010240743be'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.820383 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:47.826735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-44a68e29-8694-480d-9548-f010240743be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1040dcfbd9e46d78d33b0dfa537b01d', 'request_id': 'req-44a68e29-8694-480d-9548-f010240743be'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.833489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-44a68e29-8694-480d-9548-f010240743be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1040dcfbd9e46d78d33b0dfa537b01d', 'request_id': 'req-44a68e29-8694-480d-9548-f010240743be'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.845213 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-44a68e29-8694-480d-9548-f010240743be admin admin] The token cache is being invalidate because project f1040dcfbd9e46d78d33b0dfa537b01d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:47.845500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-44a68e29-8694-480d-9548-f010240743be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.846145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-44a68e29-8694-480d-9548-f010240743be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.847634 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4036/8094] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:47 2022] DELETE /identity/v3/projects/f1040dcfbd9e46d78d33b0dfa537b01d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:47.851576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3225f-7fb1-4951-a004-d24fd0f0f992 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:47.862455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3225f-7fb1-4951-a004-d24fd0f0f992 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:47.921439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:47.922073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:47.922350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:47.922620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] PATH_INFO: `/v3/users/553d8bf8c83e4eb6bc7a129bfd9dac38` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:47.923736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553d8bf8c83e4eb6bc7a129bfd9dac38)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:47.925674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:47.979832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553d8bf8c83e4eb6bc7a129bfd9dac38'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:47.992194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553d8bf8c83e4eb6bc7a129bfd9dac38'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:48.000923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553d8bf8c83e4eb6bc7a129bfd9dac38'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:48.008732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553d8bf8c83e4eb6bc7a129bfd9dac38'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:48.009025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-42ba0092-5ab4-49a8-8322-da0ddd672434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553d8bf8c83e4eb6bc7a129bfd9dac38'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:48.015293 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4059/8095] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:47 2022] DELETE /identity/v3/users/553d8bf8c83e4eb6bc7a129bfd9dac38 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:48.301607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a68e29-8694-480d-9548-f010240743be admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:48.303073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-44a68e29-8694-480d-9548-f010240743be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:48.319874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a68e29-8694-480d-9548-f010240743be admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:48.386374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:48.386940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:48.387221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:48.387497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] PATH_INFO: `/v3/projects/a30f1c65d58a46afb5b4f883f3a1d493` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:48.388674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30f1c65d58a46afb5b4f883f3a1d493)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:48.390627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:48.441770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30f1c65d58a46afb5b4f883f3a1d493', 'request_id': 'req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:48.450426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30f1c65d58a46afb5b4f883f3a1d493', 'request_id': 'req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:48.456430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30f1c65d58a46afb5b4f883f3a1d493', 'request_id': 'req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:48.469184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] The token cache is being invalidate because project a30f1c65d58a46afb5b4f883f3a1d493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:48.469471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:48.470111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2c34efe5-d0f1-47e5-902a-50791dcaa8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:48.471590 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4037/8096] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:48 2022] DELETE /identity/v3/projects/a30f1c65d58a46afb5b4f883f3a1d493 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:48.477555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1c9b8-9317-4fc7-9482-2dbbba217dca None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:48.478048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1c9b8-9317-4fc7-9482-2dbbba217dca None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:48.478155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1c9b8-9317-4fc7-9482-2dbbba217dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:48.498861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8aa1c9b8-9317-4fc7-9482-2dbbba217dca None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:48.500135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8aa1c9b8-9317-4fc7-9482-2dbbba217dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:48.699568 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4060/8097] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:48.707367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107c63-3a2d-45a3-a884-762952077227 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:48.707658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107c63-3a2d-45a3-a884-762952077227 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:48.707939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107c63-3a2d-45a3-a884-762952077227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:48.728693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-57107c63-3a2d-45a3-a884-762952077227 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:48.729914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-57107c63-3a2d-45a3-a884-762952077227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:48.738119 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4038/8098] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:48.743948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1c9b8-9317-4fc7-9482-2dbbba217dca None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:48.753881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1c9b8-9317-4fc7-9482-2dbbba217dca None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:48.759166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94d58f-c45e-4bbe-8361-b78897d04ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:48.759788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94d58f-c45e-4bbe-8361-b78897d04ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:48.760094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94d58f-c45e-4bbe-8361-b78897d04ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:48.760385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94d58f-c45e-4bbe-8361-b78897d04ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:48.761050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94d58f-c45e-4bbe-8361-b78897d04ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:48.761347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94d58f-c45e-4bbe-8361-b78897d04ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:48.762921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94d58f-c45e-4bbe-8361-b78897d04ad4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:48.775486 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4061/8099] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:48.779834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57107c63-3a2d-45a3-a884-762952077227 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:48.789065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57107c63-3a2d-45a3-a884-762952077227 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:48.794216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac550a5-0d5c-4ae7-b098-1bc1c8a862e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:48.794811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac550a5-0d5c-4ae7-b098-1bc1c8a862e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:48.795089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac550a5-0d5c-4ae7-b098-1bc1c8a862e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:48.795366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac550a5-0d5c-4ae7-b098-1bc1c8a862e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:48.795982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac550a5-0d5c-4ae7-b098-1bc1c8a862e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:48.797897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac550a5-0d5c-4ae7-b098-1bc1c8a862e2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:48.834451 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4039/8100] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:48 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:48.835769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94d58f-c45e-4bbe-8361-b78897d04ad4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:48.841242 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:48.847744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94d58f-c45e-4bbe-8361-b78897d04ad4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:48.910952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7a62b-e6d7-4ba2-a08e-840b62885f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:48.911561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7a62b-e6d7-4ba2-a08e-840b62885f45 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:48.911837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7a62b-e6d7-4ba2-a08e-840b62885f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:48.912106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7a62b-e6d7-4ba2-a08e-840b62885f45 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:48.912761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7a62b-e6d7-4ba2-a08e-840b62885f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:48.914690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7a62b-e6d7-4ba2-a08e-840b62885f45 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:48.936038 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4062/8101] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:48 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:48.940603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac550a5-0d5c-4ae7-b098-1bc1c8a862e2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:48.951832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac550a5-0d5c-4ae7-b098-1bc1c8a862e2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:48.956805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823671a-c77f-46ca-96f3-0b3afe66308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:48.957412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823671a-c77f-46ca-96f3-0b3afe66308a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:48.957697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823671a-c77f-46ca-96f3-0b3afe66308a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:48.957971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823671a-c77f-46ca-96f3-0b3afe66308a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:48.958614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823671a-c77f-46ca-96f3-0b3afe66308a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:48.960224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823671a-c77f-46ca-96f3-0b3afe66308a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:48.970430 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4040/8102] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:48.974778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7a62b-e6d7-4ba2-a08e-840b62885f45 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:48.985559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7a62b-e6d7-4ba2-a08e-840b62885f45 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:48.990495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bfae9-dcb9-47ec-9276-eed1d5b79129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:48.991172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bfae9-dcb9-47ec-9276-eed1d5b79129 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:48.991457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bfae9-dcb9-47ec-9276-eed1d5b79129 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:48.991735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bfae9-dcb9-47ec-9276-eed1d5b79129 admin admin] PATH_INFO: `/v3/projects/70531f1a67de4d318b8e2f0f4388281d/users/4a8b4dc85e414bebb9efa11d60e6e9f6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.009358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bfae9-dcb9-47ec-9276-eed1d5b79129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70531f1a67de4d318b8e2f0f4388281d, user_id=4a8b4dc85e414bebb9efa11d60e6e9f6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:49.012116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bfae9-dcb9-47ec-9276-eed1d5b79129 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:49.026919 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4063/8103] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:48 2022] PUT /identity/v3/projects/70531f1a67de4d318b8e2f0f4388281d/users/4a8b4dc85e414bebb9efa11d60e6e9f6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:49.030998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823671a-c77f-46ca-96f3-0b3afe66308a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:49.042443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823671a-c77f-46ca-96f3-0b3afe66308a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:49.073794 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:49.107136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d87eb-d451-4f57-9492-dde01db04bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:49.107749 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d87eb-d451-4f57-9492-dde01db04bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.108034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d87eb-d451-4f57-9492-dde01db04bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.108311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d87eb-d451-4f57-9492-dde01db04bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.108984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d87eb-d451-4f57-9492-dde01db04bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:49.110577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d87eb-d451-4f57-9492-dde01db04bf4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:49.120240 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4041/8104] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:49.124497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bfae9-dcb9-47ec-9276-eed1d5b79129 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:49.134973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bfae9-dcb9-47ec-9276-eed1d5b79129 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:49.139608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c752f-df55-4e6c-be8a-577d834b5b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:49.140251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c752f-df55-4e6c-be8a-577d834b5b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.140524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c752f-df55-4e6c-be8a-577d834b5b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.140821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c752f-df55-4e6c-be8a-577d834b5b02 admin admin] PATH_INFO: `/v3/projects/70531f1a67de4d318b8e2f0f4388281d/users/4a8b4dc85e414bebb9efa11d60e6e9f6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.142734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c752f-df55-4e6c-be8a-577d834b5b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70531f1a67de4d318b8e2f0f4388281d, user_id=4a8b4dc85e414bebb9efa11d60e6e9f6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:49.145361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c752f-df55-4e6c-be8a-577d834b5b02 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:49.156038 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4064/8105] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:49 2022] PUT /identity/v3/projects/70531f1a67de4d318b8e2f0f4388281d/users/4a8b4dc85e414bebb9efa11d60e6e9f6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:49.166829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09241d1b-a9f2-47f3-a0ae-093fc6b0f947 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.167111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09241d1b-a9f2-47f3-a0ae-093fc6b0f947 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.167380 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09241d1b-a9f2-47f3-a0ae-093fc6b0f947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.194720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-09241d1b-a9f2-47f3-a0ae-093fc6b0f947 None None] MFA Rules not processed for user `4a8b4dc85e414bebb9efa11d60e6e9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:49.196408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-09241d1b-a9f2-47f3-a0ae-093fc6b0f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:49.264793 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4042/8106] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:49.269296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c752f-df55-4e6c-be8a-577d834b5b02 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:49.331362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c752f-df55-4e6c-be8a-577d834b5b02 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:49.336882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8611e-646f-41e4-85b8-2f82d8fd8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:49.337876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8611e-646f-41e4-85b8-2f82d8fd8158 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.338160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8611e-646f-41e4-85b8-2f82d8fd8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.338444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8611e-646f-41e4-85b8-2f82d8fd8158 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.339079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8611e-646f-41e4-85b8-2f82d8fd8158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:49.341009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8611e-646f-41e4-85b8-2f82d8fd8158 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:49.366802 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4065/8107] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:49 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:49.371049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09241d1b-a9f2-47f3-a0ae-093fc6b0f947 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:49.381615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09241d1b-a9f2-47f3-a0ae-093fc6b0f947 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:49.442654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97899e66-91bb-4e73-a427-4338002cdd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:49.443263 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97899e66-91bb-4e73-a427-4338002cdd5f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.443548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97899e66-91bb-4e73-a427-4338002cdd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.443826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97899e66-91bb-4e73-a427-4338002cdd5f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.444452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97899e66-91bb-4e73-a427-4338002cdd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:49.446964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97899e66-91bb-4e73-a427-4338002cdd5f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:49.470635 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4043/8108] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:49 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:49.471972 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8611e-646f-41e4-85b8-2f82d8fd8158 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:49.489840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8611e-646f-41e4-85b8-2f82d8fd8158 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:49.495305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a753f-3d88-47b1-bf3a-5b3aab792fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:49.495913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a753f-3d88-47b1-bf3a-5b3aab792fff admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.496197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a753f-3d88-47b1-bf3a-5b3aab792fff admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.496477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a753f-3d88-47b1-bf3a-5b3aab792fff admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.497152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a753f-3d88-47b1-bf3a-5b3aab792fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:49.498740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a753f-3d88-47b1-bf3a-5b3aab792fff admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:49.509918 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4066/8109] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:49.513976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97899e66-91bb-4e73-a427-4338002cdd5f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:49.524867 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97899e66-91bb-4e73-a427-4338002cdd5f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:49.529610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcf571-288a-457d-b082-250432aa4250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:49.530221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcf571-288a-457d-b082-250432aa4250 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.530619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcf571-288a-457d-b082-250432aa4250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.530930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcf571-288a-457d-b082-250432aa4250 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.531571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcf571-288a-457d-b082-250432aa4250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:49.533200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcf571-288a-457d-b082-250432aa4250 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:49.543765 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4044/8110] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:49.547906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a753f-3d88-47b1-bf3a-5b3aab792fff admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:49.558777 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a753f-3d88-47b1-bf3a-5b3aab792fff admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:49.563790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932c125-5233-4184-a1ad-945f785c2afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:49.564442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932c125-5233-4184-a1ad-945f785c2afc admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.564758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932c125-5233-4184-a1ad-945f785c2afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.565033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932c125-5233-4184-a1ad-945f785c2afc admin admin] PATH_INFO: `/v3/projects/825b838e4e054862855b77b2ae7d1bca/users/3fb3358375c745a999997c70832c6981/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.580151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932c125-5233-4184-a1ad-945f785c2afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=825b838e4e054862855b77b2ae7d1bca, user_id=3fb3358375c745a999997c70832c6981, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:49.582845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932c125-5233-4184-a1ad-945f785c2afc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:49.596354 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4067/8111] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:49 2022] PUT /identity/v3/projects/825b838e4e054862855b77b2ae7d1bca/users/3fb3358375c745a999997c70832c6981/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:49.607664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a9452-99b2-4694-ac45-3e512b058fd4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.607956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a9452-99b2-4694-ac45-3e512b058fd4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.608239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a9452-99b2-4694-ac45-3e512b058fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.639817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-839a9452-99b2-4694-ac45-3e512b058fd4 None None] MFA Rules not processed for user `3fb3358375c745a999997c70832c6981`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:49.641069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-839a9452-99b2-4694-ac45-3e512b058fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:49.657677 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:49.707072 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4045/8112] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:49.719307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932c125-5233-4184-a1ad-945f785c2afc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:49.721066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6932c125-5233-4184-a1ad-945f785c2afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:49.725768 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:49.802306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932c125-5233-4184-a1ad-945f785c2afc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:49.806432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b98a58-976c-44c8-9f3a-a4d1c6da525d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:49.807033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98a58-976c-44c8-9f3a-a4d1c6da525d service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:49.807311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98a58-976c-44c8-9f3a-a4d1c6da525d service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:49.807583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98a58-976c-44c8-9f3a-a4d1c6da525d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:49.866373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b98a58-976c-44c8-9f3a-a4d1c6da525d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:49.868472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b98a58-976c-44c8-9f3a-a4d1c6da525d service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:49.877992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4068/8113] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:50.701467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a9452-99b2-4694-ac45-3e512b058fd4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:50.764221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a9452-99b2-4694-ac45-3e512b058fd4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:50.768755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:50.769415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:50.769694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:50.769973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] PATH_INFO: `/v3/users/4a8b4dc85e414bebb9efa11d60e6e9f6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:50.771098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8b4dc85e414bebb9efa11d60e6e9f6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:50.773053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:50.819964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8b4dc85e414bebb9efa11d60e6e9f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:50.832277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8b4dc85e414bebb9efa11d60e6e9f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:50.840446 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8b4dc85e414bebb9efa11d60e6e9f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:50.847528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8b4dc85e414bebb9efa11d60e6e9f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:50.848173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8b4dc85e414bebb9efa11d60e6e9f6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:50.854073 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4046/8114] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:50 2022] DELETE /identity/v3/users/4a8b4dc85e414bebb9efa11d60e6e9f6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:30:50.858598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22a6b-e9c5-4ddf-bf18-62fdad72d068 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:50.859093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22a6b-e9c5-4ddf-bf18-62fdad72d068 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:50.859201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22a6b-e9c5-4ddf-bf18-62fdad72d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:50.878696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d5b22a6b-e9c5-4ddf-bf18-62fdad72d068 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:50.879932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d5b22a6b-e9c5-4ddf-bf18-62fdad72d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:50.938894 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4069/8115] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:50.949875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:50.951316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:50.993697 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:51.013254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06a9c3-1cfe-4bb8-adb2-5b3085d0593e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:51.016866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b7064-1723-41b8-9cdd-e79d8891ae51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:51.017465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b7064-1723-41b8-9cdd-e79d8891ae51 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:51.017742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b7064-1723-41b8-9cdd-e79d8891ae51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:51.018011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b7064-1723-41b8-9cdd-e79d8891ae51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:51.027555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b7064-1723-41b8-9cdd-e79d8891ae51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:51.029007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b7064-1723-41b8-9cdd-e79d8891ae51 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:51.038340 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4047/8116] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:51.316093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b22a6b-e9c5-4ddf-bf18-62fdad72d068 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:51.318525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d5b22a6b-e9c5-4ddf-bf18-62fdad72d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:51.337370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b22a6b-e9c5-4ddf-bf18-62fdad72d068 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:51.343294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:51.343944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:51.344372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:51.344571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] PATH_INFO: `/v3/projects/70531f1a67de4d318b8e2f0f4388281d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:51.345794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70531f1a67de4d318b8e2f0f4388281d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:51.347763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:51.383121 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:51.397660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70531f1a67de4d318b8e2f0f4388281d', 'request_id': 'req-6a575d65-5a51-41b5-abfb-82218446c9d9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.405938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70531f1a67de4d318b8e2f0f4388281d', 'request_id': 'req-6a575d65-5a51-41b5-abfb-82218446c9d9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.411577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70531f1a67de4d318b8e2f0f4388281d', 'request_id': 'req-6a575d65-5a51-41b5-abfb-82218446c9d9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.423021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] The token cache is being invalidate because project 70531f1a67de4d318b8e2f0f4388281d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:51.423312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.423965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.425549 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4070/8117] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:51 2022] DELETE /identity/v3/projects/70531f1a67de4d318b8e2f0f4388281d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:51.429515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b7064-1723-41b8-9cdd-e79d8891ae51 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:51.439993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b7064-1723-41b8-9cdd-e79d8891ae51 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:51.497861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:51.498489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:51.498770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:51.499046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] PATH_INFO: `/v3/users/3fb3358375c745a999997c70832c6981` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:51.500162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb3358375c745a999997c70832c6981)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:51.502140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:51.548485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb3358375c745a999997c70832c6981'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.560443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb3358375c745a999997c70832c6981'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.568104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb3358375c745a999997c70832c6981'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.575753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb3358375c745a999997c70832c6981'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.576399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-be7902c1-0683-4494-9356-6374a42ab1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb3358375c745a999997c70832c6981'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.582277 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4048/8118] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:51 2022] DELETE /identity/v3/users/3fb3358375c745a999997c70832c6981 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:51.856346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:51.857932 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:51.871542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a575d65-5a51-41b5-abfb-82218446c9d9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:51.930094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:51.930862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:51.931197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:51.931414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] PATH_INFO: `/v3/projects/825b838e4e054862855b77b2ae7d1bca` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:51.932523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] RBAC: Authorizing `identity:delete_project(project_id=825b838e4e054862855b77b2ae7d1bca)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:51.934436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:51.980361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '825b838e4e054862855b77b2ae7d1bca', 'request_id': 'req-fc2da298-3b71-4161-8678-01627e68bfab'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.987237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '825b838e4e054862855b77b2ae7d1bca', 'request_id': 'req-fc2da298-3b71-4161-8678-01627e68bfab'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:51.992802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '825b838e4e054862855b77b2ae7d1bca', 'request_id': 'req-fc2da298-3b71-4161-8678-01627e68bfab'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:52.003644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] The token cache is being invalidate because project 825b838e4e054862855b77b2ae7d1bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:52.003934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:52.004576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fc2da298-3b71-4161-8678-01627e68bfab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:52.006083 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4071/8119] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:51 2022] DELETE /identity/v3/projects/825b838e4e054862855b77b2ae7d1bca => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:52.011452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87970a-7599-4c7d-9b28-acc1c2f995f1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.011944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87970a-7599-4c7d-9b28-acc1c2f995f1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.012056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87970a-7599-4c7d-9b28-acc1c2f995f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.031750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5e87970a-7599-4c7d-9b28-acc1c2f995f1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:52.032973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5e87970a-7599-4c7d-9b28-acc1c2f995f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:52.083776 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:52.094353 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4049/8120] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:52.101984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfb125-585b-4deb-8603-3c529e112f4c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.102278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfb125-585b-4deb-8603-3c529e112f4c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.102692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfb125-585b-4deb-8603-3c529e112f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.122236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-aedfb125-585b-4deb-8603-3c529e112f4c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:52.123445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-aedfb125-585b-4deb-8603-3c529e112f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:52.131499 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4072/8121] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:52.136307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87970a-7599-4c7d-9b28-acc1c2f995f1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.146088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87970a-7599-4c7d-9b28-acc1c2f995f1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.151283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009e03d-8ef3-4342-80f9-d89d9477bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.151870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009e03d-8ef3-4342-80f9-d89d9477bd29 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.152148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009e03d-8ef3-4342-80f9-d89d9477bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.152423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009e03d-8ef3-4342-80f9-d89d9477bd29 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.153197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009e03d-8ef3-4342-80f9-d89d9477bd29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:52.153492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009e03d-8ef3-4342-80f9-d89d9477bd29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.155099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009e03d-8ef3-4342-80f9-d89d9477bd29 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.166718 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4050/8122] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:52.170928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfb125-585b-4deb-8603-3c529e112f4c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.180201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfb125-585b-4deb-8603-3c529e112f4c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.184954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0bfbb-e67a-452e-b7cf-a588f4d58ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.185483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0bfbb-e67a-452e-b7cf-a588f4d58ecc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.185761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0bfbb-e67a-452e-b7cf-a588f4d58ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.186030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0bfbb-e67a-452e-b7cf-a588f4d58ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.186655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0bfbb-e67a-452e-b7cf-a588f4d58ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.188819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0bfbb-e67a-452e-b7cf-a588f4d58ecc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.216154 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4073/8123] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:52 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:52.220216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009e03d-8ef3-4342-80f9-d89d9477bd29 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.230126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009e03d-8ef3-4342-80f9-d89d9477bd29 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.287761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d1308-7301-47e5-859d-633e6bb643b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.288363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d1308-7301-47e5-859d-633e6bb643b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.288664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d1308-7301-47e5-859d-633e6bb643b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.288938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d1308-7301-47e5-859d-633e6bb643b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.289611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d1308-7301-47e5-859d-633e6bb643b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.291517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d1308-7301-47e5-859d-633e6bb643b0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.312947 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4051/8124] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:52 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:52.317093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0bfbb-e67a-452e-b7cf-a588f4d58ecc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.328251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0bfbb-e67a-452e-b7cf-a588f4d58ecc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.332960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0353-636e-48d2-93dd-69afbd671353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.333558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0353-636e-48d2-93dd-69afbd671353 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.333839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0353-636e-48d2-93dd-69afbd671353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.334110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0353-636e-48d2-93dd-69afbd671353 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.334751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c0353-636e-48d2-93dd-69afbd671353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.336346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c0353-636e-48d2-93dd-69afbd671353 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.346536 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4074/8125] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:52.350597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d1308-7301-47e5-859d-633e6bb643b0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.360413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d1308-7301-47e5-859d-633e6bb643b0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.365026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95aafe-bc9f-4a10-82ad-7c71c39474bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.365670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95aafe-bc9f-4a10-82ad-7c71c39474bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.365951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95aafe-bc9f-4a10-82ad-7c71c39474bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.366224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95aafe-bc9f-4a10-82ad-7c71c39474bb admin admin] PATH_INFO: `/v3/projects/d67fcaa56250487d8e0f0292cd1b8d90/users/bd46a6c9492a4827a6b806679a55a032/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.381472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95aafe-bc9f-4a10-82ad-7c71c39474bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67fcaa56250487d8e0f0292cd1b8d90, user_id=bd46a6c9492a4827a6b806679a55a032, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.384856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95aafe-bc9f-4a10-82ad-7c71c39474bb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.397135 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4052/8126] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:52 2022] PUT /identity/v3/projects/d67fcaa56250487d8e0f0292cd1b8d90/users/bd46a6c9492a4827a6b806679a55a032/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:52.401049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0353-636e-48d2-93dd-69afbd671353 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.411168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0353-636e-48d2-93dd-69afbd671353 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.416045 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:52.471282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c13e9a-bef1-45f7-b550-5ccfb911835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.471809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c13e9a-bef1-45f7-b550-5ccfb911835a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.472092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c13e9a-bef1-45f7-b550-5ccfb911835a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.472369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c13e9a-bef1-45f7-b550-5ccfb911835a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.473043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c13e9a-bef1-45f7-b550-5ccfb911835a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.474663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c13e9a-bef1-45f7-b550-5ccfb911835a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.484331 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4075/8127] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:52.488692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95aafe-bc9f-4a10-82ad-7c71c39474bb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.499304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95aafe-bc9f-4a10-82ad-7c71c39474bb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.503847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab38a2c-6490-4ac3-8ce9-61f2c166da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.504488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab38a2c-6490-4ac3-8ce9-61f2c166da2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.504805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab38a2c-6490-4ac3-8ce9-61f2c166da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.505083 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab38a2c-6490-4ac3-8ce9-61f2c166da2f admin admin] PATH_INFO: `/v3/projects/d67fcaa56250487d8e0f0292cd1b8d90/users/bd46a6c9492a4827a6b806679a55a032/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.506993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab38a2c-6490-4ac3-8ce9-61f2c166da2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67fcaa56250487d8e0f0292cd1b8d90, user_id=bd46a6c9492a4827a6b806679a55a032, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.510252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab38a2c-6490-4ac3-8ce9-61f2c166da2f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.520478 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4053/8128] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:52 2022] PUT /identity/v3/projects/d67fcaa56250487d8e0f0292cd1b8d90/users/bd46a6c9492a4827a6b806679a55a032/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:52.610770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e7d4-e319-458a-895b-899c1a2474fb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.611033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e7d4-e319-458a-895b-899c1a2474fb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.611309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e7d4-e319-458a-895b-899c1a2474fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.640507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f162e7d4-e319-458a-895b-899c1a2474fb None None] MFA Rules not processed for user `bd46a6c9492a4827a6b806679a55a032`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:52.641715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f162e7d4-e319-458a-895b-899c1a2474fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:52.709032 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4076/8129] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:52.713578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab38a2c-6490-4ac3-8ce9-61f2c166da2f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.775826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab38a2c-6490-4ac3-8ce9-61f2c166da2f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.780364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de659465-703c-4497-b9f4-356972796050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.780992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de659465-703c-4497-b9f4-356972796050 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.781268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de659465-703c-4497-b9f4-356972796050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.781539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de659465-703c-4497-b9f4-356972796050 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.782192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de659465-703c-4497-b9f4-356972796050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.784079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de659465-703c-4497-b9f4-356972796050 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.811403 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4054/8130] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:52 2022] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:52.815616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e7d4-e319-458a-895b-899c1a2474fb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.826152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e7d4-e319-458a-895b-899c1a2474fb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.882551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609efc4-5e18-4d11-a7cd-e4347df37143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.883385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609efc4-5e18-4d11-a7cd-e4347df37143 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.883589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609efc4-5e18-4d11-a7cd-e4347df37143 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.883876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609efc4-5e18-4d11-a7cd-e4347df37143 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.884506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609efc4-5e18-4d11-a7cd-e4347df37143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.886451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609efc4-5e18-4d11-a7cd-e4347df37143 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.907332 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4077/8131] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:52 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:52.911321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de659465-703c-4497-b9f4-356972796050 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.922201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de659465-703c-4497-b9f4-356972796050 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.926848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3f34a-5f7b-485c-8b6c-fc0773dca0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.927452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3f34a-5f7b-485c-8b6c-fc0773dca0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.927734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3f34a-5f7b-485c-8b6c-fc0773dca0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.928010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3f34a-5f7b-485c-8b6c-fc0773dca0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.928675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3f34a-5f7b-485c-8b6c-fc0773dca0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.930939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3f34a-5f7b-485c-8b6c-fc0773dca0b6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.941709 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4055/8132] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:52.945642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609efc4-5e18-4d11-a7cd-e4347df37143 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.956292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609efc4-5e18-4d11-a7cd-e4347df37143 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.961063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d605e2-4491-402e-810d-04559b522567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.961815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d605e2-4491-402e-810d-04559b522567 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.962097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d605e2-4491-402e-810d-04559b522567 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.962375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d605e2-4491-402e-810d-04559b522567 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:52.963017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d605e2-4491-402e-810d-04559b522567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:52.964599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d605e2-4491-402e-810d-04559b522567 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:52.974509 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4078/8133] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:52.979052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3f34a-5f7b-485c-8b6c-fc0773dca0b6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:52.988938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3f34a-5f7b-485c-8b6c-fc0773dca0b6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:52.994344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b3b6c-2bf5-4ed4-b585-e32cbdf10ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:52.995001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b3b6c-2bf5-4ed4-b585-e32cbdf10ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:52.995286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b3b6c-2bf5-4ed4-b585-e32cbdf10ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:52.995561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b3b6c-2bf5-4ed4-b585-e32cbdf10ac4 admin admin] PATH_INFO: `/v3/projects/93eed9c4866d43bfb677d41e557294f0/users/10155cc508d3470b933c708632b3f206/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:53.007498 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:53.012538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b3b6c-2bf5-4ed4-b585-e32cbdf10ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93eed9c4866d43bfb677d41e557294f0, user_id=10155cc508d3470b933c708632b3f206, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:53.015505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b3b6c-2bf5-4ed4-b585-e32cbdf10ac4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:53.028247 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4056/8134] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:52 2022] PUT /identity/v3/projects/93eed9c4866d43bfb677d41e557294f0/users/10155cc508d3470b933c708632b3f206/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:53.038112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22326ccd-ff65-4277-9a29-4793534ae512 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:53.038498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22326ccd-ff65-4277-9a29-4793534ae512 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:53.038781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22326ccd-ff65-4277-9a29-4793534ae512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:53.059617 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:53.069593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-22326ccd-ff65-4277-9a29-4793534ae512 None None] MFA Rules not processed for user `10155cc508d3470b933c708632b3f206`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:53.070829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-22326ccd-ff65-4277-9a29-4793534ae512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:53.139434 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4079/8135] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:53.151710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b3b6c-2bf5-4ed4-b585-e32cbdf10ac4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:53.153454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a58b3b6c-2bf5-4ed4-b585-e32cbdf10ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:53.214935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b3b6c-2bf5-4ed4-b585-e32cbdf10ac4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:53.218657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21a99-808a-43d7-93a3-6e90a528a6ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:53.219266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21a99-808a-43d7-93a3-6e90a528a6ab service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:53.219550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21a99-808a-43d7-93a3-6e90a528a6ab service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:53.219826 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21a99-808a-43d7-93a3-6e90a528a6ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:53.279822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb21a99-808a-43d7-93a3-6e90a528a6ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:53.281280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb21a99-808a-43d7-93a3-6e90a528a6ab service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:53.291546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4057/8136] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:53 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:53.681309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22326ccd-ff65-4277-9a29-4793534ae512 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:53.744492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22326ccd-ff65-4277-9a29-4793534ae512 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:53.749075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:53.749708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:53.750015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:53.750316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] PATH_INFO: `/v3/users/bd46a6c9492a4827a6b806679a55a032` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:53.751522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd46a6c9492a4827a6b806679a55a032)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:53.753489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:53.799356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd46a6c9492a4827a6b806679a55a032'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:53.811849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd46a6c9492a4827a6b806679a55a032'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:53.819058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd46a6c9492a4827a6b806679a55a032'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:53.827786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd46a6c9492a4827a6b806679a55a032'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:53.828509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd46a6c9492a4827a6b806679a55a032'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:53.834623 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4080/8137] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:53 2022] DELETE /identity/v3/users/bd46a6c9492a4827a6b806679a55a032 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:53.839732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243bbf-51cf-47eb-8c3b-74ea8826662e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:53.840088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243bbf-51cf-47eb-8c3b-74ea8826662e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:53.840455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243bbf-51cf-47eb-8c3b-74ea8826662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:53.860091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0a243bbf-51cf-47eb-8c3b-74ea8826662e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:53.861345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a243bbf-51cf-47eb-8c3b-74ea8826662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:53.921788 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4058/8138] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:53.931586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:53.933034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:53.953493 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:53.994943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed872f-6220-4c71-8edc-36d32b903268 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:53.998615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a0ffd-d3e4-4fc9-8a5e-8fe35dc52b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:53.999218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a0ffd-d3e4-4fc9-8a5e-8fe35dc52b3a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:53.999502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a0ffd-d3e4-4fc9-8a5e-8fe35dc52b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:53.999778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a0ffd-d3e4-4fc9-8a5e-8fe35dc52b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:54.009107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a0ffd-d3e4-4fc9-8a5e-8fe35dc52b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:54.010564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a0ffd-d3e4-4fc9-8a5e-8fe35dc52b3a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:54.020043 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4081/8139] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:54.286317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243bbf-51cf-47eb-8c3b-74ea8826662e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:54.287805 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a243bbf-51cf-47eb-8c3b-74ea8826662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:54.301198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243bbf-51cf-47eb-8c3b-74ea8826662e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:54.307125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288360b4-5118-4154-be8e-225801415119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:54.307766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288360b4-5118-4154-be8e-225801415119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:54.308052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288360b4-5118-4154-be8e-225801415119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:54.308332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288360b4-5118-4154-be8e-225801415119 admin admin] PATH_INFO: `/v3/projects/d67fcaa56250487d8e0f0292cd1b8d90` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:54.309497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288360b4-5118-4154-be8e-225801415119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67fcaa56250487d8e0f0292cd1b8d90)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:54.311452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288360b4-5118-4154-be8e-225801415119 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:54.350171 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:54.362631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-288360b4-5118-4154-be8e-225801415119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67fcaa56250487d8e0f0292cd1b8d90', 'request_id': 'req-288360b4-5118-4154-be8e-225801415119'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.370306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-288360b4-5118-4154-be8e-225801415119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67fcaa56250487d8e0f0292cd1b8d90', 'request_id': 'req-288360b4-5118-4154-be8e-225801415119'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.376357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-288360b4-5118-4154-be8e-225801415119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67fcaa56250487d8e0f0292cd1b8d90', 'request_id': 'req-288360b4-5118-4154-be8e-225801415119'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.387847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-288360b4-5118-4154-be8e-225801415119 admin admin] The token cache is being invalidate because project d67fcaa56250487d8e0f0292cd1b8d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:54.388167 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-288360b4-5118-4154-be8e-225801415119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.388842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-288360b4-5118-4154-be8e-225801415119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.390360 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4059/8140] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:54 2022] DELETE /identity/v3/projects/d67fcaa56250487d8e0f0292cd1b8d90 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:54.394322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a0ffd-d3e4-4fc9-8a5e-8fe35dc52b3a service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:54.404203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a0ffd-d3e4-4fc9-8a5e-8fe35dc52b3a service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:54.462417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:54.463057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:54.463340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:54.463620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] PATH_INFO: `/v3/users/10155cc508d3470b933c708632b3f206` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:54.464817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10155cc508d3470b933c708632b3f206)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:54.466757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:54.513339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10155cc508d3470b933c708632b3f206'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.527234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10155cc508d3470b933c708632b3f206'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.534698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10155cc508d3470b933c708632b3f206'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.542588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10155cc508d3470b933c708632b3f206'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.543282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-5f92642a-72c2-49ff-82b8-334a15cff193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10155cc508d3470b933c708632b3f206'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.549222 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4082/8141] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:54 2022] DELETE /identity/v3/users/10155cc508d3470b933c708632b3f206 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:54.823653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288360b4-5118-4154-be8e-225801415119 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:54.825113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-288360b4-5118-4154-be8e-225801415119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:54.838639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288360b4-5118-4154-be8e-225801415119 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:54.896377 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:54.897035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:54.897319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:54.897588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] PATH_INFO: `/v3/projects/93eed9c4866d43bfb677d41e557294f0` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:54.899376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93eed9c4866d43bfb677d41e557294f0)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:54.901520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:54.947471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93eed9c4866d43bfb677d41e557294f0', 'request_id': 'req-d2bf308b-067c-4afe-9b64-93736e852972'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.954165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93eed9c4866d43bfb677d41e557294f0', 'request_id': 'req-d2bf308b-067c-4afe-9b64-93736e852972'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.959986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93eed9c4866d43bfb677d41e557294f0', 'request_id': 'req-d2bf308b-067c-4afe-9b64-93736e852972'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.972111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] The token cache is being invalidate because project 93eed9c4866d43bfb677d41e557294f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:54.972433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.973121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d2bf308b-067c-4afe-9b64-93736e852972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:54.974615 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4060/8142] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:54 2022] DELETE /identity/v3/projects/93eed9c4866d43bfb677d41e557294f0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:54.981423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e667d0-897e-4a4c-88b5-8d03b76a54df None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:54.981884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e667d0-897e-4a4c-88b5-8d03b76a54df None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:54.982014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e667d0-897e-4a4c-88b5-8d03b76a54df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.001436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-02e667d0-897e-4a4c-88b5-8d03b76a54df None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:55.002649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-02e667d0-897e-4a4c-88b5-8d03b76a54df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:55.036661 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:55.064539 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4083/8143] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:55.072945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e05a3f-3aca-4278-a849-c2026fa4dfda None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.073175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e05a3f-3aca-4278-a849-c2026fa4dfda None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.073456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e05a3f-3aca-4278-a849-c2026fa4dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.094052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-64e05a3f-3aca-4278-a849-c2026fa4dfda None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:55.095271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-64e05a3f-3aca-4278-a849-c2026fa4dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:55.103291 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4061/8144] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:30:55.107505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e667d0-897e-4a4c-88b5-8d03b76a54df None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.117201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e667d0-897e-4a4c-88b5-8d03b76a54df None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.121858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81eaba-8e71-43d1-8f16-b5624f2a80c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.122454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81eaba-8e71-43d1-8f16-b5624f2a80c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.122729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81eaba-8e71-43d1-8f16-b5624f2a80c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.122998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81eaba-8e71-43d1-8f16-b5624f2a80c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.123630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81eaba-8e71-43d1-8f16-b5624f2a80c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:55.123926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81eaba-8e71-43d1-8f16-b5624f2a80c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.125539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81eaba-8e71-43d1-8f16-b5624f2a80c8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.137690 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4084/8145] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:55.141897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e05a3f-3aca-4278-a849-c2026fa4dfda None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.151864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e05a3f-3aca-4278-a849-c2026fa4dfda None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.156738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d268-4636-4b10-84ad-531f35536ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.157338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d268-4636-4b10-84ad-531f35536ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.157621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d268-4636-4b10-84ad-531f35536ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.157895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d268-4636-4b10-84ad-531f35536ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.158547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d268-4636-4b10-84ad-531f35536ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.160477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d268-4636-4b10-84ad-531f35536ab0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.189012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4062/8146] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:55 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:55.192961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81eaba-8e71-43d1-8f16-b5624f2a80c8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.203382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81eaba-8e71-43d1-8f16-b5624f2a80c8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.260923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35b9e-6a8f-42c7-b81b-cc8d2fb957c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.261524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35b9e-6a8f-42c7-b81b-cc8d2fb957c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.261805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35b9e-6a8f-42c7-b81b-cc8d2fb957c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.262076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35b9e-6a8f-42c7-b81b-cc8d2fb957c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.262694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b35b9e-6a8f-42c7-b81b-cc8d2fb957c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.264598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b35b9e-6a8f-42c7-b81b-cc8d2fb957c6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.285861 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4085/8147] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:55 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:55.290747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d268-4636-4b10-84ad-531f35536ab0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.301236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d268-4636-4b10-84ad-531f35536ab0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.305869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4e44d-9ba7-4dcc-9983-ef3bb5ba9d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.306465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4e44d-9ba7-4dcc-9983-ef3bb5ba9d5a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.306751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4e44d-9ba7-4dcc-9983-ef3bb5ba9d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.307061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4e44d-9ba7-4dcc-9983-ef3bb5ba9d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.307729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4e44d-9ba7-4dcc-9983-ef3bb5ba9d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.309363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4e44d-9ba7-4dcc-9983-ef3bb5ba9d5a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.319468 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4063/8148] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:30:55.323753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35b9e-6a8f-42c7-b81b-cc8d2fb957c6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.333743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35b9e-6a8f-42c7-b81b-cc8d2fb957c6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.339407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462e21f-6eb3-42ed-978b-59afd275b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.340002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462e21f-6eb3-42ed-978b-59afd275b2ac admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.340281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462e21f-6eb3-42ed-978b-59afd275b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.340556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462e21f-6eb3-42ed-978b-59afd275b2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.341218 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462e21f-6eb3-42ed-978b-59afd275b2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.342796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462e21f-6eb3-42ed-978b-59afd275b2ac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.353816 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4086/8149] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:55.358413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4e44d-9ba7-4dcc-9983-ef3bb5ba9d5a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.368783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4e44d-9ba7-4dcc-9983-ef3bb5ba9d5a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.373538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f924c-321c-4070-90ab-308a0c93bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.374219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f924c-321c-4070-90ab-308a0c93bde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.374510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f924c-321c-4070-90ab-308a0c93bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.374794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f924c-321c-4070-90ab-308a0c93bde9 admin admin] PATH_INFO: `/v3/projects/f2c1d2f15ce844ffadc71c3f2b80d4a8/users/ab40d1dadadf472190be543e8af36b04/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.386266 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:55.391346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f924c-321c-4070-90ab-308a0c93bde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c1d2f15ce844ffadc71c3f2b80d4a8, user_id=ab40d1dadadf472190be543e8af36b04, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.394183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f924c-321c-4070-90ab-308a0c93bde9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.407879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4064/8150] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:55 2022] PUT /identity/v3/projects/f2c1d2f15ce844ffadc71c3f2b80d4a8/users/ab40d1dadadf472190be543e8af36b04/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:55.420407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eb1d4-4216-48e4-9297-fcdf190a8efc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.420736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eb1d4-4216-48e4-9297-fcdf190a8efc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.421017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eb1d4-4216-48e4-9297-fcdf190a8efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.449245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9a6eb1d4-4216-48e4-9297-fcdf190a8efc None None] MFA Rules not processed for user `ab40d1dadadf472190be543e8af36b04`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:55.450458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9a6eb1d4-4216-48e4-9297-fcdf190a8efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:55.514179 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4087/8151] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:55.518663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f924c-321c-4070-90ab-308a0c93bde9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.580506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f924c-321c-4070-90ab-308a0c93bde9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.585132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272aecd-ceba-413e-ab95-95bdb026cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.585732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272aecd-ceba-413e-ab95-95bdb026cd44 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.586008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272aecd-ceba-413e-ab95-95bdb026cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.586823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272aecd-ceba-413e-ab95-95bdb026cd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.587599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272aecd-ceba-413e-ab95-95bdb026cd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.589540 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272aecd-ceba-413e-ab95-95bdb026cd44 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.616985 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4065/8152] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:55 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:55.621831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6eb1d4-4216-48e4-9297-fcdf190a8efc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.632860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6eb1d4-4216-48e4-9297-fcdf190a8efc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.668290 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:55.693944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e6f95-a6ee-4bae-9972-d234f8825a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.694556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e6f95-a6ee-4bae-9972-d234f8825a02 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.694846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e6f95-a6ee-4bae-9972-d234f8825a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.695122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e6f95-a6ee-4bae-9972-d234f8825a02 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.696243 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e6f95-a6ee-4bae-9972-d234f8825a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.698202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e6f95-a6ee-4bae-9972-d234f8825a02 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.719459 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4088/8153] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:55 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:55.723464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272aecd-ceba-413e-ab95-95bdb026cd44 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.734217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272aecd-ceba-413e-ab95-95bdb026cd44 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.738983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ba14b-943d-4ffb-afeb-464c7d0bd499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.739579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ba14b-943d-4ffb-afeb-464c7d0bd499 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.739863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ba14b-943d-4ffb-afeb-464c7d0bd499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.740146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ba14b-943d-4ffb-afeb-464c7d0bd499 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.740824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ba14b-943d-4ffb-afeb-464c7d0bd499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.742477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ba14b-943d-4ffb-afeb-464c7d0bd499 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.753410 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4066/8154] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:55.757215 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e6f95-a6ee-4bae-9972-d234f8825a02 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.767979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e6f95-a6ee-4bae-9972-d234f8825a02 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.772711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69637b-b40c-40f2-8562-eab2027ac545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.773357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69637b-b40c-40f2-8562-eab2027ac545 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.774262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69637b-b40c-40f2-8562-eab2027ac545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.774638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69637b-b40c-40f2-8562-eab2027ac545 admin admin] PATH_INFO: `/v3/projects/4f325da6146d4a3cb3ced944c2acf2a9/users/6b1b30824b2640fdb20e478cf1cc70a7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.789178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69637b-b40c-40f2-8562-eab2027ac545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f325da6146d4a3cb3ced944c2acf2a9, user_id=6b1b30824b2640fdb20e478cf1cc70a7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.792202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69637b-b40c-40f2-8562-eab2027ac545 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.804641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4089/8155] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:55 2022] PUT /identity/v3/projects/4f325da6146d4a3cb3ced944c2acf2a9/users/6b1b30824b2640fdb20e478cf1cc70a7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:55.808517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ba14b-943d-4ffb-afeb-464c7d0bd499 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.818698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ba14b-943d-4ffb-afeb-464c7d0bd499 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.876844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d941d-5fe3-40f7-ad9a-d0d5d6465093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.877452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d941d-5fe3-40f7-ad9a-d0d5d6465093 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.877735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d941d-5fe3-40f7-ad9a-d0d5d6465093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.878008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d941d-5fe3-40f7-ad9a-d0d5d6465093 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.878637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d941d-5fe3-40f7-ad9a-d0d5d6465093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.880226 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d941d-5fe3-40f7-ad9a-d0d5d6465093 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.890630 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4067/8156] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:55.894874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69637b-b40c-40f2-8562-eab2027ac545 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:55.905779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69637b-b40c-40f2-8562-eab2027ac545 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:55.910356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cfd5a-4956-40bc-8f30-73768b6df7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:55.910996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cfd5a-4956-40bc-8f30-73768b6df7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.911273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cfd5a-4956-40bc-8f30-73768b6df7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.911543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cfd5a-4956-40bc-8f30-73768b6df7ea admin admin] PATH_INFO: `/v3/projects/4f325da6146d4a3cb3ced944c2acf2a9/users/6b1b30824b2640fdb20e478cf1cc70a7/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.913515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cfd5a-4956-40bc-8f30-73768b6df7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f325da6146d4a3cb3ced944c2acf2a9, user_id=6b1b30824b2640fdb20e478cf1cc70a7, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:55.916359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cfd5a-4956-40bc-8f30-73768b6df7ea admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:55.926359 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4090/8157] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:55 2022] PUT /identity/v3/projects/4f325da6146d4a3cb3ced944c2acf2a9/users/6b1b30824b2640fdb20e478cf1cc70a7/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:55.936605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73506e-b4c9-412a-babd-529cb18a64d0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:55.936919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73506e-b4c9-412a-babd-529cb18a64d0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:55.937194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73506e-b4c9-412a-babd-529cb18a64d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:55.966577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ce73506e-b4c9-412a-babd-529cb18a64d0 None None] MFA Rules not processed for user `6b1b30824b2640fdb20e478cf1cc70a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:55.967801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ce73506e-b4c9-412a-babd-529cb18a64d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:56.015482 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:56.037843 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4068/8158] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:56.042854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cfd5a-4956-40bc-8f30-73768b6df7ea admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:56.053950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cfd5a-4956-40bc-8f30-73768b6df7ea admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:56.059338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13025838-f289-4de7-aff4-23b595c7809f tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b1b30824b2640fdb20e478cf1cc70a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f325da6146d4a3cb3ced944c2acf2a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:56.059945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025838-f289-4de7-aff4-23b595c7809f tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:56.060233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025838-f289-4de7-aff4-23b595c7809f tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:56.060515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025838-f289-4de7-aff4-23b595c7809f tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:56.061200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13025838-f289-4de7-aff4-23b595c7809f tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:56.061508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13025838-f289-4de7-aff4-23b595c7809f tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:56.063106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13025838-f289-4de7-aff4-23b595c7809f tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:56.076159 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4091/8159] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:56.080239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73506e-b4c9-412a-babd-529cb18a64d0 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:56.089882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73506e-b4c9-412a-babd-529cb18a64d0 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:56.094608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7cb53-e2c8-4387-b6b8-b2a6f79b453b tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b1b30824b2640fdb20e478cf1cc70a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f325da6146d4a3cb3ced944c2acf2a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:56.095221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7cb53-e2c8-4387-b6b8-b2a6f79b453b tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:56.095505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7cb53-e2c8-4387-b6b8-b2a6f79b453b tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:56.095785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7cb53-e2c8-4387-b6b8-b2a6f79b453b tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:56.096413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7cb53-e2c8-4387-b6b8-b2a6f79b453b tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:56.098356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7cb53-e2c8-4387-b6b8-b2a6f79b453b tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:56.125823 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4069/8160] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:56 2022] POST /identity/v3/projects => generated 349 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:56.129943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13025838-f289-4de7-aff4-23b595c7809f tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:56.140287 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13025838-f289-4de7-aff4-23b595c7809f tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:56.196309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb49d2-bcd7-4bab-baf3-ce8982df8b62 tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b1b30824b2640fdb20e478cf1cc70a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f325da6146d4a3cb3ced944c2acf2a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:56.196953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb49d2-bcd7-4bab-baf3-ce8982df8b62 tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:56.197239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb49d2-bcd7-4bab-baf3-ce8982df8b62 tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:56.197520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb49d2-bcd7-4bab-baf3-ce8982df8b62 tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:56.198159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb49d2-bcd7-4bab-baf3-ce8982df8b62 tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:56.198466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb49d2-bcd7-4bab-baf3-ce8982df8b62 tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:56.200058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb49d2-bcd7-4bab-baf3-ce8982df8b62 tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:56.211709 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4092/8161] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:56.221490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7cb53-e2c8-4387-b6b8-b2a6f79b453b tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:56.223194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a1a7cb53-e2c8-4387-b6b8-b2a6f79b453b tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:56.282110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7cb53-e2c8-4387-b6b8-b2a6f79b453b tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:56.285737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d55ee-c35b-4a01-b270-2f4a5ad948e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:56.286334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d55ee-c35b-4a01-b270-2f4a5ad948e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:56.286611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d55ee-c35b-4a01-b270-2f4a5ad948e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:56.286882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d55ee-c35b-4a01-b270-2f4a5ad948e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:56.297189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d55ee-c35b-4a01-b270-2f4a5ad948e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:56.298627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d55ee-c35b-4a01-b270-2f4a5ad948e8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:56.308056 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4070/8162] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:57.618983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb49d2-bcd7-4bab-baf3-ce8982df8b62 tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:57.635843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb49d2-bcd7-4bab-baf3-ce8982df8b62 tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:57.640574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b1b30824b2640fdb20e478cf1cc70a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f325da6146d4a3cb3ced944c2acf2a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:57.641239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:57.641522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:57.641800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] PATH_INFO: `/v3/projects/8827811b054f4bcba2eab6a49c4782c8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:57.642923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8827811b054f4bcba2eab6a49c4782c8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:57.644856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:57.691154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8827811b054f4bcba2eab6a49c4782c8', 'request_id': 'req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.699224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8827811b054f4bcba2eab6a49c4782c8', 'request_id': 'req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.703987 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:57.705493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8827811b054f4bcba2eab6a49c4782c8', 'request_id': 'req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.719225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] The token cache is being invalidate because project 8827811b054f4bcba2eab6a49c4782c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:57.719513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.720178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4b8ffc63-e2f4-45a9-a3c1-30ce2cba32bd tempest-QuotasNegativeTest-1657475435 tempest-QuotasNegativeTest-1657475435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.721688 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4093/8163] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:57 2022] DELETE /identity/v3/projects/8827811b054f4bcba2eab6a49c4782c8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:57.726721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d55ee-c35b-4a01-b270-2f4a5ad948e8 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:57.790338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d55ee-c35b-4a01-b270-2f4a5ad948e8 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:57.846269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:57.846901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:57.847183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:57.847464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] PATH_INFO: `/v3/users/ab40d1dadadf472190be543e8af36b04` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:57.848581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab40d1dadadf472190be543e8af36b04)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:57.850534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:57.864732 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:57.900456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab40d1dadadf472190be543e8af36b04'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.912447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab40d1dadadf472190be543e8af36b04'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.919951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab40d1dadadf472190be543e8af36b04'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.927193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab40d1dadadf472190be543e8af36b04'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.927830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab40d1dadadf472190be543e8af36b04'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:57.933994 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4071/8164] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:57 2022] DELETE /identity/v3/users/ab40d1dadadf472190be543e8af36b04 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:57.938938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58a7b-fb1c-406d-a89e-cb6a56a664bb None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:57.939224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58a7b-fb1c-406d-a89e-cb6a56a664bb None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:57.939521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58a7b-fb1c-406d-a89e-cb6a56a664bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:57.959088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-dfa58a7b-fb1c-406d-a89e-cb6a56a664bb None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:57.960296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dfa58a7b-fb1c-406d-a89e-cb6a56a664bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:58.017787 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4094/8165] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:58.028247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:58.029687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:58.092477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f489cd3-43c4-46dc-a066-c7a2d6b23523 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:58.096264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa94cf-d932-421d-b3f0-d0aefff41d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:58.096905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa94cf-d932-421d-b3f0-d0aefff41d11 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:58.097192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa94cf-d932-421d-b3f0-d0aefff41d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:58.097471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa94cf-d932-421d-b3f0-d0aefff41d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:58.107183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa94cf-d932-421d-b3f0-d0aefff41d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:58.108648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa94cf-d932-421d-b3f0-d0aefff41d11 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:58.118355 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4072/8166] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:30:58.397105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58a7b-fb1c-406d-a89e-cb6a56a664bb None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:58.399161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dfa58a7b-fb1c-406d-a89e-cb6a56a664bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:58.412769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58a7b-fb1c-406d-a89e-cb6a56a664bb None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:58.423073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:58.423734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:58.424040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:58.424281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] PATH_INFO: `/v3/projects/f2c1d2f15ce844ffadc71c3f2b80d4a8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:58.425518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c1d2f15ce844ffadc71c3f2b80d4a8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:58.427372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:58.477450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c1d2f15ce844ffadc71c3f2b80d4a8', 'request_id': 'req-45a41727-268b-4c0d-a18b-90401a7c98ed'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.484941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c1d2f15ce844ffadc71c3f2b80d4a8', 'request_id': 'req-45a41727-268b-4c0d-a18b-90401a7c98ed'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.490723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c1d2f15ce844ffadc71c3f2b80d4a8', 'request_id': 'req-45a41727-268b-4c0d-a18b-90401a7c98ed'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.502200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] The token cache is being invalidate because project f2c1d2f15ce844ffadc71c3f2b80d4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:58.502490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.503130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.504643 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4095/8167] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:58 2022] DELETE /identity/v3/projects/f2c1d2f15ce844ffadc71c3f2b80d4a8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:58.509020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa94cf-d932-421d-b3f0-d0aefff41d11 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:58.518641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa94cf-d932-421d-b3f0-d0aefff41d11 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:58.575366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:58.575913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:58.576220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:58.576492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] PATH_INFO: `/v3/users/6b1b30824b2640fdb20e478cf1cc70a7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:58.577627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1b30824b2640fdb20e478cf1cc70a7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:58.579529 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:58.618477 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:58.630496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1b30824b2640fdb20e478cf1cc70a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.643486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1b30824b2640fdb20e478cf1cc70a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.652199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1b30824b2640fdb20e478cf1cc70a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.659176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1b30824b2640fdb20e478cf1cc70a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.659812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8eca7da1-0657-4238-a083-82e894545323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1b30824b2640fdb20e478cf1cc70a7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:58.666062 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4073/8168] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:30:58 2022] DELETE /identity/v3/users/6b1b30824b2640fdb20e478cf1cc70a7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:58.940984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:58.942452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:58.959420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a41727-268b-4c0d-a18b-90401a7c98ed admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.019272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.019914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.020195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.020472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] PATH_INFO: `/v3/projects/4f325da6146d4a3cb3ced944c2acf2a9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.021629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f325da6146d4a3cb3ced944c2acf2a9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.023629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.039977 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:59.075409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f325da6146d4a3cb3ced944c2acf2a9', 'request_id': 'req-c322f7f8-2ec3-41a3-b201-53b7db4b327d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:59.082926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f325da6146d4a3cb3ced944c2acf2a9', 'request_id': 'req-c322f7f8-2ec3-41a3-b201-53b7db4b327d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:59.089602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f325da6146d4a3cb3ced944c2acf2a9', 'request_id': 'req-c322f7f8-2ec3-41a3-b201-53b7db4b327d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:59.101074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] The token cache is being invalidate because project 4f325da6146d4a3cb3ced944c2acf2a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:30:59.101356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:59.102009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c322f7f8-2ec3-41a3-b201-53b7db4b327d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:30:59.103573 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4096/8169] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:30:58 2022] DELETE /identity/v3/projects/4f325da6146d4a3cb3ced944c2acf2a9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:59.108584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f12fba-7fcf-40e6-bf1f-f5fa1a024dd8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.109082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f12fba-7fcf-40e6-bf1f-f5fa1a024dd8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.109192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f12fba-7fcf-40e6-bf1f-f5fa1a024dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.129127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-63f12fba-7fcf-40e6-bf1f-f5fa1a024dd8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:59.130345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-63f12fba-7fcf-40e6-bf1f-f5fa1a024dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:59.192584 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4074/8170] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:59.201348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa0d0c-37d1-4332-bbd9-232349e291df None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.201633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa0d0c-37d1-4332-bbd9-232349e291df None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.201909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa0d0c-37d1-4332-bbd9-232349e291df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.221448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6daa0d0c-37d1-4332-bbd9-232349e291df None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:59.222652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6daa0d0c-37d1-4332-bbd9-232349e291df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:59.230601 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4097/8171] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:59.234882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f12fba-7fcf-40e6-bf1f-f5fa1a024dd8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.245182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f12fba-7fcf-40e6-bf1f-f5fa1a024dd8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.249693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa52c6-b528-4a33-91e3-374eb7865c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.250519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa52c6-b528-4a33-91e3-374eb7865c37 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.250808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa52c6-b528-4a33-91e3-374eb7865c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.251080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa52c6-b528-4a33-91e3-374eb7865c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.251722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa52c6-b528-4a33-91e3-374eb7865c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:30:59.252024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa52c6-b528-4a33-91e3-374eb7865c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.253658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa52c6-b528-4a33-91e3-374eb7865c37 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.265873 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4075/8172] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:30:59.269912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa0d0c-37d1-4332-bbd9-232349e291df None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.279296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa0d0c-37d1-4332-bbd9-232349e291df None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.284136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377505d-08e4-4921-8e4a-f972a0c36db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.284799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377505d-08e4-4921-8e4a-f972a0c36db2 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.285083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377505d-08e4-4921-8e4a-f972a0c36db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.285359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377505d-08e4-4921-8e4a-f972a0c36db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.285998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377505d-08e4-4921-8e4a-f972a0c36db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.287905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377505d-08e4-4921-8e4a-f972a0c36db2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.316919 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4098/8173] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:59 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:30:59.321739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa52c6-b528-4a33-91e3-374eb7865c37 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.331686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa52c6-b528-4a33-91e3-374eb7865c37 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.389148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349daf-bc8f-4a71-9dea-70d1b57a2224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.389738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349daf-bc8f-4a71-9dea-70d1b57a2224 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.390045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349daf-bc8f-4a71-9dea-70d1b57a2224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.390320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349daf-bc8f-4a71-9dea-70d1b57a2224 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.390988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9349daf-bc8f-4a71-9dea-70d1b57a2224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.392954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9349daf-bc8f-4a71-9dea-70d1b57a2224 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.413975 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4076/8174] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:59 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:59.418781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377505d-08e4-4921-8e4a-f972a0c36db2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.429195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377505d-08e4-4921-8e4a-f972a0c36db2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.434606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c587ca-8530-494a-a3eb-e297aee945d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.435204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c587ca-8530-494a-a3eb-e297aee945d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.435486 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c587ca-8530-494a-a3eb-e297aee945d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.435761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c587ca-8530-494a-a3eb-e297aee945d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.436400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c587ca-8530-494a-a3eb-e297aee945d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.438030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c587ca-8530-494a-a3eb-e297aee945d2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.448106 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4099/8175] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:59.451933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349daf-bc8f-4a71-9dea-70d1b57a2224 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.462559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349daf-bc8f-4a71-9dea-70d1b57a2224 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.467304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ddb4f-73ad-4aeb-acc5-34850f021025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.467907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ddb4f-73ad-4aeb-acc5-34850f021025 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.468190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ddb4f-73ad-4aeb-acc5-34850f021025 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.468466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ddb4f-73ad-4aeb-acc5-34850f021025 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.469138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ddb4f-73ad-4aeb-acc5-34850f021025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.470728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ddb4f-73ad-4aeb-acc5-34850f021025 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.482546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4077/8176] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:59.486672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c587ca-8530-494a-a3eb-e297aee945d2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.498195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c587ca-8530-494a-a3eb-e297aee945d2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.502892 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b504ba9-1aeb-4f3b-a947-af64e1dd4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.503536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b504ba9-1aeb-4f3b-a947-af64e1dd4b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.503827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b504ba9-1aeb-4f3b-a947-af64e1dd4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.504106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b504ba9-1aeb-4f3b-a947-af64e1dd4b53 admin admin] PATH_INFO: `/v3/projects/37ad1bea2e7b4fa99157d6d417a16eb3/users/e31949e712df43e9bd5dd78fbd489dde/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.518703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b504ba9-1aeb-4f3b-a947-af64e1dd4b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ad1bea2e7b4fa99157d6d417a16eb3, user_id=e31949e712df43e9bd5dd78fbd489dde, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.521501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b504ba9-1aeb-4f3b-a947-af64e1dd4b53 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.534431 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4100/8177] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:59 2022] PUT /identity/v3/projects/37ad1bea2e7b4fa99157d6d417a16eb3/users/e31949e712df43e9bd5dd78fbd489dde/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:59.546743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16999517-b4e2-42c1-94bf-47be629cef31 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.547027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16999517-b4e2-42c1-94bf-47be629cef31 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.547296 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16999517-b4e2-42c1-94bf-47be629cef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.576542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-16999517-b4e2-42c1-94bf-47be629cef31 None None] MFA Rules not processed for user `e31949e712df43e9bd5dd78fbd489dde`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:30:59.577828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-16999517-b4e2-42c1-94bf-47be629cef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:30:59.586557 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:59.647276 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4078/8178] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:30:59.651983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b504ba9-1aeb-4f3b-a947-af64e1dd4b53 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.715301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b504ba9-1aeb-4f3b-a947-af64e1dd4b53 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.719946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6922-4f6d-412b-8dda-11689a40077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.720546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6922-4f6d-412b-8dda-11689a40077a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.720854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6922-4f6d-412b-8dda-11689a40077a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.721133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6922-4f6d-412b-8dda-11689a40077a admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.721750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd6922-4f6d-412b-8dda-11689a40077a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.723654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd6922-4f6d-412b-8dda-11689a40077a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.751031 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4101/8179] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:30:59 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:59.755339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16999517-b4e2-42c1-94bf-47be629cef31 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.766483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16999517-b4e2-42c1-94bf-47be629cef31 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.823640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb6925-1d86-4455-9df2-9d72860bfb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.824258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb6925-1d86-4455-9df2-9d72860bfb27 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.824543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb6925-1d86-4455-9df2-9d72860bfb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.824846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb6925-1d86-4455-9df2-9d72860bfb27 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.825469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb6925-1d86-4455-9df2-9d72860bfb27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.827389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb6925-1d86-4455-9df2-9d72860bfb27 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.849722 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4079/8180] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:30:59 2022] POST /identity/v3/users => generated 306 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:30:59.853319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6922-4f6d-412b-8dda-11689a40077a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.864729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6922-4f6d-412b-8dda-11689a40077a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.869420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718c66b-3c7a-472f-a924-79559e9b227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.870509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718c66b-3c7a-472f-a924-79559e9b227a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.870799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718c66b-3c7a-472f-a924-79559e9b227a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.871081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718c66b-3c7a-472f-a924-79559e9b227a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.871721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718c66b-3c7a-472f-a924-79559e9b227a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.873346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718c66b-3c7a-472f-a924-79559e9b227a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.883802 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4102/8181] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:30:59.887893 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb6925-1d86-4455-9df2-9d72860bfb27 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.898009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb6925-1d86-4455-9df2-9d72860bfb27 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.903138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d9b4e-138b-44fa-a0f6-d055c2122433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:30:59.903787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d9b4e-138b-44fa-a0f6-d055c2122433 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:30:59.904073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d9b4e-138b-44fa-a0f6-d055c2122433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:30:59.904350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d9b4e-138b-44fa-a0f6-d055c2122433 admin admin] PATH_INFO: `/v3/projects/86fc67ac8c874bf29770058cf12c52e9/users/f235d53dd2174c91b19b3ad6f638ea83/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:30:59.919631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d9b4e-138b-44fa-a0f6-d055c2122433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fc67ac8c874bf29770058cf12c52e9, user_id=f235d53dd2174c91b19b3ad6f638ea83, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:30:59.922341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d9b4e-138b-44fa-a0f6-d055c2122433 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:30:59.935810 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4080/8182] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:30:59 2022] PUT /identity/v3/projects/86fc67ac8c874bf29770058cf12c52e9/users/f235d53dd2174c91b19b3ad6f638ea83/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:30:59.939944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718c66b-3c7a-472f-a924-79559e9b227a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:30:59.950060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718c66b-3c7a-472f-a924-79559e9b227a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:30:59.962310 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:00.010280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9353e31-e57c-416d-bcbf-7a7fd605cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:00.010880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353e31-e57c-416d-bcbf-7a7fd605cca5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:00.011156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353e31-e57c-416d-bcbf-7a7fd605cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:00.011424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353e31-e57c-416d-bcbf-7a7fd605cca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:00.012084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9353e31-e57c-416d-bcbf-7a7fd605cca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:00.013684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9353e31-e57c-416d-bcbf-7a7fd605cca5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:00.023201 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4103/8183] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:00.027854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d9b4e-138b-44fa-a0f6-d055c2122433 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:00.038019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d9b4e-138b-44fa-a0f6-d055c2122433 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:00.043163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d6e72-7f05-4c18-b634-570e4aa8bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:00.043813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6e72-7f05-4c18-b634-570e4aa8bdec admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:00.044097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6e72-7f05-4c18-b634-570e4aa8bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:00.044369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6e72-7f05-4c18-b634-570e4aa8bdec admin admin] PATH_INFO: `/v3/projects/86fc67ac8c874bf29770058cf12c52e9/users/f235d53dd2174c91b19b3ad6f638ea83/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:00.046326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d6e72-7f05-4c18-b634-570e4aa8bdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fc67ac8c874bf29770058cf12c52e9, user_id=f235d53dd2174c91b19b3ad6f638ea83, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:00.049015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d6e72-7f05-4c18-b634-570e4aa8bdec admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:00.059464 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4081/8184] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:31:00 2022] PUT /identity/v3/projects/86fc67ac8c874bf29770058cf12c52e9/users/f235d53dd2174c91b19b3ad6f638ea83/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:00.070222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039f94-b9eb-487f-ad94-1b508fbb4dd1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:00.070523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039f94-b9eb-487f-ad94-1b508fbb4dd1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:00.070803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039f94-b9eb-487f-ad94-1b508fbb4dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:00.100554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-70039f94-b9eb-487f-ad94-1b508fbb4dd1 None None] MFA Rules not processed for user `f235d53dd2174c91b19b3ad6f638ea83`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:00.101711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-70039f94-b9eb-487f-ad94-1b508fbb4dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:00.170803 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4104/8185] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:00 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:00.180756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d6e72-7f05-4c18-b634-570e4aa8bdec admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:00.182510 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-685d6e72-7f05-4c18-b634-570e4aa8bdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:00.243014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d6e72-7f05-4c18-b634-570e4aa8bdec admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:00.246802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c722867-9ed2-4212-aabd-28b46a55e671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:00.247401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c722867-9ed2-4212-aabd-28b46a55e671 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:00.247679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c722867-9ed2-4212-aabd-28b46a55e671 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:00.247951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c722867-9ed2-4212-aabd-28b46a55e671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:00.260311 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:00.303901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c722867-9ed2-4212-aabd-28b46a55e671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:00.305370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c722867-9ed2-4212-aabd-28b46a55e671 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:00.314664 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4082/8186] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:00.634773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70039f94-b9eb-487f-ad94-1b508fbb4dd1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:00.637521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-70039f94-b9eb-487f-ad94-1b508fbb4dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:00.730934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70039f94-b9eb-487f-ad94-1b508fbb4dd1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:00.736477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092535cd-de40-4b78-a38d-587666cda817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:00.737117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092535cd-de40-4b78-a38d-587666cda817 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:00.737395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092535cd-de40-4b78-a38d-587666cda817 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:00.737666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092535cd-de40-4b78-a38d-587666cda817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:00.746183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092535cd-de40-4b78-a38d-587666cda817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:00.747759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092535cd-de40-4b78-a38d-587666cda817 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:00.757723 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4105/8187] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:05.555091 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c722867-9ed2-4212-aabd-28b46a55e671 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:05.620645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c722867-9ed2-4212-aabd-28b46a55e671 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:05.626504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:05.627143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:05.627427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:05.627705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] PATH_INFO: `/v3/users/e31949e712df43e9bd5dd78fbd489dde` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:05.628907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31949e712df43e9bd5dd78fbd489dde)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:05.630847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:05.676266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31949e712df43e9bd5dd78fbd489dde'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:05.689126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31949e712df43e9bd5dd78fbd489dde'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:05.696196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31949e712df43e9bd5dd78fbd489dde'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:05.704145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31949e712df43e9bd5dd78fbd489dde'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:05.704775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31949e712df43e9bd5dd78fbd489dde'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:05.710570 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4083/8188] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:31:05 2022] DELETE /identity/v3/users/e31949e712df43e9bd5dd78fbd489dde => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:05.715224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acf399-5bb9-43ef-ac16-92f95e6e3c7c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:05.715749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acf399-5bb9-43ef-ac16-92f95e6e3c7c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:05.715926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acf399-5bb9-43ef-ac16-92f95e6e3c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:05.735154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-20acf399-5bb9-43ef-ac16-92f95e6e3c7c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:05.736365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-20acf399-5bb9-43ef-ac16-92f95e6e3c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:05.744876 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:05.797146 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4106/8189] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:05.806811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:05.808827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:05.852022 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:05.874304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe0e49-e744-4ebc-90bb-bb299e140434 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:05.877971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a13db1-8549-4e82-b0b8-d0932c4b6a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:05.878566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a13db1-8549-4e82-b0b8-d0932c4b6a5c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:05.878844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a13db1-8549-4e82-b0b8-d0932c4b6a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:05.879138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a13db1-8549-4e82-b0b8-d0932c4b6a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:05.888093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a13db1-8549-4e82-b0b8-d0932c4b6a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:05.889541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a13db1-8549-4e82-b0b8-d0932c4b6a5c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:05.898916 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4084/8190] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:06.069576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acf399-5bb9-43ef-ac16-92f95e6e3c7c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:06.071722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-20acf399-5bb9-43ef-ac16-92f95e6e3c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:06.084984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acf399-5bb9-43ef-ac16-92f95e6e3c7c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:06.095087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:06.096075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:06.096410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:06.096858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] PATH_INFO: `/v3/projects/37ad1bea2e7b4fa99157d6d417a16eb3` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:06.098300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ad1bea2e7b4fa99157d6d417a16eb3)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:06.100279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:06.147827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ad1bea2e7b4fa99157d6d417a16eb3', 'request_id': 'req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.156529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ad1bea2e7b4fa99157d6d417a16eb3', 'request_id': 'req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.162577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ad1bea2e7b4fa99157d6d417a16eb3', 'request_id': 'req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.173989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] The token cache is being invalidate because project 37ad1bea2e7b4fa99157d6d417a16eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:31:06.174282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.174930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.176417 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4107/8191] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:31:06 2022] DELETE /identity/v3/projects/37ad1bea2e7b4fa99157d6d417a16eb3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:06.180436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a13db1-8549-4e82-b0b8-d0932c4b6a5c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:06.190937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a13db1-8549-4e82-b0b8-d0932c4b6a5c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:06.248322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:06.248907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:06.249187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:06.249458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] PATH_INFO: `/v3/users/f235d53dd2174c91b19b3ad6f638ea83` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:06.250569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f235d53dd2174c91b19b3ad6f638ea83)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:06.252492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:06.298319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f235d53dd2174c91b19b3ad6f638ea83'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.310860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f235d53dd2174c91b19b3ad6f638ea83'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.318412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f235d53dd2174c91b19b3ad6f638ea83'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.326066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f235d53dd2174c91b19b3ad6f638ea83'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.326750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0ec8f44e-fb38-4bb8-b7b0-85435f37e917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f235d53dd2174c91b19b3ad6f638ea83'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.332547 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4085/8192] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:31:06 2022] DELETE /identity/v3/users/f235d53dd2174c91b19b3ad6f638ea83 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:06.506211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:06.507731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:06.522072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7aa5-2def-4cdf-bd2a-894c8668a0d6 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:06.580660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:06.581291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:06.581577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:06.581857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] PATH_INFO: `/v3/projects/86fc67ac8c874bf29770058cf12c52e9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:06.582991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fc67ac8c874bf29770058cf12c52e9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:06.584948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:06.626661 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:06.635386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fc67ac8c874bf29770058cf12c52e9', 'request_id': 'req-933467f6-2345-42e4-b6bb-50f9dbd06614'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.643413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fc67ac8c874bf29770058cf12c52e9', 'request_id': 'req-933467f6-2345-42e4-b6bb-50f9dbd06614'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.649022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fc67ac8c874bf29770058cf12c52e9', 'request_id': 'req-933467f6-2345-42e4-b6bb-50f9dbd06614'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.660400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] The token cache is being invalidate because project 86fc67ac8c874bf29770058cf12c52e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:31:06.660719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.661355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-933467f6-2345-42e4-b6bb-50f9dbd06614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:06.662919 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4108/8193] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:31:06 2022] DELETE /identity/v3/projects/86fc67ac8c874bf29770058cf12c52e9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:06.667929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73416d0-93c1-4013-beee-ef5a5106b940 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:06.668436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73416d0-93c1-4013-beee-ef5a5106b940 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:06.668548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73416d0-93c1-4013-beee-ef5a5106b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:06.688217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a73416d0-93c1-4013-beee-ef5a5106b940 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:06.689713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a73416d0-93c1-4013-beee-ef5a5106b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:06.739725 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:06.752106 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4086/8194] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:31:06.760038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964471b-895d-4f34-932e-8ff0ee4f4720 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:06.760527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964471b-895d-4f34-932e-8ff0ee4f4720 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:06.760659 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964471b-895d-4f34-932e-8ff0ee4f4720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:06.781104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8964471b-895d-4f34-932e-8ff0ee4f4720 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:06.782317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8964471b-895d-4f34-932e-8ff0ee4f4720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:06.790202 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4109/8195] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:06.795306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73416d0-93c1-4013-beee-ef5a5106b940 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:06.805178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73416d0-93c1-4013-beee-ef5a5106b940 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:06.810948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910baa0d-216d-4e2f-bd18-b23018876914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:06.811545 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910baa0d-216d-4e2f-bd18-b23018876914 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:06.811829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910baa0d-216d-4e2f-bd18-b23018876914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:06.812104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910baa0d-216d-4e2f-bd18-b23018876914 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:06.812796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910baa0d-216d-4e2f-bd18-b23018876914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:31:06.813101 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910baa0d-216d-4e2f-bd18-b23018876914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:06.814952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910baa0d-216d-4e2f-bd18-b23018876914 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:06.826724 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4087/8196] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:31:06.830743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964471b-895d-4f34-932e-8ff0ee4f4720 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:06.840552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964471b-895d-4f34-932e-8ff0ee4f4720 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:06.845247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9db03-f7f7-48c6-9984-53dfd7634371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:06.845838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9db03-f7f7-48c6-9984-53dfd7634371 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:06.846119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9db03-f7f7-48c6-9984-53dfd7634371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:06.846391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9db03-f7f7-48c6-9984-53dfd7634371 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:06.847019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9db03-f7f7-48c6-9984-53dfd7634371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:06.848942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9db03-f7f7-48c6-9984-53dfd7634371 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:06.877543 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4110/8197] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:31:06 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:06.881668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910baa0d-216d-4e2f-bd18-b23018876914 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:06.891753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910baa0d-216d-4e2f-bd18-b23018876914 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:06.947986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e0c9e-7929-4571-a66c-88935493d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:06.949028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e0c9e-7929-4571-a66c-88935493d4ea admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:06.949322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e0c9e-7929-4571-a66c-88935493d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:06.949602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e0c9e-7929-4571-a66c-88935493d4ea admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:06.950234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e0c9e-7929-4571-a66c-88935493d4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:06.952149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e0c9e-7929-4571-a66c-88935493d4ea admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:06.971978 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4088/8198] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:31:06 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:06.976060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9db03-f7f7-48c6-9984-53dfd7634371 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:06.987443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9db03-f7f7-48c6-9984-53dfd7634371 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:06.992102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404979fd-d036-4bad-8914-75e512492eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:06.992738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404979fd-d036-4bad-8914-75e512492eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:06.993018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404979fd-d036-4bad-8914-75e512492eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:06.993289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404979fd-d036-4bad-8914-75e512492eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:06.993920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404979fd-d036-4bad-8914-75e512492eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:06.996192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404979fd-d036-4bad-8914-75e512492eb3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:07.006637 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4111/8199] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:07.009773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e0c9e-7929-4571-a66c-88935493d4ea admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:07.019677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e0c9e-7929-4571-a66c-88935493d4ea admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:07.024218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9ed71-9104-480e-b766-4a67721b905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:07.024838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9ed71-9104-480e-b766-4a67721b905f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:07.025116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9ed71-9104-480e-b766-4a67721b905f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:07.025386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9ed71-9104-480e-b766-4a67721b905f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:07.026012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9ed71-9104-480e-b766-4a67721b905f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:07.027812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9ed71-9104-480e-b766-4a67721b905f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:07.038263 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4089/8200] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:31:07.042769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404979fd-d036-4bad-8914-75e512492eb3 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:07.053110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404979fd-d036-4bad-8914-75e512492eb3 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:07.058413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2720af5-a242-4e27-b9af-ac95b63368f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:07.059153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2720af5-a242-4e27-b9af-ac95b63368f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:07.059437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2720af5-a242-4e27-b9af-ac95b63368f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:07.059710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2720af5-a242-4e27-b9af-ac95b63368f0 admin admin] PATH_INFO: `/v3/projects/46734a1198d84e6ba0bca527ec99b04f/users/bd61b59bd6224f058ce9e7a98dc47889/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:07.074647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2720af5-a242-4e27-b9af-ac95b63368f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46734a1198d84e6ba0bca527ec99b04f, user_id=bd61b59bd6224f058ce9e7a98dc47889, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:07.077387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2720af5-a242-4e27-b9af-ac95b63368f0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:07.090092 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4112/8201] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:31:07 2022] PUT /identity/v3/projects/46734a1198d84e6ba0bca527ec99b04f/users/bd61b59bd6224f058ce9e7a98dc47889/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:07.101050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3ad5b-d193-4c80-b131-fc8a3ecd2218 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:07.101337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3ad5b-d193-4c80-b131-fc8a3ecd2218 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:07.101608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3ad5b-d193-4c80-b131-fc8a3ecd2218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:07.129514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-bea3ad5b-d193-4c80-b131-fc8a3ecd2218 None None] MFA Rules not processed for user `bd61b59bd6224f058ce9e7a98dc47889`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:07.130721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bea3ad5b-d193-4c80-b131-fc8a3ecd2218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:07.193855 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4090/8202] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:07.204400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2720af5-a242-4e27-b9af-ac95b63368f0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:07.206137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e2720af5-a242-4e27-b9af-ac95b63368f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:07.266551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2720af5-a242-4e27-b9af-ac95b63368f0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:07.270164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbe5c1-3eaf-4335-9fa0-7c17d3650c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:07.270767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbe5c1-3eaf-4335-9fa0-7c17d3650c61 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:07.271048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbe5c1-3eaf-4335-9fa0-7c17d3650c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:07.271323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbe5c1-3eaf-4335-9fa0-7c17d3650c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:07.280664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbe5c1-3eaf-4335-9fa0-7c17d3650c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:07.282072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbe5c1-3eaf-4335-9fa0-7c17d3650c61 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:07.290801 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4113/8203] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:07.846655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3ad5b-d193-4c80-b131-fc8a3ecd2218 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:07.900569 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:07.914849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3ad5b-d193-4c80-b131-fc8a3ecd2218 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:07.920354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:07.921040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:07.921322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:07.921601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] PATH_INFO: `/v3/users/bd61b59bd6224f058ce9e7a98dc47889` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:07.922777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd61b59bd6224f058ce9e7a98dc47889)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:07.924734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:07.976760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd61b59bd6224f058ce9e7a98dc47889'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:07.991492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd61b59bd6224f058ce9e7a98dc47889'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:08.001697 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd61b59bd6224f058ce9e7a98dc47889'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:08.012946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd61b59bd6224f058ce9e7a98dc47889'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:08.013695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd61b59bd6224f058ce9e7a98dc47889'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:08.020171 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4091/8204] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:31:07 2022] DELETE /identity/v3/users/bd61b59bd6224f058ce9e7a98dc47889 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:08.025370 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb24783-e74e-4dbb-a5eb-a1ce81cd220b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.025881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb24783-e74e-4dbb-a5eb-a1ce81cd220b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.026158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb24783-e74e-4dbb-a5eb-a1ce81cd220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.054160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4cb24783-e74e-4dbb-a5eb-a1ce81cd220b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:08.055414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4cb24783-e74e-4dbb-a5eb-a1ce81cd220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:08.122348 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4114/8205] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:08.133206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:08.134708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:08.214783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3c1d4-e633-436f-bdb8-2cb44038d037 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:08.218584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffa89b-37a7-47c5-9ef9-a7690d7fb8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:08.219193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffa89b-37a7-47c5-9ef9-a7690d7fb8dd service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.219480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffa89b-37a7-47c5-9ef9-a7690d7fb8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.219759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffa89b-37a7-47c5-9ef9-a7690d7fb8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.228951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffa89b-37a7-47c5-9ef9-a7690d7fb8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:08.230423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffa89b-37a7-47c5-9ef9-a7690d7fb8dd service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:08.239994 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4092/8206] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:08.523237 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb24783-e74e-4dbb-a5eb-a1ce81cd220b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:08.524740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4cb24783-e74e-4dbb-a5eb-a1ce81cd220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:08.538153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb24783-e74e-4dbb-a5eb-a1ce81cd220b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:08.543478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:08.544122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.544400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.544770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] PATH_INFO: `/v3/projects/46734a1198d84e6ba0bca527ec99b04f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.545946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] RBAC: Authorizing `identity:delete_project(project_id=46734a1198d84e6ba0bca527ec99b04f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:08.548005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:08.549604 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:08.598759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46734a1198d84e6ba0bca527ec99b04f', 'request_id': 'req-da63cf29-f33b-430c-b45a-eeea114878af'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:08.606294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46734a1198d84e6ba0bca527ec99b04f', 'request_id': 'req-da63cf29-f33b-430c-b45a-eeea114878af'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:08.611921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46734a1198d84e6ba0bca527ec99b04f', 'request_id': 'req-da63cf29-f33b-430c-b45a-eeea114878af'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:08.624272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] The token cache is being invalidate because project 46734a1198d84e6ba0bca527ec99b04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:31:08.624596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:08.625474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-da63cf29-f33b-430c-b45a-eeea114878af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:08.626980 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4115/8207] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:31:08 2022] DELETE /identity/v3/projects/46734a1198d84e6ba0bca527ec99b04f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:08.632020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0893586-283d-4408-a122-0dfdcd2fcb81 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.632313 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0893586-283d-4408-a122-0dfdcd2fcb81 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.632596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0893586-283d-4408-a122-0dfdcd2fcb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.653349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f0893586-283d-4408-a122-0dfdcd2fcb81 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:08.654576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f0893586-283d-4408-a122-0dfdcd2fcb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:08.715028 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4093/8208] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:08.722832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4c8e-9e04-465e-bfc0-c04b72ec82c8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.723123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4c8e-9e04-465e-bfc0-c04b72ec82c8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.723409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4c8e-9e04-465e-bfc0-c04b72ec82c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.743544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e00d4c8e-9e04-465e-bfc0-c04b72ec82c8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:08.744805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e00d4c8e-9e04-465e-bfc0-c04b72ec82c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:08.753251 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4116/8209] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:08.757482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0893586-283d-4408-a122-0dfdcd2fcb81 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:08.767244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0893586-283d-4408-a122-0dfdcd2fcb81 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:08.771773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5553d73-5f98-41fa-9ebb-f41f1f083df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:08.772366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553d73-5f98-41fa-9ebb-f41f1f083df9 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.772675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553d73-5f98-41fa-9ebb-f41f1f083df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.772951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553d73-5f98-41fa-9ebb-f41f1f083df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.773593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553d73-5f98-41fa-9ebb-f41f1f083df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:31:08.773894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553d73-5f98-41fa-9ebb-f41f1f083df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:08.775472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553d73-5f98-41fa-9ebb-f41f1f083df9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:08.787435 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4094/8210] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:31:08.791528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4c8e-9e04-465e-bfc0-c04b72ec82c8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:08.801889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4c8e-9e04-465e-bfc0-c04b72ec82c8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:08.806571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d3c62-4b8d-4c25-9c79-62bb1e01ba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:08.807167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d3c62-4b8d-4c25-9c79-62bb1e01ba93 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.807446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d3c62-4b8d-4c25-9c79-62bb1e01ba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.808133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d3c62-4b8d-4c25-9c79-62bb1e01ba93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.808807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d3c62-4b8d-4c25-9c79-62bb1e01ba93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:08.810708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d3c62-4b8d-4c25-9c79-62bb1e01ba93 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:08.839883 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4117/8211] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:31:08 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:08.844027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5553d73-5f98-41fa-9ebb-f41f1f083df9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:08.849426 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:08.856500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5553d73-5f98-41fa-9ebb-f41f1f083df9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:08.914985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ca7b5-8f8b-4658-9c27-ad80dbee09ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:08.915587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ca7b5-8f8b-4658-9c27-ad80dbee09ca admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.915864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ca7b5-8f8b-4658-9c27-ad80dbee09ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.916137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ca7b5-8f8b-4658-9c27-ad80dbee09ca admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.916795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ca7b5-8f8b-4658-9c27-ad80dbee09ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:08.919696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ca7b5-8f8b-4658-9c27-ad80dbee09ca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:08.940792 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4095/8212] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:31:08 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:31:08.944902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d3c62-4b8d-4c25-9c79-62bb1e01ba93 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:08.955155 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d3c62-4b8d-4c25-9c79-62bb1e01ba93 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:08.959776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a346339-3d3a-4c5e-8326-90623f84f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:08.960367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a346339-3d3a-4c5e-8326-90623f84f15c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.960742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a346339-3d3a-4c5e-8326-90623f84f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.961017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a346339-3d3a-4c5e-8326-90623f84f15c admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.961652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a346339-3d3a-4c5e-8326-90623f84f15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:08.963271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a346339-3d3a-4c5e-8326-90623f84f15c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:08.975182 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4118/8213] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:08.979198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ca7b5-8f8b-4658-9c27-ad80dbee09ca admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:08.990563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ca7b5-8f8b-4658-9c27-ad80dbee09ca admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:08.995322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb1cc9-4e04-4b2b-9354-de2c3c4b0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:08.995916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb1cc9-4e04-4b2b-9354-de2c3c4b0f17 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:08.996200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb1cc9-4e04-4b2b-9354-de2c3c4b0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:08.996473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb1cc9-4e04-4b2b-9354-de2c3c4b0f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:08.997146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb1cc9-4e04-4b2b-9354-de2c3c4b0f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:08.998732 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb1cc9-4e04-4b2b-9354-de2c3c4b0f17 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:09.009245 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4096/8214] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:09.013201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a346339-3d3a-4c5e-8326-90623f84f15c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:09.023058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a346339-3d3a-4c5e-8326-90623f84f15c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:09.028354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c343c-5ca6-4745-ac0d-32a9b4e6b291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:09.029025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c343c-5ca6-4745-ac0d-32a9b4e6b291 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:09.029304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c343c-5ca6-4745-ac0d-32a9b4e6b291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:09.029576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c343c-5ca6-4745-ac0d-32a9b4e6b291 admin admin] PATH_INFO: `/v3/projects/9372f54a7d3e47799e9688ba09b2c15e/users/7d2c3609fa1043dd8cff694524eeaf28/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:09.044527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c343c-5ca6-4745-ac0d-32a9b4e6b291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9372f54a7d3e47799e9688ba09b2c15e, user_id=7d2c3609fa1043dd8cff694524eeaf28, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:09.047221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c343c-5ca6-4745-ac0d-32a9b4e6b291 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:09.060312 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4119/8215] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:31:09 2022] PUT /identity/v3/projects/9372f54a7d3e47799e9688ba09b2c15e/users/7d2c3609fa1043dd8cff694524eeaf28/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:09.071973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde3b04-e4dc-4cc1-ac14-d12f8feb38ea None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:09.072267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde3b04-e4dc-4cc1-ac14-d12f8feb38ea None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:09.072570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde3b04-e4dc-4cc1-ac14-d12f8feb38ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:09.101643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ebde3b04-e4dc-4cc1-ac14-d12f8feb38ea None None] MFA Rules not processed for user `7d2c3609fa1043dd8cff694524eeaf28`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:09.102797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ebde3b04-e4dc-4cc1-ac14-d12f8feb38ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:09.166321 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4097/8216] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:09.176387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c343c-5ca6-4745-ac0d-32a9b4e6b291 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:09.178146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ee6c343c-5ca6-4745-ac0d-32a9b4e6b291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:09.237650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c343c-5ca6-4745-ac0d-32a9b4e6b291 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:09.241378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbc409-1b05-4244-bef5-6142d6d8ecf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:09.241991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbc409-1b05-4244-bef5-6142d6d8ecf7 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:09.242275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbc409-1b05-4244-bef5-6142d6d8ecf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:09.242551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbc409-1b05-4244-bef5-6142d6d8ecf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:09.251460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbc409-1b05-4244-bef5-6142d6d8ecf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:09.252920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbc409-1b05-4244-bef5-6142d6d8ecf7 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:09.262369 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4120/8217] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:19.163488 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:19.257785 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:21.661822 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde3b04-e4dc-4cc1-ac14-d12f8feb38ea None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:21.725110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde3b04-e4dc-4cc1-ac14-d12f8feb38ea None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:21.729516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:21.730146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:21.730426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:21.730700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] PATH_INFO: `/v3/users/7d2c3609fa1043dd8cff694524eeaf28` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:21.731923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2c3609fa1043dd8cff694524eeaf28)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:21.733938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:21.780682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2c3609fa1043dd8cff694524eeaf28'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:21.793652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2c3609fa1043dd8cff694524eeaf28'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:21.800511 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2c3609fa1043dd8cff694524eeaf28'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:21.807691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2c3609fa1043dd8cff694524eeaf28'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:21.808350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2c3609fa1043dd8cff694524eeaf28'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:21.814437 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4098/8218] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:31:21 2022] DELETE /identity/v3/users/7d2c3609fa1043dd8cff694524eeaf28 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:21.818904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9295d3-49d3-4fb6-badd-ea733bc8f5f1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:21.819390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9295d3-49d3-4fb6-badd-ea733bc8f5f1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:21.819511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9295d3-49d3-4fb6-badd-ea733bc8f5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:21.839894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ca9295d3-49d3-4fb6-badd-ea733bc8f5f1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:21.841116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ca9295d3-49d3-4fb6-badd-ea733bc8f5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:21.898909 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4121/8219] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:21.908869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:21.910280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:21.970914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a38d68-e47f-477a-a546-9a58d4e2519d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:21.974543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd370c-82cb-4b50-99d0-82ce99e467c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:21.975224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd370c-82cb-4b50-99d0-82ce99e467c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:21.975449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd370c-82cb-4b50-99d0-82ce99e467c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:21.975720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd370c-82cb-4b50-99d0-82ce99e467c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:21.985459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd370c-82cb-4b50-99d0-82ce99e467c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:21.986902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd370c-82cb-4b50-99d0-82ce99e467c2 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:21.997597 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4099/8220] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:22.484648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9295d3-49d3-4fb6-badd-ea733bc8f5f1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:22.486271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ca9295d3-49d3-4fb6-badd-ea733bc8f5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:22.498950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9295d3-49d3-4fb6-badd-ea733bc8f5f1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:22.505612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:22.506427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:22.506792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:22.507217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] PATH_INFO: `/v3/projects/9372f54a7d3e47799e9688ba09b2c15e` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:22.508784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9372f54a7d3e47799e9688ba09b2c15e)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:22.511852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:22.560909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9372f54a7d3e47799e9688ba09b2c15e', 'request_id': 'req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:22.568405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9372f54a7d3e47799e9688ba09b2c15e', 'request_id': 'req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:22.574601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9372f54a7d3e47799e9688ba09b2c15e', 'request_id': 'req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:22.585697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] The token cache is being invalidate because project 9372f54a7d3e47799e9688ba09b2c15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:31:22.586009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:22.586699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea73d9f1-e0d3-4a53-ae46-67306f5b5783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:22.588369 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4122/8221] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:31:22 2022] DELETE /identity/v3/projects/9372f54a7d3e47799e9688ba09b2c15e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:22.594801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1837-e510-4d96-9bc3-f1fef0aca27f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:22.595087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1837-e510-4d96-9bc3-f1fef0aca27f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:22.595381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1837-e510-4d96-9bc3-f1fef0aca27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:22.615237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-75ab1837-e510-4d96-9bc3-f1fef0aca27f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:22.616454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-75ab1837-e510-4d96-9bc3-f1fef0aca27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:22.634521 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:22.680114 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4100/8222] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:22.688488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b7ff7-26c6-41c1-b7a5-771cdf10ca02 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:22.688805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b7ff7-26c6-41c1-b7a5-771cdf10ca02 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:22.689338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b7ff7-26c6-41c1-b7a5-771cdf10ca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:22.709748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7a1b7ff7-26c6-41c1-b7a5-771cdf10ca02 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:22.710950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7a1b7ff7-26c6-41c1-b7a5-771cdf10ca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:22.720232 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4123/8223] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:22.724344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1837-e510-4d96-9bc3-f1fef0aca27f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:22.734444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1837-e510-4d96-9bc3-f1fef0aca27f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:22.738971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795d169-14e1-4ef8-9257-1af979143779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:22.739580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795d169-14e1-4ef8-9257-1af979143779 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:22.739866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795d169-14e1-4ef8-9257-1af979143779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:22.740144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795d169-14e1-4ef8-9257-1af979143779 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:22.740823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795d169-14e1-4ef8-9257-1af979143779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:31:22.741130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795d169-14e1-4ef8-9257-1af979143779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:22.742736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795d169-14e1-4ef8-9257-1af979143779 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:22.754217 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4101/8224] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:31:22.758536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b7ff7-26c6-41c1-b7a5-771cdf10ca02 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:22.768261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b7ff7-26c6-41c1-b7a5-771cdf10ca02 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:22.772933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34233d2a-ee24-4717-9e1d-ae98ebf23898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:22.773523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34233d2a-ee24-4717-9e1d-ae98ebf23898 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:22.773800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34233d2a-ee24-4717-9e1d-ae98ebf23898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:22.774073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34233d2a-ee24-4717-9e1d-ae98ebf23898 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:22.774698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34233d2a-ee24-4717-9e1d-ae98ebf23898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:22.776735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34233d2a-ee24-4717-9e1d-ae98ebf23898 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:22.803611 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4124/8225] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:31:22 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:22.808401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795d169-14e1-4ef8-9257-1af979143779 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:22.818825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795d169-14e1-4ef8-9257-1af979143779 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:22.875636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127520a-8510-4ed4-a511-98c9d35ec5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:22.876232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127520a-8510-4ed4-a511-98c9d35ec5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:22.876512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127520a-8510-4ed4-a511-98c9d35ec5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:22.876821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127520a-8510-4ed4-a511-98c9d35ec5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:22.877452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127520a-8510-4ed4-a511-98c9d35ec5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:22.879370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127520a-8510-4ed4-a511-98c9d35ec5b8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:22.899560 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4102/8226] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:31:22 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:22.903646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34233d2a-ee24-4717-9e1d-ae98ebf23898 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:22.913971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34233d2a-ee24-4717-9e1d-ae98ebf23898 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:22.919436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2caad9-fea3-46d8-9182-2e456fcf676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:22.920031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2caad9-fea3-46d8-9182-2e456fcf676b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:22.920311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2caad9-fea3-46d8-9182-2e456fcf676b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:22.920583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2caad9-fea3-46d8-9182-2e456fcf676b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:22.921252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2caad9-fea3-46d8-9182-2e456fcf676b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:22.922833 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2caad9-fea3-46d8-9182-2e456fcf676b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:22.933329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4125/8227] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:22.937019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127520a-8510-4ed4-a511-98c9d35ec5b8 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:22.947370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127520a-8510-4ed4-a511-98c9d35ec5b8 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:22.952266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340cf52-82bf-40ba-9bad-4f5a559d0cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:22.952915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340cf52-82bf-40ba-9bad-4f5a559d0cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:22.953200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340cf52-82bf-40ba-9bad-4f5a559d0cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:22.953477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340cf52-82bf-40ba-9bad-4f5a559d0cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:22.954122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340cf52-82bf-40ba-9bad-4f5a559d0cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:22.955736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340cf52-82bf-40ba-9bad-4f5a559d0cf6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:22.969172 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4103/8228] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:22.973116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2caad9-fea3-46d8-9182-2e456fcf676b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:22.985103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2caad9-fea3-46d8-9182-2e456fcf676b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:22.990035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555348a0-285a-4c96-ad01-40edc287016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:22.990723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555348a0-285a-4c96-ad01-40edc287016b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:22.991059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555348a0-285a-4c96-ad01-40edc287016b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:22.991335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555348a0-285a-4c96-ad01-40edc287016b admin admin] PATH_INFO: `/v3/projects/ae461f2e7cf94183bcb3dfd4892c465d/users/402b32660d3c4421b3dfe076d7be07da/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.006481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555348a0-285a-4c96-ad01-40edc287016b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae461f2e7cf94183bcb3dfd4892c465d, user_id=402b32660d3c4421b3dfe076d7be07da, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:23.009178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555348a0-285a-4c96-ad01-40edc287016b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:23.025990 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4126/8229] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:31:22 2022] PUT /identity/v3/projects/ae461f2e7cf94183bcb3dfd4892c465d/users/402b32660d3c4421b3dfe076d7be07da/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:23.036979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a72bb1-e7ef-43c5-a93f-44d16a4a5990 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:23.037288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a72bb1-e7ef-43c5-a93f-44d16a4a5990 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:23.037563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a72bb1-e7ef-43c5-a93f-44d16a4a5990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.067891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-21a72bb1-e7ef-43c5-a93f-44d16a4a5990 None None] MFA Rules not processed for user `402b32660d3c4421b3dfe076d7be07da`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:23.069159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-21a72bb1-e7ef-43c5-a93f-44d16a4a5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:23.138729 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4104/8230] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:23.143245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555348a0-285a-4c96-ad01-40edc287016b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:23.164030 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:23.206586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555348a0-285a-4c96-ad01-40edc287016b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:23.211386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053592a-fcc4-43fd-88a4-573053eea3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:23.212005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053592a-fcc4-43fd-88a4-573053eea3dd admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:23.212278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053592a-fcc4-43fd-88a4-573053eea3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:23.212553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053592a-fcc4-43fd-88a4-573053eea3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.213207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053592a-fcc4-43fd-88a4-573053eea3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:23.215629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053592a-fcc4-43fd-88a4-573053eea3dd admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:23.241926 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4127/8231] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:31:23 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:23.245784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a72bb1-e7ef-43c5-a93f-44d16a4a5990 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:23.256644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a72bb1-e7ef-43c5-a93f-44d16a4a5990 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:23.268831 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:23.316176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4614-b123-47d6-a6b4-ac97cc9c31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:23.316819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4614-b123-47d6-a6b4-ac97cc9c31bb admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:23.317106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4614-b123-47d6-a6b4-ac97cc9c31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:23.317386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4614-b123-47d6-a6b4-ac97cc9c31bb admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.318013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4614-b123-47d6-a6b4-ac97cc9c31bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:23.319932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4614-b123-47d6-a6b4-ac97cc9c31bb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:23.345550 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4105/8232] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:31:23 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:23.346795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053592a-fcc4-43fd-88a4-573053eea3dd admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:23.357847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053592a-fcc4-43fd-88a4-573053eea3dd admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:23.362720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7bb7f-1cc5-43bb-936e-14dd59180d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:23.363318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7bb7f-1cc5-43bb-936e-14dd59180d32 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:23.363600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7bb7f-1cc5-43bb-936e-14dd59180d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:23.363875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7bb7f-1cc5-43bb-936e-14dd59180d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.364508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7bb7f-1cc5-43bb-936e-14dd59180d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:23.366139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7bb7f-1cc5-43bb-936e-14dd59180d32 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:23.377380 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4128/8233] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:23.381488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4614-b123-47d6-a6b4-ac97cc9c31bb admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:23.392908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4614-b123-47d6-a6b4-ac97cc9c31bb admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:23.397548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbcc9e-c1e4-4e20-9741-c233d1576a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:23.398193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbcc9e-c1e4-4e20-9741-c233d1576a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:23.398474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbcc9e-c1e4-4e20-9741-c233d1576a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:23.398748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbcc9e-c1e4-4e20-9741-c233d1576a5d admin admin] PATH_INFO: `/v3/projects/f668022237604d0ba180eaf51a8874df/users/87a526f537fc47d1918e67b9da31e4ae/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.414304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbcc9e-c1e4-4e20-9741-c233d1576a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f668022237604d0ba180eaf51a8874df, user_id=87a526f537fc47d1918e67b9da31e4ae, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:23.417758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbcc9e-c1e4-4e20-9741-c233d1576a5d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:23.430430 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4106/8234] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:31:23 2022] PUT /identity/v3/projects/f668022237604d0ba180eaf51a8874df/users/87a526f537fc47d1918e67b9da31e4ae/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:31:23.434452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7bb7f-1cc5-43bb-936e-14dd59180d32 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:23.444673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7bb7f-1cc5-43bb-936e-14dd59180d32 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:23.502753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdb4f2-813f-401a-9d7b-30775e6e6631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:23.503358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdb4f2-813f-401a-9d7b-30775e6e6631 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:23.503644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdb4f2-813f-401a-9d7b-30775e6e6631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:23.503923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdb4f2-813f-401a-9d7b-30775e6e6631 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.504673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbdb4f2-813f-401a-9d7b-30775e6e6631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:23.506323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbdb4f2-813f-401a-9d7b-30775e6e6631 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:23.516724 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4129/8235] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:31:23.521063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbcc9e-c1e4-4e20-9741-c233d1576a5d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:23.532014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbcc9e-c1e4-4e20-9741-c233d1576a5d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:23.536648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0057968-934d-4d6f-994c-976ddac63101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:23.537352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0057968-934d-4d6f-994c-976ddac63101 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:23.537635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0057968-934d-4d6f-994c-976ddac63101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:23.537907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0057968-934d-4d6f-994c-976ddac63101 admin admin] PATH_INFO: `/v3/projects/f668022237604d0ba180eaf51a8874df/users/87a526f537fc47d1918e67b9da31e4ae/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.539820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0057968-934d-4d6f-994c-976ddac63101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f668022237604d0ba180eaf51a8874df, user_id=87a526f537fc47d1918e67b9da31e4ae, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:23.542744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0057968-934d-4d6f-994c-976ddac63101 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:23.552877 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4107/8236] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:31:23 2022] PUT /identity/v3/projects/f668022237604d0ba180eaf51a8874df/users/87a526f537fc47d1918e67b9da31e4ae/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:23.564490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f34f78-5946-45ce-94b7-5cf6afcc7be9 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:23.564806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f34f78-5946-45ce-94b7-5cf6afcc7be9 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:23.565081 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f34f78-5946-45ce-94b7-5cf6afcc7be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.594604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-58f34f78-5946-45ce-94b7-5cf6afcc7be9 None None] MFA Rules not processed for user `87a526f537fc47d1918e67b9da31e4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:23.595845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-58f34f78-5946-45ce-94b7-5cf6afcc7be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:23.662303 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4130/8237] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:23.673959 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0057968-934d-4d6f-994c-976ddac63101 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:23.675763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c0057968-934d-4d6f-994c-976ddac63101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:23.757473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0057968-934d-4d6f-994c-976ddac63101 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:23.761293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce8a4-8312-40c1-95f3-92057be70ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:23.761894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce8a4-8312-40c1-95f3-92057be70ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:23.762178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce8a4-8312-40c1-95f3-92057be70ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:23.762452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce8a4-8312-40c1-95f3-92057be70ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:23.818062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ce8a4-8312-40c1-95f3-92057be70ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:23.819492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ce8a4-8312-40c1-95f3-92057be70ab5 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:23.828377 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4108/8238] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:27.432109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f34f78-5946-45ce-94b7-5cf6afcc7be9 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:27.434583 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-58f34f78-5946-45ce-94b7-5cf6afcc7be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:27.450442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f34f78-5946-45ce-94b7-5cf6afcc7be9 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:27.454064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25349c2e-3a44-4bc7-be2d-4520d42e68dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:27.454664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25349c2e-3a44-4bc7-be2d-4520d42e68dd service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:27.454945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25349c2e-3a44-4bc7-be2d-4520d42e68dd service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:27.455224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25349c2e-3a44-4bc7-be2d-4520d42e68dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:27.464790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25349c2e-3a44-4bc7-be2d-4520d42e68dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:27.466214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25349c2e-3a44-4bc7-be2d-4520d42e68dd service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:27.475606 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4131/8239] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:33.824369 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:35.252182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce8a4-8312-40c1-95f3-92057be70ab5 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:35.318899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce8a4-8312-40c1-95f3-92057be70ab5 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:35.324148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:35.324829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:35.325126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:35.325404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] PATH_INFO: `/v3/users/402b32660d3c4421b3dfe076d7be07da` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:35.326571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] RBAC: Authorizing `identity:delete_user(user_id=402b32660d3c4421b3dfe076d7be07da)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:35.328473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:35.381461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402b32660d3c4421b3dfe076d7be07da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:35.395587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402b32660d3c4421b3dfe076d7be07da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:35.405082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402b32660d3c4421b3dfe076d7be07da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:35.413557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402b32660d3c4421b3dfe076d7be07da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:35.414250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1229bb03-ac31-4514-93b2-276580dc621a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402b32660d3c4421b3dfe076d7be07da'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:35.420877 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4109/8240] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:31:35 2022] DELETE /identity/v3/users/402b32660d3c4421b3dfe076d7be07da => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:35.425387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eb556-a633-42dc-ac51-5ef8ee616121 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:35.425896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eb556-a633-42dc-ac51-5ef8ee616121 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:35.426044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eb556-a633-42dc-ac51-5ef8ee616121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:35.433769 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:35.448854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-db6eb556-a633-42dc-ac51-5ef8ee616121 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:35.450070 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db6eb556-a633-42dc-ac51-5ef8ee616121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:35.513634 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4132/8241] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:31:35.522839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567427d6-adbf-43b4-b1ba-8c3d688d0bcc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:35.523131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567427d6-adbf-43b4-b1ba-8c3d688d0bcc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:35.523412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567427d6-adbf-43b4-b1ba-8c3d688d0bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:35.575136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-567427d6-adbf-43b4-b1ba-8c3d688d0bcc None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:35.576509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-567427d6-adbf-43b4-b1ba-8c3d688d0bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:35.630292 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4110/8242] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Oct 19 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:35.636973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eb556-a633-42dc-ac51-5ef8ee616121 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:35.647618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eb556-a633-42dc-ac51-5ef8ee616121 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:35.652161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d0bb-163e-4430-b459-56a04ae0487d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:35.652816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d0bb-163e-4430-b459-56a04ae0487d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:35.653092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d0bb-163e-4430-b459-56a04ae0487d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:35.653357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d0bb-163e-4430-b459-56a04ae0487d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:35.663489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d0bb-163e-4430-b459-56a04ae0487d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:35.664993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d0bb-163e-4430-b459-56a04ae0487d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:35.675970 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4133/8243] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:35.971533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567427d6-adbf-43b4-b1ba-8c3d688d0bcc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:35.973220 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-567427d6-adbf-43b4-b1ba-8c3d688d0bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:35.990502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567427d6-adbf-43b4-b1ba-8c3d688d0bcc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:35.996357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:35.997164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:35.997527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:35.997963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] PATH_INFO: `/v3/projects/ae461f2e7cf94183bcb3dfd4892c465d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:35.999348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae461f2e7cf94183bcb3dfd4892c465d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:36.001401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:36.003760 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:36.055695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae461f2e7cf94183bcb3dfd4892c465d', 'request_id': 'req-d99dba5b-dee5-4cef-8981-5b0448b9315e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.064341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae461f2e7cf94183bcb3dfd4892c465d', 'request_id': 'req-d99dba5b-dee5-4cef-8981-5b0448b9315e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.070631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae461f2e7cf94183bcb3dfd4892c465d', 'request_id': 'req-d99dba5b-dee5-4cef-8981-5b0448b9315e'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.082716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] The token cache is being invalidate because project ae461f2e7cf94183bcb3dfd4892c465d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:31:36.083009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.083686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.085431 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4111/8244] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:31:35 2022] DELETE /identity/v3/projects/ae461f2e7cf94183bcb3dfd4892c465d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:36.089979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d0bb-163e-4430-b459-56a04ae0487d service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:36.100504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d0bb-163e-4430-b459-56a04ae0487d service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:36.159250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:36.159897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:36.160178 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:36.160456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] PATH_INFO: `/v3/users/87a526f537fc47d1918e67b9da31e4ae` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:36.161672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a526f537fc47d1918e67b9da31e4ae)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:36.163616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:36.210788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a526f537fc47d1918e67b9da31e4ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.222353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a526f537fc47d1918e67b9da31e4ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.230653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a526f537fc47d1918e67b9da31e4ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.238041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a526f537fc47d1918e67b9da31e4ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.238720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4793c007-f9ae-4944-859e-51f5b6cb86c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a526f537fc47d1918e67b9da31e4ae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.244791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4134/8245] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:31:36 2022] DELETE /identity/v3/users/87a526f537fc47d1918e67b9da31e4ae => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:36.539981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:36.542273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:36.558233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dba5b-dee5-4cef-8981-5b0448b9315e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:36.621221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:36.621857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:36.622142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:36.622421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] PATH_INFO: `/v3/projects/f668022237604d0ba180eaf51a8874df` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:36.623870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f668022237604d0ba180eaf51a8874df)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:36.626441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:36.673755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f668022237604d0ba180eaf51a8874df', 'request_id': 'req-2d5f6996-6667-4738-9fb1-70e5931d40c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.681885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f668022237604d0ba180eaf51a8874df', 'request_id': 'req-2d5f6996-6667-4738-9fb1-70e5931d40c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.688106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f668022237604d0ba180eaf51a8874df', 'request_id': 'req-2d5f6996-6667-4738-9fb1-70e5931d40c4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.700542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] The token cache is being invalidate because project f668022237604d0ba180eaf51a8874df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:31:36.700918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.701518 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2d5f6996-6667-4738-9fb1-70e5931d40c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:36.703045 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4112/8246] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:31:36 2022] DELETE /identity/v3/projects/f668022237604d0ba180eaf51a8874df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:36.709321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d74d-c543-4cbb-862d-a5bb799c3e48 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:36.709870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d74d-c543-4cbb-862d-a5bb799c3e48 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:36.710363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d74d-c543-4cbb-862d-a5bb799c3e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:36.732741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-39c5d74d-c543-4cbb-862d-a5bb799c3e48 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:36.733946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-39c5d74d-c543-4cbb-862d-a5bb799c3e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:36.738606 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:36.800727 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4135/8247] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:36.808688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec166-8f00-4024-857b-16961ad07847 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:36.808982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec166-8f00-4024-857b-16961ad07847 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:36.809262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec166-8f00-4024-857b-16961ad07847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:36.830563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-918ec166-8f00-4024-857b-16961ad07847 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:36.831784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-918ec166-8f00-4024-857b-16961ad07847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:36.841238 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4113/8248] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:36.845500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5d74d-c543-4cbb-862d-a5bb799c3e48 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:36.856498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5d74d-c543-4cbb-862d-a5bb799c3e48 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:36.861618 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbe2aa-f3ee-4b5e-bb11-586865184fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:36.862219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbe2aa-f3ee-4b5e-bb11-586865184fdf admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:36.862504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbe2aa-f3ee-4b5e-bb11-586865184fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:36.862781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbe2aa-f3ee-4b5e-bb11-586865184fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:36.863425 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbe2aa-f3ee-4b5e-bb11-586865184fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:31:36.863733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbe2aa-f3ee-4b5e-bb11-586865184fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:36.865451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbe2aa-f3ee-4b5e-bb11-586865184fdf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:36.878615 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4136/8249] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:31:36.882581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec166-8f00-4024-857b-16961ad07847 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:36.892331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec166-8f00-4024-857b-16961ad07847 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:36.897057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb13a4-cf92-4240-8c3a-2bcebe7d7b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:36.897647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb13a4-cf92-4240-8c3a-2bcebe7d7b4f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:36.897952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb13a4-cf92-4240-8c3a-2bcebe7d7b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:36.898221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb13a4-cf92-4240-8c3a-2bcebe7d7b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:36.898838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb13a4-cf92-4240-8c3a-2bcebe7d7b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:36.900755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb13a4-cf92-4240-8c3a-2bcebe7d7b4f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:36.912522 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:36.930079 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4114/8250] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:31:36 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:36.934247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbe2aa-f3ee-4b5e-bb11-586865184fdf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:36.946227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbe2aa-f3ee-4b5e-bb11-586865184fdf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:37.006546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f83e8-3d43-4ade-9b4d-cbcf4ea13222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:37.007131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f83e8-3d43-4ade-9b4d-cbcf4ea13222 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.007410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f83e8-3d43-4ade-9b4d-cbcf4ea13222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.007682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f83e8-3d43-4ade-9b4d-cbcf4ea13222 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.008308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f83e8-3d43-4ade-9b4d-cbcf4ea13222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:37.010248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f83e8-3d43-4ade-9b4d-cbcf4ea13222 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:37.032560 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4137/8251] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:31:36 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:37.036734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb13a4-cf92-4240-8c3a-2bcebe7d7b4f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:37.048150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb13a4-cf92-4240-8c3a-2bcebe7d7b4f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:37.053186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cc50f-52e0-43ad-9013-884c590af111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:37.053799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cc50f-52e0-43ad-9013-884c590af111 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.054079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cc50f-52e0-43ad-9013-884c590af111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.054354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cc50f-52e0-43ad-9013-884c590af111 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.055027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cc50f-52e0-43ad-9013-884c590af111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:37.056654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cc50f-52e0-43ad-9013-884c590af111 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:37.069870 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4115/8252] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:37.074613 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f83e8-3d43-4ade-9b4d-cbcf4ea13222 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:37.085236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f83e8-3d43-4ade-9b4d-cbcf4ea13222 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:37.090584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8af18-e73c-4f1d-9248-8bd5420a2bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:37.091199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8af18-e73c-4f1d-9248-8bd5420a2bcc admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.091470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8af18-e73c-4f1d-9248-8bd5420a2bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.091738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8af18-e73c-4f1d-9248-8bd5420a2bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.092373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8af18-e73c-4f1d-9248-8bd5420a2bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:37.094001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8af18-e73c-4f1d-9248-8bd5420a2bcc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:37.104889 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4138/8253] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:31:37.109124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cc50f-52e0-43ad-9013-884c590af111 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:37.119268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cc50f-52e0-43ad-9013-884c590af111 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:37.123993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd6de-3486-4a1b-b3a2-52919a4e9a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:37.124785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd6de-3486-4a1b-b3a2-52919a4e9a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.125070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd6de-3486-4a1b-b3a2-52919a4e9a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.125348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd6de-3486-4a1b-b3a2-52919a4e9a90 admin admin] PATH_INFO: `/v3/projects/c05ab64e9774497e8fbb09c88b269640/users/a493b978a14146a2940c015127b3f715/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.140658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dd6de-3486-4a1b-b3a2-52919a4e9a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05ab64e9774497e8fbb09c88b269640, user_id=a493b978a14146a2940c015127b3f715, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:37.143247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dd6de-3486-4a1b-b3a2-52919a4e9a90 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:37.156575 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4116/8254] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:31:37 2022] PUT /identity/v3/projects/c05ab64e9774497e8fbb09c88b269640/users/a493b978a14146a2940c015127b3f715/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:37.168249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fc8ab-d242-48ba-b41c-7bf1a2452a36 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.168552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fc8ab-d242-48ba-b41c-7bf1a2452a36 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.168866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fc8ab-d242-48ba-b41c-7bf1a2452a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.196973 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f75fc8ab-d242-48ba-b41c-7bf1a2452a36 None None] MFA Rules not processed for user `a493b978a14146a2940c015127b3f715`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:37.198754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f75fc8ab-d242-48ba-b41c-7bf1a2452a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:37.262209 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4139/8255] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:37.273170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd6de-3486-4a1b-b3a2-52919a4e9a90 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:37.274876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-241dd6de-3486-4a1b-b3a2-52919a4e9a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:37.335240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd6de-3486-4a1b-b3a2-52919a4e9a90 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:37.339064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ac841-246b-40f7-9fc3-5eebffa41609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:37.339662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ac841-246b-40f7-9fc3-5eebffa41609 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.339945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ac841-246b-40f7-9fc3-5eebffa41609 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.340224 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ac841-246b-40f7-9fc3-5eebffa41609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.348833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ac841-246b-40f7-9fc3-5eebffa41609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:37.350466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ac841-246b-40f7-9fc3-5eebffa41609 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:37.360917 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4117/8256] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:37.381849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fc8ab-d242-48ba-b41c-7bf1a2452a36 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:37.387940 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:37.454484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fc8ab-d242-48ba-b41c-7bf1a2452a36 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:37.459071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:37.459705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.459987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.460267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] PATH_INFO: `/v3/users/a493b978a14146a2940c015127b3f715` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.461450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a493b978a14146a2940c015127b3f715)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:37.463389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:37.511321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a493b978a14146a2940c015127b3f715'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:37.523289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a493b978a14146a2940c015127b3f715'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:37.531525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a493b978a14146a2940c015127b3f715'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:37.538923 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a493b978a14146a2940c015127b3f715'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:37.539599 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-fe57f5f7-7fb7-4cba-933b-ad75eba86fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a493b978a14146a2940c015127b3f715'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:37.546150 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4140/8257] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:31:37 2022] DELETE /identity/v3/users/a493b978a14146a2940c015127b3f715 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:37.550715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519f40-99be-4b36-8641-05a14544d5c8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.551496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519f40-99be-4b36-8641-05a14544d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.551496 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519f40-99be-4b36-8641-05a14544d5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.571189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8f519f40-99be-4b36-8641-05a14544d5c8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:37.572391 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8f519f40-99be-4b36-8641-05a14544d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:37.633398 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4118/8258] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:37.643143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e197-0dbc-41fb-aa93-1c325f8fef13 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.643434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e197-0dbc-41fb-aa93-1c325f8fef13 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.643710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e197-0dbc-41fb-aa93-1c325f8fef13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.666105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a461e197-0dbc-41fb-aa93-1c325f8fef13 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:37.668513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a461e197-0dbc-41fb-aa93-1c325f8fef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:37.727020 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4141/8259] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Oct 19 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:37.733705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519f40-99be-4b36-8641-05a14544d5c8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:37.743536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519f40-99be-4b36-8641-05a14544d5c8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:37.749022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4bd3c-5a70-4798-aa0d-241f1ce04b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:37.749626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4bd3c-5a70-4798-aa0d-241f1ce04b0b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:37.749908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4bd3c-5a70-4798-aa0d-241f1ce04b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:37.750211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4bd3c-5a70-4798-aa0d-241f1ce04b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:37.759477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4bd3c-5a70-4798-aa0d-241f1ce04b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:37.761748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4bd3c-5a70-4798-aa0d-241f1ce04b0b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:37.773179 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4119/8260] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:38.049462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461e197-0dbc-41fb-aa93-1c325f8fef13 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:38.051528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a461e197-0dbc-41fb-aa93-1c325f8fef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:38.066290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461e197-0dbc-41fb-aa93-1c325f8fef13 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:38.070849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:38.071487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.071763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.072034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] PATH_INFO: `/v3/projects/c05ab64e9774497e8fbb09c88b269640` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.073835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05ab64e9774497e8fbb09c88b269640)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:38.075747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:38.111204 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:38.128706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05ab64e9774497e8fbb09c88b269640', 'request_id': 'req-0e1ab782-e799-48cc-afed-82497d661e2a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:38.136653 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05ab64e9774497e8fbb09c88b269640', 'request_id': 'req-0e1ab782-e799-48cc-afed-82497d661e2a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:38.142813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05ab64e9774497e8fbb09c88b269640', 'request_id': 'req-0e1ab782-e799-48cc-afed-82497d661e2a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:38.154259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] The token cache is being invalidate because project c05ab64e9774497e8fbb09c88b269640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:31:38.154546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:38.155190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0e1ab782-e799-48cc-afed-82497d661e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:38.156802 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4142/8261] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:31:38 2022] DELETE /identity/v3/projects/c05ab64e9774497e8fbb09c88b269640 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:38.161840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0490-2f2b-4bcc-9201-ee39f1472174 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.162127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0490-2f2b-4bcc-9201-ee39f1472174 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.162404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0490-2f2b-4bcc-9201-ee39f1472174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.181704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6b2e0490-2f2b-4bcc-9201-ee39f1472174 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:38.183437 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6b2e0490-2f2b-4bcc-9201-ee39f1472174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:38.226006 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:38.244162 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4120/8262] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:38.252556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260a108-3678-48bb-9556-bf97c9b703fd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.252999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260a108-3678-48bb-9556-bf97c9b703fd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.253285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260a108-3678-48bb-9556-bf97c9b703fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.273718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0260a108-3678-48bb-9556-bf97c9b703fd None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:38.274961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0260a108-3678-48bb-9556-bf97c9b703fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:38.284113 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4143/8263] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:38.288425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e0490-2f2b-4bcc-9201-ee39f1472174 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:38.298863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e0490-2f2b-4bcc-9201-ee39f1472174 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:38.303392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf601844-df44-4841-84aa-92a3061cc974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:38.303992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601844-df44-4841-84aa-92a3061cc974 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.304273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601844-df44-4841-84aa-92a3061cc974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.304548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601844-df44-4841-84aa-92a3061cc974 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.305316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf601844-df44-4841-84aa-92a3061cc974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:31:38.305624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf601844-df44-4841-84aa-92a3061cc974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:38.307301 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf601844-df44-4841-84aa-92a3061cc974 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:38.319292 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4121/8264] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:31:38.324450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260a108-3678-48bb-9556-bf97c9b703fd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:38.333656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260a108-3678-48bb-9556-bf97c9b703fd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:38.338640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100701d5-a4ad-49af-9239-6c1d47d8fc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:38.340151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100701d5-a4ad-49af-9239-6c1d47d8fc4d admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.340551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100701d5-a4ad-49af-9239-6c1d47d8fc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.340866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100701d5-a4ad-49af-9239-6c1d47d8fc4d admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.341510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100701d5-a4ad-49af-9239-6c1d47d8fc4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:38.343408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100701d5-a4ad-49af-9239-6c1d47d8fc4d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:38.370846 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4144/8265] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:31:38 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:31:38.375068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf601844-df44-4841-84aa-92a3061cc974 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:38.385034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf601844-df44-4841-84aa-92a3061cc974 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:38.446190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9edd02-6da2-4048-97d8-b59bf6808334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:38.447417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9edd02-6da2-4048-97d8-b59bf6808334 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.448445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9edd02-6da2-4048-97d8-b59bf6808334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.448993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9edd02-6da2-4048-97d8-b59bf6808334 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.449952 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9edd02-6da2-4048-97d8-b59bf6808334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:38.451869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9edd02-6da2-4048-97d8-b59bf6808334 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:38.474379 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4122/8266] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:31:38 2022] POST /identity/v3/users => generated 280 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:38.478549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100701d5-a4ad-49af-9239-6c1d47d8fc4d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:38.491074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100701d5-a4ad-49af-9239-6c1d47d8fc4d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:38.496342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ed89c-4657-4cee-8b2a-88c4dca32d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:38.496912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed89c-4657-4cee-8b2a-88c4dca32d1d admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.497192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed89c-4657-4cee-8b2a-88c4dca32d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.497462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed89c-4657-4cee-8b2a-88c4dca32d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.498090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ed89c-4657-4cee-8b2a-88c4dca32d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:38.499673 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ed89c-4657-4cee-8b2a-88c4dca32d1d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:38.509470 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4145/8267] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:38.514505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9edd02-6da2-4048-97d8-b59bf6808334 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:38.524900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9edd02-6da2-4048-97d8-b59bf6808334 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:38.530182 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d46134-3c38-479a-88ee-827677805eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:38.530778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d46134-3c38-479a-88ee-827677805eef admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.531060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d46134-3c38-479a-88ee-827677805eef admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.531333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d46134-3c38-479a-88ee-827677805eef admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.531999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d46134-3c38-479a-88ee-827677805eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:38.533865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d46134-3c38-479a-88ee-827677805eef admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:38.544887 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4123/8268] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:38.548936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ed89c-4657-4cee-8b2a-88c4dca32d1d admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:38.560641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ed89c-4657-4cee-8b2a-88c4dca32d1d admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:38.565560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5136e7-a90c-473e-ad84-7bb8dfc96e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:38.566203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5136e7-a90c-473e-ad84-7bb8dfc96e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.566480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5136e7-a90c-473e-ad84-7bb8dfc96e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.566754 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5136e7-a90c-473e-ad84-7bb8dfc96e76 admin admin] PATH_INFO: `/v3/projects/da507ac6d7d048889f5a1ae4da337f69/users/dfb7a75afa2242e79b2dc9bdcc6f7a92/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.583788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5136e7-a90c-473e-ad84-7bb8dfc96e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da507ac6d7d048889f5a1ae4da337f69, user_id=dfb7a75afa2242e79b2dc9bdcc6f7a92, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:38.586023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5136e7-a90c-473e-ad84-7bb8dfc96e76 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:38.600389 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4146/8269] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:31:38 2022] PUT /identity/v3/projects/da507ac6d7d048889f5a1ae4da337f69/users/dfb7a75afa2242e79b2dc9bdcc6f7a92/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:31:38.611606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27010de8-e631-4930-b2a7-afe8c67ca3ed None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.612154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27010de8-e631-4930-b2a7-afe8c67ca3ed None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.612154 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27010de8-e631-4930-b2a7-afe8c67ca3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.643537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-27010de8-e631-4930-b2a7-afe8c67ca3ed None None] MFA Rules not processed for user `dfb7a75afa2242e79b2dc9bdcc6f7a92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:38.644785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-27010de8-e631-4930-b2a7-afe8c67ca3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:38.710920 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4124/8270] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:38.748362 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5136e7-a90c-473e-ad84-7bb8dfc96e76 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:38.750061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fb5136e7-a90c-473e-ad84-7bb8dfc96e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:38.810829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5136e7-a90c-473e-ad84-7bb8dfc96e76 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:38.814856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba7675-e5f6-47ca-94a7-bf8ea02bad77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:38.815471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba7675-e5f6-47ca-94a7-bf8ea02bad77 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.815750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba7675-e5f6-47ca-94a7-bf8ea02bad77 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.816022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba7675-e5f6-47ca-94a7-bf8ea02bad77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.827861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba7675-e5f6-47ca-94a7-bf8ea02bad77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:38.829434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba7675-e5f6-47ca-94a7-bf8ea02bad77 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:38.840035 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4147/8271] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:38.856193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27010de8-e631-4930-b2a7-afe8c67ca3ed None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:38.904895 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:38.925020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27010de8-e631-4930-b2a7-afe8c67ca3ed None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:38.929608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:38.930246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:38.930562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:38.930841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] PATH_INFO: `/v3/users/dfb7a75afa2242e79b2dc9bdcc6f7a92` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:38.932015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb7a75afa2242e79b2dc9bdcc6f7a92)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:38.934244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:38.981208 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb7a75afa2242e79b2dc9bdcc6f7a92'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:38.993832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb7a75afa2242e79b2dc9bdcc6f7a92'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:39.001760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb7a75afa2242e79b2dc9bdcc6f7a92'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:39.009232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb7a75afa2242e79b2dc9bdcc6f7a92'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:39.009865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb7a75afa2242e79b2dc9bdcc6f7a92'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:39.016166 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4125/8272] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:31:38 2022] DELETE /identity/v3/users/dfb7a75afa2242e79b2dc9bdcc6f7a92 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:39.020805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8fd6e-a6af-46a5-9b9a-297db0b59822 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.021115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8fd6e-a6af-46a5-9b9a-297db0b59822 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.021376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8fd6e-a6af-46a5-9b9a-297db0b59822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.041399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8be8fd6e-a6af-46a5-9b9a-297db0b59822 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:39.043611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8be8fd6e-a6af-46a5-9b9a-297db0b59822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:39.093862 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:39.107524 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4148/8273] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:39.117386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:39.118799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:39.177945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a7a0-9864-4df5-b8e5-790b2e7cf876 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:39.181591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b52cf0-e67d-412a-8a6a-34e53e1a26ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:39.182189 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b52cf0-e67d-412a-8a6a-34e53e1a26ab service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.182466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b52cf0-e67d-412a-8a6a-34e53e1a26ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.182745 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b52cf0-e67d-412a-8a6a-34e53e1a26ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.193477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b52cf0-e67d-412a-8a6a-34e53e1a26ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:39.194896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b52cf0-e67d-412a-8a6a-34e53e1a26ab service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:39.204854 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4126/8274] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:39.494510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8fd6e-a6af-46a5-9b9a-297db0b59822 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:39.496815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8be8fd6e-a6af-46a5-9b9a-297db0b59822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:39.512875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8fd6e-a6af-46a5-9b9a-297db0b59822 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:39.517767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:39.518439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.518720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.519008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] PATH_INFO: `/v3/projects/da507ac6d7d048889f5a1ae4da337f69` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.520190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da507ac6d7d048889f5a1ae4da337f69)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:39.522387 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:39.573988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da507ac6d7d048889f5a1ae4da337f69', 'request_id': 'req-30475fc8-bafd-48bf-8167-53963c1b03c3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:39.580521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da507ac6d7d048889f5a1ae4da337f69', 'request_id': 'req-30475fc8-bafd-48bf-8167-53963c1b03c3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:39.586230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da507ac6d7d048889f5a1ae4da337f69', 'request_id': 'req-30475fc8-bafd-48bf-8167-53963c1b03c3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:39.597310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] The token cache is being invalidate because project da507ac6d7d048889f5a1ae4da337f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:31:39.597589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:39.598171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-30475fc8-bafd-48bf-8167-53963c1b03c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:31:39.599711 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4149/8275] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:31:39 2022] DELETE /identity/v3/projects/da507ac6d7d048889f5a1ae4da337f69 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:39.605017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f52d06-24ec-4246-9419-e73f83761a7c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.605350 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f52d06-24ec-4246-9419-e73f83761a7c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.605666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f52d06-24ec-4246-9419-e73f83761a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.627947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e0f52d06-24ec-4246-9419-e73f83761a7c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:39.629214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e0f52d06-24ec-4246-9419-e73f83761a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:39.687202 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:39.708694 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4127/8276] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:39.718159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dd99c-a475-4c04-9afe-cd3521d2175b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.718442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dd99c-a475-4c04-9afe-cd3521d2175b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.718717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dd99c-a475-4c04-9afe-cd3521d2175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.738727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-123dd99c-a475-4c04-9afe-cd3521d2175b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:39.739924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-123dd99c-a475-4c04-9afe-cd3521d2175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:39.747849 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4150/8277] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:39.751889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f52d06-24ec-4246-9419-e73f83761a7c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:39.763291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f52d06-24ec-4246-9419-e73f83761a7c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:39.768016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3256384-08a0-436e-9ae6-6a9bd1c0f74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:39.768604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3256384-08a0-436e-9ae6-6a9bd1c0f74c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.768912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3256384-08a0-436e-9ae6-6a9bd1c0f74c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.769183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3256384-08a0-436e-9ae6-6a9bd1c0f74c admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.769823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3256384-08a0-436e-9ae6-6a9bd1c0f74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:31:39.770143 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3256384-08a0-436e-9ae6-6a9bd1c0f74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:39.771729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3256384-08a0-436e-9ae6-6a9bd1c0f74c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:39.786466 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4128/8278] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:31:39.790603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dd99c-a475-4c04-9afe-cd3521d2175b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:39.800391 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dd99c-a475-4c04-9afe-cd3521d2175b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:39.805063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e9044-8849-47ab-835c-6d68578d2939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:39.805676 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e9044-8849-47ab-835c-6d68578d2939 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.805957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e9044-8849-47ab-835c-6d68578d2939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.806227 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e9044-8849-47ab-835c-6d68578d2939 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.806851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e9044-8849-47ab-835c-6d68578d2939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:39.808863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e9044-8849-47ab-835c-6d68578d2939 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:39.835459 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4151/8279] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:31:39 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:31:39.840174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3256384-08a0-436e-9ae6-6a9bd1c0f74c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:39.850279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3256384-08a0-436e-9ae6-6a9bd1c0f74c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:39.906406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a53f10-e5d5-4531-bc7e-b546a0264cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:39.907008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a53f10-e5d5-4531-bc7e-b546a0264cfd admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.907290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a53f10-e5d5-4531-bc7e-b546a0264cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.907566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a53f10-e5d5-4531-bc7e-b546a0264cfd admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.908190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a53f10-e5d5-4531-bc7e-b546a0264cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:39.910136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a53f10-e5d5-4531-bc7e-b546a0264cfd admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:39.930888 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4129/8280] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:31:39 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:31:39.935260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e9044-8849-47ab-835c-6d68578d2939 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:39.946023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e9044-8849-47ab-835c-6d68578d2939 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:39.951286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e066204-7dd1-43e4-bf4f-8b97bb230c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:39.951884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e066204-7dd1-43e4-bf4f-8b97bb230c07 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.952167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e066204-7dd1-43e4-bf4f-8b97bb230c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.952443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e066204-7dd1-43e4-bf4f-8b97bb230c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.953132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e066204-7dd1-43e4-bf4f-8b97bb230c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:39.954723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e066204-7dd1-43e4-bf4f-8b97bb230c07 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:39.965308 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4152/8281] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:39.969145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a53f10-e5d5-4531-bc7e-b546a0264cfd admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:39.978985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a53f10-e5d5-4531-bc7e-b546a0264cfd admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:39.984644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608aaed-4852-4f55-a122-4595dda976f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:39.985251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608aaed-4852-4f55-a122-4595dda976f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:39.985531 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608aaed-4852-4f55-a122-4595dda976f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:39.985800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608aaed-4852-4f55-a122-4595dda976f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:39.986436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608aaed-4852-4f55-a122-4595dda976f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:39.988029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608aaed-4852-4f55-a122-4595dda976f8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:39.998239 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4130/8282] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:31:40.002442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e066204-7dd1-43e4-bf4f-8b97bb230c07 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:40.013292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e066204-7dd1-43e4-bf4f-8b97bb230c07 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:40.018308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74585ff-cf72-4415-af2c-6fdad52de487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:40.019132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74585ff-cf72-4415-af2c-6fdad52de487 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:40.019417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74585ff-cf72-4415-af2c-6fdad52de487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:40.019699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74585ff-cf72-4415-af2c-6fdad52de487 admin admin] PATH_INFO: `/v3/projects/1a936736e32a48cdbb773de3e8a3daec/users/0043f78a83bb4fc386c6a0240dab982d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:40.034995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74585ff-cf72-4415-af2c-6fdad52de487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a936736e32a48cdbb773de3e8a3daec, user_id=0043f78a83bb4fc386c6a0240dab982d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:40.037723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74585ff-cf72-4415-af2c-6fdad52de487 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:40.050200 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4153/8283] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:31:40 2022] PUT /identity/v3/projects/1a936736e32a48cdbb773de3e8a3daec/users/0043f78a83bb4fc386c6a0240dab982d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:31:40.060572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cb94d-80c3-4bd4-b54e-b857367bba26 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:40.060955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cb94d-80c3-4bd4-b54e-b857367bba26 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:40.061237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cb94d-80c3-4bd4-b54e-b857367bba26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:40.090132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d75cb94d-80c3-4bd4-b54e-b857367bba26 None None] MFA Rules not processed for user `0043f78a83bb4fc386c6a0240dab982d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:31:40.091261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d75cb94d-80c3-4bd4-b54e-b857367bba26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:40.156074 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4131/8284] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:31:40.167279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74585ff-cf72-4415-af2c-6fdad52de487 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:31:40.169027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e74585ff-cf72-4415-af2c-6fdad52de487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:31:40.232758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74585ff-cf72-4415-af2c-6fdad52de487 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:31:40.236591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dd038-4393-4f35-99bf-d0bdf9ecbb2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:31:40.237228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd038-4393-4f35-99bf-d0bdf9ecbb2d service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:31:40.237509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd038-4393-4f35-99bf-d0bdf9ecbb2d service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:31:40.237784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd038-4393-4f35-99bf-d0bdf9ecbb2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:31:40.247831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dd038-4393-4f35-99bf-d0bdf9ecbb2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:31:40.249309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dd038-4393-4f35-99bf-d0bdf9ecbb2d service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:31:40.258146 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4154/8285] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:31:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:31:50.152443 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:50.254160 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:09.582309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cb94d-80c3-4bd4-b54e-b857367bba26 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:09.667839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cb94d-80c3-4bd4-b54e-b857367bba26 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:09.673181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:09.673847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:09.674128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:09.674403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] PATH_INFO: `/v3/users/0043f78a83bb4fc386c6a0240dab982d` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:09.675547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0043f78a83bb4fc386c6a0240dab982d)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:09.677528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:09.733270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0043f78a83bb4fc386c6a0240dab982d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:09.747079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0043f78a83bb4fc386c6a0240dab982d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:09.755389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0043f78a83bb4fc386c6a0240dab982d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:09.764051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0043f78a83bb4fc386c6a0240dab982d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:09.764868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0043f78a83bb4fc386c6a0240dab982d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:09.771109 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4132/8286] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:32:09 2022] DELETE /identity/v3/users/0043f78a83bb4fc386c6a0240dab982d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:32:09.775924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe83b1-2c34-4498-a7af-f6b9093a9a8c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:09.776417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe83b1-2c34-4498-a7af-f6b9093a9a8c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:09.776534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe83b1-2c34-4498-a7af-f6b9093a9a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:09.808531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1cfe83b1-2c34-4498-a7af-f6b9093a9a8c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:09.809811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1cfe83b1-2c34-4498-a7af-f6b9093a9a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:09.879282 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4155/8287] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:09.890097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:09.891578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:09.986713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c39ec-8d1f-4c63-90df-91758cfcf9a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:09.990401 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f9e8c-62dc-4cd1-812f-a54724228273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:09.991908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f9e8c-62dc-4cd1-812f-a54724228273 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:09.992192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f9e8c-62dc-4cd1-812f-a54724228273 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:09.992466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f9e8c-62dc-4cd1-812f-a54724228273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.006261 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:10.009017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f9e8c-62dc-4cd1-812f-a54724228273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:10.010537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f9e8c-62dc-4cd1-812f-a54724228273 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:10.023655 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4133/8288] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:10.309473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe83b1-2c34-4498-a7af-f6b9093a9a8c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:10.310937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1cfe83b1-2c34-4498-a7af-f6b9093a9a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:10.325616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe83b1-2c34-4498-a7af-f6b9093a9a8c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:10.330518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:10.331309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.331692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.332084 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] PATH_INFO: `/v3/projects/1a936736e32a48cdbb773de3e8a3daec` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.333356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a936736e32a48cdbb773de3e8a3daec)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:10.335380 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:10.389087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a936736e32a48cdbb773de3e8a3daec', 'request_id': 'req-6fe4972a-5007-4b85-a661-f7d78981eb6c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:10.396846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a936736e32a48cdbb773de3e8a3daec', 'request_id': 'req-6fe4972a-5007-4b85-a661-f7d78981eb6c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:10.403079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a936736e32a48cdbb773de3e8a3daec', 'request_id': 'req-6fe4972a-5007-4b85-a661-f7d78981eb6c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:10.415330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] The token cache is being invalidate because project 1a936736e32a48cdbb773de3e8a3daec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:32:10.415615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:10.416408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6fe4972a-5007-4b85-a661-f7d78981eb6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:10.418014 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4156/8289] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:32:10 2022] DELETE /identity/v3/projects/1a936736e32a48cdbb773de3e8a3daec => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:32:10.422987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f458-59d4-45d1-82ca-641d60d6601f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.423356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f458-59d4-45d1-82ca-641d60d6601f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.423636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f458-59d4-45d1-82ca-641d60d6601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.445392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-df26f458-59d4-45d1-82ca-641d60d6601f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:10.446686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-df26f458-59d4-45d1-82ca-641d60d6601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:10.506284 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4134/8290] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:32:10.514838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8d7e4-2c32-411a-ba64-48408363a008 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.515126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8d7e4-2c32-411a-ba64-48408363a008 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.515405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8d7e4-2c32-411a-ba64-48408363a008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.535250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9fc8d7e4-2c32-411a-ba64-48408363a008 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:10.536454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9fc8d7e4-2c32-411a-ba64-48408363a008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:10.545189 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4157/8291] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:10.549565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f458-59d4-45d1-82ca-641d60d6601f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:10.561936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f458-59d4-45d1-82ca-641d60d6601f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:10.566926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e74012-c090-459d-8aa4-436ce4a6e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:10.567548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e74012-c090-459d-8aa4-436ce4a6e5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.567827 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e74012-c090-459d-8aa4-436ce4a6e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.568100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e74012-c090-459d-8aa4-436ce4a6e5b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.568798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e74012-c090-459d-8aa4-436ce4a6e5b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:32:10.569098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e74012-c090-459d-8aa4-436ce4a6e5b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:10.570708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e74012-c090-459d-8aa4-436ce4a6e5b4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:10.587180 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4135/8292] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:32:10.589173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8d7e4-2c32-411a-ba64-48408363a008 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:10.599089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8d7e4-2c32-411a-ba64-48408363a008 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:10.605326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c096795-76c1-4324-85cf-7fc74be3cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:10.605968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c096795-76c1-4324-85cf-7fc74be3cf85 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.606255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c096795-76c1-4324-85cf-7fc74be3cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.606532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c096795-76c1-4324-85cf-7fc74be3cf85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.607184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c096795-76c1-4324-85cf-7fc74be3cf85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:10.609137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c096795-76c1-4324-85cf-7fc74be3cf85 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:10.640055 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4158/8293] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:32:10 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:10.644174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e74012-c090-459d-8aa4-436ce4a6e5b4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:10.654273 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e74012-c090-459d-8aa4-436ce4a6e5b4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:10.710016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf64825-52ff-4758-a35d-9f5c26cb3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:10.710613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf64825-52ff-4758-a35d-9f5c26cb3eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.710892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf64825-52ff-4758-a35d-9f5c26cb3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.711164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf64825-52ff-4758-a35d-9f5c26cb3eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.711794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf64825-52ff-4758-a35d-9f5c26cb3eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:10.713862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf64825-52ff-4758-a35d-9f5c26cb3eb3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:10.735825 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4136/8294] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:32:10 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:10.740177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c096795-76c1-4324-85cf-7fc74be3cf85 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:10.753213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c096795-76c1-4324-85cf-7fc74be3cf85 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:10.758786 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887bc4a-39d2-48c3-90fe-72eecdb04b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:10.759335 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887bc4a-39d2-48c3-90fe-72eecdb04b29 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.759616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887bc4a-39d2-48c3-90fe-72eecdb04b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.759888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887bc4a-39d2-48c3-90fe-72eecdb04b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.760543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887bc4a-39d2-48c3-90fe-72eecdb04b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:10.762353 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887bc4a-39d2-48c3-90fe-72eecdb04b29 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:10.772492 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4159/8295] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:10.776580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf64825-52ff-4758-a35d-9f5c26cb3eb3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:10.786890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf64825-52ff-4758-a35d-9f5c26cb3eb3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:10.791534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47357c-043a-4480-9e65-87538be0a342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:10.792649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47357c-043a-4480-9e65-87538be0a342 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.792936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47357c-043a-4480-9e65-87538be0a342 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.793214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47357c-043a-4480-9e65-87538be0a342 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.793858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47357c-043a-4480-9e65-87538be0a342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:10.795461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47357c-043a-4480-9e65-87538be0a342 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:10.806461 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4137/8296] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:10.811812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887bc4a-39d2-48c3-90fe-72eecdb04b29 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:10.822272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887bc4a-39d2-48c3-90fe-72eecdb04b29 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:10.827076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7fdc-e1cd-4555-bbdd-3f9a6fb74c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:10.827726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7fdc-e1cd-4555-bbdd-3f9a6fb74c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.828009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7fdc-e1cd-4555-bbdd-3f9a6fb74c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.828288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7fdc-e1cd-4555-bbdd-3f9a6fb74c23 admin admin] PATH_INFO: `/v3/projects/599d1e7f22e44ed6a6238b825e81d83d/users/3c2cf284e95949e8be1e515b3614fa5f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.843118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7fdc-e1cd-4555-bbdd-3f9a6fb74c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=599d1e7f22e44ed6a6238b825e81d83d, user_id=3c2cf284e95949e8be1e515b3614fa5f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:10.845854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7fdc-e1cd-4555-bbdd-3f9a6fb74c23 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:10.859857 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4160/8297] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:10 2022] PUT /identity/v3/projects/599d1e7f22e44ed6a6238b825e81d83d/users/3c2cf284e95949e8be1e515b3614fa5f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:10.872032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54d71-7479-46a7-8f03-569f2b7e806d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:10.872319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54d71-7479-46a7-8f03-569f2b7e806d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:10.872597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54d71-7479-46a7-8f03-569f2b7e806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:10.902864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-afb54d71-7479-46a7-8f03-569f2b7e806d None None] MFA Rules not processed for user `3c2cf284e95949e8be1e515b3614fa5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:10.904076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-afb54d71-7479-46a7-8f03-569f2b7e806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:10.951260 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:10.969441 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4138/8298] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:10.974113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7fdc-e1cd-4555-bbdd-3f9a6fb74c23 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:10.987422 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:11.038094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7fdc-e1cd-4555-bbdd-3f9a6fb74c23 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.043975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200377-1cfb-45cd-a63c-0799d8c7c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.044588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200377-1cfb-45cd-a63c-0799d8c7c7fa admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.044900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200377-1cfb-45cd-a63c-0799d8c7c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.045179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200377-1cfb-45cd-a63c-0799d8c7c7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.045876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b200377-1cfb-45cd-a63c-0799d8c7c7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.047896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b200377-1cfb-45cd-a63c-0799d8c7c7fa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.074738 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4161/8299] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:32:10 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:11.078837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb54d71-7479-46a7-8f03-569f2b7e806d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.093442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb54d71-7479-46a7-8f03-569f2b7e806d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.149254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935a28d-a368-43c2-82fd-39feb49da4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.149857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a28d-a368-43c2-82fd-39feb49da4ec admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.150137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a28d-a368-43c2-82fd-39feb49da4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.150412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a28d-a368-43c2-82fd-39feb49da4ec admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.151043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935a28d-a368-43c2-82fd-39feb49da4ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.153589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935a28d-a368-43c2-82fd-39feb49da4ec admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.174787 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4139/8300] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:32:11 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:32:11.178821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200377-1cfb-45cd-a63c-0799d8c7c7fa admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.189921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200377-1cfb-45cd-a63c-0799d8c7c7fa admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.194628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eaeb1-3bcb-4ba5-b94a-ab37206e50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.195259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eaeb1-3bcb-4ba5-b94a-ab37206e50c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.195542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eaeb1-3bcb-4ba5-b94a-ab37206e50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.195821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eaeb1-3bcb-4ba5-b94a-ab37206e50c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.196460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eaeb1-3bcb-4ba5-b94a-ab37206e50c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.198094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eaeb1-3bcb-4ba5-b94a-ab37206e50c5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.208581 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4162/8301] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:11.212417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935a28d-a368-43c2-82fd-39feb49da4ec admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.223802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935a28d-a368-43c2-82fd-39feb49da4ec admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.228527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40557be7-fcd5-47d2-b49c-00296b73cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.229160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40557be7-fcd5-47d2-b49c-00296b73cf30 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.229444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40557be7-fcd5-47d2-b49c-00296b73cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.230539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40557be7-fcd5-47d2-b49c-00296b73cf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.231321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40557be7-fcd5-47d2-b49c-00296b73cf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.233025 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40557be7-fcd5-47d2-b49c-00296b73cf30 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.242980 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4140/8302] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:11.247822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eaeb1-3bcb-4ba5-b94a-ab37206e50c5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.257807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eaeb1-3bcb-4ba5-b94a-ab37206e50c5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.263443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a849178-91ed-41bc-9f51-5b151a65f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.264090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a849178-91ed-41bc-9f51-5b151a65f5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.264376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a849178-91ed-41bc-9f51-5b151a65f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.264679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a849178-91ed-41bc-9f51-5b151a65f5ba admin admin] PATH_INFO: `/v3/projects/034e572c345b46f8878b53368eca3309/users/84f1f18980994c84aeade3c3823ffbbf/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.279258 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a849178-91ed-41bc-9f51-5b151a65f5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=034e572c345b46f8878b53368eca3309, user_id=84f1f18980994c84aeade3c3823ffbbf, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.282013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a849178-91ed-41bc-9f51-5b151a65f5ba admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.295371 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4163/8303] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:11 2022] PUT /identity/v3/projects/034e572c345b46f8878b53368eca3309/users/84f1f18980994c84aeade3c3823ffbbf/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:11.305885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e1e7d-f8af-4fe1-a89c-fff6189bd39c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.306176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e1e7d-f8af-4fe1-a89c-fff6189bd39c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.306452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e1e7d-f8af-4fe1-a89c-fff6189bd39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.335330 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-975e1e7d-f8af-4fe1-a89c-fff6189bd39c None None] MFA Rules not processed for user `84f1f18980994c84aeade3c3823ffbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:11.336544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-975e1e7d-f8af-4fe1-a89c-fff6189bd39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:11.403262 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4141/8304] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:11.407831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a849178-91ed-41bc-9f51-5b151a65f5ba admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.469994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a849178-91ed-41bc-9f51-5b151a65f5ba admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.474737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98939d59-e5ea-4a37-8510-ef951a449e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.475339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98939d59-e5ea-4a37-8510-ef951a449e3c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.475617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98939d59-e5ea-4a37-8510-ef951a449e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.475888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98939d59-e5ea-4a37-8510-ef951a449e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.476521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98939d59-e5ea-4a37-8510-ef951a449e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.478455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98939d59-e5ea-4a37-8510-ef951a449e3c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.506398 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4164/8305] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:32:11 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:11.510611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e1e7d-f8af-4fe1-a89c-fff6189bd39c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.521610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e1e7d-f8af-4fe1-a89c-fff6189bd39c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.577297 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b35b4-2003-43da-8bd5-c7f6c2223b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.577820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b35b4-2003-43da-8bd5-c7f6c2223b8b admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.578100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b35b4-2003-43da-8bd5-c7f6c2223b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.578375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b35b4-2003-43da-8bd5-c7f6c2223b8b admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.578995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b35b4-2003-43da-8bd5-c7f6c2223b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.580994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b35b4-2003-43da-8bd5-c7f6c2223b8b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.589410 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:11.606665 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4142/8306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:32:11 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:32:11.607951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98939d59-e5ea-4a37-8510-ef951a449e3c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.618405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98939d59-e5ea-4a37-8510-ef951a449e3c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.623897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68eacc-b5b0-4a3d-9568-9ec3958b7462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.624497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68eacc-b5b0-4a3d-9568-9ec3958b7462 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.624812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68eacc-b5b0-4a3d-9568-9ec3958b7462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.625093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68eacc-b5b0-4a3d-9568-9ec3958b7462 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.625740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68eacc-b5b0-4a3d-9568-9ec3958b7462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.627844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68eacc-b5b0-4a3d-9568-9ec3958b7462 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.640016 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4165/8307] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:32:11.644173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b35b4-2003-43da-8bd5-c7f6c2223b8b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.654999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b35b4-2003-43da-8bd5-c7f6c2223b8b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.659671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4de40-ddf8-4050-80e5-fa5152beefa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.660324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4de40-ddf8-4050-80e5-fa5152beefa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.660610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4de40-ddf8-4050-80e5-fa5152beefa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.660920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4de40-ddf8-4050-80e5-fa5152beefa7 admin admin] PATH_INFO: `/v3/projects/7d9bc39038cf46ad814cd678f5321b84/users/4745ab3c5ce34cd3b9c992153b71b464/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.675563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4de40-ddf8-4050-80e5-fa5152beefa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9bc39038cf46ad814cd678f5321b84, user_id=4745ab3c5ce34cd3b9c992153b71b464, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.678278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4de40-ddf8-4050-80e5-fa5152beefa7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.691258 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4143/8308] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:11 2022] PUT /identity/v3/projects/7d9bc39038cf46ad814cd678f5321b84/users/4745ab3c5ce34cd3b9c992153b71b464/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:11.695373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68eacc-b5b0-4a3d-9568-9ec3958b7462 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.706175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68eacc-b5b0-4a3d-9568-9ec3958b7462 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.738865 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:11.764475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4979ec9-c986-494b-98a4-646582611f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.765104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4979ec9-c986-494b-98a4-646582611f74 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.765383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4979ec9-c986-494b-98a4-646582611f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.765652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4979ec9-c986-494b-98a4-646582611f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.766280 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4979ec9-c986-494b-98a4-646582611f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.767854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4979ec9-c986-494b-98a4-646582611f74 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.777508 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4166/8309] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:11.781681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4de40-ddf8-4050-80e5-fa5152beefa7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.792122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4de40-ddf8-4050-80e5-fa5152beefa7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:11.796966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da041f65-1d5e-4db1-ac19-fe25701a224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:11.797650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da041f65-1d5e-4db1-ac19-fe25701a224d admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.797931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da041f65-1d5e-4db1-ac19-fe25701a224d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.798205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da041f65-1d5e-4db1-ac19-fe25701a224d admin admin] PATH_INFO: `/v3/projects/7d9bc39038cf46ad814cd678f5321b84/users/4745ab3c5ce34cd3b9c992153b71b464/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.800138 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da041f65-1d5e-4db1-ac19-fe25701a224d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9bc39038cf46ad814cd678f5321b84, user_id=4745ab3c5ce34cd3b9c992153b71b464, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:11.802816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da041f65-1d5e-4db1-ac19-fe25701a224d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:11.813439 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4144/8310] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:11 2022] PUT /identity/v3/projects/7d9bc39038cf46ad814cd678f5321b84/users/4745ab3c5ce34cd3b9c992153b71b464/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:11.825554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da27f-1fb7-4f4e-b055-deccc0355399 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:11.826062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da27f-1fb7-4f4e-b055-deccc0355399 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:11.826171 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da27f-1fb7-4f4e-b055-deccc0355399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:11.854198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-262da27f-1fb7-4f4e-b055-deccc0355399 None None] MFA Rules not processed for user `4745ab3c5ce34cd3b9c992153b71b464`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:11.855520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-262da27f-1fb7-4f4e-b055-deccc0355399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:11.924631 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4167/8311] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:11.936476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da041f65-1d5e-4db1-ac19-fe25701a224d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:11.938205 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da041f65-1d5e-4db1-ac19-fe25701a224d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:11.998730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da041f65-1d5e-4db1-ac19-fe25701a224d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:12.002462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96593bb-b53c-4d56-b3bb-361e38283390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:12.003070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96593bb-b53c-4d56-b3bb-361e38283390 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:12.003354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96593bb-b53c-4d56-b3bb-361e38283390 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:12.003624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96593bb-b53c-4d56-b3bb-361e38283390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:12.060137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96593bb-b53c-4d56-b3bb-361e38283390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:12.061597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96593bb-b53c-4d56-b3bb-361e38283390 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:12.070673 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4145/8312] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:13.596487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262da27f-1fb7-4f4e-b055-deccc0355399 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:13.598046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-262da27f-1fb7-4f4e-b055-deccc0355399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:13.613117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262da27f-1fb7-4f4e-b055-deccc0355399 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:13.616712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885c1f4-734f-4fa2-aa4e-a10a3c9b29df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:13.617315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c1f4-734f-4fa2-aa4e-a10a3c9b29df service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:13.617598 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c1f4-734f-4fa2-aa4e-a10a3c9b29df service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:13.617875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c1f4-734f-4fa2-aa4e-a10a3c9b29df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:13.675878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885c1f4-734f-4fa2-aa4e-a10a3c9b29df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:13.677288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885c1f4-734f-4fa2-aa4e-a10a3c9b29df service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:13.686892 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4168/8313] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:14.202831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96593bb-b53c-4d56-b3bb-361e38283390 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:14.214915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96593bb-b53c-4d56-b3bb-361e38283390 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:14.218552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58b8e7-20b4-4656-96fc-2f30c1a1c233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:14.219150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58b8e7-20b4-4656-96fc-2f30c1a1c233 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:14.219424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58b8e7-20b4-4656-96fc-2f30c1a1c233 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:14.219691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58b8e7-20b4-4656-96fc-2f30c1a1c233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:14.228577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58b8e7-20b4-4656-96fc-2f30c1a1c233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:14.230612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58b8e7-20b4-4656-96fc-2f30c1a1c233 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:14.239939 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4146/8314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:20.157948 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885c1f4-734f-4fa2-aa4e-a10a3c9b29df service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:20.159364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8885c1f4-734f-4fa2-aa4e-a10a3c9b29df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:20.234127 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:20.254139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58b8e7-20b4-4656-96fc-2f30c1a1c233 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:20.279050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885c1f4-734f-4fa2-aa4e-a10a3c9b29df service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:20.284698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e959d-6df8-43ee-a665-afa35115f076 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:20.285461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e959d-6df8-43ee-a665-afa35115f076 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:20.285747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e959d-6df8-43ee-a665-afa35115f076 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:20.286021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e959d-6df8-43ee-a665-afa35115f076 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:20.287764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-df1e959d-6df8-43ee-a665-afa35115f076 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:20.303961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e959d-6df8-43ee-a665-afa35115f076 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:20.305580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e959d-6df8-43ee-a665-afa35115f076 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:20.321681 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:20.324225 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4169/8315] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:20.334661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58b8e7-20b4-4656-96fc-2f30c1a1c233 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:20.339983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:20.340820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:20.341096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:20.341367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] PATH_INFO: `/v3/users/3c2cf284e95949e8be1e515b3614fa5f` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:20.342522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2cf284e95949e8be1e515b3614fa5f)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:20.344442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:20.396737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2cf284e95949e8be1e515b3614fa5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:20.411840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2cf284e95949e8be1e515b3614fa5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:20.419941 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2cf284e95949e8be1e515b3614fa5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:20.427169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2cf284e95949e8be1e515b3614fa5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:20.427797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2cf284e95949e8be1e515b3614fa5f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:20.433769 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4147/8316] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:32:20 2022] DELETE /identity/v3/users/3c2cf284e95949e8be1e515b3614fa5f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:32:20.438458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdde0a2-1f0b-44ce-b3fc-71ddf4e38ee2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:20.438810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdde0a2-1f0b-44ce-b3fc-71ddf4e38ee2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:20.439152 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdde0a2-1f0b-44ce-b3fc-71ddf4e38ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:20.459670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-7fdde0a2-1f0b-44ce-b3fc-71ddf4e38ee2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:20.460914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7fdde0a2-1f0b-44ce-b3fc-71ddf4e38ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:20.523261 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4170/8317] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:20.533955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:20.535419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:20.595334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bd7b0-5814-4703-a9d3-6cd79de33134 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:20.599352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ddf7a-9673-4dd0-9c89-b45c12d10575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:20.599985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ddf7a-9673-4dd0-9c89-b45c12d10575 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:20.600266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ddf7a-9673-4dd0-9c89-b45c12d10575 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:20.600539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ddf7a-9673-4dd0-9c89-b45c12d10575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:20.610918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ddf7a-9673-4dd0-9c89-b45c12d10575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:20.612382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ddf7a-9673-4dd0-9c89-b45c12d10575 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:20.623428 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4148/8318] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:20.918342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdde0a2-1f0b-44ce-b3fc-71ddf4e38ee2 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:20.919775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7fdde0a2-1f0b-44ce-b3fc-71ddf4e38ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:20.933224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdde0a2-1f0b-44ce-b3fc-71ddf4e38ee2 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:20.938213 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:20.938873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:20.939143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:20.939418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] PATH_INFO: `/v3/projects/599d1e7f22e44ed6a6238b825e81d83d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:20.942024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=599d1e7f22e44ed6a6238b825e81d83d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:20.943986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:21.012323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599d1e7f22e44ed6a6238b825e81d83d', 'request_id': 'req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.019899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599d1e7f22e44ed6a6238b825e81d83d', 'request_id': 'req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.025749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599d1e7f22e44ed6a6238b825e81d83d', 'request_id': 'req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.038296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] The token cache is being invalidate because project 599d1e7f22e44ed6a6238b825e81d83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:32:21.038597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.039277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.041230 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4171/8319] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:32:20 2022] DELETE /identity/v3/projects/599d1e7f22e44ed6a6238b825e81d83d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:21.045608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ddf7a-9673-4dd0-9c89-b45c12d10575 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:21.055951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ddf7a-9673-4dd0-9c89-b45c12d10575 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:21.116557 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:21.117235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:21.117519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:21.117794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] PATH_INFO: `/v3/users/84f1f18980994c84aeade3c3823ffbbf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:21.118931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f1f18980994c84aeade3c3823ffbbf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:21.121504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:21.138696 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:21.170315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f1f18980994c84aeade3c3823ffbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.182788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f1f18980994c84aeade3c3823ffbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.190936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f1f18980994c84aeade3c3823ffbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.199831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f1f18980994c84aeade3c3823ffbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.200574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f1f18980994c84aeade3c3823ffbbf'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.206869 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4149/8320] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:32:21 2022] DELETE /identity/v3/users/84f1f18980994c84aeade3c3823ffbbf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:21.485299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:21.486917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:21.500950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5ab38-a156-43f9-8d25-88af2c6a52c9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:21.547092 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:21.560520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:21.561322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:21.561604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:21.561878 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] PATH_INFO: `/v3/projects/034e572c345b46f8878b53368eca3309` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:21.563002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=034e572c345b46f8878b53368eca3309)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:21.565200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:21.612572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034e572c345b46f8878b53368eca3309', 'request_id': 'req-cd232181-02ee-4bf0-b31f-9c35c51517d5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.619901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034e572c345b46f8878b53368eca3309', 'request_id': 'req-cd232181-02ee-4bf0-b31f-9c35c51517d5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.625852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034e572c345b46f8878b53368eca3309', 'request_id': 'req-cd232181-02ee-4bf0-b31f-9c35c51517d5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.637947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] The token cache is being invalidate because project 034e572c345b46f8878b53368eca3309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:32:21.638232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.638866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.640343 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4172/8321] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:32:21 2022] DELETE /identity/v3/projects/034e572c345b46f8878b53368eca3309 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:21.644419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:21.645880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:21.659406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5319c8-f22a-4ce5-bcb0-b7311330f079 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:21.716606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:21.717306 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:21.717592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:21.717871 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] PATH_INFO: `/v3/users/4745ab3c5ce34cd3b9c992153b71b464` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:21.719001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4745ab3c5ce34cd3b9c992153b71b464)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:21.720973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:21.768061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4745ab3c5ce34cd3b9c992153b71b464'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.780502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4745ab3c5ce34cd3b9c992153b71b464'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.788195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4745ab3c5ce34cd3b9c992153b71b464'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.795765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4745ab3c5ce34cd3b9c992153b71b464'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.796394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-edb3e742-8c7e-44bb-956c-ea432532838f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4745ab3c5ce34cd3b9c992153b71b464'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:21.802311 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4150/8322] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:32:21 2022] DELETE /identity/v3/users/4745ab3c5ce34cd3b9c992153b71b464 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:22.076393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:22.077880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:22.093729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd232181-02ee-4bf0-b31f-9c35c51517d5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:22.153768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:22.154399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.154680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.154953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] PATH_INFO: `/v3/projects/7d9bc39038cf46ad814cd678f5321b84` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.156074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9bc39038cf46ad814cd678f5321b84)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:22.157996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:22.204195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9bc39038cf46ad814cd678f5321b84', 'request_id': 'req-16dd751f-020a-49b6-98e8-8ff99e629267'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:22.211400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9bc39038cf46ad814cd678f5321b84', 'request_id': 'req-16dd751f-020a-49b6-98e8-8ff99e629267'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:22.217662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9bc39038cf46ad814cd678f5321b84', 'request_id': 'req-16dd751f-020a-49b6-98e8-8ff99e629267'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:22.228495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] The token cache is being invalidate because project 7d9bc39038cf46ad814cd678f5321b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:32:22.228818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:22.229469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-16dd751f-020a-49b6-98e8-8ff99e629267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:22.231782 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4173/8323] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:32:22 2022] DELETE /identity/v3/projects/7d9bc39038cf46ad814cd678f5321b84 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:22.236895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffb686-fdd9-480d-988d-3e5d0b683ab5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.237179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffb686-fdd9-480d-988d-3e5d0b683ab5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.237477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffb686-fdd9-480d-988d-3e5d0b683ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.256105 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:22.268344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-07ffb686-fdd9-480d-988d-3e5d0b683ab5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:22.269575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-07ffb686-fdd9-480d-988d-3e5d0b683ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:22.328822 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4151/8324] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:22.336850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c5a25-b7f0-4223-9003-a9e9e5086294 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.337142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c5a25-b7f0-4223-9003-a9e9e5086294 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.337424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c5a25-b7f0-4223-9003-a9e9e5086294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.358216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d19c5a25-b7f0-4223-9003-a9e9e5086294 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:22.359431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d19c5a25-b7f0-4223-9003-a9e9e5086294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:22.367514 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4174/8325] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:22.371936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffb686-fdd9-480d-988d-3e5d0b683ab5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:22.381669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffb686-fdd9-480d-988d-3e5d0b683ab5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:22.386248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69e78-f06c-4933-ac56-645322e276a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:22.387046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69e78-f06c-4933-ac56-645322e276a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.387442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69e78-f06c-4933-ac56-645322e276a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.387700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69e78-f06c-4933-ac56-645322e276a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.388338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba69e78-f06c-4933-ac56-645322e276a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:32:22.388661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba69e78-f06c-4933-ac56-645322e276a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:22.390245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba69e78-f06c-4933-ac56-645322e276a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:22.401577 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4152/8326] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:32:22.406493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c5a25-b7f0-4223-9003-a9e9e5086294 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:22.411015 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:22.417831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c5a25-b7f0-4223-9003-a9e9e5086294 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:22.424172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7902bc-d511-4591-b4c4-c9c8cfeaba16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:22.424808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7902bc-d511-4591-b4c4-c9c8cfeaba16 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.425094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7902bc-d511-4591-b4c4-c9c8cfeaba16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.425366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7902bc-d511-4591-b4c4-c9c8cfeaba16 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.425992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7902bc-d511-4591-b4c4-c9c8cfeaba16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:22.427900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7902bc-d511-4591-b4c4-c9c8cfeaba16 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:22.458379 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4175/8327] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:32:22 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:22.459447 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69e78-f06c-4933-ac56-645322e276a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:22.470068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69e78-f06c-4933-ac56-645322e276a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:22.526351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb441c-8780-43ad-ba09-d864384e6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:22.526956 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb441c-8780-43ad-ba09-d864384e6410 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.527245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb441c-8780-43ad-ba09-d864384e6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.528099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb441c-8780-43ad-ba09-d864384e6410 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.528934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb441c-8780-43ad-ba09-d864384e6410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:22.530879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb441c-8780-43ad-ba09-d864384e6410 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:22.552253 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4153/8328] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:32:22 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:22.556472 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7902bc-d511-4591-b4c4-c9c8cfeaba16 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:22.567112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7902bc-d511-4591-b4c4-c9c8cfeaba16 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:22.571721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d200-aedc-4d87-988a-268eba4f1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:22.572315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d200-aedc-4d87-988a-268eba4f1851 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.572596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d200-aedc-4d87-988a-268eba4f1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.572899 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d200-aedc-4d87-988a-268eba4f1851 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.573534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d200-aedc-4d87-988a-268eba4f1851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:22.575669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d200-aedc-4d87-988a-268eba4f1851 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:22.585418 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4176/8329] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:22.589322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb441c-8780-43ad-ba09-d864384e6410 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:22.600242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb441c-8780-43ad-ba09-d864384e6410 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:22.604949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b8182-7393-4e4c-98f9-9f2332c898ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:22.605700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b8182-7393-4e4c-98f9-9f2332c898ab admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.605991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b8182-7393-4e4c-98f9-9f2332c898ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.606271 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b8182-7393-4e4c-98f9-9f2332c898ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.606915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b8182-7393-4e4c-98f9-9f2332c898ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:22.608506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b8182-7393-4e4c-98f9-9f2332c898ab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:22.619236 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4154/8330] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:22.623267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d200-aedc-4d87-988a-268eba4f1851 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:22.633375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d200-aedc-4d87-988a-268eba4f1851 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:22.638958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63a08-b1d0-4ceb-857f-63401eb50892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:22.639608 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63a08-b1d0-4ceb-857f-63401eb50892 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.639890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63a08-b1d0-4ceb-857f-63401eb50892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.640164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63a08-b1d0-4ceb-857f-63401eb50892 admin admin] PATH_INFO: `/v3/projects/d49e0ed8c495407891d2fbe6282064c5/users/b86edb449adf44e191d4a9b50a139bae/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.655344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e63a08-b1d0-4ceb-857f-63401eb50892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49e0ed8c495407891d2fbe6282064c5, user_id=b86edb449adf44e191d4a9b50a139bae, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:22.658040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e63a08-b1d0-4ceb-857f-63401eb50892 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:22.670965 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4177/8331] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:22 2022] PUT /identity/v3/projects/d49e0ed8c495407891d2fbe6282064c5/users/b86edb449adf44e191d4a9b50a139bae/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:22.676193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993fcb-1851-4549-8694-4346c1679c32 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.676701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993fcb-1851-4549-8694-4346c1679c32 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.676811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993fcb-1851-4549-8694-4346c1679c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.695975 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ec993fcb-1851-4549-8694-4346c1679c32 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:22.697218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ec993fcb-1851-4549-8694-4346c1679c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:22.755260 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4155/8332] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:22.765624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63a08-b1d0-4ceb-857f-63401eb50892 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:22.767394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-15e63a08-b1d0-4ceb-857f-63401eb50892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:22.823900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63a08-b1d0-4ceb-857f-63401eb50892 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:22.828299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402564e-21bc-4e38-a3b6-d5ad08b595ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:22.828929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402564e-21bc-4e38-a3b6-d5ad08b595ec service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:22.829211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402564e-21bc-4e38-a3b6-d5ad08b595ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:22.829489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402564e-21bc-4e38-a3b6-d5ad08b595ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:22.839366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402564e-21bc-4e38-a3b6-d5ad08b595ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:22.841405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402564e-21bc-4e38-a3b6-d5ad08b595ec service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:22.851177 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4178/8333] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:26.600747 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef631046-d8f9-4ab7-b61a-a5704c2ae8e4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:26.601248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef631046-d8f9-4ab7-b61a-a5704c2ae8e4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:26.601448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef631046-d8f9-4ab7-b61a-a5704c2ae8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:26.623918 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:26.633799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ef631046-d8f9-4ab7-b61a-a5704c2ae8e4 None None] MFA Rules not processed for user `b86edb449adf44e191d4a9b50a139bae`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:26.635073 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ef631046-d8f9-4ab7-b61a-a5704c2ae8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:26.703132 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4156/8334] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:26.707579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402564e-21bc-4e38-a3b6-d5ad08b595ec service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:26.718568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402564e-21bc-4e38-a3b6-d5ad08b595ec service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:26.723369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c51793-f0d1-4757-8a60-f69ceb60be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:26.723993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51793-f0d1-4757-8a60-f69ceb60be77 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:26.724275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51793-f0d1-4757-8a60-f69ceb60be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:26.724547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51793-f0d1-4757-8a60-f69ceb60be77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:26.725202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c51793-f0d1-4757-8a60-f69ceb60be77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:26.727103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c51793-f0d1-4757-8a60-f69ceb60be77 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:26.755109 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4179/8335] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:32:26 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:26.759304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef631046-d8f9-4ab7-b61a-a5704c2ae8e4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:26.770780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef631046-d8f9-4ab7-b61a-a5704c2ae8e4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:26.831556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fd205-8e3c-4bb2-bb03-e57eea17a802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:26.832174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd205-8e3c-4bb2-bb03-e57eea17a802 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:26.832463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd205-8e3c-4bb2-bb03-e57eea17a802 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:26.832774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd205-8e3c-4bb2-bb03-e57eea17a802 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:26.833405 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fd205-8e3c-4bb2-bb03-e57eea17a802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:26.835716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fd205-8e3c-4bb2-bb03-e57eea17a802 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:26.859181 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4157/8336] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:32:26 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:32:26.863223 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c51793-f0d1-4757-8a60-f69ceb60be77 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:26.874298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c51793-f0d1-4757-8a60-f69ceb60be77 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:26.879025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaced7e-8e05-452d-8630-5bf922b4a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:26.879630 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaced7e-8e05-452d-8630-5bf922b4a2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:26.879916 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaced7e-8e05-452d-8630-5bf922b4a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:26.880192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaced7e-8e05-452d-8630-5bf922b4a2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:26.880859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaced7e-8e05-452d-8630-5bf922b4a2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:26.882470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaced7e-8e05-452d-8630-5bf922b4a2a5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:26.893884 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4180/8337] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:26.898327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fd205-8e3c-4bb2-bb03-e57eea17a802 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:26.913610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fd205-8e3c-4bb2-bb03-e57eea17a802 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:26.919360 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54b7b4-a37f-4af3-9893-bd49b8e9b774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:26.919780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54b7b4-a37f-4af3-9893-bd49b8e9b774 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:26.920105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54b7b4-a37f-4af3-9893-bd49b8e9b774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:26.920341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54b7b4-a37f-4af3-9893-bd49b8e9b774 admin admin] PATH_INFO: `/v3/projects/9c63d93acb0044c0aa4e1ac0c483a1dc/users/3910bbb9dc1a4cdcae901119b6814927/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:26.936841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54b7b4-a37f-4af3-9893-bd49b8e9b774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c63d93acb0044c0aa4e1ac0c483a1dc, user_id=3910bbb9dc1a4cdcae901119b6814927, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:26.940099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54b7b4-a37f-4af3-9893-bd49b8e9b774 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:26.955273 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4158/8338] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:26 2022] PUT /identity/v3/projects/9c63d93acb0044c0aa4e1ac0c483a1dc/users/3910bbb9dc1a4cdcae901119b6814927/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:26.960767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaced7e-8e05-452d-8630-5bf922b4a2a5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:26.971303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaced7e-8e05-452d-8630-5bf922b4a2a5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:27.033165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ecb20-d64f-4584-8c67-553a8c6a4b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:27.033758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ecb20-d64f-4584-8c67-553a8c6a4b8a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:27.034045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ecb20-d64f-4584-8c67-553a8c6a4b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:27.034318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ecb20-d64f-4584-8c67-553a8c6a4b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:27.034958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ecb20-d64f-4584-8c67-553a8c6a4b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:27.036545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ecb20-d64f-4584-8c67-553a8c6a4b8a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:27.048928 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4181/8339] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:32:27.052929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54b7b4-a37f-4af3-9893-bd49b8e9b774 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:27.064347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54b7b4-a37f-4af3-9893-bd49b8e9b774 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:27.069594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e229c-e046-4e53-9298-b4e97ba31506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:27.070257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e229c-e046-4e53-9298-b4e97ba31506 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:27.070532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e229c-e046-4e53-9298-b4e97ba31506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:27.070803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e229c-e046-4e53-9298-b4e97ba31506 admin admin] PATH_INFO: `/v3/projects/9c63d93acb0044c0aa4e1ac0c483a1dc/users/3910bbb9dc1a4cdcae901119b6814927/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:27.076364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e229c-e046-4e53-9298-b4e97ba31506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c63d93acb0044c0aa4e1ac0c483a1dc, user_id=3910bbb9dc1a4cdcae901119b6814927, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:27.080701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e229c-e046-4e53-9298-b4e97ba31506 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:27.108755 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4159/8340] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:27 2022] PUT /identity/v3/projects/9c63d93acb0044c0aa4e1ac0c483a1dc/users/3910bbb9dc1a4cdcae901119b6814927/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:27.436874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ecb20-d64f-4584-8c67-553a8c6a4b8a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:27.438666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f05ecb20-d64f-4584-8c67-553a8c6a4b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:27.462759 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:27.555168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ecb20-d64f-4584-8c67-553a8c6a4b8a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:27.682272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:27.683036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:27.683496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:27.684063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:27.686455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:27.701707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:27.703463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:27.728061 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4182/8341] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:31.740056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4015-2bd6-400b-90fa-fd193a32a932 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:31.740581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4015-2bd6-400b-90fa-fd193a32a932 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:31.740581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4015-2bd6-400b-90fa-fd193a32a932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:31.772528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-526d4015-2bd6-400b-90fa-fd193a32a932 None None] MFA Rules not processed for user `3910bbb9dc1a4cdcae901119b6814927`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:31.773812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-526d4015-2bd6-400b-90fa-fd193a32a932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:31.834798 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:31.875049 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4160/8342] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:31.895363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:31.898810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:32.000521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f446539-74c9-47de-93cd-f25573c0ce7d service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:32.006586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb257f4-1267-4920-8220-04f8dc7db5be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:32.007485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb257f4-1267-4920-8220-04f8dc7db5be service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:32.008654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb257f4-1267-4920-8220-04f8dc7db5be service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:32.008950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb257f4-1267-4920-8220-04f8dc7db5be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:32.019597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb257f4-1267-4920-8220-04f8dc7db5be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:32.021414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb257f4-1267-4920-8220-04f8dc7db5be service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:32.034172 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4183/8343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:33.283400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d4015-2bd6-400b-90fa-fd193a32a932 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:33.298275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d4015-2bd6-400b-90fa-fd193a32a932 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:33.303119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb5248-1dad-4440-823b-35359d1598a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:33.303718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb5248-1dad-4440-823b-35359d1598a8 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:33.303996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb5248-1dad-4440-823b-35359d1598a8 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:33.304272 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb5248-1dad-4440-823b-35359d1598a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:33.306059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cbdb5248-1dad-4440-823b-35359d1598a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:33.320872 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb5248-1dad-4440-823b-35359d1598a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:33.322445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb5248-1dad-4440-823b-35359d1598a8 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:33.334962 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4161/8344] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:33.632903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb257f4-1267-4920-8220-04f8dc7db5be service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:33.634936 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bfb257f4-1267-4920-8220-04f8dc7db5be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:33.655910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb257f4-1267-4920-8220-04f8dc7db5be service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:33.663176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985f43f-cf57-4bc5-95db-22b94bffaedd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:33.663800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985f43f-cf57-4bc5-95db-22b94bffaedd service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:33.664381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985f43f-cf57-4bc5-95db-22b94bffaedd service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:33.664966 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985f43f-cf57-4bc5-95db-22b94bffaedd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:33.667453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3985f43f-cf57-4bc5-95db-22b94bffaedd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:33.685264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985f43f-cf57-4bc5-95db-22b94bffaedd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:33.686979 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985f43f-cf57-4bc5-95db-22b94bffaedd service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:33.702318 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4184/8345] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:40.759833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb5248-1dad-4440-823b-35359d1598a8 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:40.773811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb5248-1dad-4440-823b-35359d1598a8 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:40.780019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36affb-bead-4917-ace8-3f32317f380e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:40.780761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36affb-bead-4917-ace8-3f32317f380e service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:40.781160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36affb-bead-4917-ace8-3f32317f380e service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:40.784911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36affb-bead-4917-ace8-3f32317f380e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:40.787662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fa36affb-bead-4917-ace8-3f32317f380e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:40.803145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36affb-bead-4917-ace8-3f32317f380e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:40.804894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36affb-bead-4917-ace8-3f32317f380e service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:40.819343 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4162/8346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:40.828703 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985f43f-cf57-4bc5-95db-22b94bffaedd service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:40.860902 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:40.908699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985f43f-cf57-4bc5-95db-22b94bffaedd service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:40.913566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:40.914193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:40.914473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:40.914762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] PATH_INFO: `/v3/users/b86edb449adf44e191d4a9b50a139bae` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:40.915874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86edb449adf44e191d4a9b50a139bae)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:40.917837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:40.965262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86edb449adf44e191d4a9b50a139bae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:40.978064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86edb449adf44e191d4a9b50a139bae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:40.986367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86edb449adf44e191d4a9b50a139bae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:40.993565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86edb449adf44e191d4a9b50a139bae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:40.994224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86edb449adf44e191d4a9b50a139bae'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.000799 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4185/8347] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:32:40 2022] DELETE /identity/v3/users/b86edb449adf44e191d4a9b50a139bae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:41.172373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36affb-bead-4917-ace8-3f32317f380e service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:41.189556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36affb-bead-4917-ace8-3f32317f380e service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:41.249174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:41.249812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:41.250092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:41.250366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] PATH_INFO: `/v3/projects/d49e0ed8c495407891d2fbe6282064c5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:41.251499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d49e0ed8c495407891d2fbe6282064c5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:41.253473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:41.303430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd49e0ed8c495407891d2fbe6282064c5', 'request_id': 'req-0601c2de-f124-4049-b18d-3b1d819cd157'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.311216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd49e0ed8c495407891d2fbe6282064c5', 'request_id': 'req-0601c2de-f124-4049-b18d-3b1d819cd157'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.317147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd49e0ed8c495407891d2fbe6282064c5', 'request_id': 'req-0601c2de-f124-4049-b18d-3b1d819cd157'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.328215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] The token cache is being invalidate because project d49e0ed8c495407891d2fbe6282064c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:32:41.328503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.329166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.330712 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4163/8348] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:32:41 2022] DELETE /identity/v3/projects/d49e0ed8c495407891d2fbe6282064c5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:41.334701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:41.336137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:41.349136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e7b4-02d0-45c6-8997-e559e512f0fa admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:41.406615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:41.407250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:41.407525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:41.407797 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] PATH_INFO: `/v3/users/3910bbb9dc1a4cdcae901119b6814927` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:41.408981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3910bbb9dc1a4cdcae901119b6814927)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:41.410925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:41.454334 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:41.464924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3910bbb9dc1a4cdcae901119b6814927'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.478441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3910bbb9dc1a4cdcae901119b6814927'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.486963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3910bbb9dc1a4cdcae901119b6814927'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.494074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3910bbb9dc1a4cdcae901119b6814927'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.494746 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-14dbcce6-2529-4c48-b9f1-7891b074f499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3910bbb9dc1a4cdcae901119b6814927'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.501551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4186/8349] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:32:41 2022] DELETE /identity/v3/users/3910bbb9dc1a4cdcae901119b6814927 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:41.675976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:41.677888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:41.692162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c2de-f124-4049-b18d-3b1d819cd157 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:41.733780 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:41.752283 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:41.752957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:41.753241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:41.753521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] PATH_INFO: `/v3/projects/9c63d93acb0044c0aa4e1ac0c483a1dc` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:41.754652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c63d93acb0044c0aa4e1ac0c483a1dc)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:41.756564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:41.803111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c63d93acb0044c0aa4e1ac0c483a1dc', 'request_id': 'req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.810923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c63d93acb0044c0aa4e1ac0c483a1dc', 'request_id': 'req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.817043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c63d93acb0044c0aa4e1ac0c483a1dc', 'request_id': 'req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.827861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] The token cache is being invalidate because project 9c63d93acb0044c0aa4e1ac0c483a1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:32:41.828147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.828802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-7420fcc9-565c-4cca-aaa7-8b5b8c66c0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:32:41.830267 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4164/8350] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:32:41 2022] DELETE /identity/v3/projects/9c63d93acb0044c0aa4e1ac0c483a1dc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:41.835531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866679-d8ba-49a3-b2c2-9e1f5e98e0de None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:41.836016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866679-d8ba-49a3-b2c2-9e1f5e98e0de None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:41.836129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866679-d8ba-49a3-b2c2-9e1f5e98e0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:41.857490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fd866679-d8ba-49a3-b2c2-9e1f5e98e0de None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:41.858694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fd866679-d8ba-49a3-b2c2-9e1f5e98e0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:41.920286 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4187/8351] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:41.928010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d3d77-9d86-4d6f-89b4-c16a227339da None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:41.928302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d3d77-9d86-4d6f-89b4-c16a227339da None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:41.928580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d3d77-9d86-4d6f-89b4-c16a227339da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:41.951323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d78d3d77-9d86-4d6f-89b4-c16a227339da None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:41.952541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d78d3d77-9d86-4d6f-89b4-c16a227339da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:41.960488 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4165/8352] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:32:41.965574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866679-d8ba-49a3-b2c2-9e1f5e98e0de None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:41.975647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866679-d8ba-49a3-b2c2-9e1f5e98e0de None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:41.980909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a5333-07cd-4ff5-a2f9-c327cca7574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:41.981534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a5333-07cd-4ff5-a2f9-c327cca7574c admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:41.981829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a5333-07cd-4ff5-a2f9-c327cca7574c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:41.982083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a5333-07cd-4ff5-a2f9-c327cca7574c admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:41.982722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a5333-07cd-4ff5-a2f9-c327cca7574c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:32:41.983601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a5333-07cd-4ff5-a2f9-c327cca7574c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:41.985231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a5333-07cd-4ff5-a2f9-c327cca7574c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:41.997489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4188/8353] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:32:42.001884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d3d77-9d86-4d6f-89b4-c16a227339da None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.011785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d3d77-9d86-4d6f-89b4-c16a227339da None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.016517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce7174-222c-4e23-96df-702d0152f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.017148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce7174-222c-4e23-96df-702d0152f04c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.017432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce7174-222c-4e23-96df-702d0152f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.017707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce7174-222c-4e23-96df-702d0152f04c admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.018333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce7174-222c-4e23-96df-702d0152f04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.020238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce7174-222c-4e23-96df-702d0152f04c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.048153 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4166/8354] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:32:42 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:42.052422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a5333-07cd-4ff5-a2f9-c327cca7574c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.063302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a5333-07cd-4ff5-a2f9-c327cca7574c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.121528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955db44-77af-42c3-807a-cad5373f7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.122138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955db44-77af-42c3-807a-cad5373f7861 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.122419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955db44-77af-42c3-807a-cad5373f7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.122695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955db44-77af-42c3-807a-cad5373f7861 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.123318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955db44-77af-42c3-807a-cad5373f7861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.125274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955db44-77af-42c3-807a-cad5373f7861 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.146116 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4189/8355] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:32:42 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:32:42.150256 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce7174-222c-4e23-96df-702d0152f04c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.160859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce7174-222c-4e23-96df-702d0152f04c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.165486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b857b-709a-48a7-8978-ff7098e80b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.166114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b857b-709a-48a7-8978-ff7098e80b9d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.166395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b857b-709a-48a7-8978-ff7098e80b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.166667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b857b-709a-48a7-8978-ff7098e80b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.167307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b857b-709a-48a7-8978-ff7098e80b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.169882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b857b-709a-48a7-8978-ff7098e80b9d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.179864 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4167/8356] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:42.184645 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955db44-77af-42c3-807a-cad5373f7861 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.194857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955db44-77af-42c3-807a-cad5373f7861 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.200017 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d982f-1658-4516-8c7c-6a24c912b324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.200611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d982f-1658-4516-8c7c-6a24c912b324 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.200928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d982f-1658-4516-8c7c-6a24c912b324 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.201202 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d982f-1658-4516-8c7c-6a24c912b324 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.201832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d982f-1658-4516-8c7c-6a24c912b324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.203418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d982f-1658-4516-8c7c-6a24c912b324 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.213951 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4190/8357] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:42.217996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b857b-709a-48a7-8978-ff7098e80b9d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.228026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b857b-709a-48a7-8978-ff7098e80b9d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.233145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f45fb1-2c6e-46e2-8c04-d27a517e55f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.233787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f45fb1-2c6e-46e2-8c04-d27a517e55f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.234063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f45fb1-2c6e-46e2-8c04-d27a517e55f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.234338 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f45fb1-2c6e-46e2-8c04-d27a517e55f1 admin admin] PATH_INFO: `/v3/projects/a7ac6d3676344922ab545146917e088b/users/2fe59c63cec74d209627ad37039aa4b8/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.249742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f45fb1-2c6e-46e2-8c04-d27a517e55f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ac6d3676344922ab545146917e088b, user_id=2fe59c63cec74d209627ad37039aa4b8, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.252442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f45fb1-2c6e-46e2-8c04-d27a517e55f1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.265794 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4168/8358] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:42 2022] PUT /identity/v3/projects/a7ac6d3676344922ab545146917e088b/users/2fe59c63cec74d209627ad37039aa4b8/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:42.367904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdb84b-095a-4738-a3ff-b7a2714cc19d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.368194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdb84b-095a-4738-a3ff-b7a2714cc19d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.368478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdb84b-095a-4738-a3ff-b7a2714cc19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.397221 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-64fdb84b-095a-4738-a3ff-b7a2714cc19d None None] MFA Rules not processed for user `2fe59c63cec74d209627ad37039aa4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:42.398427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-64fdb84b-095a-4738-a3ff-b7a2714cc19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:42.407072 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:42.465154 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4191/8359] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:42.470161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f45fb1-2c6e-46e2-8c04-d27a517e55f1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.530728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f45fb1-2c6e-46e2-8c04-d27a517e55f1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.535479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73f6cd-769f-4ad7-84a9-468e77f2baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.536089 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73f6cd-769f-4ad7-84a9-468e77f2baa3 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.536374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73f6cd-769f-4ad7-84a9-468e77f2baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.536676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73f6cd-769f-4ad7-84a9-468e77f2baa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.537309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73f6cd-769f-4ad7-84a9-468e77f2baa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.539260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73f6cd-769f-4ad7-84a9-468e77f2baa3 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.554093 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:42.567506 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4169/8360] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:32:42 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:42.571781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdb84b-095a-4738-a3ff-b7a2714cc19d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.582980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdb84b-095a-4738-a3ff-b7a2714cc19d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.640793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c183e-9420-4669-bdd5-244b517a03f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.641394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c183e-9420-4669-bdd5-244b517a03f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.641680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c183e-9420-4669-bdd5-244b517a03f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.641983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c183e-9420-4669-bdd5-244b517a03f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.642611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c183e-9420-4669-bdd5-244b517a03f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.644538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c183e-9420-4669-bdd5-244b517a03f4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.668582 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4192/8361] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:32:42 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:42.670310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73f6cd-769f-4ad7-84a9-468e77f2baa3 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.680836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73f6cd-769f-4ad7-84a9-468e77f2baa3 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.685720 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba458c-43de-46ce-999c-cfc0a4ca8863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.686312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba458c-43de-46ce-999c-cfc0a4ca8863 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.686588 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba458c-43de-46ce-999c-cfc0a4ca8863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.686855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba458c-43de-46ce-999c-cfc0a4ca8863 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.687483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba458c-43de-46ce-999c-cfc0a4ca8863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.689136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba458c-43de-46ce-999c-cfc0a4ca8863 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.700186 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4170/8362] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:42.704107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c183e-9420-4669-bdd5-244b517a03f4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.713968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c183e-9420-4669-bdd5-244b517a03f4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.719317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245ffb2-959d-42d5-af42-adb631535837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.719842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245ffb2-959d-42d5-af42-adb631535837 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.720120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245ffb2-959d-42d5-af42-adb631535837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.720420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245ffb2-959d-42d5-af42-adb631535837 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.721158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245ffb2-959d-42d5-af42-adb631535837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.722728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245ffb2-959d-42d5-af42-adb631535837 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.733139 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4193/8363] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:42.737386 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba458c-43de-46ce-999c-cfc0a4ca8863 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.747939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba458c-43de-46ce-999c-cfc0a4ca8863 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.752563 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54264026-af31-4027-88e4-6c97e4094018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.753238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54264026-af31-4027-88e4-6c97e4094018 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.753519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54264026-af31-4027-88e4-6c97e4094018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.753794 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54264026-af31-4027-88e4-6c97e4094018 admin admin] PATH_INFO: `/v3/projects/1c7b02ba069c4ba2bb7ce48e1e71ed55/users/8789b47726754ea3bfca61c1382db683/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.768983 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54264026-af31-4027-88e4-6c97e4094018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7b02ba069c4ba2bb7ce48e1e71ed55, user_id=8789b47726754ea3bfca61c1382db683, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.771644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54264026-af31-4027-88e4-6c97e4094018 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:42.785309 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4171/8364] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:42 2022] PUT /identity/v3/projects/1c7b02ba069c4ba2bb7ce48e1e71ed55/users/8789b47726754ea3bfca61c1382db683/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:42.795600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1eb32-72f2-42de-8035-76277d52b2b6 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.795895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1eb32-72f2-42de-8035-76277d52b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.796179 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1eb32-72f2-42de-8035-76277d52b2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.823740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-57c1eb32-72f2-42de-8035-76277d52b2b6 None None] MFA Rules not processed for user `8789b47726754ea3bfca61c1382db683`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:42.825588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-57c1eb32-72f2-42de-8035-76277d52b2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:42.895949 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4194/8365] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:42.900572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54264026-af31-4027-88e4-6c97e4094018 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:42.964201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54264026-af31-4027-88e4-6c97e4094018 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:42.970125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0b61-579d-448c-9dd2-51127a9f2ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:42.970674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0b61-579d-448c-9dd2-51127a9f2ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:42.970962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0b61-579d-448c-9dd2-51127a9f2ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:42.971228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0b61-579d-448c-9dd2-51127a9f2ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:42.971856 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af0b61-579d-448c-9dd2-51127a9f2ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:42.973804 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af0b61-579d-448c-9dd2-51127a9f2ba1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:43.002606 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4172/8366] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:32:42 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:43.006968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1eb32-72f2-42de-8035-76277d52b2b6 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:43.018646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1eb32-72f2-42de-8035-76277d52b2b6 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:43.032460 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:43.084454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1a09-9148-4007-9c9c-abeebae8ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:43.085121 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1a09-9148-4007-9c9c-abeebae8ff66 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:43.085407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1a09-9148-4007-9c9c-abeebae8ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:43.085684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1a09-9148-4007-9c9c-abeebae8ff66 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:43.086457 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1a09-9148-4007-9c9c-abeebae8ff66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:43.088470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1a09-9148-4007-9c9c-abeebae8ff66 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:43.111274 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4195/8367] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:32:43 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:32:43.115303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0b61-579d-448c-9dd2-51127a9f2ba1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:43.126299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0b61-579d-448c-9dd2-51127a9f2ba1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:43.130993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c09e89-e8c2-4c2a-9eea-a1061b04c9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:43.131592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c09e89-e8c2-4c2a-9eea-a1061b04c9ec admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:43.131877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c09e89-e8c2-4c2a-9eea-a1061b04c9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:43.132156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c09e89-e8c2-4c2a-9eea-a1061b04c9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:43.132841 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c09e89-e8c2-4c2a-9eea-a1061b04c9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:43.134450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c09e89-e8c2-4c2a-9eea-a1061b04c9ec admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:43.147035 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4173/8368] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:43.151128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1a09-9148-4007-9c9c-abeebae8ff66 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:43.161157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1a09-9148-4007-9c9c-abeebae8ff66 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:43.165784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95fed6-19a8-4969-8d06-8b0f9db5752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:43.166427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95fed6-19a8-4969-8d06-8b0f9db5752c admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:43.166706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95fed6-19a8-4969-8d06-8b0f9db5752c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:43.166977 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95fed6-19a8-4969-8d06-8b0f9db5752c admin admin] PATH_INFO: `/v3/projects/d804c58ea07d4916b2dd53fc9f67b4d7/users/3d13c5859fa2475c8896c5b1e2eddc3c/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:43.187080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95fed6-19a8-4969-8d06-8b0f9db5752c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d804c58ea07d4916b2dd53fc9f67b4d7, user_id=3d13c5859fa2475c8896c5b1e2eddc3c, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:43.189788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95fed6-19a8-4969-8d06-8b0f9db5752c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:43.203539 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4196/8369] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:43 2022] PUT /identity/v3/projects/d804c58ea07d4916b2dd53fc9f67b4d7/users/3d13c5859fa2475c8896c5b1e2eddc3c/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:43.207598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c09e89-e8c2-4c2a-9eea-a1061b04c9ec admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:43.218002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c09e89-e8c2-4c2a-9eea-a1061b04c9ec admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:43.274533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d6948-203c-48a0-a006-629138e245ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:43.275079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6948-203c-48a0-a006-629138e245ca admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:43.275346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6948-203c-48a0-a006-629138e245ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:43.275622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6948-203c-48a0-a006-629138e245ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:43.276254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d6948-203c-48a0-a006-629138e245ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:43.277943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d6948-203c-48a0-a006-629138e245ca admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:43.287599 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4174/8370] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:32:43.292166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95fed6-19a8-4969-8d06-8b0f9db5752c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:43.302632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95fed6-19a8-4969-8d06-8b0f9db5752c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:43.307305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a2854-2a74-46e4-8ca0-57b00daa7ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:43.307953 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a2854-2a74-46e4-8ca0-57b00daa7ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:43.308758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a2854-2a74-46e4-8ca0-57b00daa7ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:43.309027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a2854-2a74-46e4-8ca0-57b00daa7ec5 admin admin] PATH_INFO: `/v3/projects/d804c58ea07d4916b2dd53fc9f67b4d7/users/3d13c5859fa2475c8896c5b1e2eddc3c/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:43.310988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a2854-2a74-46e4-8ca0-57b00daa7ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d804c58ea07d4916b2dd53fc9f67b4d7, user_id=3d13c5859fa2475c8896c5b1e2eddc3c, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:43.313716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a2854-2a74-46e4-8ca0-57b00daa7ec5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:43.324713 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4197/8371] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:32:43 2022] PUT /identity/v3/projects/d804c58ea07d4916b2dd53fc9f67b4d7/users/3d13c5859fa2475c8896c5b1e2eddc3c/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:32:43.335019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371a3b6-8418-4682-8d7e-6b2f5132a3f3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:43.335307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371a3b6-8418-4682-8d7e-6b2f5132a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:43.335584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371a3b6-8418-4682-8d7e-6b2f5132a3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:43.363055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1371a3b6-8418-4682-8d7e-6b2f5132a3f3 None None] MFA Rules not processed for user `3d13c5859fa2475c8896c5b1e2eddc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:43.364269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1371a3b6-8418-4682-8d7e-6b2f5132a3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:43.381525 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:43.433029 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4175/8372] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:32:43.450059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a2854-2a74-46e4-8ca0-57b00daa7ec5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:43.451756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f02a2854-2a74-46e4-8ca0-57b00daa7ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:43.529051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a2854-2a74-46e4-8ca0-57b00daa7ec5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:43.534655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29b57-47bd-4424-8e0e-fb9849292b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:43.535257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29b57-47bd-4424-8e0e-fb9849292b0b service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:43.535540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29b57-47bd-4424-8e0e-fb9849292b0b service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:43.535815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29b57-47bd-4424-8e0e-fb9849292b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:43.591788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff29b57-47bd-4424-8e0e-fb9849292b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:43.593426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff29b57-47bd-4424-8e0e-fb9849292b0b service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:43.602489 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4198/8373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:45.689762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371a3b6-8418-4682-8d7e-6b2f5132a3f3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:45.691469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1371a3b6-8418-4682-8d7e-6b2f5132a3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:45.750251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371a3b6-8418-4682-8d7e-6b2f5132a3f3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:45.753812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127c46f-8de5-4f6a-9d4d-bd81bd8d45cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:45.754421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127c46f-8de5-4f6a-9d4d-bd81bd8d45cd service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:45.754703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127c46f-8de5-4f6a-9d4d-bd81bd8d45cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:45.754980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127c46f-8de5-4f6a-9d4d-bd81bd8d45cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:45.764776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127c46f-8de5-4f6a-9d4d-bd81bd8d45cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:45.766218 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127c46f-8de5-4f6a-9d4d-bd81bd8d45cd service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:45.775919 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4176/8374] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:49.223062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29283493-5bed-4e45-a764-d44cdd6cf1ca None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:49.223663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29283493-5bed-4e45-a764-d44cdd6cf1ca None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:49.223663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29283493-5bed-4e45-a764-d44cdd6cf1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:49.238131 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:49.244658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-29283493-5bed-4e45-a764-d44cdd6cf1ca None None] MFA Rules not processed for user `2fe59c63cec74d209627ad37039aa4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:49.246267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-29283493-5bed-4e45-a764-d44cdd6cf1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:49.259207 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4199/8375] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:50.162277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1e13-e7dc-4564-9910-2675bbbb64fb None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:50.163329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1e13-e7dc-4564-9910-2675bbbb64fb None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:50.163616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1e13-e7dc-4564-9910-2675bbbb64fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:50.205638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-baec1e13-e7dc-4564-9910-2675bbbb64fb None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:32:50.206870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-baec1e13-e7dc-4564-9910-2675bbbb64fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:50.283862 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4177/8376] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:32:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:32:50.297095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29283493-5bed-4e45-a764-d44cdd6cf1ca None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:50.298716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-29283493-5bed-4e45-a764-d44cdd6cf1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:50.318133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29283493-5bed-4e45-a764-d44cdd6cf1ca None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:50.323226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152010b0-b451-40e0-8e7f-7bc1b475c6c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:50.323835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152010b0-b451-40e0-8e7f-7bc1b475c6c0 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:50.324318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152010b0-b451-40e0-8e7f-7bc1b475c6c0 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:50.324596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152010b0-b451-40e0-8e7f-7bc1b475c6c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:50.334201 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152010b0-b451-40e0-8e7f-7bc1b475c6c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:50.335798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152010b0-b451-40e0-8e7f-7bc1b475c6c0 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:50.346709 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4200/8377] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:52.636693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec1e13-e7dc-4564-9910-2675bbbb64fb None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:52.638438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-baec1e13-e7dc-4564-9910-2675bbbb64fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:52.649984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec1e13-e7dc-4564-9910-2675bbbb64fb None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:52.653948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692c460-c832-4f82-809b-aa7848144420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:52.654555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692c460-c832-4f82-809b-aa7848144420 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:52.654834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692c460-c832-4f82-809b-aa7848144420 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:52.655102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692c460-c832-4f82-809b-aa7848144420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:52.656860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e692c460-c832-4f82-809b-aa7848144420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:52.670055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692c460-c832-4f82-809b-aa7848144420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:52.671514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692c460-c832-4f82-809b-aa7848144420 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:52.683174 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4178/8378] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:53.337808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152010b0-b451-40e0-8e7f-7bc1b475c6c0 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:53.339415 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-152010b0-b451-40e0-8e7f-7bc1b475c6c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:53.368554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152010b0-b451-40e0-8e7f-7bc1b475c6c0 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:53.375452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce48d3-3c34-405f-ae83-1226ab1b6190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:53.376327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce48d3-3c34-405f-ae83-1226ab1b6190 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:53.376750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce48d3-3c34-405f-ae83-1226ab1b6190 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:53.377135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce48d3-3c34-405f-ae83-1226ab1b6190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:53.379043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f3ce48d3-3c34-405f-ae83-1226ab1b6190 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:53.395658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce48d3-3c34-405f-ae83-1226ab1b6190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:53.397378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce48d3-3c34-405f-ae83-1226ab1b6190 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:53.423840 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4201/8379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:32:57.633902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692c460-c832-4f82-809b-aa7848144420 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:32:57.652329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692c460-c832-4f82-809b-aa7848144420 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:32:57.658546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d167b27-b196-44e7-84bb-37d416e08399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:32:57.659219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d167b27-b196-44e7-84bb-37d416e08399 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:32:57.659442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d167b27-b196-44e7-84bb-37d416e08399 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:32:57.659721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d167b27-b196-44e7-84bb-37d416e08399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:32:57.661492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3d167b27-b196-44e7-84bb-37d416e08399 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:32:57.677658 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d167b27-b196-44e7-84bb-37d416e08399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:32:57.679276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d167b27-b196-44e7-84bb-37d416e08399 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:32:57.693300 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4179/8380] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:33:03.404002 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=15 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:07.685861 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=94 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:43.576997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d57a17-e31a-4249-89ca-9f40821932b1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:33:43.577585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d57a17-e31a-4249-89ca-9f40821932b1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:33:43.577774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d57a17-e31a-4249-89ca-9f40821932b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:33:43.598720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-69d57a17-e31a-4249-89ca-9f40821932b1 None None] MFA Rules not processed for user `2fe59c63cec74d209627ad37039aa4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:33:43.600286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-69d57a17-e31a-4249-89ca-9f40821932b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:33:43.609959 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4202/8381] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:33:43.910353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d167b27-b196-44e7-84bb-37d416e08399 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:33:43.921610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d167b27-b196-44e7-84bb-37d416e08399 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:33:43.925489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:33:43.926110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:33:43.926394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:33:43.926667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:33:43.928454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:33:43.957651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:33:43.959036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:33:43.973307 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4180/8382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:33:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:33:44.369584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b628a-cd1c-41b2-b060-6ddc152b259c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:33:44.370015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b628a-cd1c-41b2-b060-6ddc152b259c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:33:44.370622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b628a-cd1c-41b2-b060-6ddc152b259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:33:44.404083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-892b628a-cd1c-41b2-b060-6ddc152b259c None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:33:44.405874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-892b628a-cd1c-41b2-b060-6ddc152b259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:33:44.424117 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4203/8383] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:33:44.439973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:33:44.441723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:33:44.469062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39579b-e6d3-413c-b380-d9e88a2786af service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:33:44.479140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76d740-8f97-4194-845a-9a55db57d7b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:33:44.480611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d740-8f97-4194-845a-9a55db57d7b2 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:33:44.480611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d740-8f97-4194-845a-9a55db57d7b2 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:33:44.481410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d740-8f97-4194-845a-9a55db57d7b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:33:44.503525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76d740-8f97-4194-845a-9a55db57d7b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:33:44.505179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76d740-8f97-4194-845a-9a55db57d7b2 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:33:44.517440 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4181/8384] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:33:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:33:54.394581 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:54.512325 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=17 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:08.980455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b628a-cd1c-41b2-b060-6ddc152b259c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:09.052998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b628a-cd1c-41b2-b060-6ddc152b259c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:09.057636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:09.058302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:09.059076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:09.059354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] PATH_INFO: `/v3/users/2fe59c63cec74d209627ad37039aa4b8` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:09.060579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe59c63cec74d209627ad37039aa4b8)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:09.062544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:09.110734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe59c63cec74d209627ad37039aa4b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.123534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe59c63cec74d209627ad37039aa4b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.132196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe59c63cec74d209627ad37039aa4b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.140908 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe59c63cec74d209627ad37039aa4b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.141654 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe59c63cec74d209627ad37039aa4b8'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.147923 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4204/8385] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:34:08 2022] DELETE /identity/v3/users/2fe59c63cec74d209627ad37039aa4b8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:09.152308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c75a0-25f8-445a-acce-caf2d4ba62f8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:09.152783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c75a0-25f8-445a-acce-caf2d4ba62f8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:09.152960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c75a0-25f8-445a-acce-caf2d4ba62f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:09.198580 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-107c75a0-25f8-445a-acce-caf2d4ba62f8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:09.200551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-107c75a0-25f8-445a-acce-caf2d4ba62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:09.261049 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4182/8386] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:09.271476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:09.272924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:09.331471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f462-91cb-4553-887b-d029d707508a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:09.335174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c97caa-c73a-4533-9ecb-12f13f3a60ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:09.335780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c97caa-c73a-4533-9ecb-12f13f3a60ea service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:09.336065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c97caa-c73a-4533-9ecb-12f13f3a60ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:09.336344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c97caa-c73a-4533-9ecb-12f13f3a60ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:09.345609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c97caa-c73a-4533-9ecb-12f13f3a60ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:09.347039 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c97caa-c73a-4533-9ecb-12f13f3a60ea service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:09.356808 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4205/8387] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:34:09.531054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c75a0-25f8-445a-acce-caf2d4ba62f8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:09.532648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-107c75a0-25f8-445a-acce-caf2d4ba62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:09.548403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c75a0-25f8-445a-acce-caf2d4ba62f8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:09.553070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:09.553948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:09.554240 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:09.554517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] PATH_INFO: `/v3/projects/a7ac6d3676344922ab545146917e088b` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:09.555684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ac6d3676344922ab545146917e088b)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:09.557646 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:09.610576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ac6d3676344922ab545146917e088b', 'request_id': 'req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.618035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ac6d3676344922ab545146917e088b', 'request_id': 'req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.624469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ac6d3676344922ab545146917e088b', 'request_id': 'req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.635519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] The token cache is being invalidate because project a7ac6d3676344922ab545146917e088b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:34:09.635801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.636445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.638098 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4183/8388] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:34:09 2022] DELETE /identity/v3/projects/a7ac6d3676344922ab545146917e088b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:09.642032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c97caa-c73a-4533-9ecb-12f13f3a60ea service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:09.652389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c97caa-c73a-4533-9ecb-12f13f3a60ea service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:09.661318 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:09.711751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:09.712441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:09.712759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:09.713038 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] PATH_INFO: `/v3/users/8789b47726754ea3bfca61c1382db683` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:09.714177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8789b47726754ea3bfca61c1382db683)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:09.716208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:09.763726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8789b47726754ea3bfca61c1382db683'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.775475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8789b47726754ea3bfca61c1382db683'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.783519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8789b47726754ea3bfca61c1382db683'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.790383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8789b47726754ea3bfca61c1382db683'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.791012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8789b47726754ea3bfca61c1382db683'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:09.797557 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4206/8389] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:34:09 2022] DELETE /identity/v3/users/8789b47726754ea3bfca61c1382db683 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:10.063958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:10.065456 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:10.081109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2767a-6b4e-4477-ac2c-29c7396ce3f5 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:10.144534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:10.145210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:10.145493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:10.145772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] PATH_INFO: `/v3/projects/1c7b02ba069c4ba2bb7ce48e1e71ed55` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:10.146886 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7b02ba069c4ba2bb7ce48e1e71ed55)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:10.148829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:10.157350 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:10.199556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7b02ba069c4ba2bb7ce48e1e71ed55', 'request_id': 'req-5810bf4e-540d-417b-9976-16392701ef78'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.207017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7b02ba069c4ba2bb7ce48e1e71ed55', 'request_id': 'req-5810bf4e-540d-417b-9976-16392701ef78'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.212708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7b02ba069c4ba2bb7ce48e1e71ed55', 'request_id': 'req-5810bf4e-540d-417b-9976-16392701ef78'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.224370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] The token cache is being invalidate because project 1c7b02ba069c4ba2bb7ce48e1e71ed55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:34:10.224682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.225340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.226840 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4184/8390] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:34:10 2022] DELETE /identity/v3/projects/1c7b02ba069c4ba2bb7ce48e1e71ed55 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:10.230808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:10.232259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:10.244915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52afca9-a183-4c0e-9f6a-95bcf70910cb admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:10.301191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:10.301743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:10.302023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:10.302326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] PATH_INFO: `/v3/users/3d13c5859fa2475c8896c5b1e2eddc3c` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:10.303437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d13c5859fa2475c8896c5b1e2eddc3c)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:10.305383 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:10.342040 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:10.353564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d13c5859fa2475c8896c5b1e2eddc3c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.366519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d13c5859fa2475c8896c5b1e2eddc3c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.374778 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d13c5859fa2475c8896c5b1e2eddc3c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.381933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d13c5859fa2475c8896c5b1e2eddc3c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.382577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a542da0e-9209-4a2f-a4a9-e3a980f5f4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d13c5859fa2475c8896c5b1e2eddc3c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.389027 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4207/8391] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:34:10 2022] DELETE /identity/v3/users/3d13c5859fa2475c8896c5b1e2eddc3c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:10.562206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:10.563624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:10.576573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810bf4e-540d-417b-9976-16392701ef78 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:10.633477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:10.634109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:10.634390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:10.634669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] PATH_INFO: `/v3/projects/d804c58ea07d4916b2dd53fc9f67b4d7` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:10.635776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d804c58ea07d4916b2dd53fc9f67b4d7)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:10.637931 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:10.683906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd804c58ea07d4916b2dd53fc9f67b4d7', 'request_id': 'req-1f36eea9-a58f-4105-b2d3-59660710d7e8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.690624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd804c58ea07d4916b2dd53fc9f67b4d7', 'request_id': 'req-1f36eea9-a58f-4105-b2d3-59660710d7e8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.696735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd804c58ea07d4916b2dd53fc9f67b4d7', 'request_id': 'req-1f36eea9-a58f-4105-b2d3-59660710d7e8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.707691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] The token cache is being invalidate because project d804c58ea07d4916b2dd53fc9f67b4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:34:10.707979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.708694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1f36eea9-a58f-4105-b2d3-59660710d7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:10.710164 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4185/8392] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:34:10 2022] DELETE /identity/v3/projects/d804c58ea07d4916b2dd53fc9f67b4d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:34:10.716319 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbafbca-8f4f-4c5b-ae34-82aac792f9db None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:10.716603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbafbca-8f4f-4c5b-ae34-82aac792f9db None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:10.716913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbafbca-8f4f-4c5b-ae34-82aac792f9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:10.756141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2cbafbca-8f4f-4c5b-ae34-82aac792f9db None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:10.757485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2cbafbca-8f4f-4c5b-ae34-82aac792f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:10.817930 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4208/8393] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:10.826775 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d7e1e-d596-4d21-8360-e7e00b74270e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:10.827065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d7e1e-d596-4d21-8360-e7e00b74270e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:10.827344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d7e1e-d596-4d21-8360-e7e00b74270e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:10.846966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5d7d7e1e-d596-4d21-8360-e7e00b74270e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:10.848177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5d7d7e1e-d596-4d21-8360-e7e00b74270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:10.856315 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4186/8394] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:10.860459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbafbca-8f4f-4c5b-ae34-82aac792f9db None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:10.870305 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbafbca-8f4f-4c5b-ae34-82aac792f9db None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:10.875412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1ce74-9b2b-4f84-908a-f4aaca51331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:10.876013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1ce74-9b2b-4f84-908a-f4aaca51331f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:10.876293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1ce74-9b2b-4f84-908a-f4aaca51331f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:10.876568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1ce74-9b2b-4f84-908a-f4aaca51331f admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:10.877239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1ce74-9b2b-4f84-908a-f4aaca51331f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:34:10.877544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1ce74-9b2b-4f84-908a-f4aaca51331f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:10.879131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1ce74-9b2b-4f84-908a-f4aaca51331f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:10.891171 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4209/8395] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:34:10.895322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d7e1e-d596-4d21-8360-e7e00b74270e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:10.905238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d7e1e-d596-4d21-8360-e7e00b74270e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:10.909924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b234a3-6d5b-4068-bb09-93d963afe04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:10.910520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b234a3-6d5b-4068-bb09-93d963afe04e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:10.910803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b234a3-6d5b-4068-bb09-93d963afe04e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:10.911077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b234a3-6d5b-4068-bb09-93d963afe04e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:10.911703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b234a3-6d5b-4068-bb09-93d963afe04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:10.913719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b234a3-6d5b-4068-bb09-93d963afe04e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:10.934586 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:10.944130 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4187/8396] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:34:10 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:34:10.948131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1ce74-9b2b-4f84-908a-f4aaca51331f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:10.958872 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1ce74-9b2b-4f84-908a-f4aaca51331f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:11.015693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd2755-df1c-4fc4-8353-d5c1242c208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:11.016296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd2755-df1c-4fc4-8353-d5c1242c208a admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:11.016580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd2755-df1c-4fc4-8353-d5c1242c208a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:11.016886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd2755-df1c-4fc4-8353-d5c1242c208a admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:11.017519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd2755-df1c-4fc4-8353-d5c1242c208a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:11.019477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd2755-df1c-4fc4-8353-d5c1242c208a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:11.040519 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4210/8397] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:34:10 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:34:11.044430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b234a3-6d5b-4068-bb09-93d963afe04e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:11.054865 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b234a3-6d5b-4068-bb09-93d963afe04e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:11.060174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dec64-bb6f-4845-9666-e7508a45682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:11.060813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dec64-bb6f-4845-9666-e7508a45682b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:11.061096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dec64-bb6f-4845-9666-e7508a45682b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:11.061373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dec64-bb6f-4845-9666-e7508a45682b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:11.062013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dec64-bb6f-4845-9666-e7508a45682b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:11.063621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dec64-bb6f-4845-9666-e7508a45682b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:11.073804 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4188/8398] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:34:11.077759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd2755-df1c-4fc4-8353-d5c1242c208a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:11.088692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd2755-df1c-4fc4-8353-d5c1242c208a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:11.093699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b72466-5fd5-4f7e-a2fe-d6ef81c52e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:11.094315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b72466-5fd5-4f7e-a2fe-d6ef81c52e95 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:11.094631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b72466-5fd5-4f7e-a2fe-d6ef81c52e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:11.094929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b72466-5fd5-4f7e-a2fe-d6ef81c52e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:11.095584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b72466-5fd5-4f7e-a2fe-d6ef81c52e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:11.097207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b72466-5fd5-4f7e-a2fe-d6ef81c52e95 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:11.109718 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4211/8399] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:34:11.113868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dec64-bb6f-4845-9666-e7508a45682b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:11.124244 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dec64-bb6f-4845-9666-e7508a45682b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:11.128968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf6b6-52c5-4f97-9434-1fa77df682d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:11.129622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf6b6-52c5-4f97-9434-1fa77df682d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:11.129906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf6b6-52c5-4f97-9434-1fa77df682d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:11.130185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf6b6-52c5-4f97-9434-1fa77df682d6 admin admin] PATH_INFO: `/v3/projects/20e7cf41c84447bdb3d7dc172aeb3060/users/17f998caa11240b7a4592887f4df6502/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:11.145383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbf6b6-52c5-4f97-9434-1fa77df682d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e7cf41c84447bdb3d7dc172aeb3060, user_id=17f998caa11240b7a4592887f4df6502, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:11.148097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbf6b6-52c5-4f97-9434-1fa77df682d6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:11.161419 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4189/8400] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:34:11 2022] PUT /identity/v3/projects/20e7cf41c84447bdb3d7dc172aeb3060/users/17f998caa11240b7a4592887f4df6502/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:11.166296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaea814-42a1-413d-b817-b2a764c22fc2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:11.166587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaea814-42a1-413d-b817-b2a764c22fc2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:11.166862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaea814-42a1-413d-b817-b2a764c22fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:11.174067 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:11.187989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-deaea814-42a1-413d-b817-b2a764c22fc2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:11.189217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-deaea814-42a1-413d-b817-b2a764c22fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:11.248826 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4212/8401] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:11.258648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf6b6-52c5-4f97-9434-1fa77df682d6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:11.260361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a7fbf6b6-52c5-4f97-9434-1fa77df682d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:11.318909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf6b6-52c5-4f97-9434-1fa77df682d6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:11.322590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959edc-84f3-47c9-8491-a61c70d9b6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:11.323193 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959edc-84f3-47c9-8491-a61c70d9b6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:11.323478 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959edc-84f3-47c9-8491-a61c70d9b6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:11.323768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959edc-84f3-47c9-8491-a61c70d9b6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:11.333806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8959edc-84f3-47c9-8491-a61c70d9b6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:11.335242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8959edc-84f3-47c9-8491-a61c70d9b6a6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:11.345305 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4190/8402] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:34:15.509708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec263db-f009-47a4-931d-d8cb27bc7364 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:15.510193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec263db-f009-47a4-931d-d8cb27bc7364 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:15.510193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec263db-f009-47a4-931d-d8cb27bc7364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:15.543540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2ec263db-f009-47a4-931d-d8cb27bc7364 None None] MFA Rules not processed for user `17f998caa11240b7a4592887f4df6502`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:15.544812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2ec263db-f009-47a4-931d-d8cb27bc7364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:15.624993 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4213/8403] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:15.630643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959edc-84f3-47c9-8491-a61c70d9b6a6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:15.648666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959edc-84f3-47c9-8491-a61c70d9b6a6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:15.658922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c232d4-8d0a-48c6-97b3-c36b9767852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:15.659696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c232d4-8d0a-48c6-97b3-c36b9767852f admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:15.660100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c232d4-8d0a-48c6-97b3-c36b9767852f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:15.660596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c232d4-8d0a-48c6-97b3-c36b9767852f admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:15.661421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c232d4-8d0a-48c6-97b3-c36b9767852f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:15.665381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c232d4-8d0a-48c6-97b3-c36b9767852f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:15.687895 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4191/8404] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:34:15 2022] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:34:15.692068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec263db-f009-47a4-931d-d8cb27bc7364 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:15.707487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec263db-f009-47a4-931d-d8cb27bc7364 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:15.715995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a157d-6be6-4499-86ad-9cace58e5385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:15.718086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a157d-6be6-4499-86ad-9cace58e5385 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:15.718595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a157d-6be6-4499-86ad-9cace58e5385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:15.718879 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a157d-6be6-4499-86ad-9cace58e5385 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:15.719542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a157d-6be6-4499-86ad-9cace58e5385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:15.721197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a157d-6be6-4499-86ad-9cace58e5385 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:15.735558 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4214/8405] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:34:15.739722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c232d4-8d0a-48c6-97b3-c36b9767852f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:15.750466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c232d4-8d0a-48c6-97b3-c36b9767852f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:15.755242 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5f58b-ec2b-4eef-83ae-e9096e84c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:15.755908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f58b-ec2b-4eef-83ae-e9096e84c4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:15.756184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f58b-ec2b-4eef-83ae-e9096e84c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:15.756459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f58b-ec2b-4eef-83ae-e9096e84c4d7 admin admin] PATH_INFO: `/v3/system/users/6ac12f9744c54077aac3ff38180748d6/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:15.772922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5f58b-ec2b-4eef-83ae-e9096e84c4d7 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6ac12f9744c54077aac3ff38180748d6, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:15.773996 n-d-master-1 devstack@keystone.service[86424]: WARNING py.warnings [None req-69e5f58b-ec2b-4eef-83ae-e9096e84c4d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 01:34:15.773996 n-d-master-1 devstack@keystone.service[86424]: warnings.warn(msg) Oct 19 01:34:15.773996 n-d-master-1 devstack@keystone.service[86424]: Oct 19 01:34:15.775116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5f58b-ec2b-4eef-83ae-e9096e84c4d7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:15.783496 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4192/8406] 10.222.0.27 () {60 vars in 1378 bytes} [Wed Oct 19 01:34:15 2022] PUT /identity/v3/system/users/6ac12f9744c54077aac3ff38180748d6/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:34:15.797189 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6ceee-7f8d-4633-8814-a8797d5863cd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:15.797497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6ceee-7f8d-4633-8814-a8797d5863cd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:15.797760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6ceee-7f8d-4633-8814-a8797d5863cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:15.828270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a1a6ceee-7f8d-4633-8814-a8797d5863cd None None] MFA Rules not processed for user `6ac12f9744c54077aac3ff38180748d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:15.829557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a1a6ceee-7f8d-4633-8814-a8797d5863cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:15.899055 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:15.912844 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4215/8407] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:15 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 01:34:15.917056 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5f58b-ec2b-4eef-83ae-e9096e84c4d7 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:16.006792 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:16.030590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5f58b-ec2b-4eef-83ae-e9096e84c4d7 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:16.069769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f3b88-daf3-4e45-8a2e-278fa3457ba4 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ac12f9744c54077aac3ff38180748d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:16.070390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f3b88-daf3-4e45-8a2e-278fa3457ba4 None tempest-ImageQuotaTest-436142237-system-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:16.070673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f3b88-daf3-4e45-8a2e-278fa3457ba4 None tempest-ImageQuotaTest-436142237-system-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:16.070944 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f3b88-daf3-4e45-8a2e-278fa3457ba4 None tempest-ImageQuotaTest-436142237-system-admin] PATH_INFO: `/v3/services` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:16.071552 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f3b88-daf3-4e45-8a2e-278fa3457ba4 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:16.072947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f3b88-daf3-4e45-8a2e-278fa3457ba4 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:16.082019 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4193/8408] 10.222.0.27 () {58 vars in 1110 bytes} [Wed Oct 19 01:34:15 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:34:16.089705 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6ceee-7f8d-4633-8814-a8797d5863cd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:16.224273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6ceee-7f8d-4633-8814-a8797d5863cd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:16.266898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2d59-3721-40c5-af05-9d5d1a7b4db0 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ac12f9744c54077aac3ff38180748d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:16.267528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2d59-3721-40c5-af05-9d5d1a7b4db0 None tempest-ImageQuotaTest-436142237-system-admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:16.267812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2d59-3721-40c5-af05-9d5d1a7b4db0 None tempest-ImageQuotaTest-436142237-system-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:16.268088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2d59-3721-40c5-af05-9d5d1a7b4db0 None tempest-ImageQuotaTest-436142237-system-admin] PATH_INFO: `/v3/limits` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:16.268779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db2d59-3721-40c5-af05-9d5d1a7b4db0 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:16.270085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db2d59-3721-40c5-af05-9d5d1a7b4db0 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application [None req-56db2d59-3721-40c5-af05-9d5d1a7b4db0 None tempest-ImageQuotaTest-436142237-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 19 01:34:16.313218 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 19 01:34:16.314593 n-d-master-1 devstack@keystone.service[86425]: ERROR keystone.server.flask.application Oct 19 01:34:16.315492 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4216/8409] 10.222.0.27 () {60 vars in 1126 bytes} [Wed Oct 19 01:34:16 2022] POST /identity/v3/limits => generated 124 bytes in 229 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 19 01:34:16.319818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f3b88-daf3-4e45-8a2e-278fa3457ba4 None tempest-ImageQuotaTest-436142237-system-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:16.429603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f3b88-daf3-4e45-8a2e-278fa3457ba4 None tempest-ImageQuotaTest-436142237-system-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:16.468229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce06249-fe25-4927-b167-8fec17365881 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ac12f9744c54077aac3ff38180748d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:16.468880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce06249-fe25-4927-b167-8fec17365881 None tempest-ImageQuotaTest-436142237-system-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:16.469159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce06249-fe25-4927-b167-8fec17365881 None tempest-ImageQuotaTest-436142237-system-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:16.469428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce06249-fe25-4927-b167-8fec17365881 None tempest-ImageQuotaTest-436142237-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:16.470038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce06249-fe25-4927-b167-8fec17365881 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:16.471122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce06249-fe25-4927-b167-8fec17365881 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:16.478165 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4194/8410] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 01:34:16 2022] GET /identity/v3/registered_limits => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:34:16.485556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2d59-3721-40c5-af05-9d5d1a7b4db0 None tempest-ImageQuotaTest-436142237-system-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:16.540024 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:16.594808 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2d59-3721-40c5-af05-9d5d1a7b4db0 None tempest-ImageQuotaTest-436142237-system-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:16.630983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430495c-893f-4d91-a96c-9de72214f316 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ac12f9744c54077aac3ff38180748d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:16.631629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430495c-893f-4d91-a96c-9de72214f316 None tempest-ImageQuotaTest-436142237-system-admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:16.632087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430495c-893f-4d91-a96c-9de72214f316 None tempest-ImageQuotaTest-436142237-system-admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:16.632207 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430495c-893f-4d91-a96c-9de72214f316 None tempest-ImageQuotaTest-436142237-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:16.632796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430495c-893f-4d91-a96c-9de72214f316 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:16.633860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430495c-893f-4d91-a96c-9de72214f316 None tempest-ImageQuotaTest-436142237-system-admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:16.640078 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4217/8411] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 01:34:16 2022] GET /identity/v3/registered_limits => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:34:20.008472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce06249-fe25-4927-b167-8fec17365881 None tempest-ImageQuotaTest-436142237-system-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:20.020936 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce06249-fe25-4927-b167-8fec17365881 None tempest-ImageQuotaTest-436142237-system-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:20.026012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:20.026730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:20.027695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:20.027695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] PATH_INFO: `/v3/users/17f998caa11240b7a4592887f4df6502` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:20.029237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f998caa11240b7a4592887f4df6502)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:20.031162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:20.033816 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:20.080788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f998caa11240b7a4592887f4df6502'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.096255 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f998caa11240b7a4592887f4df6502'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.103766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f998caa11240b7a4592887f4df6502'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.111512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f998caa11240b7a4592887f4df6502'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.112150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f998caa11240b7a4592887f4df6502'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.118115 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4195/8412] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:34:20 2022] DELETE /identity/v3/users/17f998caa11240b7a4592887f4df6502 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:20.297725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430495c-893f-4d91-a96c-9de72214f316 None tempest-ImageQuotaTest-436142237-system-admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:20.299684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7430495c-893f-4d91-a96c-9de72214f316 None tempest-ImageQuotaTest-436142237-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:20.370270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430495c-893f-4d91-a96c-9de72214f316 None tempest-ImageQuotaTest-436142237-system-admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:20.376138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:20.376939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:20.377276 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:20.377612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] PATH_INFO: `/v3/projects/20e7cf41c84447bdb3d7dc172aeb3060` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:20.378915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e7cf41c84447bdb3d7dc172aeb3060)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:20.381274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:20.433595 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e7cf41c84447bdb3d7dc172aeb3060', 'request_id': 'req-3683b718-5e31-42ae-9fcb-1c36d40e890c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.442191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e7cf41c84447bdb3d7dc172aeb3060', 'request_id': 'req-3683b718-5e31-42ae-9fcb-1c36d40e890c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.448103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e7cf41c84447bdb3d7dc172aeb3060', 'request_id': 'req-3683b718-5e31-42ae-9fcb-1c36d40e890c'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.450709 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:20.461481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] The token cache is being invalidate because project 20e7cf41c84447bdb3d7dc172aeb3060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:34:20.461770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.462428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-3683b718-5e31-42ae-9fcb-1c36d40e890c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.463919 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4218/8413] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:34:20 2022] DELETE /identity/v3/projects/20e7cf41c84447bdb3d7dc172aeb3060 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:20.468094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:20.479116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f54125-1b5e-46b0-a2be-11fbb3958f7d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:20.538123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:20.538765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:20.539043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:20.539317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] PATH_INFO: `/v3/users/6ac12f9744c54077aac3ff38180748d6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:20.540465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac12f9744c54077aac3ff38180748d6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:20.542427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:20.600873 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac12f9744c54077aac3ff38180748d6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.617359 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac12f9744c54077aac3ff38180748d6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.626146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac12f9744c54077aac3ff38180748d6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.627306 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:20.636279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac12f9744c54077aac3ff38180748d6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.637535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-06c31355-41ac-4ef2-8445-281fe2b7969a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac12f9744c54077aac3ff38180748d6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:34:20.643559 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4196/8414] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:34:20 2022] DELETE /identity/v3/users/6ac12f9744c54077aac3ff38180748d6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:20.651294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fde35-2021-4f7b-aaa7-616d728462a8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:20.651587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fde35-2021-4f7b-aaa7-616d728462a8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:20.651894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fde35-2021-4f7b-aaa7-616d728462a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:20.672044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-301fde35-2021-4f7b-aaa7-616d728462a8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:20.673295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-301fde35-2021-4f7b-aaa7-616d728462a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:20.733096 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4219/8415] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:20.741567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd2df-d923-4505-b37e-0760d556b9f7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:20.741862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd2df-d923-4505-b37e-0760d556b9f7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:20.742147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd2df-d923-4505-b37e-0760d556b9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:20.762851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2e2dd2df-d923-4505-b37e-0760d556b9f7 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:20.764077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2e2dd2df-d923-4505-b37e-0760d556b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:20.772045 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4197/8416] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:20.776256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fde35-2021-4f7b-aaa7-616d728462a8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:20.786309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fde35-2021-4f7b-aaa7-616d728462a8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:20.791046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12bf7-6a07-44c7-934d-ecde83355958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:20.791644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12bf7-6a07-44c7-934d-ecde83355958 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:20.791926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12bf7-6a07-44c7-934d-ecde83355958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:20.792203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12bf7-6a07-44c7-934d-ecde83355958 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:20.793507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a12bf7-6a07-44c7-934d-ecde83355958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:34:20.793811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a12bf7-6a07-44c7-934d-ecde83355958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:20.795427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a12bf7-6a07-44c7-934d-ecde83355958 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:20.807220 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4220/8417] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:34:20.812467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dd2df-d923-4505-b37e-0760d556b9f7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:20.823078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dd2df-d923-4505-b37e-0760d556b9f7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:20.828765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23cb83-41b2-4242-8792-5943bfa7e494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:20.829390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23cb83-41b2-4242-8792-5943bfa7e494 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:20.829676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23cb83-41b2-4242-8792-5943bfa7e494 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:20.830041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23cb83-41b2-4242-8792-5943bfa7e494 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:20.830684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23cb83-41b2-4242-8792-5943bfa7e494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:20.832597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23cb83-41b2-4242-8792-5943bfa7e494 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:20.869727 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4198/8418] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:34:20 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:34:20.874803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12bf7-6a07-44c7-934d-ecde83355958 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:20.885304 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12bf7-6a07-44c7-934d-ecde83355958 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:20.945586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b33b6-a201-4be1-937b-66e9b69e8b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:20.946196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b33b6-a201-4be1-937b-66e9b69e8b07 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:20.946479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b33b6-a201-4be1-937b-66e9b69e8b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:20.946752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b33b6-a201-4be1-937b-66e9b69e8b07 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:20.947397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b33b6-a201-4be1-937b-66e9b69e8b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:20.949462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b33b6-a201-4be1-937b-66e9b69e8b07 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:20.970055 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4221/8419] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:34:20 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:34:20.974149 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23cb83-41b2-4242-8792-5943bfa7e494 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:20.985064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23cb83-41b2-4242-8792-5943bfa7e494 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:20.989778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c8e49-34cd-4e7e-8e61-44020fe411f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:20.990382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c8e49-34cd-4e7e-8e61-44020fe411f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:20.990665 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c8e49-34cd-4e7e-8e61-44020fe411f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:20.990942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c8e49-34cd-4e7e-8e61-44020fe411f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:20.991583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c8e49-34cd-4e7e-8e61-44020fe411f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:20.993230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c8e49-34cd-4e7e-8e61-44020fe411f4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:21.007181 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4199/8420] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:34:21.008890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b33b6-a201-4be1-937b-66e9b69e8b07 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:21.019688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b33b6-a201-4be1-937b-66e9b69e8b07 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:21.024308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192ab80-58b8-4e4d-a921-96dec1930f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:21.024940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192ab80-58b8-4e4d-a921-96dec1930f99 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:21.025220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192ab80-58b8-4e4d-a921-96dec1930f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:21.025495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192ab80-58b8-4e4d-a921-96dec1930f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:21.026136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192ab80-58b8-4e4d-a921-96dec1930f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:21.028655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192ab80-58b8-4e4d-a921-96dec1930f99 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:21.038551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4222/8421] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:34:21.043247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c8e49-34cd-4e7e-8e61-44020fe411f4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:21.053940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c8e49-34cd-4e7e-8e61-44020fe411f4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:21.059085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143fc54-02b1-4947-b72d-3fa52ebf9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:21.059771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143fc54-02b1-4947-b72d-3fa52ebf9223 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:21.060057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143fc54-02b1-4947-b72d-3fa52ebf9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:21.060363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143fc54-02b1-4947-b72d-3fa52ebf9223 admin admin] PATH_INFO: `/v3/projects/9c8a6e501b284d1bafc463395f521af2/users/c05a2a0da15d4138ac68c45a9ef46d01/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:21.075472 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143fc54-02b1-4947-b72d-3fa52ebf9223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8a6e501b284d1bafc463395f521af2, user_id=c05a2a0da15d4138ac68c45a9ef46d01, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:21.078198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143fc54-02b1-4947-b72d-3fa52ebf9223 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:21.094465 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4200/8422] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:34:21 2022] PUT /identity/v3/projects/9c8a6e501b284d1bafc463395f521af2/users/c05a2a0da15d4138ac68c45a9ef46d01/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:21.099479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535995e-3358-4891-aac1-2c00bb406e90 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:21.099767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535995e-3358-4891-aac1-2c00bb406e90 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:21.100042 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535995e-3358-4891-aac1-2c00bb406e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:21.120389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a535995e-3358-4891-aac1-2c00bb406e90 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:21.122073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a535995e-3358-4891-aac1-2c00bb406e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:21.181009 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4223/8423] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:21.190984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143fc54-02b1-4947-b72d-3fa52ebf9223 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:21.192955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f143fc54-02b1-4947-b72d-3fa52ebf9223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:21.249690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143fc54-02b1-4947-b72d-3fa52ebf9223 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:21.253346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1287b-596d-444e-ab60-e09038e48d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:21.253946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1287b-596d-444e-ab60-e09038e48d09 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:21.254222 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1287b-596d-444e-ab60-e09038e48d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:21.254492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1287b-596d-444e-ab60-e09038e48d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:21.263616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1287b-596d-444e-ab60-e09038e48d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:21.265071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1287b-596d-444e-ab60-e09038e48d09 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:21.274275 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4201/8424] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:34:25.426379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35202bbf-eab9-44b2-88d0-12de13a2b5e4 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:25.426946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35202bbf-eab9-44b2-88d0-12de13a2b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:25.426946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35202bbf-eab9-44b2-88d0-12de13a2b5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:25.435224 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:25.459134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-35202bbf-eab9-44b2-88d0-12de13a2b5e4 None None] MFA Rules not processed for user `c05a2a0da15d4138ac68c45a9ef46d01`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:25.460651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-35202bbf-eab9-44b2-88d0-12de13a2b5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:25.542190 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4224/8425] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:25.546998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1287b-596d-444e-ab60-e09038e48d09 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:25.558842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1287b-596d-444e-ab60-e09038e48d09 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:25.564250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0cee7-5c0e-4b0c-8b6c-e43377dd988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:25.564935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0cee7-5c0e-4b0c-8b6c-e43377dd988e admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:25.565221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0cee7-5c0e-4b0c-8b6c-e43377dd988e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:25.565493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0cee7-5c0e-4b0c-8b6c-e43377dd988e admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:25.566404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0cee7-5c0e-4b0c-8b6c-e43377dd988e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:25.568323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0cee7-5c0e-4b0c-8b6c-e43377dd988e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:25.615118 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4202/8426] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:34:25 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:34:25.619149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35202bbf-eab9-44b2-88d0-12de13a2b5e4 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:25.632453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35202bbf-eab9-44b2-88d0-12de13a2b5e4 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:25.698293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba25681-f0f7-48f2-b059-8665161093b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:25.699232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba25681-f0f7-48f2-b059-8665161093b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:25.699525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba25681-f0f7-48f2-b059-8665161093b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:25.699805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba25681-f0f7-48f2-b059-8665161093b9 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:25.700459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba25681-f0f7-48f2-b059-8665161093b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:25.702444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba25681-f0f7-48f2-b059-8665161093b9 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:25.725130 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4225/8427] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:34:25 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:34:25.729037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0cee7-5c0e-4b0c-8b6c-e43377dd988e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:25.740442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0cee7-5c0e-4b0c-8b6c-e43377dd988e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:25.745253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d93aaa-b5b7-4f49-93be-d0722d8f4638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:25.746110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d93aaa-b5b7-4f49-93be-d0722d8f4638 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:25.746491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d93aaa-b5b7-4f49-93be-d0722d8f4638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:25.746773 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d93aaa-b5b7-4f49-93be-d0722d8f4638 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:25.747617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d93aaa-b5b7-4f49-93be-d0722d8f4638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:25.749293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d93aaa-b5b7-4f49-93be-d0722d8f4638 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:25.760732 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4203/8428] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:34:25.765536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba25681-f0f7-48f2-b059-8665161093b9 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:25.778438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba25681-f0f7-48f2-b059-8665161093b9 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:25.783050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bab50-b35d-4b7d-875e-809a57b321da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:25.783730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bab50-b35d-4b7d-875e-809a57b321da admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:25.784007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bab50-b35d-4b7d-875e-809a57b321da admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:25.784277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bab50-b35d-4b7d-875e-809a57b321da admin admin] PATH_INFO: `/v3/projects/7cee5e7afe1c49c4a09555adbca4bebf/users/1356b43105d54fdaae8d87300a0df537/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:25.800242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bab50-b35d-4b7d-875e-809a57b321da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cee5e7afe1c49c4a09555adbca4bebf, user_id=1356b43105d54fdaae8d87300a0df537, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:25.802930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bab50-b35d-4b7d-875e-809a57b321da admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:25.818397 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4226/8429] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:34:25 2022] PUT /identity/v3/projects/7cee5e7afe1c49c4a09555adbca4bebf/users/1356b43105d54fdaae8d87300a0df537/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:25.822110 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d93aaa-b5b7-4f49-93be-d0722d8f4638 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:25.832817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d93aaa-b5b7-4f49-93be-d0722d8f4638 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:25.880919 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:25.895935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a777516-2440-4590-a6be-99e706afdd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:25.896562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a777516-2440-4590-a6be-99e706afdd8a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:25.896877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a777516-2440-4590-a6be-99e706afdd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:25.897161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a777516-2440-4590-a6be-99e706afdd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:25.897807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a777516-2440-4590-a6be-99e706afdd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:25.899516 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a777516-2440-4590-a6be-99e706afdd8a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:25.910437 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4204/8430] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:34:25.914542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bab50-b35d-4b7d-875e-809a57b321da admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:25.926064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bab50-b35d-4b7d-875e-809a57b321da admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:25.931226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683996f-c4c0-47f2-b018-6c6c0dc492e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:25.932009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683996f-c4c0-47f2-b018-6c6c0dc492e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:25.932159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683996f-c4c0-47f2-b018-6c6c0dc492e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:25.932433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683996f-c4c0-47f2-b018-6c6c0dc492e7 admin admin] PATH_INFO: `/v3/projects/7cee5e7afe1c49c4a09555adbca4bebf/users/1356b43105d54fdaae8d87300a0df537/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:25.934781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683996f-c4c0-47f2-b018-6c6c0dc492e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cee5e7afe1c49c4a09555adbca4bebf, user_id=1356b43105d54fdaae8d87300a0df537, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:25.937542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683996f-c4c0-47f2-b018-6c6c0dc492e7 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:25.948512 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4227/8431] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:34:25 2022] PUT /identity/v3/projects/7cee5e7afe1c49c4a09555adbca4bebf/users/1356b43105d54fdaae8d87300a0df537/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:34:30.692412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f645529-f9a8-45a2-865b-0a60f0878d74 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:30.693094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f645529-f9a8-45a2-865b-0a60f0878d74 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:30.693094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f645529-f9a8-45a2-865b-0a60f0878d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:30.728853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9f645529-f9a8-45a2-865b-0a60f0878d74 None None] MFA Rules not processed for user `1356b43105d54fdaae8d87300a0df537`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:30.731137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9f645529-f9a8-45a2-865b-0a60f0878d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:30.815787 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4205/8432] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:30.827819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bdb3a-599b-49ad-a59c-569216c4f460 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:30.828290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bdb3a-599b-49ad-a59c-569216c4f460 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:30.828403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bdb3a-599b-49ad-a59c-569216c4f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:30.869637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1d4bdb3a-599b-49ad-a59c-569216c4f460 None None] MFA Rules not processed for user `6eb751f44d3b4fb3b49a0084e76176d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:30.871103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1d4bdb3a-599b-49ad-a59c-569216c4f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:30.898894 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:30.927910 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4228/8433] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Oct 19 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:30.934675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f645529-f9a8-45a2-865b-0a60f0878d74 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:30.944295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f645529-f9a8-45a2-865b-0a60f0878d74 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:30.948033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726aa69-65cc-4ed3-a4a7-9a6e9d0d2c02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:30.949095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726aa69-65cc-4ed3-a4a7-9a6e9d0d2c02 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:30.949095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726aa69-65cc-4ed3-a4a7-9a6e9d0d2c02 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:30.949482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726aa69-65cc-4ed3-a4a7-9a6e9d0d2c02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:31.007280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726aa69-65cc-4ed3-a4a7-9a6e9d0d2c02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:31.008818 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726aa69-65cc-4ed3-a4a7-9a6e9d0d2c02 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:31.017857 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4206/8434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:34:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:34:40.921920 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:41.013778 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=70 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:34:52.858125 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcf25c-4e73-4b90-834e-071dd593e563 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:52.858506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcf25c-4e73-4b90-834e-071dd593e563 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:52.858667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcf25c-4e73-4b90-834e-071dd593e563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:52.909113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3ebcf25c-4e73-4b90-834e-071dd593e563 None None] MFA Rules not processed for user `54b7394a5d944639b1253d5d54b688e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:34:52.910315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3ebcf25c-4e73-4b90-834e-071dd593e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:34:52.983546 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4229/8435] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Oct 19 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:34:52.990042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726aa69-65cc-4ed3-a4a7-9a6e9d0d2c02 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:34:53.001612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726aa69-65cc-4ed3-a4a7-9a6e9d0d2c02 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:34:53.006594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e542472-283b-435d-a3e1-c88760be6862 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:34:53.007191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e542472-283b-435d-a3e1-c88760be6862 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:34:53.007505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e542472-283b-435d-a3e1-c88760be6862 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:34:53.007784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e542472-283b-435d-a3e1-c88760be6862 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:34:53.016328 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e542472-283b-435d-a3e1-c88760be6862 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:34:53.017951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e542472-283b-435d-a3e1-c88760be6862 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:34:53.026049 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4207/8436] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:34:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 01:35:02.980613 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=44 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:35:03.022762 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:20.598354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94691d-dc27-41f3-97a8-67fb91439d12 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:36:20.598858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94691d-dc27-41f3-97a8-67fb91439d12 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:36:20.598963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94691d-dc27-41f3-97a8-67fb91439d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:36:20.618389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8b94691d-dc27-41f3-97a8-67fb91439d12 None None] MFA Rules not processed for user `c05a2a0da15d4138ac68c45a9ef46d01`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:36:20.619582 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8b94691d-dc27-41f3-97a8-67fb91439d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:36:20.627030 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4230/8437] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:36:20.675791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f6814-35ce-42cb-96af-93b523e60053 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:36:20.676254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f6814-35ce-42cb-96af-93b523e60053 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:36:20.676371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f6814-35ce-42cb-96af-93b523e60053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:36:20.716535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-767f6814-35ce-42cb-96af-93b523e60053 None None] MFA Rules not processed for user `5f3c0c082e3044b283bfeb58543d088c`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:36:20.717814 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-767f6814-35ce-42cb-96af-93b523e60053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:36:20.768642 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4208/8438] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Oct 19 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:36:20.774906 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94691d-dc27-41f3-97a8-67fb91439d12 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:36:20.784504 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94691d-dc27-41f3-97a8-67fb91439d12 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:36:20.788120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10704a-ec45-4720-bb61-169bd7838661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:36:20.788761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10704a-ec45-4720-bb61-169bd7838661 service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:36:20.789090 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10704a-ec45-4720-bb61-169bd7838661 service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:36:20.789367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10704a-ec45-4720-bb61-169bd7838661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:36:20.791148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5d10704a-ec45-4720-bb61-169bd7838661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:36:20.878716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10704a-ec45-4720-bb61-169bd7838661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:36:20.880143 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10704a-ec45-4720-bb61-169bd7838661 service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:36:20.894600 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4231/8439] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:36:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:36:21.179537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f6814-35ce-42cb-96af-93b523e60053 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:36:21.235426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f6814-35ce-42cb-96af-93b523e60053 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:36:21.239058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2c6b-c6e2-45bd-8a72-b1218934ea58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:36:21.239670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2c6b-c6e2-45bd-8a72-b1218934ea58 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:36:21.239937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2c6b-c6e2-45bd-8a72-b1218934ea58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:36:21.240212 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2c6b-c6e2-45bd-8a72-b1218934ea58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:36:21.241980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9abd2c6b-c6e2-45bd-8a72-b1218934ea58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:36:21.254387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2c6b-c6e2-45bd-8a72-b1218934ea58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:36:21.255806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2c6b-c6e2-45bd-8a72-b1218934ea58 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:36:21.266280 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4209/8440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:36:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:36:21.732800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10704a-ec45-4720-bb61-169bd7838661 service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:36:21.742461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10704a-ec45-4720-bb61-169bd7838661 service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:36:21.746642 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:36:21.747278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:36:21.747561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:36:21.747832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:36:21.749563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:36:21.766308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:36:21.767764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:36:21.782390 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4232/8441] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:36:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:36:31.260179 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=55 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:31.774388 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=48 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:40.936052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2c6b-c6e2-45bd-8a72-b1218934ea58 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:36:40.945078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2c6b-c6e2-45bd-8a72-b1218934ea58 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:36:40.948837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40da08-47e7-4e8b-958f-59c8d394736c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:36:40.949460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40da08-47e7-4e8b-958f-59c8d394736c service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:36:40.949744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40da08-47e7-4e8b-958f-59c8d394736c service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:36:40.950019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40da08-47e7-4e8b-958f-59c8d394736c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:36:40.959190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40da08-47e7-4e8b-958f-59c8d394736c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:36:40.960707 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40da08-47e7-4e8b-958f-59c8d394736c service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:36:40.970282 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4210/8442] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:36:50.966054 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:23.154266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:23.155930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:23.232554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6bb25-2736-4910-8368-455df04e1af5 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:23.237699 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862fbcc-08ee-47c0-8bdb-6e657b864146 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:23.238326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862fbcc-08ee-47c0-8bdb-6e657b864146 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:23.238584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862fbcc-08ee-47c0-8bdb-6e657b864146 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:23.238856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862fbcc-08ee-47c0-8bdb-6e657b864146 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:23.240646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8862fbcc-08ee-47c0-8bdb-6e657b864146 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:23.254793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862fbcc-08ee-47c0-8bdb-6e657b864146 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:23.256407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862fbcc-08ee-47c0-8bdb-6e657b864146 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:23.269202 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4233/8443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:37:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:37:33.262244 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=32 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:37.407507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40da08-47e7-4e8b-958f-59c8d394736c service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:37.409714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd40da08-47e7-4e8b-958f-59c8d394736c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:37.435866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40da08-47e7-4e8b-958f-59c8d394736c service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:37.441088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc0c74-b2e7-40ce-a938-1701f81c4c58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:37.441698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc0c74-b2e7-40ce-a938-1701f81c4c58 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:37.442442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc0c74-b2e7-40ce-a938-1701f81c4c58 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:37.443399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc0c74-b2e7-40ce-a938-1701f81c4c58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:37.445425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ccdc0c74-b2e7-40ce-a938-1701f81c4c58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:37.459892 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc0c74-b2e7-40ce-a938-1701f81c4c58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:37.461562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc0c74-b2e7-40ce-a938-1701f81c4c58 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:37.474781 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4211/8444] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:37:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:37:38.255456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862fbcc-08ee-47c0-8bdb-6e657b864146 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:38.326109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862fbcc-08ee-47c0-8bdb-6e657b864146 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:38.330605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:38.331231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:38.331508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:38.331784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] PATH_INFO: `/v3/users/c05a2a0da15d4138ac68c45a9ef46d01` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:38.333790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c05a2a0da15d4138ac68c45a9ef46d01)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:38.335860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:38.381974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c05a2a0da15d4138ac68c45a9ef46d01'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.393740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c05a2a0da15d4138ac68c45a9ef46d01'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.401896 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c05a2a0da15d4138ac68c45a9ef46d01'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.409238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c05a2a0da15d4138ac68c45a9ef46d01'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.409909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c05a2a0da15d4138ac68c45a9ef46d01'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.415996 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4234/8445] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:37:38 2022] DELETE /identity/v3/users/c05a2a0da15d4138ac68c45a9ef46d01 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:37:38.583566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc0c74-b2e7-40ce-a938-1701f81c4c58 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:38.594347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc0c74-b2e7-40ce-a938-1701f81c4c58 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:38.659134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:38.659793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:38.660072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:38.660346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] PATH_INFO: `/v3/projects/9c8a6e501b284d1bafc463395f521af2` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:38.662127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8a6e501b284d1bafc463395f521af2)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:38.664426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:38.718100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8a6e501b284d1bafc463395f521af2', 'request_id': 'req-58003159-fe35-4882-be81-c3e477dd6798'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.727067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8a6e501b284d1bafc463395f521af2', 'request_id': 'req-58003159-fe35-4882-be81-c3e477dd6798'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.733417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8a6e501b284d1bafc463395f521af2', 'request_id': 'req-58003159-fe35-4882-be81-c3e477dd6798'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.746321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] The token cache is being invalidate because project 9c8a6e501b284d1bafc463395f521af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:37:38.746616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.747290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.749058 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4212/8446] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:37:38 2022] DELETE /identity/v3/projects/9c8a6e501b284d1bafc463395f521af2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:37:38.753105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:38.754540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:38.769110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e202-c845-4d6a-9050-ceada2c4bb0e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:38.826730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:38.827359 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:38.827636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:38.827909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] PATH_INFO: `/v3/users/1356b43105d54fdaae8d87300a0df537` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:38.829067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1356b43105d54fdaae8d87300a0df537)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:38.830988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:38.853465 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:38.881701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1356b43105d54fdaae8d87300a0df537'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.893715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1356b43105d54fdaae8d87300a0df537'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.904464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1356b43105d54fdaae8d87300a0df537'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.912419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1356b43105d54fdaae8d87300a0df537'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.913071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-0b00ecde-29fe-462d-a240-f174de83c5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1356b43105d54fdaae8d87300a0df537'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:38.918870 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4235/8447] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:37:38 2022] DELETE /identity/v3/users/1356b43105d54fdaae8d87300a0df537 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:37:39.093800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:39.095428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:39.109860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58003159-fe35-4882-be81-c3e477dd6798 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:39.168454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:39.169114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.169394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.169668 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] PATH_INFO: `/v3/projects/7cee5e7afe1c49c4a09555adbca4bebf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.170762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cee5e7afe1c49c4a09555adbca4bebf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:39.172681 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:39.194437 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:39.222267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cee5e7afe1c49c4a09555adbca4bebf', 'request_id': 'req-a0587639-202c-49fc-8bc3-7923ef3a4b0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:39.229687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cee5e7afe1c49c4a09555adbca4bebf', 'request_id': 'req-a0587639-202c-49fc-8bc3-7923ef3a4b0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:39.235269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cee5e7afe1c49c4a09555adbca4bebf', 'request_id': 'req-a0587639-202c-49fc-8bc3-7923ef3a4b0b'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:39.246921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] The token cache is being invalidate because project 7cee5e7afe1c49c4a09555adbca4bebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:37:39.247209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:39.247842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-a0587639-202c-49fc-8bc3-7923ef3a4b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:37:39.249364 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4213/8448] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:37:39 2022] DELETE /identity/v3/projects/7cee5e7afe1c49c4a09555adbca4bebf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:37:39.254541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d929b2-7bc7-4725-9a7a-4b3cd07d1f25 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.255367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d929b2-7bc7-4725-9a7a-4b3cd07d1f25 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.255799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d929b2-7bc7-4725-9a7a-4b3cd07d1f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.276333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-57d929b2-7bc7-4725-9a7a-4b3cd07d1f25 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:37:39.277545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-57d929b2-7bc7-4725-9a7a-4b3cd07d1f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:39.337524 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4236/8449] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:37:39.346085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0f1bb-29e8-42b3-9343-68ea0a77d342 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.346374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0f1bb-29e8-42b3-9343-68ea0a77d342 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.346649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0f1bb-29e8-42b3-9343-68ea0a77d342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.366454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d3a0f1bb-29e8-42b3-9343-68ea0a77d342 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:37:39.367664 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d3a0f1bb-29e8-42b3-9343-68ea0a77d342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:39.375872 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4214/8450] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:37:39.380643 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d929b2-7bc7-4725-9a7a-4b3cd07d1f25 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:39.390544 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d929b2-7bc7-4725-9a7a-4b3cd07d1f25 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:39.395249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c57518-a796-4e66-82b6-e2bcbfeb2a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:39.396449 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c57518-a796-4e66-82b6-e2bcbfeb2a4f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.396756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c57518-a796-4e66-82b6-e2bcbfeb2a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.397060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c57518-a796-4e66-82b6-e2bcbfeb2a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.397739 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c57518-a796-4e66-82b6-e2bcbfeb2a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:37:39.398044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c57518-a796-4e66-82b6-e2bcbfeb2a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:39.399647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c57518-a796-4e66-82b6-e2bcbfeb2a4f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:39.411304 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4237/8451] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:37:39.415816 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0f1bb-29e8-42b3-9343-68ea0a77d342 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:39.425192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0f1bb-29e8-42b3-9343-68ea0a77d342 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:39.430123 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4915174-5b7e-45a6-bb33-5ba03cf75243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:39.430717 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4915174-5b7e-45a6-bb33-5ba03cf75243 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.431003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4915174-5b7e-45a6-bb33-5ba03cf75243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.431277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4915174-5b7e-45a6-bb33-5ba03cf75243 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.431902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4915174-5b7e-45a6-bb33-5ba03cf75243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:39.433838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4915174-5b7e-45a6-bb33-5ba03cf75243 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:39.463083 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4215/8452] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:37:39 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:37:39.467268 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c57518-a796-4e66-82b6-e2bcbfeb2a4f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:39.478864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c57518-a796-4e66-82b6-e2bcbfeb2a4f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:39.538831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3716151-a1dc-4ad7-b53d-92cc8eb9ec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:39.539358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3716151-a1dc-4ad7-b53d-92cc8eb9ec24 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.539639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3716151-a1dc-4ad7-b53d-92cc8eb9ec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.539913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3716151-a1dc-4ad7-b53d-92cc8eb9ec24 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.540556 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3716151-a1dc-4ad7-b53d-92cc8eb9ec24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:39.542515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3716151-a1dc-4ad7-b53d-92cc8eb9ec24 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:39.564713 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4238/8453] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:37:39 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:37:39.570152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4915174-5b7e-45a6-bb33-5ba03cf75243 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:39.580962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4915174-5b7e-45a6-bb33-5ba03cf75243 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:39.585998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e29f6-dadb-4bdf-9fe3-9826a33f84ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:39.586618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e29f6-dadb-4bdf-9fe3-9826a33f84ea admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.586927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e29f6-dadb-4bdf-9fe3-9826a33f84ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.587207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e29f6-dadb-4bdf-9fe3-9826a33f84ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.587853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e29f6-dadb-4bdf-9fe3-9826a33f84ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:39.589495 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e29f6-dadb-4bdf-9fe3-9826a33f84ea admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:39.600673 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4216/8454] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:37:39.604758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3716151-a1dc-4ad7-b53d-92cc8eb9ec24 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:39.616513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3716151-a1dc-4ad7-b53d-92cc8eb9ec24 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:39.622481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df73e36-7aaa-4686-b11e-3f68a87b3918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:39.623172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df73e36-7aaa-4686-b11e-3f68a87b3918 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.623452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df73e36-7aaa-4686-b11e-3f68a87b3918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.623720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df73e36-7aaa-4686-b11e-3f68a87b3918 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.624360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df73e36-7aaa-4686-b11e-3f68a87b3918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:39.626014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df73e36-7aaa-4686-b11e-3f68a87b3918 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:39.637487 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4239/8455] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:37:39.641800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e29f6-dadb-4bdf-9fe3-9826a33f84ea admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:39.652007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e29f6-dadb-4bdf-9fe3-9826a33f84ea admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:39.656758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c51b0-4766-4569-a978-0b38abf7ac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:39.657523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c51b0-4766-4569-a978-0b38abf7ac54 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.657880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c51b0-4766-4569-a978-0b38abf7ac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.658243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c51b0-4766-4569-a978-0b38abf7ac54 admin admin] PATH_INFO: `/v3/projects/034b5ba57eb7442e860a47761dfd8471/users/ee07628620204cd485da142cf386e51f/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.674760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c51b0-4766-4569-a978-0b38abf7ac54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=034b5ba57eb7442e860a47761dfd8471, user_id=ee07628620204cd485da142cf386e51f, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:39.678128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c51b0-4766-4569-a978-0b38abf7ac54 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:39.691780 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4217/8456] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:37:39 2022] PUT /identity/v3/projects/034b5ba57eb7442e860a47761dfd8471/users/ee07628620204cd485da142cf386e51f/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:37:39.697727 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7ca84-ade6-4a9e-a50e-d60e2d7faf77 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.698014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7ca84-ade6-4a9e-a50e-d60e2d7faf77 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.698288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7ca84-ade6-4a9e-a50e-d60e2d7faf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.706443 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:39.718949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-65f7ca84-ade6-4a9e-a50e-d60e2d7faf77 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:37:39.720205 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-65f7ca84-ade6-4a9e-a50e-d60e2d7faf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:39.779560 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4240/8457] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:37:39.789454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c51b0-4766-4569-a978-0b38abf7ac54 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:39.791114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f56c51b0-4766-4569-a978-0b38abf7ac54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:39.848705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c51b0-4766-4569-a978-0b38abf7ac54 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:39.852407 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8584b48-4a96-4ab4-a803-e7ec11abe3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:39.853041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8584b48-4a96-4ab4-a803-e7ec11abe3fd service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:39.853327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8584b48-4a96-4ab4-a803-e7ec11abe3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:39.853608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8584b48-4a96-4ab4-a803-e7ec11abe3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:39.862613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8584b48-4a96-4ab4-a803-e7ec11abe3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:39.864678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8584b48-4a96-4ab4-a803-e7ec11abe3fd service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:39.874096 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4218/8458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:37:43.901489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7976d-91b4-4d60-b4db-7b6b2ab9ae95 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:43.901980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7976d-91b4-4d60-b4db-7b6b2ab9ae95 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:43.902093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7976d-91b4-4d60-b4db-7b6b2ab9ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:43.932307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c3e7976d-91b4-4d60-b4db-7b6b2ab9ae95 None None] MFA Rules not processed for user `ee07628620204cd485da142cf386e51f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:37:43.933503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c3e7976d-91b4-4d60-b4db-7b6b2ab9ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:44.004668 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4241/8459] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:37:44.009096 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8584b48-4a96-4ab4-a803-e7ec11abe3fd service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:44.018889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8584b48-4a96-4ab4-a803-e7ec11abe3fd service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:44.024090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79496999-912b-4cf3-b128-a8bda8c18d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:44.024731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79496999-912b-4cf3-b128-a8bda8c18d3d admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:44.025015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79496999-912b-4cf3-b128-a8bda8c18d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:44.025286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79496999-912b-4cf3-b128-a8bda8c18d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:44.025917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79496999-912b-4cf3-b128-a8bda8c18d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:44.027807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79496999-912b-4cf3-b128-a8bda8c18d3d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:44.066162 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4219/8460] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:37:44 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:37:44.071149 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7976d-91b4-4d60-b4db-7b6b2ab9ae95 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:44.084514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7976d-91b4-4d60-b4db-7b6b2ab9ae95 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:44.151463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd7f06-a543-41fa-826c-bff879b5403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:44.152095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd7f06-a543-41fa-826c-bff879b5403e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:44.152373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd7f06-a543-41fa-826c-bff879b5403e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:44.152682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd7f06-a543-41fa-826c-bff879b5403e admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:44.153338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd7f06-a543-41fa-826c-bff879b5403e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:44.155291 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd7f06-a543-41fa-826c-bff879b5403e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:44.178269 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4242/8461] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:37:44 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:37:44.182206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79496999-912b-4cf3-b128-a8bda8c18d3d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:44.193947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79496999-912b-4cf3-b128-a8bda8c18d3d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:44.198795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868a111-db48-4db6-9d5d-37df7861212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:44.199523 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868a111-db48-4db6-9d5d-37df7861212a admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:44.199887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868a111-db48-4db6-9d5d-37df7861212a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:44.200229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868a111-db48-4db6-9d5d-37df7861212a admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:44.201140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868a111-db48-4db6-9d5d-37df7861212a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:44.202746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868a111-db48-4db6-9d5d-37df7861212a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:44.215179 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4220/8462] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:37:44.219399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd7f06-a543-41fa-826c-bff879b5403e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:44.230884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd7f06-a543-41fa-826c-bff879b5403e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:44.235660 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc98b7-2857-4e59-bba4-de76a159fd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:44.236318 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc98b7-2857-4e59-bba4-de76a159fd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:44.236605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc98b7-2857-4e59-bba4-de76a159fd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:44.236920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc98b7-2857-4e59-bba4-de76a159fd27 admin admin] PATH_INFO: `/v3/projects/40c2d3df69094316a3b493d8c074c915/users/ea08a4c308d440ce8a398b72ebcae09d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:44.252557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc98b7-2857-4e59-bba4-de76a159fd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c2d3df69094316a3b493d8c074c915, user_id=ea08a4c308d440ce8a398b72ebcae09d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:44.255914 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc98b7-2857-4e59-bba4-de76a159fd27 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:44.265057 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:44.270704 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4243/8463] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:37:44 2022] PUT /identity/v3/projects/40c2d3df69094316a3b493d8c074c915/users/ea08a4c308d440ce8a398b72ebcae09d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:37:44.274882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868a111-db48-4db6-9d5d-37df7861212a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:44.285592 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868a111-db48-4db6-9d5d-37df7861212a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:44.295845 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:44.361223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ffdb3-5070-4a36-a58d-fd9332d3465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:44.361831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ffdb3-5070-4a36-a58d-fd9332d3465f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:44.362107 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ffdb3-5070-4a36-a58d-fd9332d3465f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:44.362375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ffdb3-5070-4a36-a58d-fd9332d3465f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:44.363009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ffdb3-5070-4a36-a58d-fd9332d3465f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:44.364667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ffdb3-5070-4a36-a58d-fd9332d3465f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:44.376347 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4221/8464] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:37:44.381130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc98b7-2857-4e59-bba4-de76a159fd27 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:44.391864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc98b7-2857-4e59-bba4-de76a159fd27 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:44.398292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7211f50-febf-4b36-9a19-e7bc4ea30f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:44.399095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7211f50-febf-4b36-9a19-e7bc4ea30f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:44.399442 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7211f50-febf-4b36-9a19-e7bc4ea30f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:44.399805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7211f50-febf-4b36-9a19-e7bc4ea30f0e admin admin] PATH_INFO: `/v3/projects/40c2d3df69094316a3b493d8c074c915/users/ea08a4c308d440ce8a398b72ebcae09d/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:44.402350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7211f50-febf-4b36-9a19-e7bc4ea30f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c2d3df69094316a3b493d8c074c915, user_id=ea08a4c308d440ce8a398b72ebcae09d, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:44.405208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7211f50-febf-4b36-9a19-e7bc4ea30f0e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:44.417250 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4244/8465] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:37:44 2022] PUT /identity/v3/projects/40c2d3df69094316a3b493d8c074c915/users/ea08a4c308d440ce8a398b72ebcae09d/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:37:49.130603 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797df5-66e3-4faf-9981-859bf379c89e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:49.131164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797df5-66e3-4faf-9981-859bf379c89e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:49.131417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797df5-66e3-4faf-9981-859bf379c89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:49.165250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-76797df5-66e3-4faf-9981-859bf379c89e None None] MFA Rules not processed for user `ea08a4c308d440ce8a398b72ebcae09d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:37:49.167237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-76797df5-66e3-4faf-9981-859bf379c89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:49.249082 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4222/8466] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:37:49.260740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d5d1-c7da-48c8-9887-fd75d285a3ea None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:49.261137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d5d1-c7da-48c8-9887-fd75d285a3ea None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:49.261297 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d5d1-c7da-48c8-9887-fd75d285a3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:49.282082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8dc9d5d1-c7da-48c8-9887-fd75d285a3ea None None] MFA Rules not processed for user `5f3c0c082e3044b283bfeb58543d088c`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:37:49.283341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8dc9d5d1-c7da-48c8-9887-fd75d285a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:49.350174 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4245/8467] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Oct 19 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:37:49.355986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797df5-66e3-4faf-9981-859bf379c89e None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:49.368891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797df5-66e3-4faf-9981-859bf379c89e None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:49.373703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d57b8-cb52-4594-85be-7faa2b9ee740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:49.374398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d57b8-cb52-4594-85be-7faa2b9ee740 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:49.374781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d57b8-cb52-4594-85be-7faa2b9ee740 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:49.375267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d57b8-cb52-4594-85be-7faa2b9ee740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:49.386115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d57b8-cb52-4594-85be-7faa2b9ee740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:49.387566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d57b8-cb52-4594-85be-7faa2b9ee740 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:49.397860 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4223/8468] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:37:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:37:49.489271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d5d1-c7da-48c8-9887-fd75d285a3ea None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:49.497885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d5d1-c7da-48c8-9887-fd75d285a3ea None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:49.501811 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7dfeb-8c06-4b06-8a26-2b434b216e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:49.502531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7dfeb-8c06-4b06-8a26-2b434b216e9b service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:49.502831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7dfeb-8c06-4b06-8a26-2b434b216e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:49.503091 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7dfeb-8c06-4b06-8a26-2b434b216e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:49.563518 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7dfeb-8c06-4b06-8a26-2b434b216e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:49.565004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7dfeb-8c06-4b06-8a26-2b434b216e9b service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:49.575717 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4246/8469] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:37:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:37:51.103389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d16b1-e81a-4b59-aa45-5921732ad6a7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:51.103909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d16b1-e81a-4b59-aa45-5921732ad6a7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:51.104183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d16b1-e81a-4b59-aa45-5921732ad6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:51.124939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5e8d16b1-e81a-4b59-aa45-5921732ad6a7 None None] MFA Rules not processed for user `ee07628620204cd485da142cf386e51f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:37:51.126209 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5e8d16b1-e81a-4b59-aa45-5921732ad6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:51.134236 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4224/8470] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:37:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:37:53.917562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7dfeb-8c06-4b06-8a26-2b434b216e9b service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:53.919402 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9ad7dfeb-8c06-4b06-8a26-2b434b216e9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:54.012957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7dfeb-8c06-4b06-8a26-2b434b216e9b service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:54.017704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:54.018455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:54.018795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:54.019075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:54.021526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:54.043303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:54.049454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:54.060745 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4247/8471] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:37:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:37:55.228275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d16b1-e81a-4b59-aa45-5921732ad6a7 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:37:55.230972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5e8d16b1-e81a-4b59-aa45-5921732ad6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:55.322728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d16b1-e81a-4b59-aa45-5921732ad6a7 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:37:55.328859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc035b2-4434-4239-9b14-14802821f937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:37:55.329699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc035b2-4434-4239-9b14-14802821f937 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:37:55.329980 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc035b2-4434-4239-9b14-14802821f937 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:37:55.330254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc035b2-4434-4239-9b14-14802821f937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:37:55.332144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6dc035b2-4434-4239-9b14-14802821f937 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:37:55.348672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc035b2-4434-4239-9b14-14802821f937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:37:55.350321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc035b2-4434-4239-9b14-14802821f937 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:37:55.359393 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=100 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:55.367616 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4225/8472] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:37:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:38:04.051251 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=82,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:09.028263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:38:09.029919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:38:09.052014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44213d2-4514-4b50-95ba-6adb1344a6e0 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:38:09.059192 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:38:09.059837 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:38:09.060119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:38:09.060398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:38:09.062185 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:38:09.077685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:38:09.079267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:38:09.095978 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4248/8473] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:38:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:38:19.085430 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:23.759340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69a717-f77b-4506-a4ee-fd2b251f4e8b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:38:23.759879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69a717-f77b-4506-a4ee-fd2b251f4e8b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:38:23.760063 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69a717-f77b-4506-a4ee-fd2b251f4e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:38:23.779863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4a69a717-f77b-4506-a4ee-fd2b251f4e8b None None] MFA Rules not processed for user `ee07628620204cd485da142cf386e51f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:38:23.781147 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4a69a717-f77b-4506-a4ee-fd2b251f4e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:38:23.788259 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4226/8474] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:38:24.505029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:38:24.506483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:38:24.582403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56881e-81c9-4540-9874-bea5bb54e3c2 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:38:24.588400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:38:24.589054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:38:24.589338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:38:24.589614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:38:24.591414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:38:24.603771 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:38:24.605376 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:38:24.615551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4249/8475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:38:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:38:33.774068 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:34.611194 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=32 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:13.112179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2d724-c9b2-4add-ba55-1d4f32d31877 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:39:13.112715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2d724-c9b2-4add-ba55-1d4f32d31877 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:39:13.112842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2d724-c9b2-4add-ba55-1d4f32d31877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:39:13.132329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5cc2d724-c9b2-4add-ba55-1d4f32d31877 None None] MFA Rules not processed for user `ee07628620204cd485da142cf386e51f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:39:13.134127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cc2d724-c9b2-4add-ba55-1d4f32d31877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:39:13.141180 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4227/8476] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:39:13.776974 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:39:13.778471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:39:13.795783 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8749f-276c-4def-bbf6-be669909755a service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:39:13.801141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dacaf-3155-4734-bf63-e657fac314b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:39:13.801755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dacaf-3155-4734-bf63-e657fac314b6 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:39:13.802037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dacaf-3155-4734-bf63-e657fac314b6 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:39:13.802337 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dacaf-3155-4734-bf63-e657fac314b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:39:13.804062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4b3dacaf-3155-4734-bf63-e657fac314b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:39:13.816281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dacaf-3155-4734-bf63-e657fac314b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:39:13.818128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dacaf-3155-4734-bf63-e657fac314b6 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:39:13.829016 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4250/8477] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:39:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:39:23.126984 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:23.824592 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:37.307162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0391aca-2020-48ee-a6f7-25c612905be7 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:39:37.307721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0391aca-2020-48ee-a6f7-25c612905be7 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:39:37.307721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0391aca-2020-48ee-a6f7-25c612905be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:39:37.327289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d0391aca-2020-48ee-a6f7-25c612905be7 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:39:37.328488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d0391aca-2020-48ee-a6f7-25c612905be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:39:37.337144 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4228/8478] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Oct 19 01:39:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:39:37.353898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dacaf-3155-4734-bf63-e657fac314b6 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:39:37.367431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dacaf-3155-4734-bf63-e657fac314b6 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:39:37.372499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2e13f-ba93-4fbb-a69a-82f993e35afa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:39:37.373132 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2e13f-ba93-4fbb-a69a-82f993e35afa service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:39:37.373412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2e13f-ba93-4fbb-a69a-82f993e35afa service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:39:37.373686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2e13f-ba93-4fbb-a69a-82f993e35afa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:39:37.382510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2e13f-ba93-4fbb-a69a-82f993e35afa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:39:37.384116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2e13f-ba93-4fbb-a69a-82f993e35afa service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:39:37.394249 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4251/8479] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:39:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:39:47.321947 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:47.390090 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:11.605436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8144ad-b964-479d-9900-180a04d853d4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:40:11.605978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8144ad-b964-479d-9900-180a04d853d4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:40:11.605978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8144ad-b964-479d-9900-180a04d853d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:40:11.624770 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fd8144ad-b964-479d-9900-180a04d853d4 None None] MFA Rules not processed for user `ee07628620204cd485da142cf386e51f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:40:11.625974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fd8144ad-b964-479d-9900-180a04d853d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:40:11.633354 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4229/8480] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:40:11.894726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2e13f-ba93-4fbb-a69a-82f993e35afa service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:40:11.904992 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2e13f-ba93-4fbb-a69a-82f993e35afa service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:40:11.908506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd0523-d9b6-440a-83f7-8e6cd8afb448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:40:11.909131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd0523-d9b6-440a-83f7-8e6cd8afb448 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:40:11.909409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd0523-d9b6-440a-83f7-8e6cd8afb448 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:40:11.909677 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd0523-d9b6-440a-83f7-8e6cd8afb448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:40:11.911478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-11bd0523-d9b6-440a-83f7-8e6cd8afb448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:40:11.923710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd0523-d9b6-440a-83f7-8e6cd8afb448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:40:11.925172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd0523-d9b6-440a-83f7-8e6cd8afb448 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:40:11.936090 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4252/8481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:40:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:40:21.619456 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:21.930128 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:28.177349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ff212-5596-4461-98ee-24712bd54716 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:40:28.177923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ff212-5596-4461-98ee-24712bd54716 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:40:28.178026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ff212-5596-4461-98ee-24712bd54716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:40:28.198052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e51ff212-5596-4461-98ee-24712bd54716 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:40:28.199260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e51ff212-5596-4461-98ee-24712bd54716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:40:28.207922 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4230/8482] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Oct 19 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:40:28.219374 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71894b4c-15b2-40d8-8678-b7035de30f46 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:40:28.219767 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71894b4c-15b2-40d8-8678-b7035de30f46 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:40:28.219937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71894b4c-15b2-40d8-8678-b7035de30f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:40:28.240731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-71894b4c-15b2-40d8-8678-b7035de30f46 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:40:28.241933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-71894b4c-15b2-40d8-8678-b7035de30f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:40:28.250837 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4253/8483] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:40:28.256742 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ff212-5596-4461-98ee-24712bd54716 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:40:28.267888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ff212-5596-4461-98ee-24712bd54716 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:40:28.272947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917dd0c-08e0-4a11-a3c8-0b073a10552a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:40:28.273544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917dd0c-08e0-4a11-a3c8-0b073a10552a service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:40:28.273821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917dd0c-08e0-4a11-a3c8-0b073a10552a service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:40:28.274094 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917dd0c-08e0-4a11-a3c8-0b073a10552a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:40:28.283343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917dd0c-08e0-4a11-a3c8-0b073a10552a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:40:28.284935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917dd0c-08e0-4a11-a3c8-0b073a10552a service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:40:28.294436 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4231/8484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:40:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:40:31.137565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d550e-7245-42d2-aa95-4e3fb7e43666 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:40:31.138050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d550e-7245-42d2-aa95-4e3fb7e43666 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:40:31.138242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d550e-7245-42d2-aa95-4e3fb7e43666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:40:31.188928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-569d550e-7245-42d2-aa95-4e3fb7e43666 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:40:31.190162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-569d550e-7245-42d2-aa95-4e3fb7e43666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:40:31.255729 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4254/8485] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:40:31.309703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917dd0c-08e0-4a11-a3c8-0b073a10552a service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:40:31.311135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3917dd0c-08e0-4a11-a3c8-0b073a10552a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:40:31.382333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917dd0c-08e0-4a11-a3c8-0b073a10552a service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:40:31.388353 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf76393-4e37-4771-9574-c539fed158f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:40:31.388984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf76393-4e37-4771-9574-c539fed158f5 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:40:31.389349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf76393-4e37-4771-9574-c539fed158f5 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:40:31.389631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf76393-4e37-4771-9574-c539fed158f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:40:31.398376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf76393-4e37-4771-9574-c539fed158f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:40:31.400598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf76393-4e37-4771-9574-c539fed158f5 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:40:31.409374 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4232/8486] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:40:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:40:32.685200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff0735-502e-4a22-be44-bf9c856eb0e1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:40:32.685700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff0735-502e-4a22-be44-bf9c856eb0e1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:40:32.685816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff0735-502e-4a22-be44-bf9c856eb0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:40:32.705068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-18ff0735-502e-4a22-be44-bf9c856eb0e1 None None] MFA Rules not processed for user `ee07628620204cd485da142cf386e51f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:40:32.706277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-18ff0735-502e-4a22-be44-bf9c856eb0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:40:32.713465 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4255/8487] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:40:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:40:35.103351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf76393-4e37-4771-9574-c539fed158f5 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:40:35.114902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf76393-4e37-4771-9574-c539fed158f5 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:40:35.119121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92601f9f-7cdd-44c2-af54-fab68882c790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:40:35.120769 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92601f9f-7cdd-44c2-af54-fab68882c790 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:40:35.121349 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92601f9f-7cdd-44c2-af54-fab68882c790 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:40:35.121766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92601f9f-7cdd-44c2-af54-fab68882c790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:40:35.124053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-92601f9f-7cdd-44c2-af54-fab68882c790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:40:35.139930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92601f9f-7cdd-44c2-af54-fab68882c790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:40:35.142755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92601f9f-7cdd-44c2-af54-fab68882c790 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:40:35.158632 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4233/8488] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:40:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:40:42.700238 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=46 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:45.149141 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=47 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:24.453851 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd64f-150d-4f4e-9200-1af9c1f61f48 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:24.454398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd64f-150d-4f4e-9200-1af9c1f61f48 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:24.454752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd64f-150d-4f4e-9200-1af9c1f61f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:24.474543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-729bd64f-150d-4f4e-9200-1af9c1f61f48 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:41:24.475864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-729bd64f-150d-4f4e-9200-1af9c1f61f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:41:24.483232 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4256/8489] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 01:41:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:41:24.496095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92601f9f-7cdd-44c2-af54-fab68882c790 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:41:24.508866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92601f9f-7cdd-44c2-af54-fab68882c790 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:41:24.513972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b0f21-08af-4273-8536-fe44affdc0ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:41:24.514577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b0f21-08af-4273-8536-fe44affdc0ba service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:24.514857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b0f21-08af-4273-8536-fe44affdc0ba service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:24.515130 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b0f21-08af-4273-8536-fe44affdc0ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:24.524068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b0f21-08af-4273-8536-fe44affdc0ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:41:24.525784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b0f21-08af-4273-8536-fe44affdc0ba service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:41:24.534314 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4234/8490] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 01:41:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 01:41:34.469185 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:34.531232 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:41.109663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c26f3-ca06-4a62-bf71-7ef71f1a71f7 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:41.110153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c26f3-ca06-4a62-bf71-7ef71f1a71f7 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:41.110266 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c26f3-ca06-4a62-bf71-7ef71f1a71f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:41.129480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-0c6c26f3-ca06-4a62-bf71-7ef71f1a71f7 None None] MFA Rules not processed for user `ee07628620204cd485da142cf386e51f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:41:41.130668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0c6c26f3-ca06-4a62-bf71-7ef71f1a71f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:41:41.150966 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4257/8491] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:41:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:41:41.193111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b0f21-08af-4273-8536-fe44affdc0ba service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:41:41.212558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b0f21-08af-4273-8536-fe44affdc0ba service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:41:41.216253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476df787-f0fd-4c04-b3f6-d89946026c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:41:41.217053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df787-f0fd-4c04-b3f6-d89946026c63 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:41.217340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df787-f0fd-4c04-b3f6-d89946026c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:41.217620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df787-f0fd-4c04-b3f6-d89946026c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:41.219484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-476df787-f0fd-4c04-b3f6-d89946026c63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:41:41.235589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476df787-f0fd-4c04-b3f6-d89946026c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:41:41.237060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476df787-f0fd-4c04-b3f6-d89946026c63 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:41:41.260674 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4235/8492] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:41:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:41:41.543834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c26f3-ca06-4a62-bf71-7ef71f1a71f7 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:41:41.563795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c26f3-ca06-4a62-bf71-7ef71f1a71f7 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:41:41.567610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f1a70-7639-452a-8cbf-38a3108e0e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:41:41.568203 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1a70-7639-452a-8cbf-38a3108e0e39 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:41.568483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1a70-7639-452a-8cbf-38a3108e0e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:41.568788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1a70-7639-452a-8cbf-38a3108e0e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:41.570463 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-831f1a70-7639-452a-8cbf-38a3108e0e39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:41:41.582378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f1a70-7639-452a-8cbf-38a3108e0e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:41:41.583780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f1a70-7639-452a-8cbf-38a3108e0e39 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:41:41.594201 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4258/8493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:41:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:41:42.049376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190373c-20c3-4e21-b727-4a92a11e5131 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:42.049376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190373c-20c3-4e21-b727-4a92a11e5131 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:42.049376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190373c-20c3-4e21-b727-4a92a11e5131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:42.098062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d190373c-20c3-4e21-b727-4a92a11e5131 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:41:42.099279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d190373c-20c3-4e21-b727-4a92a11e5131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:41:42.109565 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4236/8494] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 01:41:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:41:42.120537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f1a70-7639-452a-8cbf-38a3108e0e39 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:41:42.129093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f1a70-7639-452a-8cbf-38a3108e0e39 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:41:42.132794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76facec9-0c90-4ab6-b37e-2ad714eebb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:41:42.133389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76facec9-0c90-4ab6-b37e-2ad714eebb94 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:42.133663 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76facec9-0c90-4ab6-b37e-2ad714eebb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:42.133934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76facec9-0c90-4ab6-b37e-2ad714eebb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:42.135644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-76facec9-0c90-4ab6-b37e-2ad714eebb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:41:42.152275 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76facec9-0c90-4ab6-b37e-2ad714eebb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:41:42.153844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76facec9-0c90-4ab6-b37e-2ad714eebb94 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:41:42.168162 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4259/8495] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:41:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:41:46.936866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d6fd1-823c-4df6-9c95-f6cc09f777a1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:46.937999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d6fd1-823c-4df6-9c95-f6cc09f777a1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:46.938160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d6fd1-823c-4df6-9c95-f6cc09f777a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:46.958260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-177d6fd1-823c-4df6-9c95-f6cc09f777a1 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:41:46.959589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-177d6fd1-823c-4df6-9c95-f6cc09f777a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:41:46.969238 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4237/8496] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:41:47.029161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df6e1-2b1f-42cd-a48f-00c2194e2e82 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:47.029644 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df6e1-2b1f-42cd-a48f-00c2194e2e82 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:47.029756 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df6e1-2b1f-42cd-a48f-00c2194e2e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:47.050058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-799df6e1-2b1f-42cd-a48f-00c2194e2e82 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:41:47.051289 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-799df6e1-2b1f-42cd-a48f-00c2194e2e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:41:47.060540 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4260/8497] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:41:47.072082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d6fd1-823c-4df6-9c95-f6cc09f777a1 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:41:47.082751 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d6fd1-823c-4df6-9c95-f6cc09f777a1 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:41:47.086599 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ed9ef-c3e7-48c3-8856-b856290c2deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:41:47.087219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ed9ef-c3e7-48c3-8856-b856290c2deb service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:47.087502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ed9ef-c3e7-48c3-8856-b856290c2deb service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:47.087783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ed9ef-c3e7-48c3-8856-b856290c2deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:47.098976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ed9ef-c3e7-48c3-8856-b856290c2deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:41:47.100414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ed9ef-c3e7-48c3-8856-b856290c2deb service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:41:47.111644 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4238/8498] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:41:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:41:57.044816 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=28 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:57.106706 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=36 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:57.666772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b6055-1948-4249-98e1-e48af858afad None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:57.667061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b6055-1948-4249-98e1-e48af858afad None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:57.667342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b6055-1948-4249-98e1-e48af858afad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:57.687347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ef9b6055-1948-4249-98e1-e48af858afad None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:41:57.688668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ef9b6055-1948-4249-98e1-e48af858afad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:41:57.698124 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4261/8499] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:41:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:41:57.708857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ed9ef-c3e7-48c3-8856-b856290c2deb service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:41:57.717413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ed9ef-c3e7-48c3-8856-b856290c2deb service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:41:57.721591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e8723-b8a2-4305-a10a-04f208c3d0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:41:57.722190 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e8723-b8a2-4305-a10a-04f208c3d0ad service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:41:57.722450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e8723-b8a2-4305-a10a-04f208c3d0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:41:57.722721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e8723-b8a2-4305-a10a-04f208c3d0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:41:57.732559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e8723-b8a2-4305-a10a-04f208c3d0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:41:57.733994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e8723-b8a2-4305-a10a-04f208c3d0ad service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:41:57.745571 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4239/8500] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:41:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:42:07.682512 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:42:07.740773 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:42:41.827437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d6e20-6ec7-477a-a520-ffd607625e69 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:42:41.827993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d6e20-6ec7-477a-a520-ffd607625e69 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:42:41.827993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d6e20-6ec7-477a-a520-ffd607625e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:42:41.884702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6a0d6e20-6ec7-477a-a520-ffd607625e69 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:42:41.885940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6a0d6e20-6ec7-477a-a520-ffd607625e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:42:41.912750 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4262/8501] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Oct 19 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:42:41.928513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e8723-b8a2-4305-a10a-04f208c3d0ad service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:42:41.947713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e8723-b8a2-4305-a10a-04f208c3d0ad service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:42:41.952071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8bd72-1310-481e-8264-52d5cb3e9aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:42:41.952701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8bd72-1310-481e-8264-52d5cb3e9aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:42:41.952984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8bd72-1310-481e-8264-52d5cb3e9aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:42:41.953258 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8bd72-1310-481e-8264-52d5cb3e9aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:42:41.960246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8bd72-1310-481e-8264-52d5cb3e9aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:42:41.961709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8bd72-1310-481e-8264-52d5cb3e9aa6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:42:41.969829 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4240/8502] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:42:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:42:51.910684 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=26 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:42:51.966133 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=11 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:43:59.335163 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d6e20-6ec7-477a-a520-ffd607625e69 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:43:59.363210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d6e20-6ec7-477a-a520-ffd607625e69 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:43:59.368768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d7294-5ea2-4a69-83dc-0ce91d1ffdc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:43:59.369366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d7294-5ea2-4a69-83dc-0ce91d1ffdc0 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:43:59.369650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d7294-5ea2-4a69-83dc-0ce91d1ffdc0 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:43:59.369925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d7294-5ea2-4a69-83dc-0ce91d1ffdc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:43:59.378525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d7294-5ea2-4a69-83dc-0ce91d1ffdc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:43:59.380095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d7294-5ea2-4a69-83dc-0ce91d1ffdc0 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:43:59.388983 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4263/8503] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:43:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:44:02.439813 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713dd2-668d-4d2f-a56d-2acc684e6019 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:44:02.440361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713dd2-668d-4d2f-a56d-2acc684e6019 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:44:02.440571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713dd2-668d-4d2f-a56d-2acc684e6019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:44:02.464594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7e713dd2-668d-4d2f-a56d-2acc684e6019 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:44:02.465946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7e713dd2-668d-4d2f-a56d-2acc684e6019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:44:02.478265 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4241/8504] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:44:02.496131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d7294-5ea2-4a69-83dc-0ce91d1ffdc0 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:44:02.514493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d7294-5ea2-4a69-83dc-0ce91d1ffdc0 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:44:02.521968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bdfaa-8446-4327-bf25-244a578a07d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:44:02.522603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bdfaa-8446-4327-bf25-244a578a07d2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:44:02.522886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bdfaa-8446-4327-bf25-244a578a07d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:44:02.523165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bdfaa-8446-4327-bf25-244a578a07d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:44:02.535701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bdfaa-8446-4327-bf25-244a578a07d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:44:02.538156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bdfaa-8446-4327-bf25-244a578a07d2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:44:02.551309 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4264/8505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:44:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:44:07.647092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1235ebd-604b-4bda-9a27-f77b3fd46dda None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:44:07.647544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1235ebd-604b-4bda-9a27-f77b3fd46dda None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:44:07.647645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1235ebd-604b-4bda-9a27-f77b3fd46dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:44:07.666934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d1235ebd-604b-4bda-9a27-f77b3fd46dda None None] MFA Rules not processed for user `ee07628620204cd485da142cf386e51f`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:44:07.668137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d1235ebd-604b-4bda-9a27-f77b3fd46dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:44:07.675215 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4242/8506] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:44:07.992459 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7979677-7433-48b4-b7a9-fdbad672a814 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:44:07.993007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7979677-7433-48b4-b7a9-fdbad672a814 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:44:07.993109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7979677-7433-48b4-b7a9-fdbad672a814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:44:08.025929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c7979677-7433-48b4-b7a9-fdbad672a814 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:44:08.027309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c7979677-7433-48b4-b7a9-fdbad672a814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:44:08.034625 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4265/8507] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:44:08.046266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1235ebd-604b-4bda-9a27-f77b3fd46dda None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:44:08.056159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1235ebd-604b-4bda-9a27-f77b3fd46dda None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:44:08.059699 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f164-66ce-4192-a78f-28ac94c7cb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:44:08.060295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f164-66ce-4192-a78f-28ac94c7cb17 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:44:08.060574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f164-66ce-4192-a78f-28ac94c7cb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:44:08.060874 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f164-66ce-4192-a78f-28ac94c7cb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:44:08.068014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057f164-66ce-4192-a78f-28ac94c7cb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:44:08.069622 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057f164-66ce-4192-a78f-28ac94c7cb17 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:44:08.077317 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4243/8508] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:44:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:44:18.021156 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=26 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:44:18.074016 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=12 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:44:24.649045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488dc4-87f6-4c38-a3d0-25432aa7ca75 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:44:24.649565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488dc4-87f6-4c38-a3d0-25432aa7ca75 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:44:24.649682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488dc4-87f6-4c38-a3d0-25432aa7ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:44:24.673158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4a488dc4-87f6-4c38-a3d0-25432aa7ca75 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:44:24.674894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4a488dc4-87f6-4c38-a3d0-25432aa7ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:44:24.685226 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4266/8509] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:44:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:44:24.701453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f164-66ce-4192-a78f-28ac94c7cb17 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:44:24.716984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f164-66ce-4192-a78f-28ac94c7cb17 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:44:24.723638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf710-3e9d-4ed5-bf2d-c56ed8a995d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:44:24.724257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf710-3e9d-4ed5-bf2d-c56ed8a995d0 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:44:24.724549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf710-3e9d-4ed5-bf2d-c56ed8a995d0 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:44:24.724897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf710-3e9d-4ed5-bf2d-c56ed8a995d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:44:24.735382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf710-3e9d-4ed5-bf2d-c56ed8a995d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:44:24.737022 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf710-3e9d-4ed5-bf2d-c56ed8a995d0 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:44:24.747713 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4244/8510] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:44:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:44:26.874876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488dc4-87f6-4c38-a3d0-25432aa7ca75 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:44:26.884279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488dc4-87f6-4c38-a3d0-25432aa7ca75 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:44:26.887829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aade41-889d-4724-a1af-37a0cba1f73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:44:26.888423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aade41-889d-4724-a1af-37a0cba1f73a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:44:26.888740 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aade41-889d-4724-a1af-37a0cba1f73a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:44:26.889008 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aade41-889d-4724-a1af-37a0cba1f73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:44:26.897986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aade41-889d-4724-a1af-37a0cba1f73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:44:26.899393 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aade41-889d-4724-a1af-37a0cba1f73a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:44:26.909394 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4267/8511] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:44:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:44:34.743346 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:44:36.904548 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:44:39.288722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf710-3e9d-4ed5-bf2d-c56ed8a995d0 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:44:39.310118 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf710-3e9d-4ed5-bf2d-c56ed8a995d0 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:44:39.315793 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7d08-25b0-46a3-b28e-4b5c25d053cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:44:39.316389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7d08-25b0-46a3-b28e-4b5c25d053cc service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:44:39.316967 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7d08-25b0-46a3-b28e-4b5c25d053cc service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:44:39.317247 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7d08-25b0-46a3-b28e-4b5c25d053cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:44:39.325612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d7d08-25b0-46a3-b28e-4b5c25d053cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:44:39.327186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d7d08-25b0-46a3-b28e-4b5c25d053cc service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:44:39.337172 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4245/8512] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:44:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:44:49.333813 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:45:34.178998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b60f0e-1409-4520-94e3-68cef13a7ea8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:45:34.179460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b60f0e-1409-4520-94e3-68cef13a7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:45:34.179558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b60f0e-1409-4520-94e3-68cef13a7ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:45:34.229138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d1b60f0e-1409-4520-94e3-68cef13a7ea8 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:45:34.230349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d1b60f0e-1409-4520-94e3-68cef13a7ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:45:34.239582 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4268/8513] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 19 01:45:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:45:34.245674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7d08-25b0-46a3-b28e-4b5c25d053cc service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:45:34.256122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7d08-25b0-46a3-b28e-4b5c25d053cc service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:45:34.261046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee466ff4-184e-4479-b881-08017e62f1d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:45:34.261640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466ff4-184e-4479-b881-08017e62f1d6 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:45:34.261916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466ff4-184e-4479-b881-08017e62f1d6 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:45:34.262188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466ff4-184e-4479-b881-08017e62f1d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:45:34.270276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee466ff4-184e-4479-b881-08017e62f1d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:45:34.271833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee466ff4-184e-4479-b881-08017e62f1d6 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:45:34.281809 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4246/8514] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:45:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:45:44.226853 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=14 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:45:44.277328 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:46:18.801057 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a707336-0743-4054-ae40-0baf0b84a841 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:46:18.801600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a707336-0743-4054-ae40-0baf0b84a841 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:46:18.801600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a707336-0743-4054-ae40-0baf0b84a841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:46:18.821278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6a707336-0743-4054-ae40-0baf0b84a841 None None] MFA Rules not processed for user `ee07628620204cd485da142cf386e51f`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:46:18.822483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6a707336-0743-4054-ae40-0baf0b84a841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:46:18.829551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4269/8515] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:46:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:46:19.158088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0918fce-2d26-402c-8ff8-ff8e25dad974 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:46:19.158607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0918fce-2d26-402c-8ff8-ff8e25dad974 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:46:19.158708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0918fce-2d26-402c-8ff8-ff8e25dad974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:46:19.178187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b0918fce-2d26-402c-8ff8-ff8e25dad974 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:46:19.179382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b0918fce-2d26-402c-8ff8-ff8e25dad974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:46:19.185877 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4247/8516] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 01:46:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:46:19.198212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a707336-0743-4054-ae40-0baf0b84a841 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:46:19.208708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a707336-0743-4054-ae40-0baf0b84a841 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:46:19.212263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5e49d-dc19-40e5-83bf-bd93c074864e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:46:19.212890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5e49d-dc19-40e5-83bf-bd93c074864e service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:46:19.213174 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5e49d-dc19-40e5-83bf-bd93c074864e service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:46:19.213456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5e49d-dc19-40e5-83bf-bd93c074864e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:46:19.221944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5e49d-dc19-40e5-83bf-bd93c074864e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:46:19.223303 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5e49d-dc19-40e5-83bf-bd93c074864e service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:46:19.231114 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4270/8517] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:46:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:46:19.686844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0918fce-2d26-402c-8ff8-ff8e25dad974 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:46:19.699195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0918fce-2d26-402c-8ff8-ff8e25dad974 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:46:19.704737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d0e67-36bf-43b5-bc88-84f105d0b1ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:46:19.705348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d0e67-36bf-43b5-bc88-84f105d0b1ea service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:46:19.705626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d0e67-36bf-43b5-bc88-84f105d0b1ea service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:46:19.705899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d0e67-36bf-43b5-bc88-84f105d0b1ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:46:19.715171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d0e67-36bf-43b5-bc88-84f105d0b1ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:46:19.716834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d0e67-36bf-43b5-bc88-84f105d0b1ea service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:46:19.727676 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4248/8518] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:46:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:46:21.851088 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e8e3-da88-4900-9cca-39fc2c197bff None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:46:21.851602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e8e3-da88-4900-9cca-39fc2c197bff None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:46:21.851602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e8e3-da88-4900-9cca-39fc2c197bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:46:21.873290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-e8c5e8e3-da88-4900-9cca-39fc2c197bff None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:46:21.874586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e8c5e8e3-da88-4900-9cca-39fc2c197bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:46:21.881821 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4271/8519] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Oct 19 01:46:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:46:21.893648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d0e67-36bf-43b5-bc88-84f105d0b1ea service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:46:21.904044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d0e67-36bf-43b5-bc88-84f105d0b1ea service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:46:21.909641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c7926-a07b-4dfe-9e12-6cbed5e322e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:46:21.910264 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c7926-a07b-4dfe-9e12-6cbed5e322e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:46:21.910544 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c7926-a07b-4dfe-9e12-6cbed5e322e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:46:21.910820 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c7926-a07b-4dfe-9e12-6cbed5e322e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:46:21.919211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c7926-a07b-4dfe-9e12-6cbed5e322e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:46:21.920661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c7926-a07b-4dfe-9e12-6cbed5e322e8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:46:21.930483 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4249/8520] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:46:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:46:31.868044 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=12 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:46:31.926494 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=15 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:47:47.853803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e8e3-da88-4900-9cca-39fc2c197bff None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:47:47.862574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e8e3-da88-4900-9cca-39fc2c197bff None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:47:47.866321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcbbb9-1a6c-4b93-a9fd-ff70a074f184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:47:47.866928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcbbb9-1a6c-4b93-a9fd-ff70a074f184 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:47:47.867210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcbbb9-1a6c-4b93-a9fd-ff70a074f184 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:47:47.867484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcbbb9-1a6c-4b93-a9fd-ff70a074f184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:47:47.875007 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcbbb9-1a6c-4b93-a9fd-ff70a074f184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:47:47.876611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcbbb9-1a6c-4b93-a9fd-ff70a074f184 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:47:47.885547 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4272/8521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:47:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:47:57.881650 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:09.632762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c7926-a07b-4dfe-9e12-6cbed5e322e8 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:09.634366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-720c7926-a07b-4dfe-9e12-6cbed5e322e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:09.692493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c7926-a07b-4dfe-9e12-6cbed5e322e8 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:09.696125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe072329-f61c-425f-9405-30c4b8c72530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:09.696765 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe072329-f61c-425f-9405-30c4b8c72530 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:09.697042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe072329-f61c-425f-9405-30c4b8c72530 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:09.697315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe072329-f61c-425f-9405-30c4b8c72530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:09.767425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe072329-f61c-425f-9405-30c4b8c72530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:09.768891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe072329-f61c-425f-9405-30c4b8c72530 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:09.780582 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4250/8522] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:48:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:48:10.975876 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcbbb9-1a6c-4b93-a9fd-ff70a074f184 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:11.031526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcbbb9-1a6c-4b93-a9fd-ff70a074f184 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:11.035200 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965799-ed76-426d-94c3-b3bae3f17084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:11.035830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965799-ed76-426d-94c3-b3bae3f17084 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:11.036110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965799-ed76-426d-94c3-b3bae3f17084 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:11.036385 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965799-ed76-426d-94c3-b3bae3f17084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:11.051233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92965799-ed76-426d-94c3-b3bae3f17084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:11.052741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92965799-ed76-426d-94c3-b3bae3f17084 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:11.063916 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4273/8523] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:48:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:48:11.698929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e88b-2e98-45dc-81ba-4fefd6ae39a8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:11.699419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e88b-2e98-45dc-81ba-4fefd6ae39a8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:11.699905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e88b-2e98-45dc-81ba-4fefd6ae39a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:11.735098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fce6e88b-2e98-45dc-81ba-4fefd6ae39a8 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:48:11.736326 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fce6e88b-2e98-45dc-81ba-4fefd6ae39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:11.745681 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4251/8524] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:48:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:48:11.758453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965799-ed76-426d-94c3-b3bae3f17084 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:11.770012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965799-ed76-426d-94c3-b3bae3f17084 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:11.776886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da640554-097f-4c85-9237-76c50d41ec49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:11.777494 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da640554-097f-4c85-9237-76c50d41ec49 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:11.777810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da640554-097f-4c85-9237-76c50d41ec49 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:11.778076 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da640554-097f-4c85-9237-76c50d41ec49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:11.787390 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da640554-097f-4c85-9237-76c50d41ec49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:11.789020 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da640554-097f-4c85-9237-76c50d41ec49 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:11.801842 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4274/8525] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:48:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:48:21.728956 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=62 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:21.796002 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=32 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:35.614655 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e88b-2e98-45dc-81ba-4fefd6ae39a8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:35.625565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e88b-2e98-45dc-81ba-4fefd6ae39a8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:35.629441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f85b0-9eb7-410d-a13c-1a41f9cdc45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:35.630179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f85b0-9eb7-410d-a13c-1a41f9cdc45a service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:35.630530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f85b0-9eb7-410d-a13c-1a41f9cdc45a service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:35.630877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f85b0-9eb7-410d-a13c-1a41f9cdc45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:35.632854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8d7f85b0-9eb7-410d-a13c-1a41f9cdc45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:35.727077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f85b0-9eb7-410d-a13c-1a41f9cdc45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:35.728558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f85b0-9eb7-410d-a13c-1a41f9cdc45a service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:35.748879 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4252/8526] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:48:38.716056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da640554-097f-4c85-9237-76c50d41ec49 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:38.810707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da640554-097f-4c85-9237-76c50d41ec49 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:38.816248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:38.816897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:38.817180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:38.817458 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:38.819167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:38.833839 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:38.835438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:38.849161 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4275/8527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:48:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:48:42.031131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a2ff8-a619-4f0e-aee8-abd3ced0c66b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:42.031643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a2ff8-a619-4f0e-aee8-abd3ced0c66b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:42.031767 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a2ff8-a619-4f0e-aee8-abd3ced0c66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:42.060852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-392a2ff8-a619-4f0e-aee8-abd3ced0c66b None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:48:42.062791 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-392a2ff8-a619-4f0e-aee8-abd3ced0c66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:42.098976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:42.099613 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4253/8528] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:48:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:48:42.101818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:42.120570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a2ff8-a619-4f0e-aee8-abd3ced0c66b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:42.121360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b0e02-0d52-4658-83d0-3ea14b30510a service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:42.126648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:42.127389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:42.128363 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:42.128824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] PATH_INFO: `/v3/users/ee07628620204cd485da142cf386e51f` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:42.132846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a2ff8-a619-4f0e-aee8-abd3ced0c66b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:42.138331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342ac2a-b5b8-48de-93f9-f39728f68da6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:42.139023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342ac2a-b5b8-48de-93f9-f39728f68da6 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:42.139371 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342ac2a-b5b8-48de-93f9-f39728f68da6 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:42.139736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342ac2a-b5b8-48de-93f9-f39728f68da6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:42.143000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee07628620204cd485da142cf386e51f)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:42.144967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:42.148761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342ac2a-b5b8-48de-93f9-f39728f68da6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:42.150418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342ac2a-b5b8-48de-93f9-f39728f68da6 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:42.161085 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4254/8529] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:48:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:48:42.194769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee07628620204cd485da142cf386e51f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.206770 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee07628620204cd485da142cf386e51f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.214220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee07628620204cd485da142cf386e51f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.222230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee07628620204cd485da142cf386e51f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.222925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee07628620204cd485da142cf386e51f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.228878 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4276/8530] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:48:42 2022] DELETE /identity/v3/users/ee07628620204cd485da142cf386e51f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:48:42.400257 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342ac2a-b5b8-48de-93f9-f39728f68da6 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:42.411526 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342ac2a-b5b8-48de-93f9-f39728f68da6 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:42.471198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:42.471834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:42.472117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:42.472455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] PATH_INFO: `/v3/projects/034b5ba57eb7442e860a47761dfd8471` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:42.483166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=034b5ba57eb7442e860a47761dfd8471)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:42.485100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:42.525677 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:42.534179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034b5ba57eb7442e860a47761dfd8471', 'request_id': 'req-0a695309-6f05-46af-8576-bd62cf09b9ff'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.541268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034b5ba57eb7442e860a47761dfd8471', 'request_id': 'req-0a695309-6f05-46af-8576-bd62cf09b9ff'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.547041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034b5ba57eb7442e860a47761dfd8471', 'request_id': 'req-0a695309-6f05-46af-8576-bd62cf09b9ff'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.559267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] The token cache is being invalidate because project 034b5ba57eb7442e860a47761dfd8471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:48:42.559267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.559974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.561643 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4255/8531] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:48:42 2022] DELETE /identity/v3/projects/034b5ba57eb7442e860a47761dfd8471 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:48:42.565946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:42.567355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:42.581512 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b6cba-a287-4043-83db-ff8f067719ee admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:42.628995 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:42.641065 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:42.641701 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:42.641983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:42.642260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] PATH_INFO: `/v3/users/ea08a4c308d440ce8a398b72ebcae09d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:42.656126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea08a4c308d440ce8a398b72ebcae09d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:42.658169 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:42.705085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea08a4c308d440ce8a398b72ebcae09d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.717298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea08a4c308d440ce8a398b72ebcae09d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.725334 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea08a4c308d440ce8a398b72ebcae09d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.733332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea08a4c308d440ce8a398b72ebcae09d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.733986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-618063c9-769e-414c-bdbf-b082bd58c7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea08a4c308d440ce8a398b72ebcae09d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:42.739747 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4277/8532] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:48:42 2022] DELETE /identity/v3/users/ea08a4c308d440ce8a398b72ebcae09d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:48:42.916320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:42.917918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:42.935945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a695309-6f05-46af-8576-bd62cf09b9ff admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:42.997181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:42.997819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:42.998117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:42.998390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] PATH_INFO: `/v3/projects/40c2d3df69094316a3b493d8c074c915` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:43.009132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c2d3df69094316a3b493d8c074c915)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:43.011043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:43.061647 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c2d3df69094316a3b493d8c074c915', 'request_id': 'req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:43.069700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c2d3df69094316a3b493d8c074c915', 'request_id': 'req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:43.076334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c2d3df69094316a3b493d8c074c915', 'request_id': 'req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:43.088210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] The token cache is being invalidate because project 40c2d3df69094316a3b493d8c074c915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:48:43.088689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:43.089351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-bcd3227f-0de6-4a0d-9c22-6a0e2f29900d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:48:43.091553 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4256/8533] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:48:42 2022] DELETE /identity/v3/projects/40c2d3df69094316a3b493d8c074c915 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:48:52.736374 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:53.085003 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=65,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:53.126862 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ef8d-5379-44c8-90b5-61c9a3ae21a3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.127150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ef8d-5379-44c8-90b5-61c9a3ae21a3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.127429 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ef8d-5379-44c8-90b5-61c9a3ae21a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.176296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a0e3ef8d-5379-44c8-90b5-61c9a3ae21a3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:48:53.177542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a0e3ef8d-5379-44c8-90b5-61c9a3ae21a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:53.236944 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4278/8534] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:48:53.248133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf73106-aa94-4e87-9d27-48f39af2326f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.248420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf73106-aa94-4e87-9d27-48f39af2326f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.248737 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf73106-aa94-4e87-9d27-48f39af2326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.268192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-edf73106-aa94-4e87-9d27-48f39af2326f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:48:53.269432 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-edf73106-aa94-4e87-9d27-48f39af2326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:53.277799 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4257/8535] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:48:53.282499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3ef8d-5379-44c8-90b5-61c9a3ae21a3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.292408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3ef8d-5379-44c8-90b5-61c9a3ae21a3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.297733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630c5fc-c3fc-4d68-af88-b68a8591733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.298333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630c5fc-c3fc-4d68-af88-b68a8591733a admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.298611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630c5fc-c3fc-4d68-af88-b68a8591733a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.298883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630c5fc-c3fc-4d68-af88-b68a8591733a admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.299553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630c5fc-c3fc-4d68-af88-b68a8591733a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:48:53.299856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630c5fc-c3fc-4d68-af88-b68a8591733a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:53.301543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630c5fc-c3fc-4d68-af88-b68a8591733a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:53.313618 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4279/8536] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:48:53.334991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf73106-aa94-4e87-9d27-48f39af2326f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.345017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf73106-aa94-4e87-9d27-48f39af2326f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.349876 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37518b-e512-40fc-902a-f03aea4b44e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.350477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37518b-e512-40fc-902a-f03aea4b44e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.350789 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37518b-e512-40fc-902a-f03aea4b44e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.351065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37518b-e512-40fc-902a-f03aea4b44e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.351696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37518b-e512-40fc-902a-f03aea4b44e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:53.353648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37518b-e512-40fc-902a-f03aea4b44e4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:53.391192 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4258/8537] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:48:53 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:48:53.395426 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630c5fc-c3fc-4d68-af88-b68a8591733a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.406102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630c5fc-c3fc-4d68-af88-b68a8591733a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.463396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfc6da-d10c-4eee-a5db-b52ce7257871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.464005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfc6da-d10c-4eee-a5db-b52ce7257871 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.464286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfc6da-d10c-4eee-a5db-b52ce7257871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.464559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfc6da-d10c-4eee-a5db-b52ce7257871 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.466348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfc6da-d10c-4eee-a5db-b52ce7257871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:53.468314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfc6da-d10c-4eee-a5db-b52ce7257871 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:53.490285 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4280/8538] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:48:53 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:48:53.494555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37518b-e512-40fc-902a-f03aea4b44e4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.505200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37518b-e512-40fc-902a-f03aea4b44e4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.509887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055185e8-72de-4e88-a3cc-4431e3bda0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.510487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055185e8-72de-4e88-a3cc-4431e3bda0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.510774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055185e8-72de-4e88-a3cc-4431e3bda0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.511054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055185e8-72de-4e88-a3cc-4431e3bda0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.511696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055185e8-72de-4e88-a3cc-4431e3bda0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:53.513336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055185e8-72de-4e88-a3cc-4431e3bda0c6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:53.523193 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4259/8539] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:48:53.527847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfc6da-d10c-4eee-a5db-b52ce7257871 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.537990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfc6da-d10c-4eee-a5db-b52ce7257871 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.542636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75e057-3dab-4533-b324-aea887bd8a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.544002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e057-3dab-4533-b324-aea887bd8a0f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.544298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e057-3dab-4533-b324-aea887bd8a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.544716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e057-3dab-4533-b324-aea887bd8a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.545354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75e057-3dab-4533-b324-aea887bd8a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:53.546939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75e057-3dab-4533-b324-aea887bd8a0f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:53.558114 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4281/8540] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:48:53.561992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055185e8-72de-4e88-a3cc-4431e3bda0c6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.572299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055185e8-72de-4e88-a3cc-4431e3bda0c6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.577093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b5989-33f4-4eb9-9c22-71c0617b7aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.577821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5989-33f4-4eb9-9c22-71c0617b7aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.578105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5989-33f4-4eb9-9c22-71c0617b7aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.578384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5989-33f4-4eb9-9c22-71c0617b7aa2 admin admin] PATH_INFO: `/v3/projects/5a3ec273a1dd47c5badbc1156aeb1775/users/551b20cf7739476fb8d28dce9afd1002/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.593474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b5989-33f4-4eb9-9c22-71c0617b7aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3ec273a1dd47c5badbc1156aeb1775, user_id=551b20cf7739476fb8d28dce9afd1002, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:53.596144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b5989-33f4-4eb9-9c22-71c0617b7aa2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:53.609873 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4260/8541] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:48:53 2022] PUT /identity/v3/projects/5a3ec273a1dd47c5badbc1156aeb1775/users/551b20cf7739476fb8d28dce9afd1002/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:48:53.621144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cc5ad-6d6e-45f5-a66f-462c485c7bfd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.621514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cc5ad-6d6e-45f5-a66f-462c485c7bfd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.621809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cc5ad-6d6e-45f5-a66f-462c485c7bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.649729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-413cc5ad-6d6e-45f5-a66f-462c485c7bfd None None] MFA Rules not processed for user `551b20cf7739476fb8d28dce9afd1002`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:48:53.650943 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-413cc5ad-6d6e-45f5-a66f-462c485c7bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:53.683839 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:53.719232 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4282/8542] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:48:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:48:53.723999 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b5989-33f4-4eb9-9c22-71c0617b7aa2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.803140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b5989-33f4-4eb9-9c22-71c0617b7aa2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.809683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412fb90-caf4-4203-ac64-42c44c1f4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.810225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412fb90-caf4-4203-ac64-42c44c1f4659 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.810506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412fb90-caf4-4203-ac64-42c44c1f4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.810778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412fb90-caf4-4203-ac64-42c44c1f4659 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.811417 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412fb90-caf4-4203-ac64-42c44c1f4659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:53.813368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412fb90-caf4-4203-ac64-42c44c1f4659 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:53.840560 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4261/8543] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:48:53 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:48:53.844986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cc5ad-6d6e-45f5-a66f-462c485c7bfd None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.855793 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cc5ad-6d6e-45f5-a66f-462c485c7bfd None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.912086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439f910-2407-423e-9f14-271dd63a40ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.912719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439f910-2407-423e-9f14-271dd63a40ac admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.913014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439f910-2407-423e-9f14-271dd63a40ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.913272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439f910-2407-423e-9f14-271dd63a40ac admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.913887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439f910-2407-423e-9f14-271dd63a40ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:53.915803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439f910-2407-423e-9f14-271dd63a40ac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:53.937820 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4283/8544] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:48:53 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:48:53.940763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412fb90-caf4-4203-ac64-42c44c1f4659 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.951837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412fb90-caf4-4203-ac64-42c44c1f4659 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.957476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c2ae-9260-4ce3-8328-9476de154013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.958087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c2ae-9260-4ce3-8328-9476de154013 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.958394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c2ae-9260-4ce3-8328-9476de154013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.958667 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c2ae-9260-4ce3-8328-9476de154013 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:53.959421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c2ae-9260-4ce3-8328-9476de154013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:53.960962 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c2ae-9260-4ce3-8328-9476de154013 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:53.972702 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4262/8545] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:48:53.976870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439f910-2407-423e-9f14-271dd63a40ac admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:53.986884 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439f910-2407-423e-9f14-271dd63a40ac admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:53.991497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071191e0-980b-4594-a5dc-18235f054f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:53.992137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071191e0-980b-4594-a5dc-18235f054f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:53.992417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071191e0-980b-4594-a5dc-18235f054f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:53.992723 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071191e0-980b-4594-a5dc-18235f054f85 admin admin] PATH_INFO: `/v3/projects/62984549702e4a9db66711e941728324/users/c8ed7b36f792427d80020d79263a55d5/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:54.007760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071191e0-980b-4594-a5dc-18235f054f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62984549702e4a9db66711e941728324, user_id=c8ed7b36f792427d80020d79263a55d5, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:54.010488 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071191e0-980b-4594-a5dc-18235f054f85 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:54.023759 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4284/8546] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:48:53 2022] PUT /identity/v3/projects/62984549702e4a9db66711e941728324/users/c8ed7b36f792427d80020d79263a55d5/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:48:54.027837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c2ae-9260-4ce3-8328-9476de154013 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:54.037897 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c2ae-9260-4ce3-8328-9476de154013 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:54.095449 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2469-34e9-45a0-ab6f-5d2417087462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:54.096105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2469-34e9-45a0-ab6f-5d2417087462 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:54.096381 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2469-34e9-45a0-ab6f-5d2417087462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:54.096689 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2469-34e9-45a0-ab6f-5d2417087462 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:54.097332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff2469-34e9-45a0-ab6f-5d2417087462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:54.098928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff2469-34e9-45a0-ab6f-5d2417087462 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:54.101061 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:54.110586 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4263/8547] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:48:54.114621 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071191e0-980b-4594-a5dc-18235f054f85 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:54.126058 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071191e0-980b-4594-a5dc-18235f054f85 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:54.130810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60defe7e-6f39-409a-bdca-1a8435594035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:54.131462 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60defe7e-6f39-409a-bdca-1a8435594035 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:54.131774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60defe7e-6f39-409a-bdca-1a8435594035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:54.132051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60defe7e-6f39-409a-bdca-1a8435594035 admin admin] PATH_INFO: `/v3/projects/62984549702e4a9db66711e941728324/users/c8ed7b36f792427d80020d79263a55d5/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:54.134028 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60defe7e-6f39-409a-bdca-1a8435594035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62984549702e4a9db66711e941728324, user_id=c8ed7b36f792427d80020d79263a55d5, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:54.137270 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60defe7e-6f39-409a-bdca-1a8435594035 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:54.148104 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4285/8548] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:48:54 2022] PUT /identity/v3/projects/62984549702e4a9db66711e941728324/users/c8ed7b36f792427d80020d79263a55d5/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:48:54.158187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a92ec-e854-4c89-8bf4-2a8ce95c8362 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:54.158477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a92ec-e854-4c89-8bf4-2a8ce95c8362 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:54.158759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a92ec-e854-4c89-8bf4-2a8ce95c8362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:54.187173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5f1a92ec-e854-4c89-8bf4-2a8ce95c8362 None None] MFA Rules not processed for user `c8ed7b36f792427d80020d79263a55d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:48:54.188398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f1a92ec-e854-4c89-8bf4-2a8ce95c8362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:54.256812 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4264/8549] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:48:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:48:54.270554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48486-bb20-4ee9-bad8-bb975a4e3f1c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:54.270838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48486-bb20-4ee9-bad8-bb975a4e3f1c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:54.271139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48486-bb20-4ee9-bad8-bb975a4e3f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:54.290328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-8de48486-bb20-4ee9-bad8-bb975a4e3f1c None None] MFA Rules not processed for user `551b20cf7739476fb8d28dce9afd1002`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:48:54.291528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8de48486-bb20-4ee9-bad8-bb975a4e3f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:54.346408 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4286/8550] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:48:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:48:54.360494 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a92ec-e854-4c89-8bf4-2a8ce95c8362 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:54.362252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f1a92ec-e854-4c89-8bf4-2a8ce95c8362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:54.434527 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a92ec-e854-4c89-8bf4-2a8ce95c8362 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:54.440067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a5867-a80d-4c41-9d0b-22cbacaafc4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:54.440964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a5867-a80d-4c41-9d0b-22cbacaafc4f service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:54.441243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a5867-a80d-4c41-9d0b-22cbacaafc4f service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:54.441513 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a5867-a80d-4c41-9d0b-22cbacaafc4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:54.449293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a5867-a80d-4c41-9d0b-22cbacaafc4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:54.450911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a5867-a80d-4c41-9d0b-22cbacaafc4f service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:54.459756 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4265/8551] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:48:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:48:54.926625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48486-bb20-4ee9-bad8-bb975a4e3f1c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:48:54.928137 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8de48486-bb20-4ee9-bad8-bb975a4e3f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:54.963719 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:55.005826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48486-bb20-4ee9-bad8-bb975a4e3f1c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:48:55.011177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde501d7-7e2b-48ba-a7e2-66592e0dbddf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:48:55.011817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde501d7-7e2b-48ba-a7e2-66592e0dbddf service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:48:55.012302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde501d7-7e2b-48ba-a7e2-66592e0dbddf service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:48:55.012588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde501d7-7e2b-48ba-a7e2-66592e0dbddf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:48:55.014352 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cde501d7-7e2b-48ba-a7e2-66592e0dbddf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:48:55.025741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde501d7-7e2b-48ba-a7e2-66592e0dbddf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:48:55.027933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde501d7-7e2b-48ba-a7e2-66592e0dbddf service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:48:55.038218 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4287/8552] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:48:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:49:04.455830 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=69 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:05.033799 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=18 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:06.766134 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a5867-a80d-4c41-9d0b-22cbacaafc4f service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:06.777331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a5867-a80d-4c41-9d0b-22cbacaafc4f service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:06.783012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c842a-4ca8-4067-90cb-ddd27bb63fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:06.783608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c842a-4ca8-4067-90cb-ddd27bb63fa6 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:06.783889 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c842a-4ca8-4067-90cb-ddd27bb63fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:06.784165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c842a-4ca8-4067-90cb-ddd27bb63fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:06.792279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c842a-4ca8-4067-90cb-ddd27bb63fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:06.794031 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c842a-4ca8-4067-90cb-ddd27bb63fa6 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:06.803460 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4266/8553] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:06 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:49:06.819087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059a728-9fff-4703-a4dd-7970d877c863 None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:06.819522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059a728-9fff-4703-a4dd-7970d877c863 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:06.819662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059a728-9fff-4703-a4dd-7970d877c863 None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:06.821055 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4288/8554] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 01:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 01:49:06.826473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c842a-4ca8-4067-90cb-ddd27bb63fa6 service nova] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 01:49:06.837467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c842a-4ca8-4067-90cb-ddd27bb63fa6 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:06.845907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c842a-4ca8-4067-90cb-ddd27bb63fa6 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:06.850562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8ed7b36f792427d80020d79263a55d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62984549702e4a9db66711e941728324', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:06.851168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:06.851454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:06.851740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] PATH_INFO: `/v3/projects/62984549702e4a9db66711e941728324` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:06.852929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] RBAC: Authorizing `identity:get_project(project_id=62984549702e4a9db66711e941728324)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:06.854685 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:06.856284 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4267/8555] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 01:49:06 2022] GET /identity/v3/projects/62984549702e4a9db66711e941728324 => generated 393 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:49:07.168890 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238617f-f5c9-4667-91c5-11826f8007ad None None] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:07.169180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238617f-f5c9-4667-91c5-11826f8007ad None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:07.169454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238617f-f5c9-4667-91c5-11826f8007ad None None] PATH_INFO: `/` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:07.170800 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4289/8556] 10.222.0.27 () {54 vars in 912 bytes} [Wed Oct 19 01:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 01:49:07.175459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Authenticating service token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 19 01:49:07.177178 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:07.194038 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:07.203053 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f69dd-1d85-4057-a158-393c88cf3a1d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:07.207638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510174-ba94-4af5-9a35-5d7f2a9122a1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8ed7b36f792427d80020d79263a55d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62984549702e4a9db66711e941728324', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:07.208289 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510174-ba94-4af5-9a35-5d7f2a9122a1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:07.208574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510174-ba94-4af5-9a35-5d7f2a9122a1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:07.208887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510174-ba94-4af5-9a35-5d7f2a9122a1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] PATH_INFO: `/v3/projects/62984549702e4a9db66711e941728324` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:07.210020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a510174-ba94-4af5-9a35-5d7f2a9122a1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] RBAC: Authorizing `identity:get_project(project_id=62984549702e4a9db66711e941728324)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:07.211798 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a510174-ba94-4af5-9a35-5d7f2a9122a1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:07.213452 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4268/8557] 10.222.0.27 () {58 vars in 1443 bytes} [Wed Oct 19 01:49:07 2022] GET /identity/v3/projects/62984549702e4a9db66711e941728324 => generated 393 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:49:09.687349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238617f-f5c9-4667-91c5-11826f8007ad None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:09.705413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238617f-f5c9-4667-91c5-11826f8007ad None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:09.712844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6798f9-8fa5-4013-9b28-5f5d9f410d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:09.713474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6798f9-8fa5-4013-9b28-5f5d9f410d99 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:09.713757 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6798f9-8fa5-4013-9b28-5f5d9f410d99 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:09.714035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6798f9-8fa5-4013-9b28-5f5d9f410d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:09.717445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1b6798f9-8fa5-4013-9b28-5f5d9f410d99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:09.734520 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6798f9-8fa5-4013-9b28-5f5d9f410d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:09.736156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6798f9-8fa5-4013-9b28-5f5d9f410d99 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:09.749078 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4290/8558] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:49:11.154735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510174-ba94-4af5-9a35-5d7f2a9122a1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:11.218928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510174-ba94-4af5-9a35-5d7f2a9122a1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:11.223579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:11.224201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:11.224477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:11.224787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] PATH_INFO: `/v3/users/551b20cf7739476fb8d28dce9afd1002` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:11.225903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=551b20cf7739476fb8d28dce9afd1002)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:11.227831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:11.272252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551b20cf7739476fb8d28dce9afd1002'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.284733 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551b20cf7739476fb8d28dce9afd1002'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.292187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551b20cf7739476fb8d28dce9afd1002'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.300467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551b20cf7739476fb8d28dce9afd1002'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.301078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551b20cf7739476fb8d28dce9afd1002'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.306874 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4269/8559] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:49:11 2022] DELETE /identity/v3/users/551b20cf7739476fb8d28dce9afd1002 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:49:11.311802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1bc1a-17c1-41ca-9d14-73b905ef41e1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:11.312272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1bc1a-17c1-41ca-9d14-73b905ef41e1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:11.312368 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1bc1a-17c1-41ca-9d14-73b905ef41e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:11.331616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fee1bc1a-17c1-41ca-9d14-73b905ef41e1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:49:11.332863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fee1bc1a-17c1-41ca-9d14-73b905ef41e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:11.393230 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4291/8560] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:49:11.404559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:11.406124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:11.461676 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:11.466290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113efa74-8957-4728-8c38-6f9f7bfbd86c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:11.471024 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab0a38-b676-445e-a64c-709994b31f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:11.471684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab0a38-b676-445e-a64c-709994b31f7f service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:11.472136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab0a38-b676-445e-a64c-709994b31f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:11.472571 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab0a38-b676-445e-a64c-709994b31f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:11.482846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab0a38-b676-445e-a64c-709994b31f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:11.484276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab0a38-b676-445e-a64c-709994b31f7f service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:11.493886 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4270/8561] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:49:11.665036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1bc1a-17c1-41ca-9d14-73b905ef41e1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:11.666646 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fee1bc1a-17c1-41ca-9d14-73b905ef41e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:11.680278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1bc1a-17c1-41ca-9d14-73b905ef41e1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:11.685511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:11.686241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:11.686487 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:11.686781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] PATH_INFO: `/v3/projects/5a3ec273a1dd47c5badbc1156aeb1775` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:11.688153 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3ec273a1dd47c5badbc1156aeb1775)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:11.690443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:11.739360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3ec273a1dd47c5badbc1156aeb1775', 'request_id': 'req-a33c9502-e86a-46cc-ba82-607fb3b8680a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.746844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3ec273a1dd47c5badbc1156aeb1775', 'request_id': 'req-a33c9502-e86a-46cc-ba82-607fb3b8680a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.752782 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3ec273a1dd47c5badbc1156aeb1775', 'request_id': 'req-a33c9502-e86a-46cc-ba82-607fb3b8680a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.764997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] The token cache is being invalidate because project 5a3ec273a1dd47c5badbc1156aeb1775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:49:11.765299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.765962 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.767493 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4292/8562] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:49:11 2022] DELETE /identity/v3/projects/5a3ec273a1dd47c5badbc1156aeb1775 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:49:11.771715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab0a38-b676-445e-a64c-709994b31f7f service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:11.782530 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab0a38-b676-445e-a64c-709994b31f7f service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:11.840325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:11.840969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:11.841280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:11.841556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] PATH_INFO: `/v3/users/c8ed7b36f792427d80020d79263a55d5` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:11.842688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ed7b36f792427d80020d79263a55d5)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:11.844612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:11.892532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ed7b36f792427d80020d79263a55d5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.905460 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ed7b36f792427d80020d79263a55d5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.912517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ed7b36f792427d80020d79263a55d5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.920219 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ed7b36f792427d80020d79263a55d5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.920951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-1dc8cfc4-68d8-4a0e-a0b9-7652131033c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ed7b36f792427d80020d79263a55d5'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:11.927088 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4271/8563] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:49:11 2022] DELETE /identity/v3/users/c8ed7b36f792427d80020d79263a55d5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:49:12.202044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:12.203683 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:12.217478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c9502-e86a-46cc-ba82-607fb3b8680a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:12.278918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:12.279547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.279824 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.280093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] PATH_INFO: `/v3/projects/62984549702e4a9db66711e941728324` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.281228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62984549702e4a9db66711e941728324)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:12.283124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:12.294417 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:12.331519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62984549702e4a9db66711e941728324', 'request_id': 'req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:12.338934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62984549702e4a9db66711e941728324', 'request_id': 'req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:12.344971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62984549702e4a9db66711e941728324', 'request_id': 'req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:12.356941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] The token cache is being invalidate because project 62984549702e4a9db66711e941728324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:49:12.357232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:12.357875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-85e957cd-9a94-4616-9e2b-cb0ee0f7b549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:49:12.359395 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4293/8564] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:49:12 2022] DELETE /identity/v3/projects/62984549702e4a9db66711e941728324 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:49:12.365362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965b62-c367-4320-a85d-b0614eeb0458 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.365996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965b62-c367-4320-a85d-b0614eeb0458 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.365996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965b62-c367-4320-a85d-b0614eeb0458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.386504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-76965b62-c367-4320-a85d-b0614eeb0458 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:49:12.388135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-76965b62-c367-4320-a85d-b0614eeb0458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:12.448089 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4272/8565] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:49:12.456850 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841297-8d57-44ac-bb5d-dd5f2a1dfee0 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.457136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841297-8d57-44ac-bb5d-dd5f2a1dfee0 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.457414 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841297-8d57-44ac-bb5d-dd5f2a1dfee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.477870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1e841297-8d57-44ac-bb5d-dd5f2a1dfee0 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:49:12.479161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1e841297-8d57-44ac-bb5d-dd5f2a1dfee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:12.487948 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4294/8566] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:49:12.492419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965b62-c367-4320-a85d-b0614eeb0458 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:12.503358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965b62-c367-4320-a85d-b0614eeb0458 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:12.508879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d565-ac3e-4c86-b184-086e5fba0b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:12.509514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d565-ac3e-4c86-b184-086e5fba0b5c admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.509797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d565-ac3e-4c86-b184-086e5fba0b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.510117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d565-ac3e-4c86-b184-086e5fba0b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.510771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d565-ac3e-4c86-b184-086e5fba0b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:49:12.511098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d565-ac3e-4c86-b184-086e5fba0b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:12.512849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d565-ac3e-4c86-b184-086e5fba0b5c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:12.519906 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:12.526728 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4273/8567] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:49:12.530471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841297-8d57-44ac-bb5d-dd5f2a1dfee0 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:12.539903 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841297-8d57-44ac-bb5d-dd5f2a1dfee0 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:12.545195 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c522619-1209-4ac3-877e-5710c20fa9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:12.545805 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c522619-1209-4ac3-877e-5710c20fa9fc admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.546085 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c522619-1209-4ac3-877e-5710c20fa9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.546360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c522619-1209-4ac3-877e-5710c20fa9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.546996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c522619-1209-4ac3-877e-5710c20fa9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:12.548975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c522619-1209-4ac3-877e-5710c20fa9fc admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:12.577043 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4295/8568] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:49:12 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:49:12.581300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d565-ac3e-4c86-b184-086e5fba0b5c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:12.591836 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d565-ac3e-4c86-b184-086e5fba0b5c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:12.650241 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d11c1-a644-48de-b94c-391792f22049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:12.650763 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d11c1-a644-48de-b94c-391792f22049 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.651046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d11c1-a644-48de-b94c-391792f22049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.651346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d11c1-a644-48de-b94c-391792f22049 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.651973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d11c1-a644-48de-b94c-391792f22049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:12.653991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d11c1-a644-48de-b94c-391792f22049 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:12.675198 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4274/8569] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:49:12 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:49:12.679533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c522619-1209-4ac3-877e-5710c20fa9fc admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:12.691269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c522619-1209-4ac3-877e-5710c20fa9fc admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:12.695947 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e08b8-61bf-44a8-94a9-c68f49cbb2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:12.696553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e08b8-61bf-44a8-94a9-c68f49cbb2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.696857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e08b8-61bf-44a8-94a9-c68f49cbb2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.697136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e08b8-61bf-44a8-94a9-c68f49cbb2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.697772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e08b8-61bf-44a8-94a9-c68f49cbb2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:12.699931 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e08b8-61bf-44a8-94a9-c68f49cbb2d4 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:12.709859 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4296/8570] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:49:12.713960 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d11c1-a644-48de-b94c-391792f22049 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:12.725337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d11c1-a644-48de-b94c-391792f22049 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:12.731016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaa0b9-5521-48e0-bb43-5adbac98812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:12.731661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaa0b9-5521-48e0-bb43-5adbac98812d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.731979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaa0b9-5521-48e0-bb43-5adbac98812d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.732254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaa0b9-5521-48e0-bb43-5adbac98812d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.732957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaa0b9-5521-48e0-bb43-5adbac98812d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:12.734633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaa0b9-5521-48e0-bb43-5adbac98812d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:12.745753 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4275/8571] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:49:12.750168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e08b8-61bf-44a8-94a9-c68f49cbb2d4 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:12.760151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e08b8-61bf-44a8-94a9-c68f49cbb2d4 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:12.765427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235e5fe-8d13-4bf1-abd9-8b6eb0596148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:12.766074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235e5fe-8d13-4bf1-abd9-8b6eb0596148 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.766355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235e5fe-8d13-4bf1-abd9-8b6eb0596148 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.766632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235e5fe-8d13-4bf1-abd9-8b6eb0596148 admin admin] PATH_INFO: `/v3/projects/cd50de3fc33641aa996967fe934311e8/users/de8b634f360c40d595de8f641b1ac2ba/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.781939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235e5fe-8d13-4bf1-abd9-8b6eb0596148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd50de3fc33641aa996967fe934311e8, user_id=de8b634f360c40d595de8f641b1ac2ba, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:12.784611 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235e5fe-8d13-4bf1-abd9-8b6eb0596148 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:12.797924 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4297/8572] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:49:12 2022] PUT /identity/v3/projects/cd50de3fc33641aa996967fe934311e8/users/de8b634f360c40d595de8f641b1ac2ba/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:49:12.803112 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc405-6319-409d-9933-4493cef98ed3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.803429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc405-6319-409d-9933-4493cef98ed3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.803710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc405-6319-409d-9933-4493cef98ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.823376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-898dc405-6319-409d-9933-4493cef98ed3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:49:12.824686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-898dc405-6319-409d-9933-4493cef98ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:12.885613 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4276/8573] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:49:12.895912 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235e5fe-8d13-4bf1-abd9-8b6eb0596148 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:12.897753 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5235e5fe-8d13-4bf1-abd9-8b6eb0596148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:12.957439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235e5fe-8d13-4bf1-abd9-8b6eb0596148 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:12.961681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480bf35-2cba-4573-b68b-6b25e85403cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:12.962320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480bf35-2cba-4573-b68b-6b25e85403cc service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:12.962605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480bf35-2cba-4573-b68b-6b25e85403cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:12.962887 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480bf35-2cba-4573-b68b-6b25e85403cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:12.972803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480bf35-2cba-4573-b68b-6b25e85403cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:12.974255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480bf35-2cba-4573-b68b-6b25e85403cc service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:12.984888 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4298/8574] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:49:17.090086 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e495e88-0176-46e5-b8d2-e4593c5732c8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:17.090601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e495e88-0176-46e5-b8d2-e4593c5732c8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:17.090706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e495e88-0176-46e5-b8d2-e4593c5732c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:17.120080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2e495e88-0176-46e5-b8d2-e4593c5732c8 None None] MFA Rules not processed for user `de8b634f360c40d595de8f641b1ac2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:49:17.122062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2e495e88-0176-46e5-b8d2-e4593c5732c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:17.212062 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4277/8575] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:49:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:49:17.215386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093dc66-f8f4-4f36-916c-549830f3e20f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:17.215997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093dc66-f8f4-4f36-916c-549830f3e20f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:17.216135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093dc66-f8f4-4f36-916c-549830f3e20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:17.237409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5093dc66-f8f4-4f36-916c-549830f3e20f None None] MFA Rules not processed for user `de8b634f360c40d595de8f641b1ac2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:49:17.238656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5093dc66-f8f4-4f36-916c-549830f3e20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:17.245931 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4299/8576] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:49:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:49:17.259424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e495e88-0176-46e5-b8d2-e4593c5732c8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:17.260878 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2e495e88-0176-46e5-b8d2-e4593c5732c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:17.270875 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:17.343570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e495e88-0176-46e5-b8d2-e4593c5732c8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:17.349477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868bbc-75f7-4a32-93d6-a6d4a9081169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:17.350105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868bbc-75f7-4a32-93d6-a6d4a9081169 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:17.350383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868bbc-75f7-4a32-93d6-a6d4a9081169 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:17.350657 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868bbc-75f7-4a32-93d6-a6d4a9081169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:17.360090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76868bbc-75f7-4a32-93d6-a6d4a9081169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:17.361823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76868bbc-75f7-4a32-93d6-a6d4a9081169 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:17.372250 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4278/8577] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:49:26.088193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093dc66-f8f4-4f36-916c-549830f3e20f None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:26.089436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5093dc66-f8f4-4f36-916c-549830f3e20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:26.106710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093dc66-f8f4-4f36-916c-549830f3e20f None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:26.114983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:26.115615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:26.115898 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:26.116176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:26.117999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:26.134636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:26.136321 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:26.148938 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4300/8578] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:49:27.367130 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=31 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:27.918080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f128-c919-4db4-bbeb-c937d08ad7b2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:27.918575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f128-c919-4db4-bbeb-c937d08ad7b2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:27.918917 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f128-c919-4db4-bbeb-c937d08ad7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:27.939055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-04b1f128-c919-4db4-bbeb-c937d08ad7b2 None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:49:27.940433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-04b1f128-c919-4db4-bbeb-c937d08ad7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:27.947065 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4279/8579] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:49:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:49:27.959658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:27.961685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:27.974901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb29c2c-3df2-4d14-91ef-febfff014b2a service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:27.979024 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc5455-8ef4-4e7b-81d2-c4bb961ea786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:27.980190 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc5455-8ef4-4e7b-81d2-c4bb961ea786 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:27.980665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc5455-8ef4-4e7b-81d2-c4bb961ea786 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:27.981301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc5455-8ef4-4e7b-81d2-c4bb961ea786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:27.990524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc5455-8ef4-4e7b-81d2-c4bb961ea786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:27.992029 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc5455-8ef4-4e7b-81d2-c4bb961ea786 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:28.000401 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4301/8580] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:49:28.093133 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe074-7cb6-41fb-8ef9-d2afc29d7844 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:28.093429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe074-7cb6-41fb-8ef9-d2afc29d7844 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:28.093736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe074-7cb6-41fb-8ef9-d2afc29d7844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:28.113652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-38efe074-7cb6-41fb-8ef9-d2afc29d7844 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:49:28.114855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-38efe074-7cb6-41fb-8ef9-d2afc29d7844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:28.179813 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4280/8581] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:49:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:49:28.192513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc5455-8ef4-4e7b-81d2-c4bb961ea786 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:28.193904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bacc5455-8ef4-4e7b-81d2-c4bb961ea786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:28.212482 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc5455-8ef4-4e7b-81d2-c4bb961ea786 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:28.217959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf5e3a-3d79-4de2-9645-02648b90e833 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:28.218560 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf5e3a-3d79-4de2-9645-02648b90e833 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:28.218846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf5e3a-3d79-4de2-9645-02648b90e833 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:28.219120 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf5e3a-3d79-4de2-9645-02648b90e833 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:28.224284 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:28.229068 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf5e3a-3d79-4de2-9645-02648b90e833 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:28.231574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf5e3a-3d79-4de2-9645-02648b90e833 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:28.242892 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4302/8582] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:49:28.418305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822cc1f-5e29-4b9d-ab9f-71cbff34e463 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:28.418709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822cc1f-5e29-4b9d-ab9f-71cbff34e463 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:28.418868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822cc1f-5e29-4b9d-ab9f-71cbff34e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:28.442963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5822cc1f-5e29-4b9d-ab9f-71cbff34e463 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:49:28.444406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5822cc1f-5e29-4b9d-ab9f-71cbff34e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:28.456223 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4281/8583] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:49:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:49:28.466844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf5e3a-3d79-4de2-9645-02648b90e833 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:28.476702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf5e3a-3d79-4de2-9645-02648b90e833 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:28.480302 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e150f3-416d-4e19-9184-e0b744ea66a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:28.480954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e150f3-416d-4e19-9184-e0b744ea66a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:28.481232 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e150f3-416d-4e19-9184-e0b744ea66a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:28.481533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e150f3-416d-4e19-9184-e0b744ea66a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:28.491816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e150f3-416d-4e19-9184-e0b744ea66a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:28.493278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e150f3-416d-4e19-9184-e0b744ea66a8 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:28.504654 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4303/8584] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:49:38.435406 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=35 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:38.499900 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:44.308431 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822cc1f-5e29-4b9d-ab9f-71cbff34e463 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:49:44.309891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5822cc1f-5e29-4b9d-ab9f-71cbff34e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:44.324692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822cc1f-5e29-4b9d-ab9f-71cbff34e463 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:49:44.330491 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cb353-ed67-4fb2-ab93-6174f65f6c0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:49:44.331080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cb353-ed67-4fb2-ab93-6174f65f6c0f service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:49:44.331358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cb353-ed67-4fb2-ab93-6174f65f6c0f service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:49:44.331629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cb353-ed67-4fb2-ab93-6174f65f6c0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:49:44.333309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-492cb353-ed67-4fb2-ab93-6174f65f6c0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:49:44.344743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cb353-ed67-4fb2-ab93-6174f65f6c0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:49:44.346576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cb353-ed67-4fb2-ab93-6174f65f6c0f service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:49:44.357273 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4282/8585] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:49:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:49:54.352682 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:08.354131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e150f3-416d-4e19-9184-e0b744ea66a8 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:08.368760 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e150f3-416d-4e19-9184-e0b744ea66a8 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:08.373998 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:08.374695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:08.374981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:08.375255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] PATH_INFO: `/v3/users/de8b634f360c40d595de8f641b1ac2ba` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:08.376381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8b634f360c40d595de8f641b1ac2ba)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:08.378475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:08.428235 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8b634f360c40d595de8f641b1ac2ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.440553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8b634f360c40d595de8f641b1ac2ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.448115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8b634f360c40d595de8f641b1ac2ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.455686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8b634f360c40d595de8f641b1ac2ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.456355 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-c43fa334-7b1b-411f-8feb-91295379dc66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8b634f360c40d595de8f641b1ac2ba'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.462279 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4304/8586] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:50:08 2022] DELETE /identity/v3/users/de8b634f360c40d595de8f641b1ac2ba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:50:08.639784 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cb353-ed67-4fb2-ab93-6174f65f6c0f service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:08.653978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cb353-ed67-4fb2-ab93-6174f65f6c0f service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:08.714779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:08.715441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:08.715726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:08.716003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] PATH_INFO: `/v3/projects/cd50de3fc33641aa996967fe934311e8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:08.717543 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd50de3fc33641aa996967fe934311e8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:08.719482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:08.766858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd50de3fc33641aa996967fe934311e8', 'request_id': 'req-6312ca2c-71a2-470d-b1e8-d68bf20757fb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.774192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd50de3fc33641aa996967fe934311e8', 'request_id': 'req-6312ca2c-71a2-470d-b1e8-d68bf20757fb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.779899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd50de3fc33641aa996967fe934311e8', 'request_id': 'req-6312ca2c-71a2-470d-b1e8-d68bf20757fb'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.790787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] The token cache is being invalidate because project cd50de3fc33641aa996967fe934311e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:50:08.791069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.791722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-6312ca2c-71a2-470d-b1e8-d68bf20757fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:50:08.793525 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4283/8587] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:50:08 2022] DELETE /identity/v3/projects/cd50de3fc33641aa996967fe934311e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:50:08.799282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019da26-a0c0-48ff-ac32-bb9e042cafdf None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:08.799572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019da26-a0c0-48ff-ac32-bb9e042cafdf None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:08.799849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019da26-a0c0-48ff-ac32-bb9e042cafdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:08.820549 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-c019da26-a0c0-48ff-ac32-bb9e042cafdf None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:50:08.821822 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c019da26-a0c0-48ff-ac32-bb9e042cafdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:50:08.880183 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4305/8588] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:50:08.888722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb4eb-6172-42ab-91a6-c6a031b442a5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:08.889003 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb4eb-6172-42ab-91a6-c6a031b442a5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:08.889276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb4eb-6172-42ab-91a6-c6a031b442a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:08.909085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-860cb4eb-6172-42ab-91a6-c6a031b442a5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:50:08.910277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-860cb4eb-6172-42ab-91a6-c6a031b442a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:50:08.918559 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4284/8589] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:50:08.923580 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019da26-a0c0-48ff-ac32-bb9e042cafdf None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:08.933447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019da26-a0c0-48ff-ac32-bb9e042cafdf None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:08.938157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c60f7b-fe83-4f03-8e28-d1d3a80dd7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:08.938752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60f7b-fe83-4f03-8e28-d1d3a80dd7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:08.939036 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60f7b-fe83-4f03-8e28-d1d3a80dd7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:08.939311 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60f7b-fe83-4f03-8e28-d1d3a80dd7c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:08.940208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c60f7b-fe83-4f03-8e28-d1d3a80dd7c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:50:08.940511 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c60f7b-fe83-4f03-8e28-d1d3a80dd7c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:08.942139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c60f7b-fe83-4f03-8e28-d1d3a80dd7c8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:08.953819 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4306/8590] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:50:08.958044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cb4eb-6172-42ab-91a6-c6a031b442a5 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:08.968122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cb4eb-6172-42ab-91a6-c6a031b442a5 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:08.973223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985a3e3-ef00-4d1e-8332-5a3d0b4f2cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:08.973830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985a3e3-ef00-4d1e-8332-5a3d0b4f2cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:08.974116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985a3e3-ef00-4d1e-8332-5a3d0b4f2cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:08.974395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985a3e3-ef00-4d1e-8332-5a3d0b4f2cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:08.975039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985a3e3-ef00-4d1e-8332-5a3d0b4f2cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:08.977014 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985a3e3-ef00-4d1e-8332-5a3d0b4f2cd1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:09.004688 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4285/8591] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:50:08 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:50:09.009046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c60f7b-fe83-4f03-8e28-d1d3a80dd7c8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:09.019614 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c60f7b-fe83-4f03-8e28-d1d3a80dd7c8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:09.078523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb1b5b-1c0f-4d42-bec1-2a814321bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:09.079138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb1b5b-1c0f-4d42-bec1-2a814321bdac admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:09.079443 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb1b5b-1c0f-4d42-bec1-2a814321bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:09.079736 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb1b5b-1c0f-4d42-bec1-2a814321bdac admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:09.080405 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb1b5b-1c0f-4d42-bec1-2a814321bdac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:09.082424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb1b5b-1c0f-4d42-bec1-2a814321bdac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:09.090767 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:09.105473 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4307/8592] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:50:09 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:50:09.110173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985a3e3-ef00-4d1e-8332-5a3d0b4f2cd1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:09.120781 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985a3e3-ef00-4d1e-8332-5a3d0b4f2cd1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:09.125600 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d3751-1eb5-41e5-8e86-45a7c2fefa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:09.126207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d3751-1eb5-41e5-8e86-45a7c2fefa11 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:09.126490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d3751-1eb5-41e5-8e86-45a7c2fefa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:09.126788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d3751-1eb5-41e5-8e86-45a7c2fefa11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:09.127429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d3751-1eb5-41e5-8e86-45a7c2fefa11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:09.129080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d3751-1eb5-41e5-8e86-45a7c2fefa11 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:09.139360 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4286/8593] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:50:09.143278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb1b5b-1c0f-4d42-bec1-2a814321bdac admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:09.153648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb1b5b-1c0f-4d42-bec1-2a814321bdac admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:09.159109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd742a9b-5a27-4b75-b4f4-c06dc324d08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:09.159741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742a9b-5a27-4b75-b4f4-c06dc324d08e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:09.160051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742a9b-5a27-4b75-b4f4-c06dc324d08e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:09.160332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742a9b-5a27-4b75-b4f4-c06dc324d08e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:09.161018 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd742a9b-5a27-4b75-b4f4-c06dc324d08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:09.162638 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd742a9b-5a27-4b75-b4f4-c06dc324d08e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:09.174137 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4308/8594] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:50:09.178435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d3751-1eb5-41e5-8e86-45a7c2fefa11 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:09.188440 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d3751-1eb5-41e5-8e86-45a7c2fefa11 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:09.193295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086d834-62da-4daa-97a0-9b1b6b059900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:09.193940 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086d834-62da-4daa-97a0-9b1b6b059900 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:09.194216 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086d834-62da-4daa-97a0-9b1b6b059900 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:09.194485 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086d834-62da-4daa-97a0-9b1b6b059900 admin admin] PATH_INFO: `/v3/projects/e176820ed6b041a3ba53ba3a48d981bc/users/fcb986b39582494d9483241b4d38ce93/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:09.209903 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086d834-62da-4daa-97a0-9b1b6b059900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e176820ed6b041a3ba53ba3a48d981bc, user_id=fcb986b39582494d9483241b4d38ce93, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:09.212534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086d834-62da-4daa-97a0-9b1b6b059900 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:09.225693 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4287/8595] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:50:09 2022] PUT /identity/v3/projects/e176820ed6b041a3ba53ba3a48d981bc/users/fcb986b39582494d9483241b4d38ce93/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:50:09.230791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28b5b-d327-4b7e-952e-0d3caf15ca7f None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:09.231092 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28b5b-d327-4b7e-952e-0d3caf15ca7f None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:09.231357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28b5b-d327-4b7e-952e-0d3caf15ca7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:09.251625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-1dc28b5b-d327-4b7e-952e-0d3caf15ca7f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:50:09.252873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1dc28b5b-d327-4b7e-952e-0d3caf15ca7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:50:09.312022 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4309/8596] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:50:09.322126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086d834-62da-4daa-97a0-9b1b6b059900 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:09.323809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f086d834-62da-4daa-97a0-9b1b6b059900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:50:09.498120 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:09.527088 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086d834-62da-4daa-97a0-9b1b6b059900 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:09.531443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab78ad-7282-41d6-891c-324af88e326f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:09.532048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab78ad-7282-41d6-891c-324af88e326f service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:09.532327 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab78ad-7282-41d6-891c-324af88e326f service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:09.532597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab78ad-7282-41d6-891c-324af88e326f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:09.541539 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab78ad-7282-41d6-891c-324af88e326f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:09.542955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab78ad-7282-41d6-891c-324af88e326f service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:09.552325 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4288/8597] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:50:13.758234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4816e5-d504-48f4-8597-ce95c72127f3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:13.758780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4816e5-d504-48f4-8597-ce95c72127f3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:13.758780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4816e5-d504-48f4-8597-ce95c72127f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:13.790806 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6f4816e5-d504-48f4-8597-ce95c72127f3 None None] MFA Rules not processed for user `fcb986b39582494d9483241b4d38ce93`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:50:13.792117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6f4816e5-d504-48f4-8597-ce95c72127f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:50:13.863555 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4310/8598] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:50:13.874807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72690800-8e9f-4a72-a5a3-12a8479c97e6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:13.875336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72690800-8e9f-4a72-a5a3-12a8479c97e6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:13.875336 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72690800-8e9f-4a72-a5a3-12a8479c97e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:13.896687 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-72690800-8e9f-4a72-a5a3-12a8479c97e6 None None] MFA Rules not processed for user `fcb986b39582494d9483241b4d38ce93`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:50:13.898049 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-72690800-8e9f-4a72-a5a3-12a8479c97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:50:13.906017 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4289/8599] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:50:13.921082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4816e5-d504-48f4-8597-ce95c72127f3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:13.922526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6f4816e5-d504-48f4-8597-ce95c72127f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:50:14.004033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4816e5-d504-48f4-8597-ce95c72127f3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:14.010196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d453dfe-50ad-48c5-9208-27e55c67e903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:14.010883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453dfe-50ad-48c5-9208-27e55c67e903 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:14.011104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453dfe-50ad-48c5-9208-27e55c67e903 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:14.011382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453dfe-50ad-48c5-9208-27e55c67e903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:14.018006 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:14.023271 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d453dfe-50ad-48c5-9208-27e55c67e903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:14.025436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d453dfe-50ad-48c5-9208-27e55c67e903 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:14.036459 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4311/8600] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:50:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:50:23.890543 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=17 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:24.032393 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:38.184982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72690800-8e9f-4a72-a5a3-12a8479c97e6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:50:38.186365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-72690800-8e9f-4a72-a5a3-12a8479c97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:50:38.257368 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72690800-8e9f-4a72-a5a3-12a8479c97e6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:50:38.262686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:50:38.263282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:50:38.263561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:50:38.263834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:50:38.265701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:50:38.278462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:50:38.280067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:50:38.289930 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4290/8601] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:50:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:50:48.285912 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=32 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:02.435074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02987e-3d9c-471b-987d-59b9822ca603 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:02.435687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02987e-3d9c-471b-987d-59b9822ca603 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:02.435687 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02987e-3d9c-471b-987d-59b9822ca603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:02.456565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ec02987e-3d9c-471b-987d-59b9822ca603 None None] MFA Rules not processed for user `fcb986b39582494d9483241b4d38ce93`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:51:02.457812 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ec02987e-3d9c-471b-987d-59b9822ca603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:51:02.464813 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4312/8602] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:51:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:51:03.031010 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:03.032424 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:51:03.044636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98607aad-f703-4f83-8d19-80f29e57c3db service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:03.048342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf00a36-904f-43b7-ba56-cb615705537e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:03.049039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf00a36-904f-43b7-ba56-cb615705537e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:03.049320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf00a36-904f-43b7-ba56-cb615705537e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:03.049594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf00a36-904f-43b7-ba56-cb615705537e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:03.052036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ccf00a36-904f-43b7-ba56-cb615705537e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:51:03.061989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf00a36-904f-43b7-ba56-cb615705537e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:03.063399 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf00a36-904f-43b7-ba56-cb615705537e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:03.071477 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4291/8603] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:51:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:51:12.450625 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:13.068038 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:42.477397 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02987e-3d9c-471b-987d-59b9822ca603 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:42.496477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02987e-3d9c-471b-987d-59b9822ca603 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:42.500060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d949b-2dcb-432e-b0b9-076a00dab39b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:42.501177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d949b-2dcb-432e-b0b9-076a00dab39b service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:42.501453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d949b-2dcb-432e-b0b9-076a00dab39b service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:42.501728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d949b-2dcb-432e-b0b9-076a00dab39b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:42.503430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7c4d949b-2dcb-432e-b0b9-076a00dab39b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:51:42.512720 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d949b-2dcb-432e-b0b9-076a00dab39b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:42.514117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d949b-2dcb-432e-b0b9-076a00dab39b service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:42.522670 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4313/8604] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:51:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:51:52.519069 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:56.280761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf00a36-904f-43b7-ba56-cb615705537e service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:56.315704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf00a36-904f-43b7-ba56-cb615705537e service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:56.320515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:56.321295 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:56.321577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:56.321852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] PATH_INFO: `/v3/users/fcb986b39582494d9483241b4d38ce93` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:56.323015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb986b39582494d9483241b4d38ce93)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:56.325013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:56.376731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb986b39582494d9483241b4d38ce93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.388593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb986b39582494d9483241b4d38ce93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.396061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb986b39582494d9483241b4d38ce93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.403221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb986b39582494d9483241b4d38ce93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.403862 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-faa96650-8bb6-455b-8058-a1c781fa22a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb986b39582494d9483241b4d38ce93'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.409738 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4292/8605] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:51:56 2022] DELETE /identity/v3/users/fcb986b39582494d9483241b4d38ce93 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:51:56.584603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d949b-2dcb-432e-b0b9-076a00dab39b service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:56.596339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d949b-2dcb-432e-b0b9-076a00dab39b service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:56.663925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:56.664559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:56.664873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:56.665151 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] PATH_INFO: `/v3/projects/e176820ed6b041a3ba53ba3a48d981bc` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:56.666288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e176820ed6b041a3ba53ba3a48d981bc)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:56.668228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:56.717126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e176820ed6b041a3ba53ba3a48d981bc', 'request_id': 'req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.725367 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e176820ed6b041a3ba53ba3a48d981bc', 'request_id': 'req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.731576 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e176820ed6b041a3ba53ba3a48d981bc', 'request_id': 'req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.744279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] The token cache is being invalidate because project e176820ed6b041a3ba53ba3a48d981bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:51:56.744682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.745499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-803b52a1-dc2e-4e4c-9ea5-70264e72c67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:51:56.747020 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4314/8606] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:51:56 2022] DELETE /identity/v3/projects/e176820ed6b041a3ba53ba3a48d981bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:51:56.751965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cabe5-e128-4e6c-95a8-c02ff1552259 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:56.752254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cabe5-e128-4e6c-95a8-c02ff1552259 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:56.752525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cabe5-e128-4e6c-95a8-c02ff1552259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:56.772346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c99cabe5-e128-4e6c-95a8-c02ff1552259 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:51:56.773514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c99cabe5-e128-4e6c-95a8-c02ff1552259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:51:56.831617 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4293/8607] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:51:56.839513 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d0048-65e6-4b19-aaff-6ccaf6b7cd21 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:56.839801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d0048-65e6-4b19-aaff-6ccaf6b7cd21 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:56.840083 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d0048-65e6-4b19-aaff-6ccaf6b7cd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:56.860842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-bc9d0048-65e6-4b19-aaff-6ccaf6b7cd21 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:51:56.862059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-bc9d0048-65e6-4b19-aaff-6ccaf6b7cd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:51:56.870169 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4315/8608] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:51:56.874337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cabe5-e128-4e6c-95a8-c02ff1552259 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:56.884146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cabe5-e128-4e6c-95a8-c02ff1552259 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:56.888725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e753a-61c4-4d7e-ac0f-f86aea646918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:56.889321 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e753a-61c4-4d7e-ac0f-f86aea646918 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:56.889607 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e753a-61c4-4d7e-ac0f-f86aea646918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:56.889879 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e753a-61c4-4d7e-ac0f-f86aea646918 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:56.890548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e753a-61c4-4d7e-ac0f-f86aea646918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:51:56.890958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e753a-61c4-4d7e-ac0f-f86aea646918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:56.892538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e753a-61c4-4d7e-ac0f-f86aea646918 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:56.903900 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4294/8609] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 01:51:56.908694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d0048-65e6-4b19-aaff-6ccaf6b7cd21 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:56.918128 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d0048-65e6-4b19-aaff-6ccaf6b7cd21 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:56.923400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe06bfa-49d3-462c-bcf3-b3236cc0ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:56.923997 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe06bfa-49d3-462c-bcf3-b3236cc0ef19 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:56.924277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe06bfa-49d3-462c-bcf3-b3236cc0ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:56.924554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe06bfa-49d3-462c-bcf3-b3236cc0ef19 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:56.925208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe06bfa-49d3-462c-bcf3-b3236cc0ef19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:56.927106 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe06bfa-49d3-462c-bcf3-b3236cc0ef19 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:56.957206 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4316/8610] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:51:56 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:51:56.958498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e753a-61c4-4d7e-ac0f-f86aea646918 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:56.969211 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e753a-61c4-4d7e-ac0f-f86aea646918 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:57.012888 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:57.027151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6165b-c980-4f05-aba0-b178422c34c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:57.027694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6165b-c980-4f05-aba0-b178422c34c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:57.027982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6165b-c980-4f05-aba0-b178422c34c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:57.028253 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6165b-c980-4f05-aba0-b178422c34c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:57.028905 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6165b-c980-4f05-aba0-b178422c34c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:57.030823 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6165b-c980-4f05-aba0-b178422c34c9 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:57.052772 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4295/8611] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:51:56 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:51:57.056935 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe06bfa-49d3-462c-bcf3-b3236cc0ef19 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:57.068228 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe06bfa-49d3-462c-bcf3-b3236cc0ef19 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:57.072904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89977a-5545-4fe3-8fa5-c68b505e7cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:57.073534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89977a-5545-4fe3-8fa5-c68b505e7cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:57.073819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89977a-5545-4fe3-8fa5-c68b505e7cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:57.074095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89977a-5545-4fe3-8fa5-c68b505e7cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:57.074730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89977a-5545-4fe3-8fa5-c68b505e7cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:57.076332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89977a-5545-4fe3-8fa5-c68b505e7cb8 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:57.086952 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4317/8612] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:51:57.090777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6165b-c980-4f05-aba0-b178422c34c9 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:57.101078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6165b-c980-4f05-aba0-b178422c34c9 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:57.105740 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96edc52-d740-4762-a67d-0aaf403e1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:57.106337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96edc52-d740-4762-a67d-0aaf403e1f8f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:57.106624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96edc52-d740-4762-a67d-0aaf403e1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:57.106900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96edc52-d740-4762-a67d-0aaf403e1f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:57.107537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96edc52-d740-4762-a67d-0aaf403e1f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:57.109676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96edc52-d740-4762-a67d-0aaf403e1f8f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:57.120344 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4296/8613] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:51:57.124589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89977a-5545-4fe3-8fa5-c68b505e7cb8 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:57.135409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89977a-5545-4fe3-8fa5-c68b505e7cb8 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:57.140313 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eb2f0-3800-4578-af4e-376fe53cca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:57.141086 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb2f0-3800-4578-af4e-376fe53cca5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:57.141372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb2f0-3800-4578-af4e-376fe53cca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:57.141650 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb2f0-3800-4578-af4e-376fe53cca5b admin admin] PATH_INFO: `/v3/projects/34f3d54d905646719fc1e7470e7dd959/users/dd9317ca3ff04c259208b5b70b53383d/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:57.157711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eb2f0-3800-4578-af4e-376fe53cca5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f3d54d905646719fc1e7470e7dd959, user_id=dd9317ca3ff04c259208b5b70b53383d, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:57.160386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eb2f0-3800-4578-af4e-376fe53cca5b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:57.174123 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4318/8614] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:51:57 2022] PUT /identity/v3/projects/34f3d54d905646719fc1e7470e7dd959/users/dd9317ca3ff04c259208b5b70b53383d/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:51:57.179080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f17d2-9607-4b53-bd98-d5b86360a3d5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:57.179366 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f17d2-9607-4b53-bd98-d5b86360a3d5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:57.179690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f17d2-9607-4b53-bd98-d5b86360a3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:57.199127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a33f17d2-9607-4b53-bd98-d5b86360a3d5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:51:57.200325 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a33f17d2-9607-4b53-bd98-d5b86360a3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:51:57.262091 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4297/8615] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:51:57.271999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eb2f0-3800-4578-af4e-376fe53cca5b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:51:57.273842 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-877eb2f0-3800-4578-af4e-376fe53cca5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:51:57.305238 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:57.334527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eb2f0-3800-4578-af4e-376fe53cca5b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:51:57.338263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1305c-7704-4c8b-93fc-d1a19cb9280a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:51:57.338866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1305c-7704-4c8b-93fc-d1a19cb9280a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:51:57.339148 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1305c-7704-4c8b-93fc-d1a19cb9280a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:51:57.339420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1305c-7704-4c8b-93fc-d1a19cb9280a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:51:57.348371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1305c-7704-4c8b-93fc-d1a19cb9280a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:51:57.349826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1305c-7704-4c8b-93fc-d1a19cb9280a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:51:57.359725 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4319/8616] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:52:01.450930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2f89-08af-49a7-a3ee-749e1bf163b0 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:52:01.451413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2f89-08af-49a7-a3ee-749e1bf163b0 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:52:01.451678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2f89-08af-49a7-a3ee-749e1bf163b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:52:01.488087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fa8f2f89-08af-49a7-a3ee-749e1bf163b0 None None] MFA Rules not processed for user `dd9317ca3ff04c259208b5b70b53383d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:52:01.489492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fa8f2f89-08af-49a7-a3ee-749e1bf163b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:52:01.583669 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4298/8617] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:52:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:52:01.598199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1305c-7704-4c8b-93fc-d1a19cb9280a service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:52:01.599763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b1e1305c-7704-4c8b-93fc-d1a19cb9280a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:52:01.689206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1305c-7704-4c8b-93fc-d1a19cb9280a service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:52:01.694960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfa1b1-48ed-44f2-85e7-5d73ab9ea5fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:52:01.695586 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfa1b1-48ed-44f2-85e7-5d73ab9ea5fd service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:52:01.695863 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfa1b1-48ed-44f2-85e7-5d73ab9ea5fd service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:52:01.696135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfa1b1-48ed-44f2-85e7-5d73ab9ea5fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:52:01.705490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfa1b1-48ed-44f2-85e7-5d73ab9ea5fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:52:01.707089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfa1b1-48ed-44f2-85e7-5d73ab9ea5fd service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:52:01.716931 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4320/8618] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:52:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:52:03.039261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc511809-7f02-4670-b2d6-a763dfefc8f3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:52:03.039854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc511809-7f02-4670-b2d6-a763dfefc8f3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:52:03.039854 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc511809-7f02-4670-b2d6-a763dfefc8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:52:03.060410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-dc511809-7f02-4670-b2d6-a763dfefc8f3 None None] MFA Rules not processed for user `dd9317ca3ff04c259208b5b70b53383d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:52:03.061880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dc511809-7f02-4670-b2d6-a763dfefc8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:52:03.069927 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4299/8619] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:52:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:52:03.729548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfa1b1-48ed-44f2-85e7-5d73ab9ea5fd service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:52:03.731593 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-babfa1b1-48ed-44f2-85e7-5d73ab9ea5fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:52:03.816692 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfa1b1-48ed-44f2-85e7-5d73ab9ea5fd service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:52:03.821830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86842c5-33a2-44eb-8b7e-42087f8f8515 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:52:03.822479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86842c5-33a2-44eb-8b7e-42087f8f8515 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:52:03.822763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86842c5-33a2-44eb-8b7e-42087f8f8515 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:52:03.823040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86842c5-33a2-44eb-8b7e-42087f8f8515 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:52:03.824843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c86842c5-33a2-44eb-8b7e-42087f8f8515 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:52:03.837160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86842c5-33a2-44eb-8b7e-42087f8f8515 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:52:03.838751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86842c5-33a2-44eb-8b7e-42087f8f8515 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:52:03.849216 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4321/8620] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:52:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:52:13.054731 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:13.844712 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=84 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:52.033988 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc511809-7f02-4670-b2d6-a763dfefc8f3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:52:52.035666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dc511809-7f02-4670-b2d6-a763dfefc8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:52:52.091860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc511809-7f02-4670-b2d6-a763dfefc8f3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:52:52.096481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53eba0-c3b2-4c84-9947-2332fecbdb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:52:52.097387 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53eba0-c3b2-4c84-9947-2332fecbdb72 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:52:52.097845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53eba0-c3b2-4c84-9947-2332fecbdb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:52:52.098122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53eba0-c3b2-4c84-9947-2332fecbdb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:52:52.099971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-bb53eba0-c3b2-4c84-9947-2332fecbdb72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:52:52.111090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53eba0-c3b2-4c84-9947-2332fecbdb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:52:52.112533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53eba0-c3b2-4c84-9947-2332fecbdb72 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:52:52.121060 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4300/8621] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:52:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:53:02.117041 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=19 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:53:10.353206 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86842c5-33a2-44eb-8b7e-42087f8f8515 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:53:10.372166 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86842c5-33a2-44eb-8b7e-42087f8f8515 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:53:10.376421 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1852e-5b34-45b8-a36a-8dcabbe99da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:53:10.377050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1852e-5b34-45b8-a36a-8dcabbe99da3 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:53:10.377327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1852e-5b34-45b8-a36a-8dcabbe99da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:53:10.377597 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1852e-5b34-45b8-a36a-8dcabbe99da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:53:10.379267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-67b1852e-5b34-45b8-a36a-8dcabbe99da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:53:10.392847 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1852e-5b34-45b8-a36a-8dcabbe99da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:53:10.394248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1852e-5b34-45b8-a36a-8dcabbe99da3 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:53:10.404934 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4322/8622] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:53:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:53:11.427993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53eba0-c3b2-4c84-9947-2332fecbdb72 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:53:11.442180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53eba0-c3b2-4c84-9947-2332fecbdb72 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:53:11.447797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4988c-5a37-46a8-8fc8-6a0866b66bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:53:11.448409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4988c-5a37-46a8-8fc8-6a0866b66bf4 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:53:11.448722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4988c-5a37-46a8-8fc8-6a0866b66bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:53:11.448995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4988c-5a37-46a8-8fc8-6a0866b66bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:53:11.451458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5cf4988c-5a37-46a8-8fc8-6a0866b66bf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:53:11.463919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4988c-5a37-46a8-8fc8-6a0866b66bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:53:11.465521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4988c-5a37-46a8-8fc8-6a0866b66bf4 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:53:11.476807 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4301/8623] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:53:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:53:13.131776 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1852e-5b34-45b8-a36a-8dcabbe99da3 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:53:13.140722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1852e-5b34-45b8-a36a-8dcabbe99da3 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:53:13.144411 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2839507-d164-4bb9-99ee-53034dfe2b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:53:13.145050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2839507-d164-4bb9-99ee-53034dfe2b6d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:53:13.145331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2839507-d164-4bb9-99ee-53034dfe2b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:53:13.145607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2839507-d164-4bb9-99ee-53034dfe2b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:53:13.147326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f2839507-d164-4bb9-99ee-53034dfe2b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:53:13.160773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2839507-d164-4bb9-99ee-53034dfe2b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:53:13.162193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2839507-d164-4bb9-99ee-53034dfe2b6d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:53:13.173691 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4323/8624] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:53:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:53:21.218972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125c08-c189-4aa1-8bd8-b0aa095d0960 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:53:21.219448 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125c08-c189-4aa1-8bd8-b0aa095d0960 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:53:21.219551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125c08-c189-4aa1-8bd8-b0aa095d0960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:53:21.239009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-31125c08-c189-4aa1-8bd8-b0aa095d0960 None None] MFA Rules not processed for user `dd9317ca3ff04c259208b5b70b53383d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:53:21.240223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-31125c08-c189-4aa1-8bd8-b0aa095d0960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:53:21.247217 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4302/8625] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:53:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:53:21.558389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2839507-d164-4bb9-99ee-53034dfe2b6d service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:53:21.567976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2839507-d164-4bb9-99ee-53034dfe2b6d service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:53:21.571751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcde99d-127b-4166-b536-2d5856e7b53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:53:21.572348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde99d-127b-4166-b536-2d5856e7b53d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:53:21.572657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde99d-127b-4166-b536-2d5856e7b53d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:53:21.572933 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde99d-127b-4166-b536-2d5856e7b53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:53:21.574662 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cfcde99d-127b-4166-b536-2d5856e7b53d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:53:21.585249 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde99d-127b-4166-b536-2d5856e7b53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:53:21.586665 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde99d-127b-4166-b536-2d5856e7b53d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:53:21.594769 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4324/8626] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:53:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:53:31.233784 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=9 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:53:31.591044 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=23 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:21.586870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125c08-c189-4aa1-8bd8-b0aa095d0960 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:54:21.606174 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125c08-c189-4aa1-8bd8-b0aa095d0960 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:54:21.611462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1500aa-82c1-4633-bd0c-613a4e9a0ff3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:54:21.612070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1500aa-82c1-4633-bd0c-613a4e9a0ff3 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:54:21.612351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1500aa-82c1-4633-bd0c-613a4e9a0ff3 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:54:21.612643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1500aa-82c1-4633-bd0c-613a4e9a0ff3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:54:21.614436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8e1500aa-82c1-4633-bd0c-613a4e9a0ff3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:54:21.626376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1500aa-82c1-4633-bd0c-613a4e9a0ff3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:54:21.627937 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1500aa-82c1-4633-bd0c-613a4e9a0ff3 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:54:21.637674 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4303/8627] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:54:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:54:31.633659 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=9 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:31.954031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcde99d-127b-4166-b536-2d5856e7b53d service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:54:31.978781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcde99d-127b-4166-b536-2d5856e7b53d service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:54:31.985347 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:54:31.985976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:54:31.986261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:54:31.986543 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:54:31.988298 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:54:32.006033 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:54:32.008284 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:54:32.020879 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4325/8628] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:54:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:54:38.050635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e2478-615e-440e-951f-a75565ee8298 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:54:38.051124 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e2478-615e-440e-951f-a75565ee8298 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:54:38.051223 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e2478-615e-440e-951f-a75565ee8298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:54:38.070774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-528e2478-615e-440e-951f-a75565ee8298 None None] MFA Rules not processed for user `dd9317ca3ff04c259208b5b70b53383d`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:54:38.071973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-528e2478-615e-440e-951f-a75565ee8298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:54:38.079526 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4304/8629] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:54:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:54:42.015912 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:42.520016 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:54:42.521590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:54:42.535789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1840fc8-55ab-46e1-93a5-c741f3f4f1c2 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:54:42.541722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028ba5-2607-4f81-b4f6-edb87568dbf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:54:42.542343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028ba5-2607-4f81-b4f6-edb87568dbf4 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:54:42.542628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028ba5-2607-4f81-b4f6-edb87568dbf4 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:54:42.543110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028ba5-2607-4f81-b4f6-edb87568dbf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:54:42.545314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-86028ba5-2607-4f81-b4f6-edb87568dbf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:54:42.557874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86028ba5-2607-4f81-b4f6-edb87568dbf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:54:42.560064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86028ba5-2607-4f81-b4f6-edb87568dbf4 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:54:42.571468 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4326/8630] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:54:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:54:48.065875 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:50.264902 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e2478-615e-440e-951f-a75565ee8298 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:54:50.293653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e2478-615e-440e-951f-a75565ee8298 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:54:50.299221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:54:50.300071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:54:50.300354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:54:50.300722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:54:50.302604 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:54:50.315585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:54:50.317497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:54:50.341966 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4305/8631] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:54:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:54:52.566884 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:00.324440 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=10 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:31.267283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028ba5-2607-4f81-b4f6-edb87568dbf4 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:55:31.277807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028ba5-2607-4f81-b4f6-edb87568dbf4 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:55:31.281450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4222b6b-6bce-436c-a028-6dab6c1f261a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:55:31.282053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4222b6b-6bce-436c-a028-6dab6c1f261a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:55:31.282331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4222b6b-6bce-436c-a028-6dab6c1f261a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:55:31.282606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4222b6b-6bce-436c-a028-6dab6c1f261a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:55:31.284346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c4222b6b-6bce-436c-a028-6dab6c1f261a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:55:31.309466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4222b6b-6bce-436c-a028-6dab6c1f261a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:55:31.310881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4222b6b-6bce-436c-a028-6dab6c1f261a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:55:31.319729 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4327/8632] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:55:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:55:31.397654 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:55:31.399111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:55:31.412323 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92c19-4894-4102-8e8a-eb02fc10aa86 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:55:31.418276 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5cce6-62ce-4f8d-bbd3-341e02a86353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:55:31.418870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5cce6-62ce-4f8d-bbd3-341e02a86353 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:55:31.419161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5cce6-62ce-4f8d-bbd3-341e02a86353 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:55:31.419433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5cce6-62ce-4f8d-bbd3-341e02a86353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:55:31.421105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-54e5cce6-62ce-4f8d-bbd3-341e02a86353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:55:31.431998 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5cce6-62ce-4f8d-bbd3-341e02a86353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:55:31.434100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5cce6-62ce-4f8d-bbd3-341e02a86353 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:55:31.443946 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4306/8633] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:55:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:55:31.624073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4222b6b-6bce-436c-a028-6dab6c1f261a service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:55:31.632845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4222b6b-6bce-436c-a028-6dab6c1f261a service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:55:31.636648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36fa76-bede-48ec-be86-c809183f7c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:55:31.637260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36fa76-bede-48ec-be86-c809183f7c16 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:55:31.637536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36fa76-bede-48ec-be86-c809183f7c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:55:31.637804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36fa76-bede-48ec-be86-c809183f7c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:55:31.639495 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dd36fa76-bede-48ec-be86-c809183f7c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:55:31.652900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36fa76-bede-48ec-be86-c809183f7c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:55:31.654301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36fa76-bede-48ec-be86-c809183f7c16 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:55:31.665647 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4328/8634] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:55:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:55:41.439968 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:41.660957 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=17 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:44.207808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5cce6-62ce-4f8d-bbd3-341e02a86353 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:55:44.219129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5cce6-62ce-4f8d-bbd3-341e02a86353 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:55:44.224249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:55:44.224884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:55:44.225168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:55:44.225445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:55:44.227148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:55:44.252819 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:55:44.254332 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:55:44.265896 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4307/8635] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:55:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:55:54.261467 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=11 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:00.747427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab972503-0969-47a5-a63e-1043754dc2dc None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:56:00.747917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab972503-0969-47a5-a63e-1043754dc2dc None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:56:00.748025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab972503-0969-47a5-a63e-1043754dc2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:56:00.769116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ab972503-0969-47a5-a63e-1043754dc2dc None None] MFA Rules not processed for user `dd9317ca3ff04c259208b5b70b53383d`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:56:00.770365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab972503-0969-47a5-a63e-1043754dc2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:56:00.778264 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4329/8636] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:56:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:56:10.763737 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:01.442092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:57:01.443528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:57:01.520320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91f32-97ff-4dff-89db-bd1fbf7fec75 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:57:01.523945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc6be4-974a-4cbb-8e62-6a32b3418826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:57:01.524542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6be4-974a-4cbb-8e62-6a32b3418826 service cinder] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:57:01.524849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6be4-974a-4cbb-8e62-6a32b3418826 service cinder] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:57:01.525121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6be4-974a-4cbb-8e62-6a32b3418826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:57:01.533559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc6be4-974a-4cbb-8e62-6a32b3418826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:57:01.534981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc6be4-974a-4cbb-8e62-6a32b3418826 service cinder] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:57:01.543773 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4308/8637] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:57:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:57:11.539720 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=35 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:24.071263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab972503-0969-47a5-a63e-1043754dc2dc None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:57:24.081242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab972503-0969-47a5-a63e-1043754dc2dc None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:57:24.084907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b641656-53f2-4cef-b57d-d699f75f9f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:57:24.085524 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b641656-53f2-4cef-b57d-d699f75f9f34 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:57:24.085801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b641656-53f2-4cef-b57d-d699f75f9f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:57:24.088678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b641656-53f2-4cef-b57d-d699f75f9f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:57:24.088678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8b641656-53f2-4cef-b57d-d699f75f9f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:57:24.098814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b641656-53f2-4cef-b57d-d699f75f9f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:57:24.100239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b641656-53f2-4cef-b57d-d699f75f9f34 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:57:24.109363 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4330/8638] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:57:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:57:34.104759 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:57.929598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc6be4-974a-4cbb-8e62-6a32b3418826 service cinder] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:57:57.940028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc6be4-974a-4cbb-8e62-6a32b3418826 service cinder] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:57:57.943797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b60a89-ad6e-4329-96ab-6b626661d29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:57:57.944409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b60a89-ad6e-4329-96ab-6b626661d29f service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:57:57.944728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b60a89-ad6e-4329-96ab-6b626661d29f service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:57:57.945008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b60a89-ad6e-4329-96ab-6b626661d29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:57:57.952777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b60a89-ad6e-4329-96ab-6b626661d29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:57:57.954203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b60a89-ad6e-4329-96ab-6b626661d29f service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:57:57.963257 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4309/8639] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:57:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:58:07.960111 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:11.230325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b641656-53f2-4cef-b57d-d699f75f9f34 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:11.238984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b641656-53f2-4cef-b57d-d699f75f9f34 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:11.244035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faff109-fd53-4c42-a6fe-a951cdf87952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:11.244697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faff109-fd53-4c42-a6fe-a951cdf87952 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:11.245030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faff109-fd53-4c42-a6fe-a951cdf87952 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:11.245307 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faff109-fd53-4c42-a6fe-a951cdf87952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:11.254685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faff109-fd53-4c42-a6fe-a951cdf87952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:11.256101 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faff109-fd53-4c42-a6fe-a951cdf87952 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:11.266436 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4331/8640] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:58:14.538682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b60a89-ad6e-4329-96ab-6b626661d29f service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:14.551203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b60a89-ad6e-4329-96ab-6b626661d29f service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:14.557593 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77feb9-5301-4808-94d0-dc0e1d3a0de6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:14.558201 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77feb9-5301-4808-94d0-dc0e1d3a0de6 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:14.559390 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77feb9-5301-4808-94d0-dc0e1d3a0de6 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:14.559918 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77feb9-5301-4808-94d0-dc0e1d3a0de6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:14.562441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0a77feb9-5301-4808-94d0-dc0e1d3a0de6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:14.574824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77feb9-5301-4808-94d0-dc0e1d3a0de6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:14.576906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77feb9-5301-4808-94d0-dc0e1d3a0de6 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:14.588209 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4310/8641] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:58:14.609295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faff109-fd53-4c42-a6fe-a951cdf87952 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:14.619843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faff109-fd53-4c42-a6fe-a951cdf87952 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:14.625324 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:14.625895 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:14.626172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:14.626446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] PATH_INFO: `/v3/users/dd9317ca3ff04c259208b5b70b53383d` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:14.627606 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9317ca3ff04c259208b5b70b53383d)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:14.629591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:14.680014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9317ca3ff04c259208b5b70b53383d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:14.692484 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9317ca3ff04c259208b5b70b53383d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:14.700283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9317ca3ff04c259208b5b70b53383d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:14.707669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9317ca3ff04c259208b5b70b53383d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:14.708315 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-e9e4770a-66a1-487f-8b36-11183e2f28ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9317ca3ff04c259208b5b70b53383d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:14.715287 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4332/8642] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:58:14 2022] DELETE /identity/v3/users/dd9317ca3ff04c259208b5b70b53383d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:58:14.894095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77feb9-5301-4808-94d0-dc0e1d3a0de6 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:14.907265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77feb9-5301-4808-94d0-dc0e1d3a0de6 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:14.966535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:14.967166 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:14.967445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:14.967721 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] PATH_INFO: `/v3/projects/34f3d54d905646719fc1e7470e7dd959` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:14.968921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f3d54d905646719fc1e7470e7dd959)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:14.970815 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:15.021565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f3d54d905646719fc1e7470e7dd959', 'request_id': 'req-45ba1ba2-9b77-4c92-aaad-9f09d1516070'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:15.030743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f3d54d905646719fc1e7470e7dd959', 'request_id': 'req-45ba1ba2-9b77-4c92-aaad-9f09d1516070'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:15.037202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f3d54d905646719fc1e7470e7dd959', 'request_id': 'req-45ba1ba2-9b77-4c92-aaad-9f09d1516070'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:15.050877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] The token cache is being invalidate because project 34f3d54d905646719fc1e7470e7dd959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:58:15.051105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:15.051779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-45ba1ba2-9b77-4c92-aaad-9f09d1516070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:15.053633 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4311/8643] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:58:14 2022] DELETE /identity/v3/projects/34f3d54d905646719fc1e7470e7dd959 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:58:15.058519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d5bf5-8f24-4219-9920-2f3b69daf0c3 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.058799 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d5bf5-8f24-4219-9920-2f3b69daf0c3 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.059082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d5bf5-8f24-4219-9920-2f3b69daf0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.097826 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3a4d5bf5-8f24-4219-9920-2f3b69daf0c3 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:15.099102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3a4d5bf5-8f24-4219-9920-2f3b69daf0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:15.162385 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4333/8644] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:58:15.170343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c7d8-901f-41f4-bb9e-429eadcc197f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.170628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c7d8-901f-41f4-bb9e-429eadcc197f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.170933 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c7d8-901f-41f4-bb9e-429eadcc197f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.190957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c5d8c7d8-901f-41f4-bb9e-429eadcc197f None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:15.192171 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c5d8c7d8-901f-41f4-bb9e-429eadcc197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:15.200761 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4312/8645] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:58:15.205014 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d5bf5-8f24-4219-9920-2f3b69daf0c3 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:15.215602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d5bf5-8f24-4219-9920-2f3b69daf0c3 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:15.220229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48535-795a-4c13-b456-267c08f79478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:15.220843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48535-795a-4c13-b456-267c08f79478 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.221124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48535-795a-4c13-b456-267c08f79478 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.221395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48535-795a-4c13-b456-267c08f79478 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.222079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c48535-795a-4c13-b456-267c08f79478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:58:15.222379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c48535-795a-4c13-b456-267c08f79478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:15.223965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c48535-795a-4c13-b456-267c08f79478 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:15.235748 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4334/8646] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:58:15.239968 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c7d8-901f-41f4-bb9e-429eadcc197f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:15.249509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c7d8-901f-41f4-bb9e-429eadcc197f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:15.254187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52031-2534-4c47-942f-9058d6703092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:15.254788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52031-2534-4c47-942f-9058d6703092 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.255072 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52031-2534-4c47-942f-9058d6703092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.255348 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52031-2534-4c47-942f-9058d6703092 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.255965 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52031-2534-4c47-942f-9058d6703092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:15.258414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52031-2534-4c47-942f-9058d6703092 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:15.285893 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4313/8647] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:58:15 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:58:15.290164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48535-795a-4c13-b456-267c08f79478 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:15.303142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48535-795a-4c13-b456-267c08f79478 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:15.339042 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:15.363960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a64a1-25e4-4683-9f50-4329784abf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:15.364563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a64a1-25e4-4683-9f50-4329784abf95 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.364870 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a64a1-25e4-4683-9f50-4329784abf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.365141 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a64a1-25e4-4683-9f50-4329784abf95 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.365758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a64a1-25e4-4683-9f50-4329784abf95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:15.368285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a64a1-25e4-4683-9f50-4329784abf95 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:15.389623 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4335/8648] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:58:15 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:58:15.394076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52031-2534-4c47-942f-9058d6703092 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:15.404759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52031-2534-4c47-942f-9058d6703092 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:15.409463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab3c8d-29fc-4701-ba77-1b98832e2d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:15.410062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab3c8d-29fc-4701-ba77-1b98832e2d62 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.410345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab3c8d-29fc-4701-ba77-1b98832e2d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.410627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab3c8d-29fc-4701-ba77-1b98832e2d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.411265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab3c8d-29fc-4701-ba77-1b98832e2d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:15.413076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab3c8d-29fc-4701-ba77-1b98832e2d62 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:15.423683 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4314/8649] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:58:15.427577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a64a1-25e4-4683-9f50-4329784abf95 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:15.438670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a64a1-25e4-4683-9f50-4329784abf95 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:15.443326 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cda120-ff58-4397-93f0-7d7a95cb0d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:15.443917 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cda120-ff58-4397-93f0-7d7a95cb0d0f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.444830 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cda120-ff58-4397-93f0-7d7a95cb0d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.445821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cda120-ff58-4397-93f0-7d7a95cb0d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.446532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cda120-ff58-4397-93f0-7d7a95cb0d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:15.448119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cda120-ff58-4397-93f0-7d7a95cb0d0f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:15.458405 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4336/8650] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:58:15.462693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab3c8d-29fc-4701-ba77-1b98832e2d62 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:15.473202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab3c8d-29fc-4701-ba77-1b98832e2d62 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:15.478334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b4aa5-97db-4297-a4b3-4a81a4c01c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:15.478993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b4aa5-97db-4297-a4b3-4a81a4c01c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.479278 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b4aa5-97db-4297-a4b3-4a81a4c01c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.479558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b4aa5-97db-4297-a4b3-4a81a4c01c7c admin admin] PATH_INFO: `/v3/projects/14759ca153c7401f809cc795bbbaf519/users/387445132a5d4fb88c7a0e08d0840d13/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.495989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b4aa5-97db-4297-a4b3-4a81a4c01c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=14759ca153c7401f809cc795bbbaf519, user_id=387445132a5d4fb88c7a0e08d0840d13, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:15.498783 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b4aa5-97db-4297-a4b3-4a81a4c01c7c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:15.512512 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4315/8651] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:58:15 2022] PUT /identity/v3/projects/14759ca153c7401f809cc795bbbaf519/users/387445132a5d4fb88c7a0e08d0840d13/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:58:15.517741 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58947f-3a87-490f-b93d-51f266be1535 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.518030 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58947f-3a87-490f-b93d-51f266be1535 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.518314 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58947f-3a87-490f-b93d-51f266be1535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.537619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-db58947f-3a87-490f-b93d-51f266be1535 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:15.539078 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-db58947f-3a87-490f-b93d-51f266be1535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:15.602037 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4337/8652] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 01:58:15.612829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b4aa5-97db-4297-a4b3-4a81a4c01c7c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:15.615145 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-695b4aa5-97db-4297-a4b3-4a81a4c01c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:15.630625 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:15.675422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b4aa5-97db-4297-a4b3-4a81a4c01c7c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:15.679590 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6c954-b356-42a2-ab18-2d72e68216ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:15.680261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c954-b356-42a2-ab18-2d72e68216ff service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:15.680547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c954-b356-42a2-ab18-2d72e68216ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:15.680845 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c954-b356-42a2-ab18-2d72e68216ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:15.690315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6c954-b356-42a2-ab18-2d72e68216ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:15.691739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6c954-b356-42a2-ab18-2d72e68216ff service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:15.701847 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4316/8653] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:58:19.858123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a30d8-976a-4993-801c-00467e88f588 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:19.858648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a30d8-976a-4993-801c-00467e88f588 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:19.858648 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a30d8-976a-4993-801c-00467e88f588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:19.889408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-708a30d8-976a-4993-801c-00467e88f588 None None] MFA Rules not processed for user `387445132a5d4fb88c7a0e08d0840d13`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:19.890640 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-708a30d8-976a-4993-801c-00467e88f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:19.965405 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4338/8654] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:58:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:58:19.976939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816463d-c621-46eb-a966-d020c7202b63 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:19.977493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816463d-c621-46eb-a966-d020c7202b63 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:19.977598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816463d-c621-46eb-a966-d020c7202b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:19.997976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a816463d-c621-46eb-a966-d020c7202b63 None None] MFA Rules not processed for user `387445132a5d4fb88c7a0e08d0840d13`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:19.999305 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a816463d-c621-46eb-a966-d020c7202b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:20.007315 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4317/8655] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:58:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:58:20.019328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a30d8-976a-4993-801c-00467e88f588 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:20.020761 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-708a30d8-976a-4993-801c-00467e88f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:20.089768 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:20.126378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a30d8-976a-4993-801c-00467e88f588 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:20.133316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684b1c6-aea4-458c-957d-d40102f04f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:20.133950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684b1c6-aea4-458c-957d-d40102f04f70 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:20.134233 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684b1c6-aea4-458c-957d-d40102f04f70 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:20.134507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684b1c6-aea4-458c-957d-d40102f04f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:20.143172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684b1c6-aea4-458c-957d-d40102f04f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:20.144800 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684b1c6-aea4-458c-957d-d40102f04f70 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:20.155546 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4339/8656] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:58:20.192202 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816463d-c621-46eb-a966-d020c7202b63 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:20.193650 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a816463d-c621-46eb-a966-d020c7202b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:20.285727 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816463d-c621-46eb-a966-d020c7202b63 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:20.290428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:20.291045 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:20.291343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:20.291616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:20.293445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:20.308308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:20.310098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:20.332121 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4318/8657] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:58:20.922357 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684b1c6-aea4-458c-957d-d40102f04f70 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:20.923803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4684b1c6-aea4-458c-957d-d40102f04f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:20.939116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684b1c6-aea4-458c-957d-d40102f04f70 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:20.942897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb2dde-a81f-4cc9-b37d-05399235a412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:20.943505 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb2dde-a81f-4cc9-b37d-05399235a412 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:20.943780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb2dde-a81f-4cc9-b37d-05399235a412 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:20.944843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb2dde-a81f-4cc9-b37d-05399235a412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:20.946604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-81fb2dde-a81f-4cc9-b37d-05399235a412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:20.960105 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb2dde-a81f-4cc9-b37d-05399235a412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:20.961685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb2dde-a81f-4cc9-b37d-05399235a412 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:20.972329 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4340/8658] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:58:21.919736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:21.921671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:21.994766 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490e38a-b5cc-4928-960f-b47a160ae644 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:21.999851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7ff0-b58d-4552-a819-350b1515600f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:22.000462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7ff0-b58d-4552-a819-350b1515600f service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:22.000801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7ff0-b58d-4552-a819-350b1515600f service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:22.001078 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7ff0-b58d-4552-a819-350b1515600f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:22.002828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-591c7ff0-b58d-4552-a819-350b1515600f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:22.015356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c7ff0-b58d-4552-a819-350b1515600f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:22.016991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c7ff0-b58d-4552-a819-350b1515600f service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:22.027748 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4319/8659] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 01:58:30.967619 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=24 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:32.023386 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:34.873173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e150f4-7a38-4deb-b02e-3d622a0d5430 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:34.873714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e150f4-7a38-4deb-b02e-3d622a0d5430 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:34.873714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e150f4-7a38-4deb-b02e-3d622a0d5430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:34.898478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-83e150f4-7a38-4deb-b02e-3d622a0d5430 None None] MFA Rules not processed for user `387445132a5d4fb88c7a0e08d0840d13`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:34.899711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-83e150f4-7a38-4deb-b02e-3d622a0d5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:34.907142 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4341/8660] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:58:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:58:35.163520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7ff0-b58d-4552-a819-350b1515600f service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:35.173473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7ff0-b58d-4552-a819-350b1515600f service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:35.177122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7099496-a769-445c-998b-9ca5e6e7c223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:35.177708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7099496-a769-445c-998b-9ca5e6e7c223 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:35.177985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7099496-a769-445c-998b-9ca5e6e7c223 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:35.178254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7099496-a769-445c-998b-9ca5e6e7c223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:35.179929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f7099496-a769-445c-998b-9ca5e6e7c223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:35.189616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7099496-a769-445c-998b-9ca5e6e7c223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:35.191102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7099496-a769-445c-998b-9ca5e6e7c223 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:35.198709 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4320/8661] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:58:37.963165 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e150f4-7a38-4deb-b02e-3d622a0d5430 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:37.979231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e150f4-7a38-4deb-b02e-3d622a0d5430 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:37.985516 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:37.986220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:37.986503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:37.986791 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:37.988479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:38.003253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:38.004905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:38.016995 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4342/8662] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:58:45.195342 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:48.011748 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:56.990197 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a48cb-3f7f-45a8-a5b8-4ea449e233c6 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:56.990692 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a48cb-3f7f-45a8-a5b8-4ea449e233c6 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:56.990838 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a48cb-3f7f-45a8-a5b8-4ea449e233c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.039640 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-d11a48cb-3f7f-45a8-a5b8-4ea449e233c6 None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:57.040911 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d11a48cb-3f7f-45a8-a5b8-4ea449e233c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:57.049935 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4321/8663] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 01:58:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:58:57.067310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:57.068873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:57.072991 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a48cb-3f7f-45a8-a5b8-4ea449e233c6 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:57.087325 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7167ae-1168-4a16-aef6-2940eb1eda9c service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:57.093046 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de931ed-babf-4b35-bd0f-b3027b6abf2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:57.093934 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de931ed-babf-4b35-bd0f-b3027b6abf2d service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.094698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de931ed-babf-4b35-bd0f-b3027b6abf2d service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.094698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de931ed-babf-4b35-bd0f-b3027b6abf2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.104691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de931ed-babf-4b35-bd0f-b3027b6abf2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:57.106329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de931ed-babf-4b35-bd0f-b3027b6abf2d service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:57.106626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a48cb-3f7f-45a8-a5b8-4ea449e233c6 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:57.111352 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:57.112055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.112337 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.112641 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] PATH_INFO: `/v3/users/387445132a5d4fb88c7a0e08d0840d13` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.113777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387445132a5d4fb88c7a0e08d0840d13)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:57.115704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:57.116866 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4343/8664] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:58:57.165403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387445132a5d4fb88c7a0e08d0840d13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.178039 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387445132a5d4fb88c7a0e08d0840d13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.184934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387445132a5d4fb88c7a0e08d0840d13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.192379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387445132a5d4fb88c7a0e08d0840d13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.193090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c161cfaf-4e71-4e0c-8501-6815ae5badc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387445132a5d4fb88c7a0e08d0840d13'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.199033 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4322/8665] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:58:57 2022] DELETE /identity/v3/users/387445132a5d4fb88c7a0e08d0840d13 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:58:57.369316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de931ed-babf-4b35-bd0f-b3027b6abf2d service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:57.381139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de931ed-babf-4b35-bd0f-b3027b6abf2d service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:57.441089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:57.441721 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.442000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.442269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] PATH_INFO: `/v3/projects/14759ca153c7401f809cc795bbbaf519` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.443396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14759ca153c7401f809cc795bbbaf519)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:57.445345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:57.495790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14759ca153c7401f809cc795bbbaf519', 'request_id': 'req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.503627 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14759ca153c7401f809cc795bbbaf519', 'request_id': 'req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.509548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14759ca153c7401f809cc795bbbaf519', 'request_id': 'req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.534559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] The token cache is being invalidate because project 14759ca153c7401f809cc795bbbaf519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:58:57.534858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.535519 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-6ab4c7fb-9112-42c5-baec-ae75df12fbf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:58:57.537075 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4344/8666] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:58:57 2022] DELETE /identity/v3/projects/14759ca153c7401f809cc795bbbaf519 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:58:57.542200 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c02bc-d0b1-4ae9-8915-a130142108fc None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.542504 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c02bc-d0b1-4ae9-8915-a130142108fc None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.542799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c02bc-d0b1-4ae9-8915-a130142108fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.590163 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-542c02bc-d0b1-4ae9-8915-a130142108fc None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:57.591464 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-542c02bc-d0b1-4ae9-8915-a130142108fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:57.651501 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4323/8667] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:58:57.660423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f034e33-a24b-4f69-9260-580561a7b5e5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.660751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f034e33-a24b-4f69-9260-580561a7b5e5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.661031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f034e33-a24b-4f69-9260-580561a7b5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.680553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-5f034e33-a24b-4f69-9260-580561a7b5e5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:57.681804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5f034e33-a24b-4f69-9260-580561a7b5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:57.690839 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4345/8668] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:58:57.695125 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c02bc-d0b1-4ae9-8915-a130142108fc None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:57.705414 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c02bc-d0b1-4ae9-8915-a130142108fc None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:57.710214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c24c0-82e7-4593-bea3-08efb70fd980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:57.710824 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c24c0-82e7-4593-bea3-08efb70fd980 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.711106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c24c0-82e7-4593-bea3-08efb70fd980 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.711385 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c24c0-82e7-4593-bea3-08efb70fd980 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.712028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c24c0-82e7-4593-bea3-08efb70fd980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:58:57.712340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c24c0-82e7-4593-bea3-08efb70fd980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:57.713986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c24c0-82e7-4593-bea3-08efb70fd980 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:57.716170 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:57.731638 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4324/8669] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:58:57.733269 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f034e33-a24b-4f69-9260-580561a7b5e5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:57.742578 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f034e33-a24b-4f69-9260-580561a7b5e5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:57.747431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a98e5-c5de-4421-87aa-cd7cf5be6bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:57.747976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a98e5-c5de-4421-87aa-cd7cf5be6bde admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.748262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a98e5-c5de-4421-87aa-cd7cf5be6bde admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.748539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a98e5-c5de-4421-87aa-cd7cf5be6bde admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.749211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a98e5-c5de-4421-87aa-cd7cf5be6bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:57.751134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a98e5-c5de-4421-87aa-cd7cf5be6bde admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:57.787402 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4346/8670] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:58:57 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:58:57.791683 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c24c0-82e7-4593-bea3-08efb70fd980 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:57.802559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c24c0-82e7-4593-bea3-08efb70fd980 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:57.857966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348abf8-f3a4-4941-aa65-a827f57677e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:57.858573 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348abf8-f3a4-4941-aa65-a827f57677e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.858857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348abf8-f3a4-4941-aa65-a827f57677e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.859139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348abf8-f3a4-4941-aa65-a827f57677e6 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.859764 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348abf8-f3a4-4941-aa65-a827f57677e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:57.861722 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348abf8-f3a4-4941-aa65-a827f57677e6 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:57.882032 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4325/8671] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:58:57 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:58:57.886240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a98e5-c5de-4421-87aa-cd7cf5be6bde admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:57.896697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a98e5-c5de-4421-87aa-cd7cf5be6bde admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:57.901444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17738e1-5712-4356-9e89-dea237a10fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:57.902048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17738e1-5712-4356-9e89-dea237a10fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.903004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17738e1-5712-4356-9e89-dea237a10fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.903464 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17738e1-5712-4356-9e89-dea237a10fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.903864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17738e1-5712-4356-9e89-dea237a10fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:57.905501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17738e1-5712-4356-9e89-dea237a10fd2 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:57.915436 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4347/8672] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:58:57.920199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348abf8-f3a4-4941-aa65-a827f57677e6 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:57.930170 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348abf8-f3a4-4941-aa65-a827f57677e6 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:57.935120 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50f43f-2f0e-404a-afd4-a2c6bdc9850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:57.935966 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50f43f-2f0e-404a-afd4-a2c6bdc9850b admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.936250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50f43f-2f0e-404a-afd4-a2c6bdc9850b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.936528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50f43f-2f0e-404a-afd4-a2c6bdc9850b admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.937198 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50f43f-2f0e-404a-afd4-a2c6bdc9850b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:57.938795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50f43f-2f0e-404a-afd4-a2c6bdc9850b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:57.948561 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4326/8673] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:58:57.953131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17738e1-5712-4356-9e89-dea237a10fd2 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:57.963620 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17738e1-5712-4356-9e89-dea237a10fd2 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:57.969526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b25c-988e-4cc7-9dee-5925cc351c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:57.970204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b25c-988e-4cc7-9dee-5925cc351c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:57.970490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b25c-988e-4cc7-9dee-5925cc351c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:57.970769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b25c-988e-4cc7-9dee-5925cc351c53 admin admin] PATH_INFO: `/v3/projects/3d2ce1ab940347cea936a07b34b53294/users/95b8b7ff3acb4e90b87296751ac2f47a/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:57.985871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965b25c-988e-4cc7-9dee-5925cc351c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2ce1ab940347cea936a07b34b53294, user_id=95b8b7ff3acb4e90b87296751ac2f47a, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:57.988565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965b25c-988e-4cc7-9dee-5925cc351c53 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:57.990739 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:58.002842 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4348/8674] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:58:57 2022] PUT /identity/v3/projects/3d2ce1ab940347cea936a07b34b53294/users/95b8b7ff3acb4e90b87296751ac2f47a/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:58:58.013378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd596b6-94a7-4b85-bdf8-164652564bbd None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:58.013869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd596b6-94a7-4b85-bdf8-164652564bbd None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:58.013969 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd596b6-94a7-4b85-bdf8-164652564bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:58.042311 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-ecd596b6-94a7-4b85-bdf8-164652564bbd None None] MFA Rules not processed for user `95b8b7ff3acb4e90b87296751ac2f47a`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:58:58.044165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ecd596b6-94a7-4b85-bdf8-164652564bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:58.109354 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4327/8675] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:58:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:58:58.119476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b25c-988e-4cc7-9dee-5925cc351c53 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:58:58.121900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a965b25c-988e-4cc7-9dee-5925cc351c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:58:58.178711 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b25c-988e-4cc7-9dee-5925cc351c53 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:58:58.182406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc67a6e-bf1c-426f-bdb3-60856753aa88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:58:58.183004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc67a6e-bf1c-426f-bdb3-60856753aa88 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:58:58.183282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc67a6e-bf1c-426f-bdb3-60856753aa88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:58:58.184214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc67a6e-bf1c-426f-bdb3-60856753aa88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:58:58.192897 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc67a6e-bf1c-426f-bdb3-60856753aa88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:58:58.194312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc67a6e-bf1c-426f-bdb3-60856753aa88 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:58:58.203164 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4349/8676] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:58:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:59:08.106425 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:08.199105 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:10.636176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd596b6-94a7-4b85-bdf8-164652564bbd None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:10.704462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd596b6-94a7-4b85-bdf8-164652564bbd None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:10.708920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:10.709572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:10.709852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:10.710122 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] PATH_INFO: `/v3/users/95b8b7ff3acb4e90b87296751ac2f47a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:10.711234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b8b7ff3acb4e90b87296751ac2f47a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:10.713537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:10.759282 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b8b7ff3acb4e90b87296751ac2f47a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:10.771964 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b8b7ff3acb4e90b87296751ac2f47a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:10.779055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b8b7ff3acb4e90b87296751ac2f47a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:10.786071 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b8b7ff3acb4e90b87296751ac2f47a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:10.786671 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b8b7ff3acb4e90b87296751ac2f47a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:10.792472 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4328/8677] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:59:10 2022] DELETE /identity/v3/users/95b8b7ff3acb4e90b87296751ac2f47a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 01:59:10.796952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563aa42-e997-41ce-a0bf-09601ddcf89b None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:10.797447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563aa42-e997-41ce-a0bf-09601ddcf89b None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:10.797546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563aa42-e997-41ce-a0bf-09601ddcf89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:10.816889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4563aa42-e997-41ce-a0bf-09601ddcf89b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:10.818124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4563aa42-e997-41ce-a0bf-09601ddcf89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:10.877738 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4350/8678] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:10.888270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:10.889708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:10.946254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb63be2-f8be-4744-9d07-6e42248a6929 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:10.950483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a3267-3ac1-412c-9837-5c0e6d370da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:10.951077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a3267-3ac1-412c-9837-5c0e6d370da7 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:10.951351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a3267-3ac1-412c-9837-5c0e6d370da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:10.951621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a3267-3ac1-412c-9837-5c0e6d370da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:10.960481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a3267-3ac1-412c-9837-5c0e6d370da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:10.961932 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a3267-3ac1-412c-9837-5c0e6d370da7 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:10.972365 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4329/8679] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:59:11.149709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563aa42-e997-41ce-a0bf-09601ddcf89b None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:11.151257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4563aa42-e997-41ce-a0bf-09601ddcf89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:11.166712 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563aa42-e997-41ce-a0bf-09601ddcf89b None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:11.171772 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:11.172432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.172731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.173010 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] PATH_INFO: `/v3/projects/3d2ce1ab940347cea936a07b34b53294` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.174168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2ce1ab940347cea936a07b34b53294)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:11.176222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:11.224730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2ce1ab940347cea936a07b34b53294', 'request_id': 'req-26916dd7-0e58-4219-affc-652c0459a40d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:11.232239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2ce1ab940347cea936a07b34b53294', 'request_id': 'req-26916dd7-0e58-4219-affc-652c0459a40d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:11.237951 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2ce1ab940347cea936a07b34b53294', 'request_id': 'req-26916dd7-0e58-4219-affc-652c0459a40d'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:11.250116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] The token cache is being invalidate because project 3d2ce1ab940347cea936a07b34b53294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:59:11.250406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:11.251049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-26916dd7-0e58-4219-affc-652c0459a40d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:11.252551 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4351/8680] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:59:11 2022] DELETE /identity/v3/projects/3d2ce1ab940347cea936a07b34b53294 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:59:11.257888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02abe-8f2d-48d3-93ae-000c3fbbaf1c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.258176 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02abe-8f2d-48d3-93ae-000c3fbbaf1c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.258458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02abe-8f2d-48d3-93ae-000c3fbbaf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.279018 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c9d02abe-8f2d-48d3-93ae-000c3fbbaf1c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:11.280270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c9d02abe-8f2d-48d3-93ae-000c3fbbaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:11.297125 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:11.342375 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4330/8681] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:11.350035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282af11d-0439-4195-b22f-755dd8743b3c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.350342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282af11d-0439-4195-b22f-755dd8743b3c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.350609 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282af11d-0439-4195-b22f-755dd8743b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.370795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-282af11d-0439-4195-b22f-755dd8743b3c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:11.372147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-282af11d-0439-4195-b22f-755dd8743b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:11.380289 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4352/8682] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:11.384562 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d02abe-8f2d-48d3-93ae-000c3fbbaf1c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:11.394884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d02abe-8f2d-48d3-93ae-000c3fbbaf1c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:11.399416 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8a743-b70d-4d39-8e0c-00fee674e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:11.400019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a743-b70d-4d39-8e0c-00fee674e0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.400299 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a743-b70d-4d39-8e0c-00fee674e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.400570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a743-b70d-4d39-8e0c-00fee674e0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.401243 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8a743-b70d-4d39-8e0c-00fee674e0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:59:11.401542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8a743-b70d-4d39-8e0c-00fee674e0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:11.404156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8a743-b70d-4d39-8e0c-00fee674e0c4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:11.415835 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4331/8683] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:59:11.420239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282af11d-0439-4195-b22f-755dd8743b3c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:11.429774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282af11d-0439-4195-b22f-755dd8743b3c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:11.435400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109d7c8-def1-473e-a8c1-389a6c8e2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:11.436256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109d7c8-def1-473e-a8c1-389a6c8e2ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.436539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109d7c8-def1-473e-a8c1-389a6c8e2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.436838 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109d7c8-def1-473e-a8c1-389a6c8e2ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.437542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109d7c8-def1-473e-a8c1-389a6c8e2ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:11.439466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109d7c8-def1-473e-a8c1-389a6c8e2ce0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:11.467061 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4353/8684] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:59:11 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:59:11.471082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8a743-b70d-4d39-8e0c-00fee674e0c4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:11.482589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8a743-b70d-4d39-8e0c-00fee674e0c4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:11.540266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2480cd-7d7d-4f5c-ac94-986a73d3bc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:11.540923 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2480cd-7d7d-4f5c-ac94-986a73d3bc75 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.541207 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2480cd-7d7d-4f5c-ac94-986a73d3bc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.541483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2480cd-7d7d-4f5c-ac94-986a73d3bc75 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.542105 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2480cd-7d7d-4f5c-ac94-986a73d3bc75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:11.545079 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2480cd-7d7d-4f5c-ac94-986a73d3bc75 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:11.566914 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4332/8685] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:59:11 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:59:11.571140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109d7c8-def1-473e-a8c1-389a6c8e2ce0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:11.583053 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109d7c8-def1-473e-a8c1-389a6c8e2ce0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:11.587759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862c48d-33a6-4f24-853f-40fe651d0507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:11.588358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862c48d-33a6-4f24-853f-40fe651d0507 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.588674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862c48d-33a6-4f24-853f-40fe651d0507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.588957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862c48d-33a6-4f24-853f-40fe651d0507 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.589717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862c48d-33a6-4f24-853f-40fe651d0507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:11.591323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862c48d-33a6-4f24-853f-40fe651d0507 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:11.601343 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4354/8686] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:59:11.606279 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2480cd-7d7d-4f5c-ac94-986a73d3bc75 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:11.616169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2480cd-7d7d-4f5c-ac94-986a73d3bc75 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:11.621319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e7407-aef0-4866-ab76-4da4e7e7fdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:11.621916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e7407-aef0-4866-ab76-4da4e7e7fdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.622204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e7407-aef0-4866-ab76-4da4e7e7fdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.622480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e7407-aef0-4866-ab76-4da4e7e7fdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.623117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e7407-aef0-4866-ab76-4da4e7e7fdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:11.624730 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e7407-aef0-4866-ab76-4da4e7e7fdd4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:11.635178 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4333/8687] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:59:11.639996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862c48d-33a6-4f24-853f-40fe651d0507 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:11.650110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862c48d-33a6-4f24-853f-40fe651d0507 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:11.655133 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f3737-9372-4796-9be8-853c4ae5a44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:11.655781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f3737-9372-4796-9be8-853c4ae5a44a admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.656067 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f3737-9372-4796-9be8-853c4ae5a44a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.656349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f3737-9372-4796-9be8-853c4ae5a44a admin admin] PATH_INFO: `/v3/projects/0e4b657de7e5402aa684e5741e8c4790/users/d34736888b234247922ebe2cf524ba19/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.671591 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f3737-9372-4796-9be8-853c4ae5a44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4b657de7e5402aa684e5741e8c4790, user_id=d34736888b234247922ebe2cf524ba19, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:11.674290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f3737-9372-4796-9be8-853c4ae5a44a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:11.688945 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4355/8688] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:59:11 2022] PUT /identity/v3/projects/0e4b657de7e5402aa684e5741e8c4790/users/d34736888b234247922ebe2cf524ba19/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:59:11.699131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909000b-3518-42a7-bc93-54950c87d1cf None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.699633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909000b-3518-42a7-bc93-54950c87d1cf None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.699633 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909000b-3518-42a7-bc93-54950c87d1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.727594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-3909000b-3518-42a7-bc93-54950c87d1cf None None] MFA Rules not processed for user `d34736888b234247922ebe2cf524ba19`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:11.728868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3909000b-3518-42a7-bc93-54950c87d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:11.796053 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4334/8689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:11.806220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f3737-9372-4796-9be8-853c4ae5a44a admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:11.808894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-356f3737-9372-4796-9be8-853c4ae5a44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:11.832564 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:11.871475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f3737-9372-4796-9be8-853c4ae5a44a admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:11.875438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fdc5e-c843-4487-8bc7-c7f3e1f73532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:11.876044 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fdc5e-c843-4487-8bc7-c7f3e1f73532 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:11.876317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fdc5e-c843-4487-8bc7-c7f3e1f73532 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:11.876762 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fdc5e-c843-4487-8bc7-c7f3e1f73532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:11.884859 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fdc5e-c843-4487-8bc7-c7f3e1f73532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:11.886274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fdc5e-c843-4487-8bc7-c7f3e1f73532 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:11.895014 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4356/8690] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:59:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:59:16.324986 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909000b-3518-42a7-bc93-54950c87d1cf None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:16.344974 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:16.395486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909000b-3518-42a7-bc93-54950c87d1cf None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:16.400030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:16.400684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:16.400963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:16.401236 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] PATH_INFO: `/v3/users/d34736888b234247922ebe2cf524ba19` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:16.402951 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34736888b234247922ebe2cf524ba19)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:16.404901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:16.452631 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34736888b234247922ebe2cf524ba19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.465005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34736888b234247922ebe2cf524ba19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.472698 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34736888b234247922ebe2cf524ba19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.480068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34736888b234247922ebe2cf524ba19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.481400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34736888b234247922ebe2cf524ba19'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.487508 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4335/8691] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 01:59:16 2022] DELETE /identity/v3/users/d34736888b234247922ebe2cf524ba19 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:59:16.491846 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4328-277a-43a6-af01-f7315c82718d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:16.492323 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4328-277a-43a6-af01-f7315c82718d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:16.492420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4328-277a-43a6-af01-f7315c82718d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:16.511553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ba9f4328-277a-43a6-af01-f7315c82718d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:16.513366 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ba9f4328-277a-43a6-af01-f7315c82718d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:16.573907 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4357/8692] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:16.584041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:16.585514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:16.642673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ac5c-6bd9-409f-b57b-265ed50c1d86 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:16.646379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba87f8-242b-42aa-a5b6-92b950b4f5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:16.646981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba87f8-242b-42aa-a5b6-92b950b4f5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:16.647262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba87f8-242b-42aa-a5b6-92b950b4f5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:16.647538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba87f8-242b-42aa-a5b6-92b950b4f5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:16.656636 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba87f8-242b-42aa-a5b6-92b950b4f5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:16.658062 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba87f8-242b-42aa-a5b6-92b950b4f5c8 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:16.667627 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4336/8693] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:59:16.841466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4328-277a-43a6-af01-f7315c82718d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:16.843409 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ba9f4328-277a-43a6-af01-f7315c82718d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:16.856672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4328-277a-43a6-af01-f7315c82718d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:16.861529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:16.862173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:16.862460 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:16.862749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] PATH_INFO: `/v3/projects/0e4b657de7e5402aa684e5741e8c4790` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:16.863999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4b657de7e5402aa684e5741e8c4790)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:16.865965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:16.913716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4b657de7e5402aa684e5741e8c4790', 'request_id': 'req-28a70777-e211-4948-9e9d-ecc97a0168de'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.921891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4b657de7e5402aa684e5741e8c4790', 'request_id': 'req-28a70777-e211-4948-9e9d-ecc97a0168de'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.928142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4b657de7e5402aa684e5741e8c4790', 'request_id': 'req-28a70777-e211-4948-9e9d-ecc97a0168de'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.941399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] The token cache is being invalidate because project 0e4b657de7e5402aa684e5741e8c4790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 01:59:16.941685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.942333 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-28a70777-e211-4948-9e9d-ecc97a0168de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 01:59:16.943828 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4358/8694] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:59:16 2022] DELETE /identity/v3/projects/0e4b657de7e5402aa684e5741e8c4790 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:59:16.948880 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9cfa1-44e1-4202-a649-d3c2a3eaa4c2 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:16.949172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9cfa1-44e1-4202-a649-d3c2a3eaa4c2 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:16.949459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9cfa1-44e1-4202-a649-d3c2a3eaa4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:16.970069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a7d9cfa1-44e1-4202-a649-d3c2a3eaa4c2 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:16.971265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a7d9cfa1-44e1-4202-a649-d3c2a3eaa4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:17.006003 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:17.034210 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4337/8695] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:17.042959 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84561d-d599-4025-a807-8c7bd6f4d5ca None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:17.043737 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84561d-d599-4025-a807-8c7bd6f4d5ca None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:17.044013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84561d-d599-4025-a807-8c7bd6f4d5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:17.065690 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-cc84561d-d599-4025-a807-8c7bd6f4d5ca None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:17.066900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-cc84561d-d599-4025-a807-8c7bd6f4d5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:17.074905 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4359/8696] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:17.079616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9cfa1-44e1-4202-a649-d3c2a3eaa4c2 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:17.089709 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9cfa1-44e1-4202-a649-d3c2a3eaa4c2 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:17.094848 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cf297-6bcb-4a18-95dd-a6d66da89153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:17.095458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cf297-6bcb-4a18-95dd-a6d66da89153 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:17.095739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cf297-6bcb-4a18-95dd-a6d66da89153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:17.096015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cf297-6bcb-4a18-95dd-a6d66da89153 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:17.096695 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cf297-6bcb-4a18-95dd-a6d66da89153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 01:59:17.097002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cf297-6bcb-4a18-95dd-a6d66da89153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:17.098601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cf297-6bcb-4a18-95dd-a6d66da89153 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:17.114798 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4338/8697] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 01:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 01:59:17.116054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84561d-d599-4025-a807-8c7bd6f4d5ca None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:17.127055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84561d-d599-4025-a807-8c7bd6f4d5ca None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:17.133226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad9b08-15e4-405e-83d0-e1bf313d3b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:17.133708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad9b08-15e4-405e-83d0-e1bf313d3b6c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:17.133987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad9b08-15e4-405e-83d0-e1bf313d3b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:17.134259 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad9b08-15e4-405e-83d0-e1bf313d3b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:17.134900 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad9b08-15e4-405e-83d0-e1bf313d3b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:17.137680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad9b08-15e4-405e-83d0-e1bf313d3b6c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:17.165802 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4360/8698] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:59:17 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:59:17.171438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cf297-6bcb-4a18-95dd-a6d66da89153 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:17.182055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cf297-6bcb-4a18-95dd-a6d66da89153 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:17.240694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b56c36-7e4f-44ff-a06b-8ffd8b1e96c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:17.241290 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b56c36-7e4f-44ff-a06b-8ffd8b1e96c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:17.241565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b56c36-7e4f-44ff-a06b-8ffd8b1e96c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:17.241833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b56c36-7e4f-44ff-a06b-8ffd8b1e96c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:17.242444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b56c36-7e4f-44ff-a06b-8ffd8b1e96c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:17.244361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b56c36-7e4f-44ff-a06b-8ffd8b1e96c0 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:17.265319 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4339/8699] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:59:17 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:59:17.269600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad9b08-15e4-405e-83d0-e1bf313d3b6c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:17.280248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad9b08-15e4-405e-83d0-e1bf313d3b6c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:17.285093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397ff7-a233-4bf9-999d-b1771f40bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:17.285694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397ff7-a233-4bf9-999d-b1771f40bc51 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:17.285984 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397ff7-a233-4bf9-999d-b1771f40bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:17.286241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397ff7-a233-4bf9-999d-b1771f40bc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:17.286874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397ff7-a233-4bf9-999d-b1771f40bc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:17.288450 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397ff7-a233-4bf9-999d-b1771f40bc51 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:17.298986 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4361/8700] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 01:59:17.303081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b56c36-7e4f-44ff-a06b-8ffd8b1e96c0 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:17.313568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b56c36-7e4f-44ff-a06b-8ffd8b1e96c0 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:17.318250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde1898-b82b-4ac5-a3fd-7d12f7c515cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:17.318843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde1898-b82b-4ac5-a3fd-7d12f7c515cc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:17.319126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde1898-b82b-4ac5-a3fd-7d12f7c515cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:17.319403 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde1898-b82b-4ac5-a3fd-7d12f7c515cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:17.320043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde1898-b82b-4ac5-a3fd-7d12f7c515cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:17.321672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde1898-b82b-4ac5-a3fd-7d12f7c515cc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:17.332598 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4340/8701] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:59:17.336875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397ff7-a233-4bf9-999d-b1771f40bc51 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:17.347499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397ff7-a233-4bf9-999d-b1771f40bc51 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:17.352043 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd617769-497b-4193-afe6-1b4dc0460ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:17.352724 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd617769-497b-4193-afe6-1b4dc0460ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:17.353005 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd617769-497b-4193-afe6-1b4dc0460ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:17.353282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd617769-497b-4193-afe6-1b4dc0460ed1 admin admin] PATH_INFO: `/v3/projects/5e3f24038436423db470356123e5e0e5/users/d12ec1f0259e4b3787efc086ce6721ac/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:17.356467 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:17.372717 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd617769-497b-4193-afe6-1b4dc0460ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3f24038436423db470356123e5e0e5, user_id=d12ec1f0259e4b3787efc086ce6721ac, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:17.375561 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd617769-497b-4193-afe6-1b4dc0460ed1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:17.389616 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4362/8702] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:59:17 2022] PUT /identity/v3/projects/5e3f24038436423db470356123e5e0e5/users/d12ec1f0259e4b3787efc086ce6721ac/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:59:17.394901 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833e2d8-5876-4280-b87d-95e1d06d8f5c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:17.395195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833e2d8-5876-4280-b87d-95e1d06d8f5c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:17.395470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833e2d8-5876-4280-b87d-95e1d06d8f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:17.414644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5833e2d8-5876-4280-b87d-95e1d06d8f5c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:17.415847 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5833e2d8-5876-4280-b87d-95e1d06d8f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:17.477704 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4341/8703] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:17.487726 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd617769-497b-4193-afe6-1b4dc0460ed1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:17.489506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dd617769-497b-4193-afe6-1b4dc0460ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:17.551064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd617769-497b-4193-afe6-1b4dc0460ed1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:17.554789 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf1715-a8f6-48fe-980c-c1f53f3b82a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:17.555395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf1715-a8f6-48fe-980c-c1f53f3b82a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:17.555672 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf1715-a8f6-48fe-980c-c1f53f3b82a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:17.555944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf1715-a8f6-48fe-980c-c1f53f3b82a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:17.565574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf1715-a8f6-48fe-980c-c1f53f3b82a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:17.566989 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf1715-a8f6-48fe-980c-c1f53f3b82a6 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:17.577416 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4363/8704] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:59:21.720741 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175bc78-c129-4c91-8ad4-9fc035361f27 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:21.721229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175bc78-c129-4c91-8ad4-9fc035361f27 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:21.721342 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175bc78-c129-4c91-8ad4-9fc035361f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:21.755926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-9175bc78-c129-4c91-8ad4-9fc035361f27 None None] MFA Rules not processed for user `d12ec1f0259e4b3787efc086ce6721ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:21.757160 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9175bc78-c129-4c91-8ad4-9fc035361f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:21.799086 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:21.832654 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4342/8705] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:21.837499 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf1715-a8f6-48fe-980c-c1f53f3b82a6 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:21.848054 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf1715-a8f6-48fe-980c-c1f53f3b82a6 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:21.853025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1624186-f891-46d5-8d5c-0dfcfb8b484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:21.853634 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1624186-f891-46d5-8d5c-0dfcfb8b484f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:21.853939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1624186-f891-46d5-8d5c-0dfcfb8b484f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:21.854208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1624186-f891-46d5-8d5c-0dfcfb8b484f admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:21.854845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1624186-f891-46d5-8d5c-0dfcfb8b484f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:21.857605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1624186-f891-46d5-8d5c-0dfcfb8b484f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:21.889569 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4364/8706] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 01:59:21 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 01:59:21.893398 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175bc78-c129-4c91-8ad4-9fc035361f27 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:21.915628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175bc78-c129-4c91-8ad4-9fc035361f27 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:21.987294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6611f-99cc-4da2-a2be-1dfeecea73a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:21.987913 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6611f-99cc-4da2-a2be-1dfeecea73a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:21.988192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6611f-99cc-4da2-a2be-1dfeecea73a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:21.988462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6611f-99cc-4da2-a2be-1dfeecea73a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:21.989141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6611f-99cc-4da2-a2be-1dfeecea73a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:21.991055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6611f-99cc-4da2-a2be-1dfeecea73a1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:22.014235 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4343/8707] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 01:59:21 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 01:59:22.018398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1624186-f891-46d5-8d5c-0dfcfb8b484f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:22.031755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1624186-f891-46d5-8d5c-0dfcfb8b484f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:22.037034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bea6d-6ecf-4ddc-a686-22d2fd37620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:22.037751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bea6d-6ecf-4ddc-a686-22d2fd37620e admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:22.038102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bea6d-6ecf-4ddc-a686-22d2fd37620e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:22.038455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bea6d-6ecf-4ddc-a686-22d2fd37620e admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:22.039198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bea6d-6ecf-4ddc-a686-22d2fd37620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:22.040915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bea6d-6ecf-4ddc-a686-22d2fd37620e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:22.055610 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4365/8708] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:59:22.057759 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6611f-99cc-4da2-a2be-1dfeecea73a1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:22.069064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6611f-99cc-4da2-a2be-1dfeecea73a1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:22.074067 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e4ef-4190-4d47-8009-42d4d353f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:22.075912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e4ef-4190-4d47-8009-42d4d353f930 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:22.076196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e4ef-4190-4d47-8009-42d4d353f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:22.076475 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e4ef-4190-4d47-8009-42d4d353f930 admin admin] PATH_INFO: `/v3/projects/9897731e0e7643a5a8c165a1fc296273/users/192f3f9a85e6428b9d34873dee3c3a8a/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:22.094484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55e4ef-4190-4d47-8009-42d4d353f930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9897731e0e7643a5a8c165a1fc296273, user_id=192f3f9a85e6428b9d34873dee3c3a8a, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:22.097303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55e4ef-4190-4d47-8009-42d4d353f930 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:22.111336 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4344/8709] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:59:22 2022] PUT /identity/v3/projects/9897731e0e7643a5a8c165a1fc296273/users/192f3f9a85e6428b9d34873dee3c3a8a/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:59:22.115674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bea6d-6ecf-4ddc-a686-22d2fd37620e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:22.126637 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bea6d-6ecf-4ddc-a686-22d2fd37620e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:22.187256 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4d5b7-5153-48d1-a50b-077ec4645c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:22.187885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4d5b7-5153-48d1-a50b-077ec4645c96 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:22.188147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4d5b7-5153-48d1-a50b-077ec4645c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:22.188418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4d5b7-5153-48d1-a50b-077ec4645c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:22.189093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4d5b7-5153-48d1-a50b-077ec4645c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:22.190684 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4d5b7-5153-48d1-a50b-077ec4645c96 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:22.205097 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4366/8710] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 01:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 01:59:22.206564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e4ef-4190-4d47-8009-42d4d353f930 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:22.218849 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e4ef-4190-4d47-8009-42d4d353f930 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:22.223519 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063910d9-ed82-4bce-9ebe-3c3e4540501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:22.224188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063910d9-ed82-4bce-9ebe-3c3e4540501a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:22.224469 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063910d9-ed82-4bce-9ebe-3c3e4540501a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:22.224776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063910d9-ed82-4bce-9ebe-3c3e4540501a admin admin] PATH_INFO: `/v3/projects/9897731e0e7643a5a8c165a1fc296273/users/192f3f9a85e6428b9d34873dee3c3a8a/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:22.226900 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063910d9-ed82-4bce-9ebe-3c3e4540501a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9897731e0e7643a5a8c165a1fc296273, user_id=192f3f9a85e6428b9d34873dee3c3a8a, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:22.229626 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063910d9-ed82-4bce-9ebe-3c3e4540501a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:22.241606 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4345/8711] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 01:59:22 2022] PUT /identity/v3/projects/9897731e0e7643a5a8c165a1fc296273/users/192f3f9a85e6428b9d34873dee3c3a8a/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 01:59:26.353255 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57384d4-d6b1-4c5a-a2b7-e11fd655e707 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:26.353814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57384d4-d6b1-4c5a-a2b7-e11fd655e707 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:26.353902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57384d4-d6b1-4c5a-a2b7-e11fd655e707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:26.383477 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b57384d4-d6b1-4c5a-a2b7-e11fd655e707 None None] MFA Rules not processed for user `192f3f9a85e6428b9d34873dee3c3a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:26.385026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b57384d4-d6b1-4c5a-a2b7-e11fd655e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:26.436335 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:26.481482 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4367/8712] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:26.498165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063910d9-ed82-4bce-9ebe-3c3e4540501a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:26.500499 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-063910d9-ed82-4bce-9ebe-3c3e4540501a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:26.582476 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063910d9-ed82-4bce-9ebe-3c3e4540501a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:26.588186 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1d28f-b9dd-4b01-9830-4e75201aad32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:26.588832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d28f-b9dd-4b01-9830-4e75201aad32 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:26.589393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d28f-b9dd-4b01-9830-4e75201aad32 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:26.589393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1d28f-b9dd-4b01-9830-4e75201aad32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:26.615251 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:26.649148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1d28f-b9dd-4b01-9830-4e75201aad32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:26.650684 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1d28f-b9dd-4b01-9830-4e75201aad32 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:26.660873 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4346/8713] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:59:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:59:26.732479 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491bb10-2ec1-4265-8afc-60b3b963b8ea None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:26.732796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491bb10-2ec1-4265-8afc-60b3b963b8ea None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:26.733077 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491bb10-2ec1-4265-8afc-60b3b963b8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:26.755639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2491bb10-2ec1-4265-8afc-60b3b963b8ea None None] MFA Rules not processed for user `d12ec1f0259e4b3787efc086ce6721ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 01:59:26.757248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2491bb10-2ec1-4265-8afc-60b3b963b8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:26.765111 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4368/8714] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 01:59:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 01:59:34.879396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1d28f-b9dd-4b01-9830-4e75201aad32 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:34.895470 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1d28f-b9dd-4b01-9830-4e75201aad32 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:34.906150 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:34.907261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:34.907637 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:34.907989 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:34.910374 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:34.933837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:34.936461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:34.949874 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4347/8715] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:59:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:59:36.750058 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=15 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:37.332835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491bb10-2ec1-4265-8afc-60b3b963b8ea None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 01:59:37.334330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2491bb10-2ec1-4265-8afc-60b3b963b8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 01:59:37.391625 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491bb10-2ec1-4265-8afc-60b3b963b8ea None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 01:59:37.395272 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb948e-5fa7-4006-adba-bcca33c186bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3c0c082e3044b283bfeb58543d088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 01:59:37.395881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb948e-5fa7-4006-adba-bcca33c186bd service cinder] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 01:59:37.396164 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb948e-5fa7-4006-adba-bcca33c186bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 01:59:37.396441 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb948e-5fa7-4006-adba-bcca33c186bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 01:59:37.406131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb948e-5fa7-4006-adba-bcca33c186bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 01:59:37.407557 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb948e-5fa7-4006-adba-bcca33c186bd service cinder] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 01:59:37.417155 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4369/8716] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 01:59:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 01:59:44.945385 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=22 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:47.412792 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=26 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:01.036642 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:00:01.038093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:00:01.107346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07cffc-cfa7-41f9-aab4-140b70dcf124 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:00:01.112406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af57a02-bad8-4d3e-8cff-4afd4c0f33d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:00:01.113054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af57a02-bad8-4d3e-8cff-4afd4c0f33d2 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:00:01.113339 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af57a02-bad8-4d3e-8cff-4afd4c0f33d2 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:00:01.113615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af57a02-bad8-4d3e-8cff-4afd4c0f33d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:00:01.115318 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1af57a02-bad8-4d3e-8cff-4afd4c0f33d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:00:01.127254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af57a02-bad8-4d3e-8cff-4afd4c0f33d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:00:01.128851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af57a02-bad8-4d3e-8cff-4afd4c0f33d2 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:00:01.139689 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4348/8717] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:00:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:00:01.716968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb948e-5fa7-4006-adba-bcca33c186bd service cinder] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:00:01.718456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-76fb948e-5fa7-4006-adba-bcca33c186bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:00:01.748920 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb948e-5fa7-4006-adba-bcca33c186bd service cinder] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:00:01.755685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975669f-994c-4da2-a57f-ce90bf508823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:00:01.756423 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975669f-994c-4da2-a57f-ce90bf508823 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:00:01.756809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975669f-994c-4da2-a57f-ce90bf508823 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:00:01.757161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975669f-994c-4da2-a57f-ce90bf508823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:00:01.759023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1975669f-994c-4da2-a57f-ce90bf508823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:00:01.781539 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975669f-994c-4da2-a57f-ce90bf508823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:00:01.783172 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975669f-994c-4da2-a57f-ce90bf508823 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:00:01.795896 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4370/8718] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:00:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:00:02.892156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5862e-cad8-425f-9ca8-fc466423d4d5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:00:02.892726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5862e-cad8-425f-9ca8-fc466423d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:00:02.892726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5862e-cad8-425f-9ca8-fc466423d4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:00:02.911421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4bd5862e-cad8-425f-9ca8-fc466423d4d5 None None] MFA Rules not processed for user `d12ec1f0259e4b3787efc086ce6721ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:00:02.912648 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4bd5862e-cad8-425f-9ca8-fc466423d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:00:02.920094 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4349/8719] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:00:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:00:03.492820 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975669f-994c-4da2-a57f-ce90bf508823 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:00:03.504928 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975669f-994c-4da2-a57f-ce90bf508823 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:00:03.510066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:00:03.510685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:00:03.510968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:00:03.511248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:00:03.513679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:00:03.526250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:00:03.528410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:00:03.548756 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4371/8720] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:00:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:00:12.906070 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=35 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:13.535432 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=12 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:38.469704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd829946-2562-4254-a154-be8e4ffaea58 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:00:38.470269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd829946-2562-4254-a154-be8e4ffaea58 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:00:38.470269 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd829946-2562-4254-a154-be8e4ffaea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:00:38.489097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-cd829946-2562-4254-a154-be8e4ffaea58 None None] MFA Rules not processed for user `d12ec1f0259e4b3787efc086ce6721ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:00:38.490303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cd829946-2562-4254-a154-be8e4ffaea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:00:38.497858 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4350/8721] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:00:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:00:48.157037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:00:48.158537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:00:48.172251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee563bd1-a8d9-4c93-922b-22f8a67e08c6 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:00:48.177428 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8553034-0bf7-4757-bcd8-f65a119703c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:00:48.178063 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8553034-0bf7-4757-bcd8-f65a119703c2 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:00:48.178354 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8553034-0bf7-4757-bcd8-f65a119703c2 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:00:48.178624 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8553034-0bf7-4757-bcd8-f65a119703c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:00:48.180810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-c8553034-0bf7-4757-bcd8-f65a119703c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:00:48.193369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8553034-0bf7-4757-bcd8-f65a119703c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:00:48.194942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8553034-0bf7-4757-bcd8-f65a119703c2 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:00:48.205412 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4372/8722] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:00:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:00:48.483693 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:58.201195 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:21.750565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd829946-2562-4254-a154-be8e4ffaea58 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:21.818734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd829946-2562-4254-a154-be8e4ffaea58 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:21.823335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:21.824507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:21.824860 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:21.825136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] PATH_INFO: `/v3/users/d12ec1f0259e4b3787efc086ce6721ac` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:21.826347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12ec1f0259e4b3787efc086ce6721ac)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:21.828309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:21.880992 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12ec1f0259e4b3787efc086ce6721ac'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:21.893307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12ec1f0259e4b3787efc086ce6721ac'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:21.900679 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12ec1f0259e4b3787efc086ce6721ac'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:21.907713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12ec1f0259e4b3787efc086ce6721ac'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:21.908346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12ec1f0259e4b3787efc086ce6721ac'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:21.914313 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4351/8723] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:01:21 2022] DELETE /identity/v3/users/d12ec1f0259e4b3787efc086ce6721ac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:01:22.086747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8553034-0bf7-4757-bcd8-f65a119703c2 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:22.098343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8553034-0bf7-4757-bcd8-f65a119703c2 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:22.155813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:22.156381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:22.156715 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:22.156994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] PATH_INFO: `/v3/projects/5e3f24038436423db470356123e5e0e5` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:22.158129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3f24038436423db470356123e5e0e5)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:22.160118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:22.206925 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3f24038436423db470356123e5e0e5', 'request_id': 'req-21fb4003-4d31-4aca-a3f7-f710c42a1309'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.213436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3f24038436423db470356123e5e0e5', 'request_id': 'req-21fb4003-4d31-4aca-a3f7-f710c42a1309'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.219361 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3f24038436423db470356123e5e0e5', 'request_id': 'req-21fb4003-4d31-4aca-a3f7-f710c42a1309'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.230514 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] The token cache is being invalidate because project 5e3f24038436423db470356123e5e0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:01:22.230790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.231454 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.232988 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4373/8724] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:01:22 2022] DELETE /identity/v3/projects/5e3f24038436423db470356123e5e0e5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:01:22.237029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:22.238443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:22.251877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3de79-3986-4397-aa45-c357cc3c4e4e admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:22.307710 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:22.308375 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:22.309214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:22.309560 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] PATH_INFO: `/v3/users/192f3f9a85e6428b9d34873dee3c3a8a` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:22.310748 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=192f3f9a85e6428b9d34873dee3c3a8a)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:22.313266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:22.335041 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:22.361294 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192f3f9a85e6428b9d34873dee3c3a8a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.374315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192f3f9a85e6428b9d34873dee3c3a8a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.381652 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192f3f9a85e6428b9d34873dee3c3a8a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.388736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192f3f9a85e6428b9d34873dee3c3a8a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.389415 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-e35152de-481f-45e5-a602-26b0b25ee10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192f3f9a85e6428b9d34873dee3c3a8a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.395380 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4352/8725] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:01:22 2022] DELETE /identity/v3/users/192f3f9a85e6428b9d34873dee3c3a8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:01:22.578080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:22.579553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:22.593994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb4003-4d31-4aca-a3f7-f710c42a1309 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:22.652601 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:22.653175 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:22.653456 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:22.653728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] PATH_INFO: `/v3/projects/9897731e0e7643a5a8c165a1fc296273` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:22.654864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9897731e0e7643a5a8c165a1fc296273)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:22.656829 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:22.692582 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:22.706957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9897731e0e7643a5a8c165a1fc296273', 'request_id': 'req-f8948040-c481-4a58-901d-b76a6b5cd3d0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.713444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9897731e0e7643a5a8c165a1fc296273', 'request_id': 'req-f8948040-c481-4a58-901d-b76a6b5cd3d0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.719612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9897731e0e7643a5a8c165a1fc296273', 'request_id': 'req-f8948040-c481-4a58-901d-b76a6b5cd3d0'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.731004 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] The token cache is being invalidate because project 9897731e0e7643a5a8c165a1fc296273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:01:22.731296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.731950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f8948040-c481-4a58-901d-b76a6b5cd3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:01:22.733488 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4374/8726] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:01:22 2022] DELETE /identity/v3/projects/9897731e0e7643a5a8c165a1fc296273 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:01:22.738505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b143-1254-4225-85e6-7c6a98a6a1d8 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:22.738801 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b143-1254-4225-85e6-7c6a98a6a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:22.739077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b143-1254-4225-85e6-7c6a98a6a1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:22.759280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5a94b143-1254-4225-85e6-7c6a98a6a1d8 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:01:22.760477 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5a94b143-1254-4225-85e6-7c6a98a6a1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:22.821913 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4353/8727] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:01:22.831480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4eac3-cdd8-4e0f-a532-b490e0c32f7e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:22.831764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4eac3-cdd8-4e0f-a532-b490e0c32f7e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:22.832037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4eac3-cdd8-4e0f-a532-b490e0c32f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:22.852212 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-19a4eac3-cdd8-4e0f-a532-b490e0c32f7e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:01:22.853434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-19a4eac3-cdd8-4e0f-a532-b490e0c32f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:22.862392 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4375/8728] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:01:22.866734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b143-1254-4225-85e6-7c6a98a6a1d8 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:22.876785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b143-1254-4225-85e6-7c6a98a6a1d8 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:22.881422 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf133d3-e8bc-43f2-b63e-1486c284b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:22.882019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf133d3-e8bc-43f2-b63e-1486c284b198 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:22.882303 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf133d3-e8bc-43f2-b63e-1486c284b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:22.882579 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf133d3-e8bc-43f2-b63e-1486c284b198 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:22.883251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf133d3-e8bc-43f2-b63e-1486c284b198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:01:22.883554 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf133d3-e8bc-43f2-b63e-1486c284b198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:22.885203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf133d3-e8bc-43f2-b63e-1486c284b198 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:22.896731 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4354/8729] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 02:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:01:22.900999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4eac3-cdd8-4e0f-a532-b490e0c32f7e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:22.911048 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4eac3-cdd8-4e0f-a532-b490e0c32f7e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:22.915758 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa5d7-6b5d-4b36-9710-44d812388a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:22.916358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa5d7-6b5d-4b36-9710-44d812388a79 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:22.916669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa5d7-6b5d-4b36-9710-44d812388a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:22.916952 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa5d7-6b5d-4b36-9710-44d812388a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:22.917573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fa5d7-6b5d-4b36-9710-44d812388a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:22.920496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fa5d7-6b5d-4b36-9710-44d812388a79 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:22.948031 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4376/8730] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 02:01:22 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:01:22.952409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf133d3-e8bc-43f2-b63e-1486c284b198 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:22.962507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf133d3-e8bc-43f2-b63e-1486c284b198 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:23.020830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc6fd0-fc6c-4c60-823b-9147065c5170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:23.021542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc6fd0-fc6c-4c60-823b-9147065c5170 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:23.021832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc6fd0-fc6c-4c60-823b-9147065c5170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:23.022108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc6fd0-fc6c-4c60-823b-9147065c5170 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:23.022758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc6fd0-fc6c-4c60-823b-9147065c5170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:23.024712 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc6fd0-fc6c-4c60-823b-9147065c5170 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:23.051876 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4355/8731] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 02:01:22 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:01:23.055823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa5d7-6b5d-4b36-9710-44d812388a79 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:23.066697 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa5d7-6b5d-4b36-9710-44d812388a79 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:23.071349 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5618e-6b6d-407a-9be5-0628f8b5be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:23.072001 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5618e-6b6d-407a-9be5-0628f8b5be76 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:23.072226 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5618e-6b6d-407a-9be5-0628f8b5be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:23.072498 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5618e-6b6d-407a-9be5-0628f8b5be76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:23.073173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5618e-6b6d-407a-9be5-0628f8b5be76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:23.075517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5618e-6b6d-407a-9be5-0628f8b5be76 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:23.088592 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4377/8732] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:01:23.089512 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc6fd0-fc6c-4c60-823b-9147065c5170 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:23.100686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc6fd0-fc6c-4c60-823b-9147065c5170 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:23.105466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd28f75-80d1-4eb8-8de2-a631d2289b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:23.106179 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd28f75-80d1-4eb8-8de2-a631d2289b9f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:23.106466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd28f75-80d1-4eb8-8de2-a631d2289b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:23.106744 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd28f75-80d1-4eb8-8de2-a631d2289b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:23.107392 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd28f75-80d1-4eb8-8de2-a631d2289b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:23.109058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd28f75-80d1-4eb8-8de2-a631d2289b9f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:23.120445 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4356/8733] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:01:23.124553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5618e-6b6d-407a-9be5-0628f8b5be76 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:23.135722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5618e-6b6d-407a-9be5-0628f8b5be76 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:23.141375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759d2a0-998b-4275-8480-40c52c74d702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:23.142119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d2a0-998b-4275-8480-40c52c74d702 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:23.142410 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d2a0-998b-4275-8480-40c52c74d702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:23.142691 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d2a0-998b-4275-8480-40c52c74d702 admin admin] PATH_INFO: `/v3/projects/adc2ee3a031b400d90c14e8b06caa191/users/145362d3a96243b28db39a61a49c9292/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:23.158502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759d2a0-998b-4275-8480-40c52c74d702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc2ee3a031b400d90c14e8b06caa191, user_id=145362d3a96243b28db39a61a49c9292, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:23.161216 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759d2a0-998b-4275-8480-40c52c74d702 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:23.173920 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4378/8734] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:01:23 2022] PUT /identity/v3/projects/adc2ee3a031b400d90c14e8b06caa191/users/145362d3a96243b28db39a61a49c9292/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:01:23.179119 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347eeea-94ee-4a95-a03d-e298bb1bc736 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:23.179411 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347eeea-94ee-4a95-a03d-e298bb1bc736 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:23.179716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347eeea-94ee-4a95-a03d-e298bb1bc736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:23.188260 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:23.201097 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7347eeea-94ee-4a95-a03d-e298bb1bc736 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:01:23.202308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7347eeea-94ee-4a95-a03d-e298bb1bc736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:23.260194 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4357/8735] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:01:23.270652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759d2a0-998b-4275-8480-40c52c74d702 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:23.272332 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e759d2a0-998b-4275-8480-40c52c74d702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:23.329144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759d2a0-998b-4275-8480-40c52c74d702 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:23.332707 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a6fba-7b1b-4920-b581-f7458cc82e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:23.333300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a6fba-7b1b-4920-b581-f7458cc82e6d service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:23.333577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a6fba-7b1b-4920-b581-f7458cc82e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:23.333849 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a6fba-7b1b-4920-b581-f7458cc82e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:23.343356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a6fba-7b1b-4920-b581-f7458cc82e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:23.344802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a6fba-7b1b-4920-b581-f7458cc82e6d service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:23.354128 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4379/8736] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:01:27.736881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2054a-84ba-47c9-9263-60c44ba5c6a9 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:27.737429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2054a-84ba-47c9-9263-60c44ba5c6a9 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:27.737429 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2054a-84ba-47c9-9263-60c44ba5c6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:27.767238 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-60e2054a-84ba-47c9-9263-60c44ba5c6a9 None None] MFA Rules not processed for user `145362d3a96243b28db39a61a49c9292`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:01:27.768719 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-60e2054a-84ba-47c9-9263-60c44ba5c6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:27.843139 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4358/8737] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:01:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:01:27.849452 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a6fba-7b1b-4920-b581-f7458cc82e6d service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:27.862351 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a6fba-7b1b-4920-b581-f7458cc82e6d service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:27.870738 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1ba8d-b28a-4cd6-baf6-754ee3df6c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:27.872096 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1ba8d-b28a-4cd6-baf6-754ee3df6c8e admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:27.872530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1ba8d-b28a-4cd6-baf6-754ee3df6c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:27.873157 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1ba8d-b28a-4cd6-baf6-754ee3df6c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:27.873987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1ba8d-b28a-4cd6-baf6-754ee3df6c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:27.875995 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1ba8d-b28a-4cd6-baf6-754ee3df6c8e admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:27.908532 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4380/8738] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 02:01:27 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:01:27.912503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2054a-84ba-47c9-9263-60c44ba5c6a9 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:27.925568 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2054a-84ba-47c9-9263-60c44ba5c6a9 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:27.986990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd76ccd-244e-41e1-a8bd-cfd52d46a168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:27.987621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd76ccd-244e-41e1-a8bd-cfd52d46a168 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:27.987908 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd76ccd-244e-41e1-a8bd-cfd52d46a168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:27.988188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd76ccd-244e-41e1-a8bd-cfd52d46a168 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:27.988915 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd76ccd-244e-41e1-a8bd-cfd52d46a168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:27.990881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd76ccd-244e-41e1-a8bd-cfd52d46a168 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:28.014291 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4359/8739] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 02:01:27 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:01:28.018748 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1ba8d-b28a-4cd6-baf6-754ee3df6c8e admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:28.030497 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1ba8d-b28a-4cd6-baf6-754ee3df6c8e admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:28.035489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e5d24-447a-4b97-ac7f-5d563104378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:28.036104 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e5d24-447a-4b97-ac7f-5d563104378b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:28.036416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e5d24-447a-4b97-ac7f-5d563104378b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:28.036735 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e5d24-447a-4b97-ac7f-5d563104378b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:28.037445 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e5d24-447a-4b97-ac7f-5d563104378b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:28.039122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e5d24-447a-4b97-ac7f-5d563104378b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:28.053815 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4381/8740] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:01:28.058774 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd76ccd-244e-41e1-a8bd-cfd52d46a168 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:28.069703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd76ccd-244e-41e1-a8bd-cfd52d46a168 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:28.075021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eb426-c2ef-41b1-9830-fd8775f5fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:28.075691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb426-c2ef-41b1-9830-fd8775f5fbab admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:28.075972 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb426-c2ef-41b1-9830-fd8775f5fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:28.076246 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb426-c2ef-41b1-9830-fd8775f5fbab admin admin] PATH_INFO: `/v3/projects/5e08f4e64e094d3e9ad3c8d121494369/users/25f6b84f405d4b29a6f87ca139a270aa/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:28.092778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6eb426-c2ef-41b1-9830-fd8775f5fbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e08f4e64e094d3e9ad3c8d121494369, user_id=25f6b84f405d4b29a6f87ca139a270aa, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:28.095454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6eb426-c2ef-41b1-9830-fd8775f5fbab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:28.105745 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:28.110871 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4360/8741] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:01:28 2022] PUT /identity/v3/projects/5e08f4e64e094d3e9ad3c8d121494369/users/25f6b84f405d4b29a6f87ca139a270aa/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:01:28.114950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e5d24-447a-4b97-ac7f-5d563104378b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:28.126716 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e5d24-447a-4b97-ac7f-5d563104378b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:28.153157 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:28.191702 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318fae6-cf16-495d-b614-4647cf306592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:28.192320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318fae6-cf16-495d-b614-4647cf306592 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:28.192649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318fae6-cf16-495d-b614-4647cf306592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:28.193027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318fae6-cf16-495d-b614-4647cf306592 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:28.193667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318fae6-cf16-495d-b614-4647cf306592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:28.195306 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318fae6-cf16-495d-b614-4647cf306592 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:28.206064 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4382/8742] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:01:28.210168 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eb426-c2ef-41b1-9830-fd8775f5fbab admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:28.221831 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eb426-c2ef-41b1-9830-fd8775f5fbab admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:28.226594 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d592e3-f081-4503-8c57-f007207901d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:28.227267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d592e3-f081-4503-8c57-f007207901d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:28.227548 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d592e3-f081-4503-8c57-f007207901d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:28.227825 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d592e3-f081-4503-8c57-f007207901d1 admin admin] PATH_INFO: `/v3/projects/5e08f4e64e094d3e9ad3c8d121494369/users/25f6b84f405d4b29a6f87ca139a270aa/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:28.229786 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d592e3-f081-4503-8c57-f007207901d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e08f4e64e094d3e9ad3c8d121494369, user_id=25f6b84f405d4b29a6f87ca139a270aa, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:28.233361 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d592e3-f081-4503-8c57-f007207901d1 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:28.245658 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4361/8743] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:01:28 2022] PUT /identity/v3/projects/5e08f4e64e094d3e9ad3c8d121494369/users/25f6b84f405d4b29a6f87ca139a270aa/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:01:32.333857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050c86-2647-4df8-9108-24b0970e1ffd None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:32.334379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050c86-2647-4df8-9108-24b0970e1ffd None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:32.334379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050c86-2647-4df8-9108-24b0970e1ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:32.368473 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ab050c86-2647-4df8-9108-24b0970e1ffd None None] MFA Rules not processed for user `25f6b84f405d4b29a6f87ca139a270aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:01:32.369980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ab050c86-2647-4df8-9108-24b0970e1ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:32.447224 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4383/8744] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:01:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:01:32.491542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d592e3-f081-4503-8c57-f007207901d1 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:32.493467 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-38d592e3-f081-4503-8c57-f007207901d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:32.554997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d592e3-f081-4503-8c57-f007207901d1 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:32.559421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd4945-d22d-4115-b877-31f174c19628 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:32.559857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd4945-d22d-4115-b877-31f174c19628 service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:32.560140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd4945-d22d-4115-b877-31f174c19628 service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:32.560413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd4945-d22d-4115-b877-31f174c19628 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:32.621945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd4945-d22d-4115-b877-31f174c19628 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:32.623335 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd4945-d22d-4115-b877-31f174c19628 service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:32.632914 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4362/8745] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:01:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:01:32.793234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b36e7-4062-4b96-93d2-2005168db67e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:32.793988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b36e7-4062-4b96-93d2-2005168db67e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:32.793988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b36e7-4062-4b96-93d2-2005168db67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:32.854283 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-2b3b36e7-4062-4b96-93d2-2005168db67e None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:01:32.856395 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-2b3b36e7-4062-4b96-93d2-2005168db67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:32.944075 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4384/8746] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 02:01:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:01:33.015393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd4945-d22d-4115-b877-31f174c19628 service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:33.021943 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8cdd4945-d22d-4115-b877-31f174c19628 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:33.146957 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd4945-d22d-4115-b877-31f174c19628 service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:33.153060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c1f0-9daf-40b8-8ee9-2fad20fc14a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:33.153750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c1f0-9daf-40b8-8ee9-2fad20fc14a8 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:33.154034 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c1f0-9daf-40b8-8ee9-2fad20fc14a8 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:33.154946 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9c1f0-9daf-40b8-8ee9-2fad20fc14a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:33.164887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9c1f0-9daf-40b8-8ee9-2fad20fc14a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:33.166666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9c1f0-9daf-40b8-8ee9-2fad20fc14a8 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:33.176739 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4363/8747] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:01:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:01:42.327987 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb029d-aa4c-4e80-8b65-ebcf4145aa62 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:42.328555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb029d-aa4c-4e80-8b65-ebcf4145aa62 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:42.328555 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb029d-aa4c-4e80-8b65-ebcf4145aa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:42.348804 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-a8fb029d-aa4c-4e80-8b65-ebcf4145aa62 None None] MFA Rules not processed for user `145362d3a96243b28db39a61a49c9292`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:01:42.350002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a8fb029d-aa4c-4e80-8b65-ebcf4145aa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:42.356949 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4385/8748] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:01:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:01:42.620127 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c1f0-9daf-40b8-8ee9-2fad20fc14a8 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:42.622237 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f6a9c1f0-9daf-40b8-8ee9-2fad20fc14a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:42.635353 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:42.688870 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9c1f0-9daf-40b8-8ee9-2fad20fc14a8 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:42.692459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c343cab-e3a9-4a9e-a32a-15eb02954f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:42.693080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c343cab-e3a9-4a9e-a32a-15eb02954f4e service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:42.693357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c343cab-e3a9-4a9e-a32a-15eb02954f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:42.693627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c343cab-e3a9-4a9e-a32a-15eb02954f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:42.695308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1c343cab-e3a9-4a9e-a32a-15eb02954f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:42.705041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c343cab-e3a9-4a9e-a32a-15eb02954f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:42.706442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c343cab-e3a9-4a9e-a32a-15eb02954f4e service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:42.714472 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4364/8749] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:01:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:01:45.558534 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc636d-be67-45e5-b16e-015f12473e8c None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:45.559037 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc636d-be67-45e5-b16e-015f12473e8c None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:45.559146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc636d-be67-45e5-b16e-015f12473e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:45.579779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-fdcc636d-be67-45e5-b16e-015f12473e8c None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:01:45.581071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-fdcc636d-be67-45e5-b16e-015f12473e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:01:45.588925 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4386/8750] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 02:01:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:01:45.602383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c343cab-e3a9-4a9e-a32a-15eb02954f4e service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:01:45.614978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c343cab-e3a9-4a9e-a32a-15eb02954f4e service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:01:45.620500 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81244c74-4f04-4539-9caa-24ddf68ef0d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:01:45.621280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81244c74-4f04-4539-9caa-24ddf68ef0d6 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:01:45.621632 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81244c74-4f04-4539-9caa-24ddf68ef0d6 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:01:45.622797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81244c74-4f04-4539-9caa-24ddf68ef0d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:01:45.631425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81244c74-4f04-4539-9caa-24ddf68ef0d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:01:45.633108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81244c74-4f04-4539-9caa-24ddf68ef0d6 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:01:45.641618 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4365/8751] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:01:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:01:55.574201 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=97 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:55.638405 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=31 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:02:19.884530 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc636d-be67-45e5-b16e-015f12473e8c None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:02:19.895129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc636d-be67-45e5-b16e-015f12473e8c None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:02:19.898764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce95f4-96eb-4504-8137-66e0aecd7a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:02:19.899369 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce95f4-96eb-4504-8137-66e0aecd7a69 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:02:19.899647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce95f4-96eb-4504-8137-66e0aecd7a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:02:19.899919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce95f4-96eb-4504-8137-66e0aecd7a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:02:19.922710 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce95f4-96eb-4504-8137-66e0aecd7a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:02:19.924139 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce95f4-96eb-4504-8137-66e0aecd7a69 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:02:19.933687 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4387/8752] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:02:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:02:29.929560 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=12 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:03:02.813435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81244c74-4f04-4539-9caa-24ddf68ef0d6 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:03:02.822704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81244c74-4f04-4539-9caa-24ddf68ef0d6 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:03:02.826795 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1f2e1-72b0-4bd5-ac7d-af6028ee78f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:03:02.827395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f2e1-72b0-4bd5-ac7d-af6028ee78f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:03:02.827675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f2e1-72b0-4bd5-ac7d-af6028ee78f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:03:02.827950 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f2e1-72b0-4bd5-ac7d-af6028ee78f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:03:02.829718 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6bf1f2e1-72b0-4bd5-ac7d-af6028ee78f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:03:02.860231 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1f2e1-72b0-4bd5-ac7d-af6028ee78f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:03:02.861738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1f2e1-72b0-4bd5-ac7d-af6028ee78f3 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:03:02.869617 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4366/8753] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:03:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:03:12.866125 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=14 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:04:04.271600 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce95f4-96eb-4504-8137-66e0aecd7a69 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:04:04.293031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce95f4-96eb-4504-8137-66e0aecd7a69 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:04:04.297533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:04:04.298138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:04:04.298420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:04:04.298693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:04:04.300404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:04:04.379976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:04:04.381439 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:04:04.402360 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4388/8754] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:04:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:04:05.648164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1f2e1-72b0-4bd5-ac7d-af6028ee78f3 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:04:05.667799 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1f2e1-72b0-4bd5-ac7d-af6028ee78f3 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:04:05.673281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:04:05.674104 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:04:05.674591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:04:05.674997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:04:05.677002 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:04:05.692393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:04:05.694408 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:04:05.706219 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4367/8755] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:04:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:04:14.399599 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=43 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:04:15.701196 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=11 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:03.316150 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:05:03.317559 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:03.403340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c3224-f99e-4189-b8c0-410ad4c49487 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:05:03.408398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:05:03.409045 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:03.409329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:03.409604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:03.411341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:03.423341 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:05:03.424954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:05:03.435518 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4389/8756] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:05:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:05:13.430595 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=39 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:21.726274 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:05:21.728438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:21.762779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928e6a-82b7-4248-8b9b-21bef5b3dcd6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:05:21.768690 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b57e-7500-474b-b14c-5651d97e971c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:05:21.769463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b57e-7500-474b-b14c-5651d97e971c service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:21.770070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b57e-7500-474b-b14c-5651d97e971c service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:21.770406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b57e-7500-474b-b14c-5651d97e971c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:21.772291 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-ba07b57e-7500-474b-b14c-5651d97e971c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:21.786357 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07b57e-7500-474b-b14c-5651d97e971c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:05:21.788050 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07b57e-7500-474b-b14c-5651d97e971c service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:05:21.800786 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4368/8757] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:05:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:05:23.211538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:05:23.213109 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:23.230263 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820355-e2bc-4a04-b965-0c26483ab1af service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:05:23.236774 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa2e5-bd15-4f07-b56f-31105dc1daf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:05:23.237527 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa2e5-bd15-4f07-b56f-31105dc1daf9 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:23.237946 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa2e5-bd15-4f07-b56f-31105dc1daf9 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:23.238342 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa2e5-bd15-4f07-b56f-31105dc1daf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:23.240062 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-59dfa2e5-bd15-4f07-b56f-31105dc1daf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:23.253481 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfa2e5-bd15-4f07-b56f-31105dc1daf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:05:23.254693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfa2e5-bd15-4f07-b56f-31105dc1daf9 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:05:23.266844 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4390/8758] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:05:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:05:31.795473 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=12 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:33.261718 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:35.846009 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff4e2-49cf-4d58-9c54-bb96fd2af50f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:35.846462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff4e2-49cf-4d58-9c54-bb96fd2af50f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:35.846567 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff4e2-49cf-4d58-9c54-bb96fd2af50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:35.867046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a4fff4e2-49cf-4d58-9c54-bb96fd2af50f None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:05:35.868251 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a4fff4e2-49cf-4d58-9c54-bb96fd2af50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:35.875546 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4369/8759] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:05:35.915763 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa2e5-bd15-4f07-b56f-31105dc1daf9 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:05:35.927113 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa2e5-bd15-4f07-b56f-31105dc1daf9 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:05:35.932117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1283f-a261-42bb-b355-661c91f111e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:05:35.932747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1283f-a261-42bb-b355-661c91f111e9 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:35.933147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1283f-a261-42bb-b355-661c91f111e9 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:35.933436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1283f-a261-42bb-b355-661c91f111e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:35.941821 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1283f-a261-42bb-b355-661c91f111e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:05:35.943422 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1283f-a261-42bb-b355-661c91f111e9 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:05:35.952005 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4391/8760] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:05:36.453930 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62d07-757c-4968-b63c-5a72d6e7b5a1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:36.454214 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62d07-757c-4968-b63c-5a72d6e7b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:36.454482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62d07-757c-4968-b63c-5a72d6e7b5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:36.473410 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-48c62d07-757c-4968-b63c-5a72d6e7b5a1 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:05:36.474591 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-48c62d07-757c-4968-b63c-5a72d6e7b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:36.482416 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4370/8761] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 02:05:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:05:36.495641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1283f-a261-42bb-b355-661c91f111e9 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:05:36.507025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1283f-a261-42bb-b355-661c91f111e9 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:05:36.512356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea96db-7d7d-46fe-b799-b78ca07755ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:05:36.513003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea96db-7d7d-46fe-b799-b78ca07755ab service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:36.513288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea96db-7d7d-46fe-b799-b78ca07755ab service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:36.513571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea96db-7d7d-46fe-b799-b78ca07755ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:36.522927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea96db-7d7d-46fe-b799-b78ca07755ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:05:36.524921 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea96db-7d7d-46fe-b799-b78ca07755ab service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:05:36.544235 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4392/8762] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:05:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:05:45.267693 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af252a3-1b7a-4e19-bfd6-c415d4e7347c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:45.268351 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af252a3-1b7a-4e19-bfd6-c415d4e7347c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:45.268583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af252a3-1b7a-4e19-bfd6-c415d4e7347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:45.287851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-5af252a3-1b7a-4e19-bfd6-c415d4e7347c None None] MFA Rules not processed for user `145362d3a96243b28db39a61a49c9292`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:05:45.289069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5af252a3-1b7a-4e19-bfd6-c415d4e7347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:45.295765 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4371/8763] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:05:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:05:45.576073 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea96db-7d7d-46fe-b799-b78ca07755ab service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:05:45.586554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea96db-7d7d-46fe-b799-b78ca07755ab service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:05:45.591574 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059f3c3-73d6-497b-be3e-20446337768c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:05:45.592181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059f3c3-73d6-497b-be3e-20446337768c service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:45.592500 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059f3c3-73d6-497b-be3e-20446337768c service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:45.592807 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059f3c3-73d6-497b-be3e-20446337768c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:45.594542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-8059f3c3-73d6-497b-be3e-20446337768c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:45.621937 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059f3c3-73d6-497b-be3e-20446337768c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:05:45.623373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059f3c3-73d6-497b-be3e-20446337768c service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:05:45.633288 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4393/8764] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:05:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:05:46.988566 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af252a3-1b7a-4e19-bfd6-c415d4e7347c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:05:47.000833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af252a3-1b7a-4e19-bfd6-c415d4e7347c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:05:47.005714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac1210-dd29-47eb-ba13-25b9ce74014b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:05:47.006312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac1210-dd29-47eb-ba13-25b9ce74014b service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:47.006624 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac1210-dd29-47eb-ba13-25b9ce74014b service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:47.006894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac1210-dd29-47eb-ba13-25b9ce74014b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:47.008596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c1ac1210-dd29-47eb-ba13-25b9ce74014b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:47.031995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac1210-dd29-47eb-ba13-25b9ce74014b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:05:47.033596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac1210-dd29-47eb-ba13-25b9ce74014b service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:05:47.043892 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4372/8765] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:05:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:05:51.508015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3d823-d9a8-4c61-bfa3-9456958ee78e None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:51.508525 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3d823-d9a8-4c61-bfa3-9456958ee78e None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:51.508689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3d823-d9a8-4c61-bfa3-9456958ee78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:51.529241 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-85b3d823-d9a8-4c61-bfa3-9456958ee78e None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:05:51.530572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-85b3d823-d9a8-4c61-bfa3-9456958ee78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:51.538492 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4394/8766] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 02:05:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:05:51.557924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac1210-dd29-47eb-ba13-25b9ce74014b service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:05:51.569812 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac1210-dd29-47eb-ba13-25b9ce74014b service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:05:51.575517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0993-39c8-474b-afc9-295f409a879d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:05:51.576132 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0993-39c8-474b-afc9-295f409a879d service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:51.576409 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0993-39c8-474b-afc9-295f409a879d service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:51.576714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0993-39c8-474b-afc9-295f409a879d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:51.585032 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f0993-39c8-474b-afc9-295f409a879d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:05:51.586601 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f0993-39c8-474b-afc9-295f409a879d service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:05:51.595828 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4373/8767] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:05:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:05:52.129911 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3d823-d9a8-4c61-bfa3-9456958ee78e None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:05:52.154784 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3d823-d9a8-4c61-bfa3-9456958ee78e None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:05:52.167340 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d7d08-8c1f-4244-bbda-0c3a05aae536 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:05:52.169536 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d7d08-8c1f-4244-bbda-0c3a05aae536 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:05:52.170134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d7d08-8c1f-4244-bbda-0c3a05aae536 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:05:52.170666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d7d08-8c1f-4244-bbda-0c3a05aae536 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:05:52.186466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ad9d7d08-8c1f-4244-bbda-0c3a05aae536 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:05:52.205296 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d7d08-8c1f-4244-bbda-0c3a05aae536 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:05:52.207107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d7d08-8c1f-4244-bbda-0c3a05aae536 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:05:52.256498 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4395/8768] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:05:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:06:01.592285 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=26 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:02.235114 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=32 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:06.757487 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0993-39c8-474b-afc9-295f409a879d service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:06:06.770183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0993-39c8-474b-afc9-295f409a879d service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:06:06.775716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4e1e5-9533-4b86-a926-5264ffce6d0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:06:06.776322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4e1e5-9533-4b86-a926-5264ffce6d0f service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:06:06.776615 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4e1e5-9533-4b86-a926-5264ffce6d0f service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:06:06.777938 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4e1e5-9533-4b86-a926-5264ffce6d0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:06:06.779806 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-9be4e1e5-9533-4b86-a926-5264ffce6d0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:06:06.792345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4e1e5-9533-4b86-a926-5264ffce6d0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:06:06.795245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4e1e5-9533-4b86-a926-5264ffce6d0f service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:06:06.806995 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4374/8769] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:06:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:06:16.802165 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:43.535292 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d7d08-8c1f-4244-bbda-0c3a05aae536 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:06:43.547436 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d7d08-8c1f-4244-bbda-0c3a05aae536 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:06:43.552922 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cd541-e368-405c-93d3-fdc729412574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:06:43.553508 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cd541-e368-405c-93d3-fdc729412574 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:06:43.553785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cd541-e368-405c-93d3-fdc729412574 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:06:43.554055 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cd541-e368-405c-93d3-fdc729412574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:06:43.562277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cd541-e368-405c-93d3-fdc729412574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:06:43.564118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cd541-e368-405c-93d3-fdc729412574 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:06:43.573641 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4396/8770] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:06:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:06:53.568901 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:43.017481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34740d5-5f65-436f-a5cd-bb17662fcd37 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:43.018008 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34740d5-5f65-436f-a5cd-bb17662fcd37 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:43.018114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34740d5-5f65-436f-a5cd-bb17662fcd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:43.037365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-b34740d5-5f65-436f-a5cd-bb17662fcd37 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:07:43.038574 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b34740d5-5f65-436f-a5cd-bb17662fcd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:43.046545 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4375/8771] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 02:07:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:07:43.086312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cd541-e368-405c-93d3-fdc729412574 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:43.099430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cd541-e368-405c-93d3-fdc729412574 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:43.106264 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3ee11-0f90-42f7-bafb-3c7abfaf009a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:43.106875 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3ee11-0f90-42f7-bafb-3c7abfaf009a service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:43.107158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3ee11-0f90-42f7-bafb-3c7abfaf009a service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:43.107433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3ee11-0f90-42f7-bafb-3c7abfaf009a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:43.116034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3ee11-0f90-42f7-bafb-3c7abfaf009a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:43.117649 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3ee11-0f90-42f7-bafb-3c7abfaf009a service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:43.126424 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4397/8772] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:07:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:07:43.477023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34740d5-5f65-436f-a5cd-bb17662fcd37 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:43.487358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34740d5-5f65-436f-a5cd-bb17662fcd37 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:43.491075 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbd65a-02ad-42d2-aeac-e8a4fb87a1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:43.491678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbd65a-02ad-42d2-aeac-e8a4fb87a1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:43.491958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbd65a-02ad-42d2-aeac-e8a4fb87a1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:43.492230 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbd65a-02ad-42d2-aeac-e8a4fb87a1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:43.554037 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbd65a-02ad-42d2-aeac-e8a4fb87a1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:43.556388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbd65a-02ad-42d2-aeac-e8a4fb87a1d6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:43.566590 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4376/8773] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:07:46.731873 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3ee11-0f90-42f7-bafb-3c7abfaf009a service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:46.733573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f3b3ee11-0f90-42f7-bafb-3c7abfaf009a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:46.751567 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3ee11-0f90-42f7-bafb-3c7abfaf009a service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:46.756718 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a063ab0-c10c-4ac1-8c6a-d25b2316d01b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:46.757329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a063ab0-c10c-4ac1-8c6a-d25b2316d01b service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:46.757610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a063ab0-c10c-4ac1-8c6a-d25b2316d01b service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:46.757881 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a063ab0-c10c-4ac1-8c6a-d25b2316d01b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:46.759939 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-0a063ab0-c10c-4ac1-8c6a-d25b2316d01b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:46.772285 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a063ab0-c10c-4ac1-8c6a-d25b2316d01b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:46.774538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a063ab0-c10c-4ac1-8c6a-d25b2316d01b service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:46.793559 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4398/8774] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:07:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:07:50.228746 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbd65a-02ad-42d2-aeac-e8a4fb87a1d6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:50.240800 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbd65a-02ad-42d2-aeac-e8a4fb87a1d6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:50.246162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dcca4-35b0-4d71-8354-0305bf7f6467 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:50.246953 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dcca4-35b0-4d71-8354-0305bf7f6467 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:50.247312 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dcca4-35b0-4d71-8354-0305bf7f6467 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:50.247785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dcca4-35b0-4d71-8354-0305bf7f6467 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:50.250161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5b7dcca4-35b0-4d71-8354-0305bf7f6467 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:50.263934 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7dcca4-35b0-4d71-8354-0305bf7f6467 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:50.265556 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7dcca4-35b0-4d71-8354-0305bf7f6467 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:50.276300 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4377/8775] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:07:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:07:50.306885 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a063ab0-c10c-4ac1-8c6a-d25b2316d01b service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:50.319632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a063ab0-c10c-4ac1-8c6a-d25b2316d01b service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:50.324728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:50.325446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:50.325795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:50.326159 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] PATH_INFO: `/v3/users/145362d3a96243b28db39a61a49c9292` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:50.327490 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145362d3a96243b28db39a61a49c9292)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:50.329569 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:50.376816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145362d3a96243b28db39a61a49c9292'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.389775 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145362d3a96243b28db39a61a49c9292'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.396871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145362d3a96243b28db39a61a49c9292'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.404419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145362d3a96243b28db39a61a49c9292'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.405115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145362d3a96243b28db39a61a49c9292'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.410866 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4399/8776] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:07:50 2022] DELETE /identity/v3/users/145362d3a96243b28db39a61a49c9292 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:07:50.585389 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dcca4-35b0-4d71-8354-0305bf7f6467 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:50.596011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dcca4-35b0-4d71-8354-0305bf7f6467 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:50.654939 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:50.655498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:50.655778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:50.656055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] PATH_INFO: `/v3/projects/adc2ee3a031b400d90c14e8b06caa191` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:50.657203 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc2ee3a031b400d90c14e8b06caa191)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:50.659090 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:50.712307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc2ee3a031b400d90c14e8b06caa191', 'request_id': 'req-66596d3c-070f-48f6-80b1-9ba088631d4a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.720587 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc2ee3a031b400d90c14e8b06caa191', 'request_id': 'req-66596d3c-070f-48f6-80b1-9ba088631d4a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.726583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc2ee3a031b400d90c14e8b06caa191', 'request_id': 'req-66596d3c-070f-48f6-80b1-9ba088631d4a'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.738142 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] The token cache is being invalidate because project adc2ee3a031b400d90c14e8b06caa191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:07:50.738433 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.739173 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.740731 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4378/8777] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:07:50 2022] DELETE /identity/v3/projects/adc2ee3a031b400d90c14e8b06caa191 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:07:50.744944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:50.746796 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:50.760087 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25ae5-7bb8-447e-8011-391808bfa336 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:50.816095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:50.816768 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:50.817051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:50.817329 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] PATH_INFO: `/v3/users/25f6b84f405d4b29a6f87ca139a270aa` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:50.818466 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f6b84f405d4b29a6f87ca139a270aa)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:50.820398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:50.867162 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f6b84f405d4b29a6f87ca139a270aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.868404 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:50.880403 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f6b84f405d4b29a6f87ca139a270aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.888072 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f6b84f405d4b29a6f87ca139a270aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.895049 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f6b84f405d4b29a6f87ca139a270aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.895686 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-54ec4a7a-8e44-4ec5-ae76-a2a1cd602897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f6b84f405d4b29a6f87ca139a270aa'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:50.902309 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4400/8778] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:07:50 2022] DELETE /identity/v3/users/25f6b84f405d4b29a6f87ca139a270aa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:07:51.081833 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:51.083354 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:51.098522 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:51.103610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596d3c-070f-48f6-80b1-9ba088631d4a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:51.170333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:51.171054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.171343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.171616 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] PATH_INFO: `/v3/projects/5e08f4e64e094d3e9ad3c8d121494369` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.172785 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e08f4e64e094d3e9ad3c8d121494369)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:51.174703 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:51.225620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e08f4e64e094d3e9ad3c8d121494369', 'request_id': 'req-acb51a24-f0e6-40c3-a279-55d2e0132594'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:51.235454 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e08f4e64e094d3e9ad3c8d121494369', 'request_id': 'req-acb51a24-f0e6-40c3-a279-55d2e0132594'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:51.241729 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e08f4e64e094d3e9ad3c8d121494369', 'request_id': 'req-acb51a24-f0e6-40c3-a279-55d2e0132594'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:51.253834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] The token cache is being invalidate because project 5e08f4e64e094d3e9ad3c8d121494369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:07:51.254126 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:51.254790 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-acb51a24-f0e6-40c3-a279-55d2e0132594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:07:51.256268 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4379/8779] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:07:51 2022] DELETE /identity/v3/projects/5e08f4e64e094d3e9ad3c8d121494369 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:07:51.261485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740f44c-a66b-4f8c-aba4-111a82d397c1 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.261752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740f44c-a66b-4f8c-aba4-111a82d397c1 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.262031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740f44c-a66b-4f8c-aba4-111a82d397c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.282348 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b740f44c-a66b-4f8c-aba4-111a82d397c1 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:07:51.283553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b740f44c-a66b-4f8c-aba4-111a82d397c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:51.345191 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4401/8780] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:07:51.354463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8193df-a35f-4a66-977c-3704408a638c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.354753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8193df-a35f-4a66-977c-3704408a638c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.355081 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8193df-a35f-4a66-977c-3704408a638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.376233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-7b8193df-a35f-4a66-977c-3704408a638c None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:07:51.377586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7b8193df-a35f-4a66-977c-3704408a638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:51.386012 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4380/8781] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:07:51.390261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740f44c-a66b-4f8c-aba4-111a82d397c1 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:51.401529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740f44c-a66b-4f8c-aba4-111a82d397c1 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:51.406532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e1a4c-69da-4235-9da2-240265ca9955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:51.407147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e1a4c-69da-4235-9da2-240265ca9955 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.407431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e1a4c-69da-4235-9da2-240265ca9955 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.407708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e1a4c-69da-4235-9da2-240265ca9955 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.408356 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e1a4c-69da-4235-9da2-240265ca9955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:07:51.408688 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e1a4c-69da-4235-9da2-240265ca9955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:51.410293 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e1a4c-69da-4235-9da2-240265ca9955 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:51.422192 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4402/8782] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 02:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:07:51.426436 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8193df-a35f-4a66-977c-3704408a638c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:51.435890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8193df-a35f-4a66-977c-3704408a638c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:51.440863 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456620b-c8a3-48e5-a55b-37941881b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:51.441459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456620b-c8a3-48e5-a55b-37941881b65c admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.441739 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456620b-c8a3-48e5-a55b-37941881b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.442012 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456620b-c8a3-48e5-a55b-37941881b65c admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.442645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456620b-c8a3-48e5-a55b-37941881b65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:51.444575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456620b-c8a3-48e5-a55b-37941881b65c admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:51.472852 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4381/8783] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 02:07:51 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:07:51.477047 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e1a4c-69da-4235-9da2-240265ca9955 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:51.487379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e1a4c-69da-4235-9da2-240265ca9955 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:51.545061 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3a140-dac1-44c8-a4bf-acef096397bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:51.545664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3a140-dac1-44c8-a4bf-acef096397bf admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.545945 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3a140-dac1-44c8-a4bf-acef096397bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.546240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3a140-dac1-44c8-a4bf-acef096397bf admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.546844 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3a140-dac1-44c8-a4bf-acef096397bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:51.548785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3a140-dac1-44c8-a4bf-acef096397bf admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:51.570556 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4403/8784] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 02:07:51 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:07:51.575129 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456620b-c8a3-48e5-a55b-37941881b65c admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:51.585363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456620b-c8a3-48e5-a55b-37941881b65c admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:51.591098 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a387915-e7b0-4acb-a7f2-4cdc79adc7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:51.591696 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a387915-e7b0-4acb-a7f2-4cdc79adc7ab admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.591978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a387915-e7b0-4acb-a7f2-4cdc79adc7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.592249 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a387915-e7b0-4acb-a7f2-4cdc79adc7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.592916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a387915-e7b0-4acb-a7f2-4cdc79adc7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:51.594538 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a387915-e7b0-4acb-a7f2-4cdc79adc7ab admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:51.605571 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4382/8785] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:07:51.609503 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3a140-dac1-44c8-a4bf-acef096397bf admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:51.619478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3a140-dac1-44c8-a4bf-acef096397bf admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:51.624056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8364ce-2d71-4750-a40b-295000bcd45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:51.624752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8364ce-2d71-4750-a40b-295000bcd45f admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.624954 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8364ce-2d71-4750-a40b-295000bcd45f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.625225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8364ce-2d71-4750-a40b-295000bcd45f admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.625852 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8364ce-2d71-4750-a40b-295000bcd45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:51.627432 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8364ce-2d71-4750-a40b-295000bcd45f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:51.638442 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4404/8786] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:07:51.642517 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a387915-e7b0-4acb-a7f2-4cdc79adc7ab admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:51.653963 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a387915-e7b0-4acb-a7f2-4cdc79adc7ab admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:51.658702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7a323-5e5e-4dfe-b253-2e65a56a099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:51.659367 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7a323-5e5e-4dfe-b253-2e65a56a099a admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.659644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7a323-5e5e-4dfe-b253-2e65a56a099a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.659919 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7a323-5e5e-4dfe-b253-2e65a56a099a admin admin] PATH_INFO: `/v3/projects/4030669e64c14c27af306c4582fc5ede/users/02f03048cac8457e9a3a278df65f19f4/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.675042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7a323-5e5e-4dfe-b253-2e65a56a099a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4030669e64c14c27af306c4582fc5ede, user_id=02f03048cac8457e9a3a278df65f19f4, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:51.677678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7a323-5e5e-4dfe-b253-2e65a56a099a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:51.691323 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4383/8787] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:07:51 2022] PUT /identity/v3/projects/4030669e64c14c27af306c4582fc5ede/users/02f03048cac8457e9a3a278df65f19f4/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:07:51.701364 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a0d4-886d-4dd4-81af-b86f1c367746 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.701689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a0d4-886d-4dd4-81af-b86f1c367746 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.701971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a0d4-886d-4dd4-81af-b86f1c367746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.729744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ce31a0d4-886d-4dd4-81af-b86f1c367746 None None] MFA Rules not processed for user `02f03048cac8457e9a3a278df65f19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:07:51.730956 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ce31a0d4-886d-4dd4-81af-b86f1c367746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:51.749257 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:51.796389 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4405/8788] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:07:51.801026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7a323-5e5e-4dfe-b253-2e65a56a099a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:51.835446 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:51.866331 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7a323-5e5e-4dfe-b253-2e65a56a099a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:51.872196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013f83-534a-4f2f-a2a1-98e4ca826a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:51.873777 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013f83-534a-4f2f-a2a1-98e4ca826a84 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.874106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013f83-534a-4f2f-a2a1-98e4ca826a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.874395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013f83-534a-4f2f-a2a1-98e4ca826a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.875044 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28013f83-534a-4f2f-a2a1-98e4ca826a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:51.876990 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28013f83-534a-4f2f-a2a1-98e4ca826a84 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:51.904317 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4384/8789] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 02:07:51 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:07:51.908416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a0d4-886d-4dd4-81af-b86f1c367746 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:51.919765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a0d4-886d-4dd4-81af-b86f1c367746 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:51.976094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db9e2d-cab9-4564-9cf6-ed395bc18394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:51.976652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db9e2d-cab9-4564-9cf6-ed395bc18394 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:51.976927 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db9e2d-cab9-4564-9cf6-ed395bc18394 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:51.977840 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db9e2d-cab9-4564-9cf6-ed395bc18394 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:51.978437 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db9e2d-cab9-4564-9cf6-ed395bc18394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:51.980372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db9e2d-cab9-4564-9cf6-ed395bc18394 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:52.002264 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4406/8790] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 02:07:51 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:07:52.006317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013f83-534a-4f2f-a2a1-98e4ca826a84 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:52.017753 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013f83-534a-4f2f-a2a1-98e4ca826a84 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:52.022455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb02977-6438-45db-86cb-fba530736f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:52.023058 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb02977-6438-45db-86cb-fba530736f9d admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:52.023341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb02977-6438-45db-86cb-fba530736f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:52.023619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb02977-6438-45db-86cb-fba530736f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:52.024388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb02977-6438-45db-86cb-fba530736f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:52.025947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb02977-6438-45db-86cb-fba530736f9d admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:52.036604 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4385/8791] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:07:52.041115 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db9e2d-cab9-4564-9cf6-ed395bc18394 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:52.052926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db9e2d-cab9-4564-9cf6-ed395bc18394 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:52.058848 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4105a-6985-4e9d-969c-45ce417d5bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:52.059506 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4105a-6985-4e9d-969c-45ce417d5bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:52.059787 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4105a-6985-4e9d-969c-45ce417d5bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:52.060060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4105a-6985-4e9d-969c-45ce417d5bf1 admin admin] PATH_INFO: `/v3/projects/a9399d51d82e43ac979cc79ad3b196d0/users/2821c88eed11433e9bfbc9b8513e0eb8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:52.075751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4105a-6985-4e9d-969c-45ce417d5bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9399d51d82e43ac979cc79ad3b196d0, user_id=2821c88eed11433e9bfbc9b8513e0eb8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:52.078521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4105a-6985-4e9d-969c-45ce417d5bf1 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:52.092077 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4407/8792] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:07:52 2022] PUT /identity/v3/projects/a9399d51d82e43ac979cc79ad3b196d0/users/2821c88eed11433e9bfbc9b8513e0eb8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:07:52.095996 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb02977-6438-45db-86cb-fba530736f9d admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:52.107139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb02977-6438-45db-86cb-fba530736f9d admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:52.162542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beee09-78bb-424b-9f9a-7f1832388afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:52.163146 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beee09-78bb-424b-9f9a-7f1832388afc admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:52.163430 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beee09-78bb-424b-9f9a-7f1832388afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:52.163708 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beee09-78bb-424b-9f9a-7f1832388afc admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:52.164344 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beee09-78bb-424b-9f9a-7f1832388afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:52.166743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beee09-78bb-424b-9f9a-7f1832388afc admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:52.176459 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4386/8793] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:07:52.180905 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4105a-6985-4e9d-969c-45ce417d5bf1 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:52.191434 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4105a-6985-4e9d-969c-45ce417d5bf1 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:52.196572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e8f0c-f1a0-4247-b0bb-dc313d57a8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:52.197401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e8f0c-f1a0-4247-b0bb-dc313d57a8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:52.197681 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e8f0c-f1a0-4247-b0bb-dc313d57a8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:52.197957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e8f0c-f1a0-4247-b0bb-dc313d57a8ef admin admin] PATH_INFO: `/v3/projects/a9399d51d82e43ac979cc79ad3b196d0/users/2821c88eed11433e9bfbc9b8513e0eb8/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:52.199880 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e8f0c-f1a0-4247-b0bb-dc313d57a8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9399d51d82e43ac979cc79ad3b196d0, user_id=2821c88eed11433e9bfbc9b8513e0eb8, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:52.202545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e8f0c-f1a0-4247-b0bb-dc313d57a8ef admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:52.213315 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4408/8794] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:07:52 2022] PUT /identity/v3/projects/a9399d51d82e43ac979cc79ad3b196d0/users/2821c88eed11433e9bfbc9b8513e0eb8/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:07:52.224199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6caba-426b-4b69-a20e-62297e08651a None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:52.224492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6caba-426b-4b69-a20e-62297e08651a None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:52.224907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6caba-426b-4b69-a20e-62297e08651a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:52.252578 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-e0e6caba-426b-4b69-a20e-62297e08651a None None] MFA Rules not processed for user `2821c88eed11433e9bfbc9b8513e0eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:07:52.253760 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e0e6caba-426b-4b69-a20e-62297e08651a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:52.321983 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4387/8795] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:07:52 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:07:52.336079 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e8f0c-f1a0-4247-b0bb-dc313d57a8ef admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:52.338424 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a61e8f0c-f1a0-4247-b0bb-dc313d57a8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:52.410773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e8f0c-f1a0-4247-b0bb-dc313d57a8ef admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:52.417294 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ca238-094f-40d2-a9e4-b7e5b05d6724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:52.417910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ca238-094f-40d2-a9e4-b7e5b05d6724 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:52.418197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ca238-094f-40d2-a9e4-b7e5b05d6724 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:52.418474 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ca238-094f-40d2-a9e4-b7e5b05d6724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:52.427054 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:52.477915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ca238-094f-40d2-a9e4-b7e5b05d6724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:52.479563 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ca238-094f-40d2-a9e4-b7e5b05d6724 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:52.488609 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4409/8796] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:07:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:07:55.141175 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6caba-426b-4b69-a20e-62297e08651a None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:55.142715 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-e0e6caba-426b-4b69-a20e-62297e08651a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:55.175971 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:55.206547 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6caba-426b-4b69-a20e-62297e08651a None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:55.210383 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c5663-488f-4180-a2cb-d72209c103bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:55.210994 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c5663-488f-4180-a2cb-d72209c103bc service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:55.211982 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c5663-488f-4180-a2cb-d72209c103bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:55.212270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c5663-488f-4180-a2cb-d72209c103bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:55.223239 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c5663-488f-4180-a2cb-d72209c103bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:55.224713 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c5663-488f-4180-a2cb-d72209c103bc service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:55.235407 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4388/8797] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:07:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:07:58.417491 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe8942-9777-4434-8006-8c061cb530c8 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:58.418461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe8942-9777-4434-8006-8c061cb530c8 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:58.418991 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe8942-9777-4434-8006-8c061cb530c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:58.441281 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-4dfe8942-9777-4434-8006-8c061cb530c8 None None] MFA Rules not processed for user `02f03048cac8457e9a3a278df65f19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:07:58.442509 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4dfe8942-9777-4434-8006-8c061cb530c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:58.449960 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4410/8798] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:07:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:07:59.195188 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c5663-488f-4180-a2cb-d72209c103bc service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:07:59.197317 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-950c5663-488f-4180-a2cb-d72209c103bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:59.304020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c5663-488f-4180-a2cb-d72209c103bc service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:07:59.309914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eee7c5-79f3-4bd2-81a6-fd01ccf6fad3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:07:59.310868 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eee7c5-79f3-4bd2-81a6-fd01ccf6fad3 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:07:59.311183 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eee7c5-79f3-4bd2-81a6-fd01ccf6fad3 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:07:59.311635 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eee7c5-79f3-4bd2-81a6-fd01ccf6fad3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:07:59.313618 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-05eee7c5-79f3-4bd2-81a6-fd01ccf6fad3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:07:59.330927 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eee7c5-79f3-4bd2-81a6-fd01ccf6fad3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:07:59.332546 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eee7c5-79f3-4bd2-81a6-fd01ccf6fad3 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:07:59.343759 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4389/8799] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:07:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:08:03.766093 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe8942-9777-4434-8006-8c061cb530c8 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:08:03.767604 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4dfe8942-9777-4434-8006-8c061cb530c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:08:03.780245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe8942-9777-4434-8006-8c061cb530c8 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:08:03.783856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:08:03.784453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:08:03.784773 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:08:03.785052 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:08:03.786706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:08:03.796134 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:08:03.797577 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:08:03.805845 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4411/8800] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:08:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:08:09.339201 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=46 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:13.802013 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=32 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:06.765492 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b710e5-c437-4170-b17c-1e6de8cb7ce4 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:09:06.766028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b710e5-c437-4170-b17c-1e6de8cb7ce4 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:09:06.766028 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b710e5-c437-4170-b17c-1e6de8cb7ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:09:06.793048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-f9b710e5-c437-4170-b17c-1e6de8cb7ce4 None None] MFA Rules not processed for user `02f03048cac8457e9a3a278df65f19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:09:06.794288 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f9b710e5-c437-4170-b17c-1e6de8cb7ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:09:06.801829 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4390/8801] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:09:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:09:06.854565 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:09:06.856375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:09:06.952234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a603-7315-4feb-91b5-41e612817369 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:09:06.956019 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f42ea-3a06-4f0a-9e68-46a9eee06ce2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:09:06.956714 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f42ea-3a06-4f0a-9e68-46a9eee06ce2 service glance] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:09:06.956944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f42ea-3a06-4f0a-9e68-46a9eee06ce2 service glance] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:09:06.957225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f42ea-3a06-4f0a-9e68-46a9eee06ce2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:09:06.958961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-dc2f42ea-3a06-4f0a-9e68-46a9eee06ce2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:09:06.987485 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f42ea-3a06-4f0a-9e68-46a9eee06ce2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:09:06.989131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f42ea-3a06-4f0a-9e68-46a9eee06ce2 service glance] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:09:07.001761 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4412/8802] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:09:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:09:07.682369 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b710e5-c437-4170-b17c-1e6de8cb7ce4 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:09:07.693890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b710e5-c437-4170-b17c-1e6de8cb7ce4 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:09:07.698394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0824209-b58f-48cb-853c-1c29d17e49ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:09:07.699215 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0824209-b58f-48cb-853c-1c29d17e49ae service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:09:07.699565 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0824209-b58f-48cb-853c-1c29d17e49ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:09:07.700103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0824209-b58f-48cb-853c-1c29d17e49ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:09:07.702694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c0824209-b58f-48cb-853c-1c29d17e49ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:09:07.719268 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0824209-b58f-48cb-853c-1c29d17e49ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:09:07.720853 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0824209-b58f-48cb-853c-1c29d17e49ae service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:09:07.741143 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4391/8803] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:09:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:09:16.996431 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=40 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:17.728912 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=9 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:10:09.423693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f42ea-3a06-4f0a-9e68-46a9eee06ce2 service glance] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:10:09.435562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f42ea-3a06-4f0a-9e68-46a9eee06ce2 service glance] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:10:09.440930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:10:09.441562 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:10:09.441845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:10:09.442122 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:10:09.443857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:10:09.455792 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:10:09.457399 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:10:09.467384 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4413/8804] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:10:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:10:19.463179 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:10:48.955340 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0824209-b58f-48cb-853c-1c29d17e49ae service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:10:48.972771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0824209-b58f-48cb-853c-1c29d17e49ae service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:10:48.979619 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d972e-963d-466f-8105-0066f1809664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:10:48.980666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d972e-963d-466f-8105-0066f1809664 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:10:48.980666 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d972e-963d-466f-8105-0066f1809664 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:10:48.980948 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d972e-963d-466f-8105-0066f1809664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:10:48.984085 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c19d972e-963d-466f-8105-0066f1809664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:10:49.000935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d972e-963d-466f-8105-0066f1809664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:10:49.002598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d972e-963d-466f-8105-0066f1809664 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:10:49.015104 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4392/8805] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:10:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:10:51.781961 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:10:51.783729 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:10:51.809330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bf75b-3b5f-43d0-b491-c918636c5d8c service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:10:51.815408 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534491-cf96-46d6-b1c4-06264b4bd161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:10:51.816013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534491-cf96-46d6-b1c4-06264b4bd161 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:10:51.816308 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534491-cf96-46d6-b1c4-06264b4bd161 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:10:51.816564 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534491-cf96-46d6-b1c4-06264b4bd161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:10:51.818396 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae534491-cf96-46d6-b1c4-06264b4bd161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:10:51.832603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534491-cf96-46d6-b1c4-06264b4bd161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:10:51.834373 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534491-cf96-46d6-b1c4-06264b4bd161 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:10:51.846857 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4414/8806] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:10:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:10:57.114828 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d972e-963d-466f-8105-0066f1809664 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:10:57.126605 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d972e-963d-466f-8105-0066f1809664 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:10:57.132866 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1837db8-9375-48b0-b03b-c734cb5ef150 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:10:57.133549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1837db8-9375-48b0-b03b-c734cb5ef150 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:10:57.133837 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1837db8-9375-48b0-b03b-c734cb5ef150 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:10:57.134131 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1837db8-9375-48b0-b03b-c734cb5ef150 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:10:57.136445 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d1837db8-9375-48b0-b03b-c734cb5ef150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:10:57.149532 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1837db8-9375-48b0-b03b-c734cb5ef150 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:10:57.151233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1837db8-9375-48b0-b03b-c734cb5ef150 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:10:57.162362 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4393/8807] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:10:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:11:01.842729 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:02.010542 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeca25-6379-4bae-a1c4-8f3e239e2d72 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:02.014619 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeca25-6379-4bae-a1c4-8f3e239e2d72 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:02.014894 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeca25-6379-4bae-a1c4-8f3e239e2d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:02.037612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-6cbeca25-6379-4bae-a1c4-8f3e239e2d72 None None] MFA Rules not processed for user `02f03048cac8457e9a3a278df65f19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:02.039317 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6cbeca25-6379-4bae-a1c4-8f3e239e2d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:02.048791 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4415/8808] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:11:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:11:02.434419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1837db8-9375-48b0-b03b-c734cb5ef150 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:02.445653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1837db8-9375-48b0-b03b-c734cb5ef150 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:02.449481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0f343-457d-4076-b5fc-a417c73419ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:02.451316 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0f343-457d-4076-b5fc-a417c73419ec service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:02.451606 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0f343-457d-4076-b5fc-a417c73419ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:02.451884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0f343-457d-4076-b5fc-a417c73419ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:02.453756 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7da0f343-457d-4076-b5fc-a417c73419ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:02.465248 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0f343-457d-4076-b5fc-a417c73419ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:02.467095 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0f343-457d-4076-b5fc-a417c73419ec service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:02.480043 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4394/8809] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:11:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:11:10.343680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeca25-6379-4bae-a1c4-8f3e239e2d72 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:10.360144 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeca25-6379-4bae-a1c4-8f3e239e2d72 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:10.365924 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae8165-cf09-4d53-b80a-3ae76ec5a6ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:10.366636 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae8165-cf09-4d53-b80a-3ae76ec5a6ed service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:10.367110 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae8165-cf09-4d53-b80a-3ae76ec5a6ed service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:10.367389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae8165-cf09-4d53-b80a-3ae76ec5a6ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:10.369330 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-43ae8165-cf09-4d53-b80a-3ae76ec5a6ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:10.383590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae8165-cf09-4d53-b80a-3ae76ec5a6ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:10.385222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae8165-cf09-4d53-b80a-3ae76ec5a6ed service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:10.397609 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4416/8810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:11:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:11:12.472781 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=18 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:20.393851 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:49.290761 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2e70a-1b2f-4794-8362-aa32896c722b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.291358 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2e70a-1b2f-4794-8362-aa32896c722b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.291533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2e70a-1b2f-4794-8362-aa32896c722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.355192 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-8df2e70a-1b2f-4794-8362-aa32896c722b None None] MFA Rules not processed for user `67bdb67cd5854c38b2031a1b8c26023e`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:49.356423 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-8df2e70a-1b2f-4794-8362-aa32896c722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:49.372897 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4395/8811] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 02:11:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:11:49.385015 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae8165-cf09-4d53-b80a-3ae76ec5a6ed service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:49.395523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae8165-cf09-4d53-b80a-3ae76ec5a6ed service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:49.399381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011733c1-3dbb-4b66-96fa-396a8879de29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:49.399990 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011733c1-3dbb-4b66-96fa-396a8879de29 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.400273 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011733c1-3dbb-4b66-96fa-396a8879de29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.400548 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011733c1-3dbb-4b66-96fa-396a8879de29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.408759 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011733c1-3dbb-4b66-96fa-396a8879de29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:49.410196 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011733c1-3dbb-4b66-96fa-396a8879de29 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:49.418316 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4417/8812] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:11:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:11:49.497210 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d149d68-1697-40c5-8512-9842f12cfc5e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.497497 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d149d68-1697-40c5-8512-9842f12cfc5e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.497772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d149d68-1697-40c5-8512-9842f12cfc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.535673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-6d149d68-1697-40c5-8512-9842f12cfc5e None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:49.536987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-6d149d68-1697-40c5-8512-9842f12cfc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:49.545543 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4396/8813] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 02:11:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:11:49.557002 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011733c1-3dbb-4b66-96fa-396a8879de29 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:49.558394 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-011733c1-3dbb-4b66-96fa-396a8879de29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:49.574099 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011733c1-3dbb-4b66-96fa-396a8879de29 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:49.579999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8abf8a-e257-460c-a3c1-2b32b461673d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:49.580674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8abf8a-e257-460c-a3c1-2b32b461673d service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.580965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8abf8a-e257-460c-a3c1-2b32b461673d service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.581242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8abf8a-e257-460c-a3c1-2b32b461673d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.589865 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8abf8a-e257-460c-a3c1-2b32b461673d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:49.591431 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8abf8a-e257-460c-a3c1-2b32b461673d service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:49.601837 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4418/8814] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:11:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:11:49.773309 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043ef97-8367-4de1-bdbf-acc7f4b28322 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.773677 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043ef97-8367-4de1-bdbf-acc7f4b28322 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.773955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043ef97-8367-4de1-bdbf-acc7f4b28322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.811614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-c043ef97-8367-4de1-bdbf-acc7f4b28322 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:49.813373 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c043ef97-8367-4de1-bdbf-acc7f4b28322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:49.822914 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4397/8815] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 02:11:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:11:49.834406 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8abf8a-e257-460c-a3c1-2b32b461673d service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:49.844641 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8abf8a-e257-460c-a3c1-2b32b461673d service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:49.848346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d549-5541-43c5-a36d-61100fae7b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:49.848978 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d549-5541-43c5-a36d-61100fae7b06 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.849262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d549-5541-43c5-a36d-61100fae7b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.849535 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d549-5541-43c5-a36d-61100fae7b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.859693 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608d549-5541-43c5-a36d-61100fae7b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:49.861140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608d549-5541-43c5-a36d-61100fae7b06 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:49.871911 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4419/8816] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:11:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:11:49.932341 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043ef97-8367-4de1-bdbf-acc7f4b28322 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:49.944796 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043ef97-8367-4de1-bdbf-acc7f4b28322 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:49.949840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81e8f1-726f-4889-9669-9c51a9210365 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:49.950435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81e8f1-726f-4889-9669-9c51a9210365 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.950716 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81e8f1-726f-4889-9669-9c51a9210365 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.950987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81e8f1-726f-4889-9669-9c51a9210365 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.952714 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2a81e8f1-726f-4889-9669-9c51a9210365 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:49.965019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81e8f1-726f-4889-9669-9c51a9210365 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:49.966585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81e8f1-726f-4889-9669-9c51a9210365 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:49.976936 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4398/8817] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:11:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:11:59.867148 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=18 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:59.972865 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=45 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:08.937552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d549-5541-43c5-a36d-61100fae7b06 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:08.947975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d549-5541-43c5-a36d-61100fae7b06 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.951695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553499b7-2007-4ed8-97af-29fd6bf5c279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.952236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553499b7-2007-4ed8-97af-29fd6bf5c279 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.952532 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553499b7-2007-4ed8-97af-29fd6bf5c279 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.952841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553499b7-2007-4ed8-97af-29fd6bf5c279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.954523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-553499b7-2007-4ed8-97af-29fd6bf5c279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:08.963915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553499b7-2007-4ed8-97af-29fd6bf5c279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:08.965358 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553499b7-2007-4ed8-97af-29fd6bf5c279 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:08.973945 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4420/8818] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:12:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:12:18.969739 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:52.475570 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81e8f1-726f-4889-9669-9c51a9210365 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:52.485319 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81e8f1-726f-4889-9669-9c51a9210365 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:52.489169 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ce80-cda5-4cd3-ab25-7678897b07e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:52.489888 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ce80-cda5-4cd3-ab25-7678897b07e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:52.490302 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ce80-cda5-4cd3-ab25-7678897b07e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:52.490583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ce80-cda5-4cd3-ab25-7678897b07e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:52.514885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733ce80-cda5-4cd3-ab25-7678897b07e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:52.516370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733ce80-cda5-4cd3-ab25-7678897b07e6 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:52.526741 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4399/8819] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:12:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:12:55.127026 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096959-2fc7-479d-9f16-58b99e6338df None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.127888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096959-2fc7-479d-9f16-58b99e6338df None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.128168 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096959-2fc7-479d-9f16-58b99e6338df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.154069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3d096959-2fc7-479d-9f16-58b99e6338df None None] MFA Rules not processed for user `02f03048cac8457e9a3a278df65f19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:55.156136 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3d096959-2fc7-479d-9f16-58b99e6338df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:55.169384 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4421/8820] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:12:55.896645 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ce80-cda5-4cd3-ab25-7678897b07e6 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.906782 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ce80-cda5-4cd3-ab25-7678897b07e6 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.910625 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87815d-6c99-4ec9-afde-108b85913166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.911364 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87815d-6c99-4ec9-afde-108b85913166 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.911735 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87815d-6c99-4ec9-afde-108b85913166 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.911997 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87815d-6c99-4ec9-afde-108b85913166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.914628 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fc87815d-6c99-4ec9-afde-108b85913166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:55.924979 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87815d-6c99-4ec9-afde-108b85913166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.926442 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87815d-6c99-4ec9-afde-108b85913166 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.934710 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4400/8821] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:13:04.980021 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096959-2fc7-479d-9f16-58b99e6338df None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:04.989685 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096959-2fc7-479d-9f16-58b99e6338df None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:04.993810 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afc18-8401-4a8b-a5f8-8110bb9f64df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:04.994412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afc18-8401-4a8b-a5f8-8110bb9f64df service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:04.994694 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afc18-8401-4a8b-a5f8-8110bb9f64df service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:04.994994 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afc18-8401-4a8b-a5f8-8110bb9f64df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.003779 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58afc18-8401-4a8b-a5f8-8110bb9f64df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:05.005239 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58afc18-8401-4a8b-a5f8-8110bb9f64df service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:05.014952 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4422/8822] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:13:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:13:05.931028 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=18 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.688891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87815d-6c99-4ec9-afde-108b85913166 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:06.699199 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87815d-6c99-4ec9-afde-108b85913166 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:06.703060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3f9d3-eba9-47fa-83fc-72705e1f6ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:06.703976 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3f9d3-eba9-47fa-83fc-72705e1f6ffd service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.704549 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3f9d3-eba9-47fa-83fc-72705e1f6ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.705042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3f9d3-eba9-47fa-83fc-72705e1f6ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.713928 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3f9d3-eba9-47fa-83fc-72705e1f6ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:06.715731 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3f9d3-eba9-47fa-83fc-72705e1f6ffd service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:06.725361 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4401/8823] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:13:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:13:15.010742 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:16.720545 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:31.542866 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afc18-8401-4a8b-a5f8-8110bb9f64df service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:31.561386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afc18-8401-4a8b-a5f8-8110bb9f64df service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:31.565416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80606fcb-3e9a-490a-bca7-0341e888705c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:31.566022 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80606fcb-3e9a-490a-bca7-0341e888705c service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:31.566310 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80606fcb-3e9a-490a-bca7-0341e888705c service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:31.566585 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80606fcb-3e9a-490a-bca7-0341e888705c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:31.577230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80606fcb-3e9a-490a-bca7-0341e888705c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:31.578669 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80606fcb-3e9a-490a-bca7-0341e888705c service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:31.611900 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4423/8824] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:14:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:14:32.800488 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3f9d3-eba9-47fa-83fc-72705e1f6ffd service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:32.819778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3f9d3-eba9-47fa-83fc-72705e1f6ffd service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:32.823909 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e1a1f-c0a9-47a9-af88-fcc279965000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:32.824503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e1a1f-c0a9-47a9-af88-fcc279965000 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:32.824808 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e1a1f-c0a9-47a9-af88-fcc279965000 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:32.825080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e1a1f-c0a9-47a9-af88-fcc279965000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:32.835139 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e1a1f-c0a9-47a9-af88-fcc279965000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:32.837542 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e1a1f-c0a9-47a9-af88-fcc279965000 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:32.849456 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4402/8825] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:14:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:14:38.629612 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80606fcb-3e9a-490a-bca7-0341e888705c service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:38.641533 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80606fcb-3e9a-490a-bca7-0341e888705c service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:38.646515 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb2004-dca0-4ddb-b216-317f06436b95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:38.647118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb2004-dca0-4ddb-b216-317f06436b95 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:38.647398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb2004-dca0-4ddb-b216-317f06436b95 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:38.647671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb2004-dca0-4ddb-b216-317f06436b95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:38.650074 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-4beb2004-dca0-4ddb-b216-317f06436b95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:14:38.671327 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb2004-dca0-4ddb-b216-317f06436b95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:38.672942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb2004-dca0-4ddb-b216-317f06436b95 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:38.683430 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4424/8826] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:14:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:14:42.844740 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=11 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:44.434343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00913-40d9-41d5-b28b-6a362c02d7f3 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:44.434899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00913-40d9-41d5-b28b-6a362c02d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:44.434899 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00913-40d9-41d5-b28b-6a362c02d7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:44.455750 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-0eb00913-40d9-41d5-b28b-6a362c02d7f3 None None] MFA Rules not processed for user `02f03048cac8457e9a3a278df65f19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:14:44.457395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0eb00913-40d9-41d5-b28b-6a362c02d7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:14:44.465390 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4403/8827] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:14:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:14:48.679327 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=28 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:54.450276 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:17.323996 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb2004-dca0-4ddb-b216-317f06436b95 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:17.344938 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb2004-dca0-4ddb-b216-317f06436b95 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:17.350066 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507affb-6050-423e-8b26-1430a9b03662 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:17.350670 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507affb-6050-423e-8b26-1430a9b03662 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:17.350949 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507affb-6050-423e-8b26-1430a9b03662 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:17.351219 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507affb-6050-423e-8b26-1430a9b03662 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:17.360378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507affb-6050-423e-8b26-1430a9b03662 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:17.361993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507affb-6050-423e-8b26-1430a9b03662 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:17.371778 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4425/8828] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:15:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:15:27.367529 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:47.572136 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00913-40d9-41d5-b28b-6a362c02d7f3 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:47.680507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00913-40d9-41d5-b28b-6a362c02d7f3 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:47.685260 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:47.685912 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:47.686184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:47.686457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] PATH_INFO: `/v3/users/02f03048cac8457e9a3a278df65f19f4` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:47.687676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f03048cac8457e9a3a278df65f19f4)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:47.689803 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:47.742206 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f03048cac8457e9a3a278df65f19f4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:47.754117 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f03048cac8457e9a3a278df65f19f4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:47.768412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f03048cac8457e9a3a278df65f19f4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:47.775520 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f03048cac8457e9a3a278df65f19f4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:47.776204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f03048cac8457e9a3a278df65f19f4'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:47.783091 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4404/8829] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:15:47 2022] DELETE /identity/v3/users/02f03048cac8457e9a3a278df65f19f4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:15:47.787709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0815fe-70c2-4f90-b9cd-51917fdc089d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:47.788224 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0815fe-70c2-4f90-b9cd-51917fdc089d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:47.788345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0815fe-70c2-4f90-b9cd-51917fdc089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:47.829573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ff0815fe-70c2-4f90-b9cd-51917fdc089d None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:47.830785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ff0815fe-70c2-4f90-b9cd-51917fdc089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:47.894503 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4426/8830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:15:47.905080 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:47.906507 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:47.967649 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:47.980388 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04b54c-c215-4336-86b3-89cd7bc25b1a admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:47.984887 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d5cf-385a-4fc9-9791-3310504605b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:47.985502 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d5cf-385a-4fc9-9791-3310504605b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:47.985787 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d5cf-385a-4fc9-9791-3310504605b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:47.986069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d5cf-385a-4fc9-9791-3310504605b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:47.995674 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718d5cf-385a-4fc9-9791-3310504605b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:47.997217 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718d5cf-385a-4fc9-9791-3310504605b1 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:48.008809 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4405/8831] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:15:48.196552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0815fe-70c2-4f90-b9cd-51917fdc089d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:48.198407 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ff0815fe-70c2-4f90-b9cd-51917fdc089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:48.212492 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0815fe-70c2-4f90-b9cd-51917fdc089d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:48.218238 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:48.218970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:48.219328 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:48.219682 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] PATH_INFO: `/v3/projects/4030669e64c14c27af306c4582fc5ede` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:48.220958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4030669e64c14c27af306c4582fc5ede)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:48.223025 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:48.273295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4030669e64c14c27af306c4582fc5ede', 'request_id': 'req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.281680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4030669e64c14c27af306c4582fc5ede', 'request_id': 'req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.288220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4030669e64c14c27af306c4582fc5ede', 'request_id': 'req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.301220 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] The token cache is being invalidate because project 4030669e64c14c27af306c4582fc5ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:15:48.301507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.302161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.303905 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4427/8832] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:15:48 2022] DELETE /identity/v3/projects/4030669e64c14c27af306c4582fc5ede => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:15:48.307779 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d5cf-385a-4fc9-9791-3310504605b1 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:48.318694 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d5cf-385a-4fc9-9791-3310504605b1 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:48.379858 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:48.380444 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:48.380754 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:48.381033 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] PATH_INFO: `/v3/users/2821c88eed11433e9bfbc9b8513e0eb8` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:48.382162 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2821c88eed11433e9bfbc9b8513e0eb8)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:48.384099 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:48.437011 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2821c88eed11433e9bfbc9b8513e0eb8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.451261 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2821c88eed11433e9bfbc9b8513e0eb8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.461030 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2821c88eed11433e9bfbc9b8513e0eb8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.469811 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2821c88eed11433e9bfbc9b8513e0eb8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.470639 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-c5b411ed-c329-4314-b08d-0c4c348a2cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2821c88eed11433e9bfbc9b8513e0eb8'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.477008 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4406/8833] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:15:48 2022] DELETE /identity/v3/users/2821c88eed11433e9bfbc9b8513e0eb8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:15:48.755671 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:48.757222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:48.773993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3807fa5-4ee0-448b-b5f2-e8ebdd5db3b5 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:48.835231 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:48.835909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:48.836154 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:48.836427 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] PATH_INFO: `/v3/projects/a9399d51d82e43ac979cc79ad3b196d0` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:48.837652 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9399d51d82e43ac979cc79ad3b196d0)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:48.839554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:48.849550 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:48.891980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9399d51d82e43ac979cc79ad3b196d0', 'request_id': 'req-44cd5819-f6e6-43a4-a4ac-43f415e5094a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.899545 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9399d51d82e43ac979cc79ad3b196d0', 'request_id': 'req-44cd5819-f6e6-43a4-a4ac-43f415e5094a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.906453 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9399d51d82e43ac979cc79ad3b196d0', 'request_id': 'req-44cd5819-f6e6-43a4-a4ac-43f415e5094a'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.918108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] The token cache is being invalidate because project a9399d51d82e43ac979cc79ad3b196d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:15:48.918447 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.919309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-44cd5819-f6e6-43a4-a4ac-43f415e5094a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:15:48.920872 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4428/8834] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:15:48 2022] DELETE /identity/v3/projects/a9399d51d82e43ac979cc79ad3b196d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:15:48.926103 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880829d-390f-475b-9206-6841c8dd1891 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:48.926612 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880829d-390f-475b-9206-6841c8dd1891 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:48.926723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880829d-390f-475b-9206-6841c8dd1891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:48.968052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-a880829d-390f-475b-9206-6841c8dd1891 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:48.969270 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-a880829d-390f-475b-9206-6841c8dd1891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:49.014546 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:49.031081 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4407/8835] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:15:49.039678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a676-19fc-4102-a163-8c0575b913a5 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:49.039958 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a676-19fc-4102-a163-8c0575b913a5 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:49.040230 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a676-19fc-4102-a163-8c0575b913a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:49.061502 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-53d7a676-19fc-4102-a163-8c0575b913a5 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:49.062733 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-53d7a676-19fc-4102-a163-8c0575b913a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:49.073504 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4429/8836] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:15:49.076315 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880829d-390f-475b-9206-6841c8dd1891 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:49.086726 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880829d-390f-475b-9206-6841c8dd1891 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:49.092483 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc1c09-74c7-4bcb-9c5f-4276ac43ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:49.093161 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc1c09-74c7-4bcb-9c5f-4276ac43ee07 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:49.093438 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc1c09-74c7-4bcb-9c5f-4276ac43ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:49.093711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc1c09-74c7-4bcb-9c5f-4276ac43ee07 admin admin] PATH_INFO: `/v3/domains` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:49.094376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc1c09-74c7-4bcb-9c5f-4276ac43ee07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86424) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:49.094678 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc1c09-74c7-4bcb-9c5f-4276ac43ee07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:49.096298 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc1c09-74c7-4bcb-9c5f-4276ac43ee07 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:49.113385 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4408/8837] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 02:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:49.115183 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a676-19fc-4102-a163-8c0575b913a5 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:49.124970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a676-19fc-4102-a163-8c0575b913a5 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:49.129639 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661f09c-7837-432f-a82c-819bfe3148ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:49.130247 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661f09c-7837-432f-a82c-819bfe3148ec admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:49.130528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661f09c-7837-432f-a82c-819bfe3148ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:49.130802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661f09c-7837-432f-a82c-819bfe3148ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:49.131438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661f09c-7837-432f-a82c-819bfe3148ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:49.133382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661f09c-7837-432f-a82c-819bfe3148ec admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:49.176897 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4430/8838] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 02:15:49 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:15:49.178426 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc1c09-74c7-4bcb-9c5f-4276ac43ee07 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:49.192042 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc1c09-74c7-4bcb-9c5f-4276ac43ee07 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:49.248156 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e101e81-d619-414d-be6f-30c54c313e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:49.248776 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e101e81-d619-414d-be6f-30c54c313e70 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:49.249055 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e101e81-d619-414d-be6f-30c54c313e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:49.249322 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e101e81-d619-414d-be6f-30c54c313e70 admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:49.249935 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e101e81-d619-414d-be6f-30c54c313e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:49.251864 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e101e81-d619-414d-be6f-30c54c313e70 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:49.272536 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4409/8839] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 02:15:49 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:15:49.276788 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661f09c-7837-432f-a82c-819bfe3148ec admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:49.287794 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661f09c-7837-432f-a82c-819bfe3148ec admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:49.292547 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54160-ca28-4904-b057-b26b2607de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:49.293181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54160-ca28-4904-b057-b26b2607de1b admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:49.294131 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54160-ca28-4904-b057-b26b2607de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:49.294418 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54160-ca28-4904-b057-b26b2607de1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:49.295059 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb54160-ca28-4904-b057-b26b2607de1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:49.296680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb54160-ca28-4904-b057-b26b2607de1b admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:49.306580 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4431/8840] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:15:49.310595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e101e81-d619-414d-be6f-30c54c313e70 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:49.321007 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e101e81-d619-414d-be6f-30c54c313e70 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:49.325723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f518e4-cef8-4446-bdf1-cf801930919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:49.326308 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f518e4-cef8-4446-bdf1-cf801930919f admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:49.326586 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f518e4-cef8-4446-bdf1-cf801930919f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:49.326855 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f518e4-cef8-4446-bdf1-cf801930919f admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:49.327515 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f518e4-cef8-4446-bdf1-cf801930919f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:49.329144 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f518e4-cef8-4446-bdf1-cf801930919f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:49.339902 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4410/8841] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:15:49.344416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54160-ca28-4904-b057-b26b2607de1b admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:49.354338 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54160-ca28-4904-b057-b26b2607de1b admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:49.360146 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b31ec-c81c-40a7-9d8f-125dff10e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:49.360827 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b31ec-c81c-40a7-9d8f-125dff10e57c admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:49.361108 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b31ec-c81c-40a7-9d8f-125dff10e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:49.361413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b31ec-c81c-40a7-9d8f-125dff10e57c admin admin] PATH_INFO: `/v3/projects/6ce5fe85f8b94c92b72fe172eb024b60/users/4ea84bfb9df044fdadd880ed8260c393/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:49.379097 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b31ec-c81c-40a7-9d8f-125dff10e57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce5fe85f8b94c92b72fe172eb024b60, user_id=4ea84bfb9df044fdadd880ed8260c393, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:49.381883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b31ec-c81c-40a7-9d8f-125dff10e57c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:49.397537 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4432/8842] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:15:49 2022] PUT /identity/v3/projects/6ce5fe85f8b94c92b72fe172eb024b60/users/4ea84bfb9df044fdadd880ed8260c393/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:15:49.403702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3d65-0712-46ad-af9a-8e259da55c0e None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:49.403993 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3d65-0712-46ad-af9a-8e259da55c0e None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:49.404300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3d65-0712-46ad-af9a-8e259da55c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:49.423262 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-df6c3d65-0712-46ad-af9a-8e259da55c0e None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:49.424473 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-df6c3d65-0712-46ad-af9a-8e259da55c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:49.484468 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4411/8843] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:15:49.494260 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b31ec-c81c-40a7-9d8f-125dff10e57c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:49.495930 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-311b31ec-c81c-40a7-9d8f-125dff10e57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:49.553309 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b31ec-c81c-40a7-9d8f-125dff10e57c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:49.557056 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9904-8abe-4dcf-8408-9b9bd2a5b965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:49.557658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9904-8abe-4dcf-8408-9b9bd2a5b965 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:49.557944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9904-8abe-4dcf-8408-9b9bd2a5b965 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:49.558240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9904-8abe-4dcf-8408-9b9bd2a5b965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:49.568217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f9904-8abe-4dcf-8408-9b9bd2a5b965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:49.569678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f9904-8abe-4dcf-8408-9b9bd2a5b965 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:49.579787 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4433/8844] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:15:53.330877 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df11c-1690-4151-8638-3f72e1ed730f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:53.331345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df11c-1690-4151-8638-3f72e1ed730f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:53.331463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df11c-1690-4151-8638-3f72e1ed730f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:53.362265 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-610df11c-1690-4151-8638-3f72e1ed730f None None] MFA Rules not processed for user `4ea84bfb9df044fdadd880ed8260c393`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:53.363498 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-610df11c-1690-4151-8638-3f72e1ed730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:53.432106 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:53.461481 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4412/8845] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:15:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:15:53.466554 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9904-8abe-4dcf-8408-9b9bd2a5b965 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:53.479158 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9904-8abe-4dcf-8408-9b9bd2a5b965 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:53.487401 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52bc4e-f2da-4686-98d0-2568c8cbaa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:53.489267 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52bc4e-f2da-4686-98d0-2568c8cbaa9c admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:53.489780 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52bc4e-f2da-4686-98d0-2568c8cbaa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:53.490135 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52bc4e-f2da-4686-98d0-2568c8cbaa9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:53.490913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52bc4e-f2da-4686-98d0-2568c8cbaa9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:53.493041 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52bc4e-f2da-4686-98d0-2568c8cbaa9c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:53.532682 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4434/8846] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 02:15:53 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:15:53.536869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df11c-1690-4151-8638-3f72e1ed730f None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:53.550005 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df11c-1690-4151-8638-3f72e1ed730f None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:53.632857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb6da1-9c8d-404a-9246-c0a9118a57ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:53.633758 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb6da1-9c8d-404a-9246-c0a9118a57ce admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:53.634047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb6da1-9c8d-404a-9246-c0a9118a57ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:53.634324 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb6da1-9c8d-404a-9246-c0a9118a57ce admin admin] PATH_INFO: `/v3/users` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:53.634974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb6da1-9c8d-404a-9246-c0a9118a57ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:53.637482 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb6da1-9c8d-404a-9246-c0a9118a57ce admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:53.664367 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4413/8847] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 02:15:53 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:15:53.668864 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52bc4e-f2da-4686-98d0-2568c8cbaa9c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:53.677323 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:53.680496 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52bc4e-f2da-4686-98d0-2568c8cbaa9c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:53.689107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a13cea-8ead-49aa-bff6-75335f2621be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:53.689915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a13cea-8ead-49aa-bff6-75335f2621be admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:53.690345 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a13cea-8ead-49aa-bff6-75335f2621be admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:53.690831 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a13cea-8ead-49aa-bff6-75335f2621be admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:53.691856 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a13cea-8ead-49aa-bff6-75335f2621be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:53.693901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a13cea-8ead-49aa-bff6-75335f2621be admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:53.710291 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4435/8848] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:15:53.711894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb6da1-9c8d-404a-9246-c0a9118a57ce admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:53.723259 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb6da1-9c8d-404a-9246-c0a9118a57ce admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:53.728277 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae23df-d238-471a-b71c-8461f9f518b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:53.729020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae23df-d238-471a-b71c-8461f9f518b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:53.729307 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae23df-d238-471a-b71c-8461f9f518b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:53.729596 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae23df-d238-471a-b71c-8461f9f518b4 admin admin] PATH_INFO: `/v3/projects/9aea33d1aad04ce19b747e21ad157ef9/users/3cde62d635634096a263dccc415935e9/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:53.747140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae23df-d238-471a-b71c-8461f9f518b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aea33d1aad04ce19b747e21ad157ef9, user_id=3cde62d635634096a263dccc415935e9, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:53.749675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae23df-d238-471a-b71c-8461f9f518b4 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:53.765510 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4414/8849] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:15:53 2022] PUT /identity/v3/projects/9aea33d1aad04ce19b747e21ad157ef9/users/3cde62d635634096a263dccc415935e9/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:15:53.769658 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a13cea-8ead-49aa-bff6-75335f2621be admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:53.781571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a13cea-8ead-49aa-bff6-75335f2621be admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:53.852734 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212407fd-f3be-48ed-9f54-ad81f61d95f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:53.853365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212407fd-f3be-48ed-9f54-ad81f61d95f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:53.853655 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212407fd-f3be-48ed-9f54-ad81f61d95f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:53.853913 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212407fd-f3be-48ed-9f54-ad81f61d95f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:53.854706 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212407fd-f3be-48ed-9f54-ad81f61d95f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:53.857210 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212407fd-f3be-48ed-9f54-ad81f61d95f0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:53.871609 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4436/8850] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:15:53.873102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae23df-d238-471a-b71c-8461f9f518b4 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:53.887109 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae23df-d238-471a-b71c-8461f9f518b4 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:53.892576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06004567-4ddf-4cb9-9625-ca6580e74ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:53.893300 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06004567-4ddf-4cb9-9625-ca6580e74ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:53.893585 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06004567-4ddf-4cb9-9625-ca6580e74ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:53.893926 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06004567-4ddf-4cb9-9625-ca6580e74ff5 admin admin] PATH_INFO: `/v3/projects/9aea33d1aad04ce19b747e21ad157ef9/users/3cde62d635634096a263dccc415935e9/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:53.895958 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06004567-4ddf-4cb9-9625-ca6580e74ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aea33d1aad04ce19b747e21ad157ef9, user_id=3cde62d635634096a263dccc415935e9, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:53.898706 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06004567-4ddf-4cb9-9625-ca6580e74ff5 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:53.912855 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4415/8851] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:15:53 2022] PUT /identity/v3/projects/9aea33d1aad04ce19b747e21ad157ef9/users/3cde62d635634096a263dccc415935e9/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:15:58.149253 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212407fd-f3be-48ed-9f54-ad81f61d95f0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:58.151400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-212407fd-f3be-48ed-9f54-ad81f61d95f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:58.357483 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212407fd-f3be-48ed-9f54-ad81f61d95f0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:58.446350 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:58.447336 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:58.447809 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:58.448245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:58.450679 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:58.470584 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:58.472251 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:58.498711 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4437/8852] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:15:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:15:58.772924 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60c64f-7a75-42b1-901c-12a9e8d2a7a5 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:58.773768 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60c64f-7a75-42b1-901c-12a9e8d2a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:58.774048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60c64f-7a75-42b1-901c-12a9e8d2a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:58.807929 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-fe60c64f-7a75-42b1-901c-12a9e8d2a7a5 None None] MFA Rules not processed for user `3cde62d635634096a263dccc415935e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:58.809370 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-fe60c64f-7a75-42b1-901c-12a9e8d2a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:58.884905 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4416/8853] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:15:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:15:58.903229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:58.905299 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:58.920432 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=100 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:58.992476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7cd49-2fbc-4e08-9c9e-aabfb0c79785 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:58.998988 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c1f7e-30b9-4e56-91e8-d89852b20a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:58.999617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c1f7e-30b9-4e56-91e8-d89852b20a08 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:58.999902 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c1f7e-30b9-4e56-91e8-d89852b20a08 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:59.000181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c1f7e-30b9-4e56-91e8-d89852b20a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:59.064124 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c1f7e-30b9-4e56-91e8-d89852b20a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:59.065769 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c1f7e-30b9-4e56-91e8-d89852b20a08 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:59.075394 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4438/8854] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:15:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:16:00.087471 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e1c0-0b8d-4f83-9e0d-0a0021ffde19 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:16:00.088711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e1c0-0b8d-4f83-9e0d-0a0021ffde19 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:16:00.089061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e1c0-0b8d-4f83-9e0d-0a0021ffde19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:16:00.109569 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4147e1c0-0b8d-4f83-9e0d-0a0021ffde19 None None] MFA Rules not processed for user `4ea84bfb9df044fdadd880ed8260c393`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:16:00.110771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4147e1c0-0b8d-4f83-9e0d-0a0021ffde19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:16:00.117749 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4417/8855] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:16:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:16:01.113860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c1f7e-30b9-4e56-91e8-d89852b20a08 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:16:01.127632 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c1f7e-30b9-4e56-91e8-d89852b20a08 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:16:01.132993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec612a-fc29-4628-86bd-7dde2d3d8c4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:16:01.133795 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec612a-fc29-4628-86bd-7dde2d3d8c4c service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:16:01.134240 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec612a-fc29-4628-86bd-7dde2d3d8c4c service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:16:01.134700 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec612a-fc29-4628-86bd-7dde2d3d8c4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:16:01.137094 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6aec612a-fc29-4628-86bd-7dde2d3d8c4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:16:01.150501 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec612a-fc29-4628-86bd-7dde2d3d8c4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:16:01.152129 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec612a-fc29-4628-86bd-7dde2d3d8c4c service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:16:01.166142 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4439/8856] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:16:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:16:04.094807 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e1c0-0b8d-4f83-9e0d-0a0021ffde19 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:16:04.096609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4147e1c0-0b8d-4f83-9e0d-0a0021ffde19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:16:04.120029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e1c0-0b8d-4f83-9e0d-0a0021ffde19 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:16:04.126245 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:16:04.127100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:16:04.127559 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:16:04.128040 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:16:04.130280 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:16:04.153705 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:16:04.155320 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:16:04.166842 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4418/8857] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:16:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:16:09.952430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec612a-fc29-4628-86bd-7dde2d3d8c4c service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:16:09.966290 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec612a-fc29-4628-86bd-7dde2d3d8c4c service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:16:09.972012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904502ba-0990-48b2-9300-7eb1d0f25ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:16:09.972657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904502ba-0990-48b2-9300-7eb1d0f25ab8 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:16:09.972942 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904502ba-0990-48b2-9300-7eb1d0f25ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:16:09.973217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904502ba-0990-48b2-9300-7eb1d0f25ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:16:09.974967 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-904502ba-0990-48b2-9300-7eb1d0f25ab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:16:09.987622 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904502ba-0990-48b2-9300-7eb1d0f25ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:16:09.989250 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904502ba-0990-48b2-9300-7eb1d0f25ab8 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:16:10.001830 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4440/8858] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:16:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:16:12.105832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:16:12.107413 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:16:12.113393 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:16:12.166304 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381c7fe-9449-463b-90e9-d27795e34858 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:16:12.170821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec829d-5584-4441-8d7c-40b350837293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:16:12.171421 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec829d-5584-4441-8d7c-40b350837293 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:16:12.171701 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec829d-5584-4441-8d7c-40b350837293 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:16:12.171977 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec829d-5584-4441-8d7c-40b350837293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:16:12.180906 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec829d-5584-4441-8d7c-40b350837293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:16:12.182334 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec829d-5584-4441-8d7c-40b350837293 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:16:12.193072 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4419/8859] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:16:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:16:19.997304 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=66 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:16:22.188502 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=24 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:16.025413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904502ba-0990-48b2-9300-7eb1d0f25ab8 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:18:16.034965 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904502ba-0990-48b2-9300-7eb1d0f25ab8 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:18:16.038668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:18:16.039261 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:16.039537 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:16.039813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:16.041592 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:16.052040 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:18:16.053517 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:18:16.061542 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4441/8860] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:18:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:18:25.119372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafc6e9-d812-458a-a98d-7b690dabc46c None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:25.119907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafc6e9-d812-458a-a98d-7b690dabc46c None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:25.119907 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafc6e9-d812-458a-a98d-7b690dabc46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:25.173164 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4fafc6e9-d812-458a-a98d-7b690dabc46c None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:18:25.174406 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4fafc6e9-d812-458a-a98d-7b690dabc46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:25.241298 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4420/8861] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 02:18:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:18:25.286678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:18:25.288123 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:25.380245 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1cb0d-97da-4fd9-a644-f0aa6b17d119 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:18:25.385412 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a973030-bcff-4546-a6e4-c084978f804b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:18:25.386012 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a973030-bcff-4546-a6e4-c084978f804b service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:25.386295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a973030-bcff-4546-a6e4-c084978f804b service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:25.386570 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a973030-bcff-4546-a6e4-c084978f804b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:25.395071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a973030-bcff-4546-a6e4-c084978f804b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:18:25.396666 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a973030-bcff-4546-a6e4-c084978f804b service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:18:25.404699 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4442/8862] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:18:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:18:35.238365 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=40 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:35.401459 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=47 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:37.972428 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafc6e9-d812-458a-a98d-7b690dabc46c None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:18:37.981973 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafc6e9-d812-458a-a98d-7b690dabc46c None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:18:37.985581 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:18:37.986180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:37.986462 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:37.986738 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:37.988453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:37.998194 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:18:37.999610 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:18:38.007901 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4421/8863] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:18:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:18:38.124009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc6d49-1c7d-4d8f-9754-67fed68f1a31 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:38.124541 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc6d49-1c7d-4d8f-9754-67fed68f1a31 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:38.125278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc6d49-1c7d-4d8f-9754-67fed68f1a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:38.145507 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-d3bc6d49-1c7d-4d8f-9754-67fed68f1a31 None None] MFA Rules not processed for user `0165e2f8b5e34c8d8570262c777de161`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:18:38.146814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-d3bc6d49-1c7d-4d8f-9754-67fed68f1a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:38.156834 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4443/8864] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 19 02:18:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:18:38.168508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:18:38.169949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:38.233180 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a2b5c-aa94-4077-9589-e001f5e87010 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:18:38.236875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7744b-916c-4520-ba83-3b274df2aafb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb751f44d3b4fb3b49a0084e76176d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:18:38.237479 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7744b-916c-4520-ba83-3b274df2aafb service glance] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:38.237755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7744b-916c-4520-ba83-3b274df2aafb service glance] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:38.238026 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7744b-916c-4520-ba83-3b274df2aafb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:38.248293 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7744b-916c-4520-ba83-3b274df2aafb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:18:38.249672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7744b-916c-4520-ba83-3b274df2aafb service glance] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:18:38.261372 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4422/8865] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:18:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:18:38.331071 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc6d49-1c7d-4d8f-9754-67fed68f1a31 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:18:38.340420 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc6d49-1c7d-4d8f-9754-67fed68f1a31 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:18:38.344522 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:18:38.345194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:38.345478 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:38.345750 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:38.347470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:38.356801 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:18:38.358246 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:18:38.367244 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4444/8866] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:18:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:18:38.441869 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7744b-916c-4520-ba83-3b274df2aafb service glance] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:18:38.451493 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7744b-916c-4520-ba83-3b274df2aafb service glance] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:18:38.455925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923eab-e7dd-4b18-995b-4a91e8a806f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:18:38.456522 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923eab-e7dd-4b18-995b-4a91e8a806f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:38.456834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923eab-e7dd-4b18-995b-4a91e8a806f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:38.457113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923eab-e7dd-4b18-995b-4a91e8a806f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:38.458843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b2923eab-e7dd-4b18-995b-4a91e8a806f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:38.472115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923eab-e7dd-4b18-995b-4a91e8a806f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:18:38.473572 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923eab-e7dd-4b18-995b-4a91e8a806f2 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:18:38.485039 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4423/8867] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:18:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:18:38.544745 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:18:38.546142 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:38.561167 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af350f0-ac9c-4d62-937d-3458c3d5b58a service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:18:38.567107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5b8e-f7ad-4f83-b9ed-8eb11bed256c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:18:38.567698 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5b8e-f7ad-4f83-b9ed-8eb11bed256c service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:38.567976 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5b8e-f7ad-4f83-b9ed-8eb11bed256c service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:38.568248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5b8e-f7ad-4f83-b9ed-8eb11bed256c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:38.569919 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-430a5b8e-f7ad-4f83-b9ed-8eb11bed256c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:38.581191 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5b8e-f7ad-4f83-b9ed-8eb11bed256c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:18:38.582747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5b8e-f7ad-4f83-b9ed-8eb11bed256c service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:18:38.592283 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4445/8868] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:18:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:18:40.375019 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63829078-44a7-4c0b-8caa-74c134e081c1 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:40.375662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63829078-44a7-4c0b-8caa-74c134e081c1 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:40.375662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63829078-44a7-4c0b-8caa-74c134e081c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:40.395536 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-63829078-44a7-4c0b-8caa-74c134e081c1 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:18:40.396772 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-63829078-44a7-4c0b-8caa-74c134e081c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:40.403907 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4424/8869] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 02:18:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:18:40.416320 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5b8e-f7ad-4f83-b9ed-8eb11bed256c service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:18:40.428286 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5b8e-f7ad-4f83-b9ed-8eb11bed256c service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:18:40.433360 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031539a-2654-4bb3-8967-23a2c9e8ebf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:18:40.433960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031539a-2654-4bb3-8967-23a2c9e8ebf8 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:40.434346 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031539a-2654-4bb3-8967-23a2c9e8ebf8 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:40.434628 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031539a-2654-4bb3-8967-23a2c9e8ebf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:40.443389 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031539a-2654-4bb3-8967-23a2c9e8ebf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:18:40.445034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031539a-2654-4bb3-8967-23a2c9e8ebf8 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:18:40.453218 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4446/8870] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:18:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:18:50.389409 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=41 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:50.449838 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=21 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:56.453036 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7180fa-b60d-4e19-b808-1c6e4a012f4d None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:56.454069 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7180fa-b60d-4e19-b808-1c6e4a012f4d None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:56.454187 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7180fa-b60d-4e19-b808-1c6e4a012f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:56.473771 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-4d7180fa-b60d-4e19-b808-1c6e4a012f4d None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:18:56.474955 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-4d7180fa-b60d-4e19-b808-1c6e4a012f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:18:56.482055 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4425/8871] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 02:18:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:18:56.494468 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031539a-2654-4bb3-8967-23a2c9e8ebf8 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:18:56.505116 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031539a-2654-4bb3-8967-23a2c9e8ebf8 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:18:56.510160 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49208b4-06bd-4337-8292-cd6682474149 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:18:56.510781 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49208b4-06bd-4337-8292-cd6682474149 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:18:56.511064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49208b4-06bd-4337-8292-cd6682474149 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:18:56.511343 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49208b4-06bd-4337-8292-cd6682474149 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:18:56.519980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49208b4-06bd-4337-8292-cd6682474149 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:18:56.521589 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49208b4-06bd-4337-8292-cd6682474149 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:18:56.529677 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4447/8872] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:18:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:19:06.467903 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:19:06.526355 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:14.241533 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7180fa-b60d-4e19-b808-1c6e4a012f4d None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:20:14.251356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7180fa-b60d-4e19-b808-1c6e4a012f4d None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:20:14.255314 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1910375-9998-4ab6-a3a0-d879dcf4195d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:20:14.255922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1910375-9998-4ab6-a3a0-d879dcf4195d service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:20:14.256196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1910375-9998-4ab6-a3a0-d879dcf4195d service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:20:14.256465 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1910375-9998-4ab6-a3a0-d879dcf4195d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:20:14.258196 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-b1910375-9998-4ab6-a3a0-d879dcf4195d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:20:14.285046 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1910375-9998-4ab6-a3a0-d879dcf4195d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:20:14.286688 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1910375-9998-4ab6-a3a0-d879dcf4195d service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:20:14.297921 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4426/8873] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:20:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:20:15.492674 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49208b4-06bd-4337-8292-cd6682474149 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:20:15.502941 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49208b4-06bd-4337-8292-cd6682474149 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:20:15.506904 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30381032-1d00-4dac-b527-6e9faee84b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:20:15.507552 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381032-1d00-4dac-b527-6e9faee84b88 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:20:15.507835 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381032-1d00-4dac-b527-6e9faee84b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:20:15.508112 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381032-1d00-4dac-b527-6e9faee84b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:20:15.510082 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-30381032-1d00-4dac-b527-6e9faee84b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:20:15.524372 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30381032-1d00-4dac-b527-6e9faee84b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:20:15.525825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30381032-1d00-4dac-b527-6e9faee84b88 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:20:15.536647 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4448/8874] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:20:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:20:16.726884 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1910375-9998-4ab6-a3a0-d879dcf4195d service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:20:16.738583 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1910375-9998-4ab6-a3a0-d879dcf4195d service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:20:16.743651 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f19fb-c71f-46c4-a6de-526e75404c27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:20:16.744204 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f19fb-c71f-46c4-a6de-526e75404c27 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:20:16.744481 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f19fb-c71f-46c4-a6de-526e75404c27 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:20:16.744817 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f19fb-c71f-46c4-a6de-526e75404c27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:20:16.746534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-001f19fb-c71f-46c4-a6de-526e75404c27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:20:16.759015 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f19fb-c71f-46c4-a6de-526e75404c27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:20:16.760589 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f19fb-c71f-46c4-a6de-526e75404c27 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:20:16.770981 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4427/8875] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:20:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:20:19.003398 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aad0e-d0f2-4b4f-9982-eda4df02972d None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:20:19.003915 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aad0e-d0f2-4b4f-9982-eda4df02972d None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:20:19.004032 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aad0e-d0f2-4b4f-9982-eda4df02972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:20:19.022882 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-b31aad0e-d0f2-4b4f-9982-eda4df02972d None None] MFA Rules not processed for user `4ea84bfb9df044fdadd880ed8260c393`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:20:19.024114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b31aad0e-d0f2-4b4f-9982-eda4df02972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:20:19.031319 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4449/8876] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:20:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:20:26.766344 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=17 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:29.017856 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=9 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:21:04.133534 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f19fb-c71f-46c4-a6de-526e75404c27 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:21:04.147461 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f19fb-c71f-46c4-a6de-526e75404c27 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:21:04.152895 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2305a-e1f1-47c9-a2bd-efbbb9b17a88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:21:04.153576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2305a-e1f1-47c9-a2bd-efbbb9b17a88 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:21:04.153859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2305a-e1f1-47c9-a2bd-efbbb9b17a88 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:21:04.154137 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2305a-e1f1-47c9-a2bd-efbbb9b17a88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:21:04.165859 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2305a-e1f1-47c9-a2bd-efbbb9b17a88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:21:04.167602 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2305a-e1f1-47c9-a2bd-efbbb9b17a88 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:21:04.179410 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4428/8877] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:21:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:21:14.174377 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=6 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:22:53.411845 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31aad0e-d0f2-4b4f-9982-eda4df02972d None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:22:53.438631 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31aad0e-d0f2-4b4f-9982-eda4df02972d None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:22:53.444117 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fcaa6-94eb-45e1-a090-5b0c6de596f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:22:53.444743 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fcaa6-94eb-45e1-a090-5b0c6de596f4 service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:22:53.445027 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fcaa6-94eb-45e1-a090-5b0c6de596f4 service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:22:53.445300 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fcaa6-94eb-45e1-a090-5b0c6de596f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:22:53.453433 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fcaa6-94eb-45e1-a090-5b0c6de596f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:22:53.455013 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fcaa6-94eb-45e1-a090-5b0c6de596f4 service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:22:53.463841 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4450/8878] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:22:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:23:03.459856 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=12 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:10.301881 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2305a-e1f1-47c9-a2bd-efbbb9b17a88 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:23:10.332780 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2305a-e1f1-47c9-a2bd-efbbb9b17a88 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:23:10.339480 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854198d-0f3c-49ec-9107-adec6f715bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:23:10.340925 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854198d-0f3c-49ec-9107-adec6f715bee service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:10.341400 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854198d-0f3c-49ec-9107-adec6f715bee service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:10.341672 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854198d-0f3c-49ec-9107-adec6f715bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:10.351404 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854198d-0f3c-49ec-9107-adec6f715bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:23:10.353029 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854198d-0f3c-49ec-9107-adec6f715bee service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:23:10.365058 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4429/8879] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:23:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:23:15.163404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fcaa6-94eb-45e1-a090-5b0c6de596f4 service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:23:15.183400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fcaa6-94eb-45e1-a090-5b0c6de596f4 service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:23:15.187566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0182714-aefc-4f17-bf21-9c75975674bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:23:15.188161 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182714-aefc-4f17-bf21-9c75975674bf service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:15.188451 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182714-aefc-4f17-bf21-9c75975674bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:15.188752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182714-aefc-4f17-bf21-9c75975674bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:15.190480 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-b0182714-aefc-4f17-bf21-9c75975674bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:15.200893 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0182714-aefc-4f17-bf21-9c75975674bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:23:15.203339 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0182714-aefc-4f17-bf21-9c75975674bf service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:23:15.211462 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4451/8880] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:23:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:23:16.157484 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854198d-0f3c-49ec-9107-adec6f715bee service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:23:16.169852 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854198d-0f3c-49ec-9107-adec6f715bee service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:23:16.177490 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8b00d-4bb8-43b8-a28b-6eac49687d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:23:16.178111 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8b00d-4bb8-43b8-a28b-6eac49687d64 service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:16.178394 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8b00d-4bb8-43b8-a28b-6eac49687d64 service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:16.178670 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8b00d-4bb8-43b8-a28b-6eac49687d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:16.189457 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8b00d-4bb8-43b8-a28b-6eac49687d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:23:16.191070 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8b00d-4bb8-43b8-a28b-6eac49687d64 service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:23:16.202066 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4430/8881] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:23:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:23:25.207793 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:26.197499 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=18 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:43.638854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0182714-aefc-4f17-bf21-9c75975674bf service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:43.687282 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0182714-aefc-4f17-bf21-9c75975674bf service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:43.697089 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf265-5b1f-49cb-b82f-d313ff38e82d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:43.697316 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf265-5b1f-49cb-b82f-d313ff38e82d service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:43.697553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf265-5b1f-49cb-b82f-d313ff38e82d service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:43.697832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf265-5b1f-49cb-b82f-d313ff38e82d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:43.699730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-421bf265-5b1f-49cb-b82f-d313ff38e82d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:43.727100 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bf265-5b1f-49cb-b82f-d313ff38e82d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:43.728749 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bf265-5b1f-49cb-b82f-d313ff38e82d service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:43.742775 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4452/8882] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:50.933914 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8b00d-4bb8-43b8-a28b-6eac49687d64 service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:50.956159 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8b00d-4bb8-43b8-a28b-6eac49687d64 service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:50.960412 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61177cd0-7299-4fcd-a4ae-f15631551fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:50.961228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61177cd0-7299-4fcd-a4ae-f15631551fcb service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:50.961505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61177cd0-7299-4fcd-a4ae-f15631551fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:50.961778 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61177cd0-7299-4fcd-a4ae-f15631551fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:51.026047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61177cd0-7299-4fcd-a4ae-f15631551fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:51.027458 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61177cd0-7299-4fcd-a4ae-f15631551fcb service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:51.038181 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4431/8883] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:53.737068 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=22 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:54.531668 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf265-5b1f-49cb-b82f-d313ff38e82d service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:54.546069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf265-5b1f-49cb-b82f-d313ff38e82d service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:54.551843 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404e879-4308-49ad-a3cd-552ffb9b0ef1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:54.552446 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404e879-4308-49ad-a3cd-552ffb9b0ef1 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:54.552755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404e879-4308-49ad-a3cd-552ffb9b0ef1 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:54.553031 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404e879-4308-49ad-a3cd-552ffb9b0ef1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:54.554730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-1404e879-4308-49ad-a3cd-552ffb9b0ef1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:54.567975 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404e879-4308-49ad-a3cd-552ffb9b0ef1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:54.569798 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404e879-4308-49ad-a3cd-552ffb9b0ef1 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:54.590586 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4453/8884] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:57.836844 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61177cd0-7299-4fcd-a4ae-f15631551fcb service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:57.849266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61177cd0-7299-4fcd-a4ae-f15631551fcb service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:57.854450 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0ed4-fab9-4d82-805a-785ad429b601 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:57.855066 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0ed4-fab9-4d82-805a-785ad429b601 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:57.855347 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0ed4-fab9-4d82-805a-785ad429b601 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:57.855621 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0ed4-fab9-4d82-805a-785ad429b601 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:57.857466 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-60eb0ed4-fab9-4d82-805a-785ad429b601 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:57.870114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0ed4-fab9-4d82-805a-785ad429b601 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:57.871728 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0ed4-fab9-4d82-805a-785ad429b601 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:57.883149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4432/8885] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:57.899118 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404e879-4308-49ad-a3cd-552ffb9b0ef1 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:57.911430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404e879-4308-49ad-a3cd-552ffb9b0ef1 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:57.916929 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:57.917815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:57.918138 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:57.918371 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] PATH_INFO: `/v3/users/4ea84bfb9df044fdadd880ed8260c393` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:57.919579 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea84bfb9df044fdadd880ed8260c393)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:57.921629 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:57.969680 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea84bfb9df044fdadd880ed8260c393'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:57.982765 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea84bfb9df044fdadd880ed8260c393'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.000064 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea84bfb9df044fdadd880ed8260c393'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.007725 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea84bfb9df044fdadd880ed8260c393'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.008365 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea84bfb9df044fdadd880ed8260c393'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.014272 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4454/8886] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:24:57 2022] DELETE /identity/v3/users/4ea84bfb9df044fdadd880ed8260c393 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:24:58.186048 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0ed4-fab9-4d82-805a-785ad429b601 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:58.199627 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0ed4-fab9-4d82-805a-785ad429b601 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:58.258920 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:58.259551 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.259829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.260102 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] PATH_INFO: `/v3/projects/6ce5fe85f8b94c92b72fe172eb024b60` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.261235 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce5fe85f8b94c92b72fe172eb024b60)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:58.263128 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:58.310564 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce5fe85f8b94c92b72fe172eb024b60', 'request_id': 'req-210b6c0a-2034-49b0-a55c-bb262336020f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.319310 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce5fe85f8b94c92b72fe172eb024b60', 'request_id': 'req-210b6c0a-2034-49b0-a55c-bb262336020f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.325402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce5fe85f8b94c92b72fe172eb024b60', 'request_id': 'req-210b6c0a-2034-49b0-a55c-bb262336020f'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.334095 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:58.338809 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] The token cache is being invalidate because project 6ce5fe85f8b94c92b72fe172eb024b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:24:58.339365 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.340663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.342365 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4433/8887] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:24:58 2022] DELETE /identity/v3/projects/6ce5fe85f8b94c92b72fe172eb024b60 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:24:58.346526 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:58.348940 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:58.362080 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf7c23-1914-432f-bc23-0c9eccb84d1c admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:58.419322 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:58.419950 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.420234 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.420510 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] PATH_INFO: `/v3/users/3cde62d635634096a263dccc415935e9` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.421678 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cde62d635634096a263dccc415935e9)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:58.423602 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:58.469375 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cde62d635634096a263dccc415935e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.480582 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:58.483274 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cde62d635634096a263dccc415935e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.492277 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cde62d635634096a263dccc415935e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.499344 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cde62d635634096a263dccc415935e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.499983 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-4f291231-4753-4186-8df8-29b761356d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cde62d635634096a263dccc415935e9'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.505911 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4455/8888] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:24:58 2022] DELETE /identity/v3/users/3cde62d635634096a263dccc415935e9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:24:58.688882 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:58.690598 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:58.706152 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6c0a-2034-49b0-a55c-bb262336020f admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:58.765954 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:58.766506 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.766788 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.767064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] PATH_INFO: `/v3/projects/9aea33d1aad04ce19b747e21ad157ef9` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.768191 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aea33d1aad04ce19b747e21ad157ef9)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:58.771092 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:58.817987 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aea33d1aad04ce19b747e21ad157ef9', 'request_id': 'req-36cc1acf-889a-4669-8c3d-95e6237262c7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.825916 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aea33d1aad04ce19b747e21ad157ef9', 'request_id': 'req-36cc1acf-889a-4669-8c3d-95e6237262c7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.831528 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aea33d1aad04ce19b747e21ad157ef9', 'request_id': 'req-36cc1acf-889a-4669-8c3d-95e6237262c7'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.843675 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] The token cache is being invalidate because project 9aea33d1aad04ce19b747e21ad157ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86424) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:24:58.844221 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.844922 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-36cc1acf-889a-4669-8c3d-95e6237262c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:24:58.846621 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4434/8889] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:24:58 2022] DELETE /identity/v3/projects/9aea33d1aad04ce19b747e21ad157ef9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:24:58.851968 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b403b-1562-41a8-8d5c-c20289583639 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.852257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b403b-1562-41a8-8d5c-c20289583639 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.852538 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b403b-1562-41a8-8d5c-c20289583639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.882656 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-ae8b403b-1562-41a8-8d5c-c20289583639 None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:58.883861 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-ae8b403b-1562-41a8-8d5c-c20289583639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:58.943744 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4456/8890] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:58.952060 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a4ef-5c6e-4de5-bef2-e6e7912b1f1b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.952363 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a4ef-5c6e-4de5-bef2-e6e7912b1f1b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.952661 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a4ef-5c6e-4de5-bef2-e6e7912b1f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.972597 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1386a4ef-5c6e-4de5-bef2-e6e7912b1f1b None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:58.973829 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1386a4ef-5c6e-4de5-bef2-e6e7912b1f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:58.981771 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4435/8891] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:58.986184 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b403b-1562-41a8-8d5c-c20289583639 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:58.996107 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b403b-1562-41a8-8d5c-c20289583639 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:59.000785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ef870-2e10-4c17-bf91-a7b9c603ed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:59.001386 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef870-2e10-4c17-bf91-a7b9c603ed72 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.001667 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef870-2e10-4c17-bf91-a7b9c603ed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.001963 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef870-2e10-4c17-bf91-a7b9c603ed72 admin admin] PATH_INFO: `/v3/domains` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.002607 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ef870-2e10-4c17-bf91-a7b9c603ed72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:24:59.002910 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ef870-2e10-4c17-bf91-a7b9c603ed72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:59.005119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ef870-2e10-4c17-bf91-a7b9c603ed72 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:59.016640 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4457/8892] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 19 02:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:24:59.021949 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386a4ef-5c6e-4de5-bef2-e6e7912b1f1b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:59.031558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386a4ef-5c6e-4de5-bef2-e6e7912b1f1b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:59.036474 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f13842-04e5-4511-b4e7-4861f90b2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:59.037100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f13842-04e5-4511-b4e7-4861f90b2a00 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.037378 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f13842-04e5-4511-b4e7-4861f90b2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.037649 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f13842-04e5-4511-b4e7-4861f90b2a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.038266 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f13842-04e5-4511-b4e7-4861f90b2a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:59.040151 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f13842-04e5-4511-b4e7-4861f90b2a00 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:59.069144 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4436/8893] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 02:24:59 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:24:59.073610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ef870-2e10-4c17-bf91-a7b9c603ed72 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:59.084610 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ef870-2e10-4c17-bf91-a7b9c603ed72 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:59.142009 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c3838-d1df-4891-b672-334b3d262854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:59.142616 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c3838-d1df-4891-b672-334b3d262854 admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.142901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c3838-d1df-4891-b672-334b3d262854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.143180 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c3838-d1df-4891-b672-334b3d262854 admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.143817 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c3838-d1df-4891-b672-334b3d262854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:59.145832 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c3838-d1df-4891-b672-334b3d262854 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:59.166391 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4458/8894] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 02:24:59 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:24:59.170577 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f13842-04e5-4511-b4e7-4861f90b2a00 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:59.182106 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f13842-04e5-4511-b4e7-4861f90b2a00 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:59.187021 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1407b3-f1b2-42d6-a132-bc99d241ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:59.187608 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1407b3-f1b2-42d6-a132-bc99d241ac79 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.187891 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1407b3-f1b2-42d6-a132-bc99d241ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.188165 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1407b3-f1b2-42d6-a132-bc99d241ac79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.188843 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1407b3-f1b2-42d6-a132-bc99d241ac79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:59.190443 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1407b3-f1b2-42d6-a132-bc99d241ac79 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:59.201191 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4437/8895] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:24:59.204999 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c3838-d1df-4891-b672-334b3d262854 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:59.215208 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c3838-d1df-4891-b672-334b3d262854 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:59.219993 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d339c9-f2c2-4918-af82-84b991e00fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:59.220596 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d339c9-f2c2-4918-af82-84b991e00fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.220901 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d339c9-f2c2-4918-af82-84b991e00fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.221176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d339c9-f2c2-4918-af82-84b991e00fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.221816 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d339c9-f2c2-4918-af82-84b991e00fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:59.223475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d339c9-f2c2-4918-af82-84b991e00fa5 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:59.234141 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4459/8896] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:24:59.238043 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1407b3-f1b2-42d6-a132-bc99d241ac79 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:59.248614 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1407b3-f1b2-42d6-a132-bc99d241ac79 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:59.253343 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da532757-f281-4ba2-9123-b6070bc6612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:59.254017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532757-f281-4ba2-9123-b6070bc6612b admin admin] REQUEST_METHOD: `PUT` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.254896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532757-f281-4ba2-9123-b6070bc6612b admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.255252 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532757-f281-4ba2-9123-b6070bc6612b admin admin] PATH_INFO: `/v3/projects/8a07543f2a974ab68250790aa05e4457/users/31cee11ce9074305a2420fd576588ac6/roles/2eefb0a36d0744ec8e25b5669af179cf` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.271846 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da532757-f281-4ba2-9123-b6070bc6612b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a07543f2a974ab68250790aa05e4457, user_id=31cee11ce9074305a2420fd576588ac6, role_id=2eefb0a36d0744ec8e25b5669af179cf)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:59.274736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da532757-f281-4ba2-9123-b6070bc6612b admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:59.287597 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4438/8897] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:24:59 2022] PUT /identity/v3/projects/8a07543f2a974ab68250790aa05e4457/users/31cee11ce9074305a2420fd576588ac6/roles/2eefb0a36d0744ec8e25b5669af179cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:24:59.292647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3f195-fafa-437a-b3d0-6eef4baf9bab None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.292957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3f195-fafa-437a-b3d0-6eef4baf9bab None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.293236 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3f195-fafa-437a-b3d0-6eef4baf9bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.314823 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-9ff3f195-fafa-437a-b3d0-6eef4baf9bab None None] MFA Rules not processed for user `0eea56facd274e79a70b3efac3a71b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:59.316023 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9ff3f195-fafa-437a-b3d0-6eef4baf9bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:59.346813 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:59.378539 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4460/8898] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:59.389185 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da532757-f281-4ba2-9123-b6070bc6612b admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:59.390890 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-da532757-f281-4ba2-9123-b6070bc6612b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:59.421676 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:59.450617 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da532757-f281-4ba2-9123-b6070bc6612b admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:59.454346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1050105-e8f3-42fa-a352-50e710aeda44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:59.454945 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050105-e8f3-42fa-a352-50e710aeda44 service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.455229 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050105-e8f3-42fa-a352-50e710aeda44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.455505 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050105-e8f3-42fa-a352-50e710aeda44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.464653 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1050105-e8f3-42fa-a352-50e710aeda44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:59.466082 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1050105-e8f3-42fa-a352-50e710aeda44 service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:59.476338 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4439/8899] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:03.406708 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13dc13-42dd-4068-bdd7-5d1702e7e024 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:03.407252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13dc13-42dd-4068-bdd7-5d1702e7e024 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:03.407252 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13dc13-42dd-4068-bdd7-5d1702e7e024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:03.436785 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-df13dc13-42dd-4068-bdd7-5d1702e7e024 None None] MFA Rules not processed for user `31cee11ce9074305a2420fd576588ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:03.438546 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-df13dc13-42dd-4068-bdd7-5d1702e7e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:03.517992 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4461/8900] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:03.522834 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1050105-e8f3-42fa-a352-50e710aeda44 service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:03.533054 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1050105-e8f3-42fa-a352-50e710aeda44 service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:03.538068 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c1485-1264-4354-9c79-ec4da6112a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:03.538691 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c1485-1264-4354-9c79-ec4da6112a41 admin admin] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:03.538974 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c1485-1264-4354-9c79-ec4da6112a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:03.539427 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c1485-1264-4354-9c79-ec4da6112a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:03.540087 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c1485-1264-4354-9c79-ec4da6112a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:03.542057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c1485-1264-4354-9c79-ec4da6112a41 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:03.573003 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4440/8901] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 19 02:25:03 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:25:03.577960 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13dc13-42dd-4068-bdd7-5d1702e7e024 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:03.589744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13dc13-42dd-4068-bdd7-5d1702e7e024 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:03.651664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce955f4-8bd7-4126-9752-83728cf19e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:03.652419 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce955f4-8bd7-4126-9752-83728cf19e3f admin admin] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:03.652573 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce955f4-8bd7-4126-9752-83728cf19e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:03.652889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce955f4-8bd7-4126-9752-83728cf19e3f admin admin] PATH_INFO: `/v3/users` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:03.653521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce955f4-8bd7-4126-9752-83728cf19e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:03.655909 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce955f4-8bd7-4126-9752-83728cf19e3f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:03.687099 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4462/8902] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 19 02:25:03 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:25:03.690595 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c1485-1264-4354-9c79-ec4da6112a41 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:03.702345 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c1485-1264-4354-9c79-ec4da6112a41 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:03.707084 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51c316-b9f2-4397-a8c6-e1c79ddb5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:03.707942 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51c316-b9f2-4397-a8c6-e1c79ddb5286 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:03.708225 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51c316-b9f2-4397-a8c6-e1c79ddb5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:03.708503 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51c316-b9f2-4397-a8c6-e1c79ddb5286 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:03.709184 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51c316-b9f2-4397-a8c6-e1c79ddb5286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:03.711027 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51c316-b9f2-4397-a8c6-e1c79ddb5286 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:03.724133 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4441/8903] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:25:03.728755 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce955f4-8bd7-4126-9752-83728cf19e3f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:03.739722 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce955f4-8bd7-4126-9752-83728cf19e3f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:03.744764 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3bbcc-5d6d-4d13-9a34-65fd108e8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:03.745404 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3bbcc-5d6d-4d13-9a34-65fd108e8aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:03.745689 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3bbcc-5d6d-4d13-9a34-65fd108e8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:03.745970 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3bbcc-5d6d-4d13-9a34-65fd108e8aa0 admin admin] PATH_INFO: `/v3/projects/d445770b5d3b40df9abb738ef12b01ef/users/46625554afc440e38002c738652f9984/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:03.763098 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3bbcc-5d6d-4d13-9a34-65fd108e8aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d445770b5d3b40df9abb738ef12b01ef, user_id=46625554afc440e38002c738652f9984, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:03.765854 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3bbcc-5d6d-4d13-9a34-65fd108e8aa0 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:03.781433 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4463/8904] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:25:03 2022] PUT /identity/v3/projects/d445770b5d3b40df9abb738ef12b01ef/users/46625554afc440e38002c738652f9984/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:25:03.786584 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51c316-b9f2-4397-a8c6-e1c79ddb5286 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:03.799662 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51c316-b9f2-4397-a8c6-e1c79ddb5286 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:03.863995 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042410ce-70f2-432f-9795-65a46c249f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:03.864644 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042410ce-70f2-432f-9795-65a46c249f85 admin admin] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:03.864961 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042410ce-70f2-432f-9795-65a46c249f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:03.865250 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042410ce-70f2-432f-9795-65a46c249f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:03.865910 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042410ce-70f2-432f-9795-65a46c249f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:03.867535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042410ce-70f2-432f-9795-65a46c249f85 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:03.880255 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4442/8905] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 02:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:25:03.884378 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3bbcc-5d6d-4d13-9a34-65fd108e8aa0 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:03.903050 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3bbcc-5d6d-4d13-9a34-65fd108e8aa0 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:03.908225 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b7cc5-94da-4f5c-a61d-27e64b467d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:03.909035 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b7cc5-94da-4f5c-a61d-27e64b467d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:03.909382 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b7cc5-94da-4f5c-a61d-27e64b467d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:03.909731 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b7cc5-94da-4f5c-a61d-27e64b467d78 admin admin] PATH_INFO: `/v3/projects/d445770b5d3b40df9abb738ef12b01ef/users/46625554afc440e38002c738652f9984/roles/3c676188d9f646ba8509d3eef1e196de` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:03.912790 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b7cc5-94da-4f5c-a61d-27e64b467d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d445770b5d3b40df9abb738ef12b01ef, user_id=46625554afc440e38002c738652f9984, role_id=3c676188d9f646ba8509d3eef1e196de)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:03.915475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b7cc5-94da-4f5c-a61d-27e64b467d78 admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:03.926994 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4464/8906] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 19 02:25:03 2022] PUT /identity/v3/projects/d445770b5d3b40df9abb738ef12b01ef/users/46625554afc440e38002c738652f9984/roles/3c676188d9f646ba8509d3eef1e196de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:25:08.963286 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825daf0e-97d2-4ec5-96e1-7f8a4b0f6788 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:08.963861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825daf0e-97d2-4ec5-96e1-7f8a4b0f6788 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:08.963861 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825daf0e-97d2-4ec5-96e1-7f8a4b0f6788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:08.996041 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-825daf0e-97d2-4ec5-96e1-7f8a4b0f6788 None None] MFA Rules not processed for user `46625554afc440e38002c738652f9984`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:08.997281 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-825daf0e-97d2-4ec5-96e1-7f8a4b0f6788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:09.086911 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4443/8907] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:25:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:09.103461 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b7cc5-94da-4f5c-a61d-27e64b467d78 admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:09.105531 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-862b7cc5-94da-4f5c-a61d-27e64b467d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:09.127945 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:09.187248 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b7cc5-94da-4f5c-a61d-27e64b467d78 admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:09.193558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0fe81-d77c-47b3-8527-61e520962c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:09.194194 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0fe81-d77c-47b3-8527-61e520962c5a service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:09.194475 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0fe81-d77c-47b3-8527-61e520962c5a service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:09.194751 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0fe81-d77c-47b3-8527-61e520962c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:09.253523 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0fe81-d77c-47b3-8527-61e520962c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:09.255214 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0fe81-d77c-47b3-8527-61e520962c5a service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:09.268567 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4465/8908] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:10.347395 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea0d6-bb72-4b2f-8fd0-c36bcf142c9b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:10.348489 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea0d6-bb72-4b2f-8fd0-c36bcf142c9b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:10.348700 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea0d6-bb72-4b2f-8fd0-c36bcf142c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:10.368638 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2aeea0d6-bb72-4b2f-8fd0-c36bcf142c9b None None] MFA Rules not processed for user `31cee11ce9074305a2420fd576588ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:10.369857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2aeea0d6-bb72-4b2f-8fd0-c36bcf142c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:10.377141 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4444/8909] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:25:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:10.700181 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0fe81-d77c-47b3-8527-61e520962c5a service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:10.701704 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-6eb0fe81-d77c-47b3-8527-61e520962c5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:10.762969 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0fe81-d77c-47b3-8527-61e520962c5a service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:10.766572 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bd0e5-e6b5-4118-880e-aa35b55c9939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:10.767193 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd0e5-e6b5-4118-880e-aa35b55c9939 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:10.767471 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd0e5-e6b5-4118-880e-aa35b55c9939 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:10.767747 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd0e5-e6b5-4118-880e-aa35b55c9939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:10.770301 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-445bd0e5-e6b5-4118-880e-aa35b55c9939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:10.780566 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bd0e5-e6b5-4118-880e-aa35b55c9939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:10.782075 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bd0e5-e6b5-4118-880e-aa35b55c9939 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:10.790534 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4466/8910] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:11.154158 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeea0d6-bb72-4b2f-8fd0-c36bcf142c9b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:11.156121 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2aeea0d6-bb72-4b2f-8fd0-c36bcf142c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:11.169893 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:11.239704 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeea0d6-bb72-4b2f-8fd0-c36bcf142c9b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:11.244802 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f63fd3-1fd0-4c33-949a-aef69106976d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:11.245797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f63fd3-1fd0-4c33-949a-aef69106976d service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:11.245797 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f63fd3-1fd0-4c33-949a-aef69106976d service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:11.246059 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f63fd3-1fd0-4c33-949a-aef69106976d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:11.247643 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-f6f63fd3-1fd0-4c33-949a-aef69106976d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:11.260435 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f63fd3-1fd0-4c33-949a-aef69106976d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:11.262051 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f63fd3-1fd0-4c33-949a-aef69106976d service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:11.275352 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4445/8911] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:13.351825 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bd0e5-e6b5-4118-880e-aa35b55c9939 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:13.360888 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bd0e5-e6b5-4118-880e-aa35b55c9939 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:13.364926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346b3f-6310-4810-b72d-43bc5270ae9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:13.365540 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346b3f-6310-4810-b72d-43bc5270ae9a service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:13.365814 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346b3f-6310-4810-b72d-43bc5270ae9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:13.366288 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346b3f-6310-4810-b72d-43bc5270ae9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:13.369229 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-5c346b3f-6310-4810-b72d-43bc5270ae9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:13.379732 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c346b3f-6310-4810-b72d-43bc5270ae9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:13.381455 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c346b3f-6310-4810-b72d-43bc5270ae9a service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:13.393811 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4467/8912] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:14.633555 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f63fd3-1fd0-4c33-949a-aef69106976d service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:14.642984 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f63fd3-1fd0-4c33-949a-aef69106976d service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:14.647177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e220-0b23-4ea2-b112-fac465f2ed9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:14.648157 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e220-0b23-4ea2-b112-fac465f2ed9b service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:14.648509 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e220-0b23-4ea2-b112-fac465f2ed9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:14.648840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e220-0b23-4ea2-b112-fac465f2ed9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:14.651135 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-d813e220-0b23-4ea2-b112-fac465f2ed9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:14.665985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813e220-0b23-4ea2-b112-fac465f2ed9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:14.667425 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813e220-0b23-4ea2-b112-fac465f2ed9b service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:14.679372 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4446/8913] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:15.879204 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346b3f-6310-4810-b72d-43bc5270ae9a service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:15.887871 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346b3f-6310-4810-b72d-43bc5270ae9a service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:15.891605 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cf300-4b12-45bd-b0d4-b52a94c40857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:15.892209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf300-4b12-45bd-b0d4-b52a94c40857 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:15.892493 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf300-4b12-45bd-b0d4-b52a94c40857 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:15.892813 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf300-4b12-45bd-b0d4-b52a94c40857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:15.894696 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-982cf300-4b12-45bd-b0d4-b52a94c40857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:15.908571 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cf300-4b12-45bd-b0d4-b52a94c40857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:15.910126 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cf300-4b12-45bd-b0d4-b52a94c40857 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:15.922718 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4468/8914] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:25:21.059537 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e220-0b23-4ea2-b112-fac465f2ed9b service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:21.069047 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e220-0b23-4ea2-b112-fac465f2ed9b service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:21.072832 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdda69-b63c-41d0-b3f2-4325459224eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:21.073441 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdda69-b63c-41d0-b3f2-4325459224eb service neutron] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:21.073725 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdda69-b63c-41d0-b3f2-4325459224eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:21.074013 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdda69-b63c-41d0-b3f2-4325459224eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:21.084275 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdda69-b63c-41d0-b3f2-4325459224eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:21.085851 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdda69-b63c-41d0-b3f2-4325459224eb service neutron] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:21.096209 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4447/8915] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:25.918027 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=86 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:29.237834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cf300-4b12-45bd-b0d4-b52a94c40857 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:29.258222 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cf300-4b12-45bd-b0d4-b52a94c40857 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:29.263254 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955665f-79b7-4893-9b06-d669fb4fafae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:29.263841 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955665f-79b7-4893-9b06-d669fb4fafae service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:29.264119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955665f-79b7-4893-9b06-d669fb4fafae service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:29.264388 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955665f-79b7-4893-9b06-d669fb4fafae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:29.266095 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-a955665f-79b7-4893-9b06-d669fb4fafae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:29.278603 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955665f-79b7-4893-9b06-d669fb4fafae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:29.280182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955665f-79b7-4893-9b06-d669fb4fafae service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:29.290726 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4469/8916] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:31.092070 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=39 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:39.285845 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=10 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:08.111686 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdda69-b63c-41d0-b3f2-4325459224eb service neutron] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:08.113181 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-cdbdda69-b63c-41d0-b3f2-4325459224eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:08.149521 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdda69-b63c-41d0-b3f2-4325459224eb service neutron] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:08.154629 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:08.155233 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:08.155514 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:08.155792 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:08.157541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:08.169108 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:08.170682 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:08.180761 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4448/8917] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:18.176349 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=14 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:25.757889 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e59db1-1828-43f9-9180-cb0edda593da None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:25.758413 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e59db1-1828-43f9-9180-cb0edda593da None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:25.758528 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e59db1-1828-43f9-9180-cb0edda593da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:25.790980 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-21e59db1-1828-43f9-9180-cb0edda593da None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:27:25.792182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-21e59db1-1828-43f9-9180-cb0edda593da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:25.855943 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4470/8918] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 02:27:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:27:25.905558 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:27:25.907195 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:25.988228 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376abc3-74cf-4c78-bc43-e77130f82b27 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:27:25.994453 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9628b7-09a4-4bf3-88c8-abbd591382f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:27:25.995065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9628b7-09a4-4bf3-88c8-abbd591382f3 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:25.995346 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9628b7-09a4-4bf3-88c8-abbd591382f3 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:25.995620 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9628b7-09a4-4bf3-88c8-abbd591382f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:26.004420 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9628b7-09a4-4bf3-88c8-abbd591382f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:27:26.006077 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9628b7-09a4-4bf3-88c8-abbd591382f3 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:27:26.015290 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4449/8919] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:27:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:27:35.375262 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426792-d627-4499-9aa0-02eb2d39a1e2 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:35.375803 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426792-d627-4499-9aa0-02eb2d39a1e2 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:35.375918 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426792-d627-4499-9aa0-02eb2d39a1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:35.395709 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-66426792-d627-4499-9aa0-02eb2d39a1e2 None None] MFA Rules not processed for user `31cee11ce9074305a2420fd576588ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:27:35.396986 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-66426792-d627-4499-9aa0-02eb2d39a1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:35.404142 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4471/8920] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 19 02:27:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:27:36.011865 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=32 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:37.060020 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9628b7-09a4-4bf3-88c8-abbd591382f3 service swift] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:27:37.072541 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9628b7-09a4-4bf3-88c8-abbd591382f3 service swift] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:27:37.077669 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19d198-a1a1-4d74-a596-b49c8074f7b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:27:37.078393 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d198-a1a1-4d74-a596-b49c8074f7b7 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:37.078676 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d198-a1a1-4d74-a596-b49c8074f7b7 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:37.078947 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d198-a1a1-4d74-a596-b49c8074f7b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:37.080723 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-0e19d198-a1a1-4d74-a596-b49c8074f7b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:37.093842 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19d198-a1a1-4d74-a596-b49c8074f7b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:27:37.095434 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19d198-a1a1-4d74-a596-b49c8074f7b7 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:27:37.105983 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4450/8921] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:27:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:27:38.423069 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060f60f-5864-411c-a69b-1d180db61078 None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:38.423615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060f60f-5864-411c-a69b-1d180db61078 None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:38.423615 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060f60f-5864-411c-a69b-1d180db61078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:38.443199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-f060f60f-5864-411c-a69b-1d180db61078 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:27:38.444971 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f060f60f-5864-411c-a69b-1d180db61078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:38.452297 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4472/8922] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 02:27:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:27:38.464762 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19d198-a1a1-4d74-a596-b49c8074f7b7 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:27:38.477402 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19d198-a1a1-4d74-a596-b49c8074f7b7 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:27:38.482875 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ebd3-e640-4869-86e7-45ba12662323 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:27:38.483550 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ebd3-e640-4869-86e7-45ba12662323 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:38.483894 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ebd3-e640-4869-86e7-45ba12662323 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:38.484234 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ebd3-e640-4869-86e7-45ba12662323 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:38.493418 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ebd3-e640-4869-86e7-45ba12662323 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:27:38.495001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ebd3-e640-4869-86e7-45ba12662323 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:27:38.503586 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4451/8923] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:27:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 02:27:48.438167 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=38 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:48.500027 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=12 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:08.839802 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060f60f-5864-411c-a69b-1d180db61078 None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:08.849295 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060f60f-5864-411c-a69b-1d180db61078 None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:08.853430 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f53677-d11c-4805-a3bf-cd71b3b4ff01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bdb67cd5854c38b2031a1b8c26023e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:08.854034 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f53677-d11c-4805-a3bf-cd71b3b4ff01 service neutron] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:08.854312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f53677-d11c-4805-a3bf-cd71b3b4ff01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:08.854587 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f53677-d11c-4805-a3bf-cd71b3b4ff01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:08.856279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-35f53677-d11c-4805-a3bf-cd71b3b4ff01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:29:08.878742 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f53677-d11c-4805-a3bf-cd71b3b4ff01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:08.880182 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f53677-d11c-4805-a3bf-cd71b3b4ff01 service neutron] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:08.889195 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4473/8924] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:29:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:29:18.885616 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=11 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:30.050561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82a10-2843-4ed0-a750-1bc705cacb65 None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:30.050561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82a10-2843-4ed0-a750-1bc705cacb65 None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:30.051093 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82a10-2843-4ed0-a750-1bc705cacb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:30.105535 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-1bf82a10-2843-4ed0-a750-1bc705cacb65 None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:29:30.107017 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1bf82a10-2843-4ed0-a750-1bc705cacb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:29:30.124613 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4452/8925] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 19 02:29:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:29:30.170130 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f53677-d11c-4805-a3bf-cd71b3b4ff01 service neutron] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:30.192051 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f53677-d11c-4805-a3bf-cd71b3b4ff01 service neutron] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:30.197381 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641878ec-ac75-4a00-8755-fe2f1900ff0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:30.198000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641878ec-ac75-4a00-8755-fe2f1900ff0b service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:30.198279 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641878ec-ac75-4a00-8755-fe2f1900ff0b service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:30.198551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641878ec-ac75-4a00-8755-fe2f1900ff0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:30.207217 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641878ec-ac75-4a00-8755-fe2f1900ff0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:30.208855 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641878ec-ac75-4a00-8755-fe2f1900ff0b service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:30.217934 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4474/8926] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:29:32.077734 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf82a10-2843-4ed0-a750-1bc705cacb65 None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:32.079382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-1bf82a10-2843-4ed0-a750-1bc705cacb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:29:32.101376 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf82a10-2843-4ed0-a750-1bc705cacb65 None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:32.108724 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c84da5-e4e4-4d24-8b41-1c8bc058235a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:32.109362 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c84da5-e4e4-4d24-8b41-1c8bc058235a service nova] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:32.109634 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c84da5-e4e4-4d24-8b41-1c8bc058235a service nova] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:32.110232 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c84da5-e4e4-4d24-8b41-1c8bc058235a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:32.112064 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-85c84da5-e4e4-4d24-8b41-1c8bc058235a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:29:32.136001 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c84da5-e4e4-4d24-8b41-1c8bc058235a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:32.136382 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c84da5-e4e4-4d24-8b41-1c8bc058235a service nova] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:32.150890 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4453/8927] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:29:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:29:39.455957 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e844-fa38-4b6c-99a0-186fe72316ac None None] REQUEST_METHOD: `POST` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:39.456467 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e844-fa38-4b6c-99a0-186fe72316ac None None] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:39.456590 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e844-fa38-4b6c-99a0-186fe72316ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:39.475521 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.auth.core [None req-3fa9e844-fa38-4b6c-99a0-186fe72316ac None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:29:39.476752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-3fa9e844-fa38-4b6c-99a0-186fe72316ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:29:39.483884 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4475/8928] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 02:29:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:29:39.496575 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c84da5-e4e4-4d24-8b41-1c8bc058235a service nova] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:39.508356 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c84da5-e4e4-4d24-8b41-1c8bc058235a service nova] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:39.513452 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f8cc4-b3ea-4c80-9c76-07537770f184 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:39.514052 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f8cc4-b3ea-4c80-9c76-07537770f184 service swift] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:39.514333 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f8cc4-b3ea-4c80-9c76-07537770f184 service swift] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:39.514609 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f8cc4-b3ea-4c80-9c76-07537770f184 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:39.523057 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f8cc4-b3ea-4c80-9c76-07537770f184 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:39.524663 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f8cc4-b3ea-4c80-9c76-07537770f184 service swift] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:39.532903 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4454/8929] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:29:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:29:41.013198 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e844-fa38-4b6c-99a0-186fe72316ac None None] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:41.029744 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e844-fa38-4b6c-99a0-186fe72316ac None None] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:41.036529 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1cce-a05e-4a9e-b34f-1f05c3e66d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0165e2f8b5e34c8d8570262c777de161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:41.038119 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1cce-a05e-4a9e-b34f-1f05c3e66d7f service nova] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:41.038469 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1cce-a05e-4a9e-b34f-1f05c3e66d7f service nova] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:41.038818 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1cce-a05e-4a9e-b34f-1f05c3e66d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:41.040883 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-240b1cce-a05e-4a9e-b34f-1f05c3e66d7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:29:41.056000 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b1cce-a05e-4a9e-b34f-1f05c3e66d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:41.057719 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b1cce-a05e-4a9e-b34f-1f05c3e66d7f service nova] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:41.070173 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4476/8930] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:29:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:29:44.734455 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a7780-f76b-4026-9875-35048113d04b None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:44.734921 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a7780-f76b-4026-9875-35048113d04b None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:44.735035 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a7780-f76b-4026-9875-35048113d04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:44.754830 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-2c9a7780-f76b-4026-9875-35048113d04b None None] MFA Rules not processed for user `b9187894d0574f6e887a98b8563b6d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:29:44.757061 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2c9a7780-f76b-4026-9875-35048113d04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:29:44.764252 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4455/8931] 10.222.0.27 () {58 vars in 967 bytes} [Wed Oct 19 02:29:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:29:44.776558 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1cce-a05e-4a9e-b34f-1f05c3e66d7f service nova] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:44.788114 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1cce-a05e-4a9e-b34f-1f05c3e66d7f service nova] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:44.793209 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288110f0-4a4e-4dfd-829f-e1782127bdb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b7394a5d944639b1253d5d54b688e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:44.793819 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288110f0-4a4e-4dfd-829f-e1782127bdb4 service swift] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:44.794102 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288110f0-4a4e-4dfd-829f-e1782127bdb4 service swift] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:44.794379 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288110f0-4a4e-4dfd-829f-e1782127bdb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:44.803199 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288110f0-4a4e-4dfd-829f-e1782127bdb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:44.804834 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288110f0-4a4e-4dfd-829f-e1782127bdb4 service swift] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:44.813144 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4477/8932] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 19 02:29:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:29:54.749940 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=33 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:54.809747 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=25 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:56.644904 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a7780-f76b-4026-9875-35048113d04b None None] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:56.734857 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a7780-f76b-4026-9875-35048113d04b None None] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:56.739384 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:56.739978 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:56.740254 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:56.740525 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] PATH_INFO: `/v3/users/31cee11ce9074305a2420fd576588ac6` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:56.741673 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=31cee11ce9074305a2420fd576588ac6)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:56.743576 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:56.789114 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cee11ce9074305a2420fd576588ac6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:56.801115 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cee11ce9074305a2420fd576588ac6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:56.817329 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cee11ce9074305a2420fd576588ac6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:56.825076 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cee11ce9074305a2420fd576588ac6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:56.825736 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cee11ce9074305a2420fd576588ac6'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:56.831726 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4456/8933] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:29:56 2022] DELETE /identity/v3/users/31cee11ce9074305a2420fd576588ac6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:29:57.007907 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288110f0-4a4e-4dfd-829f-e1782127bdb4 service swift] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:57.018617 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288110f0-4a4e-4dfd-829f-e1782127bdb4 service swift] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:57.078553 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:57.078858 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:57.079140 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:57.079417 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] PATH_INFO: `/v3/projects/8a07543f2a974ab68250790aa05e4457` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:57.080550 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a07543f2a974ab68250790aa05e4457)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:57.082476 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:57.129657 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a07543f2a974ab68250790aa05e4457', 'request_id': 'req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.138664 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a07543f2a974ab68250790aa05e4457', 'request_id': 'req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.144400 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a07543f2a974ab68250790aa05e4457', 'request_id': 'req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.168197 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] The token cache is being invalidate because project 8a07543f2a974ab68250790aa05e4457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:29:57.168489 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.169156 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.170709 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4478/8934] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:29:57 2022] DELETE /identity/v3/projects/8a07543f2a974ab68250790aa05e4457 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:29:57.174711 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:57.176141 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:29:57.190419 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954edba-bbdd-4618-b66f-be0202f540ae admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:57.246839 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:57.247463 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:57.247743 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:57.248016 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] PATH_INFO: `/v3/users/46625554afc440e38002c738652f9984` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:57.249172 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46625554afc440e38002c738652f9984)` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:57.251140 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:57.253349 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:57.299267 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46625554afc440e38002c738652f9984'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.312459 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46625554afc440e38002c738652f9984'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.321896 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46625554afc440e38002c738652f9984'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.329116 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46625554afc440e38002c738652f9984'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.329755 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.notifications [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46625554afc440e38002c738652f9984'} {{(pid=86424) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.336149 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4457/8935] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 02:29:57 2022] DELETE /identity/v3/users/46625554afc440e38002c738652f9984 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:29:57.508568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:29:57.510060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:29:57.524265 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc3662-9cb5-4fe2-8940-5dc4f78ed56f admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:29:57.582568 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eea56facd274e79a70b3efac3a71b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac0b2bfbc95a4438a5a4c53c6936c9e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:29:57.583874 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:29:57.584312 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:29:57.584588 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] PATH_INFO: `/v3/projects/d445770b5d3b40df9abb738ef12b01ef` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:29:57.585728 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d445770b5d3b40df9abb738ef12b01ef)` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:29:57.587633 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:29:57.609889 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:57.635886 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd445770b5d3b40df9abb738ef12b01ef', 'request_id': 'req-7d296379-1e69-4b6a-9616-29586484d8ac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.644651 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd445770b5d3b40df9abb738ef12b01ef', 'request_id': 'req-7d296379-1e69-4b6a-9616-29586484d8ac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.651176 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd445770b5d3b40df9abb738ef12b01ef', 'request_id': 'req-7d296379-1e69-4b6a-9616-29586484d8ac'} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.662438 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] The token cache is being invalidate because project d445770b5d3b40df9abb738ef12b01ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:29:57.662730 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.663416 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.notifications [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:29:57.665111 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4479/8936] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 02:29:57 2022] DELETE /identity/v3/projects/d445770b5d3b40df9abb738ef12b01ef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:30:07.332194 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:30:07.659138 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:30:33.276065 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:33.277508 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:33.347611 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89674a-0ebb-448d-9b5d-3ed6ab07f0a2 admin admin] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:33.407100 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c08334-59b0-4088-aa0a-4744e5449831 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:33.407702 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c08334-59b0-4088-aa0a-4744e5449831 service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:33.407985 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c08334-59b0-4088-aa0a-4744e5449831 service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:33.408287 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c08334-59b0-4088-aa0a-4744e5449831 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:33.410148 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-c4c08334-59b0-4088-aa0a-4744e5449831 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:33.421613 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c08334-59b0-4088-aa0a-4744e5449831 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:33.423177 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c08334-59b0-4088-aa0a-4744e5449831 service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:33.433432 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4458/8937] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:30:43.429321 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=58 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:31:12.118444 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:31:12.119860 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:31:12.139003 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d296379-1e69-4b6a-9616-29586484d8ac admin admin] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:31:12.144060 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d9a3e-e763-4bcc-89f0-f8c0d44b2e05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:31:12.144695 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d9a3e-e763-4bcc-89f0-f8c0d44b2e05 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:31:12.144981 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d9a3e-e763-4bcc-89f0-f8c0d44b2e05 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:31:12.145257 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d9a3e-e763-4bcc-89f0-f8c0d44b2e05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:31:12.147857 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.fernet_utils [None req-f12d9a3e-e763-4bcc-89f0-f8c0d44b2e05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:31:12.164145 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d9a3e-e763-4bcc-89f0-f8c0d44b2e05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:31:12.165752 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d9a3e-e763-4bcc-89f0-f8c0d44b2e05 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:31:12.175607 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4480/8938] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:31:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:31:22.171414 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:38.286379 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c08334-59b0-4088-aa0a-4744e5449831 service placement] Authenticating user token {{(pid=86424) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:38.337396 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c08334-59b0-4088-aa0a-4744e5449831 service placement] Validating token access rules against request {{(pid=86424) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:38.342971 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6aa8a-ce4e-4825-9dc1-bdbb8a2b4c7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86424) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:38.343561 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6aa8a-ce4e-4825-9dc1-bdbb8a2b4c7f service placement] REQUEST_METHOD: `GET` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:38.343840 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6aa8a-ce4e-4825-9dc1-bdbb8a2b4c7f service placement] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:38.344113 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6aa8a-ce4e-4825-9dc1-bdbb8a2b4c7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:38.352372 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6aa8a-ce4e-4825-9dc1-bdbb8a2b4c7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:38.353981 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6aa8a-ce4e-4825-9dc1-bdbb8a2b4c7f service placement] RBAC: Authorization granted {{(pid=86424) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:38.363662 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4459/8939] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:48.359610 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=24 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:36:15.158103 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d9a3e-e763-4bcc-89f0-f8c0d44b2e05 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:36:15.219242 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d9a3e-e763-4bcc-89f0-f8c0d44b2e05 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:36:15.224551 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3d3a5-7d34-4677-90f3-43a0d075ead7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:36:15.225211 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3d3a5-7d34-4677-90f3-43a0d075ead7 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:15.225647 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3d3a5-7d34-4677-90f3-43a0d075ead7 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:15.225926 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3d3a5-7d34-4677-90f3-43a0d075ead7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:15.234815 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3d3a5-7d34-4677-90f3-43a0d075ead7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:36:15.236470 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3d3a5-7d34-4677-90f3-43a0d075ead7 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:36:15.246188 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4481/8940] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:36:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:36:25.242153 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=27 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:37:42.280885 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a34e27-b9c5-443f-9fb2-b8c37391e04f None None] REQUEST_METHOD: `POST` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:42.281486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a34e27-b9c5-443f-9fb2-b8c37391e04f None None] SCRIPT_NAME: `/identity` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:42.281486 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a34e27-b9c5-443f-9fb2-b8c37391e04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86424) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:42.361821 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.auth.core [None req-34a34e27-b9c5-443f-9fb2-b8c37391e04f None None] MFA Rules not processed for user `0a618510905146ceadcdddc97187e364`. Rule list: `[]` (Enabled: `True`). {{(pid=86424) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:37:42.363023 n-d-master-1 devstack@keystone.service[86424]: DEBUG keystone.common.fernet_utils [None req-34a34e27-b9c5-443f-9fb2-b8c37391e04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86424) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:42.372476 n-d-master-1 devstack@keystone.service[86424]: [pid: 86424|app: 0|req: 4460/8941] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Oct 19 02:37:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:37:42.389177 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3d3a5-7d34-4677-90f3-43a0d075ead7 service placement] Authenticating user token {{(pid=86425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:37:42.400147 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3d3a5-7d34-4677-90f3-43a0d075ead7 service placement] Validating token access rules against request {{(pid=86425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:37:42.405278 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78305375-d276-44b9-8c19-7de822d99115 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a618510905146ceadcdddc97187e364', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f743cd924f045c2a026670ff8d6a5ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:37:42.405891 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78305375-d276-44b9-8c19-7de822d99115 service placement] REQUEST_METHOD: `GET` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:42.406173 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78305375-d276-44b9-8c19-7de822d99115 service placement] SCRIPT_NAME: `/identity` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:42.406448 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78305375-d276-44b9-8c19-7de822d99115 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:42.415331 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78305375-d276-44b9-8c19-7de822d99115 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:37:42.416944 n-d-master-1 devstack@keystone.service[86425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78305375-d276-44b9-8c19-7de822d99115 service placement] RBAC: Authorization granted {{(pid=86425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:37:42.426859 n-d-master-1 devstack@keystone.service[86425]: [pid: 86425|app: 0|req: 4482/8942] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 19 02:37:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:37:52.359188 n-d-master-1 devstack@keystone.service[86424]: DEBUG dbcounter [-] [86424] Writing DB stats keystone:SELECT=26 {{(pid=86424) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:37:52.422480 n-d-master-1 devstack@keystone.service[86425]: DEBUG dbcounter [-] [86425] Writing DB stats keystone:SELECT=6 {{(pid=86425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}